JP2005318347A - Imaging device, and image recording method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily confirm an angle of view on the person side as a subject while displaying an image effect-processed on the cameraman side by a monitor. <P>SOLUTION: When the kind of either effect is selected, an effected through-image selected at a step S103 is displayed on a main display unit (S104), while the through image not effected is displayed on a sub-display unit (S105). Accordingly, a user compares the image displayed on the main display unit and the image displayed on a sub-display unit with eyes, and can confirm whether or not there is a difference in any extent between both images or whether or not the effected image is excellent before the image is recorded. When the user operates a decision key when the effected image is decided to be excellent as the result of the confirmation, the decision of S106 reaches YES, and the effected image is conserved (S107). <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging apparatus, an image recording method, and an image recording program for displaying an image of a subject and recording the image on a recording medium.

Today, it not only functions to capture and record the subject image as it is, but also changes the tone of the subject image to monochrome / sepia, and records with special effects (effects) such as mosaic effect and frame composition. An imaging device has been proposed (see, for example, Patent Document 1). In this imaging apparatus, when an effect mode for giving a special effect to a captured image is set, the image data obtained by the imaging unit and DMA-transferred is subjected to effect processing, and the image data after the effect processing is supplied to the monitor display unit. The Therefore, for example, when the effect is processing that emphasizes the skin color, the subject image with the skin color enhanced is displayed on the monitor. In addition, an effect-processed image such as an image with enhanced skin color can be recorded in a memory by a user's shutter operation.
JP 2002-344870 A

  However, in the above-described imaging device, particularly when performing human photographing or the like, the monitor display means performs the photographing confirmation by displaying the image subjected to the effect processing toward the person as the subject. When there is only one, the angle is moved every time recording is performed, and there is a problem that an image desired by the subject cannot be recorded.

  In order to solve this problem, if a monitor display means for confirming the angle of view on the subject side is further provided, there is a problem that it is difficult to confirm the angle of view of the shooting with the effect-processed image.

  The present invention has been made in view of such a conventional problem, and an image pickup apparatus that allows an angle of view to be easily confirmed on a person who is a subject while displaying an image subjected to effect processing on the photographer on a monitor, An object of the present invention is to provide an image recording method and an image recording program.

  In order to solve the above-mentioned problem, in the imaging apparatus according to the first aspect of the present invention, the imaging means, the first display means, and the first display means are provided at positions where the display directions face each other. The second display means and images sequentially taken by the imaging means are displayed on the first display means, and a special effect is given to the sequentially taken images and displayed on the second display means. Display control means for instructing, instruction means for instructing recording of the image, and recording for recording image data based on the image displayed on the second display means when the instruction means instructs recording of the image Means.

  Therefore, when a person is imaged by this imaging apparatus, the first display means displays a person image that is not given a special effect and is sequentially taken by the imaging means, and the second display means A person image with a special effect is displayed. At this time, since the second display means is provided at a position where the display direction faces the first display means, an image to which a special effect is given on the photographer side is displayed on the second display means. On the other hand, the angle of view can be easily confirmed by the first display means on the person side as the subject.

  In the imaging apparatus according to the second aspect of the present invention, the display direction of the first display unit and the imaging direction of the imaging unit are substantially parallel. Accordingly, since only the image displayed on the first display means to which the special effect is not given can be visually recognized from the person being imaged, it is recognized that the person is taking an image with the special effect added. It cannot be done, and it is recognized as normal imaging. When an operation is performed, an image with a special effect is recorded, so that when the recorded image is played back, it can be seen that the user's own image was captured with the special effect for the first time. Therefore, it is possible to generate interest in the person image by surprise when the person visually recognizes the image to which the special effect is given.

  In the invention according to claim 3, the imaging unit, the first display unit, the second display unit provided at a position where the display direction faces the first display unit, an operation unit, and An image recording method in an imaging device including a memory, wherein images sequentially captured by the imaging unit are displayed on the first display unit, and a special effect is applied to the sequentially captured images. A display control step for displaying on the second display unit; an instruction step for instructing recording of an image by detecting a predetermined operation from the operation unit during display by the display control step; and When the recording of the image is instructed, the recording step of recording in the memory the image data based on the image displayed on the second display unit. Therefore, by performing the processing according to the described steps, the same effects as those of the first aspect of the invention can be obtained.

  In the image recording program according to the fourth aspect of the present invention, the imaging unit, the first display unit, and the second display unit provided at a position where the display direction faces the first display unit. , An operation unit, and a computer included in an imaging device including a memory display images sequentially captured by the imaging unit on the first display unit, and also give special effects to the sequentially captured images. Display control means to be displayed on the second display section, instruction means for instructing recording of an image by detecting a predetermined operation from the operation section, and recording of an image by the instruction means is instructed And functioning as recording means for recording image data based on the image displayed on the second display section in the memory. Therefore, when the computer executes processing according to this program, the same effects as those of the first aspect of the invention can be obtained.

  As described above, according to the first, third, and fourth aspects of the present invention, the image on which the special effect is given on the photographer side is displayed on the second display means, while the person who is the subject has the first The display means can easily confirm the angle of view.

  Furthermore, according to the second aspect of the present invention, since only the image that has not been given the special effect displayed on the first display means can be viewed from the person being imaged, When replayed, it can be seen that for the first time, his / her image was captured with a special effect. Therefore, it is possible to generate interest in the person image by surprise when the person visually recognizes the image to which the special effect is given.

  Embodiments in which the present invention is applied to a mobile phone will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is an external view (open state: front view and rear view) of a mobile phone (imaging device) 1 that is common to each embodiment of the present invention. It is a two-fold structure. The antenna 103 is provided on the back surface of the main body 12 and is extendable. The speaker 101 is provided on the front side of the lid portion 11 and outputs sound. The main display unit 102 is a QVGA color liquid crystal, and is disposed at a substantially central portion on the front surface of the lid unit 11.

  On the front surface of the main body 12, there are a camera key 104, a mail key 105, a cross key 106, an enter key 107, an address key 108, a net connection key 109, a clear key 110, an on-hook key 111 and an off-hook key 112, a numeric key 113, and the like. Is provided. Among these keys, a cross key 106, an enter key 107, an address key 108, and a network connection key 109 are arranged at positions that can be operated with the thumb of the right hand when the mobile phone 1 is held with the right hand.

  The camera key 104 is operated at the time of transition from the incoming standby state to the shooting mode and when the imaging unit is activated, and is used for camera-movie switching. The mail key 105 is a key that is operated when the mail mode is shifted and when the mail program is loaded. The cross key 106 is operated when the cursor is moved, the enter key 107 is operated when various modes (such as an effect mode described later) are determined, and in the present embodiment, the enter key 107 functions as a shutter key in the shooting mode. To do.

  The address key 108 is a key operated when displaying address book data, and the network connection key 109 is an operation key for external network connection. The clear key 110 is a cancel instruction key, and the numeric key 113 is used for character input and dial input, and is configured with keys [0] to [9]. The microphone 114 is provided in the lower part of the main body 12 and performs voice input during a call.

  In addition, on the back surface of the lid portion 11, a recording microphone 115, a sub display unit 116 made of color liquid crystal, a notification LED 117 that emits light when receiving a call, an imaging lens 118 as an optical system, and a flash LED 119 are arranged. Yes. An informing speaker 120 is disposed on the back surface of the main body 12. This notification speaker 120 is used to notify an incoming call or the like, and is arranged on the back surface of the main body 12 so that a notification sound can be heard even when the lid 11 is closed to the main body 12.

  FIG. 2 is a block diagram showing the configuration of the mobile phone 1. The wireless unit 121 is connected to the antenna 103 and performs communication processing including modulation / demodulation based on the QPSK method and terminal authentication processing based on the CDMA method. The control unit 122 controls the device and performs WWW connection control, and measures the current time based on the communication data processing unit 1221, the system ROM 1222, the audio interface 1223, and a built-in clock (not shown). The time counter 1224 is provided.

  The communication data processing unit 1221 includes a CLEP speech decoding / encoding processing circuit, a packet data generation circuit, and a packet data restoration circuit, and performs data processing according to a communication protocol. The system ROM 1222 stores a basic system such as an OS. The audio interface 1223 inputs and outputs audio signals processed by the communication data processing unit 1221. The speaker 101, the microphone 114, and the recording microphone 115 are connected to the audio interface 1223. The input unit includes the camera key 104 to the numeric key 113.

  The address / data bus processing unit 123 controls / manages data input / output timing and the like between the control unit 122 and peripheral circuits (circuits within a broken line frame). The RAM 124 stores various data generated in the device such as address book data and mail data. A program ROM (NOR Flash) 125 stores various application programs and the like, and particularly in this embodiment, a camera application including a program and the like for performing compression encoding processing on image data digitized by the DSP 129. Remember. The sound source IC 126 stores and outputs the waveform of the notification sound. The amplifier 127 amplifies the output from the sound source IC 126, and the notification speaker 120 reproduces it.

  The display module system driver 128 drives the main display unit 102, the sub display unit 116, the notification LED 117, and the flash LED 119. The imaging device 130 is composed of a CCD or the like on which a subject image is formed through the diaphragm 132 by the imaging lens 118. The DSP 129 converts the image signal from the imaging device 130 into a digital signal. Based on the digital signal processed image data, the display module driver drives the main display unit 102 to display the subject image formed on the imaging device 130 on the main display unit 102 and the shutter. The image data of the subject image is recorded in an image memory 1243, which will be described later, with the operation (operation of the enter key 107).

  The DSP 129 constitutes effect processing means in the present embodiment. In the effect mode described later, the DSP 129 converts the image signal from the imaging device 130 to the through image data obtained by performing only the digital signal processing and the digital signal. Output image data with special effects (effect processing). Based on the image data to which the special effect is applied, the display module driver drives the main display unit 102, whereby an image with the special effect is displayed on the main display unit 102. Further, the display module driver drives the sub display unit 116 based on the through image data, whereby an image of the through image data itself is displayed on the sub display unit 116. Then, the image data to which the special effect is given in accordance with the shutter operation (operation of the enter key 107) is recorded in an image memory 1243 described later.

  The imaging lens 118 is held by a drive mechanism (not shown) including a step motor for autofocus control. Then, in response to a control signal based on contrast detection passive AF from the control unit 122, the drive signal output from the AF driver 131 is supplied to the drive mechanism, thereby moving the imaging lens 118 back and forth on the optical axis. Thus, the focusing operation is performed. The aperture 132 is a fixed type in which an aperture value capable of pan focus is set.

  FIG. 3 is a conceptual diagram showing the configuration of the memory area of the program ROM 125. The program ROM 125 has a software program storage area 1251 and other storage areas 1252. The software program storage area 1251 stores a camera application that is a feature of the present embodiment, and the other storage area 1252 stores other applications.

  FIG. 4 is a conceptual diagram showing the configuration of the memory area of the RAM 124. The RAM 124 includes an address book storage area 1241, a mail data storage area 1242, an image memory 1243, and other work areas 1244. The address book storage area 1241 stores a plurality of names, telephone numbers, mail addresses, etc. as one record. The mail data storage area 1242 stores mail data created using mail software and received mail data. The image memory 1243 stores an image file of a captured image. The other work area 1244 stores various data as work memory.

  Next, the operation of the mobile phone 1 according to the above configuration will be described. In the incoming call waiting state, the mobile phone 1 functions in the same manner as a general mobile phone. That is, as described above, the mail key 105 functions as a key that is operated when the mail mode is shifted and when the mail program is loaded, and the address key 108 functions as a key that is operated when displaying address book data. The network connection key 109 functions as an operation key for external network connection, and the numeric key 113 functions as a character input and dial input key.

  When the user operates the camera key 104 to set the camera mode in the shooting mode in order to take a still image with the mobile phone 1, the control unit 122 shifts to the camera mode and is stored in the software program storage area 1251. The camera application is loaded and processing is executed according to the flowchart shown in FIG.

  First, in the camera mode, it is determined whether or not an effect mode for monitoring and displaying image data with a special effect is set (step S101). If the effect mode is not set, the process proceeds to a normal camera mode process. To do. If the effect mode is selected, a special effect selection screen is displayed on the main display unit 102 (step S102). Here, the special effects in the present embodiment are “don't face”, “face-to-face”, “mosaic”, and “nose-rolling” that apply an effect to a human face image, as will be described later. Therefore, when the user selects the effect mode at the time of photographing a person, these special effects prepared in advance are displayed on the main display unit 102 and waits until one is selected (step S103). If any special effect is selected, a through image to which the special effect selected in step S103 is added is displayed on the main display unit 102 (step S104), while the sub display unit 116 displays A through image without a special effect is displayed (step S105).

  In other words, as described above, the DSP 129 is controlled to convert the image signal from the imaging device 130 into a digital signal, and the digital signal is subjected to the selected special effect and the image signal from the imaging device 130 is processed. Through image data that has undergone only digital signal processing is output. Then, based on the image data to which the special effect is given, the main display unit 102 is driven by the display module system driver, thereby displaying the image to which the special effect is given on the main display unit 102 (step S104). Accordingly, as a result of the processing in step S104, as shown in FIG. 6, the main display unit 102 displays an image E1 to which a special effect such as “don't face” is added. Further, when another special effect is selected, any of the images E2, E3, and E4 to which the selected special effect is given is displayed.

  On the other hand, based on the through image data output from the DSP 129, the main display unit 102 is driven by the display module system driver, thereby causing the sub display unit 116 to display an image to which no special effect is given (step S105). Therefore, as a result of the processing in step S105, as shown in FIG. 7, the sub display unit 116 displays the image P of the person part that is the subject.

  Therefore, the user can view the image E1 (E2, E3, E4) displayed on the main display unit 102 on the front side while holding the current shooting position of the mobile phone 1 to display an image with a special effect. On the other hand, on the subject side, it is possible to confirm the angle of view taken by the image P displayed on the sub-display unit 116 on the back side.

  If the user determines that the image data with the special effect is better as a result of the confirmation, the enter key 107 operates the operation. Then, the determination in step S106 is YES, and the image data to which the special effect is added is saved (step S107). That is, the image data of the image E1 displayed on the main display unit 102 is compression-coded by the camera application to generate an image file, and this image file is stored in the image memory 1243.

  In this way, when a person is imaged with the mobile phone 1, the effect-processed image E1 of the person is arranged on the front surface, which is the surface opposite to the person side to which the imaging lens 118 is directed. The image P displayed on the sub display unit 116 and not subjected to the effect processing is displayed on the sub display unit 116 disposed on the back surface, which is the person side surface to which the imaging lens 118 is directed.

  In this embodiment, when the enter key 107 is operated, an image to which a special effect is added is immediately saved. This image to be saved is temporarily displayed on the main display unit 102, and thereafter You may make it preserve | save according to predetermined operation.

(Second Embodiment)
FIG. 8 is a flowchart showing a processing procedure in the second embodiment of the present invention. When the user operates the camera key 104 to set the movie mode in the shooting mode in order to shoot a movie with the mobile phone 1, the control unit 122 shifts to the movie mode, and the camera application stored in the software program storage area 1251 is displayed. Loaded and executed according to the flowchart shown in FIG.

  First, it is determined whether or not the effect mode has been set in the movie mode as in the first embodiment (step S201). If the effect mode has not been set, the routine proceeds to normal movie mode processing. . If the effect mode is selected, the main display unit 102 sequentially displays a through image with a special effect (step S202), while the sub display unit 116 displays a through image without a special effect. (Step S203).

Here, as described above, the types of special effects in the present embodiment are “don't face”, “face-to-face”, “mosaic”, and “nose-rolling” that give a special effect to a human face image. Therefore, when the user selects the effect mode at the time of photographing a person, the image data provided by changing the special effect at every predetermined timing and the through image data obtained by performing only the digital signal processing on the image signal from the imaging device 130 are obtained. The DSP 129 is output. Then, the main display unit 102 is driven by the display module system driver based on the image data to which the special effect has been applied, so that the main display unit 102 has images E1 → E3 to which the special effect has been applied as shown in FIG. → E4 → E2 is displayed. On the other hand, by driving the main display unit 102 by the display module system driver based on the through image data output from the DSP 129, as shown in FIG. An image P of the person part is displayed.
Therefore, the user holds the current shooting position of the mobile phone 1 and sees the image E1 → E3 → E4 → E2 displayed on the main display unit 102 on the front side to change, thereby providing a moving image with a special effect. On the other hand, on the subject side, it is possible to confirm the angle of view taken by the image P displayed on the sub-display unit 116 on the back side.

  If the user determines that it is better to give a special effect as a result of the confirmation, the enter key 107 operates the operation. Then, the determination in step S204 is YES, and the moving image data to which the special effect is added is accumulated in the other work area 1244 of the RAM 124 (step S205). Further, it is determined whether or not the enter key 107 is operated again (step S206), and the accumulation of the moving image data in the other work area 1244 is continued until the enter key 107 is operated again.

  Then, when the user operates the enter key 107 again to end the moving image shooting, the moving image shooting ends, and the moving image data composed of a plurality of frames stored in the other work area 1244 is compressed and encoded by the camera application. The moving image file is generated by processing, and the moving image file is recorded in the image memory 1243 (step S207). Therefore, it is possible to prevent the inconvenience of recording moving image data that seems to be better for the user not to give special effects.

  In the present embodiment, the case where the present invention is applied to a mobile phone is shown. However, the present invention is not limited to this and is applied to other devices having an imaging function such as a PDA, a digital camera alone, and a portable game machine. Of course you get.

(A) is a front view of a mobile phone common to each embodiment of the present invention, and (b) is a rear view. It is a block diagram which shows the structure of a mobile telephone. It is a conceptual diagram which shows the structure of the memory area of program ROM. It is a conceptual diagram which shows the structure of the memory area of RAM. It is a flowchart which shows the process sequence in the 1st Embodiment of this invention. It is a figure which shows the example of a display screen of the main display part in the embodiment. It is a figure which shows the example of a display screen of the sub display part in the embodiment and 2nd Embodiment. It is a flowchart which shows the process sequence in the 2nd Embodiment of this invention. It is a figure which shows the example of a main display part display screen in the embodiment.

Explanation of symbols

1 Mobile phone (imaging device)
102 Main display section (second display means, second display section)
104 Camera key 107 Enter key (instruction means, operation unit)
113 Numeric keys 116 Sub display section (first display means, first display section)
118 Imaging lens (imaging means, imaging unit)
122 Control unit (display control means)
123 Data bus processing unit 124 RAM
125 program ROM
128 Display module system driver (display control means, recording means)
129 DSP
130 Imaging device (imaging means, imaging unit)
131 AF driver 1021 Magnification value 1241 Address book storage area 1242 Mail data storage area 1243 Image memory (recording means, memory)
1244 Work area 1251 Software program storage area

Claims (4)

Imaging means;
First display means;
The first display means is a second display means provided at a position where the display direction is directly opposite,
Display control means for causing the first display means to display images sequentially captured by the imaging means, and to display special images on the sequentially captured images to be displayed on the second display means;
Instruction means for instructing recording of the image;
An image pickup apparatus comprising: a recording unit that records image data based on an image displayed on the second display unit when recording of an image is instructed by the instruction unit.   The imaging apparatus according to claim 1, wherein a display direction of the first display unit and an imaging direction by the imaging unit are substantially parallel. The imaging unit, the first display unit, and the first display unit are an image recording method in an imaging apparatus including a second display unit, an operation unit, and a memory provided at a position where the display direction is directly opposed. And
A display control step of causing the first display unit to display images that are sequentially captured by the imaging unit, and providing a special effect to the sequentially captured images to be displayed on the second display unit;
An instruction step for instructing recording of an image by detecting a predetermined operation from the operation unit during display by the display control step;
An image recording method comprising: a recording step of recording image data based on an image displayed on the second display unit in a memory when image recording is instructed in the instruction step. An imaging unit, a first display unit, a computer included in an imaging apparatus including a second display unit, an operation unit, and a memory provided at a position where the display direction faces the first display unit,
Display control means for causing the first display unit to display images sequentially captured by the imaging unit, and to display a special effect on the sequentially captured images to be displayed on the second display unit;
Instruction means for instructing recording of an image by detecting a predetermined operation from the operation unit;
An image recording program for causing an image data based on an image displayed on the second display section to be recorded in a memory when an instruction to record an image by the instruction unit is given.

Images