JP2013115691A - Imaging apparatus and control program for use in imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of easily selecting and overlapping appropriate object images corresponding to a moving image being imaged.SOLUTION: On a screen 304s, a moving image Imv is displayed. An effect mode initial image Iem1 which is one of effect execution images is displayed on a part of an area in the screen 304s so as not to cover the entire moving image Imv. When an operation to overlap an object image onto an object image overlapping area in the moving image Imv is made, the object image is overlapped. Even when a setting button Bs is pressed to perform an operation of selecting any one of plural types of object images, a size of the effect execution image is maintained to the size of not covering the entire moving image Imv.

Description

  The present invention relates to an imaging apparatus capable of superimposing an object image on a captured image and a control program used for the imaging apparatus.

  There is known an imaging apparatus capable of superimposing an object image such as a figure or a character on a captured image obtained by capturing a still image and storing the captured image on which the object image is superimposed. Patent Document 1 describes that a still image captured in advance is displayed on a display unit, a handwritten object image is superimposed on the still image, and a still image on which the object image is superimposed is recorded. Patent Document 2 describes that a hand-drawn object image is superimposed on an image displayed on a display unit, and the object image is recorded in association with a still image as additional data such as XML data.

JP 2005-184778 A JP 2006-211356 A

  Even in an imaging apparatus that records and reproduces a moving image, the object image is converted into a moving image so that the moving image can be recorded by superimposing the object image on the captured image that is a moving image or the moving image on which the object image is superimposed can be reproduced. It is desirable to record in correspondence. A moving image differs from a still image in that the captured image changes every moment, so an appropriate object image can be selected according to the changing captured image, and the appropriate position of the captured image can be checked while checking the changing captured image. An imaging device that can superimpose an object image on the image is required.

  In order to meet such a demand, the present invention can easily select an appropriate object image corresponding to a moving image being captured, and can check an appropriate position of the moving image while checking the moving image being captured. An object of the present invention is to provide an imaging apparatus capable of superimposing an object image on the image and a control program used for the imaging apparatus.

  In order to solve the above-described problems of the related art, the present invention provides an image capturing unit (100) that captures a moving image (Imv) of a subject and the moving image captured by the image capturing unit on a screen (304s). A display unit (304) for displaying, an object image storage unit (405) for storing a plurality of types of object images to be superimposed on the moving image displayed on the screen, and the moving image displayed on the screen An image indicating that the effect mode is to superimpose the object image on an image, and includes a first selection button for selecting any one of the plurality of types of object images, and the moving image An effect execution image generation unit (404) for generating an effect execution image to be displayed in a partial area of the screen so as not to cover the entire image; An effect execution image superimposing unit (2020) that superimposes the effect execution image on the moving image displayed on the screen, and the effect execution on an object image superimposing area that is an area where the object image in the moving image is superimposed An object image superimposing unit (2020) that superimposes the selected object image stored in the object image storage unit when a predetermined operation is performed to superimpose an object image of a type selected by an image. The effect execution image generation unit maintains the size of the effect execution image at a size that does not cover the entire moving image even when an operation is performed on the first selection button. An imaging device (1) is provided.

  In the imaging apparatus, it is preferable that the object image superimposing unit sets an area where the moving image is displayed excluding an area where the effect execution image is superimposed on the screen as the object image superimposing area.

  In the imaging apparatus, the effect execution image generation unit generates an image including a second selection button for selecting a size of the object image as the effect execution image, and performs an operation on the second selection button. Even when an operation for selecting the size of the object image is performed, it is preferable to maintain the size of the effect execution image at a size that does not cover the entire moving image.

  In the imaging apparatus, the effect execution image generation unit permits the object image to be superimposed on the object image overlap area as the effect execution image, and shifts to an image for selecting the type or size of the object image. A first execution image (Iem1) including a setting button for displaying, and an image to be displayed when the setting button is operated, including the first selection button or the second selection button, And a second execution image (Iem2) having the same size as the execution image of the first image, and the effect execution image superimposing unit superimposes the first and second execution images on the same position on the screen. Is preferred.

  In the imaging apparatus, the moving image displayed on the screen in a state where the object image is superimposed, the object image combined with the moving image, or the moving image using the object image as additional data It is preferable to include a recording unit (302) for recording in a state multiplexed with an image.

  In order to solve the above-described problems of the conventional technique, the present invention provides a moving image (Imv) displayed on the screen (304s) with respect to the computer (400) mounted on the imaging device (1). Is an effect mode for superimposing an object image on the image, and includes an image including a first selection button for selecting one of a plurality of types of object images, and the entire moving image Generating an effect execution image to be displayed in a partial area of the screen so as not to cover the image, superimposing the effect execution image on the moving image displayed on the screen, and the moving image in the moving image An object image superimposition area, which is an area on which an object image is superimposed, is used as the object image superimposition area in the moving image. When the predetermined operation of superimposing the object image of the type selected by the effect execution image is performed on the image, the step of superimposing the selected object image is executed to generate the effect execution image The step is a control used for an imaging apparatus, wherein the size of the effect execution image is maintained at a size that does not cover the entire moving image even when an operation is performed on the first selection button. Provide a program.

  In the control program used for the imaging apparatus, the step of superimposing the selected object image includes, in the object image, an area where the moving image is displayed excluding an area where the effect execution image is superimposed on the screen. It is preferable to superimpose the selected object image as a superimposition area.

  In the control program used for the imaging apparatus, the step of generating the effect execution image generates an image including a second selection button for selecting a size of the object image as the effect execution image, Even when an operation for selecting the size of the object image is performed by an operation on the selection button 2, it is preferable to maintain the size of the effect execution image at a size that does not cover the entire moving image.

  In the control program used for the imaging apparatus, the step of generating the effect execution image permits the object image to be superimposed on the object image overlap area as the effect execution image, and sets the type or size of the object image. A first execution image (Iem1) including a setting button for shifting to an image to be selected, and an image to be displayed when the setting button is operated; the first selection button or the second selection button And generating a second execution image (Iem2) having the same size as the first execution image and superimposing the effect execution image, the first and second execution images are It is preferable to superimpose at the same position on the screen.

  In the control program used for the imaging apparatus, the moving image displayed on the screen in a state where the object image is superimposed on the computer and the object image combined with the moving image, or Preferably, the step of causing the recording unit (302) to record the object image in a state of being multiplexed with the moving image as additional data is further executed.

  According to the imaging apparatus and the control program used for the imaging apparatus of the present invention, it is possible to easily select an appropriate object image corresponding to the moving image being captured, and to check the moving image while checking the moving image being captured. It is possible to superimpose the object image at an appropriate position.

It is a block diagram showing one embodiment of an imaging device of the present invention. It is a flowchart which shows the operation | movement at the time of transfering to an effect mode. It is a flowchart which shows the operation | movement at the time of effect mode. It is a flowchart which shows the operation | movement at the time of effect mode. It is a flowchart which shows the specific operation | movement of step S15, S36 of FIG. FIG. 10 is a diagram showing a state in which an effect mode initial image Iem1 which is one of effect execution images is displayed in the effect mode. It is a figure which shows the state which displayed the effect selection menu image Iem2 which is one of the effect execution images in the effect mode. FIG. 8 is a diagram showing a state in which an effect selection menu image Iem2 which is one of effect execution images is displayed in an effect mode, and an object button different from FIG. 7 is selected. FIG. 14 is a diagram showing a state in which a size selection menu image Iem3 that is one of effect execution images is displayed in the effect mode. FIG. 10 is a diagram showing a state in which a size selection menu image Iem3 which is one of effect execution images is displayed in an effect mode, and a size different from that in FIG. 9 is selected. FIG. 18 is a diagram showing a state where an object image Io1 is moved by dragging a finger on the screen 304s in the effect mode. FIG. 19 is a diagram showing a state in which an effect mode image Iem4 is displayed by superimposing an object image Io1 on a moving image Imv displayed on a screen 304s in the effect mode. FIG. 12 is a diagram showing a state in which an effect mode image Iem4 ′ is displayed by pressing an on / off button Bnf in the effect mode image Iem4 of FIG. 11. FIG. 12 is a diagram showing a state in which an effect mode image Iem5 is displayed by pressing the delete button Bdl in the effect mode image Iem4 of FIG. It is a figure which shows the example of a dynamic object image. It is a figure which shows the state which entered the area of the effect mode image Iem4 when a finger is dragged on the screen 304s in the effect mode. It is a flowchart which shows the preferable operation | movement at the time of an effect mode. It is a figure which shows the display state of object image Io1 when a finger | toe enters into the area of effect mode image Iem4 when a finger is dragged on screen 304s in effect mode. It is a figure which shows the display state of the object image Io1 when a finger is dragged within the area of the effect mode image Iem4 in the effect mode.

  Hereinafter, an embodiment of an imaging apparatus and a control program used for the imaging apparatus of the present invention will be described with reference to the accompanying drawings. An imaging apparatus 1 according to an embodiment shown in FIG. 1 is a so-called digital video camera. The imaging device of the present invention is not limited to a digital video camera, and may be any imaging device that can capture a moving image. The imaging device is an arbitrary electronic device that can capture a moving image such as a digital still camera such as a so-called compact digital camera, a mobile phone, or a PDA (Personal Digital Assistant).

  In FIG. 1, a central control unit 400 is configured by a semiconductor integrated circuit including a CPU, a ROM storing various programs, a RAM as a work area, and the like. The central control unit 400 can be constituted by a microcomputer. The central control unit 400 controls each unit in the imaging apparatus 1. The central control unit 400 includes an object image reading unit 401, an icon reading unit 402, an object image adjustment unit 403, and an effect execution image generation unit 404. The operations of the object image reading unit 401 to the effect execution image generating unit 404 will be described later.

  The imaging unit 100 includes a zoom lens 101, a focus lens 102, a diaphragm 103, and an imaging element 104. The zoom lens 101 is moved along the optical axis LA by a zoom actuator (not shown). Similarly, the focus lens 102 moves along the optical axis LA by a focus actuator (not shown). The aperture 103 is driven by an aperture actuator (not shown) to control the size of the aperture through which light passes. The image sensor 104 is configured by a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS), or the like.

  The image sensor 104 photoelectrically converts light that has passed through the zoom lens 101, the focus lens 102, and the aperture 103 to generate an analog image signal of the subject. The analog image signal processing unit 105 amplifies the analog image signal output from the image sensor 104, and the A / D conversion unit 106 converts the amplified analog image signal into digital image data. The image input controller 107 takes in the digital image data output from the A / D conversion unit 106 as imaging data and stores it in the main memory 206 via the bus 200.

  The digital signal processing unit 108 takes in the imaging data stored in the main memory 206 according to an instruction from the central control unit 400 via the bus 200, performs predetermined signal processing, and outputs data including a luminance signal and a color difference signal. Generate. The digital signal processing unit 108 performs various digital signal processing such as offset processing, white balance adjustment processing, gamma correction processing, RGB interpolation processing, noise reduction processing, contour correction processing, color tone correction processing, and light source type determination processing. .

  The microphone 109 picks up the sound around the imaging apparatus 1 and generates an analog sound signal. The analog audio signal processing unit 110 amplifies the analog audio signal output from the microphone 109, and the A / D conversion unit 111 converts the amplified analog audio signal into digital audio data. The audio input controller 112 takes in the digital audio data output from the A / D conversion unit 111 and stores it in the main memory 206 in a state corresponding to the imaging data via the bus 200.

  The compression / decompression processing unit 201 performs predetermined compression processing on the captured image data and digital audio data in accordance with an instruction from the central control unit 400 via the bus 200 to generate compressed data. The compression / decompression processing unit 201 generates uncompressed data by performing a predetermined format decompression process on the compressed data stored in the card-type recording medium 302, which is an example of a recording unit, in accordance with an instruction from the central control unit 400. To do. As the predetermined compression processing, a compression method based on the JPEG standard can be adopted for still images, and MPEG2 standard or AVC / H. A compression method compliant with the H.264 standard can be employed.

  The image processing unit 202 performs predetermined image processing on the imaging data read from the main memory 206 in accordance with an instruction from the central control unit 400 via the bus 200. Specifically, the image processing unit 202 generates OSD (on-screen display) image data such as a menu image and superimposes the image data on the captured image data. In addition, the image processing unit 202 includes an object image / effect execution image superimposing unit 2020 that superimposes an object image and an effect execution image described later.

  The ROM 203 is connected to the central control unit 400 via the bus 200 and stores a control program executed by the central control unit 400 and various data necessary for control. The flash ROM 204 stores various setting information related to the operation of the imaging apparatus 1, such as user setting information. The VRAM 205 is used as a temporary storage area for image data for display. The main memory 206 is used as a temporary storage area for various image data, and is also used as a calculation work area for the central control unit 400.

  The multiplexing unit 113 multiplexes the captured image data and digital audio data, which are compressed data, to generate stream data (multiplexed data). At this time, the multiplexing unit 113 may multiplex additional data such as metadata with stream data.

  The media control unit 207 controls to write data to the card type recording medium 302 via the card I / F 301 and to read data recorded on the card type recording medium 302 in accordance with an instruction from the central control unit 400. Here, the recording unit is a card-type recording medium, but the recording unit is not limited to a card-type recording medium, and may be a recording unit having an arbitrary recording medium such as a hard disk drive.

  A liquid crystal monitor 304, a speaker 305, an operation unit 306, and an input / output terminal 307, which are examples of a display unit, are connected to an input / output I / F 303. A touch panel 304t is attached to the screen of the liquid crystal monitor 304. The liquid crystal monitor 304 displays an image based on image data such as imaging data. The speaker 305 outputs sound based on the sound data. The operation unit 306 is an operation key including a relay switch and a power switch (not shown), a cross key, a joystick, and the like, and receives an operation input from the user to the imaging apparatus 1. An input / output terminal 307 for inputting / outputting a video signal and an audio signal is connected to a television monitor, a personal computer, etc. (not shown).

  Connected to the central control unit 400 is an object image / icon storage unit 405 that stores object images and icons. An object image is an image made up of a predetermined graphic or character that is superimposed when image data is recorded or reproduced with respect to image data of a moving image obtained by imaging a subject. The icon is an image made up of figures and characters included in the effect execution image displayed when the object image is superimposed on the moving image displayed on the liquid crystal monitor 304. Examples of the icon include an icon for forming a button for selecting the type of object image and an icon for forming a button for selecting the size of the object image. There is also an icon as a simple mark that does not form a button.

  The object image reading unit 401 in the central control unit 400 reads the object image stored in the object image / icon storage unit 405. The icon reading unit 402 in the central control unit 400 reads an icon stored in the object image / icon storage unit 405. The object image adjustment unit 403 in the central control unit 400 enlarges or reduces the object image read by the object image reading unit 401 when the size of the object image is selected as will be described later. Further, the object image adjustment unit 403 determines a position where the object image is to be superimposed by an operation on the touch panel 304t.

  The effect execution image generation unit 404 in the central control unit 400 executes an effect of superimposing the object image on the moving image when the effect image mode is superimposed on the moving image displayed on the liquid crystal monitor 304. Generate an effect execution image. The effect execution image is displayed in a partial area of the screen of the liquid crystal monitor 304 in a state where a moving image obtained by imaging the subject is displayed.

  With reference to the flowchart shown in FIG. 2, the operation of the imaging apparatus 1 when shifting to an effect mode in which an object image can be superimposed on a moving image displayed on the liquid crystal monitor 304 will be described. The flowcharts shown in FIGS. 2 to 5 show the procedure of processing executed by the control program of the present embodiment. In FIG. 2, the central control unit 400 determines whether or not the menu button has been pressed in step S1. The menu button may be a physical key (button) provided in the operation unit 306, or may be a software button displayed on the screen of the liquid crystal monitor 304. In the case of a button displayed on the screen, whether or not the button is pressed by the touch panel 304t is detected.

  If it is not determined that the menu button has been pressed (NO), step S1 is repeated. If it is determined that the menu button has been pressed (YES), the central control unit 400 moves the process to step S2. The central controller 400 displays a menu image in step S2. The menu image is an image for selecting various menus including a menu for shifting to the effect mode. The central control unit 400 determines whether or not the menu button has been pressed in step S3.

  If it is not determined that the menu button has been pressed (NO), the central control unit 400 determines whether any one of the plurality of menus has been pressed in step S4. If it is not determined that any menu has been pressed (NO), the central controller 400 returns the process to step S3. On the other hand, if it is determined in step S3 that the menu button has been pressed (YES), the menu image is erased in step S6 and the process ends.

  If it is determined in step S4 that one of the menus has been pressed (YES), central control unit 400 executes processing corresponding to the pressed menu in step S5 and ends. The specific operation in step S5 when the pressed menu is a menu for shifting to the effect mode will be described with reference to the flowcharts shown in FIGS. At this time, FIGS. 3 to 5 will be described with reference to FIGS.

  In FIG. 3, the central control unit 400 (the object image reading unit 401 and the icon reading unit 402) reads the object image and icon stored in the object image / icon storage unit 405 in step S11. In step S12, central controller 400 causes liquid crystal monitor 304 to display effect mode initial image Iem1.

  FIG. 6 shows an example of the effect mode initial image Iem1. The effect mode initial image Iem1 is one of effect execution images. As shown in FIG. 6, the moving image Imv of the subject imaged by the imaging unit 100 is displayed on the screen 304s of the liquid crystal monitor 304, and the effect mode initial image Iem1 is displayed at, for example, the lower end of the screen 304s. ing. The effect execution image is displayed in a state of being superimposed on the moving image Imv. The moving image Imv of the subject is a so-called through image in which an image captured by the imaging device 1 is displayed on the screen 304s.

  The effect mode initial image Iem1 (first execution image) indicates that it is an effect mode in which an object image can be superimposed on the moving image Imv. The effect mode initial image Iem1 includes a setting button Bs for shifting to an image for performing various settings in the effect mode, and a close button Bc for ending the effect mode initial image Iem1. The button is an icon for executing a predetermined process when pressed.

  In the effect mode initial image Iem1, a recording state icon irs indicating whether recording is in progress or recording standby, a counter Ct indicating elapsed time from the start of recording, and time information Trm indicating remaining recording time are displayed. . Here, the recording state icon irs is an icon indicating that recording is on standby. The icon here is a mark that does not execute any processing even when pressed.

  In this embodiment, the effect execution image such as the effect mode initial image Iem1 is given a predetermined light color throughout the area of the effect execution image so that the user can easily recognize the range of the effect execution image area. It has become. The effect execution image is formed of a translucent image, and the moving image Imv of the subject is also displayed lightly in the area of the effect execution image. This is merely an example, as long as the user can recognize the area range of the effect execution image.

  The setting button Bs and the close button Bc will be described in detail. In the example shown in FIG. 6, the setting button Bs is a composite icon in which an icon made up of a flower figure, which is one of the object images, is described in an icon indicating a rectangular frame. Of course, it may be one icon in which a frame and a flower figure are integrated. In the setting button Bs, a number “2” indicating the size of the object image is described adjacent to an icon made of a flower figure. In the initial setting state, the object image is a flower figure having a size of size 2, and the setting button Bs corresponding to this is an icon shown in FIG.

  As will be described later, when the object image is changed to another graphic, the setting button Bs becomes an icon corresponding to the other graphic. Similarly, when the size of the object image is changed to another size, the number indicating the size of the object image displayed adjacent to the icon is a number indicating the other size. Accordingly, the effect mode initial image Iem1 is changed in accordance with the change in the type and size of the object image.

  The close button Bc is a composite icon in which a graphic icon “x” is described in an icon indicating a rectangular frame. Similarly, the close button Bc may be a single icon in which a frame and a graphic “x” are integrated. The same applies to other icons.

  Returning to FIG. 3, the central control unit 400 determines whether or not the close button Bc is pressed in step S <b> 13. If it is determined that the close button Bc has been pressed (YES), the central controller 400 deletes the effect mode initial image Iem1 and ends in step S40. If it is not determined that the close button Bc is pressed (NO), the central control unit 400 determines whether or not the setting button Bs is pressed in step S14. If it is determined that the setting button Bs has been pressed (YES), the central control unit 400 shifts the process to step S15.

  The central control unit 400 executes a setting state change process in step S15. Details of the setting state change process in step S15 will be described with reference to FIG. In FIG. 5, the central controller 400 displays an effect selection menu image Iem2 in step S51.

  FIG. 7 shows an example of the effect selection menu image Iem2. The effect selection menu image Iem2 is one of effect execution images. The effect selection menu image Iem2 (second execution image) also indicates an effect mode in which an object image can be superimposed on the moving image Imv.

  As shown in FIG. 7, the effect selection menu image Iem2 displays a setting display icon is, a page feed button Bfp, object buttons Bo1 to Bo4, a size change button Bsz, and a return button Br. The setting display icon is is a composite icon indicating the current object image and its size. In the example shown in FIG. 7, among the object buttons Bo1 to Bo4, the object button Bo1 that is a flower figure is selected. Accordingly, the setting display icon is is an icon corresponding to a flower figure.

  The currently selected object button Bo1 is displayed in, for example, a different color from the non-selected object buttons Bo2 to Bo4, so that it can be easily recognized which object button is selected. In addition to distinguishing the selected object button from the non-selected object button by color, the brightness of the selected object button is increased, the icon of the frame of the selected object button is thickened, or selected. Any object button can be marked or distinguished.

  The object image adjustment unit 403 or the image processing unit 202 can perform visual distinction between the selected object button and the non-selected object button.

  When the page feed button Bfp is pressed, object buttons of other figures than the object buttons Bo1 to Bo4 can be displayed. When the size change button Bsz is pressed, the size of the currently selected object image can be changed. When the return button Br is pressed, the effect mode initial image Iem1 is restored.

  In FIG. 5, the central control unit 400 determines whether or not the return button Br has been pressed in step S52. If it is determined that the return button Br has been pressed (YES), the central controller 400 deletes the effect selection menu image Iem2 in step S65, returns to the effect mode initial image Iem1, and ends. If it is not determined that the return button Br has been pressed (NO), the central controller 400 determines in step S53 whether or not the page feed button Bfp has been pressed. If it is determined that the page feed button Bfp has been pressed (YES), the central controller 400 pages the object button in step S54, and the process proceeds to step S55.

  If it is not determined in step S53 that the page feed button Bfp has been pressed (NO), the central control unit 400 moves the process to step S55. In step S55, the central control unit 400 determines whether an object button other than the currently selected object button (the object button Bo1 in FIG. 7) has been pressed. If it is determined that an object button other than the currently selected object button has been pressed (YES), the central control unit 400 changes the setting display icon is to the icon of the object image corresponding to the selected object button in step S56. change.

  FIG. 8 shows a state in which the object button Bo4 that is a jewel figure is selected in step S56. In step S57, the central control unit 400 changes the object image to be superimposed on the moving image Imv displayed on the screen 304s of the liquid crystal monitor 304 to the newly selected object image, and shifts the processing to step S58. . Here, an operation on the touch panel 304t for actually superimposing an object image on a moving image Imv described later is not performed. Therefore, when an operation for superimposing the object image on the moving image Imv is performed, the object image to be superimposed is changed.

  If it is not determined in step S55 that an object button other than the currently selected object button has been pressed (NO), the central control unit 400 moves the process to step S58.

  In step S58, the central control unit 400 determines whether or not the size change button Bsz is pressed. If it is determined that the size change button Bsz is pressed (YES), the central control unit 400 displays a size selection menu image Iem3 including size selection buttons Bsz1 to Bsz3 as shown in FIG. 9 in step S59. . The size selection menu image Iem3 displays size selection buttons Bsz1 to Bsz3 in place of the page feed button Bfp, the object buttons Bo1 to Bo4 (or other object buttons), and the size change button Bsz in the effect selection menu image Iem2. It has been made.

  The size selection menu image Iem3 is one of effect execution images. The size selection menu image Iem3 also indicates that it is an effect mode in which an object image can be superimposed on the moving image Imv.

  If it is not determined in step S58 that the resize button Bsz has been pressed (NO), the central controller 400 returns the process to step S52.

  In step S60, central control unit 400 determines whether a size selection button of a size other than the currently selected size has been pressed. If it is determined that a size selection button of another size has been pressed (YES), the central control unit 400 changes the size selection menu image Iem3 in accordance with the newly selected size in step S61. FIG. 10 shows a state in which the size is changed to “3” by pressing the size selection button Bsz3. 9 and 10 show the case where the object image is not changed in step S55, and the size of the flower graphic object image is changed from "2" to "3".

  In step S62, the central control unit 400 changes the object image to be superimposed on the moving image Imv displayed on the screen 304s of the liquid crystal monitor 304 to the newly selected size, and shifts the processing to step S63. Again, since the operation on the touch panel 304t for superimposing the object image on the moving image Imv is not performed, the size of the object image to be superimposed is changed when the operation for superimposing the object image on the moving image Imv is performed. Is to do.

  In step S63, the central control unit 400 determines whether or not the return button Br has been pressed. If it is determined that the return button Br has been pressed (YES), the central controller 400 deletes the size selection menu image Iem3 and returns to the effect selection menu image Iem2 in step S64, and returns the process to step S52. If it is not determined that the return button Br has been pressed (NO), the central controller 400 returns the process to step S60.

  In the present embodiment, when the object image is changed after the size change button Bsz in FIG. 8 is pressed to display the size selection menu image Iem3 in FIG. 9, the return button Br is pressed in FIG. It is necessary to return to the state. This is just an example. The object buttons Bo1 to Bo4 and the like and the size selection buttons Bsz1 to Bsz3 are set as one effect execution image, and the object buttons and the size selection buttons Bsz1 to Bsz3 are arbitrarily selected by one effect execution image. May be.

  Returning to FIG. 3, if it is not determined in step S14 that the setting button Bs has been pressed (NO), the central controller 400 shifts the process to step S16 in FIG. In step S16, the central control unit 400 determines whether or not the object overlapping area of the touch panel 304t has been touched. The object superposition area is an area excluding the effect execution image (effect mode initial image Iem1 and the like) on the screen 304s of the liquid crystal monitor 304. If it is not determined that the object overlapping area has been touched (NO), the central control unit 400 returns the process to step S13 in FIG.

  If it is determined that the object superimposition area has been touched (YES), the central control unit 400 superimposes the object image on the moving image Imv displayed on the screen 304s in step S17. For example, an object image is displayed on the touch panel 304t at a position where the user touches with a finger, and the object image is superimposed at a position where the finger is released. If the finger is dragged, the object image moves on the screen 304s as the finger moves, and is superimposed on the position when the finger is released.

  FIG. 11 shows a state in which the object image Io1 follows the movement of the finger by dragging the finger on the screen 304s. The object image Io1 is a flower figure corresponding to the object button Bo1. FIG. 12 shows a state in which one object image Io1 is superimposed on the moving image Imv at the position where the finger is released.

  In step S18, the central control unit 400 displays an on / off button Bnf and a delete button Bdl for the effect mode initial image Iem1. FIG. 12 shows an effect mode image Iem4 including an on / off button Bnf and a delete button Bdl displayed when the object image is superimposed. The effect mode image Iem4 is one of effect execution images.

  In step S19, the central control unit 400 determines whether or not the close button Bc is pressed. If it is determined that the close button Bc is pressed (YES), the central control unit 400 deletes the effect mode image Iem4 and returns to the normal screen in step S33, and shifts the processing to step S1 in FIG.

  If it is not determined that the close button Bc is pressed (NO), the central control unit 400 determines whether or not the on / off button Bnf is pressed in step S20. If it is determined that the on / off button Bnf has been pressed (YES), the central control unit 400 moves the process to step S21.

  In step S21, the central control unit 400 temporarily hides the superimposed object image and shifts the processing to step S22. FIG. 13 shows a state after the on / off button Bnf is pressed in FIG. In FIG. 13, the object image Io1 is temporarily hidden. In FIG. 13, the delete button Bdl in the effect mode image Iem4 is grayed out to become an effect mode image Iem4 '. In the effect mode image Iem4 ', the delete button Bdl is invalid and cannot be operated.

  The central controller 400 determines whether or not the on / off button Bnf is pressed in step S22. If it is determined that the on / off button Bnf has been pressed (YES), the central controller 400 returns the process to step S17, and thus returns to the state of FIG. 12 in which the object image Io1 is superimposed.

  In the present embodiment, when the effect mode image Iem4 includes the on / off button Bnf, the object image superimposed on the moving image Imv can be temporarily hidden and the object image can be displayed again. Therefore, it is possible to superimpose the object image at an appropriate timing for superimposing the object image while viewing the state of the moving image Imv.

  If it is not determined in step S22 that the on / off button Bnf has been pressed (NO), the central controller 400 determines in step S23 whether or not the close button Bc has been pressed. If it is determined that the close button Bc has been pressed (YES), the central control unit 400 shifts the processing to step S32. If it is not determined that the close button Bc has been pressed (NO), the central control unit 400 returns the process to step S22.

  On the other hand, if it is not determined in step S20 that the on / off button Bnf has been pressed (NO), the central controller 400 determines in step S24 whether or not the delete button Bdl has been pressed. If it is not determined that the delete button Bdl has been pressed (NO), the central controller 400 returns the process to step S16. By returning the process to step S16, if the object superimposition area is touched in the second or subsequent determination in step S16, the object image is superimposed on the object superposition area by the number of times the object superposition area is touched. .

  If it is determined in step S24 that the delete button Bdl has been pressed (YES), the central control unit 400 performs “Yes” button By and “No” button Bn in step S26 as shown in FIG. The effect mode image Iem5 is displayed, and the process proceeds to step S26. FIG. 14 shows a case where the delete button Bdl is pressed after a plurality of object images Io1 are superimposed.

  In step S26, the central control unit 400 determines whether or not the close button Bc is pressed. If it is determined that the close button Bc has been pressed (YES), the central control unit 400 shifts the processing to step S32. If it is not determined that the close button Bc is pressed (NO), the central control unit 400 determines whether or not the “Yes” button By is pressed in step S27. If it is determined that the “Yes” button By is pressed (YES), the central control unit 400 deletes the object image in step S28 and shifts the process to step S31. The central control unit 400 returns to the effect mode initial image Iem1 in step S31, and shifts the processing to step S33 in FIG.

  If it is not determined in step S27 that the “Yes” button By has been pressed (NO), the central controller 400 determines in step S29 whether or not the “No” button Bn has been pressed. If it is determined that the “No” button Bn is pressed (YES), the central control unit 400 returns the process to step S17. If it is not determined that the “No” button Bn is pressed (NO), the central control unit 400 determines whether or not the close button Bc is pressed in Step S30. If it is determined that the close button Bc has been pressed (YES), the central control unit 400 shifts the processing to step S32. If it is not determined that the close button Bc has been pressed (NO), the central controller 400 returns the process to step S29.

  As described above, the imaging apparatus 1 of the present embodiment displays the moving image Imv of the subject on the screen 304s of the liquid crystal monitor 304 by the processing from step S12 in FIG. 3 to step S31 in FIG. The object image can be superimposed on the moving image Imv displayed on the screen 304 s in a state where no image is recorded. At this time, an object image to be superimposed on the moving image Imv can be selected from a plurality of types, and the size of the object image can be changed.

  Next, the process after step S33 of FIG. 3 is demonstrated. In FIG. 3, the central control unit 400 determines whether or not an instruction to start recording has been given in step S33. If it is not determined that there is an instruction to start recording (NO), the central controller 400 returns the process to step S13. If it is determined that there is an instruction to start recording (YES), central control unit 400 causes moving image Imv to be recorded in step S34, and the process proceeds to step S35.

  In step S35, the central control unit 400 determines whether or not the setting button Bs has been pressed. If it is determined that the setting button Bs has been pressed (YES), the central control unit 400 shifts the processing to step S36. The process of step S36 is the same as the process of step S15, and the specific process of step S36 is the same as steps S51 to S64 described in FIG.

  If it is not determined in step S35 that the setting button Bs has been pressed (NO), the central control unit 400 shifts the processing to step S16 in FIG. The processes in steps S16 to S32 in FIG. 4 are as described above. Here, if it is not determined in step S16 that the object overlapping area has been touched (NO), the central control unit 400 shifts the process to step S34. When the central control unit 400 returns to the effect mode initial image Iem1 in step S31, the process proceeds to step S37 in FIG.

  In step S37, central control unit 400 determines whether or not an instruction to end recording has been given. If it is not determined that there is an instruction to end recording (NO), the central control unit 400 returns the process to step S34 and continues the recording process of the moving image Imv. If it is determined that there is an instruction to end recording (YES), the central control unit 400 executes a recording end process for ending the recording of the instruction moving image Imv in step S38, and shifts the process to step S39.

  In step S39, the central control unit 400 determines whether or not the close button Bc is pressed. If it is determined that the close button Bc has been pressed (YES), the central controller 400 deletes the effect mode initial image Iem1 and ends in step S40. If it is not determined that the close button Bc has been pressed (NO), the central control unit 400 returns the process to step S14.

  As described above, the imaging apparatus 1 of the present embodiment displays the moving image Imv of the subject on the screen 304s of the liquid crystal monitor 304 by the processing from step S33 to step S39 in FIG. 3 (including each processing in FIG. 4). In the state where the moving image Imv is recorded, the object image can be superimposed on the moving image Imv displayed on the screen 304s. At this time, an object image to be superimposed on the moving image Imv can be selected from a plurality of types, and the size of the object image can be changed.

  In FIG. 1, the object image is superimposed on the moving image Imv displayed on the screen 304s of the liquid crystal monitor 304 by the following operation, and the moving image Imv on which the object image is superimposed is recorded.

  The effect execution image generated by the effect execution image generation unit 404 and the object image adjusted by the object image adjustment unit 403 are superimposed on the moving image Imv by the object image / effect execution image superimposition unit 2020, and the image processing unit 202 After being adjusted to a size corresponding to the screen 304 s of the liquid crystal monitor 304, it is supplied to the liquid crystal monitor 304. As a result, the states of the respective screens 304 s described with reference to FIGS. 6 to 13 are realized.

  When recording the moving image Imv on which the object image is superimposed, the VRAM 205 temporarily stores the moving image Imv on which the object image is superimposed by the object image / effect execution image superimposing unit 2020, and compressing / decompressing the processing unit 201. Compresses to generate compressed data. After the compressed data is stored in the main memory 206, it is sequentially supplied to the card type recording medium 302 and recorded.

  Instead of superimposing the object image on the moving image Imv, the multiplexing unit 113 may multiplex the object image as additional data to the captured data so that the moving image Imv on which the object image is superimposed can be reproduced. . In this case, compressed data including additional data is recorded on the card type recording medium 302.

  The object image is not limited to a fixed figure, and may be a figure that rotates or its position is displaced, or may be a figure that sequentially changes within a predetermined time. FIG. 15 shows an example of an object image composed of figures that change sequentially within a predetermined time.

  15 (A) to 15 (D) show an effect selection menu image Iem2 having object buttons Bo5 to Bo8 by pressing the page feed button Bfp in the effect selection menu image Iem2 shown in FIG. 'Indicates the state of transition. FIGS. 15A to 15D show that a plurality of object images Io1 and a plurality of object images Io4 corresponding to the object button Bo4 selected before moving to the effect selection menu image Iem2 ′ are already moving images Imv. The state superimposed on is shown. Here, for simplification, illustration of the moving image Imv displayed on the screen 304s is omitted.

  15A to 15D show an object image corresponding to the object button Bo8 when the user selects the object button Bo8 after moving to the effect selection menu image Iem2 'and the user touches the object overlapping area. A state in which Io8 is superimposed on the moving image Imv is shown. As shown in order from FIG. 15 (A) to FIG. 15 (D), the object image Io8 sequentially changes in figure over a predetermined time, and when it becomes the state of FIG. 15 (D), FIG. 15 (A). This is a dynamic object image that returns to the state of.

  As can be seen from FIGS. 6 to 15 described above, in this embodiment, the object buttons Bo1 to Bo4 are pressed to select the type of object image, and the size change buttons Bsz and size selection buttons Bsz1 to Bsz3 are set. Even when the size of the object image is changed by pressing it, the moving image Imv is always displayed on the screen 304s. The effect execution image generation unit 404 does not change the size of the effect execution image regardless of the type of the object image or the size of the object image, and does not cover the entire moving image Imv. maintain.

  The same applies to the selection of the type of object image and the change in size. In this embodiment, the area of the effect execution image is enlarged to cover the entire moving image Imv regardless of the operation of the effect execution image. There is no end to it. It is preferable that the effect execution image generation unit 404 generates all of the plurality of effect execution images with the same size, and the object image / effect execution image superimposing unit 2020 always superimposes them at the same position on the screen 304s.

  Therefore, according to the present embodiment, while viewing the captured image (moving image Imv) that changes every moment, an appropriate type of object image appropriate for the changed captured image or an object image of an appropriate size is appropriately selected. Can be superimposed at various positions. Moreover, according to the present embodiment, it is possible to reduce the possibility of missing a suitable timing for superimposing the object image.

  As described above, in the present embodiment, the object image is superimposed on the object overlapping area excluding the area where the effect execution image is displayed on the screen 304s. The object image is not displayed in the area where the effect execution image is displayed, and the object image is not superimposed on the moving image Imv corresponding to the area where the effect execution image is displayed. Further, when the button portion is touched with a finger or the like in the effect execution image area, an operation corresponding to each button is executed. Further, nothing is operated when a part other than the button in the area of the effect execution image is touched.

  This is because the central control unit 400 performs control according to the position on the screen 304s when a finger or the like touches the touch panel 304t at each position on the screen 304s.

  First, the central control unit 400 detects contact of a finger or the like with respect to the touch panel 304t on the entire screen of the screen 304s. The object image / effect execution image superimposing unit 2020 superimposes the object image only on the object superimposition area excluding the area where the effect execution image is displayed. Therefore, the central control unit 400 does not execute the process of superimposing the object image even if the contact of the finger or the like on the effect execution image is detected.

  That is, even when the touch of the touch panel 304t is detected in the state where the effect execution image is displayed and the effect mode is entered, the central control unit 400 does not change the object image within the area of the effect execution image. Prioritize non-operation without executing any operation such as superposition.

  Furthermore, if the central control unit 400 detects contact with a finger or the like in the area of the effect execution image, if the contact with the button is detected, the central control unit 400 gives priority to processing corresponding to the button.

  Since the central control unit 400 controls the imaging apparatus 1 with such priorities, the operation as described with reference to FIGS. 3 to 5 can be executed.

  As described with reference to FIG. 11, in this embodiment, when a finger is dragged on the screen 304s, the object image / effect execution image superimposing unit 2020 follows the movement of the finger to display the object image on the moving image Imv. Superimpose. As shown in FIG. 16, it is assumed that when a finger is dragged on the screen 304s, the finger enters the area of the effect execution image such as the effect mode image Iem4 and touches the on / off button Bnf, for example. In FIG. 16 and subsequent figures, the illustration of the moving image Imv displayed on the screen 304s is omitted for simplification.

  In such a case, the user does not intend to press the on / off button Bnf. The same applies when a button other than the on / off button Bnf is touched. Even in such a case, it is required to execute an operation not contrary to the user's intention.

  Therefore, a preferable configuration example will be described in which when the finger is dragged on the screen 304s and the finger enters the area of the effect execution image, an operation according to the user's intention can be executed. The flowchart shown in FIG. 17 shows a preferable operation in the effect mode. The flowchart shown in FIG. 17 shows the procedure of processing executed by the control program of this embodiment.

  In FIG. 17, the central controller 400 determines whether or not the touch panel 304t is touched with a finger or the like in step S71. If it is not determined that it has been touched (NO), the central control unit 400 returns the process to step S71 and repeats step S71. If it is determined that it has been touched (YES), the central controller 400 determines whether or not the inside of the area of the effect execution image has been touched in step S72. If it is not determined that the inside of the effect execution image area has been touched (NO), this means that the object overlap area has been touched, and the central control unit 400 displays the object image at the touched position in step S74. Let

  If it is determined that the inside of the effect execution image area is touched (YES), the central control unit 400 determines whether or not the button in the effect execution image area is pressed in step S73. If it is determined that the button has been pressed (YES), the central control unit 400 executes processing corresponding to each button described above in step S86. If it is not determined that the button has been pressed (NO), no operation is performed as described above, so the central control unit 400 returns the process to step S71 and repeats the processes after step S71.

  Then, the central control unit 400 determines whether or not it has shifted to dragging in step S75. What is necessary is just to determine with having shifted to drag | drug, when it moves more than a process distance in the state which the finger | toe etc. are touching. If it is determined that the state has shifted to the drag (YES), the central control unit 400 invalidates the button press determination and the like in step S76. Specifically, the central control unit 400 invalidates the control that is inactivated when the inside of the area of the effect execution image is touched and the button pressing determination.

  In step S77, central control unit 400 determines whether or not a finger or the like is located within the area of the effect execution image. The determination in the first step S77 is to determine whether or not a finger or the like has entered the area of the effect execution image. If it is determined that the position is within the effect execution image area (YES), in step S78, the central control unit 400 executes position adjustment so that the object image does not cover the effect execution image area.

  FIG. 18 shows a display example of the object image Io1 when position adjustment is executed in step S78. The example shown in FIG. 18 shows a state in which a finger is dragged on the screen 304s and, for example, the on / off button Bnf in the area of the effect execution image is touched. As a result of executing the position adjustment, the object image Io1 does not enter the area of the effect execution image and is displayed at the lower end portion of the object superposition area. The position where the object image Io1 is displayed may be the lower end of the object overlapping area on the horizontal position where the finger or the like is located.

  In step S79, central control unit 400 determines whether or not dragging is continued within the area of the effect execution image. If it determines with continuing (YES), the central control part 400 will return a process to step S78, and will perform a position adjustment similarly. FIG. 19 shows a state where the finger is dragged rightward within the area of the effect execution image. When the finger is dragged to the right, in step S78, the position where the object image Io1 is displayed is adjusted to the lower end of the object overlapping area on the horizontal position where the finger is located. Therefore, as shown in FIG. 19, the object image Io1 follows the movement of the finger and moves the lower end portion of the object overlapping area to the right.

  Returning to FIG. 17, if it is not determined in step S77 that the image is located within the area of the effect execution image (NO), the central control unit 400 shifts the process to step S80. If it is not determined in step S79 that the drag is continued (NO), the central control unit 400 shifts the process to step S80. The central control unit 400 determines whether or not the finger or the like has been removed in step S80. If it is not determined that the finger or the like has been released (NO), the central control unit 400 returns the process to step S77. If it is determined in step S80 that the finger or the like has been released (YES), central control unit 400 causes the process to proceed to step S82.

  If it is not determined that dragging has been performed in step S75 (NO), the central control unit 400 determines whether a finger or the like has been removed in step S81. If it is not determined that the finger or the like has been released (NO), the central control unit 400 returns the process to step S81 and repeats step S81. If it is determined in step S81 that the finger or the like has been released (YES), central control unit 400 causes the process to proceed to step S82.

  In step S82, the central control unit 400 provisionally determines the position where the finger or the like is separated as the superimposed position of the object image. In step S83, central control unit 400 determines whether or not the position where the finger or the like is separated is within the area of the effect execution image. If it is determined that it is within the area of the effect execution image (YES), the central control unit 400 executes position adjustment so that the object image does not cover the area of the effect execution image in step S84, and the process is performed. The process proceeds to S85. If it is not determined that the area is within the effect execution image area (NO), the central control unit 400 shifts the process to step S85.

  In step S85, the central control unit 400 determines the superimposed position of the object image and superimposes it on the moving image Imv, and returns the process to step S71.

  When the finger or the like is dragged on the screen 304s by the processing shown in FIG. 17 described above, even if the finger or the like enters the area of the effect execution image and touches any button, the function of the button is It will not be executed and the user can continue dragging. In addition, even if a user or the like enters the effect execution image area, the vertical position of the object image stops at the lower end of the object superimposition area, so the object image is superimposed in the effect execution image area. I can easily understand that I can't do it.

  In the present embodiment described above, the object image is an image made of a graphic or a character stored in the object image / icon storage unit 405 in advance. However, an object image such as a character handwritten by the user is superimposed on the moving image Imv. Similar control can be executed also in the case of the control. For object images such as handwritten characters, a button for selecting a color may be used instead of the object buttons Bo1 to Bo8, and a button for selecting a line thickness is used instead of the size selection buttons Bsz1 to Bsz3. do it.

  The present invention is not limited to the embodiment described above, and various modifications can be made without departing from the scope of the present invention. In the present embodiment, the case where the operation on the touch panel 304t is performed with a finger is shown, but a touch pen may be used instead of the finger, and the operation may be performed with an arbitrary operator including the finger. The control program of the present invention may be downloaded to the imaging apparatus 1 via a communication line such as the Internet, or the control program of the present invention may be recorded on a recording medium and provided.

DESCRIPTION OF SYMBOLS 1 Imaging device 100 Imaging part 202 Image processing part 302 Card type recording medium (recording part)
304 LCD monitor (display unit)
304s screen 304t touch panel 400 central control unit (microcomputer, control unit)
404 Effect execution image generation unit 405 Object image / icon storage unit (object image storage unit)
2020 Object image / effect execution image superimposing unit (object image superimposing unit, effect execution image superimposing unit)

Claims (10)

An imaging unit that captures a moving image of the subject;
A display unit that displays the moving image captured by the imaging unit on a screen;
An object image storage unit for storing a plurality of types of object images to be superimposed on the moving image displayed on the screen;
A first selection for selecting any one of the plurality of types of object images, indicating that the effect mode is to superimpose the object image on the moving image displayed on the screen An effect execution image generating unit that generates an effect execution image to be displayed in a partial area of the screen so as not to cover the whole of the moving image.
An effect execution image superimposing unit that superimposes the effect execution image on the moving image displayed on the screen;
When a predetermined operation for superimposing an object image of a type selected by the effect execution image is performed on an object image superimposing area that is an area on which the object image is superimposed on the moving image, the object image storage unit stores An object image superimposing unit that superimposes the selected object image stored;
With
The effect execution image generation unit maintains the size of the effect execution image at a size that does not cover the entire moving image even when an operation is performed on the first selection button. Imaging device. 2. The imaging according to claim 1, wherein the object image superimposing unit sets an area where the moving image is displayed excluding an area where the effect execution image is superimposed on the screen as the object image superimposing area. apparatus. The effect execution image generation unit
As the effect execution image, an image including a second selection button for selecting the size of the object image is generated,
Even when an operation for selecting the size of the object image is performed by an operation on the second selection button, the size of the effect execution image is maintained so as not to cover the entire moving image. The imaging apparatus according to claim 1 or 2. The effect execution image generation unit, as the effect execution image,
A first execution image including a setting button for allowing the object image to be superimposed on the object image superimposing area and shifting to an image for selecting a type or size of the object image;
A second execution image that is displayed when the setting button is operated, includes the first selection button or the second selection button, and has the same size as the first execution image;
Produces
The imaging apparatus according to claim 3, wherein the effect execution image superimposing unit superimposes the first and second execution images at the same position on the screen.   A state in which the moving image displayed on the screen in a state where the object image is superimposed is combined with the moving image, or a state in which the object image is multiplexed with the moving image as additional data The imaging apparatus according to claim 1, further comprising: a recording unit configured to record the information. For computers installed in imaging devices,
An image indicating that the effect mode is to superimpose an object image on a moving image displayed on the screen, and includes a first selection button for selecting one of a plurality of types of object images Generating an effect execution image to be displayed in a partial area of the screen so as not to obscure the entire moving image;
Superimposing the effect execution image on the moving image displayed on the screen;
A predetermined operation for superimposing an object image of the type selected by the effect execution image on the object image superimposition area in the moving image is an object image superimposing area that is an area on which the object image in the moving image is superimposed. If so, superimposing the selected object image;
And execute
The step of generating the effect execution image maintains the size of the effect execution image at a size that does not cover the entire moving image even when an operation is performed on the first selection button. A control program used for the imaging apparatus. The step of superimposing the selected object image includes selecting the selected object image using the area where the moving image is displayed excluding the area where the effect execution image is superimposed on the screen as the object image superimposition area. The control program used for the imaging apparatus according to claim 6, wherein: The step of generating the effect execution image includes:
As the effect execution image, an image including a second selection button for selecting the size of the object image is generated,
Even when an operation for selecting the size of the object image is performed by an operation on the second selection button, the size of the effect execution image is maintained so as not to cover the entire moving image. A control program used for the imaging apparatus according to claim 6 or 7. The step of generating the effect execution image includes the effect execution image,
A first execution image including a setting button for allowing the object image to be superimposed on the object image superimposing area and shifting to an image for selecting a type or size of the object image;
A second execution image that is displayed when the setting button is operated, includes the first selection button or the second selection button, and has the same size as the first execution image;
To generate
The control program used for the imaging apparatus according to claim 8, wherein the step of superimposing the effect execution image superimposes the first and second execution images at the same position on the screen. For the computer
A state in which the moving image displayed on the screen with the object image superimposed is combined with the moving image, or a state in which the object image is multiplexed with the moving image as additional data The control program used for the imaging apparatus according to any one of claims 6 to 9, further comprising the step of:

Images