JP2013156882A - Image processing program and image processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program for supporting finding an optimal image and an optimal image processing method while executing various types of image processing on the same image.SOLUTION: A program causes a computer to execute an image generation step, a first history storage step, a duplication step, and a second history storage step. The image generation step is for generating a second image by executing first image processing on a first image. The first history storage step is for storing a first history. The first history indicates that the second image is an image generated by executing the first image processing on the first image. The duplication step is for duplicating the second image as a third image. The second history storage step is for storing a second history by referring to the first history. The second history indicates that the third image is an image generated by executing the first image processing on the first image.

Description

  The present invention relates to an image processing program and an image processing apparatus.

  2. Description of the Related Art Conventionally, an image processing program and an image processing apparatus that execute image processing and store an image processing history are known (for example, Patent Document 1). Note that the history of image processing is information indicating what image processing is executed for which image and which image is generated as a result. In Patent Document 1, an image processing history is used to generate a processed image by performing image processing on an original image, and then execute different image processing on the same original image to generate different processed images. The Specifically, the apparatus of Patent Document 1 accepts editing of an image processing history from a user, and automatically generates a new processed image from an original image according to the contents of the editing.

JP 2001-209818 A

By the way, there is a case where it is desired to find an optimal image and an optimal image processing method while performing various image processing on the original image while repeating trial and error. However, in Patent Document 1, when a new processed image is generated from an original image, the previous processed image and the contents of the previous image processing are overwritten and disappear. That is, in Patent Document 1, even when various image processing is performed on the original image, the image derived from the original image and the contents of the image processing are only managed along one route. Then, it is difficult to compare the previous processed image with the new processed image, and it is difficult to determine which image is optimal and which image processing method is optimal. .
An object of the present invention is to provide an image processing program and an image processing apparatus that support finding an optimal image and an optimal image processing method while executing various image processes on the same image.

  An image processing program according to a first aspect of the present invention causes a computer to execute a second image generation step, a first history storage step, a duplication step, and a second history storage step. The second image generation step is a step of generating a second image by executing first image processing on the first image. The first history storage step is a step of storing the first history. The first history indicates that the second image is an image generated by executing the first image processing on the first image. The duplication step is a step of duplicating the second image as the third image. The second history storage step is a step of storing the second history with reference to the first history. The second history indicates that the third image is an image generated by executing the first image processing on the first image.

  Here, when the first image processing is executed on the first image and the second image is generated, the contents of the first image processing are stored as the first history in association with the first image and the second image. The Then, when the second image is duplicated as the third image, the contents of the first image processing are stored as the second history in association with the first image and the third image. In other words, a plurality of images (second image and third image) and the contents of image processing (first image processing) up to these images are managed in a manner branched from the first image. That is, a plurality of routes for managing images derived from the same image (first image) and the contents of image processing are formed. As a result, it is possible to assist in finding an optimal image and an optimal image processing method while executing various image processes on the same image (first image).

  An image processing program according to a second aspect of the present invention is an image processing program according to the first aspect, and further causes the computer to execute a fourth image generation step and a third history storage step. The fourth image generation step is a step of generating a fourth image instead of the second image by executing second image processing on the first image after the duplication step. The third history storage step is a step of storing the third history instead of the first history. The third history indicates that the fourth image is an image generated by performing the second image processing on the first image.

  Here, when the second image processing is performed on the first image after the second image is copied, a fourth image that is used instead of the second image is generated. Then, instead of the first history that associates the first image and the second image with the content of the first image processing, a third history that associates the first image and the fourth image with the content of the second image processing is stored. . In other words, the image of the original route (second image) and the content of the image processing (first image processing) among the plurality of routes for managing the image derived from the first image and the content of the image processing are updated. However, here, comparing the images that have disappeared before the update (contents of the third image and the first image processing) with the images after the update (contents of the fourth image and the second image processing) Can do.

  An image processing program according to the third aspect of the present invention is an image processing program according to the second aspect, further causing the computer to execute a first display step. The first display step is a step of simultaneously displaying the third image and the fourth image.

  Here, a plurality of images (third image and fourth image) branched from the same image (first image) are displayed simultaneously. Therefore, the user can easily compare a plurality of images (third image and fourth image) branched from the same image (first image).

  An image processing program according to a fourth aspect of the present invention is an image processing program according to the second aspect or the third aspect, and further causes the computer to execute a second display step and a third display step. The second display step is a step in which the third image and the second history are displayed at the same time or displayed while switching. The third display step is a step in which the fourth image and the third history are displayed at the same time or displayed while switching.

  Here, the contents of the image processing up to the third image and the third image (second history) are displayed at the same time or displayed while switching. The fourth image and the contents of the image processing up to the fourth image (third history) are displayed at the same time or displayed while switching. Therefore, the user can easily compare a plurality of images (third image and fourth image) branched from the same image (first image) and perform a plurality of image processing (first images) up to the plurality of images. The contents of the image processing and the second image processing) can be easily compared.

  An image processing program according to a fifth aspect of the present invention is the image processing program according to any one of the first to fourth aspects, and further executes a sixth image generation step and a fourth history storage step on the computer. Let The sixth image generation step is a step of generating a sixth image by executing third image processing on the fifth image on the same timeline as the first image. The fourth history storage step is a step of storing the fourth history. The fourth history indicates that the sixth image is an image generated by performing the third image processing on the fifth image.

  Here, when the third image processing is performed on the fifth image on the same timeline as the first image and the sixth image is generated, the fourth history is associated with the fifth image and the sixth image. The contents of the third image processing are stored. Therefore, a plurality of images on the same timeline (first image and fifth image), images derived from these images (second image to fourth image), and image processing (first image processing to third image processing) ) Can be systematically managed.

An image processing program according to a sixth aspect of the present invention is the image processing program according to any one of the first to fifth aspects, and the second image generation step executes the first image processing on the first image. This is a step of generating a second image in response to an instruction from the user who orders to do so. The first history storage step is a step of storing the first history as the second image is generated. The duplication step is a step of duplicating the second image as the third image in accordance with an instruction from a user who orders duplication. The second history storage step is a step of storing the second history as the second image is duplicated.
Here, the user can instruct execution of image processing and image duplication.

  An image processing apparatus according to a seventh aspect of the present invention includes an image processing unit, a first history storage unit, a duplication unit, and a second history storage unit. The image processing unit generates the second image by executing the first image processing on the first image. The first history storage unit stores the first history. The first history indicates that the second image is an image generated by executing the first image processing on the first image. The duplicating unit duplicates the second image as the third image. The second history storage unit refers to the first history and stores the second history. The second history indicates that the third image is an image generated by executing the first image processing on the first image.

  Here, when the first image processing is executed on the first image and the second image is generated, the contents of the first image processing are stored as the first history in association with the first image and the second image. The Then, when the second image is duplicated as the third image, the contents of the first image processing are stored as the second history in association with the first image and the third image. In other words, a plurality of images (second image and third image) and the contents of image processing (first image processing) up to these images are managed in a manner branched from the first image. That is, a plurality of routes for managing images derived from the same image (first image) and the contents of image processing are formed. As a result, it is possible to assist in finding an optimal image and an optimal image processing method while executing various image processes on the same image (first image).

  According to the present invention, a plurality of images and the contents of image processing up to those images are managed in a manner branched from the same image. That is, a plurality of routes for managing images derived from the same image and the contents of image processing are formed. As a result, it is possible to assist in finding an optimal image and an optimal image processing method while performing various image processing on the same image.

1 is a block diagram of an image processing apparatus according to an embodiment of the present invention. It is a figure of the basic screen before image data is taken in. It is a figure of the basic screen after image data was taken in. It is a figure which shows the still image group which belongs to 1 timeline. It is a figure which shows the content of a history file. FIG. 6 is a history window corresponding to the history file of FIG. 5. It is a figure of the basic screen in the state where the history tab was expanded. The coordinate m _s from the state of FIG. 6 is a diagram of the history window after two decremented. It is another figure which shows the content of a history file. FIG. 10 is a history window corresponding to the history file of FIG. 9. It is a figure of the basic screen after a clip window was created from the state of FIG. It is a figure which shows the content of a clip history file. It is a figure of the history window corresponding to the clip history file of FIG. It is a figure of the basic screen for demonstrating the usage example of a clip function. It is another figure of the basic screen for demonstrating the usage example of a clip function. It is another figure of the basic screen for demonstrating the usage example of a clip function.

Hereinafter, an image processing program and an image processing apparatus according to an embodiment of the present invention will be described with reference to the drawings.
<1. Overview of Image Processing Device>
An image processing apparatus 1 shown in FIG. 1 is an embodiment of an image processing apparatus according to the present invention. The image processing apparatus 1 is a general-purpose personal computer. An image processing program 2 that is an embodiment of an image processing program according to the present invention is installed in the image processing apparatus 1. The image processing program 2 is application software for supporting image processing for moving images and still images. The image processing program 2 causes the image processing apparatus 1 to execute steps included in the operations described later.

  The image processing apparatus 1 includes a display 10, an input unit 20, a storage unit 30, and a control unit 40. The display 10, the input unit 20, the storage unit 30, and the control unit 40 are connected to each other via the bus line 5 and can communicate with each other. In the present embodiment, the display 10 is a liquid crystal display. The input unit 20 includes a mouse and a keyboard. The storage unit 30 is composed of a hard disk or the like. The control unit 40 includes a CPU, a ROM, a RAM, and the like. The hard disk is non-volatile. The display 10 displays a screen or the like described later to the user. The input unit 20 receives an operation from the user for the image processing apparatus 1.

  The image processing program 2 is stored in the storage unit 30. A software management area 50 is secured in the storage unit 30. The software management area 50 is an area used by the image processing program 2. In the software management area 50, an original image area 51, a processed file area 52, a history area 53, and a clip area 54 are secured. The role of each of the areas 51 to 54 will be described later.

  The control unit 40 reads and executes the image processing program 2 stored in the storage unit 30 to virtually operate as the image processing unit 41, the history management unit 42, the clip management unit 43, and the display control unit 44. To do. The operation of each unit 41 to 44 will be described later.

<2. Details of Configuration and Operation of Image Processing Apparatus>
When the control unit 40 detects that the user has performed a predetermined operation via the input unit 20, the control unit 40 activates the image processing program 2. When the image processing program 2 is activated, a basic screen W1 (see FIG. 2) is displayed on the display 10. The display control unit 44 controls the display of all elements such as the screen, window, buttons, and the like displayed on the display 10.

<2-1. Importing image data>
The basic screen W1 accepts a command for capturing image data into the original image area 51 from the user. The image data captured in the original image area 51 is a target of image processing to be described later. The control unit 40 captures image data from the still image file or the moving image file into the original image area 51. In this specification, a still image file is a data file in a still image format, and a moving image file is a data file in a moving image format.

  When capturing image data from a still image file, the user operates the input unit 20 to specify one still image file or one folder. In the former case, the control unit 40 causes the user to input the address path and file name in the storage unit 30 of the still image file. In the latter case, the control unit 40 allows the user to input the address path and folder name in the storage unit 30 of the folder. Thereafter, the control unit 40 stores the specified one still image file or all the still image files in the specified one folder as a still image file group in the original image area 51. In the present specification, when referring to a “group”, the number of elements is not limited to a plurality, and may be one.

  On the other hand, when capturing image data from a moving image file, the user operates the input unit 20 to input the address path and file name in the storage unit 30 of one moving image file. When the display control unit 44 detects that the user has specified a moving image file, the display control unit 44 displays a moving image capturing window (not shown) in an overlapping manner on the basic screen W1. The moving image capture window receives, from the user, selection of a section having an arbitrary length among all the sections of the timeline of the specified moving image file. When the control unit 40 detects that the user has selected a section via the input unit 20, the control unit 40 generates a still image file group corresponding to the frame group included in the section of the specified moving image file on a one-to-one basis. To do. Thereafter, the control unit 40 stores the still image file group in the original image area 51.

  Therefore, in the present embodiment, the target of image processing to be described later is not a moving image file but a still image file. The still image file is taken into the original image area 51 in file units, folder units, or all or part of a section of the moving image file.

  The control unit 40 determines the still image file included in the still image file group even if the still image file group captured in the original image area 51 is not derived from the moving image file but derived from the still image file. Recognize that they are arranged along the timeline. The array is automatically determined from file attributes (file name, creation date, update date, etc.).

<2-2. Playback of still image files>
When the still image file group is taken into the original image area 51, the display control unit 44 displays the display window W2 (see FIG. 3) on the basic screen W1. The display windows W2 are created by the number of timelines of the still image file group captured in the original image area 51.

  In the display window W2, first, one still image file (for example, the still image file of the first frame on the timeline) included in the still image file group captured in the original image area 51 is displayed. As will be described later, the frame displayed in the display window W2 is switched in response to a user operation. The display control unit 44 identifies the identifier of the frame currently displayed in the display window W2 (hereinafter referred to as frame ID) for each display window W2, that is, for each timeline of the still image file group captured in the original image area 51. ) In the software management area 50 in real time.

  The display control unit 44 can reproduce the frame group belonging to the timeline corresponding to the display window W2 as a moving image in the display window W2. As shown in FIG. 3, a window selection pull-down menu T1, a playback button T2, a frame advance button T3, a frame return button T4, a timeline bar T5, and a clip button T6 are arranged on the basic screen W1.

  Even when there are a plurality of display windows W2, there is only one active display window W2. The window selection pull-down menu T1 accepts selection of which display window W2 is active from the user. Therefore, the user can appropriately switch the active display window W2 among all the display windows W2 on the basic screen W1 by operating the window selection pull-down menu T1 via the input unit 20. Hereinafter, a timeline corresponding to the active display window W2 is referred to as an active timeline, and a frame group belonging to the active timeline is referred to as an active frame group. A frame currently displayed in the active display window W2 is referred to as an active display frame.

  The playback button T2 receives a playback command from the user as a moving image of the active frame group. When the display control unit 44 detects that the user has pressed the play button T2 via the input unit 20, the frame included in the active frame group is sequentially framed along the active timeline in the active display window W2. Display in the format. Note that the reproduction starts from the active display frame at the time when the reproduction button T2 is pressed. The playback button T2 accepts a playback stop command from the user. When the display control unit 44 detects that the user has pressed the playback button T2 via the input unit 20 during playback, the display control unit 44 fixes the display in the active display window W2 to the active display frame at that time.

  Each of the frame advance button T3 and the frame return button T4 receives an instruction from the user to switch the active display frame to the next previous frame along the active timeline.

  The timeline bar T5 is an object that schematically shows the active timeline. The timeline bar T5 is equally divided by the number of frames of the active frame group in the direction in which the bar extends. The nth divided region from the left on the timeline bar T5 corresponds to the nth frame on the active timeline (n is a natural number).

  As shown in FIG. 3, the timeline bar T5 displays the divided area A1 corresponding to the selected frame group and the divided area A2 corresponding to the non-selected frame group in different modes. The selected frame group is a frame group corresponding to the currently selected section on the active timeline. The non-selected frame group is a frame group corresponding to a section that is not currently selected on the active timeline. In the present embodiment, the area A1 is displayed with a light tone color, and the area A2 is displayed with a dark tone color.

The timeline bar T5 accepts selection of an arbitrary section on the active timeline from the user. The selected section may be a continuous section or a discontinuous section. In other words, the user can select an arbitrary number of arbitrary frames from the active frame group by operating the timeline bar T5 via the input unit 20. Specifically, the user selects a divided region corresponding to a frame to be selected on the timeline bar T5. A plurality of divided areas can be selected at the same time. The image processing unit 41 recognizes the selected frame group as an image processing target to be described later. Each time the divided area on the timeline bar T5 is selected by the user, the active display frame is switched to a frame corresponding to the most recently selected divided area. A pointer C1 is displayed on the most recently selected divided area to indicate the position of the active display frame on the active timeline.
The clip button T6 is an object that receives a command to execute a clip function from the user. Details of the clip function will be described later.

<2-3. Image processing>
Hereinafter, image processing for the selected frame group will be described. The image processing unit 41 can execute a plurality of image processing modules such as noise removal, sharpness, brightness / contrast / saturation adjustment, image resolution, level correction, rotation, and addition of characters / arrows / mosaic. The image processing module is incorporated in the image processing program 2.

  The user can select any one of the image processing modules in any order and any number of times by operating the basic screen W1 via the input unit 20. If necessary, the user inputs parameters used when executing the image processing module in conjunction with the selection of the image processing module. Each time the image processing unit 41 detects that the user has selected an image processing module, the image processing unit 41 executes the image processing module on the selected frame group. Note that executing an image processing module for a selected frame group means executing the image processing module for each frame included in the selected frame group.

  As the image processing module is sequentially executed once, twice, three times,... With respect to the frame, the frame is sequentially sorted into the first order, the second order, the third order,. It will be processed. The 0th frame corresponds to the still image file stored in the original image area 51. The (m + 1) th frame corresponds to the still image file after the image processing module is executed once for the still image file corresponding to the mth frame (m is an integer of 0 or more). The image processing unit 41 sequentially generates first and subsequent still images, and stores these still images in the processed file area 52 as separate files.

  FIG. 4 is a conceptual diagram showing how still image groups belonging to one timeline are managed by the image processing program 2. In FIG. 4, the N axis on the horizontal axis indicates the order of frames on the timeline, and the M axis on the vertical axis indicates the order of processing. A square corresponding to the coordinates (n, m) in the NM space in FIG. 4 represents the still image I (n, m). The still image I (n, m) is the mth-order still image of the nth frame on the timeline (n is a natural number, and m is an integer of 0 or more).

For each frame, the control unit 40 manages the value of the currently selected coordinate m as the parameter _ms in the software management area 50 in real time. A rectangle surrounded by a thick line in FIG. 4 represents a still image with coordinates m _s . Note that to execute the image processing module to the frame, it is to perform an image processing module to the m _s next still image of the frame. In other words, executing the image processing module for the nth frame on the timeline means executing the image processing module for the still image I (n, m _s ).

Immediately after the still image file group is taken into the original image area 51, the coordinates m _s of all the frames of the still image file group have an initial value of 0. Thereafter, each time the image processing module is executed once, the coordinate m _s of the frame is incremented by one. Further, as described later, the user can freely change the coordinate m _s of an arbitrary frame.

<2-4. History>
Each time an image processing module is executed, the history management unit 42 automatically creates or updates a history file 53a corresponding to the frame that is the target of execution of the image processing module, and stores it in the history area 53. To do. The history file 53a is created for each frame. The history file 53a stores history information of frames corresponding to the history file 53a. The history is a history of execution of the image processing module. That is, the history file 53a stores information indicating which image processing module is executed using which parameter for which still image and, as a result, which still image is generated. The history file 53a also stores information indicating the order of execution of the image processing modules.

  Specifically, the history file 53a is described in the format shown in FIG. That is, the history file 53a stores the frame ID of the frame corresponding to the history file 53a (see <Frame ID> tab in FIG. 5). In the history file 53a, the identifier of the 0th-order still image (hereinafter, still image ID) is described using the <m> tab (that is, <0> tab) of m = 0. The still image ID is an address path and file name of the still image file. Further, the history file 53a stores the contents of the image processing module executed for the (m−1) -th still image of the frame corresponding to the history file 53a in association with the coordinate m of m ≧ 1. The More specifically, using the <m> tab with m ≧ 1, the still image ID of the m-th still image and the name of the image processing module executed for the (m−1) -th still image And parameters are described. As a result, the contents of the executed image processing module are associated with still images before and after the execution of the image processing module.

  By the way, as shown in FIGS. 2 and 3, the display control unit 44 can display the history window W3 on the basic screen W1. Details of the history of the active display frame are displayed in the history window W3 (see FIG. 6). Details of the history of the active display frame are determined by referring to the history file 53a. The history file 53a in FIG. 5 corresponds to the state in FIG. Further, every time the active display frame is switched, the display of the history details in the history window W3 is also switched in real time.

  As shown in FIG. 6, an initial state area E1 and a module name area E2 are displayed side by side in the history window W3. The initial state area E1 corresponds to the initial state (0th-order still image) of the active display frame. The module name area E2 has a one-to-one correspondence with the image processing module executed for the active display frame. Accordingly, the number of initial state areas E1 is one, and the number of module name areas E2 is the same as the number of image processing modules executed for the active display frame. The uppermost area E2 corresponds to the image processing module executed first for the active display frame, and the lowermost area E2 corresponds to the image processing module executed last for the active display frame. . In the module name area E2, the name of the image processing module corresponding to the area E2 is displayed.

<2-5. Changing the coordinate _{m s>}
The user can freely change the currently selected coordinate m _s for an arbitrary frame by operating the input unit 20. As described above, when the coordinate m _s is changed, the still image to be executed by the image processing module is changed. Therefore, changing the coordinate m _s means changing the object of image processing. There are the following two specific change operation methods.

The first method is a method of changing the coordinate m _s of the active display frame by operating the history window W3. Specifically, first, the user displays a frame in which the coordinate m _{s is} to be changed in the active display window W2. As a result, in the history window W3, detailed history of the frame to be changed the coordinates m _s is displayed. The history window W3 accepts the selection of any one area from the areas E1 and E2 from the user. The control unit 40 changes the coordinate m _s of the active display frame to the value of the coordinate m of the still image corresponding to the areas E1 and E2 in response to the user selecting the areas E1 and E2. The still image corresponding to the area E2 is a still image after execution of the image processing module corresponding to the area E2.

The second method is a method of collectively changing the coordinates m _s of all the frames included in the selected frame group by operating the basic screen W1. Specifically, first, the user selects a frame group whose coordinate m _{s is} to be changed as a selected frame group. The basic screen W1 accepts the selection of any one item from the items "Go to previous history", "Go to next history", "Go to latest history" and "Specify history position" on the history tab H1 from the user ( (See FIG. 7). When the control unit 40 detects that the user has selected a specific item from these items, the control unit 40 collectively changes the coordinates m _s of all the frames included in the selected frame group. The history window W3 in FIG. 6 is an enlarged view of the history window W3 on the basic screen W1 in FIG.

Specifically, when the item “to previous history” is selected, the coordinates m _s of all the frames included in the selected frame group are decremented by one. However, for a frame in which the coordinate m _s is already 0, the coordinate m _s is maintained at 0. When the item “to the next history” is selected, the coordinates m _s of all the frames included in the selected frame group are incremented by one. However, for a frame in which the coordinate m _s is already the upper limit value, the coordinate m _s is maintained as the upper limit value. The upper limit value is the number of image processing modules executed for the frame. When the item “to latest history” is selected, the coordinates m _s of all the frames included in the selected frame group are set to the upper limit value. When the item “history position designation” is selected, the display control unit 44 causes a position designation window (not shown) to be displayed in an overlapping manner on the basic screen W1. The position designation window accepts an input of an integer k of 0 or more from the user. The coordinates m _s of all the frames included in the selected frame group are set to the input integer k. However, for frames in which the integer k exceeds the upper limit, the coordinate m _s is set to the upper limit.

By the way, to display a frame means to display a still image at the coordinate m _s of the frame. In other words, displaying the nth frame on the timeline means displaying the still image I (n, m _s ). Therefore, when the coordinate m _s of the active display frame is changed, the display of the active display window W2 also switched immediately.

Further, when the coordinates m _s active display frame is changed, the display mode of the area E1, E2 in the history window W3 also changed immediately. FIG. 8 shows a state of the history window W3 after the state of the coordinate m _s = 5 in FIG. 6 is changed to the state of the coordinate m _s = 3. As can be seen by comparing FIG. 8 and FIG. 6, the area E2 corresponding to the still image after the coordinates (m _s +1) of the active display frame is displayed in a gray-out manner. Therefore, the user can always easily understand what image processing module the still image currently displayed in the active display window W2 is generated through.

Further, as described above, the still image groups belonging to the same frame are stored as separate files in the software management area 50. Further, only the coordinate m _s is changed, the still image coordinates m _s before the change is not to be removed from the software management area 50 within. Therefore, for example, when the user decrements the coordinate m _s of the active display frame, a still image of the coordinate m _s after decrement is immediately displayed in the active display window W2. Further, thereafter, the user, even when the incremented coordinates m _s active display frame, in the active display window W2, are immediately displayed still image coordinates m _s of the incremented.

By the way, when the image processing module is executed for a frame in which the coordinate m _s is smaller than the upper limit value, still images after the (m _s +1) th order before the execution of the image processing module belonging to the frame are processed. All files are erased from the file area 52. Instead, a still image after execution of the image processing module is stored in the processed file area 52 as a new (m _s +1) -th still image belonging to the frame. At the same time, when the image processing module is executed for a frame in which the coordinate m _s is smaller than the upper limit value, history information after the (m _s +1) th order before the execution of the image processing module belonging to the frame. That is, the information in the <m> tab and the <m> tab with m ≧ (m _s +1) is deleted from the history file 53a corresponding to the frame. Instead, the history file 53a uses the <m> tab of m = (m _s +1), and the execution history of the image processing module (in this embodiment, the still image ID, the image processing module). Are newly described. For example, when the sharpness image processing module is executed for a frame corresponding to the history window W3 of FIG. 8, the history window W3 of the frame is changed from the state shown in FIG. 8 to the state shown in FIG. Further, the history file 53a of the frame is changed from the state shown in FIG. 5 to the state shown in FIG.

  That is, in the software management area 50, still image groups and histories belonging to the same frame are managed in the processing order m. Therefore, in the software management area 50, still image groups and histories belonging to the same frame are managed along one route, and are not managed by branching.

<2-6. Clip>
The user, by using the clip function implemented in the image processing program 2, it is possible to replicate a static image of an arbitrary coordinate m _s belonging to any frame on any timeline. The clip function can be executed any number of times, but only one still image is copied in one execution. The specific processing flow of the clip function is as follows.

When the clip management unit 43 detects that the user has pressed the clip button T6, the clip management unit 43 copies the m _sth still image of the active display frame (hereinafter referred to as a copy source frame) at that time as a clip image, and clips the clip area. Save in 54. In response to this, the display control unit 44 displays the clip window W4 (see FIG. 11 and the like) on the basic screen W1. A clip image is displayed in the clip window W4. Note that the basic screen W1 in FIG. 11 is the basic screen W1 when the clip button T6 is pressed on the basic screen W1 in FIG.

  The display window W2 and the clip window W4 are arranged in a predetermined area on the basic screen W1. The user operates the input unit 20 to place the arbitrary windows W2 and W4 in the display window W2 and the clip window W4 displayed in the predetermined area at arbitrary positions in the predetermined area. Can be moved. When the display control unit 44 detects an operation of moving the windows W2 and W4 by the user, the display control unit 44 changes the positions of the windows W2 and W4 in real time within the predetermined area.

  When the clip window W4 is created, the window selection pull-down menu T1 accepts selection of one window W2, W4 from the display window W2 and clip window W4 as the active window from the user.

  In the window frame W2a of the display window W2, the time of the frame currently displayed in the display window W2 and the display window name for identifying the display window W2 from other display windows W2 are displayed. . The frame time is the time on the timeline to which the frame belongs. Therefore, the user can specify the order n on the timeline of the frame currently displayed in the display window W2 by referring to the time in the window frame W2a of the display window W2.

  Further, the time of the clip image currently displayed in the clip window W4 and the display window name are also displayed in the window frame W4a of the clip window W4. The time of the clip image is the time of the copy source frame. The display window name in the window frame W4a of the clip window W4 is the display window name of the display window W2 to which the copy source frame of the clip image currently displayed in the clip window W4 belongs. Therefore, when the user looks at the window frame W4a of the clip window W4, the user can determine which frame of which display window W2 the clip image in the clip window W4 is derived from. Note that the characters “clip” are also displayed in the window frame W4a of the clip window W4. Accordingly, as shown in FIG. 11, the display window W2 and the clip window W4 have similar GUIs (graphical user interfaces), but the user can easily distinguish them.

  When the clip window W4 is active, the display control unit 44 invalidates the playback button T2, the frame advance button T3, the frame return button T4, and the timeline bar T5, and these objects T2 to T5 accept operations from the user. Do not. In addition, when the clip window W4 is active, the display control unit 44 displays the divided area corresponding to the copy source frame on the timeline bar T5 and the other divided areas in different modes. Therefore, the user can easily determine the order n on the timeline of the duplication source frame by referring to the timeline bar T5.

  When the clip management unit 43 detects that the user has pressed the clip button T6, the clip management unit 43 creates the clip history file 54a by referring to the history information in the history file 53a corresponding to the copy source frame, Save in the clip area 54. The clip history file 54a is created for each clip image.

The clip history file 54a stores information on the execution history (hereinafter, clip history) of the image processing module executed up to the clip image corresponding to the clip history file 54a. Specifically, the clip management unit 43 duplicates the history file 53a of the source frames as a clip history file 54a, from the clip history file 54a, whole the <m> Tab m = 0 and m> _{m s} to erase. Furthermore, the clip management unit 43 from the clip history file 54a, and whole erased <still image file> tabs in <m> Tab 1 ≦ m ≦ m _s, and add a <clip image file> Tab To do. Accordingly, in the clip history file 54a, links to all still images belonging to the copy source frame are lost. In the <Clip Image File> tab, the address path and file name of the clip image are described. The clip history file 54a in FIG. 12 corresponds to the state in FIG. In the state of FIG. 11, since the coordinate _ms is the upper limit value, there is no <m> tab that has been erased entirely in addition to the <0> tab in the clip history file 54a of FIG.

  As shown in FIG. 11, when the clip window W4 is active, the history window W3 displays the details of the clip history of the clip image corresponding to the clip window W4. The details of the clip history are determined by referring to the clip history file 54a.

Further, as shown in FIGS. 11 and 13, in the history window W3 corresponding to the clip image, the initial state area E3, the module, and the module are similar to the history window W3 corresponding to an arbitrary frame on the display window W2. The name area E4 is displayed side by side. The initial state area E3 corresponds to the initial state (0th-order still image) of the copy source frame. The module name area E4 has a one-to-one correspondence with the image processing module executed on the 0th-order still image of the copy source frame up to the clip image. Therefore, the number of initial state areas E3 is one, and the number of module name areas E4 is equal to the number of image processing modules executed for the 0th-order still image of the copy source frame up to the clip image. The same. Incidentally, the uppermost column area E4 corresponds to the originally executed image processing module to copy source frame, area E4 of the lowermost column corresponds to the image processing module executed the m _s th. In the module name area E4, the name of the image processing module corresponding to the area E4 is displayed.

  Moreover, even if the areas E3 and E4 are selected in the history window W3 corresponding to the clip image, the display in the clip window W4 is not switched. In the present embodiment, the image processing module cannot be executed for a clip image. That is, the role of the history window W3 corresponding to the clip image is mainly to display clip history information.

  By the way, the image processing program 2 has a function of deleting an arbitrary frame on the timeline corresponding to an arbitrary display window W2 in accordance with a user instruction. Specifically, when the control unit 40 detects that the user has performed a predetermined operation on the basic screen W1 via the input unit 20, the control unit 40 deletes the selected frame group from the active timeline. When the selected frame group is deleted, all still image groups belonging to the selected frame group and all history files 53a corresponding to the selected frame group are deleted from the software management area 50.

  In addition, the image processing program 2 has a function of deleting an arbitrary clip image in accordance with a user instruction. Specifically, when the clip management unit 43 detects that the user has performed a predetermined operation on the basic screen W1 via the input unit 20, the clip management unit 43 deletes the clip image from the clip area 54 and The clip history file 54a corresponding to the image is deleted from the clip area 54. At the same time, the display control unit 44 deletes the clip window W4 corresponding to the deleted clip image from the basic screen W1.

  When the user deletes the copy source frame by using the above-described frame deletion function, the clip management unit 43 automatically deletes the clip image copied from the copy source frame from the clip area 54. At the same time, the clip management unit 43 automatically deletes the clip history file 54 a corresponding to the deleted clip image from the clip area 54. At the same time, the display control unit 44 deletes the clip window W4 corresponding to the deleted clip image from the basic screen W1. Note that that the copy source frame is deleted means that the object to be compared with the clip image is deleted. Accordingly, in conjunction with the deletion of the object to be compared, information regarding clip images that are no longer necessary is deleted from the software management area 50. As a result, the user does not have to delete the clip image that is no longer necessary using the clip image deletion function described above, and the user's workability is improved.

<2-6-1. Example of using the clip function>
As described above, the still image group and history belonging to one frame are managed along one route (processing order m) in the software management area 50, and are not managed by branching. Then, by switching only the display in the active display window W2, even if different image processing modules are executed for still images of the same coordinate m belonging to the same frame, different still images obtained as a result can be compared. Have difficulty. However, if the clip function is used, such still images can be easily compared. Hereinafter, usage examples of the clip function will be described.

  For example, the user executes a still image (hereinafter referred to as a first comparison image) in which all the image processing modules displayed in the history window W3 in FIG. 6 are executed, and an image displayed in the history window W3 in FIG. Consider a case where the processing module desires to compare a still image (hereinafter referred to as a second comparison image) in which all processing modules have been executed. As can be seen from FIG. 6 and FIG. 10, the first comparison image and the second comparison image were executed until reaching the m-th still image (hereinafter referred to as the branching source image) of m = 3. The image processing module is the same. The first comparison image is a still image obtained by executing image processing (hereinafter referred to as first comparison processing) in which the image processing modules for level correction and noise removal are combined in this order with respect to the branch original image. On the other hand, the second comparison image is a still image obtained by executing a sharpness image processing module (hereinafter referred to as second comparison processing) on the branch original image.

  In such a case, the user clicks the clip button T6 in a state in which the history window W3 in FIG. 6 is displayed on the basic screen W1, that is, in a state in which the first comparison image is displayed in the active display window W2. Press. As a result, the first comparison image is stored as a clip image in the clip area 54, and a clip window W4 for displaying the first comparison image is displayed on the basic screen W1. At the same time, the history information up to the first comparison image displayed in the history window W3 in FIG. 6 is appropriately changed to the clip history information up to the first comparison image, and is stored in the clip area 54. Saved. At this time, the active window is the clip window W4. Therefore, in this state, the clip history information up to the first comparison image is displayed in the history window W3.

Subsequently, the user switches the active window to the display window W2 to which the copy source frame belongs. Then, in this state, the user decrements the coordinate m _s of the active display frame by two to bring the history window W3 into the state shown in FIG. In this state, the branch source image is displayed in the active display window W2. Then, from this state, the user executes the second comparison process on the branch source image to bring the history window W3 into the state shown in FIG. In this state, the second comparison image is displayed in the active display window W2.

  When the above operation is completed, the display screen W1 is in the state shown in FIG. On the display screen W1 of FIG. 14, an active display window W2 for displaying the second comparison image and a clip window W4 for displaying the first comparison image are displayed side by side. Therefore, the user can easily determine which comparison image is appropriate while comparing the first comparison image and the second comparison image simultaneously displayed on the display screen W1 of FIG. . Therefore, if the branch source image is desired to be clarified, the user may determine which of the two is clearer.

  Here, it is assumed that it is determined that the first comparison image displayed in the clip window W4 is more appropriate than the second comparison image displayed in the active display window W2. In this state, the user can display the clip history information in the history window W3 by switching the active window to the clip window W4. As a result, the user can know the contents of appropriate image processing (a combination of one or more image processing modules) leading to the first comparison image by referring to the history window W3. That is, the user can specify the content of the first comparison process as appropriate image processing for the branch source image.

  Thereafter, the user applies image processing with appropriate contents up to the first comparison image to the copy source frame as necessary. Specifically, the user sets the basic screen W1 to the state shown in FIG. 15 in which the branch source image is displayed in the active display window W2. Then, from this state, the user may execute the first comparison process specified by referring to the history window W3 earlier with respect to the branch source image in the active display window W2. As a result, a first comparison image is generated instead of the second comparison image belonging to the duplication source frame, and the basic screen W1 is in the state shown in FIG. In the state of FIG. 16, the first comparison image determined to be more appropriate is displayed in both the active display window W2 and the clip window W4. In the history window W3, the contents of the first comparison process determined to be more appropriate are displayed.

  Further, the user can apply image processing with appropriate contents up to the first comparison image to any frame other than the copy source frame on the timeline to which the copy source frame belongs. Incidentally, in general, it is often appropriate to apply the same image processing to a group of frames belonging to the same timeline. This is because it is highly possible that frames belonging to the same timeline were shot under the same shooting conditions using the same camera. In such a case, the user selects a frame group similar to the copy source frame as the selected frame group, and performs image processing with appropriate contents up to the first comparison image specified by referring to the history window W3. Should be executed.

By the way, the image processing program 2 has a function of deleting an execution history of the image processing module corresponding to an arbitrary coordinate m or later belonging to an arbitrary frame in accordance with a user instruction. Specifically, when the control unit 40 detects that the user has performed a predetermined operation on the basic screen W1 via the input unit 20, the control unit 40 selects the selected frame group from the history file 53a corresponding to the selected frame group. remove the history of execution image processing module corresponding to the subsequent coordinate m _s. At the same time, the control unit 40 deletes the still image after the coordinate m _s of the selected frame group from the processing file area 52.

  The user may want to reproduce the state before deleting the history after deleting the execution history of the image processing module using the history deletion function described above. Even in such a situation, when the clip function is executed for a frame related to the deleted history, the history window W3 corresponding to the frame is referred to, and the same as before the history is deleted. The state can be reproduced.

<3. Application>
As described above, the image processing program 2 manages the image data as a still image file group, regardless of whether the image data is taken in from either a still image or a moving image file. Therefore, the image processing program 2 can easily meet the user's desire to arbitrarily perform image processing on any frame in the same timeline. The image processing program 2 has a function of reproducing a still image file group as a moving image. As a result, even if the image data is handled as a still image file group in the image processing program 2, the user can recognize the image data as a moving image. Therefore, the image processing program 2 is particularly useful in scenes where analysis or editing of moving images is performed.

  The image processing program 2 can handle image processing for a wide variety of moving images. For example, when an organization such as the police investigates an incident, the image processing program 2 can also be used to analyze a surveillance video of a security camera. For example, when the user wants to find the optimal video and the optimal image processing method that matches the purpose (for example, clearing of the monitoring video) while performing various image processing on the monitoring video through trial and error There is. In such a case, the user may use the clip function to capture various videos that have been subjected to various image processes and the history of these various image processes. Thereby, the user can find an appropriate image processing method while comparing various videos subjected to various image processes.

<4. Features>
<4-1>
In response to an instruction from the user, the image processing unit 41 executes an arbitrary image processing module (hereinafter referred to as a first specified module) on an arbitrary still image (hereinafter referred to as a specified image), thereby creating a new still image ( Hereinafter, the first still image) can be generated. At this time, the history management unit 42 stores the contents of the first designated module from the designated image to the first still image in the history file 53a as the first still image is generated. Thereafter, the clip management unit 43 copies the first still image as a clip image in response to another instruction from the user. At this time, the clip management unit 43 refers to the history file 53a as the first still image is duplicated, and the contents of the first designated module from the designated image to the clip image are stored in the clip history file 54a. To store. After that, the image processing unit 41 executes an arbitrary image processing module (hereinafter referred to as a second designated module) on the designated image in accordance with an instruction from the user, so that a new one is used as a substitute for the first still image. A still image (hereinafter referred to as a second still image) can be generated. At this time, the history management unit 42 replaces the contents of the first designated module from the designated image to the first still image with the contents of the second designated module from the designated image to the second still image as a history file. Store in 53a.

  That is, in the above embodiment, when the first designation module is executed for the designated image and the first still image is generated, the contents of the first designated module are stored in association with the designated image and the first still image. . When the first still image is duplicated as a clip image, the contents of the first designation module are stored in association with the first still image and the clip image. Further, when the second designation module is executed for the designated image after the first still image is duplicated, a second still image that is substituted for the first still image is generated. Then, instead of the information that associates the designated image and the first still image with the contents of the first designated module, information that associates the designated image and the second still image with the contents of the second processing module is stored in the history file 53a. Is done.

  In other words, a plurality of images (the same clip image and second still image as the first still image) and the contents of the image processing modules (first designation module and second designation module) up to these images are designated. Managed in a manner branched from the image. That is, a plurality of routes for managing images derived from the same designated image and the contents of the image processing are formed. As a result, the image processing program 2 can assist the user in finding an optimal still image and an optimal image processing method while performing various image processing on the same designated image.

  Further, in response to a user instruction, the first still image of the original route among the plurality of routes that manage the image derived from the same designated image and the content of the image processing is updated by the second still image, and the original route The contents of the first designated module can be updated with the contents of the second designated module. However, here, the still image before the update (contents of the first still image and the first designated module) is compared with the image after the update (second still image and the second designated module). be able to.

<4-2>
In the above embodiment, the display control unit 44 executes the image processing module on the first comparison image (clip image) branched from the branch source image and the second comparison image (the same still image as the clip image belonging to the duplication source frame). Still image) can be displayed on the basic screen W1 at the same time. Therefore, the user can easily compare a plurality of still images (for example, the first comparison image and the second comparison image) branched from the same still image (for example, the branch original image).

<4-3>
In the above embodiment, the display control unit 44 can simultaneously display the first comparison image (clip image) and the history information (clip history information) up to the first comparison image on the basic screen W1. it can. The display control unit 44 also displays the second comparison image (the still image obtained by executing the image processing module on the same still image as the clip image belonging to the copy source frame) and the history information up to the second comparison image. They can be displayed simultaneously on the basic screen W1. Therefore, the user performs a plurality of image processing (for example, the first comparison image) up to each of a plurality of still images (for example, the first comparison image and the second comparison image) branched from the same still image (for example, the branch original image). The contents of the process and the second comparison process) can be easily compared.

<4-4>
In the above embodiment, the image processing unit 41 can generate a plurality of still images by executing the same or different image processing on different still images belonging to different frames on the same timeline. Therefore, it is possible to systematically manage a plurality of still images on the same timeline, all still images derived from the plurality of still images, and all image processing contents.

<5. Modification>
As mentioned above, although one Embodiment of this invention was described, this invention is not limited to the said embodiment, A various change is possible unless it deviates from the meaning. For example, the following changes can be made.

<5-1>
In the above embodiment, the clip function, only the m _s next still picture belonging to the active display frame was designed to be replicated. That is, in the above embodiment, the clip function, only the m _s next still picture belonging to one of the frame were designed to be replicated. However, a plurality of still images belonging to a plurality of frames may be duplicated by the clip function. For example, when the clip button T6 is pressed, all still images of the coordinate m _s of one or more frames included in the selected frame group at that time may be copied.

<5-2>
In the above embodiment, only the m _sth still image of the active display frame is duplicated by the clip function. That is, in the above embodiment, only one still image belonging to the active display frame is duplicated by the clip function. However, a plurality of still images belonging to the active display frame, for example, all still images belonging to the active display frame may be duplicated by the clip function. In that case, still images corresponding to the areas E3 and E4 selected on the history window W3 may be displayed in the active display window W2.
<5-3>
In the above embodiment, the image processing module cannot be executed on the clip image. However, this may be possible.

<5-4>
In the above embodiment, the display control unit 44 can simultaneously display the first comparison image (clip image) and the history information (clip history information) up to the first comparison image on the basic screen W1. However, instead of this, both may be displayed while being switched on the display screen W1. In the above embodiment, the display control unit 44 includes the second comparison image (the still image obtained by executing the image processing module on the same still image as the clip image belonging to the duplication source frame) and the second comparison image. The history information can be displayed on the basic screen W1 at the same time, but instead, the two may be displayed while being switched on the display screen W1. Also in this modified example, the user performs a plurality of image processing (for example, the first comparison image and the second comparison image) respectively leading to a plurality of still images (for example, the first comparison image and the second comparison image) branched from the same still image (for example, the branch original image). , The contents of the first comparison process and the second comparison process) can be easily compared.

<5-5>
In the above embodiment, all the image data captured in the original image area 51 is stored as a still image file. However, the image data captured in the original image area 51 may be saved as a moving image file. Whether the format of the image data in the original image area 51 is a still image format or a moving image format may be selectable by the user, or automatically determined according to the format of the image data of the capture source, etc. You may be made to do. Further, after that, when image processing is performed on the moving image file, the image data after the image processing may be stored in the moving image file format.

1 Image processing device (computer)
2 Image processing program 41 Image processing unit 43 Clip management unit (replication unit)
53 History area (first history storage unit)
54 clip area (second history storage unit)

Claims (7)

Generating a second image by performing first image processing on the first image;
Storing a first history indicating that the second image is an image generated by performing the first image processing on the first image;
Replicating the second image as a third image;
Referring to the first history, storing in the computer a second history indicating that the third image is an image generated by executing the first image processing on the first image. To execute,
Image processing program. Generating a fourth image instead of the second image by performing second image processing on the first image after the duplicating step;
Storing, in place of the first history, a third history indicating that the fourth image is an image generated by executing the second image processing on the first image; To execute,
The image processing program according to claim 1. Causing the computer to further execute the step of simultaneously displaying the third image and the fourth image;
The image processing program according to claim 2. Causing the computer to further execute the step of displaying the third image and the second history at the same time or displaying them while switching and the step of displaying the fourth image and the third history at the same time or displaying them while switching.
The image processing program according to claim 2 or 3. Generating a sixth image by performing third image processing on a fifth image on the same timeline as the first image;
Storing the fourth history indicating that the sixth image is an image generated by executing the third image processing on the fifth image, and causing the computer to execute the step.
The image processing program according to claim 1. The step of generating the second image is a step of generating the second image in response to an instruction from a user who orders execution of the first image processing on the first image,
The step of storing the first history is a step of storing the first history as the second image is generated.
The step of duplicating is a step of duplicating the second image as the third image in response to an instruction from a user who orders the duplication;
The step of storing the second history is a step of storing the second history as the second image is duplicated.
The image processing program according to claim 1. An image processing unit that generates a second image by executing first image processing on the first image;
A first history storage unit that stores a first history indicating that the second image is an image generated by executing the first image processing on the first image;
A duplicating unit that duplicates the second image as a third image;
A second history storage unit that stores a second history indicating that the third image is an image generated by executing the first image processing on the first image with reference to the first history. With
Image processing device.