JP2010134768A - Device and method for generating moving image having image feature composed therein, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device and method for generating a moving image having image features composed therein, capable of enhancing the features of an image while maintaining the image quality of the image, and to provide a program. <P>SOLUTION: The device for generating the moving image having image features composed therein includes: an edge-enhanced image generation unit which generates a plurality of edge-enhanced images obtained by enhancing edges in a plurality of directions with respect to a target image of composition; a composite image generation unit which generates a plurality of composite images resulting from composing the plurality of edge-enhanced images and a source image of composition; and a composite moving image generation unit which generates a composite moving image wherein the plurality of composite images are consecutively switched and displayed. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image feature synthesized moving image generating apparatus, an image feature synthesized moving image generating method, and a program.

For example, a technique is known in which texture enhancement processing, edge enhancement processing, or the like is performed on a satellite image or the like to enhance and visualize the characteristics of the image (for example, see Patent Document 1). In addition, examples of these processing target images include medical images, advertisement images, traffic sign images, microscope images, and experimental measurement images.
The texture, roughness, and the like of the image are extracted by texture enhancement processing, and the edge (edge) is enhanced by edge enhancement processing. By these processes, the characteristics of the image are emphasized.
JP 2005-234603 A

  However, when the above-described emphasis processing such as texture and edge is performed, the feature of the image is enhanced, but the image quality of the image is degraded. In other words, these feature enhancement processes have been aimed at emphasizing specific features in the image and have sacrificed the image quality. For example, the relationship between the image subjected to the feature enhancement process and the original image before the process is performed. It was difficult to read.

  The present invention has been made in view of such a problem, and an object of the present invention is to provide an image feature synthesis movie generation apparatus, an image feature synthesis movie generation method, and an image feature synthesis movie generation method capable of enhancing the features of the image while maintaining the image quality. And providing a program.

  An invention for solving the above-described problems includes an edge-enhanced image generation unit that generates a plurality of edge-enhanced images in which edges in a plurality of directions are emphasized with respect to a synthesis target image, and the plurality of edge-enhanced images and a synthesis source image. An image feature synthesized moving image generating apparatus including a synthesized image generating unit that generates a plurality of synthesized images, and a synthesized moving image generating unit that generates a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed. is there.

  In the image feature synthesis moving image generating apparatus, it is preferable that the synthesis target image is an image in which a predetermined element is emphasized.

  In the image feature composition moving image generating apparatus, it is preferable that the predetermined element is a texture or an edge.

  In the image feature synthesis moving image generation apparatus, the synthesis target image may be an image different from the synthesis source image.

  In the image feature synthesis moving image generating apparatus, the synthesis target image may be the same image as the synthesis source image.

  In the image feature synthesis moving image generating apparatus, the synthesis source image may include a red image, a green image, and a blue image.

  Further, the invention for solving the above-described problem is that a plurality of edge-enhanced images in which edges in a plurality of directions are emphasized with respect to a synthesis target image are generated, and the plurality of edge-enhanced images and a synthesis source image are synthesized. Is generated, and a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed is generated.

  In addition, the invention for solving the above-described problems includes a computer that generates a plurality of edge-enhanced images in which edges in a plurality of directions are emphasized with respect to a synthesis target image, and the plurality of edge-enhanced images and a synthesis source image. Is a program for executing a procedure for generating a plurality of synthesized images obtained by synthesizing the images and a procedure for generating a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed.

  Further, the invention for solving the above problems includes an embossed image generating unit that generates a plurality of embossed images in which a plurality of directions are regarded as light sources with respect to a compositing target image in which predetermined elements are emphasized, and the plurality of embossed images And a composite video generation unit that generates a composite video that generates a composite video in which the plurality of composite images are continuously switched and displayed. It is a synthetic moving image generating apparatus.

  Further, the invention for solving the above-described problem is to generate a plurality of embossed images in which a plurality of directions are regarded as light sources with respect to a compositing target image in which a predetermined element is emphasized, and the plurality of embossed images and the composition original image are generated. This is an image feature synthesized moving image generating method that generates a plurality of combined images that are respectively combined and generates a combined moving image in which the plurality of combined images are continuously switched and displayed.

  Further, the invention for solving the above-described problems includes a computer that generates a plurality of embossed images in which a plurality of directions are regarded as light sources for a synthesis target image in which predetermined elements are emphasized, and the plurality of embossed images. And a procedure for generating a plurality of synthesized images obtained by synthesizing each of the source images and a procedure for generating a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed.

  According to the present invention, it is possible to emphasize the features of the image while maintaining the image quality.

=== System configuration ===
A configuration example of the image feature synthesis moving image generation system of the present embodiment will be described with reference to FIGS. 1 to 7.
FIG. 1 is a block diagram illustrating a configuration example of an image feature synthesis moving image generation system. FIG. 2 is a block diagram illustrating a configuration example of the client 10 in the system of FIG. FIG. 3 is a block diagram illustrating a configuration example of the image feature synthesis moving image generation apparatus 20 in the system of FIG. FIG. 4 is a functional block diagram of the image feature synthesis moving image generating apparatus 20 of FIG. FIG. 5 is a schematic diagram illustrating an example of the irradiation direction of virtual light in the embossing process. FIG. 6 is a schematic diagram illustrating an example of a filter coefficient in the embossing process. FIG. 7 is a schematic diagram illustrating an example of the embossing process.

  As illustrated in FIG. 1, the image feature synthesis movie generation system includes a client 10 and an image feature synthesis movie generation device 20. Here, the client 10 and the image feature composition moving image generating apparatus 20 are connected to be communicable via the network 30.

  The client 10 is, for example, an information processing apparatus such as a personal computer, a portable information terminal, or a mobile phone. The client 10 transmits an image (composition original image and composition target image) to the image feature composite video generation device 20 via the network 30, and the video generated and transmitted by the image feature composite video generation device 20. (Image feature composite animation) is displayed.

  The image feature synthesized moving image generating apparatus 20 is an information processing apparatus such as a PC server or a workstation. The image feature synthesis moving image generating apparatus 20 generates a moving image for highlighting the image feature from the client 10, and transmits the moving image to the client 10 via the network 30.

  The network 30 is, for example, the Internet, a LAN (Local Area Network), or the like, and connects the client 10 and the image feature synthesis moving image generating apparatus 20 so as to communicate with each other. The network 30 can be wired or wireless.

In addition, the composition original image of the present embodiment means an image obtained from an observation apparatus and not subjected to feature enhancement processing, for example.
Further, the composition target image of the present embodiment is, for example, an image that is a compositing partner with the composition original image, and that has not been subjected to feature enhancement processing having a directionality for enhancing the characteristics of the observation target. Means.
Further, the image feature synthesis moving image of the present embodiment means a moving image generated based on the above-described composition source image and composition target image, as will be described later.

<<< Client configuration >>>
As illustrated in FIG. 2, the client 10 includes a CPU (Central Processing Unit) 40, a memory 41, a storage device 42, a display interface (I / F) 43, and an input interface (I / F) 44. A communication interface (I / F) 45 and a recording medium reading device 46 are provided.

  The CPU 40 executes a program stored in the memory 41 to control the client 10 and implement various functions in the client 10. The memory 41 is, for example, a RAM (Random Access Memory) or the like, and is used as a temporary storage area for programs and data. The storage device 42 is a storage area such as a hard disk, for example, and stores programs, various data, and the like. The display interface 43 is an interface device such as a video card for displaying an image on the display device 50 such as a display.

  The input interface 44 is an interface device such as USB (Universal Serial Bus) or PS / 2 (Personal System / 2) for inputting data from the input device 51 such as a keyboard, a mouse, and various digital devices. The communication interface 45 is an interface device such as a network card for transmitting and receiving data via the network 30. The recording medium reader 46 is an interface device such as a CD-ROM drive or a memory card interface for reading programs and various data stored in the recording medium 52 such as a CD-ROM or a memory card.

  The client 10 can read an image (combination original image, composition target image) from the recording medium 52 and store it in the storage device 42, for example. The client 10 can also acquire an image from another information processing apparatus (not shown) via the network 30, for example. Further, the client 10 can acquire an image using an image scanner, a digital camera, or the like as the input device 51.

<<< Configuration of image feature composition video generation device >>>
As illustrated in FIG. 3, the image feature synthesis moving image generating apparatus 20 includes a CPU 60, a memory 61, a storage device 62, a communication interface 63, and a recording medium reading device 64.

  The CPU 60 executes the program stored in the memory 61, thereby controlling the image feature synthesized moving image generating apparatus 20 in an integrated manner and realizing various functions in the image feature synthesized moving image generating apparatus 20. The memory 61 is a RAM, for example, and is used as a temporary storage area for programs and data. The storage device 62 is a storage area such as a hard disk, and stores programs, various data, and the like. The communication interface 63 is an interface device such as a network card for transmitting and receiving data via the network 30. The recording medium reading device 64 is an interface device such as a CD-ROM drive or a memory card interface for reading programs and various data stored in the recording medium 53 such as a CD-ROM or a memory card.

  As illustrated in FIG. 4, the image feature synthesis moving image generation device 20 described above includes an embossed image generation unit 70, an edge enhanced image generation unit 71, an image feature synthesis image generation unit (synthetic image generation unit) 72, An image feature synthesized moving image generating unit (synthesized moving image generating unit) 75 and a feature enhancement processing unit 76 are provided. These functional blocks 70, 71, 72, 75, 76 are realized by the CPU 60 executing a program stored in the memory 61.

<Embossed image generator>
The embossed image generation unit 70 reads out the compositing target image from the memory 61, and generates a plurality of embossed images that regard a plurality of directions as light sources for the compositing target image. The plurality of generated embossed images are stored in the memory 61.

  As illustrated in FIG. 5, the embossed image generation unit 70 can generate eight embossed images with the irradiation direction as eight directions shifted by 45 degrees clockwise with the north side of the compositing target image as 0 degrees. In this case, the filter coefficient used for the embossing process in each irradiation direction can be, for example, a 3 × 3 matrix shown in FIGS. Note that the filter coefficients shown in FIGS. 6A to 6H are examples, and numerical values (weights) in the matrix and the size of the matrix can be changed.

  An example of the embossing process in the embossed image generation part 70 is shown. In the present embodiment, it is assumed that the image density value of each pixel of the synthesis target image is, for example, 8 bits (0 to 255). As illustrated in FIG. 7, the center value of a 3 × 3 pixel indicating a part of the synthesis target image before the embossing process is “18”, the upper left value is “5”, and the lower right value is “135”. ”. At this time, when emboss processing is performed using the filter coefficient shown in FIG. 6D, the value after emboss processing of the 3 × 3 center pixel is (−5 + 135) + 128 = 258. However, when the value after the embossing process exceeds “255”, the embossed image generation unit 70 adjusts the image density value to be 255 or less. In this way, the embossing process is performed on each pixel of the compositing target image.

<Edge-enhanced image generator>
The edge-enhanced image generation unit 71 reads the synthesis target image from the memory 61, and generates a plurality of edge-enhanced images in which edges (predetermined elements) in a plurality of directions are enhanced with respect to the synthesis target image. The generated plurality of edge-enhanced images are stored in the memory 61. Specifically, edge enhancement in a plurality of directions is performed by a filter that emphasizes the edge direction exemplified below. That is, for example, a primary differential / difference type Prewitt filter, a primary differential / template type Robinson filter, and the like are applicable.

<Image feature composite image generator>
For example, the image feature composite image generation unit 72 reads a plurality of edge-enhanced images from the memory 61, and synthesizes a combination original image read from the memory 61 with each of the plurality of edge-enhanced images. The image feature composite image is generated. In addition, the image feature composite image generation unit 72 reads, for example, a plurality of embossed images from the memory 61, and synthesizes a composite original image read from the memory 61 with each of the plurality of embossed images. The image feature composite image is generated. The plurality of image feature composite images generated as described above are stored in the memory 61.

<Image feature synthesis movie generator>
The image feature synthesized moving image generating unit 75 reads a plurality of edge enhanced images stored in the memory 61 and generates an image feature synthesized moving image in which these edge enhanced images are continuously switched and displayed. In addition, the image feature synthesized moving image generating unit 75 reads a plurality of embossed images stored in the memory 61 and generates an image feature synthesized moving image in which these embossed images are continuously switched. The image feature synthesized moving image generated as described above is stored in the memory 61.

  For example, in the case of eight embossed images having eight directions as irradiation directions (see FIG. 5), a moving image that repeatedly displays eight embossed images while switching them at a predetermined interval, for example, clockwise can be used as an image feature synthesized moving image. Note that the order in which the embossed images are switched in the image feature synthesized moving image is not limited to the clockwise direction, but may be the counterclockwise direction or may be random. Further, the interval at which the embossed image is switched can be made variable.

  In addition, in the image feature synthesis moving image, any two embossed images whose irradiation directions are 180 degrees may be repeatedly displayed while being switched. Referring to FIG. 5, for example, the display is switched between two embossed images whose irradiation directions are 0 degrees (north) and 180 degrees (south) in one direction, such as north to south and south to north. Alternatively, two embossed images having irradiation directions of 45 degrees (northeast) and 225 degrees (southwest) may be switched and displayed in one direction from northeast to southwest and southwest to northeast.

  Further, any two embossed image sets whose irradiation directions are 180 degrees with respect to each other are selected, and the above-described one-way switching display is alternately performed for the two sets. Good. Referring to FIG. 5, for example, a first set of two embossed images having an irradiation direction of 315 degrees (northwest) and 135 degrees (southeast), and an irradiation direction of 45 degrees (northeast) and 225 degrees (southwest) ) To select the second set of embossed images, and alternately display the switching from northwest to southeast and southeast to northwest in the first set, and the switching display from northeast to southwest and southwest to northeast in the second set. Such a switching display may be used.

  The same applies to the case where the image feature composite image is composed of a plurality of edge-enhanced images corresponding to a plurality of edge directions.

  Thereby, since the images whose irradiation direction and edge direction are opposite to each other are switched, enhancement of image features described later is improved.

<Feature enhancement processing section>
The feature enhancement processing unit 76 reads the synthesis target image from the memory 61, and performs texture enhancement processing, edge enhancement processing, and the like on the synthesis target image. The compositing target image that has been subjected to the feature enhancement processing is stored in the memory 61. Specifically, in the texture enhancement process, for example, a feature amount of a texture (predetermined elements) such as correlation, dispersion, contrast, and entropy is obtained. In the edge enhancement process, for example, a second-order differential Laplacian filter or the like is used. Applied.

<<< Client screen >>>
A screen displayed on the display (display device 50) of the client 10 will be described with reference to FIGS. FIG. 8 is a schematic diagram illustrating an example of a moving image generation screen 100 for generating an image feature synthetic moving image. FIG. 9 is a schematic diagram illustrating an example of a moving image display screen 130 for displaying an image feature synthesized moving image.

<Video generation screen>
As illustrated in FIG. 8, a moving image generation screen 100 for inputting conditions and the like for generating an image feature combined moving image includes a combining source image input area 110, a combining target image input area 111, and a moving image generation condition. It is divided into a selection area 112 and a moving image generation button 113. For example, the user of the client 10 moves the cursor to each of the areas 110, 111, 112 and the button 113 on the screen through the mouse (input device 51), and then performs a predetermined input through the mouse and the keyboard (input device 51). It is supposed to do.

  The moving image generation screen 100 is, for example, HTML transmitted from the image feature composition moving image generation apparatus 20 when the client 10 refers to a predetermined URL (Uniform Resource Locator) of the image feature composition moving image generation apparatus 20 from a Web browser or the like. (Hyper Markup Text Language) etc. The moving image generation screen may be activated by a program inside the client 10 without accessing the image feature synthesis moving image generation apparatus 20.

  In the composition source image input area 110, the storage destination (file path name, etc.) of the composition source image is input. In the composition source image input area 110, the input composition source image is further converted into RGB images (R image (red image), G image (green image), and B image (blue image)), single band image, The panchromatic image and the panchromatic image are selected. Here, when a single band image is selected, which band image (for example, only an R image) is further selected.

The compositing target image input area 111 further includes an input image input area 111a for inputting information related to the input image as a source of the compositing target image, and a type of feature enhancement processing performed on the input image. It is divided into a feature enhancement processing input area 111b.
In the input image input area 111a, whether or not the input image is a composition source image is selected, and when the input image is selected as an image other than the composition source image ("other") The input image storage destination (file path name, etc.) is input.
In the feature enhancement processing input area 111b, whether or not to perform the feature enhancement processing on the input image is selected, and the features when the feature enhancement processing is selected on the input image ("Yes") are selected. The type of enhancement processing (for example, texture enhancement processing or edge enhancement processing) is selected.

  The moving image generation condition selection area 112 is further divided into a direction selection area 112a, a filter selection area 112b, a display order selection area 112c, and a display speed selection area 112d.

In the direction selection area 112a, the irradiation direction when the embossing process is performed on the compositing target image is selected, and the edge direction when the edge emphasizing process is performed on the compositing target image is selected. Yes. In the present embodiment, any one of the four directions, the eight directions, and the sixteen directions is selected.
In the filter selection area 112b, the type of feature enhancement processing having directionality applied to the synthesis target image is selected. In this embodiment, pattern embossing processing, pattern B embossing processing, pattern C embossing processing, edge emphasis processing using a Perwitt filter, edge emphasis processing using a Robinson filter, and Laplacian filter are used as feature emphasis processing having directionality. Any one of the edge enhancement processes is selected. Here, patterns A to C represent different filter coefficients (matrix size, weight, etc.) for emboss processing.
In the display order selection area 112c, the display order of the embossed image and the edge-enhanced image in the image feature composition moving image is selected. In the present embodiment, any one of clockwise, counterclockwise, random, one-way, and brushing is selected.
In the display speed selection area 112d, the speed at which the embossed image and the edge-enhanced image are switched in the image feature composition moving image is selected. In the present embodiment, any one of 4 fps (flame per second), 8 fps, and 16 fps is selected.

  The moving image generation button 113 is used to transmit information selected or input in each of the above-described areas 110 to 112 to the image feature synthesis moving image generation apparatus 20.

<Movie display screen>
As illustrated in FIG. 9, the moving image display screen 130 on which the image feature combined moving image is displayed displays an image feature combined moving image display area 135. In this embodiment, the moving image display screen 130 is realized by HTML or the like transmitted from the image feature synthesis moving image generating device 20 after the moving image generation button 113 of the moving image generation screen 100 is pressed. In other words, in this image feature composite video display area 135, a video transmitted from the image feature composite video generation device 20 is displayed. The moving image displayed in the image feature synthesized moving image display area 135 is realized by, for example, Macromedia Flash (registered trademark).

=== System behavior ===
An operation example of the image feature synthesis moving image generation system according to the present embodiment will be described with reference to FIGS. 10 to 13.
FIG. 10 is a flowchart illustrating an example of a processing procedure of the image feature synthesis moving image generation system. FIG. 11 is a flowchart illustrating an example of a processing procedure of the image feature synthesis moving image generating apparatus 20. FIG. 12 is an image diagram of the image feature synthesis moving image generation processing. FIG. 13 is another image diagram of the image feature synthesis moving image generation processing.

<<< Operation of Image Feature Synthesis Movie Generation System >>>
As illustrated in FIG. 10, in the client 10, a composition source image and a composition target image are selected (S1001). Specifically, in the moving image generation screen 100, in the composition source image input area 110 and the input image input area 111a of the composition target image input area 111, the storage destination of the composition original image and the input as the source of the composition target image The image storage destination is input.

  Further, the client 10 selects information related to the feature enhancement processing for the input image as the source of the compositing target image (S1002). Specifically, in the feature emphasis processing input area 111b of the compositing target image input area 111 on the moving image generation screen 100, information related to the feature emphasizing processing for the input image as the source of the compositing target image (applied / not applied / applied). Type of feature enhancement processing in the case).

  Furthermore, in the client 10, a moving image generation condition for generating an image feature composite moving image is selected (S1003). Specifically, a direction, a filter (emboss / edge emphasis), a display order, and a display speed are selected in the moving image generation condition selection area 112 on the moving image generation screen 100.

When the movie generation button 113 on the movie generation screen 100 is pressed, the client 10 transmits the input or selected image and the movie generation condition to the image feature synthesis movie generation device 20 (S1004).
The image feature composition moving image generating apparatus 20 receives the image and moving image generating conditions transmitted from the client 10 (S1005) and stores them in the memory 61.
The image feature synthesis moving image generation apparatus 20 reads the image and the movie generation conditions from the memory 61, executes the image feature synthesis movie generation processing (S1006), and stores them in the memory 61.
The image feature synthesized moving image generation apparatus 20 reads the image feature synthesized movie from the memory 61 and transmits it to the client 10 (S1007).
The client 10 receives the image feature synthesized moving image transmitted from the image feature synthesized movie generating apparatus 20 (S1008), and displays the movie in the image feature synthesized movie display area 135 of the image display screen 130 (S1009).

<<< Operation of the image feature composition video generator >>>
With reference to FIGS. 11 to 13, the above-described image feature synthesis moving image generation processing (S1006) will be described in detail.

  As illustrated in FIG. 11, the image feature synthesis moving image generation device 20 reads out a synthesis source image, a synthesis target image, and a video generation condition stored in the memory 61, and will be described below according to the designated information. Execute the process.

  The image feature synthesis moving image generating apparatus 20 determines whether the synthesis source image 152 is designated as a color image, a single band image, or a panchromatic image (S1101). If it is determined that the composition source image 152 is designated as a color image (S1101: “color”), the R image 152R, the G image 152G, and the B image 152B are synthesized (S1102, FIGS. 12 and 13). Process C), and the color image 170 obtained thereby is stored in the memory 61 as a composition original image. On the other hand, when it is determined that the composition source image 152 is designated as a single band image or a panchromatic image (S1101: “single band”, “panchromatic”), the composition source image 152 is designated as well. And is stored in the memory 61. Note that the color image 170 may be stored in advance in the memory 61 as the composition source image 152.

  Further, the image feature synthesis moving image generating apparatus 20 performs the feature enhancement process on the input image 150 as the synthesis target images 150 and 151 to obtain the texture or edge enhancement image 151, and does not perform the feature enhancement process on the input image 150. , Which one is designated is discriminated (S1103). If it is determined that the input image 150 is designated to be subjected to feature enhancement processing (S1103: “Yes”), the feature enhancement processing unit 76 performs feature enhancement processing on the input image 150 (S1104, FIG. 12 and processing A) of FIG. 13, and the texture or edge-enhanced image 151 obtained thereby is stored in the memory 61 as a synthesis target image. On the other hand, when it is determined that it is specified that the feature enhancement processing is not performed on the input image 150 (S1103: “No”), the input image 150 is set as a synthesis target image (S1110).

  Further, the image feature synthesis moving image generating apparatus 20 performs the feature enhancement processing having directionality applied to the synthesis target images 150 and 151 as either the embossing processing or the edge enhancement processing following each of the above-described steps S1104 and S1110. It is determined whether it is designated (S1105 and S1111).

<Process A + B1 + C + D + E>
As described above, the composition source image 152 is the color image 170 obtained by compositing the R image 152R, the G image 152G, and the B image 152B by the process C (S1101: “color”, S1102), and the composition target image 151 Is the texture or edge-enhanced image 151 obtained by performing the feature enhancement process on the input image 150 (S1103: “Yes”, S1104), and the feature enhancement process having directionality applied to the synthesis target image 151 is an edge. When it is designated as enhancement processing (S1105: “edge enhancement”), the image feature synthesis moving image generating apparatus 20 executes processing described below.

  As illustrated in FIG. 11, the edge-enhanced image generation unit 71 performs edge-enhancement processing on the compositing target image 151 read from the memory 61, and, for example, eight edge-enhanced images (monochrome) corresponding to 8 directions in increments of 45 degrees. ) 160a to 160h (collectively referred to as “edge-enhanced image (monochrome) 160”) (S1106, process B1 in FIG. 12), and these are stored in the memory 61.

  The image feature composite image generation unit 72 combines each of the eight edge-enhanced images (monochrome) 160a to 160h read from the memory 61 and the color image 170 read from the memory 61, so that eight image feature composite images are obtained. (Color) 180a to 180h (collectively referred to as “image feature composite image (color) 180”) are generated (process D in FIG. 12), and then the image feature composite video generation unit 75 performs this image feature composite. From the image (color) 180, an image feature synthesis moving image (color) 190 is generated in accordance with the designated display order and display speed (process E in FIG. 12) (hereinafter, S1107). This image feature synthesized moving image (color) 190 is stored in the memory 61.

  According to the illustration of FIG. 12, in the image feature synthesized moving image (color) 190, for example, when the display order is clockwise and the display speed is 4 fps, the image feature synthesized images (color) 180a to 180h are sequentially rightward from 0 degrees. It is displayed while switching around at a rate of 4 frames per second.

<Process A + B2 + C + D + E>
As described above, the composition source image 152 is the color image 170 obtained by compositing the R image 152R, the G image 152G, and the B image 152B by the process C (S1101: “color”, S1102), and the composition target image 151 Is a texture or edge-enhanced image 151 obtained by performing feature enhancement processing on the input image 150 (S1103: “Yes”, S1104), and the feature enhancement processing having directionality applied to the synthesis target image 151 is embossed. When the process is designated (S1105: “emboss”), the image feature composition moving image generating apparatus 20 executes the process described below.

  As illustrated in FIG. 11, the embossed image generation unit 70 embosses the compositing target image 151 read from the memory 61, and, for example, eight embossed images (monochrome) 161 a to 161 a corresponding to eight directions in 45 degrees increments. 161h (collectively referred to as “embossed image (monochrome) 161”) is generated (S1108, process B2 in FIG. 13), and stored in the memory 61.

  The image feature synthesized image generation unit 72 synthesizes each of the eight embossed images (monochrome) 161a to 161h read from the memory 61 and the color image 170 read from the memory 61 to obtain eight image feature synthesized images ( (Color) 181a to 181h (collectively referred to as “image feature composite image (color) 181”) (process D in FIG. 13), and then the image feature composite video generation unit 75 generates the image feature composite image. From the (color) 181, an image feature synthesized moving image (color) 191 is generated in accordance with the designated display order and display speed (process E in FIG. 13) (hereinafter, S 1109). The image feature synthesized moving image (color) 191 is stored in the memory 61.

  According to the illustration of FIG. 13, in the image feature synthesis moving image (color) 191, for example, when the display order is clockwise and the display speed is 4 fps, the image feature synthesis images (color) 181a to 181h are sequentially rightward from 0 degrees. It is displayed while switching around at a rate of 4 frames per second.

<Process A + B3 + C + D + E>
As described above, the composition source image 152 is the color image 170 obtained by compositing the R image 152R, the G image 152G, and the B image 152B by the process C (S1101: “color”, S1102), and the composition target image 150 Is the input image 150 (S1103: “No”, S1110), and the feature enhancement processing having directionality applied to the compositing target image 150 is designated as embossing processing (S1111: “embossing”). If so, the image feature synthesis moving image generating apparatus 20 executes the processing described below.

  As illustrated in FIG. 11, the embossed image generation unit 70 embosses the compositing target image 150 read from the memory 61, for example, eight embossed images (monochrome) 161 a to 161 a corresponding to eight directions in 45 degrees increments. 161h is generated (S1112, process B3 in FIG. 13) and stored in the memory 61.

  The image feature synthesized image generation unit 72 synthesizes each of the eight embossed images (monochrome) 161a to 161h read from the memory 61 and the color image 170 read from the memory 61 to obtain eight image feature synthesized images ( Color) 181a to 181h (process D in FIG. 13), and then the image feature synthesis moving image generation unit 75 generates an image from the image feature synthesis image (color) 181 according to the designated display order and display speed. A feature synthesized moving image (color) 191 is generated (Processing E in FIG. 13) (S1113). The image feature synthesized moving image (color) 191 is stored in the memory 61.

<Process A + B4 + C + D + E>
As described above, the composition source image 152 is the color image 170 obtained by compositing the R image 152R, the G image 152G, and the B image 152B by the process C (S1101: “color”, S1102), and the composition target image 151 Is the input image 150 (S1103: “No”, S1110), and the feature enhancement processing having directionality applied to the synthesis target image 150 is designated as edge enhancement processing (S1111: “edge enhancement”). If it is, the image feature synthesis moving image generating apparatus 20 executes the processing described below.

  As illustrated in FIG. 11, the edge-enhanced image generation unit 71 performs edge-enhancement processing on the compositing target image 150 read from the memory 61, for example, eight edge-enhanced images (monochrome) corresponding to 8 directions in 45 ° increments. ) 160a to 160h are generated (S1114, process B4 in FIG. 12), and these are stored in the memory 61.

  The image feature composite image generation unit 72 combines each of the eight edge-enhanced images (monochrome) 160a to 160h read from the memory 61 and the color image 170 read from the memory 61, so that eight image feature composite images are obtained. (Color) 180a to 180h are generated (Processing D in FIG. 12), and then the image feature synthesis moving image generation unit 75 generates the image feature synthesis image (color) 180 from the specified display order and display speed. An image feature synthesized moving image (color) 190 is generated (processing E in FIG. 12) (S1115 above). This image feature synthesized moving image (color) 190 is stored in the memory 61.

<Same image and different image>
In the above-described image feature synthesis moving image generation processing (S1006), the synthesis target images 150 and 151 are obtained from the same image 152 as the synthesis source image 152 (the same image and the same image), but different from the synthesis source image 152. Any of the image (same kind image) and the image (heterogeneous image) that cannot be obtained from the same image 152 because the observation target, the observation means, and the like are different from the synthesis source image 152 may be used. Here, the observation target includes, for example, an observation period in addition to the target object, and the observation means includes, for example, an observation wavelength in addition to the observation apparatus.

  As an example of the same kind of image described above, there is a case where the composition source image 152 is an image including the R image 152R, the G image 152G, and the B image 152B, and the composition target images 150 and 151 are the R image 152R.

  As an example of the heterogeneous image described above, when the composition source image 152 and the composition target images 150 and 151 are images obtained by observing the same observation target with different observation means, or different observation targets are the same observation means. The case where it is the image obtained by observing in FIG. Specifically, when the composition source image 152 and the composition target images 150 and 151 are images obtained by observing the same object through different optical sensors, the composition source image 152 is an optical sensor image with respect to the same object. When the synthesis target images 150 and 151 are microwave video radar images, hyperspectral images, etc., the same is true when the synthesis source image 152 is an optical sensor image and the synthesis target images 150 and 151 are laser scanner images with respect to the same object. When the compositing source image 152 is an optical sensor image and the compositing target images 150 and 151 are digital terrain models (DTM: Digital Terrain Model), the compositing original image 152 and the compositing target images 150 and 151 have different observation times. In the case of a satellite image, the compositing source image 152 and the compositing target images 150 and 151 are displayed at the measurement time. , And the like if it is inspection and medical image to be.

<Composite image>
In the process D (FIGS. 12 and 13) in the image feature synthesized moving image generation process (S1006) described above, the pixel value of each pixel of the image feature synthesized image (color) 180, 181 is set to Q (i), and the synthesis source The pixel value of each pixel of the image (color) 152 is set to P, the pixel value of each pixel of the edge enhanced image (monochrome) 160 and the embossed image (monochrome) 161 is set to E (i), and i is edge enhanced processing and embossed processing. For example, when the pixel value E (i) is 128 or more, the pixel value Q (i) can be obtained by the following equation (1), and the pixel value E ( When i) is less than 128, it can be obtained by the following equation (2).
Q (i) = 2 × (P + E (i) −P × E (i) / 255) −255 (1)
Q (i) = P × E (i) × 2/255 (2)

=== Example of video generation ===
A generation example of an image feature synthesis moving image will be described with reference to FIGS. In this generation example, the irradiation direction in the embossing process is eight directions in 45 degree increments, and the display order of the embossed images in the moving image is clockwise.

<<< First example >>>
In FIG. 14, (a) exemplifies a source image (color) 152 of a satellite image, and (b) exemplifies a texture enhanced image (monochrome) 151 as a synthesis target image of the satellite image. In this example, the input image (color) 150 as the source of the compositing target image is the same as the compositing original image (color) 152. Further, in the texture enhancement process, a dispersion feature amount is required. Comparing FIG. 14A and FIG. 14B, the texture-enhanced image (monochrome) 151 enhances the image characteristics of the composition source image (color) 152, but maintains the image quality of the image 152. It turns out that it is not a thing.

  Therefore, as illustrated in FIG. 15, emboss processing having a plurality of irradiation directions with respect to the texture-enhanced image (monochrome) 151 in FIG. 14B using the image feature synthesis moving image generating apparatus 20 of the present embodiment. To generate a plurality of embossed images (monochrome) 161a to 161h. Subsequently, as illustrated in FIG. 16, the composite original image (color) 152 in FIG. 14A is combined with each of the plurality of embossed images (monochrome) 161a to 161h in FIG. Feature composite images (colors) 181a to 181h are generated.

  In the image feature composite images (colors) 181a to 181h in FIG. 16, the optical illusion about the unevenness differs depending on the light irradiation direction, and the image quality of each of the images 181a to 181h is the composite original image (color) in FIG. It can be seen that the image quality of 152 is reflected. Therefore, these image feature composite images (colors) 181a to 181h are continuously switched and displayed, so that in the image feature composite video (color) 191 (FIG. 17), the image quality of the composite original image (color) 152 is displayed. Is maintained, and the feature of the texture-enhanced image (monochrome) 151 is enhanced and sharpened by induction of the pseudo-rotational illusion. Note that FIG. 17 illustrates the image feature synthesis moving image 191 as a still image for convenience, and merely gives one standard for grasping an actual dynamic shadow change.

<<< second example >>>
In FIG. 18, (a) exemplifies a composition original image (color) 152 ′ with a bag as an object, and (b) exemplifies the image feature composition moving image (color) 191 ′. Note that FIG. 18B illustrates the image feature synthesis moving image 191 ′ as a still image for convenience, and provides only one standard for grasping the actual dynamic shadow change. In this example, the input image (color) 150 ′ as the source of the compositing target image is the same as the compositing source image (color) 152 ′.

  Using the image feature synthesis moving image generation apparatus 20 of the present embodiment, edge enhancement processing is performed on the input image (color) 150 ′ in FIG. 18A to generate an edge enhancement image (monochrome) as a synthesis target image. Then, an embossing process having a plurality of irradiation directions is applied to the edge-enhanced image (monochrome) to generate a plurality of embossed images (monochrome). Each of the plurality of embossed images (monochrome) is shown in FIG. Are synthesized to generate a plurality of image feature synthesized images (colors). In the edge enhancement process, a Sobel filter is applied.

  The plurality of image feature composite images (colors) are continuously switched and displayed, so that in the image feature composite video (color) 191 ′, the image quality of the composition source image (color) 152 ′ is maintained, and the pseudo The feature of the edge-enhanced image (monochrome) is enhanced by inducing the rotation illusion. That is, in FIG. 18B, it is understood that the image quality representing the shell surface of the cocoon and the like is maintained while the edges of the cocoon hair and the like are emphasized.

<<< Third example >>>
In FIG. 19, (a) exemplifies a composition original image (color) 152 ″ having a concrete wall as an object, and (b) illustrates the image feature composition moving image (color) 191 ″. Note that FIG. 19B illustrates the image feature synthesis moving image 191 ″ as a still image for convenience, and provides only one guide for grasping the actual dynamic shadow change. In this example, the input image (color) 150 ″ as the source of the composition target image is the same as the composition original image (color) 152 ″.

  Using the image feature synthesis moving image generation apparatus 20 of the present embodiment, a texture enhancement process (monochrome) is generated as a synthesis target image by performing a texture enhancement process on the input image (color) 150 ″ of FIG. Then, the texture emphasizing image (monochrome) is embossed with a plurality of irradiation directions to generate a plurality of embossed images (monochrome). Each of the plurality of embossed images (monochrome) is shown in FIG. Are synthesized to generate a plurality of image feature synthesized images (colors). In the texture enhancement process, an average feature amount is obtained.

  The plurality of image feature synthesized images (colors) are continuously switched and displayed, so that the image feature synthesized moving image (color) 191 ″ maintains the image quality of the synthesis source image (color) 152 ″ while maintaining the image quality. The feature of the texture-enhanced image (monochrome) is enhanced by inducing the rotational illusion. That is, in FIG. 19B, it can be seen that the image quality representing the surface of the concrete wall and the like is maintained while the edges of the concrete wall such as cracks are emphasized.

  As described above, in the first to third examples, the image feature obtained by embossing the image to be synthesized with the texture, the edge, etc. emphasized (processing B2 in FIG. 13) and synthesizing the synthesized image. An image feature synthesis video generated from a composite image was described.

  Similarly, an image feature synthesis moving image generated from an image feature synthesis image obtained by performing edge enhancement processing on the synthesis target image (processing B1 and B4 in FIG. 12) and synthesizing this with the synthesis source image, The same effects as those of the first to third examples described above can be obtained. That is, in the image feature synthesis moving image, the feature of the edge-enhanced image as the synthesis target image is enhanced by inducing the pseudo-rotation illusion while maintaining the image quality of the synthesis source image.

=== Image quality maintenance and feature enhancement ===
The image feature synthesis moving image generation apparatus 20 according to the present embodiment includes at least an edge-enhanced image generation unit 71 that generates a plurality of edge-enhanced images 160 obtained by emphasizing edges in a plurality of directions with respect to the synthesis target images 150 and 151. A composite image generation unit (image feature composite image generation unit 72) that generates a plurality of composite images (image feature composite image 180) obtained by combining the plurality of edge-enhanced images 160 and the composite original image 152, and the plurality of composite images are continuous. It is only necessary to include a synthesized moving image generating unit (image feature synthesized moving image generating unit 75) that generates a synthesized moving image (image feature synthesized moving image 190) to be switched and displayed. Thereby, in the synthesized moving image, the feature of the edge enhanced image 160 is enhanced by the induction of the pseudo-rotational illusion while maintaining the image quality of the synthesized original image 152.

  In the above-described image feature synthesis moving image generating apparatus 20, the synthesis target image 151 is an image in which a predetermined element is emphasized. Thereby, since a predetermined element is further emphasized, the image enhancement and sharpening in the synthesized moving image are further improved.

  In the above-described image feature synthesis moving image generating apparatus 20, the predetermined element is a texture or an edge. This further enhances the texture, roughness, etc., or the edges (edges) in the composite original image 152, thereby further improving image enhancement and sharpening in the composite moving image.

  In the above-described image feature synthesized moving image generating apparatus 20, the synthesis target images 150 and 151 may be images different from the synthesis source image 152. Thereby, for example, the characteristics of the compositing target images 150 and 151 are more conspicuous.

  Further, in the above-described image feature synthesized moving image generating apparatus 20, the synthesis target images 150 and 151 may be the same images as the synthesis source image 152. Thereby, for example, the characteristics of the compositing target images 150 and 151 can be easily read.

  In the above-described image feature synthesized moving image generating apparatus 20, the synthesis source image 152 may include an R image 152R, a G image 152G, and a B image 152B. Thereby, the maintenance of image quality and the enhancement of features are further improved in the synthesized moving image.

In addition, the image feature synthesis moving image generation apparatus 20 according to the present embodiment generates an emboss image 161 that generates a plurality of emboss images 161 that regard at least a plurality of directions as light sources with respect to the synthesis target image 151 in which a predetermined element is emphasized. Unit 70, a composite image generation unit (image feature composite image generation unit 72) that generates a plurality of composite images (image feature composite image 181) by respectively combining the plurality of embossed images 161 and composite original image 152, and a plurality of composites What is necessary is just to provide the synthetic | combination moving image production | generation part (image feature synthetic | combination moving image generation part 75) which produces | generates the synthetic | combination moving image (image feature synthetic | combination moving image 191) by which an image is switched continuously.
Thereby, in the synthesized moving image, the characteristics of the embossed image 161 are enhanced by inducing the pseudo-rotational illusion while maintaining the image quality of the synthesized original image 152.

  As described above, according to the image feature synthesis moving image generating apparatus 20 of the present embodiment, for the synthesis source image and synthesis target image in various combinations, the characteristics of the synthesis target image are maintained while maintaining the image quality of the synthesis source image. To be emphasized. Therefore, the apparatus 20 can be applied to, for example, land cover change analysis (environment change analysis), mineral exploration (lineament analysis), disaster prevention (analysis and grasp of damaged area), medical image analysis, inspection measurement image analysis, and the like.

=== Other image feature composition video generation processing ===
With reference to FIGS. 20 to 24, other image feature synthesis moving image generation processing by the above-described image feature synthesis moving image generation apparatus 20 will be described.
FIG. 20 is a schematic diagram illustrating an example of another moving image generation screen 200 for generating an image feature synthesized moving image. FIG. 21 is a flowchart illustrating an example of another processing procedure of the image feature synthesis moving image generation system. FIG. 22 is a flowchart illustrating an example of another processing procedure of the image feature synthesis moving image generating apparatus 20. FIG. 23 is an image diagram of other image feature synthesis moving image generation processing. FIG. 24A is a diagram showing an example of a satellite image synthesis source image 251, and FIG. 24B is a diagram showing an example of a synthesis target image 250 of the satellite image, and FIG. These are figures which show an example of the image feature synthetic animation 300 of the satellite image.

<<< Other client screens >>>
As illustrated in FIG. 20, in the client 10 described above, a moving image generation screen 200 for inputting conditions and the like when generating an image feature combined moving image includes a combining source image input area 210, a combining target image input area, and the like. 211, a moving image generation condition selection area 212, and a moving image generation button 213.

In the composition source image input area 210, the storage destination (file path name, etc.) of the composition source image is input. Further, in the composition source image input area 210, the input composition source image is further divided into a GB image (R image and G image), an RB image (R image and G image), and an RG image (R image and G image). Which state is selected is selected.
In the compositing target image input area 211, a storage destination (file path name or the like) of the compositing target image is input.

The moving image generation condition selection area 212 is further divided into an irradiation direction selection area 212a, an emboss pattern selection area 212b, a display order selection area 212c, and a display speed selection area 212d. In the irradiation direction selection area 212a, an irradiation direction at the time of embossing the composition target image is selected. For example, any one of four directions, eight directions, and sixteen directions is selected. ing. In the emboss pattern selection area 212b, one of, for example, three patterns of emboss processing representing different filter coefficients (matrix size, weight, etc.) for emboss processing is selected. In the display order selection area 212c, the display order of the embossed images in the image feature composition moving image is selected. For example, one of clockwise, counterclockwise, random, one-way, and marking is selected. It has become. In the display speed selection area 212d, the speed at which the embossed image is switched in the image feature composition moving image is selected. For example, any one of 4 fps (flame per second), 8 fps, and 16 fps is selected. Yes.
The moving image generation button 213 is used to transmit information selected or input in the above-described areas 210 to 212 to the image feature synthesis moving image generation apparatus 20.

<<< Other features of the image feature composition video generation system >>>
As illustrated in FIG. 21, in the client 10, a composition source image and a composition target image are selected (S2001). Specifically, in the synthesis source image input area 210 and the synthesis target image input area 211 on the moving image generation screen 200, the storage destination of the synthesis source image and the storage destination of the synthesis target image are input. Note that any one of the GB image, the RB image, and the RG image is further selected for the composition source image.

  In addition, the client 10 selects a moving image generation condition for generating an image feature composite moving image (S2002). Specifically, an irradiation direction, an emboss pattern, a display order, and a display speed are selected in the moving image generation condition selection area 212 on the moving image generation screen 200.

When the moving image generation button 213 on the moving image generation screen 200 is pressed, the client 10 transmits the input or selected image and the moving image generation condition to the image feature synthesis moving image generation apparatus 20 (S2003).
The image feature synthesis moving image generating apparatus 20 receives the image and moving image generation conditions transmitted from the client 10 (S2004) and stores them in the memory 61.
The image feature synthesis moving image generation apparatus 20 reads out the image and movie generation conditions from the memory 61, executes the image feature synthesis movie generation processing (S2005), and stores them in the memory 61.
The image feature synthesized moving image generation apparatus 20 reads the image feature synthesized movie from the memory 61 and transmits it to the client 10 (S2006).
The client 10 receives the image feature synthesized moving image transmitted from the image feature synthesized movie generating apparatus 20 (S2007), and displays the movie in the image feature synthesized movie display area 135 (see FIG. 9) of the image display screen 130 described above. (S2008).

<<< Other operations of the image feature composition video generator >>>
With reference to FIGS. 22 to 24, the above-described image feature synthesis moving image generation processing (S2005) will be described in detail.
As illustrated in FIG. 22, the image feature synthesis moving image generation apparatus 20 reads out a synthesis source image, a synthesis target image, and a video generation condition stored in the memory 61, and will be described below according to the designated information. Execute the process.
The image feature synthesis moving image generating apparatus 20 determines whether the synthesis source image 251 is designated as a GB image, an RB image, or an RG image (S2101).

<Composition source image GB / Composition target image R>
When it is determined that the synthesis source image 251 is designated as a GB image (S2101: “GB”), the G image and the B image are synthesized (S2102, process X in FIG. 23), and the GB image obtained thereby 270 is stored in the memory 61 as a composition original image. Note that the image 270 may be stored in advance in the memory 61 as the composition source image 251.

  The embossed image generation unit 70 described above applies eight embossed images (monochrome) 260a to 260h corresponding to eight directions in increments of 45 degrees, for example, only for the R image of the compositing target image 250 read out from the memory 61 (the " Embossed image (monochrome) 260 ”is generated (S2103, process V in FIG. 23), and these are stored in the memory 61.

  The embossed image generation unit 70 combines each of the eight embossed images (monochrome) 260a to 260h read from the memory 61 with the R image compositing target image 250 read from the memory 61 to obtain eight embossed images (monochrome) 260a to 260h. Embossed images (color) 280a to 280h (collectively referred to as “embossed image (color) 280”) are generated (S2104, process W in FIG. 23).

  The above-described image feature synthesis image generation unit 72 synthesizes each of the eight embossed images (colors) 280a to 280h read from the memory 61 and the GB image 270 read from the memory 61, thereby combining eight image feature synthesis. Images (colors) 290a to 290h (collectively referred to as “image feature composite image (color) 290”) are generated (processing Y in FIG. 23), and then the image feature composite video generation unit 75 described above performs this processing. An image feature synthesized moving image (color) 300 is generated from the image feature synthesized image (color) 290 in accordance with the designated display order and display speed (process Z in FIG. 23) (hereinafter, S2105). The image feature synthesized moving image (color) 300 is stored in the memory 61.

  According to the illustration of FIG. 23, in the image feature synthesis moving image (color) 300, for example, if the display order is clockwise and the display speed is 4 fps, the image feature synthesis images (color) 290a to 290h It is displayed while switching around at a rate of 4 frames per second.

<Composition source image RB / Composition target image G>
The case where the composition source image is an RB image is the same as that described above. In other words, when it is determined that the composition source image 251 is designated as the RB image (S2101: “RB”), the R image and the B image are synthesized, and the composition source image 251 of the RB image is generated (S2106). ).
The embossed image generation unit 70 generates embossed images (monochrome) 260a to 260h for the G image synthesis target image 250 (S2107), and further, each of these embossed images (monochrome) 260a to 260h and the G image The embossed images (colors) 280a to 280h are generated by compositing with the compositing target image 250 (S2108).
The image feature composite image generation unit 72 combines the embossed images (colors) 280a to 280h with the composite image 251 of the RB images to generate image feature composite images (colors) 290a to 290h, and then The image feature synthesized moving image generating unit 75 generates an image feature synthesized moving image (color) 300 from the image feature synthesized image (color) 290 in accordance with the designated display order and display speed (S2109).

<Composition source image RG / Composition target image B>
The same applies to the case where the composition source image is an RG image. In other words, when it is determined that the composition source image 251 is designated as the RG image (S2101: “RG”), the R image and the G image are synthesized, and the composition source image 251 of the RG image is generated (S2110). ).
The embossed image generation unit 70 generates embossed images (monochrome) 260a to 260h for the B image synthesis target image 250 (S2111), and further, each of these embossed images (monochrome) 260a to 260h and the B image The embossed images (colors) 280a to 280h are generated by compositing with the compositing target image 250 (S2112).
The image feature composite image generation unit 72 combines the embossed images (colors) 280a to 280h with the composite image 251 of the RG image to generate image feature composite images (colors) 290a to 290h, and then The image feature synthesized moving image generating unit 75 generates an image feature synthesized moving image (color) 300 from the image feature synthesized image (color) 290 in accordance with the designated display order and display speed (S2113).

<Same image and different image>
In the above-described image feature synthesis moving image generation processing (S2005), the synthesis target image 250 is the same because the image obtained from the synthesis source image 251 (same type image) and the synthesis source image 251 are different from the observation target, observation means, and the like. Any of images (heterogeneous images) that cannot be obtained from the image 251 may be used. Here, the observation target includes, for example, an observation period in addition to the target object, and the observation means includes, for example, an observation wavelength in addition to the observation apparatus.
In particular, as examples of different types of images, when the synthesis source image 251 and the synthesis target image 250 are satellite images with different observation times, the same when the synthesis source image 251 and the synthesis target image 250 are examination / medical images with different measurement times. For example, the composition source image 251 is an optical sensor image and the composition target image 250 is a microwave video radar image, a hyperspectral image, or the like.
In this case, in the image feature synthesis moving image 300, due to the synthesis watermark effect, a change portion between images of the synthesis source image 251 and the synthesis target image 250 is emphasized, or an image feature between bands is emphasized.

<<< Example of video generation >>>
24A illustrates an original image (color) 251 of the RGB image of the satellite image, and FIG. 24B illustrates an image to be combined (monochrome) 250 of the G image of the satellite image. .
Using the image feature synthesis moving image generating apparatus 20 of the present embodiment, emboss processing having a plurality of irradiation directions is performed on the G image synthesis target image (monochrome) 250 in FIG. Monochrome) 260a to 260h are generated, and then a G image composition target image (color) 250 is synthesized with each of the plurality of embossed images (monochrome) 260a to 260h, and a plurality of embossed images (color) 280a are synthesized. Through 280h, and then, by combining the original image 251 of the RB image with each of the plurality of embossed images (colors) 280a through 280h, a plurality of image feature composite images (colors) 290a through 290h are generated. To do.

  In the image feature synthesis moving image (color) 300 in FIG. 24C, a plurality of image feature synthesis images (color) 290a to 290h are continuously switched and displayed, whereby the image quality of the synthesis source image (color) 251 is displayed. Is maintained, and the feature of the green object is emphasized by the composite watermark effect. Here, FIG. 24C exemplifies the image feature synthesis moving image 300 as a still image for convenience, and provides only one standard for grasping an actual dynamic shadow change.

As described above, since the watermark effect associated with the image synthesis is obtained, there is a possibility of creating a new synthesized image by combining the synthesis source image and the synthesis target image. Therefore, the image feature synthesis moving image generation apparatus 20 can be applied to image feature analysis support, image synthesis / display of design, advertisement, and the like.
In this generation example, the irradiation direction in the embossing process is eight directions in 45 degree increments, and the display order of the embossed images in the moving image is clockwise.

=== Other Embodiments ===
The above-described embodiment is intended to facilitate understanding of the present invention, and is not intended to limit the present invention. The present invention can be changed and improved without departing from the gist thereof, and the present invention includes equivalents thereof.

  For example, in the above-described embodiment, the client 10 is used. However, without using the client 10, the image feature synthesis moving image generating apparatus 20 can select an image, input a moving image generation condition, display a moving image, and the like. It may be performed.

It is a block diagram which shows the structural example of an image feature synthetic | combination moving image production | generation system. It is a block diagram which shows the structural example of the client in the system of FIG. It is a block diagram which shows the structural example of the image characteristic synthetic | combination moving image production | generation apparatus in the system of FIG. It is a functional block diagram of the image feature synthetic | combination moving image production | generation apparatus of FIG. It is a schematic diagram which shows an example of the irradiation direction of the virtual light in an embossing process. It is a schematic diagram which shows an example of the filter coefficient in an embossing process. It is a schematic diagram which shows an example of an embossing process. It is a schematic diagram which shows an example of a moving image production | generation screen. It is a schematic diagram which shows an example of a moving image display screen. It is a flowchart which shows an example of the process sequence of an image feature synthetic | combination animation production | generation system. It is a flowchart which shows an example of the process sequence of an image feature synthetic | combination moving image production | generation apparatus. It is an image figure of an image feature synthetic | combination animation production | generation process. It is another image figure of an image characteristic synthetic | combination animation production | generation process. (A) is a figure which shows an example of the synthetic | combination original image of a satellite image, (b) is a figure which shows an example of the synthetic | combination object image of (a). It is a figure which shows an example of the embossed image of the synthetic | combination target image of FIG.14 (b). It is a figure which shows an example of the image feature synthetic image of the synthetic | combination original image of Fig.14 (a), and the embossed image of FIG. It is a figure which shows an example of the image characteristic synthetic | combination moving image (however, still image) produced | generated from the image characteristic synthetic | combination image of FIG. (A) is a figure which shows an example of the synthetic | combination original image of a camellia, (b) is a figure which shows an example of the image characteristic synthetic | combination moving image (however, still image) of (a). (A) is a figure which shows an example of the synthetic | combination original image of a concrete wall, (b) is a figure which shows an example of the image characteristic synthetic | combination moving image (however, still image) of (a). It is a schematic diagram which shows an example of another moving image production | generation screen. It is a flowchart which shows an example of the other process sequence of an image feature synthetic | combination moving image production | generation system. It is a flowchart which shows an example of the other process sequence of an image feature synthetic | combination moving image production | generation apparatus. It is an image figure of other image feature synthetic animation production processing. (A) is a figure which shows an example of the synthetic | combination original image of a satellite image, (b) is a figure which shows an example of the synthetic | combination target image of (a), (c) is (a) and (b ) Is a diagram illustrating an example of an image feature synthesis moving image.

Explanation of symbols

10 Client 20 Image Feature Synthetic Movie Generation Device 30 Network 40 CPU
41 Memory 42 Storage Device 43 Display Interface 44 Input Interface 45 Communication Interface 46 Recording Medium Reading Device 50 Display Device 51 Input Device 52 Recording Medium 53 Recording Medium 60 CPU
61 Memory 62 Storage Device 63 Communication Interface 64 Recording Medium Reading Device 70 Embossed Image Generation Unit 71 Edge Enhanced Image Generation Unit 72 Image Feature Composite Image Generation Unit 75 Image Feature Composite Movie Generation Unit 76 Feature Enhancement Processing Units 100 and 200 Movie Generation Screen 110 , 210 Composition source image input area 111, 211 Composition target image input area 111a Input image input area 111b Feature enhancement processing selection area 112, 212 Movie generation condition selection area 112a Direction selection area 112b Filter selection area 112c, 212c Display order selection area 112d , 212d Display speed selection area 113 Movie generation button 130 Movie display screen 135 Image feature synthesis movie display area 150, 150 ', 150 "Synthesis target image, input image 151 Synthesis target image, texture enhanced image, edge strength Tone image 152 Composition original image 152R R image 152G G image 152B B image 160, 160a to 160h Edge-enhanced images 161, 161a to 161h Embossed image 170 Composition original image, color images 180, 181, 180a to 180h, 181a to 181h Composite image 190, 191, 191 ′, 191 ″ Image feature composite video 212a Irradiation direction selection area 212b Emboss pattern selection area 250 Composite target image, R image 251 Composite original image 260, 260a to 260h Emboss image 270 Composite original image, GB image 280, 280a to 280h Embossed image 290, 290a to 290h Image feature composite image 300 Image feature composite video

Claims (11)

An edge-enhanced image generation unit that generates a plurality of edge-enhanced images in which edges in a plurality of directions are respectively enhanced with respect to the synthesis target image;
A composite image generation unit that generates a plurality of composite images obtained by combining the plurality of edge-enhanced images and the composite original image,
A synthesized moving image generating unit for generating a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed;
An image feature synthesis moving image generating apparatus comprising:   The image feature synthesis moving image generating apparatus according to claim 1, wherein the synthesis target image is an image in which a predetermined element is emphasized.   The image feature synthesis moving image generating apparatus according to claim 2, wherein the predetermined element is a texture or an edge.   4. The image feature synthesis moving image generating apparatus according to claim 1, wherein the synthesis target image is an image different from the synthesis source image.   4. The image feature synthesis moving image generating apparatus according to claim 1, wherein the synthesis target image is the same image as the synthesis source image.   6. The image feature composition moving image generating apparatus according to claim 1, wherein the composition original image includes a red image, a green image, and a blue image. Generate a plurality of edge-enhanced images that emphasize edges in multiple directions with respect to the compositing target image,
Generating a plurality of combined images obtained by combining the plurality of edge-enhanced images and the original image,
Generating a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed;
An image feature synthesis moving image generation method characterized by the above. On the computer,
A procedure for generating a plurality of edge-enhanced images in which edges in a plurality of directions are respectively enhanced with respect to the synthesis target image;
Generating a plurality of synthesized images obtained by synthesizing the plurality of edge-enhanced images and the source image;
A procedure for generating a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed;
A program for running An embossed image generating unit that generates a plurality of embossed images in which a plurality of directions are regarded as light sources with respect to the compositing target image in which predetermined elements are emphasized;
A composite image generating unit that generates a plurality of composite images obtained by combining the plurality of embossed images and the original image;
A synthesized moving image generating unit for generating a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed;
An image feature synthesis moving image generating apparatus comprising: Generating a plurality of embossed images in which a plurality of directions are regarded as light sources with respect to a compositing target image in which a predetermined element is emphasized;
Generating a plurality of synthesized images obtained by synthesizing the plurality of embossed images and the source image;
Generating a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed;
An image feature synthesis moving image generation method characterized by the above. On the computer,
A procedure for generating a plurality of embossed images in which a plurality of directions are regarded as light sources with respect to a compositing target image in which predetermined elements are emphasized,
Generating a plurality of synthesized images obtained by synthesizing the plurality of embossed images and the source image;
A procedure for generating a synthesized moving image in which the plurality of synthesized images are continuously switched and displayed;
A program for running