JP2007034710A - Image processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To permit easy selection of a predetermined area in image data generated as template image data for retrieving image data. <P>SOLUTION: A frame decision part 313 decides the position, size and the like of a frame in image data stored in an acquisition image data storage part 312 to generate a frame. The position of the frame is decided in a frame position decision part 3131 based on an instruction from a frame position designation operation part 402. The size of the frame is decided in a frame size decision part 3133 based on an instruction from a frame size designation operation part 405. A fixed frame generation part 3132 generates a frame in the image data based on the decided position and size of the frame. A template generation part 316 cuts out an area surrounded by the frame in the image data generated in the fixed frame generation part 3132 to generate template image data. A retrieval part 317 retrieves image data based on the template image data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that selects a predetermined area of an image, and more particularly to an image processing apparatus that searches for image data using a predetermined area of a selected image as template image data, a processing method in these, and a method for the image processing apparatus. It relates to the program to be executed.

  In recent years, the memory and the like for storing image data provided in video cameras and digital still cameras has been increased in capacity, and a large amount of captured image data can be stored. On the other hand, as the number of stored image data increases, it becomes more difficult for the user to grasp the image data stored in the memory or the like.

In order to solve such a problem, a method has been proposed in which a part of predetermined image data is used as a template image and an image similar to the template image is searched from an image database. (For example, refer to Patent Document 1). According to this method, a part of predetermined image data used as a template image is designated with a mouse or the like.
JP-A-8-263522 (FIG. 1)

  However, the above-described prior art is based on the premise that a part of predetermined image data is selected using a pointing device such as a mouse, and in a device that does not use a pointing device such as a mouse. It is difficult to select a partial area of predetermined image data. In particular, it is more difficult to select a partial area of predetermined image data in image data displayed on a small portable device.

  SUMMARY An advantage of some aspects of the invention is that it provides an image processing apparatus that easily selects a predetermined area of image data generated as template image data.

  The present invention has been made to solve the above problems, and a first aspect of the present invention is that a frame position designation operation means for accepting designation of a position of a frame surrounding a predetermined area of image data, and the frame position designation Frame position determining means for determining the position of the frame based on designation from the operating means, frame size designation operating means for accepting designation of the size of the frame, and the frame based on designation from the frame size designation operating means Frame size determining means for determining the size of the frame, fixed frame generating means for generating a frame of a predetermined shape in a predetermined region of the image data based on the determined position and size of the frame, and the generated frame A template generation unit that generates template image data of the image data based on a predetermined region surrounded by image data, an image data holding unit that holds search target image data, and the search pair. The image data is an image processing apparatus characterized by comprising a search means for searching for image data that is similar to the template image data. This brings about the effect that a predetermined region of image data generated as template image data is easily selected.

  In the first aspect, the image processing apparatus further includes a frame shape selection operation unit that accepts selection of any one of the at least two frames having different shapes, and the fixed frame generation unit includes: A frame having a selected shape is generated as the frame having the predetermined shape. This brings about the effect of selecting the shape of the frame according to the object in the image data. Thereby, since it is possible to prevent unnecessary objects from being included in the template image data, it becomes possible to accurately search for image data desired by the user.

  In the first aspect, the frame size designation operation means accepts designation of the border position of the frame in the image data, and the frame size determination means is configured to determine the size of the frame based on the border position of the frame. It is characterized by determining. Thus, there is an effect that a predetermined region of image data generated as template image data is selected only by designating the position of the frame and the boundary position of the spread of the frame in the image data.

  In the first aspect, the frame size designation operation means accepts selection of any one of at least two different sizes, and the frame size determination means determines the selected size. To do. Accordingly, it is possible to select a predetermined region of the image data generated as the template image data only by designating the frame position and the predetermined frame size in the image data.

  Further, in this first aspect, the frame size designation determining means includes boundary frame size determining means for determining the size of the frame based on the boundary position of the frame, and at least two different sizes of the frame. A selection frame size determination unit that determines a selected size, and further includes a function selection operation unit that selects one of the boundary frame size determination unit and the selection frame size determination unit. Is. Accordingly, there is an effect that a predetermined region of the image data generated as the template image data is selected in accordance with a user-friendly method.

  In the first aspect, the frame position moving operation means for accepting designation of the position to move the frame generated by the fixed frame generating means, and the frame position based on the designation from the frame position moving operation means. And a frame position moving means for moving the position. This brings about the effect of correcting the position of the frame once determined.

  Further, in the first aspect, the frame size changing operation means for accepting the change in the frame size generated by the fixed frame generating means, and the frame size based on the designation from the frame size changing operation means. It further comprises frame size changing means for changing the size. This brings about the effect of correcting the size of the frame once determined.

  In the first aspect, the image data selection operation means for accepting selection of predetermined image data held in the image data holding means, and the image data for acquiring the image data selected by the image data selection operation means Acquisition means, and the fixed frame generation means generates a frame of a predetermined shape in a predetermined region of the image data acquired by the image data acquisition means based on the determined position and size of the frame It is characterized by doing. This brings about the effect that the image data is searched based on the image data held by the image processing apparatus.

  In the first aspect, the frame has a quadrangular shape. This brings about the effect that a desired object in the image data is easily selected.

  The shape of the frame is a rhombus. Thereby, when the target of the template image data is a human face or the like, there is an effect that the template image data does not include an extra target.

  In the first aspect, the frame has a circular shape. Thereby, when the target of the template image data is a human face or the like, there is an effect that the template image data does not include an extra target.

  According to a second aspect of the present invention, there is provided a processing method for executing the following procedure or a program for causing a computer to execute the following procedure in an image processing apparatus including an image data holding unit that holds image data. A frame position designation acceptance procedure for accepting designation of the position of a frame surrounding the predetermined area, a frame position decision procedure for determining the position of the frame based on designation in the frame position designation acceptance procedure, and a size of the frame A frame size designation acceptance procedure for accepting designation, a frame size determination procedure for determining the size of the frame based on the designation in the frame size designation acceptance procedure, and the image based on the determined position and size of the frame A template frame generation procedure for generating a frame of a predetermined shape in a predetermined area of data, and a template image based on the area of the image data surrounded by the frame A template generation procedure for generating data, and a search procedure for searching image data including image data similar to the template image data from the image data holding means based on the template image data. A processing method or a program for causing a computer to execute these procedures. This brings about the effect that a predetermined region of image data generated as template image data is easily selected.

  According to the present invention, an excellent effect of easily selecting a predetermined region of image data generated as template image data can be obtained.

  Next, embodiments of the present invention will be described in detail with reference to the drawings. In the embodiment of the present invention, an imaging apparatus will be described as an example of an image processing apparatus.

  FIG. 1 is an external view of imaging devices 100a and 100b, which are examples of an image processing device according to an embodiment of the present invention. The imaging device 100a mainly captures still images, and the imaging device 100b mainly captures moving images.

  FIG. 1A is a front view of the imaging apparatus 100a. The imaging device 100a images a subject from the lens unit 110a. Then, the imaging device 100a generates still image data when the shutter unit 120a is pressed. FIG. 1B is a rear view of the imaging apparatus 100a. The movement of the subject captured by the lens unit 110a is displayed on the display unit 130a. The generated still image data is also displayed on the display unit 130a.

  FIG. 1C is a front view of the imaging apparatus 100b. The imaging device 100b images a subject from the lens unit 110b. Then, the imaging device 100b generates moving image data when a recording button (not shown) is pressed. FIG. 1D is a rear view of the imaging apparatus 100b. The movement of the subject captured by the lens unit 110b is displayed on the display unit 130b. The generated moving image data is also displayed on the display unit 130b. The imaging device 100b also has a function of generating still image data, and the generated still image data is also displayed on the display unit 130b.

  In the embodiment of the present invention, a part of the still image data displayed on the display units 130a and 130b is selected and cut out, and the cut out still image data is used as template image data. The template image data is used when searching for desired image data from image data held in a storage device (not shown) built in the imaging devices 100a and 100b. In the embodiment of the present invention, the operation for selecting a part of still image data is assumed to be a touch panel method that is specified by directly pressing the display units 130a and 130b, but is not limited thereto.

  FIG. 2 is a diagram illustrating a configuration of the imaging apparatus 100 according to the embodiment of the present invention. The imaging device 100 according to the embodiment of the present invention includes an imaging unit 10, a recording / playback processing unit 20, a control unit 30, a bus 40, a key input unit 50, a touch panel unit 60, and a storage device 70.

  The imaging unit 10 includes an imaging element unit 11, an imaging control unit 12, and an image processing unit 13. The imaging element unit 11 includes a lens group for imaging a subject (corresponding to the lens units 110a and 110b in FIG. 1), an aperture adjustment mechanism, a focus adjustment mechanism, and an imaging element such as a CCD (Charge Coupled Devices). And an image through the lens group is formed on an imaging surface of an image sensor such as a CCD. The image sensor unit 11 receives an image capture timing signal supplied from the control unit 30 through the bus 40 in response to the shutter operation, converts the subject image formed on the imaging surface of the image sensor into an image signal, The image is supplied to the image processing unit 13.

  The imaging control unit 12 receives a control signal supplied from the control unit 30 through the bus 40 and generates a control signal to be supplied to the imaging element unit 11. In addition, the imaging control unit 12 supplies the generated control signal to the imaging element unit 11 to perform zoom control, shutter control, exposure control, and the like.

  The image processing unit 13 performs processing such as gamma correction and AGC (Auto Gain Control) on the imaging signal based on the control signal supplied from the control unit 30 through the bus 40, and also uses the imaging signal as a digital signal. Processing to convert to a signal is also performed.

  The recording / playback processing unit 20 includes an image encoding / decoding unit 21 and a recording control unit 22. The image encoding / decoding unit 21 has an encoding function for encoding and multiplexing an image signal or the like supplied from the imaging unit 10 through the bus 40 and converting the encoded signal into compressed data. The image encoding / decoding unit 21 has a decoding function for decoding an image signal from compressed data.

  The recording control unit 22 receives the compressed data from the image encoding / decoding unit 21 and writes it in the storage device 70. The recording control unit 22 reads compressed data from the storage device 70 and supplies the compressed data to the image encoding / decoding unit 21. The storage device 70 may be externally attached to the imaging device 100 or may be built in. As the storage device 70, a memory card in which flash memory is packaged in a card type, a magnetic disk such as a hard disk, an optical disk such as a DVD, and a magneto-optical disk such as an MO. However, the present invention is not limited to this.

  The control unit 30 includes a system control unit 31, an input control unit 32, a display control unit 33, an output image processing unit 34, an external device control unit 35, and a network control unit 36.

  The system control unit 31 is responsible for overall processing of the control unit 30. A key input unit 50 connected to the input control unit 32 includes a mode switching key for switching between a shooting mode and another mode such as a playback mode, a zoom adjustment key, a key for exposure adjustment, and a shutter key (shutter in FIG. 1). A plurality of keys such as a moving image shooting key. The touch panel input unit 62 connected to the input control unit 32 receives selection of a menu displayed on the display unit 61 and designation of a predetermined area of image data.

  The input control unit 32 transmits operation signals from the key input unit 50 and the touch panel input unit 62 to the system control unit 31. The system control unit 31 determines which key or the like is operated on the key input unit 50 and the touch panel input unit 62, and performs control processing according to the determination result.

  The display unit 61 connected to the display control unit 33 is configured by, for example, an LCD (Liquid Crystal Display) or the like. Under the control of the system control unit 31, an image signal supplied from the imaging unit 10 through the bus 40, or storage The image signal read from the device 70 is displayed. The display unit 61 corresponds to the display units 130a and 130b in FIG.

  The output image processing unit 34 performs predetermined modification processing on the image data when reproducing the image data. The modification process is assumed to be color correction of image data, for example. Note that the system control unit 31 may be configured to perform processing on image data performed by the output image processing unit 34.

  The external device 80 connected to the external device control unit 35 is assumed to be a personal computer, for example, but is not limited thereto. The external device 80 and the external device control unit 35 are assumed to be connected by, for example, a USB (Universal Serial Bus) cable, but the present invention is not limited to this. The external device control unit 35 controls data exchange between the imaging apparatus 100 and the external device 80.

  The network control unit 36 controls data exchanged between the imaging device 100 and the network 90. The network is assumed to be the Internet or a LAN (Local Area Network), but is not limited to this.

  FIG. 3 is a diagram illustrating an example of functional configurations of the system control unit 31 and the operation unit 400 according to the embodiment of the present invention. The operation unit 400 is realized by the key input unit 50, the touch panel input unit 62, and the input control unit 32 in FIG.

  The system control unit 31 includes an image data acquisition unit 311, an acquired image data holding unit 312, a frame determination unit 313, a frame position movement unit 314, a frame size change unit 315, a template generation unit 316, and a search unit 317. With.

  The image data acquisition unit 311 receives an image data selection signal from the image data selection operation unit 401 in the operation unit 400 and acquires predetermined image data from the storage device 70 via the bus 40. The image data acquisition unit 311 supplies the image data acquired from the storage device 70 to the acquired image data holding unit 312. The acquired image data holding unit 312 holds the image data supplied from the image data acquisition unit 311.

  The image data selection operation unit 401 in the operation unit 400 receives selection of image data held in the storage device 70 and supplies an instruction to that effect to the image data acquisition unit 311 as an image data selection signal. .

  The frame determination unit 313 is a predetermined area of the image data held in the acquired image data holding unit 312 based on a designation signal that designates the size and shape of the frame supplied from the operation unit 400 and the position of the frame in the image data. A frame position determination unit 3131, a fixed frame generation unit 3132, and a frame size determination unit 3133 are determined.

  The frame position determination unit 3131 is a frame in the image data held in the acquired image data holding unit 312 based on a frame position designation signal that designates the frame position supplied from the frame position designation operation unit 402 in the operation unit 400. The position of is determined. The frame position designation operation unit 402 receives designation of the position of a frame surrounding a predetermined area of the image data, and supplies an instruction to that effect to the frame position determination unit 3131 as a frame position designation signal.

  The frame size determination unit 3133 determines the frame size based on a frame size designation signal that designates the frame size supplied from the frame size designation operation unit 405. A size determination unit 3135. The frame size designation operation unit 405 receives designation of the size of a frame surrounding a predetermined area of the image data, and supplies an instruction to that effect to the frame size determination unit 3133 as a frame size designation signal.

  The selection frame size determination unit 3134 determines the frame size based on a frame size designation signal that designates one of a plurality of preset frame sizes supplied from the frame size designation operation unit 405. is there. For example, if it was set in advance so that a small frame, a medium frame, a large frame, and three types of frames could be selected, specify one of the three types of frame size. To decide.

  The boundary frame size determination unit 3135 determines the frame size based on a frame boundary position designation signal that designates the frame boundary position supplied from the frame size designation operation unit 405. As a frame generated in the embodiment of the present invention, a line connecting a frame position determined by the frame position determining unit 3131 and a frame boundary position determined by the boundary frame size determining unit 3135 is a diagonal line. A rhombus or rectangle is assumed. Therefore, the frame size is determined by the boundary position of the frame which is the end point of the diagonal line.

  Note that which function of the selection frame size determination unit 3134 or the boundary frame size determination unit 3135 is used to determine the frame size is determined based on a function selection signal supplied from the function selection operation unit 404. .

  The fixed frame generation unit 3132 generates a frame having a predetermined shape in the image data based on the frame position determined by the frame position determination unit 3131 and the frame size determined by the frame size determination unit 3133. . The predetermined shape of the frame can be specified by the frame shape selection operation unit 403 in the operation unit 400. That is, the fixed frame generation unit 3132 has a function of generating a frame having at least two shapes, and the shape is designated by the frame shape selection operation unit 403. As the shape of the frame, for example, a rhombus or other quadrangular shape or a circular shape is assumed.

  The frame position moving unit 314 moves the position of the frame based on an operation signal that designates the position of the frame supplied from the frame position moving operation unit 407 in the operation unit 400. The frame size changing unit 315 changes the frame size based on an operation signal supplied from the frame size changing operation unit 408 to change the frame size.

  The template generation unit 316 cuts out a region surrounded by a frame in the image data held in the acquired image data holding unit 312 and generates it as template image data. The template generation unit 316 also generates a plurality of image data obtained by enlarging and reducing the cut out image data in addition to the cut out image data. That is, the template generation unit 316 generates a plurality of image data as a template image data group.

As the enlarged image data, for example, image data obtained by enlarging the cut image data by 1.1 times, 1.21 times, and 1.1 times can be used. As the reduced image data, for example, image data obtained by reducing the cut-out image data by 0.909 times, 0.826 times, and 0.909 times can be used. Here, the sequence of numbers 1.21, 1.1, 1.0, 0.909, and 0.826 are (1.1) ² , (1.1) ¹ , (1.1) ⁰ , (1. 1) ^-1 and (1.1) ^-2, that is, a geometric sequence with a common ratio of 1.1. Increasing the common ratio increases the possibility of search omission when searching for image data using the template image data group. On the other hand, if the common ratio is decreased, the template image data group is used to search for image data. There is a negative effect that the amount of calculation increases when performing. For this reason, the common ratio is preferably about 1.1, but is not limited thereto, and may be 1.09 or 1.2, for example.

  When the search unit 317 receives an operation signal indicating that the search should be started supplied from the search instruction operation unit 406 in the operation unit 400, the search unit 317 stores it in the storage device 70 based on the template image data generated by the template generation unit 316. Image data similar to the template image data is retrieved from the stored image data.

  FIG. 4 is a diagram showing an example of a template image data generation screen in the embodiment of the present invention. On the display screen 600, an image data display 610, a selection frame 620, an “OK” button 631, and a “return” button 632 are displayed.

  The image data display 610 is assumed to be image data held in the storage device 70, but is not limited to this. The image data display 610 is not limited to this, but via the image data transferred from the external device 80 described in FIG. It may be acquired image data.

  In the selection frame 620, three types of frames having different sizes from the small frame 621, the middle frame 622, and the large frame 623 are displayed in FIG. 4, but the present invention is not limited to this, and four types of size frames are displayed. You may make it make it.

  In the embodiment of the present invention, the designation of any one of the small frame 621, the middle frame 622, and the large frame 623 is performed by directly pressing a portion where the small frame 621, the middle frame 622, and the large frame 623 are displayed. Although operation is assumed, it is not limited to this. When the “OK” button 631 is selected, the next screen is displayed. When the “return” button 632 is selected, an image data selection screen (not shown) for selecting image data to be displayed on the image data display 610 is displayed.

  FIG. 5 is a diagram showing an operation on the template image data generation screen according to the embodiment of the present invention. FIG. 5A is a diagram showing how the initial state of the frame is determined on the template image data generation screen. First, a desired frame size is designated by the stylus 651 from the selection frame 620. Next, the position where the frame in the image data display 610 is to be displayed is designated by the stylus 652. In the description of FIGS. 5 to 10, the position of the frame, the size of the frame, and the like are designated by the stylus. However, the present invention is not limited to this, and the position of the frame, the size of the frame, etc. are designated by the user's finger. You may do it.

  In FIG. 5A, the position designated by the stylus 652 is set at the center of the frame 641, but the present invention is not limited to this, and the position designated by the stylus 652 is set at the corner of the frame 641. May be. When the position where the frame 641 in the image data display 610 is to be displayed is designated by the stylus 652, the frame 641 is displayed on the image data display 610. Thereby, the initial state of the frame 641 is determined.

  FIG. 5B is a diagram showing how the position of the frame 641 determined in FIG. 5A is changed. Even if the initial state of the frame 641 is determined as shown in FIG. 5A, the position of the frame 641 may not be the position desired by the user. In this case, the position where the frame 641 in the image data display 610 is to be displayed is designated again by the stylus 653. As a result, the position of the frame 641 moves. If there is no problem with the position of the frame 641, the “OK” button 631 is selected with the stylus 654. When the “OK” button 631 is selected, a screen shown in FIG. 6 is displayed.

  FIG. 6 is a diagram showing how the frame size is changed in the embodiment of the present invention. Even if the initial state of the frame is determined and the frame 641 is displayed in the image data display 610 as shown in FIG. 6A, the purpose is included in the image data displayed in the area surrounded by the frame 641. It is possible that not all objects to be included are included. In addition, objects other than the target object may be included in the image data displayed in the area surrounded by the frame.

  In this case, the stylus 655 selects the frame reduction button 633 displayed as “a little smaller frame” or the frame enlargement button 634 displayed as “a little larger frame”. FIG. 6A shows a state where the frame enlargement button 634 is selected with the stylus 655 and the operation is performed so that the image data of the house is included in the region surrounded by the frame. If the state in which the frame enlargement button 634 is selected by the stylus 655 is continued, the frame 641 gradually increases. As illustrated in FIG. 6B, the frame is expanded until all the houses are included in the region surrounded by the frame 641.

  When the “OK” button 635 is selected with the stylus 656, a region surrounded by a frame is cut out from the image data, and the cut-out image data is generated as template image data. Image data similar to the template image data is retrieved from the storage device 70 based on the template image data.

  FIG. 7 is a diagram showing a template image data generation screen when the frame shape of the selection frame 620 is changed to another shape in the embodiment of the present invention. FIG. 7A is a diagram showing a display screen 600 when the frame shape of the selection frame 620 is circular. In FIG. 7A, a circular middle frame 625 is selected, and a circular frame 642 is displayed at a position surrounding the window portion of the house.

  FIG. 7B is a diagram showing a display screen 600 when the selection frame 620 has a rhombus shape. In FIG. 7A, a rhombus-shaped middle frame 628 is selected, and a rhombus-shaped frame 643 is displayed at a position surrounding a human face portion.

  By making the shape of the frame in the selection frame 620 circular or rhombus, when the target of the template image data is a human face or the like, the template image data does not include an extra target. Can do. Thereby, it becomes possible to search the image data desired by the user with high accuracy. Except for the shape of the frame in the selection frame 620, the description is omitted because it is the same as that described in FIGS.

  The designation of the frame size in the selection frame 620 in FIGS. 5 to 7 can be realized by, for example, the frame size designation operation unit 405 and the selection frame size determination unit 3134 described with reference to FIG. 5 to 7 can be specified by the frame position specifying operation unit 402 and the frame position determining unit 3131 described with reference to FIG.

  FIG. 8 is a diagram showing a state of a template image data generation screen in another embodiment of the present invention. FIG. 8A is a diagram showing a template image data generation screen according to another embodiment of the present invention. On the display screen 600, an image data display 610, a selection frame 660, an “OK” button 681, and a “return” button 682 are displayed.

  The image data display 610 is assumed to be image data held in the storage device 70 as in the case described with reference to FIG. 4, but is not limited to this, and is transferred from the external device 80 described with reference to FIG. 2. Alternatively, image data acquired via the network 90 may be used.

  The selection frame 660 displays three types of frames different in shape from the rhombus-shaped frame 661, the circular frame 662, and the rectangular frame 663, but the present invention is not limited to this, and frames of other shapes are used. May be.

  In the embodiment of the present invention, the selection of any one of the diamond-shaped frame 661, the circular frame 662 and the rectangular frame 663 directly displays the diamond-shaped frame 661, the circular frame 662 and the rectangular frame 663. A touch panel operation performed by pressing a part is assumed. Specifically, any one of the diamond-shaped frame 661, the circular frame 662, and the rectangular frame 663 is selected by the stylus 671, and the shape of the frame is first selected.

  FIG. 8B is a diagram illustrating a state in which the position of the frame is designated. When the shape of the frame is determined, the position of the frame is next determined. The position of the frame is determined by designating a position 691 a where the frame is to be displayed by the stylus 672.

  FIG. 9 is a diagram showing how frames are generated on the template image data generation screen according to another embodiment of the present invention. After specifying the position 691a for specifying the position of the frame in FIG. 8B, another position 691b is specified by the stylus 673 as shown in FIG. 9A. This other position 691b corresponds to the border position of the frame described in FIG. When another position 691b is designated by the stylus 673, a diamond-shaped frame 691 having a line connecting the position 691a and the position 691b as a diagonal line is displayed.

  The size of the diamond-shaped frame 691 varies depending on the position in the image data display 610 where the position 691b is designated. Therefore, in another embodiment of the present invention, the position of the frame is determined based on the position 691a specified first, and the size of the frame is determined based on the position 691b specified next. Thereby, the initial state of the frame 691 is determined.

  In FIG. 9A, the frame 691 does not include all the faces. In such a case, as shown in FIG. 9B, when the position 692a is designated again by the stylus 674, the frame 691 is reset. Then, the frame 692 is displayed by designating the position 692b with the stylus 675.

  When the position and size of the frame are determined, an “OK” button 681 is selected. When the “OK” button 681 is selected, the screen shown in FIG. 10 is displayed. When the “return” button 682 is selected, an image data selection screen (not shown) for selecting image data to be displayed on the image data display 610 is displayed.

  FIG. 10 is a diagram showing how the frame size is changed in the embodiment of the present invention. When the frame 692 displayed in FIG. 9B is made slightly larger or smaller, the size of the frame 692 is reduced by a frame reduction button 683 displaying “frame slightly smaller” or a frame displaying “frame slightly larger”. The enlargement button 684 is adjusted with the stylus 676. In FIG. 10, the frame enlargement button 684 is selected with the stylus 676 to increase the size of the frame 692.

  When the “OK” button 685 is selected after the size of the frame 692 is set to an appropriate size as shown in FIG. 10B, the area surrounded by the frame 692 is cut out from the image data, and the cut-out image data Are generated as template image data. Image data similar to the template image data is retrieved from the storage device 70 based on the template image data.

  8 to 10, the specification of the frame shape in the selection frame 660 can be realized by, for example, the frame shape selection operation unit 403 and the fixed frame generation unit 3132 described with reference to FIG. Also, the designation of the frame position (position 691a) in FIGS. 8 to 10 can be realized by, for example, the frame position designation operation unit 402 and the frame position determination unit 3131 described in FIG. In addition, the designation of the border position (position 691b) of the frame in FIGS. 8 to 10 can be realized by, for example, the frame size designation operation unit 405 and the selection frame size determination unit 3134 described with reference to FIG.

  FIG. 11 is a diagram showing an image of template image data generation. When the position, shape, and size of the frame surrounding the predetermined area of the image data are determined, the portion surrounded by the frame in the image data is cut out by the template generation unit 316, and the template image data 200 shown in FIG. Is generated as

  The template generation unit 316 also generates template image data 211 to 214 that are image data obtained by enlarging and reducing the template image data 200. The template image data 211 to 214 are assumed to be obtained by multiplying the template image data 200 by, for example, 0.826 times, 0.909 times, 1.1 times, and 1.21 times, respectively. In FIG. 11A, there are only four template image data other than the template image data 200. However, the number of template image data is not limited to this and may be any number.

  Further, as shown in FIG. 11B, the template image data may be generated not only by enlarging and reducing the template image data 200 but also by rotating the template image data 200.

  FIG. 12 is a diagram illustrating a state in which a portion similar to the template image data is searched from the image data. When searching for a portion similar to the template image data from the image data, for example, the template image data and the image data are collated. As a result of the collation, if there is a portion that matches or is similar to the template image data in the image data, the image data is image data including a partial image similar to the template image data. When collating the template image data and the image data, as shown in FIG. 12, for example, the collation is started from the vicinity of the upper left end of the image data 230. Then, for example, the template image data and the image data are collated by shifting by a predetermined pixel (for example, one pixel) in the arrow direction shown in FIG.

  After collating to the right end while shifting a predetermined pixel, next, the template image data 200 and the image data 230 are collated from the left end to the right end by shifting a predetermined pixel (for example, 1 pixel) downward. Further, when searching for a portion similar to the template image data from the image data 230, in addition to the template image data 200, the above-described collation is also performed on the image data obtained by enlarging and reducing the template image data 200 described in FIG. I do.

  Note that the method of searching for a portion similar to the template image data from the image data can be performed by using a genetic algorithm in addition to performing verification for all portions of the image data as described above. A portion similar to the template image data may be searched for in the image data while efficiently changing each variation of the place to be performed, the size of the template, and the rotation of the template.

  Next, the operation of the imaging apparatus 100 according to the embodiment of the present invention will be described with reference to the drawings.

  FIG. 13 is a diagram showing a flow from generation of template image data from image data to search for image data similar to the template image data in the imaging apparatus 100 according to the embodiment of the present invention.

  First, the image data acquisition unit 311 determines whether an instruction to select image data has been given from the image data selection operation unit 401 (step S911). When it is determined that an instruction to select image data has been given from the image data selection operation unit 401, the image data acquisition unit 311 acquires the selected image data from the storage device 70. Next, an initial state of the position, size, and shape of the frame in the acquired image data is determined by the frame determination unit 313 (step S912).

  Next, the frame position moving unit 314 determines whether or not an instruction to move the position of the frame in the initial state is given from the frame position moving operation unit 407 (step S913). If it is determined that an instruction to move the position of the frame in the initial state has been given, the frame position moving unit 314 moves the position of the frame and proceeds to step S915 (step S914). On the other hand, if it is determined that an instruction to move the position of the frame in the initial state is not given, step S914 is skipped and the process proceeds to step S915.

  The frame position moving unit 314 determines whether an instruction to change the size of the frame in the initial state is given from the frame size changing operation unit 408 (step S915). If it is determined that an instruction to change the size of the frame in the initial state is received from the frame size change operation unit 408, the frame size change unit 315 performs a process of enlarging or reducing the size of the frame, and proceeds to step S917 ( Step S916).

  On the other hand, if it is determined that the frame size change operation unit 408 has not instructed to change the size of the frame in the initial state, it is determined whether or not the search instruction operation unit 406 has instructed to perform a search. Determination is made in the search unit 317 (step S917).

  If it is determined that an instruction to search is given from the search instruction operation unit 406, the search unit 317 generates a portion surrounded by a frame in the image data as template image data (step S918). After the template image data is generated, the search unit 317 starts searching for image data (step S919). On the other hand, if it is determined that the operation signal indicating that the search should be performed is not supplied from the search instruction operation unit 406 to the search unit 317, the process returns to step S913.

  FIG. 14 is a diagram showing a flow when the frame size is determined by the selection frame size determination unit 3134 in the flow of step S912 described in FIG. When the predetermined image data is selected, a frame size selection display in which a plurality of preset frame sizes are displayed is displayed on the display unit 61 (step S921).

  Next, the selection frame size determination unit 3134 determines whether or not an instruction to specify the frame size has been given from the frame size specification operation unit 405 (step S922). When it is determined that the frame size designation operation unit 405 has instructed to designate the frame size, the selection frame size determination unit 3134 determines the frame size based on the instruction to designate the frame size. (Step S923).

  Next, the frame position determination unit 3131 determines whether or not an instruction to specify the position of the frame in the image data is given from the frame position specifying operation unit 402 (step S924). When it is determined that an instruction to designate the position of the frame in the image data is given from the frame position designation operation unit 402, the frame position determination unit 3131 determines the position of the frame based on the instruction to designate the position of the frame. Is determined (step S925). When the position and size of the frame are determined, the fixed frame generation unit 3132 generates a frame based on the size of the frame and the position of the frame (step S926). Thereby, the initial state of the frame is determined.

  FIG. 15 is a diagram showing a flow when the border frame size determination unit 3135 determines the frame size in the flow of step S912 described with reference to FIG. When predetermined image data is selected, a frame designation display for designating the position of the frame is displayed on the display unit 61 (step S931).

  Next, the frame position determination unit 3131 determines whether or not an instruction for designating the frame position is given from the frame position designation operation unit 402 based on the frame designation display (step S932). When it is determined that the frame position specifying operation unit 402 has instructed to specify the position of the frame based on the frame specification display, the frame position determining unit 3131 determines the frame based on the instruction to specify the position of the frame. Is determined (step S933).

  Next, the border frame size determination unit 3135 determines whether or not an instruction to designate the border position of the frame is given from the frame size designation operation unit 405 based on the frame designation display (step S934). When it is determined that the frame size designation operation unit 405 has instructed to designate the border position of the frame based on the frame designation display, the border frame size determination unit 3135 gives an instruction to designate the border position of the frame. Based on this, the size of the frame is determined (step S935). When the position and size of the frame are determined, the fixed frame generation unit 3132 generates a frame based on the position of the frame and the size of the frame (step S936). Thereby, the initial state of the frame is determined.

  As described above, according to the embodiment of the present invention, the frame position designation operation unit 402 instructs the frame position determination unit 3131 to specify the frame position, and the frame size designation operation unit 405 instructs the frame size determination unit 3133. By simply designating the frame size, it is possible to select a predetermined area of the image data that is the premise of the template image data used for searching the image data. Such a simple operation is convenient for the user.

  Although the imaging apparatus has been described in the embodiment of the present invention, the present invention can be similarly applied to a mobile phone or the like having other image processing functions.

  The embodiment of the present invention is an example for embodying the present invention and has a corresponding relationship with the invention-specific matters in the claims as shown below, but is not limited thereto. However, various modifications can be made without departing from the scope of the present invention.

  That is, in claim 1, the frame position designation operation means corresponds to, for example, the frame position designation operation unit 402. The frame position determination unit corresponds to the frame position determination unit 3131, for example. A frame size designation operation unit corresponds to the frame size designation operation unit 405, for example. The frame size determining means corresponds to the frame size determining unit 3133, for example. The fixed frame generation unit corresponds to the fixed frame generation unit 3132, for example. A template generation unit corresponds to the template generation unit 316, for example. An image data holding unit corresponds to the storage device 70, for example. The search means corresponds to the search unit 317, for example.

  Further, in claim 2, the frame shape selection operation means corresponds to, for example, the frame shape selection operation unit 403.

  Further, in claim 5, the boundary frame size determining means corresponds to, for example, the boundary frame size determining unit 3135. The selection frame size determination unit corresponds to the selection frame size determination unit 3134, for example. The function selection operation means corresponds to the function selection operation unit 404, for example.

  Further, in claim 6, frame position movement operation means corresponds to the frame position movement operation unit 407, for example. The frame position moving means corresponds to the frame position moving unit 314, for example.

  Further, in claim 7, frame size change operation means corresponds to the frame size change operation unit 408, for example. The frame size changing unit corresponds to the frame size changing unit 315, for example.

  Further, in claim 8, image data selection operation means corresponds to, for example, the image data selection operation unit 401. The image data acquisition unit corresponds to the image data acquisition unit 311, for example.

  In claim 12 and claim 13, the image data holding means corresponds to the storage device 70, for example. The frame position designation receiving procedure corresponds to, for example, step S924 or step S932. The frame position determination procedure corresponds to, for example, step S925 or step S933. Also, the frame size designation receiving procedure corresponds to, for example, step S922 or step S934. The frame size determination procedure corresponds to, for example, step S923 or step S935. The fixed frame generation procedure corresponds to, for example, step S926 or step S936. A template generation procedure corresponds to, for example, step S918. The search procedure corresponds to, for example, step S919.

  The processing procedure described in the embodiment of the present invention may be regarded as a method having a series of these procedures, and a program for causing a computer to execute these series of procedures or a recording medium storing the program May be taken as

1 is an external view of imaging devices 100a and 100b that are examples of an image processing device according to an embodiment of the present invention. It is a figure which shows the structure of the imaging device 100 in embodiment of this invention. It is a figure which shows an example of a function structure of the system control part 31 and the operation part 400 in embodiment of this invention. It is a figure which shows an example of the template image data generation screen in embodiment of this invention. It is a figure which shows the mode of operation in the template image data generation screen in embodiment of this invention. It is the figure which showed a mode that the size of a frame was changed in embodiment of this invention. It is a figure which shows the template image data generation screen at the time of making the shape of the frame in the selection frame 620 into another shape in embodiment of this invention. It is a figure which shows the mode of the template image data generation screen in another embodiment of this invention. It is a figure which shows the mode of the production | generation of the frame in the template image data production | generation screen in another embodiment of this invention. It is a figure which shows a mode that the size of a frame is changed in embodiment of this invention. It is a figure which shows the image of template image data generation. It is a figure which shows a mode that the part similar to template image data is searched from image data. It is a figure which shows the flow until it searches for image data similar to template image data after producing | generating template image data from image data in the imaging device 100 in embodiment of this invention. It is a figure which shows the flow in the case of determining the size of a frame by the selection frame size determination part 3134 among the flows of step S912 demonstrated in FIG. It is a figure which shows the flow in the case of determining the size of a frame by the boundary frame size determination part 3135 among the flows of step S912 demonstrated in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Imaging device 311 Image data acquisition part 312 Acquisition image data holding part 313 Frame determination part 314 Frame position movement part 315 Frame size change part 316 Template generation part 317 Search part 400 Operation part 401 Image data selection operation part 402 Frame position designation operation part 402 403 Frame shape selection operation unit 404 Function selection operation unit 405 Frame size designation operation unit 406 Search instruction operation unit 407 Frame position movement operation unit 408 Frame size change operation unit 3131 Frame position determination unit 3132 Fixed frame generation unit 3133 Frame size determination unit 3134 Selection frame size determination unit 3135 Boundary frame size determination unit

Claims (13)

Frame position designation operation means for accepting designation of the position of a frame surrounding a predetermined area of image data;
Frame position determination means for determining the position of the frame based on designation from the frame position designation operation means;
Frame size designation operation means for accepting designation of the size of the frame;
Frame size determination means for determining the size of the frame based on designation from the frame size designation operation means;
Fixed frame generation means for generating a frame of a predetermined shape in a predetermined region of the image data based on the determined position and size of the frame;
Template generating means for generating template image data based on a predetermined area surrounded by the generated frame;
Image data holding means for holding search target image data;
An image processing apparatus comprising: search means for searching image data similar to the template image data in the search target image data. A frame shape selection operation means for accepting selection of any one of the at least two frames having different shapes;
The image processing apparatus according to claim 1, wherein the fixed frame generation unit generates the frame having the selected shape as the frame having the predetermined shape. The frame size designation operation means accepts designation of a border position of the frame in the image data;
The image processing apparatus according to claim 1, wherein the frame size determination unit determines the size of the frame based on a boundary position of the frame. The frame size designation operation means accepts selection of any one of at least two different sizes,
The image processing apparatus according to claim 1, wherein the frame size determining unit determines the selected size. The frame size designation determining means includes
Boundary frame size determining means for determining the size of the frame based on the boundary position of the frame;
Selection frame size determining means for determining the size of the frame to a size selected from at least two different sizes;
The image processing apparatus according to claim 1, further comprising a function selection operation unit that selects one of the boundary frame size determination unit and the selection frame size determination unit. Frame position movement operation means for accepting designation of a position to move the frame generated by the fixed frame generation means;
The image processing apparatus according to claim 1, further comprising a frame position moving unit that moves the position of the frame based on a designation from the frame position moving operation unit. Frame size change operation means for accepting designation of change in the frame size generated by the fixed frame generation means;
The image processing apparatus according to claim 1, further comprising: a frame size changing unit that changes a size of the frame based on a designation from the frame size changing operation unit. Image data selection operation means for accepting selection of predetermined image data held in the image data holding means;
Image data acquisition means for acquiring image data selected by the image data selection operation means,
The predetermined frame generation unit generates a frame having a predetermined shape in a predetermined region of image data acquired by the image data acquisition unit based on the determined position and size of the frame. The image processing apparatus according to 1.   The image processing apparatus according to claim 1, wherein the frame has a quadrangular shape.   The image processing apparatus according to claim 9, wherein the shape of the frame is a rhombus.   The image processing apparatus according to claim 1, wherein the frame has a circular shape. A processing method in an image processing apparatus comprising image data holding means for holding image data,
A frame position designation acceptance procedure for accepting designation of the position of a frame surrounding a predetermined area of image data;
A frame position determination procedure for determining the position of the frame based on the designation in the frame position designation reception procedure;
A frame size designation acceptance procedure for accepting designation of the size of the frame;
A frame size determination procedure for determining the size of the frame based on the designation in the frame size designation reception procedure;
A fixed frame generation procedure for generating a frame of a predetermined shape in a predetermined region of the image data based on the determined position and size of the frame;
A template generation procedure for generating template image data based on an area of the image data surrounded by the frame;
And a retrieval procedure for retrieving image data including image data similar to the template image data from the image data holding means based on the template image data. In an image processing apparatus comprising image data holding means for holding image data,
A frame position designation acceptance procedure for accepting designation of the position of a frame surrounding a predetermined area of image data;
A frame position determination procedure for determining the position of the frame based on the designation in the frame position designation reception procedure;
A frame size designation acceptance procedure for accepting designation of the size of the frame;
A frame size determination procedure for determining the size of the frame based on the designation in the frame size designation reception procedure;
A fixed frame generation procedure for generating a frame of a predetermined shape in a predetermined region of the image data based on the determined position and size of the frame;
A template generation procedure for generating template image data based on an area of the image data surrounded by the frame;
A program for causing a search procedure for searching for image data including image data similar to the template image data from the image data holding means based on the template image data.

Images