JP5588267B2 - Image data management apparatus, image data management program, and image data management method - Google Patents

Description

  The present invention relates to an image data management apparatus, an image data management program, and an image data management method.

  2. Description of the Related Art Today, digital cameras that capture moving images or images using an image sensor such as a CCD are widely used. Images taken with this digital camera are recorded as digital data on a recording medium, and the recorded digital data can be displayed and viewed on a display device such as a monitor.

  In recent years, such a digital camera has been used in various fields such as the medical or beauty field, for example, for magnifying and photographing a subject in order to diagnose skin or hair (for example, Patent Document 1). In the diagnostic apparatus disclosed in Patent Document 1, the CCD camera is brought close to the subject portion, the subject portion is enlarged and output to the monitor, and the image is used to diagnose skin and hair. Can do.

  However, since the diagnostic apparatus disclosed in Patent Document 1 merely captures an enlarged image with a CCD camera, an image with a poor focus state that is not in focus due to camera shake at the time of shooting occurs. May be shot. In particular, in a magnified photograph of hair, a large amount of subjects are photographed densely at different distances, so skill is required to photograph focusing on hair suitable for diagnosis.

  In order to solve such a problem, there is an imaging apparatus disclosed in Patent Document 2. The imaging apparatus includes an imaging system that can form an image on subjects at different distances, a plurality of image memory units that store image signals from the imaging system, a recording unit that records image information on a recording medium, and the imaging system Are sequentially imaged at different distances from the initial position, and during that time, image signals from the imaging system are stored in each of the plurality of image memory means, and among the plurality of images stored in the plurality of image memory means Control means for selecting the best image from the recording means and supplying it to the recording means. According to such an imaging apparatus, it is possible to obtain an image that is always in focus within a short period of time without any automatic focus adjustment operation for a subject at any shooting distance.

Japanese Patent Laid-Open No. 11-70085 Japanese Patent Application Laid-Open No. 11-211974

  However, in the imaging apparatus disclosed in Patent Document 2 described above, focus adjustment is performed for the entire shooting distance with respect to the subject, and an image in which all the subjects are in focus is shot in a short time. When shooting a large number of densely populated subjects, the effects of camera shake are large, and the fine focal length is frequently adjusted, so that the in-focus timing matches the shutter timing. It is difficult to take a good image that can withstand diagnosis. In addition, an optical mechanism that can adjust a large number of fine focal lengths and a high-speed shutter mechanism that can follow the operation are required, which may increase the complexity and sophistication of the device and increase the manufacturing cost of the device. There is also.

  Therefore, the present invention solves the above-described problems, and enables simple photography to take an enlarged photograph in which a subject is dense like skin and hair, as well as photographed image data. To provide an image data management device, an image data management program, and an image data management program that can select and display only image data in good focus and display the target image data immediately. Objective.

In order to solve the above problems, the present invention is an apparatus that manages image data captured by an imaging unit, and stores a storage unit that stores a plurality of pieces of image data, and image data captured by the imaging unit. The focus evaluation value calculation unit that sequentially acquires and calculates the focus evaluation value of the acquired image data and sets the priority order based on the focus evaluation value of each image data, and the focus evaluation value calculation unit are set A data selection unit that selects image data stored in the storage unit according to the priority order, an image display unit that displays the image data stored in the storage unit based on the selection of the data selection unit , Based on a user operation, a range designating unit for designating a predetermined range in the image data displayed on the image display unit, and an addition for processing the image data included in the predetermined range designated by the range designating unit. Possess a processing unit, the range designation unit, wherein by inputting the three points specified on the image data as the user operation, recognizes the parallelogram portion including the three points as the predetermined range.

Another invention is a management method for managing image data captured by an imaging unit,
(1) a storage step of storing and holding a plurality of pieces of image data in a storage unit;
(2) In-focus evaluation values for sequentially acquiring image data picked up by the image pickup unit, calculating in-focus evaluation values for the acquired image data, and setting priorities based on the in-focus evaluation values of the respective image data A calculation step;
(3) a data selection step for selecting image data stored in the storage unit according to the priority set in the in-focus evaluation value calculation step;
(4) an image display step of displaying the image data stored and held in the storage unit on the image display unit based on the selection of the data selection unit ;
(5) Input three points on the image data displayed on the image display unit as a user operation, recognize the parallelogram portion including the three points as the predetermined range, and specify the predetermined range in the image data A range specification step to be performed;
(6) a processing step of processing the image data included in the predetermined range specified in the range specifying step .

  According to such an invention, since the in-focus evaluation value is calculated by the in-focus evaluation value calculation unit and the priority order based on the in-focus evaluation value is set for a plurality of imaged image data, the image is captured. Further, it is possible to discriminate between good image data in a focused state and bad image data from a plurality of pieces of image data. In the present invention, since the image data is selected according to the priority order, for example, it is possible to automatically and preferentially display image data with a high priority and a good focus state. Thereby, according to the present invention, an imaging device that does not have an automatic focus adjustment mechanism can be used even in an enlarged view in which a large amount of subjects are concentrated in a narrow range like hair, and with a simple configuration, The target image data can be acquired.

Furthermore, in the present invention, since the image data is displayed on the display unit based on the priority order calculated based on the focus evaluation value, the user does not need to rearrange the images, and the user can select an image in a good focus state. Only data can be viewed immediately. In the present invention, since a predetermined range of an image displayed on the display unit can be designated and processed, image data in accordance with the user's purpose can be obtained. Here, the processing of the image data includes, for example, processing for inserting characters or graphics into the image data, processing for sharpening and embossing, various image processing processing such as red-eye correction, brightness, and contrast adjustment.

  In the above invention, the in-focus evaluation value calculation unit preferably calculates the in-focus evaluation value based on the standard deviation of each image data. That is, the standard deviation of the pixel in the image data is usually out of focus, and the deviation becomes smaller as it becomes blurred. Therefore, by obtaining the standard deviation, whether or not the image data includes a focused part. Can be determined.

In the above invention, the imaging unit has a function of capturing an enlarged image by close-up, and the in-focus evaluation value calculation unit obtains a difference between a gradation of each pixel and an average of the gradations of neighboring pixels. Calculating the sharpness of only the hair part, obtaining the standard deviation of the gradation of the entire image, calculating the amount of hair, and calculating the in-focus evaluation value based on the sharpness and the amount of hair. Is preferred.

  In the above invention, the imaging unit has a function of capturing an enlarged image by close-up, the processing unit has a function of binarizing pixels included in a predetermined range, and the image display unit It is preferable to have a function of synthesizing and displaying the binarized image in a predetermined range in the image data.

  In this case, for example, it is possible to clarify the boundary portion for executing the process of separating the background portion from the designated range, and facilitate the separation processing.

Furthermore, in the above invention, the enlarged image is an enlarged photograph of the hair, and the image display unit has a diagnostic result display function for displaying the diagnostic result of the hair based on the binarized image within a predetermined range. preferable.

  In this case, from the enlarged photograph of the captured hair, for example, the predetermined range in focus is binarized as the designated range, and the surface state of the hair is displayed on the display unit by displaying a binarized image. Therefore, the cuticle of the subject's hair can be easily diagnosed. Here, in the diagnosis of hair, for example, a user who is a researcher or a beauty technician diagnoses the state of the cuticle by viewing the binarized image displayed on the image display unit, and the The user may input the diagnosis result and display the diagnosis result on the display unit. For example, the CPU of the computer digitizes the binarized portion of the displayed image data, and based on a predetermined threshold value The diagnosis result may be calculated and the diagnosis result may be automatically displayed.

Furthermore, another invention is a management program for managing image data captured by an imaging unit, and
(1) a storage step of storing and holding a plurality of pieces of image data in a storage unit;
(2) Focusing evaluation that sequentially acquires image data captured by the imaging unit, calculates a focusing evaluation value of the acquired image data, and sets a priority order based on the focusing evaluation value of each image data A value calculation step;
(3) a data selection step of selecting image data stored in the storage unit according to the priority set in the in-focus evaluation value calculation step;
(4) An image display step of displaying the image data stored and held in the storage unit on the image display unit based on the selection of the data selection unit;
(5) Input three points on the image data displayed on the image display unit as a user operation, recognize the parallelogram portion including the three points as the predetermined range, and specify the predetermined range in the image data A range specification step to be performed;
(6) a processing step for processing image data included in the predetermined range specified in the range specifying step;
The process which has is performed.

  According to such an invention, by using the image data management program, no special processing device is required, and various information processing devices are used as the above-described image data management device, and the image data management method is changed to various information processing methods. It can be realized in the device. That is, by installing this image data management program on a general-purpose computer or IC chip and executing it on the CPU, an image data management apparatus having the above-described functions is constructed, and an image data management method is easily constructed. can do. This program can be distributed through a communication line, for example, and can be transferred as a package application that operates on a stand-alone computer. Such an image data management program can be recorded on a computer-readable recording medium, and the above-described system and method can be implemented using a general-purpose computer or a dedicated computer. The program can be easily stored, transported and installed.

  As described above, according to the present invention, it is possible to take an enlarged photograph in which a subject is dense like skin and hair with a simple configuration, and from the photographed image data, Only good image data can be selected and displayed, and the target image data can be viewed immediately. As a result, according to the present invention, it is possible to provide a useful imaging device that can be used in various fields such as the medical and beauty fields while suppressing an increase in manufacturing cost.

It is a conceptual diagram which shows the whole structure of the image data management apparatus which concerns on embodiment. It is a block diagram which shows the management function module of the image data in CPU on the computer which concerns on embodiment. It is explanatory drawing which shows the image data list display screen displayed on the window which concerns on embodiment. It is explanatory drawing which shows the range designation | designated process displayed on the window which concerns on embodiment. It is a flowchart figure which shows the procedure of selecting and displaying the image | photographed image data which concerns on embodiment. It is a flowchart which shows the analysis / preservation | save process of the stored image data based on embodiment. It is a flowchart figure which shows the focus evaluation value calculation method which concerns on embodiment. It is a flowchart figure which shows the binarization process and hair diagnostic process which concern on embodiment.

  Embodiments of an image data management apparatus according to the present invention will be described below in detail with reference to the accompanying drawings. FIG. 1 is a conceptual diagram showing the overall configuration of the image data management apparatus according to the present embodiment. Here, it is assumed that the image data management program of the present invention is installed in the computer 1 in advance, and a case where a subject's hair is photographed to diagnose the health condition of the hair will be described as an example.

  As shown in the figure, the image data management apparatus is an apparatus for accumulating and managing image data picked up by a CCD camera 5 as an image pickup means, and is an operation device in a computer 1 in which an image data management program is installed. 2 (mouse 2a and keyboard 2b), a monitor 4 which is a display device, and a CCD camera 5 are connected.

  The computer 1 is an arithmetic processing unit equipped with a CPU, and can be realized by a general-purpose computer such as a personal computer or a dedicated device specialized in functions, such as a mobile computer, PDA (Personal Digital Assistance), portable Includes telephone. The computer 1 may be connected to a communication network such as a LAN, and may have a communication function for transmitting / receiving data to / from an external device such as a camera or a printer through the communication network.

  The operation device 2 is an operation device that inputs a user operation to the computer 1 as an operation signal, and may be a jog dial, a touch panel, or the like in addition to buttons such as a mouse 2a and a keyboard 2b. In particular, in the present embodiment, the operation device 2 performs an image display instruction from the user, selection of displayed image data, operation for specifying a range in the image data, start and stop of image data processing, and the like. Functions as an operation unit that accepts user operations. The monitor 4 is a display device such as a liquid crystal display, for example, and can display images, characters, and the like through a window generated by an application.

  The CCD camera 5 is an imaging device that captures a still image or a moving image. The CCD camera 5 includes a lens 5a and a fixed imaging element that is a CCD (not shown), and incident light representing an object image is coupled to a light receiving surface of the CCD. The image data is transmitted to the computer 1 via a camera signal processing circuit, an A / D converter, and the like. This image data includes a moving image and a still image, and the moving image data is transferred to the computer 1 in a streaming format in which a large number of continuous images are converted into frames. Further, the CCD camera 5 has an optical or electronic function for taking a magnified image by close-up. In this embodiment, the magnified image includes a magnified photograph in which subjects such as hair and skin are densely packed. It is.

  In the present embodiment, the moving image of the subject's hair can be displayed in real time on the window 42 on the monitor 4 by capturing a moving image of the subject's hair with the CCD camera 5, and from among the plurality of captured image data. The image data with good focus state is selected, and the selected enlarged image 48 is displayed on the window 42. Then, the user operates the keyboard 2b and mouse 2a connected to the computer 1 to execute a predetermined operation, thereby specifying a predetermined range of the image data displayed on the monitor 4 and processing the image data. By doing so, it is possible to diagnose the health state (cuticle state or the like) of the hair using the image data.

(Image data management function module)
The image data management described above is performed by an image data management function module on the CPU of the computer 1. FIG. 2 is a block diagram showing an image data management function module in the CPU on the computer 1 according to this embodiment, and FIG. 3 shows an image data list display screen displayed in the window according to this embodiment. 4 is an explanatory diagram, and FIG. 4 is an explanatory diagram illustrating a range designation process displayed in a window according to the present embodiment. The “module” used in the description refers to a functional unit that is configured by hardware such as an apparatus or a device, software having the function, or a combination thereof, and achieves a predetermined operation. .

  As shown in FIG. 2, in the present embodiment, the CPU of the computer 1 includes an input interface 101 and an output interface 102 as input / output modules.

  The input interface 101 (101a, 101b) is a module to which signals from the operation device 2, an external connection device, and the like are input. In the present embodiment, the input interface 101a is a module to which an operation device 2 such as a mouse 2a or a keyboard 2b is connected and an operation signal is input. Selection of displayed image data and a predetermined range of image data Or an instruction operation for processing the image data is input to the operation signal acquisition unit 111 as an operation signal. On the other hand, the input interface 101b is connected to an external connection device such as a CCD camera 5 as an imaging unit, and a moving image captured by the CCD camera 5 is input as continuous image data in a streaming format.

  The output interface 102 is a module that outputs video and audio output signals from the monitor 4 and the speaker, respectively, and outputs captured image data received from the application execution unit 110 to the monitor 4 in this embodiment.

  In addition, the CPU of the computer 1 includes an application execution unit 110 and a storage unit 120.

  The storage unit 120 is a memory device or the like that stores various data and programs. In this embodiment, the storage unit 120 stores and holds an image data management program and a plurality of image data captured by the CCD camera 5. In particular, in the present embodiment, the storage unit 120 includes a folder 120a that records and holds a plurality of pieces of image data recorded by a series of shooting processes as a group of image data. Depending on the conditions, a plurality of pieces of image data are stored and held in the folder 120a.

  The application execution unit 110 is a module that executes an application such as browser software or an image reproduction application on the OS. In the present embodiment, a module group that executes image data priority setting / selection processing, and an image It is roughly divided into a module group for executing data processing. Hereinafter, each module group will be described.

The module group related to image data priority setting / selection processing includes an output signal generation unit 114, an image processing unit 117, a focus evaluation value calculation unit 116, and a data selection unit 115.
The image processing unit 117 is a module that performs conversion of image data necessary for image display, and performs digital signal processing specialized for image processing. In the present embodiment, the image processing unit 117 performs compression encoding of still image and moving image data captured by the CCD camera 5, and the compressed and encoded image data is controlled by the application execution unit 110. Based on this, the data is stored in the storage unit 120. Also, the image processing unit 117 performs decompression decoding on the compression-encoded image data read from the storage unit 120 based on control by the application execution unit 110, and outputs the image data after the decompression decoding It transmits to the signal generation unit 114. The image processing unit 117 includes an image formation control function that controls color conversion for converting image data into a display image into an RGB image, switching of image data, and the like, and controls the entire image formation processing in the image display unit 41. It is.

  The output signal generation unit 114 is a module that converts the image data digitally processed by the image processing unit 117 into a video signal and an audio signal, and generates a signal that can be output by the image display unit 41 or a speaker. In the present embodiment, the output signal generation unit 114 performs signal generation processing based on the signals from the image processing unit 117 and the processing processing unit 113, and sends the video signal and audio signal to the output interface 102.

  The in-focus evaluation value calculation unit 116 sequentially acquires the image data captured by the CCD camera 5, calculates the in-focus evaluation value of the acquired image data, and priorities based on the in-focus evaluation value of each image data. Is a module to set In particular, in the present embodiment, the in-focus evaluation value calculation unit 116 has a function of calculating the in-focus evaluation value based on the standard deviation of each image data.

  Specifically, the in-focus evaluation value calculation unit 116 performs noise amount (V1), overall image data sharpness (V2), hair sharpness (V3) on the image data captured by the CCD camera 5, And the hair amount (V4) are calculated, and the focus evaluation value (F) is calculated based on the calculated data (V1, V2, V3, and V4).

More specifically, first, the in-focus evaluation value calculation unit 116 calculates the amount of noise (V1) included in the captured image data. Specifically, the in-focus evaluation value calculation unit 116 obtains an average value of the gradation differences of green components between pixels adjacent in the vertical direction (Y-axis direction) as the calculation of the noise amount. This is because the interlaced noise is generated in the image data because the image data captured by moving images is displayed by the interlace method, and this interlaced noise affects the calculation of the in-focus evaluation value. Specifically, this noise amount (V1) is calculated by the following equation.

Then, the in-focus evaluation value calculation unit 116 removes the noise of the entire image from the calculated noise amount by the moving average method.

  Next, the in-focus evaluation value calculation unit 116 calculates the sharpness (V2) of the entire image data. Usually, in a blurred image, gradations in the vicinity of pixels are averaged, and since there are many intermediate gradation pixels, the degree of gradation variation becomes small. That is, image data with a high standard deviation is a clear image, and image data with a low standard deviation is a blurred image with poor focus.

Therefore, in this embodiment, the sharpness of the image is calculated by obtaining the standard deviation of the gradation of the entire image. Specifically, the sharpness (V2) of the entire image is calculated by the following equation.

Next, the in-focus evaluation value calculation unit 116 calculates the sharpness (V3) of the hair. That is, since the calculated sharpness (V2) of the entire image is affected by the reflected background and the amount of hair, it is necessary to calculate the sharpness of only the hair portion. Here, since the background portion has a uniform gradation variation and the hair portion has a large variation in gradation, the present embodiment obtains the difference between the gradation of each pixel and the average of the gradation of neighboring pixels. Thus, the sharpness of only the hair portion is calculated. Specifically, the sharpness (V3) of the hair is calculated by the following formula.

Further, the focused evaluation value calculation unit 116 calculates the hair amount (V4). Here, since the calculated sharpness (V2) of the entire image is affected by the reflected background and the amount of hair, it is necessary to calculate and normalize the amount of hair. Since the background portion has no edge and the detected edge is a hair portion, in this embodiment, the amount of hair is calculated by obtaining the standard deviation of the gradation of the entire image after edge extraction by the Laplacian filter. To do. Specifically, the hair amount (V4) is calculated by the following formula.

And the in-focus evaluation value calculation unit 116 uses the result calculated with the noise amount (V1), the sharpness of the entire image data (V2), the sharpness of the hair (V3), and the hair amount (V4) as an explanatory variable, Further, the in-focus evaluation value (F) is calculated by the regression equation calculated using the visual result as the objective variable. Specifically, the in-focus evaluation value (F) is calculated by the following formula.

  The data selection unit 115 is a module that executes deletion or rearrangement on the image data stored in the storage unit 120 in accordance with the priority order set by the in-focus evaluation value calculation unit 116. Specifically, the data selection unit 115 compares the priority order of each image data from a group of image data, performs ranking based on the priority order, and executes rearrangement. Then, the data selection unit 115 causes the storage unit 120 to store the ranked image data. In the present embodiment, the image data up to the top 30 in the priority order are rearranged, and the rearranged 30 pieces of image data are controlled by the image processing unit 117 as shown in FIG. As a result, a list is displayed in the window 42 of the image display unit 41. In this window 42, image images 43 are displayed in order of priority, and the user can select arbitrary image data through this screen. In the present embodiment, the data selection unit 115 also has a function of selecting or deleting image data stored in the storage unit 120 for image data having a priority order equal to or lower than a certain value.

  Next, a module group related to image data processing in the application execution unit 110 will be described. The module group related to the image data processing includes an operation signal acquisition unit 111, a range specification unit 112, and a processing unit 113.

  The operation signal acquisition unit 111 is a module that receives an operation signal generated by a user operation from the input interface 101, analyzes the received operation signal, and causes another module to execute processing according to the user operation. In particular, in the present embodiment, the operation signal acquisition unit 111 acquires a signal related to an operation for specifying a predetermined range in the image data displayed on the image display unit 41 acquired from the operation device 2, and sends the signal to the range specification unit 112. input.

  The range designation unit 112 is a module that designates a predetermined range in the image data displayed on the image display unit 41 based on a user operation. In the range specifying mode for specifying a range on the image data displayed in the window 42, the range specifying unit 112 specifies a range surrounded by the user's point specifying operation as a specified range, and this range is determined by a polygon. Can be specified. In this embodiment, in particular, in this range designation mode, when the user obtains an operation signal for designating three points from the operation signal acquisition unit 111 from the operation device 2, the range designation mode is designated based on the operation signal. A function for automatically specifying a parallelogram as a specified range is provided.

  More specifically, in this embodiment, as shown in FIG. 4A, in the state where the enlarged image 48 of the hair is displayed, for example, the mouse 2a is used to click an arbitrary range point 45 of the hair part at three locations. Then, the range specifying unit 112 acquires the operation signal of this click operation and specifies the point position on the image data. Then, the range specifying unit 112 specifies the parallelogram portion including the three points as the specified range 46, as shown in FIG. Then, a signal regarding the designated range is input to the processing unit 113. In this way, when the subject is an enlarged view of the hair, in many cases, the shape of the designated range for specifying the hair surface is a parallelogram, and therefore in the range designation mode, a parallelogram with three-point designation is automatically set. An area is recognized as a specified range. Thereby, in this embodiment, labor saving of a user's operation is aimed at.

  The processing unit 113 is a module that processes the image data included in the specified range 46 specified by the range specifying unit 112. The processing unit 113 includes processing for inserting characters, graphics, and the like into the image data, and processing such as sharpening and embossing. Image processing such as red-eye correction, brightness, and contrast adjustment is executed. In particular, in the present embodiment, the processing unit 113 has a function of binarizing pixels included in a predetermined range, and an image of the specified designated range 46 as shown in FIG. Data is acquired and the pixels within the specified range 46 are binarized. Then, the processing unit 113 transmits the binarized image data to the image processing unit 117 and the output signal generation unit 114.

  The image display unit 41 is a module that includes, for example, a display device such as a liquid crystal display and a display drive circuit for the display, and displays images, characters, and the like on the display. In particular, in the present embodiment, the image display unit 41 displays the image data stored and held in the storage unit 120 based on the priority set by the in-focus evaluation value calculation unit 116, or displayed image data. It has a function of combining and displaying a binarized image within a predetermined range.

  In the present embodiment, the application execution unit 110 also has a function of diagnosing a cuticle state of hair based on image data binarized within a predetermined range. Specifically, the application execution unit 110 digitizes the binarized portion of the displayed image data, executes a diagnosis process based on a predetermined threshold stored in the storage unit 120, and calculates a diagnosis result To do. And the image display part 41 displays the diagnostic result of the hair based on the image diagnosed by the application execution part 110. FIG.

(Image data management method)
By operating the image data management apparatus having the above configuration, the image data management method of the present invention can be implemented. FIG. 5 is a flowchart showing a procedure for selecting and displaying photographed image data according to this embodiment, and FIG. 6 is a flowchart showing analysis / storage processing of photographed image data according to this embodiment. FIG. 7 is a flowchart showing the in-focus evaluation value calculation method according to this embodiment, and FIG. 8 is a flowchart showing the binarization process and the hair diagnosis process according to this embodiment. In the present embodiment, a case where a subject's hair is photographed and the hair is diagnosed will be described as an example.

  First, as shown in FIG. 5, a user, such as a researcher or a beauty engineer, takes an enlarged image of the hair by close-up of the subject's head with the CCD camera 5 (S101). This moving image data is input to the image processing unit 117 of the computer 1 via the input interface 101b.

  The image processing unit 117 displays the moving image data being shot on the screen of the image display unit 41 through the output signal generation unit 114 and the output interface 102 while the user is imaging the subject's hair (S102). Further, the focus evaluation value calculation unit 116 acquires image data as needed from the moving image data being shot, analyzes the in-focus evaluation value of each image data, sets priorities, and sets the image data with the priorities set. Recording is held in the storage unit 120 (S103).

  The processes in S101 to S103 are repeated until the user finishes shooting (“N” in S104), and ends with the user's stop operation and application end operation (“Y” in S104). When the user's stop operation or application end operation is performed (“Y” in S104), image data selection / display is executed (S105). More specifically, the image processing unit 117 receives a signal indicating that the priority setting has been completed from the in-focus evaluation value calculation unit 116, and based on the priorities of a plurality of image data, as shown in FIG. The held image data is selected and displayed as each image image 43 in the window 42 (S105).

  Next, the processing for analyzing / saving captured image data executed in step 103 will be described. First, when the user executes an image data management program, the in-focus evaluation value calculation unit 116 acquires an operation signal for analyzing and storing captured image data (S201). The in-focus evaluation value calculation unit 116 that acquired the operation signal calculates the in-focus evaluation value (F) based on the standard deviation of the image data acquired from the captured moving image data (S202). Then, the in-focus evaluation value calculation unit 116 sets a priority order based on the in-focus evaluation value (F) of each image data (S203), and transmits the image data to the data selection unit 115.

  The data selection unit 115 determines whether or not the priority order of the acquired image data is the top 30 or higher image data (S204), and if the priority order of the acquired image data is within the top 30, (“Y” in S204), the data selection unit 115 selects and stores the image data (S205). If there are already 30 or more image data with priorities set, the data selection unit 115 selects the newly acquired image data, the 30th image data with the priorities of the previous image data, Is executed (S205).

  On the other hand, if the priority order of the selected image data is not within the top 30, the data selection unit 115 does not execute the selection / save process for the image data (“N” in S204) and ends. .

  Next, an image processing method according to the image data management method according to the present embodiment will be described. Here, it is assumed that arbitrary image data is selected from the list screen in which the priority order is set, and an enlarged hair image 48 is displayed in the window 42 on the image display unit 41.

  First, as shown in FIG. 8, a predetermined range in the image data displayed on the window 42 is designated based on a user operation (S401). Specifically, as shown in FIG. 4A, the user clicks three points on the hair portion in the enlarged image of the hair with the mouse 2a. At this time, when the operation signal of the click operation is acquired, the range specifying unit 112 specifies the specified position of the image data as shown in FIG. 4B and designates the parallelogram portion including the three points as the specified range. Is specified. Then, the range specifying unit 112 inputs a signal related to the specified range to the processing unit 113.

  The processing unit 113 executes a processing process on the image data included in the predetermined range specified by the range specifying unit 112. Specifically, the processing unit 113 performs an arithmetic process for binarizing pixels included in the designated range of the image data based on the signal from the range designation unit 112 (S402). The data of this arithmetic processing is transmitted to the image processing unit 117, and is binarized in the designated range portion in the image data displayed on the window 42 on the image display unit 41 under the control of the image processing unit 117. Execute the process to synthesize. As a result, as shown in FIG. 4C, an image 47 that has been binarized is displayed on the image portion within the designated range 46 in the window 42 of the image display unit 41.

  Then, the application execution unit 110 digitizes the binarized portion of the displayed image data, executes a diagnosis process based on a predetermined threshold stored in the storage unit 120, and calculates a diagnosis result The diagnosis result data is transmitted to the image processing unit 117.

  Then, under the control of the image processing unit 117, the diagnosis result of hair based on the image binarized within the predetermined range is displayed on the window 42 (S403).

  In step S203 described above, specifically, the following control is performed. FIG. 7 is a flowchart showing a focus evaluation value calculation method according to this embodiment.

  As shown in FIG. 7, the in-focus evaluation value calculation unit 116 calculates the noise amount (V1) of the acquired image data (S301). Then, the in-focus evaluation value calculation unit 116 removes the noise amount (V1) from the image data by the moving average method (S302).

  Next, the in-focus evaluation value calculation unit 116 calculates the sharpness (V2) of the entire image from the image data (S303) and calculates the sharpness (V3) of the hair portion (S304). Then, the in-focus evaluation value calculation unit 116 extracts an edge from the image data using a Laplacian filter (S305), and calculates a hair amount (V4) that is a hair portion in the image data (S306).

  Then, the noise amount (V1), the sharpness of the entire image (V2), the sharpness of the hair portion (V3), and the hair amount (V4) are calculated by a regression equation to calculate a focus evaluation value (F) ( S307).

(Management program related to image data)
The above-described image data management apparatus and image data management method can be realized by executing a program described in a predetermined language on a computer. That is, by installing this program on a computer such as a user terminal or a Web server or an IC chip and executing it on the CPU, a system having the above-described functions can be easily constructed. This program can be distributed through a communication line, for example, and can be transferred as a package application that operates on a stand-alone computer.

  For example, the image data management program executes the image data management program on a computer 1 such as a PC, displays the above-described image data on a display of the PC, and the like, and can manage the image data through the operation device 2. Can be.

  Specifically, the storage step of storing and holding a plurality of pieces of image data in the storage unit 120 and the image data captured by the CCD camera 5 are sequentially acquired in the computer 1, and the in-focus evaluation value of the acquired image data is acquired. And a focus evaluation value calculation step for setting priority based on the focus evaluation value of each image data, and the image stored in the storage unit according to the priority set in the focus evaluation value calculation step A process including a data selection step of selecting data and an image display step of displaying the image data stored and held in the storage unit 120 on the window 42 based on the selection of the data selection unit is executed.

  Further, the image data management program causes the focus evaluation value (F) to be calculated based on the standard deviation of each image data in the focus evaluation value calculation step. In the present embodiment, the image data management program causes the computer 1 to designate a predetermined range in the image data displayed on the window 42 in the image display step based on a user operation, and in the range designation step. And processing including processing steps for processing the image data included in the predetermined range.

  Further, the CCD camera 5 has a function of photographing a magnified image by close-up. In the processing step, a calculation process for binarizing pixels included in a predetermined range is performed. In the image display step, the image is displayed on the window 42. Then, a process of combining and displaying the binarized image within a predetermined range in the image data is executed.

  Further, the enlarged image is an enlarged photograph of hair, and the image display step executes processing including a diagnosis result display step for displaying a hair diagnosis result based on an image binarized within a predetermined range.

  Such an image data management program can be recorded on a recording medium readable by a general-purpose computer, and the above-described system and method can be implemented using a general-purpose computer or a dedicated computer. The program can be easily stored, transported and installed.

(Action / Effect)
According to such an embodiment, it is possible to discriminate between good image data in a focused state and bad image data from a plurality of captured image data. In this embodiment, the image data is selected or deleted from the image data stored in the storage unit 120 according to the priority order. For example, the image data with a high priority and good focus state is given priority. In addition, it is possible to automatically delete defective image data and to eliminate troublesome operations such as confirmation of image data and deletion by the user. Furthermore, in this embodiment, since the image data is displayed on the window 42 based on the priority order calculated based on the focus evaluation value (F), the user does not need to perform rearrangement, and the user can change the focus state. Only good image data can be viewed immediately.

  In the present embodiment, since the in-focus evaluation value calculation unit 116 calculates the in-focus evaluation value (F) based on the standard deviation of each image data, it is determined whether or not the image data is out of focus and blurred. And whether or not the image data includes a focused portion can be determined.

  Further, in the present embodiment, based on a user operation, a range specifying unit 112 that specifies a predetermined range in the image data displayed in the window 42, and image data included in the predetermined range specified by the range specifying unit 112 Is further provided with a processing unit 113 for processing the image, so that a predetermined range of the image displayed in the window 42 can be designated and various types of processing can be performed, and image data in accordance with the user's purpose can be obtained. it can.

  In the present embodiment, the CCD camera 5 has a function of shooting an enlarged image by close-up, and the processing unit 113 has a function of binarizing pixels included in a predetermined range. The window 42 has a function of combining and displaying a binarized image within a predetermined range in the displayed image data. The enlarged image is an enlarged photograph of hair, and the window 42 includes a predetermined range. Since it has a diagnostic result display function that displays the diagnostic result of hair based on the binarized image in the inside, from the enlarged photograph of the imaged hair, binary processing is performed with the predetermined range in focus as the designated range The hair surface state can be clearly displayed, and the hair cuticle can be easily diagnosed.

DESCRIPTION OF SYMBOLS 1 ... Computer 2 ... Operation device 2a ... Mouse 2b ... Keyboard 4 ... Monitor 5 ... CCD camera 5a ... Lens 41 ... Image display part 42 ... Window 43 ... Image image 45 ... Range designation point 46 ... Designation range 47 ... Binarization 48 ... enlarged image of hair 101 ... input interface 101a ... input interface 101b ... input interface 102 ... output interface 110 ... application execution unit 111 ... operation signal acquisition unit 112 ... range specification unit 113 ... processing processing unit 114 ... output signal generation Unit 115 ... Data selection unit 116 ... In-focus evaluation value calculation unit 117 ... Image processing unit 120 ... Storage unit 120a ... Folder

Claims (15)

An apparatus for managing image data captured by an imaging unit,
A storage unit for storing and holding a plurality of pieces of image data;
The in-focus evaluation value calculation unit that sequentially acquires the image data captured by the imaging unit, calculates the in-focus evaluation value of the acquired image data, and sets the priority order based on the in-focus evaluation value of each image data When,
A data selection unit that selects image data stored in the storage unit according to the priority set by the in-focus evaluation value calculation unit;
Based on the selection by the data selection unit, the image data stored and held in the storage unit,
An image display section to be displayed ;
A range designating unit for designating a predetermined range in the image data displayed on the image display unit based on a user operation;
A processing unit that processes image data included in the predetermined range specified by the range specifying unit;
I have a,
The image data management apparatus characterized in that the range specification unit inputs a three-point specification on image data as the user operation and recognizes a parallelogram portion including the three points as the predetermined range. .   The image data management apparatus according to claim 1, wherein the in-focus evaluation value calculation unit calculates the in-focus evaluation value based on a standard deviation of each image data. The imaging unit has a function of shooting an enlarged image by close-up,
The in-focus evaluation value calculation unit calculates the sharpness of only the hair portion by calculating the difference between the gradation of each pixel and the gradation of the neighboring pixels, and calculates the standard deviation of the gradation of the entire image. The image data management apparatus according to claim 2 , wherein the image data management device calculates the amount of hair, calculates the in-focus evaluation value based on the sharpness and the amount of hair . The imaging unit has a function of shooting an enlarged image by close-up,
The processing unit has a function of binarizing pixels included in the predetermined range,
The image data management apparatus according to claim 1 , wherein the image display unit has a function of combining and displaying a binarized image within the predetermined range in the displayed image data. The enlarged image is an enlarged photograph of hair,
The image data management apparatus according to claim 4, wherein the image display unit has a diagnosis result display function for displaying a diagnosis result of hair based on an image binarized within the predetermined range. A management program for managing image data captured by an imaging unit,
A storage step of storing and holding a plurality of pieces of image data in the storage unit;
In-focus evaluation value calculation step of sequentially acquiring image data picked up by the image pickup unit, calculating a focus evaluation value of the acquired image data, and setting a priority order based on the focus evaluation value of each image data When,
A data selection step of selecting image data stored in the storage unit according to the priority set in the in-focus evaluation value calculation step;
An image display step of causing the image display unit to display the image data stored and held in the storage unit based on the selection of the data selection unit ;
Specifying a three-point specification on the image data displayed on the image display unit as a user operation, recognizing the parallelogram portion including the three points as the predetermined range, and specifying a predetermined range in the image data Steps,
A processing step for processing image data included in the predetermined range specified in the range specifying step;
An image data management program for executing a process including:   The image data management program according to claim 6, wherein the focus evaluation value calculation step calculates the focus evaluation value based on a standard deviation of each image data. The imaging unit has a function of shooting an enlarged image by close-up,
In the in-focus evaluation value calculating step, by calculating the difference between the gradation of each pixel and the average of the gradation of neighboring pixels, the sharpness of only the hair portion is calculated, and the standard deviation of the gradation of the entire image is calculated. The image data management program according to claim 7 , wherein the image data management program is obtained by calculating a hair amount and calculating the focus evaluation value based on the sharpness and the hair amount . The imaging unit has a function of shooting an enlarged image by close-up,
In the processing step, an arithmetic process for binarizing pixels included in the predetermined range is performed,
The image data management program according to claim 6 , wherein in the image display step, the binarized image is synthesized and displayed in the predetermined range in the image data displayed on the image display unit. . The enlarged image is an enlarged photograph of hair,
The image data management program according to claim 9, wherein the image display step further includes a diagnosis result display step of displaying a hair diagnosis result based on an image binarized within the predetermined range. A management method for managing image data captured by an imaging unit,
A storage step of storing and holding a plurality of pieces of image data in the storage unit;
In-focus evaluation value calculation step of sequentially acquiring image data picked up by the image pickup unit, calculating a focus evaluation value of the acquired image data, and setting a priority order based on the focus evaluation value of each image data When,
A data selection step of selecting image data stored in the storage unit according to the priority set in the in-focus evaluation value calculation step;
An image display step of causing the image display unit to display the image data stored and held in the storage unit based on the selection of the data selection unit ;
Specifying a three-point specification on the image data displayed on the image display unit as a user operation, recognizing the parallelogram portion including the three points as the predetermined range, and specifying a predetermined range in the image data Steps,
A processing step for processing image data included in the predetermined range specified in the range specifying step;
An image data management method comprising:   12. The image data management method according to claim 11, wherein in the focus evaluation value calculation step, the focus evaluation value is calculated based on a standard deviation of each image data. The imaging unit has a function of shooting an enlarged image by close-up,
In the in-focus evaluation value calculating step, by calculating the difference between the gradation of each pixel and the average of the gradation of neighboring pixels, the sharpness of only the hair portion is calculated, and the standard deviation of the gradation of the entire image is calculated. The image data management method according to claim 12 , wherein the image data management method is obtained by calculating a hair amount and calculating the focus evaluation value based on the sharpness and the hair amount . The imaging unit has a function of shooting an enlarged image by close-up,
In the processing step, an arithmetic process for binarizing pixels included in the predetermined range is performed,
12. The image data management method according to claim 11 , wherein in the image display step, a binarized image is synthesized and displayed in the predetermined range in the image data displayed on the image display unit. . The enlarged image is an enlarged photograph of hair,
The image data management method according to claim 14, wherein the image display step further includes a diagnosis result display step of displaying a hair diagnosis result based on an image binarized within the predetermined range.