JP5096863B2 - Search device - Google Patents

Description

The present invention relates to a search apparatus having an image processing equipment provided with the communication unit to transmit the stored images to the outside.

  2. Description of the Related Art Conventionally, there has been an idea of improving the quality of a service by determining a person's values and the like by quantifying and providing information based on the determination result. For example, Japanese Patent Laid-Open No. 2001-229260 discloses a service that provides information based on a person's behavior history. Japanese Patent Application Laid-Open No. 2002-366728 discloses a system that determines a person's values from selection of a product and recommends a product based on the result. Japanese Patent Application Laid-Open No. 2001-310683 discloses a navigation device that digitizes operator values and reflects the results in navigation searches.

By the way, with the development of information communication technology in recent years, the number of photograph lovers who publish photographs (images) on the Internet such as Web sites and blogs is increasing. In addition, among these photo enthusiasts, there is an increasing demand for improving their photographic techniques by reviewing each other's photographs on the Internet and exchanging information.
JP 2001-229260 A JP 2002-366728 A JP 2001-310683 A

  However, a person who wants to improve his or her photography technology based on images posted on many websites and blogs published on the Internet is a photographer with a wealth of experience on the Internet. It is difficult to meet.

  The present invention has been made in view of the above-mentioned problems, and makes it possible to estimate the field of interest of a plurality of photographers existing on the network and the depth of knowledge about the field, and further to know at present. An object of the present invention is to provide an image processing apparatus and a search apparatus that can access a person who has abundant accurate knowledge.

The search device according to the present invention includes a storage unit that stores an image, a shooting date and time of the image, and a shooting condition of the image in association with each other, a theme assignment unit that adds a theme to the image, the shooting date and time, and the above Based on at least one of the shooting conditions, an evaluation value generation unit that generates an evaluation value for evaluating the depth and breadth of the photographer's knowledge and efforts on the theme, the image, and the photographer are identified and identification information, comprising the above-described theme, the shooting date and time, and a communication unit for transmitting and applying information including the photographing conditions and the evaluation value to the outside, the images processing equipment that have a connection to the communication network A search device for searching for the image in response to a search request, wherein a search unit that searches for and extracts the image to which the theme has been assigned is extracted by the theme included in the search request and the search unit. Given the above image A search result creation unit that ranks and sorts the results based on the evaluation values and transmits the search results, and the grant information includes comment information given by the photographer, When the theme is not assigned, the search unit searches for an image having information similar to the theme based on the comment information from an image without the theme.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a perspective view of a digital camera as viewed from the back side. FIG. 2 is a block diagram showing the main configuration of the digital camera according to the first embodiment of the present invention.

  The digital camera 10, which is an electronic apparatus according to the present embodiment, electronically captures an object image including an image sensor 3 and a photographing lens 2 that forms an optical image of the object 20 on a light receiving surface of the image sensor 3. As an imaging unit. The digital camera is generally called a digital still camera, an electronic camera, or the like.

  On the upper surface of the digital camera 10, a release switch 1a for a user to instruct a photographing operation and a power switch 1d for instructing a starting operation and an ending operation of the digital camera 10 are disposed.

  Further, on the back of the digital camera 10, a zoom instruction switch 1e for giving a zoom instruction for the taking lens 2 at the time of shooting, an operation switch 1f for setting the operation mode and parameters of the digital camera 10, and at the time of shooting. A liquid crystal display device 8 is provided as a display means for displaying a subject image as a moving image (live view display) or displaying a captured image recorded on a recording medium. At the time of shooting, in addition to the subject image, the number of images that can be shot, shooting conditions, warnings, and the like are displayed on the liquid crystal display device 8.

  As shown in FIG. 2, the digital camera 10 according to the present embodiment includes an MPU 1 that is a control unit that controls the operation of the digital camera 10, an imaging lens 2, and an optical image formed on the light receiving surface by the imaging lens 2. An image sensor 3 that converts an image of a subject 20 into an electrical image signal by photoelectric conversion and outputs the image signal, and an analog front end that converts the image signal output from the image sensor 3 into a predetermined digital signal and outputs the digital signal (hereinafter referred to as an image signal). 4), an image processing unit 5 that performs predetermined image processing on the image signal converted into a digital signal by the AFE 4 and converts the image signal into image data, a compression circuit 6 that compresses the image data for recording, and And a recording medium 9 for recording the image as a file.

  The MPU 1 includes a calculation unit, a storage unit, an input / output unit, and the like, and controls each circuit in the digital camera 10. As will be described later in detail, the MPU 1 executes a theme assignment process for assigning a predetermined theme to captured image data and an evaluation value generation process for generating and assigning an evaluation value for the theme. .

  The MPU 1 is provided with a clock function unit 1t. The clock function unit 1t is a circuit that generates and outputs time data of year / month / day / hour / minute / second.

  For example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or other various types of image sensors are applied to the image sensor 3. The recording medium 9 is a non-volatile recording medium such as a flash memory or a small hard disk drive.

  The image signal output from the image sensor 3 and converted into a digital signal by the AFE 4 is subjected to predetermined processing such as γ correction, color conversion, pixel conversion, and the like by the image processing unit 5 and converted into image data. The image data is converted by the compression circuit 6 into an image file that has been subjected to reversible or irreversible compression processing such as JPEG format, and is recorded on the recording medium 9 as an image file.

  In addition, the AFE 4 has a function of reading several pixels constituting the light receiving surface of the image pickup device 3 in a lump. With this function, when the signal level of each pixel is low, for example, when shooting in a dark place, signals from several pixels such as 4 pixels (2 × 2) and 9 pixels (3 × 3) are added. As a result, the S / N ratio can be improved and the sensitivity can be increased.

  The image processing unit 5 includes a contrast determination unit 5c that calculates the contrast (sharpness) of a predetermined area of the image data, and an image determination unit that determines the characteristics and the like of the image data. The image determination unit includes a color determination unit 5a that detects a color component included in image data, a face detection unit 5d that detects the position of a person's face in the image data, and the like. The image determination unit is for determining what kind of photograph the user is going to take from the difference in background color and the position of the subject.

  The face detection unit 5d is a circuit that executes image processing for detecting the position and size of the face of a person who is a main subject in image data described below, or a program therefor. An outline of an example of face detection processing executed by the face detection unit 5d will be described. In the face detection processing, pattern matching processing is performed on the image data 50 as shown in FIG. 4 using templates 51 having different sizes corresponding to the shadow of the human face as shown in FIG. The position and size of the face are detected from the change of the face.

  The photographing lens 2 is provided with an AF driving unit 2a and an aperture driving unit 2c. The AF driving unit 2a and the diaphragm driving unit 2c are for controlling the driving of the focusing lens and the diaphragm 2b (not shown) arranged on the optical axis of the photographing lens 2 based on an instruction from the MPU 1.

  The digital camera 10 of the present embodiment can change the in-focus distance by driving the focusing lens, and the focusing lens is set so that the MPU 1 has the maximum contrast value in a predetermined area of the image data. By driving, so-called contrast detection AF is possible.

  The diaphragm 2b has a diaphragm function for adjusting the amount of light by defining the passage range of the subject luminous flux and a shutter function for blocking the arrival of the subject luminous flux to the image sensor 3.

  Further, the digital camera 10 includes a communication unit 9b that transmits an image file recorded on the recording medium 9 and data associated with the image file by connecting to the communication network 90. The communication unit is a communication circuit capable of wireless communication standardized by, for example, IEEE 802.11. The communication unit may be connected to the communication network 90 via a connection cable, or may be connected to the communication network 90 by, for example, infrared communication or another wireless communication method.

  In this embodiment, the communication network 90 is a so-called Internet that can be interconnected using an Internet Protocol (IP) technology. The communication network 90 may be a closed network using a dedicated line such as an optical fiber or a telephone line in addition to the Internet.

  In the digital camera 10 of the present embodiment described above, when the user operates an operation member (including one not shown) such as the operation switch 1f, the sensitivity, the shutter speed, and the aperture value are set at the time of shooting. That is, the shooting conditions can be changed. Information on the shooting conditions (hereinafter referred to as shooting information) is recorded on the recording medium 9 in association with the image file. Further, the focal length, zoom magnification, and the like of the taking lens 2 at the time of taking an image are also recorded on the recording medium as shooting information.

  Note that information associated with image data such as shooting conditions and later-described themes and evaluation values may be stored in the image file as header information of the image file and recorded on a recording medium. The image file may be recorded on a recording medium as a separate file. Further, the photographing information may include information on altitude and water depth obtained by a pressure sensor and position information obtained by positioning means such as GPS.

  Below, operation | movement of the digital camera 10 of this embodiment is demonstrated.

  A main routine executed in the digital camera 10 of this embodiment is shown in FIG. When the power switch 1d is turned on by the user, the MPU 1 starts its operation. In step S01, the system performs initial setting operations such as memory initialization, IO initialization, and circuit initialization. In the shooting mode.

  In step S02, it is determined whether or not the release switch 1a has been pressed by the user and a shooting instruction has been issued. If a shooting instruction has been given, the process proceeds to step S10 to execute a shooting process. The photographing process in step S10 will be described in detail later with reference to the flowchart shown in FIG.

  If it is determined in step S02 that no shooting instruction has been given, it is next determined in step S03 whether or not the reproduction display mode is selected by the operation switch 1f. If the reproduction display mode is selected, the process proceeds to step S20, and reproduction transmission processing is executed. The reproduction / transmission process in step S20 will be described in detail later with reference to the flowchart shown in FIG.

  If it is determined in step S03 that the playback display mode has not been selected, it is then determined in step S04 whether or not the power switch 1d has been turned off. If the power switch is not OFF, the process returns to step S02. If the power switch is off, the process proceeds to step S06, and an end process for stopping the operation of the digital camera 10 is executed.

  Next, photographing processing when the release switch 1a in step S10 is pressed, which is executed in the digital camera 10 of the present embodiment, will be described with reference to FIGS.

  First, in the photographing process, after the autofocus operation and the exposure value are determined in step S11, image data is acquired (photographed) in step S12. In step S13, the time data acquired for the image data is acquired as shooting date / time information.

  In step S <b> 14, the feature information of the acquired image data is acquired by the image determination unit of the image processing unit 5. The feature information of the image data indicates what the image data is acquired as a theme (theme) in the present embodiment. In step S14, the digital camera 10 of the present embodiment automatically determines and acquires a theme that is feature information of image data by an image feature analysis process described below.

  FIG. 7 shows a flowchart of the image feature analysis processing. In the image feature analysis process, first, in step S61, the face detection unit 5d determines whether or not a human face exists in the image data.

  If it is determined in step S61 that a human face exists in the image data, the process proceeds to step S62, and whether the size of the human face is greater than or equal to a predetermined value with respect to the imaging area of the image data. Determine whether. If the size of the person's face is equal to or greater than a predetermined value, the process proceeds to step S64, where the theme of the image data is determined as “portrait” and the process ends. On the other hand, if the size of the person's face is smaller than the predetermined value, the process proceeds to step S63, the image data theme is determined to be “snap”, and the process ends.

  If it is determined in step S61 that no human face is present in the image data, the process proceeds to step S65, and it is determined whether the distance to the subject is a long distance from the focus distance information during AF. If the in-focus distance is equal to or greater than a predetermined value (for example, 5 m), it is determined that the subject exists at a long distance, and the process proceeds to step S71, where the theme of the image data is determined to be “landscape” and the process ends. .

  On the other hand, if the in-focus distance is shorter than the predetermined value in the determination in step S65, the process proceeds to step S66, and it is determined whether or not the distance to the subject is close from the in-focus distance information. If the in-focus distance is equal to or greater than a predetermined value (for example, 0.5 m), it is determined that the subject does not exist in the immediate vicinity, and the process proceeds to step S70, where the theme of the image data is determined as “animal” and ends. To do.

  On the other hand, if the in-focus distance is shorter than the predetermined value in the determination in step S66, the process proceeds to step S67, and the color in the image data is identified by the color determination unit 5a. For example, if the ratio of predetermined colors such as green, yellow, and red in the image data is large, the process proceeds to step S68 to determine that the theme of the image data is “plant”, and the process ends. Otherwise, it is determined that the theme of the image data is “Accessories” and the process ends.

  After the theme is determined to be landscape, the color is further identified by the color determination unit 5a. For example, if the ratio of blue is large, it is determined that the photograph is the sky or the sea, and if it is orange, the photograph is dusk. More detailed theme setting may be performed so that it is determined that.

  Further, in the digital camera 10 of the present embodiment, the theme of the captured image data is automatically determined as described above, but the user operates the operation switch 1f to determine the theme of the captured image data. It may be in the form of selecting and specifying. Moreover, the form which acquires the theme preset by the user before imaging | photography by the process of step S14 may be sufficient.

  After completion of the image feature analysis processing in step S14, in step S15, shooting information and feature information (theme) regarding the shot image data are added to the image data. In step S16, the image data is converted into a predetermined format such as JPEG format by the compression circuit 6 and recorded on the recording medium 9.

  In the present embodiment, shooting information and feature information (theme) regarding image data are recorded on the recording medium 9 as shooting history as data independent of the image data. The photographing history is left without being erased even if the corresponding image file in the recording medium 9 is erased.

  Next, the reproduction / transmission process in step S20 executed in the digital camera 10 of the present embodiment will be described with reference to FIG.

  In the reproduction transmission process, first, in step S21, the image file recorded on the recording medium 9 is reproduced and displayed on the liquid crystal display device 8.

  In step S22, it is determined whether the shooting mode is selected by the operation switch 1f or whether the power switch 1d is operated and is in the OFF state. If it is determined in step S22 that the shooting mode is selected by the operation switch 1f or the power switch 1d is operated and the camera is in the OFF state, the shooting mode processing is terminated and the process proceeds to step S04 in FIG. Transition.

  On the other hand, if it is determined in step S22 that the shooting mode is not selected by the operation switch 1f and the power switch 1d is not operated, the process proceeds to step S23.

  In step S23, a display asking the user whether or not to announce the image file recorded on the recording medium 9 through the communication network 90 is performed.

  If it is determined in step S23 that an image file is to be announced via the operation switch 1f, the process proceeds to step S24. On the other hand, when an instruction not to announce the image file is given, the process proceeds to step S22.

  In step S24, a process for causing the user to select an image file to be announced through the communication network 90 from the image files recorded on the recording medium 9 is performed. In step S25, a confirmation process for asking the user whether or not to transmit the selected image file to the communication network 90 is performed. Here, when it is selected not to transmit, the process proceeds to step S22.

  If it is determined in step S25 that the selected image file is to be transmitted via the operation switch 1f, the process proceeds to step S26. A series of processes in subsequent steps S26 to S33 is a process of calculating an evaluation value for evaluating the knowledge of the user (photographer) and the depth and breadth of the approach to the theme assigned to the image file to be transmitted. is there.

  The evaluation values calculated from step S26 to step S33 represent the user's (photographer's) feelings and depth of knowledge for the theme assigned to the image file, as schematically shown in FIG. Three items of “diversity”, “continuity” and “immediateness” are set as indices, and these values are calculated based on the photographing information.

  Diversity is an index indicating that a user is in contact with a predetermined theme from various angles. In this embodiment, the background of image data, the change of shooting time and season in the same theme are used. The degree of change in the value of each piece of photographic information such as composition change, exposure, distance, zoom position, etc. can be obtained by calculating the variance of those values, for example.

  For example, regarding the theme “portrait”, when shooting is performed under various different shooting conditions and compositions at various times and seasons, it can be determined that the diversity of the theme “portrait” of the user is high.

  Continuity is an index that indicates how long a user has been interested in a given theme, and is based on the interval and period at which images of the same theme were shot, and the regularity of shooting. Calculated as a numerical value. As an example, continuity can be quantified by the number of images taken per month for images of the same theme.

  For example, if the subject called portrait is taken regularly every month for several years or more, it can be determined that the user's continuity with respect to the theme called portrait is high.

  Immediacy is an index indicating the priority set by the user for a predetermined theme, and is calculated as a numerical value based on the time from the shooting of an image of the predetermined theme until the announcement.

  For example, regarding the theme “portrait”, if the image is announced via the communication network 90 on the shooting day, it can be determined that the immediacy of the user's theme “portrait” is high.

  In this embodiment, first, in step S26, the current time is acquired from the clock function unit 1t, and in step S27, the immediacy evaluation value is obtained by comparing the current time with the shooting date / time information of the selected image. calculate.

  In step S28, the theme is read out from the feature information given to the selected image, and the shooting history of the theme recorded in the recording medium 9 is read out. Here, the imaging history is data composed of shooting information such as shooting conditions, shooting date and time, and feature information (theme) for an image shot with the digital camera 10 in the past as described above.

  Next, in step S29, a diversity evaluation value is calculated based on the shooting and transmission history of the same theme as that assigned to the selected image. In step S30, a continuity evaluation value is calculated based on the shooting and transmission history of the same theme as that assigned to the selected image.

  Next, in step S31, it is determined whether or not the theme assigned to the selected image is a “main theme” for the user. Here, the main theme is a theme whose sum of values of immediacy, continuity and diversity is higher than a predetermined value, and the user's interest is high and knowledge is accumulated about the main theme. It shows that it is. If it is determined in step S31 that it belongs to the main theme, main theme information stating that fact is assigned to the image selected in step S32.

  Next, in the step S33, when the user wants to give a comment on the selected image when the selected image is presented, the phrase inputted by the user is given to the image.

  In step S34, the selected image file is transmitted to the server 91 via the Internet, which is the communication network 90, with the theme and the evaluation value added as metadata, and is released.

  The public method may be a form in which only the image file is uploaded on the server 91 connected to the communication network 90, or the digital camera 10 may upload the selected image file and the image file to the server. A form in which a blog entry or web page describing a hyperlink is automatically generated and uploaded may be used.

  Further, if a unique ID (identification information) is assigned to the digital camera 10 in the communication network 90, the digital camera 10 itself transmits a designated image file to the communication network 90 upon request. The form which becomes may be sufficient.

  The operation and effect of the digital camera 10 which is the electronic apparatus of the present embodiment having the above-described configuration will be described below.

  According to the present embodiment, the image file selected by the user is published on the communication network 90 with the theme and the evaluation value added as metadata. As described above, the metadata assigned to the image file becomes a search target of the automatic cyclic file search service on the general communication network 90. The theme and evaluation value assigned to the published image are indices indicating the level of interest and the amount of knowledge of the person who photographed the image, as described above.

  Therefore, when a third party performs a search by a terminal device using a theme and an evaluation value as a search key by a file search service, the third party can easily obtain an image file taken by a photographer who has a lot of experience and a large amount of knowledge. Can be referred to.

  More specifically, as shown in FIG. 10, it is assumed that four persons A to D who have published photographs can be connected to the communication network 90. In the bar graph attached to each person A to D in the figure, the horizontal axis represents the theme for photography, and the vertical axis represents the knowledge amount of each person A to D for each theme. Here, themes a to g correspond to a landscape, b is a plant, c is an animal, d is a snap, e is an accessory, and f is a portrait.

  When a person who is interested in a portrait wants to improve the skill on this theme, the server 92 that provides a file search service searches for an image having a high evaluation value in the portrait theme. . Then, in the search result by the server 92 that provides the file search service, the portrait taken by the person C is displayed as a result as the image with the highest match rate.

  Therefore, it becomes possible to refer to portraits that have been photographed and released in various ways by person C for a long period of time, and to improve the skill on this theme with reference to the image and the photographing conditions given as photographing information. Can be useful. It is also possible to contact the person C via a Web page or a blog on which an image photographed by the person C is posted, and obtain knowledge about the portrait of the person C.

  In other words, according to the present embodiment, it is possible to estimate the area of interest and the depth of knowledge about a plurality of photographers existing on the communication network, and further, there is abundant accurate knowledge about what you want to know now. Can be accessed.

  In the above-described embodiment, as shown in FIG. 11, the digital camera 10 having the imaging unit is directly connected to a communication network 90 such as the Internet, and an image file and a theme assigned to the image file. However, the present invention is not limited to this form.

  For example, a digital camera 101 that can add photographing information to a photographed image as in the EXIF standard is known. An image processing unit that assigns a theme to an image to the personal computer 102, which is an electronic device that stores an image that has been photographed by the digital camera 101, and the knowledge and efforts of the user about this theme There is also an embodiment in which an evaluation value generation unit that generates an evaluation value for evaluating the depth and breadth of the image, and a communication unit that transmits an image to which a theme, shooting information, and the evaluation value are assigned, are provided. The program to be executed is also included in the present invention.

  According to such a form, it is possible to execute precise image processing at a higher speed than the image processing apparatus provided in the digital camera 10, and to perform automatic determination of a theme to be given to an image more finely and accurately. It becomes possible.

  Further, the determination of the theme of the photographed image or the selection process of the theme of the photographed image by the user can be executed at a place and time different from those at the time of photographing. For this reason, according to such a form, the user can more comfortably take a picture and release it.

  The electronic device of the present invention is not limited to a digital camera. For example, an image that gives a theme and shooting information to a captured image as described above on a mobile terminal 10a such as a mobile phone equipped with an imaging unit. A processing unit, an evaluation value generating unit that generates an evaluation value for evaluating the depth and breadth of the user's knowledge and efforts on this theme, and transmitting an image with the theme, shooting information, and evaluation value to the communication network And a communication unit may be provided.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to the flowchart of FIG. FIG. 12 is a flowchart of importance evaluation processing.

  This embodiment is obtained by adding an item of importance to the first embodiment as an evaluation value to be added to an image file. Therefore, only this difference will be described below.

  In the present embodiment, the importance of the image is reversed in three stages of large, medium, and small according to the importance evaluation process of the flowchart shown in FIG. This importance evaluation process is performed after the evaluation values of the three items of “diversity”, “continuity”, and “immediateness” are determined. Is attached.

  In the importance evaluation process, first, in step S41, it is determined whether or not the immediacy value of the image file is a predetermined value or more. That is, an image file having a high immediacy value has high news properties, and is considered to be basically high in importance as an image that no one has seen yet.

  Then, if the value of immediacy is high and the assigned theme is important such as news reporting (YES in step S45), the importance of the image file is evaluated as large.

  However, even for an image file with a high value of immediacy, if immediacy is not important (eg, landscape or pet photograph) (NO in step S45), the same theme can be used. When the amount of images is large or when the diversity is high, the importance is evaluated as large. Otherwise, the importance is evaluated as medium.

  On the other hand, even if an image file has a low value of immediacy, it is evaluated that the photographer's approach to the subject is high if the image amount is large and the diversity is high, or the image amount is large and the regularity or continuity is high. And evaluate the importance as high.

  If the immediacy value is low and the above condition is not satisfied even if the image amount is large, the importance is evaluated as medium. Also, if the amount of image is at least high in diversity, the importance is evaluated as medium.

  If the value of immediacy is low, the amount of images is small, and the diversity is low, the importance is evaluated as low.

  By adding importance as described above to the image file as an evaluation value, it is possible to objectively determine not only a single image but also the photographer's approach to the theme, and the photographer's knowledge level Can easily determine whether or not the approach is sufficient for others to refer to. For this reason, this embodiment can contribute to the construction of a system that accesses useful information, and can realize a system that can improve the photography skill by feeding back the system.

  In the present embodiment, in order to simplify the description, importance is evaluated in three stages, but weighting may be performed more finely. With such a configuration, it is possible to digitize, and filtering such as rearranging search results in order of increasing numerical values becomes easier.

(Third embodiment)
Hereinafter, a third embodiment of the present invention will be described with reference to FIGS. FIG. 13 is a diagram illustrating a schematic configuration of the third embodiment. The present embodiment is different from the first embodiment in that a service provider site on a communication network has a configuration for assigning a theme and an evaluation value to a published image. Therefore, only this difference will be described below.

  The service provider site 110 includes a service that publishes on the communication network 90 an image uploaded from a previously registered and uniquely assigned image provider to the storage device 111 of the service provider site 110, and It is a server device that provides a service for searching for images. The service provider site 110 according to the present embodiment also provides a service for publishing a blog edited by a registered image provider on the communication network 90.

  In the present embodiment, as shown in FIG. 13, a storage device 111, an image processing device 112, and a search device 113 are arranged in a service provider site 110 connected to a communication network such as the Internet.

  The storage device 111 is a storage device such as a hard disk drive or a tape drive that stores an image file uploaded from an image provider. Similar to the digital camera 10 of the first embodiment, the image processing device 112 performs image processing on an image file, thereby detecting feature information of the image file and calculating a theme of the image file; And an evaluation value calculating unit that calculates an evaluation value for evaluating the knowledge and depth and breadth of the image provider's knowledge about the theme.

  The search device 113 searches a file stored in the storage device 111 based on a search word input from a user connected via the communication network 90 by a method described later, and displays the search result as a list to the user. To return.

  The operation of the service provider site 110 will be described with reference to the flowchart of FIG.

  First, the service provider site 110 determines a request from a user (user) who has accessed via the communication network 90 in steps S101 to S103. If it is determined in step S101 that the request from the user is to upload the provided image file, the process proceeds to step S110 to execute reception processing.

  If it is determined in step S102 that the request from the user is a search for an image file stored in the storage device 111, the process proceeds to step S120 to execute a search process.

  If it is determined in step S103 that the request from the user is a request for writing a comment on the blog of the image provider, the process proceeds to step S130 to execute a comment addition process.

  In the reception process of step S110, as shown in FIG. 15, first, in step S111, the provided image file uploaded from the image provider is stored in a folder corresponding to the ID of the image provider in the storage device 111.

  In step S112, it is determined whether it is necessary to determine the theme of the provided image file and add theme information. For example, if the theme has already been added to the provided image file by the digital camera as shown in the first embodiment, it is determined that theme determination and theme information addition are unnecessary, and the process proceeds to steps S114 and S115. Then, the provided image file is posted on a blog corresponding to the image provider's ID.

  On the other hand, if the theme information is not added to the provided image file, in step S113, the image processing apparatus 112 determines a theme that is characteristic information of the provided image file, and adds it to the provided image data. Since the theme determination process in step S113 is equivalent to the process in step S14 of the first embodiment, the description thereof is omitted.

  Then, the process proceeds to S114 and S115, and the provided image file is posted on the blog corresponding to the ID of the image provider.

  In the search process in step S120, as shown in FIG. 16, first, in step S121, among the image files stored in the storage device 111, an image file to which a theme that matches the search word input by the user is added. To extract.

  For the image file to which no theme is added, in step S122, the image file in the article in which the character string matching the search word is entered is extracted from the blog that publishes the image file.

  Then, in step S123, for the image provider who uploaded the extracted image file, an evaluation value for evaluating the knowledge and the depth and breadth of the approach that matches the search word is calculated, and the image with a high evaluation value is provided. The image files are ranked in the order of the users.

  In step S124, a search result list in which links to the ranked image files are listed in the ranking order is generated and provided to the user.

  In the comment adding process in step S130, as shown in FIG. 17, it is determined in step S131 whether or not the request from the user is a trackback process. If it is not the track back process, the process proceeds to step S132, and the character string input by the user is attached as a comment to the corresponding blog. If the request from the user is a trackback process, an association process between the user's blog and the blog that the user is currently browsing is performed.

  Also in this embodiment mentioned above, it has the same effect as 1st and 2nd embodiment.

  Further, according to the present embodiment, it is possible to provide a dedicated service for searching for an image file taken by a person interested in taking a picture. For example, it is possible to provide not only a search for an image file using only a search word (search formula) but also a weighted search based on the type of evaluation value. An example of this will be described below.

  As shown in FIG. 18, on the interface screen 120 for search processing provided to the user connected to the service provider's site 110, not only the search word entry field 121 but also which items of evaluation values are important. A check box 122 for selecting whether to perform a search visually is displayed.

  Check boxes 122 indicate that “blogs with the latest images”, “blogs with a large number of images”, “blogs with regular postings”, and “diversity” among blogs on which images matching the search word are posted. The user is allowed to select a blog satisfying which condition of “Blog”.

  By providing such a search service, the user can easily refer to the blog of the image provider who has taken an image that matches the theme he is interested in.

  In addition, according to such a configuration, it becomes possible for the image provider side to obtain the number of blog views (page view) that matches the effort on the subject matter that they are good at. be able to.

  Further, for example, by providing a search service according to the flowchart shown in FIG. 14, the service provider site 110 of the present embodiment can accurately provide an image file that the user wants to browse.

Based on the embodiment described above, the following configuration can be proposed. That is,
(Appendix 1)
A camera that shoots and records a subject,
Photographing means for photographing the subject;
Theme assignment means for assigning a theme to an image photographed by the photographing means;
Shooting date and time giving means for giving shooting date and time information of the image to the image;
Shooting condition specifying means for specifying shooting information representing shooting conditions when a subject is shot by the shooting means;
Evaluation value generating means for generating an evaluation value for evaluating the photographer's knowledge and the depth and breadth of the approach to the theme based on at least one of the shooting date and time information of the image and the shooting information;
Evaluation value giving means for giving the evaluation value to the image;
A camera comprising: the image; the theme assigned to the image; and storage means for storing an evaluation value for the theme.

(Appendix 2)
The image processing apparatus further includes communication means for transmitting the image stored in the storage means, identification information for identifying the camera or photographer, and the theme and the evaluation value assigned to the image to the outside. The camera according to attachment 1.

(Appendix 3)
The above evaluation value is
An evaluation value representing immediacy of evaluating a period from when the image is taken by the photographing means until an image is transmitted by the communication means, and a value representing continuity to evaluate the length of the period of tackling the same theme, The camera according to appendix 1 or 2, wherein the camera is calculated by one or a combination of values for evaluating the diversity of images photographed under the same theme.

(Appendix 4)
The camera according to appendix 3, wherein the theme assigning means assigns a theme to the image from a predetermined list by a photographer.

(Appendix 5)
The camera according to appendix 3, wherein the theme assigning means automatically selects a theme based on the shooting date / time information and the shooting information and assigns it to the image.

(Appendix 6)
The theme assigning means automatically selects a theme based on color information obtained by analyzing the image in addition to the shooting date and time information and the shooting information, and assigns the theme to the image. The camera according to appendix 5.

(Appendix 7)
An image processing apparatus that processes an image stored in storage means in association with an image, shooting date and time information of the image, and shooting information indicating shooting conditions when the image was shot,
Theme assignment means for assigning a theme to the image;
An evaluation value generating means for generating an evaluation value for evaluating the photographer's knowledge and the depth and breadth of the approach to the theme based on at least one information of the shooting date and time of the image and the shooting information;
Communication means for transmitting the image, identification information for identifying a photographer of the image, the theme assigned to the image, and the evaluation value for the theme to the outside;
An image processing apparatus comprising:

(Appendix 8)
The above evaluation value is
For the same identification information, a value indicating the immediacy of evaluating the shooting date and time until the image is transmitted by the communication means, and a value indicating the continuity for evaluating the length of the period of tackling the same theme The image processing apparatus according to appendix 7, wherein the image processing device is calculated by one or a combination of values for evaluating the diversity of images taken with the same theme.

(Appendix 9)
The image processing apparatus according to appendix 8, wherein the theme assigning means assigns a theme selected from a predetermined list by a user of the image processing apparatus to the image.

(Appendix 10)
The image processing apparatus according to appendix 8, wherein the theme assigning unit automatically selects a theme based on the shooting date and time and the shooting information and assigns the theme to the image.

(Appendix 11)
The theme assigning means automatically selects a theme based on color information obtained by analyzing the image in addition to the shooting date and time and the shooting information, and adds the theme to the image. Camera described in.

(Appendix 12)
A search device connected to a network and searching for an image on demand.
A communication means for transmitting and receiving information via the network;
The image received by the communication means, the identification information identifying the camera or photographer who took the image attached to the image, the theme given to the image, and the photographer's knowledge and depth of the approach Image storage means for associating and storing given information including an evaluation value for evaluating the sheath width;
Image publishing means for placing an image stored in the storage means on a web page and publishing it via the network;
Selection means for selecting a Web page on which the image is arranged based on the provision information;
Search means for searching for the Web page on which an image associated with the theme is arranged according to a theme included in the search request received by the communication means;
Rank ordering means for ranking the Web pages searched by the search means according to the evaluation values associated with the images arranged on the Web page;
Have
The search device according to claim 1, wherein the communication means sequentially transmits the Web pages searched by the search means in accordance with the rank assigned by the rank assigning means.

(Appendix 13)
The above evaluation value is
For the same identification information, a value representing immediacy for evaluating a period from when an image to which the evaluation value is given is taken until the image is transmitted to the search device, and a period for tackling the same theme The search device according to claim 12, wherein the search device is calculated by one or a combination of a value representing continuity for evaluating the length of the image and a value for evaluating the diversity of images taken with the same theme. .

(Appendix 14)
The grant information includes shooting information indicating shooting conditions when the image is shot or comment information given by the photographer,
When the theme and evaluation value are not given to the image received by the receiving means,
The storage means stores the identification information and at least one information of the shooting information and a comment,
The appendix 12 is characterized in that the retrieval means retrieves an image having information similar to the theme from the image in which the theme and the evaluation value are not associated with each other based on the shooting condition or the comment information. The described search device.

(Appendix 15)
The above evaluation value is
For the same identification information, it has a value representing immediacy for evaluating a period from when an image included in the shooting information is shot until the search device receives the image, and information similar to the theme. It is calculated by one or a combination of a value representing continuity for evaluating the length of a period during which an image is taken and a value for evaluating diversity of an image having information similar to the above-mentioned theme, The search device according to appendix 14.

(Appendix 16)
Item 13. The search device according to appendix 12, further comprising link means for linking another Web page to the Web page on which the image is arranged.

  The present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the gist or concept of the invention that can be read from the claims and the entire specification. The processing device and the search device are also included in the technical scope of the present invention.

  The electronic device according to the present invention is not limited to the digital camera described in the above embodiment, but may be a recording device, a mobile phone, a PDA, a personal computer, a game machine, a digital video camera, a digital media player, a television, a GPS, a clock, and the like. There may be.

It is a perspective view of a digital camera. It is a block diagram which shows the main structures of a digital camera. It is a figure explaining the template used for face recognition. It is a figure for demonstrating face recognition. It is a flowchart of the main routine of a digital camera. It is a flowchart of an imaging process. It is a flowchart of an image feature analysis process. It is a flowchart of a reproduction | regeneration transmission process. It is a figure explaining the evaluation criteria of an evaluation value. It is a figure explaining the effect | action by this invention. It is a figure explaining the modification of 1st Embodiment. It is a flowchart of the importance evaluation process in 2nd Embodiment. It is a figure explaining schematic structure of a 3rd embodiment. It is a flowchart of the main routine of 3rd Embodiment. It is a flowchart of the reception process of 3rd Embodiment. It is a flowchart of the search process of 3rd Embodiment. It is a flowchart of the comment addition process of 3rd Embodiment. It is a figure for demonstrating the screen display to search.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 Digital camera, 1 MPU, 1t Clock function part, 2 Shooting lens, 3 Image sensor, 4 AFE, 5 Image processing part, 5a Color judgment part, 5c Contrast judgment part, 5d Face detection part, 6 Compression circuit, 9 Recording medium 9b Communication part, 90 communication network

Claims (5)

A storage unit that stores an image, a shooting date and time of the image, and shooting conditions of the image in association with each other;
A theme assignment unit for assigning a theme to the image;
Based on at least one of the shooting date and time and the shooting conditions, an evaluation value generating unit that generates an evaluation value for evaluating the photographer's knowledge of the image and the depth and breadth of the approach to the theme;
A communication unit for transmitting the image, identification information for identifying the photographer, the theme, the shooting date and time, the shooting condition, and the grant information including the evaluation value to the outside;
With the images processing equipment that have a,
A search device connected to a communication network and searching for the image in response to a search request,
A search unit that searches for and extracts the image to which the theme is assigned according to the theme included in the search request;
A search result creation unit that ranks and rearranges the images extracted by the search unit based on the evaluation values assigned thereto, and transmits the result as a search result;
Have
The grant information includes comment information given by the photographer,
If the theme is not given to the image,
The search device, wherein an image having information similar to the theme is searched based on the comment information from an image to which the theme is not assigned. The evaluation value is a value representing immediacy calculated based on a period from the shooting date and time to the outside date and time for the same image, and the image to which the same theme is assigned is shot. A value representing continuity calculated based on a history, and a value representing diversity calculated based on the image information, the shooting condition, and the shooting date and time of the image to which the same theme is assigned. The search device according to claim 1, wherein the search device is calculated from at least one value. The search device according to claim 1, wherein the theme assignment unit assigns a theme selected from a predetermined list by a user of the image processing device to the image. The search device according to claim 1 or 2, wherein the theme assigning unit automatically selects a theme based on the shooting date and time and the shooting condition and assigns the theme to the image. The theme assigning unit automatically selects and assigns a theme to the image based on color information obtained by analyzing the image in addition to the shooting date and time and the shooting condition. Item 5. The search device according to any one of Items 1 to 4.

Images