JP2006309600A - Retrieval system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To photograph a retrieval object, and to remotely retrieve a name or the like of the object by easy operation. <P>SOLUTION: When retrieving information related to the retrieval object imaged by a photographing part 11, menu information for the retrieval is wirelessly transmitted to a camera 10 side from a server 20 side, retrieval category data, retrieval target image data and retrieval assistance information data of the retrieval object obtained by use of the menu information are wirelessly transmitted to the server 20 side from the camera 10 side. The server 20 retrieves name information or the like related to the retrieval object from a relation information DB part 24 by use of the retrieval category data, the retrieval target image data and the retrieval assistance information data received on the server 20 side, and a retrieval result is wirelessly transmitted to the camera 10 side from the server 20 side. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a retrieval system that remotely retrieves the name of an object in a field of view.

  In many cases, it is often desirable to know what an object (object to be imaged) photographed with a camera or the like is, and its name and type. However, usually, the subject is photographed with a camera and the image is displayed while searching using an Internet website or browsing and searching a picture book to determine its name, There are often difficulties in general. There is also an image search apparatus that performs image recognition using a computer dedicated to search, but such an image search apparatus is still in a limited place and can be used only by a limited number of people. There is also a technique for transferring image data of a camera by wireless communication, but generally, a large-scale image search system cannot be accessed, and image search is difficult.

  Therefore, for example, as shown in Patent Document 1, a feature portion of an image of a target object to be searched taken by a camera is designated by a pen input unit, its attribute information is input, and the target image designated by the pen input unit is designated. In addition, by comparing the attribute information with the partial images stored in the image database, the image database to be searched is recognized from the image database.

Japanese Patent Laid-Open No. 10-254901

  However, the image search device of Patent Document 1 is a dedicated stand-alone system, and can repeatedly perform a search operation for each input image portion, but is suitable for inputting image data from a remote place. It was not possible to perform a simple image search operation from a remote location with a limited number of procedures.

  The present invention has been made in view of the above problems, and an object thereof is to provide a search system capable of photographing a search object and remotely searching for the name of the object by a simple operation. To do.

  In order to solve the above-described problems and achieve the object, a search system according to the present invention includes a terminal and a server, and is a search system for searching for information related to a search target, wherein the terminal is a search target. Imaging means for imaging an object, search auxiliary data input means for inputting search auxiliary data used for searching using a menu transmitted from the server, and the search auxiliary data input together with image information captured by the imaging means Terminal-side transmission means for transmitting search auxiliary data input by the means to the server, terminal-side reception means for receiving menu information transmitted from the server and information related to search results searched by the server, and the terminal Display means for displaying information related to the search result received by the side receiving means, and the server includes the search auxiliary data input means. Search target using menu transmitting means for transmitting menu information to be used to the terminal, receiving means for receiving information transmitted by the terminal-side transmitting means, image information and search auxiliary data received by the receiving means Search means for searching for information related to an object, and search result transmitting means for transmitting information related to a search result searched by the search means to the terminal.

  In the search system according to a second aspect of the present invention, in the above invention, the menu information transmitted by the menu transmission means corresponds to the shape, color, size, number, orientation, and whole of the whole or part of the search object. It is at least one search auxiliary data among the positions of some images.

  According to a third aspect of the present invention, there is provided a search system according to the above-mentioned invention, wherein the whole or a part of the search target object is obtained by calculating the focus distance information of the imaging lens and the angle-of-view information of the photographing lens of the imaging means. It is characterized by calculating using.

  According to a fourth aspect of the present invention, in the search system according to the fourth aspect, the terminal further includes a sensor for detecting spectrum information related to the ambient light of the terminal, and the menu information transmitted by the menu transmission means is color. In this case, the terminal-side transmission means also transmits spectrum information related to the ambient light detected by the sensor.

  The search system according to the invention of claim 5 is characterized in that, in the above-mentioned invention, the menu information includes an application for obtaining information of a part of an image of the search object.

  Further, in the search system according to the invention of claim 6, in the above invention, the menu information transmitted by the menu transmission means is a search category that allows an operator of the terminal to select a category to which a search object belongs. It is a menu.

  According to a seventh aspect of the present invention, there is provided the search system according to the above invention, wherein the menu transmission means is a search auxiliary inputted by the image auxiliary means input by the image pickup means received by the reception means and the search auxiliary data input means. A search category menu is transmitted based on information of at least one of the data.

  The search system according to the present invention transmits menu information from the server side to the terminal side when searching for information related to the search target imaged by the imaging means, and an image of the search target object obtained by using this menu information. Information and search auxiliary data are transmitted from the terminal side to the server side, and the server searches for information on the search target using the received image information and search auxiliary data, and the search target is photographed. There is an effect that the name of the object can be searched remotely by a simple operation.

  Hereinafter, an embodiment of a search system according to the present invention will be described in detail with reference to the drawings of FIGS. The present invention is not limited to these embodiments, and various modifications can be made without departing from the scope of the present invention.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of a first embodiment of a search system according to the present invention. In the figure, the search system 1 includes a camera 10 as a terminal side and a server 20 as a search side. The communication between the camera 10 and the server 20 is performed via a public network such as the Internet. For example, wireless communication is mainly assumed, and necessary functions such as a communication protocol are used for the camera 10 and the server. 20 is included.

  The camera 10 includes an imaging unit 11 as an imaging unit, a display unit 12 as a display unit, an image area designation input unit 13, an image processing unit and an auxiliary information data processing unit 14, and a search menu and category selection as a search auxiliary data input unit. It comprises an input unit 15, a terminal-side transmission unit and a transmission / reception unit 16 as a terminal-side reception unit, and a control unit 17 connected to these units.

  The photographing unit 11 has a function of photographing an object, and the display unit 12 displays an image photographed by the photographing unit, a character / icon display such as a menu display or advice instruction to a user, a character display of search output, It has a GUI (Graphic User Interface) function with the user such as pseudo image display. The image area designation input unit 13 is composed of a touch panel such as a PDA (Personal Digital Assistant) provided on the display unit 12, and can input a search mode setting for searching and an image target portion instruction as shown below. To. The image processing unit and the auxiliary information data processing unit 14 perform necessary general images such as image area clipping processing necessary for search, background mask and color detection, color conversion, and area boundary line display when designating an image area. It has a processing function.

  The search menu and category selection input unit 15 generally has a function capable of giving an instruction to the camera 10 from the user when performing menu selection or category selection by a key operation (not shown). Information selected from the menu and category is referred to as search auxiliary data. Although this transmission / reception part 16 has a wireless communication function and enables data communication, for example, it is assumed that the transmission / reception part 16 goes through a public communication facility. Yes. The transmission / reception unit 16 may have a wired communication function for performing communication via a communication line or the like. The control unit 17 performs control of these units and other operation control of the camera 10.

  The server 20 includes a transmission / reception unit 21 as a menu transmission unit, a reception unit, and a search result transmission unit, a category-specific image DB (database) unit 22, a search menu and search auxiliary instruction set information DB unit 23, target name information and relation information DB A unit 24, a search unit 25 as search means, and a control unit 26 connected to each of these units.

  The transmission / reception unit 21 has a communication function similar to that of the transmission / reception unit 16 described above. For example, the received image information captured by the imaging unit 11 or the search menu and at least search auxiliary data input by the category selection input unit 15 is used. A search category menu is transmitted based on one information. The category-specific image DB unit 22 includes a category DB for defining a range of images to be searched and an image DB associated with them. The search menu and search auxiliary instruction set information DB unit 23 includes information on a search category menu DB for selection on the camera 10 side and a search instruction set for a user for the purpose of data acquisition for reliably performing the search. It consists of DB. In this search category menu DB, the search category menu shown in FIG. 2 is stored. That is, in FIG. 2, the search category menu includes, for example, “nature” for recognizing the higher-order items in the natural world, “things” for recognizing artificially created items, and persons active in each field. It consists of categories such as “person name” for recognizing, “color name” for recognizing color, and “signpost” for recognizing various signs. Has been. For example, the category of “Nature” has subcategories of “living” and “place”, and the subordinate of this “living” category has subcategories of “animal” and “plant”. Below the “animal” category are categories such as “bird”, “dog”, “cat”, and “fish”. The image DB stores image data associated with these lower categories.

  In addition, the search menu and search auxiliary instruction set information DB unit 23 can perform an action instruction display data set displayed on a display for the user to execute and further narrowed search for assisting the generation of search auxiliary data. A search support additional keyword data set and a program data set as an application used for image processing in the camera body are stored. The action instruction display data includes, for example, “enclose the entire bird with a line” shown in FIG. 3 as an entire search object, or a partial image position with respect to the entire object, for example “ Display information of action instructions for each category such as “enclose” is stored. In addition, the action instruction display data includes search auxiliary data such as the shape, color, size, number, and orientation of the whole or a part of the search object.

  Further, as the program data, information on a part of the image of the search object such as program data for performing image cutout processing of the image portion surrounded by the above-described line and program data for performing color extraction processing of the eyelid is obtained. Software for storing is stored. Further, as the search support additional keyword data set, display information of additional keywords such as “wild bird” and “livestock” is stored so that the search can be further narrowed down.

  The target name information and relation information DB unit 24 is a target name information DB linked to the output related to the image data at the time of search. In addition to these, content information related to those other than the name and further information outside these servers It is also a temporary storage DB of related information obtained through communication access to the DB. In addition, the target name information and relation information DB unit 24 also stores DB related information for outputting a similar image when it is ambiguous, which is not fixed in the search.

  The search unit 25 uses these DB units 22 to 24 to search for information related to the search object. The search unit 25 is composed of, for example, a large dedicated CPU, and the image search here is based on a general image search method, for example, a pseudo image search technique, but an image search other than the above-described pseudo image search method is used. Techniques are also included. As this image search method, for example, a database of MPEG7 feature description data (metadata) may be used. Feature extraction extracts features such as image coloration, color distribution, contour lines, and patterns. Further, when the search result by the search unit 25 cannot be narrowed down to one, the search unit 25 can output, for example, two or more similar names or similar images. Further, the search unit 25 outputs an additional search auxiliary instruction set and transfers it to the camera 10 from the transmission / reception unit 21. For example, as an instruction of the search auxiliary instruction set, “shoot from another angle and repeat” or It is also possible to narrow down the search by giving an additional instruction such as “Please take a larger image and repeat” and perform a corresponding shooting operation. The control unit 26 performs control of each of these units and operation control of the entire server 20 other than that.

  Next, the search operation of the search object by the search system will be described based on the flowchart of FIG. In FIG. 4, first, a subject (search target) is photographed by the photographing unit 11 on the camera 10 side (step 101), and when the search mode is turned on by setting from the image area designation input unit 13 (step 102), transmission / reception is performed. The unit 16 transmits communication request ID data (identification information) to the server 20 side by the operation control of the control unit 17 (step 103).

  In the server 20, for example, ID data for recognizing communication request ID data is registered in advance in an internal memory (not shown) of the control unit 26, and when the transmission / reception unit 21 receives this transmission request (step 201). The control unit 26 checks the ID data registered in the internal memory and, if they match, authenticates the ID (step 202) and sends a communication permission signal indicating communication permission via the transmission / reception unit 21. To the camera 10 side (step 203). In step 203, if the IDs do not match, transmission of the communication permission signal may be stopped, or a signal indicating that communication is not permitted may be transmitted.

  On the camera 10 side, the transmission / reception unit 16 receives data (step 104). When a communication permission signal is received (step 105: Yes), a search category menu request is transmitted to the server 20 side (step 105). 108). When the communication permission signal is not received, or when the signal indicating that communication is not permitted is received (step 105: No), the control unit 17 controls the display unit 12, for example, “communication impossible”. The display is displayed on the display screen of the display unit 12 to notify the photographer or the like (step 106). Next, when the search mode is turned off by the setting from the image area designation input unit 13 (step 107), the process returns to step 101 to wait for the next shooting.

  Next, when the server 20 side receives a request for a search category menu from the camera 10 side (step 204), the search unit 25 is selected on the camera 10 side from the search menu and search auxiliary instruction set information DB unit 23. The search category menu and the data of the search instruction set for the user are searched and acquired, and the menu data is transmitted from the transmission / reception unit 21 to the camera 10 side (step 205).

  On the camera 10 side, when the transmission / reception unit 16 receives these menu data (step 109), the control unit 17 displays the search category menu (see FIG. 2) on the display screen of the display unit 12 (step 110). In this embodiment, first, “nature”, “thing”, “person name”, “color name”, and “sign” are displayed. Then, according to the search category menu, the category display and the category selection by the camera user (operator) are sequentially performed, and the lowest category selection by the user, for example, in this embodiment, “nature”, “biology” ”And“ animal ”are selected in the order of display, and when the lowest category“ bird ”is selected (step 111), a request for search auxiliary instruction set data is sent from the transmitting / receiving unit 16 to the server 20 side. Transmit (step 112). The searched category “bird” is temporarily recorded in the internal memory of the control unit 17 as, for example, search category character data A.

  On the server 20 side, when a request for search auxiliary instruction set data is received from the camera 10 side (step 206), the search unit 25 receives the action menu display data set from the search menu and search auxiliary instruction set information DB unit 23, and the camera body. The program data sets to be used for image processing are searched and acquired, and these data sets are transmitted from the transmitting / receiving unit 21 to the camera 10 side (step 207).

  On the camera 10 side, when the transmission / reception unit 16 receives these data sets (step 113), the control unit 17 displays action advice on the display screen of the display unit 12 based on the program data set (step 114). In this embodiment, as shown in FIG. 3, the action advice display “Enclose the whole bird with a line” is displayed on the image P0 obtained by photographing the search object (step 114), as shown in the image P1. Then, the target area instruction input for encircling the whole bird with a line is performed by the image region designation input unit 13 (step 115), and then the image cutout process 1 as the image preprocessing is performed by the image processing unit and the auxiliary information data processing unit 14. Then, the entire bird image shown in the image P2 is cut out (step 116). The extracted whole bird image data is temporarily recorded in the internal memory of the control unit 17 as search image data B, for example.

  Note that the search assisting operation in steps 114 to 116 using these data sets may be performed once or may be performed several times depending on, for example, the category of the search object. In the case of this bird search, as shown in FIG. 3, next, an action advice display of “enclose the eagle with a line” is performed (step 114), and as shown in an image P3, the image area designation input unit 13 A target part instruction is input to surround the eyelid with a line (step 115), and the image processing unit 14 and the auxiliary information data processing unit 14 then perform image cutout processing 2 as image preprocessing, and the image of the eyelid shown in the image P4 Is cut out (step 116). The cut out image data of the cocoon is temporarily recorded in the internal memory of the control unit 17 as search image data C, for example.

  Furthermore, in this embodiment, in step 116, the image processing unit and the auxiliary information data processing unit 14 perform the color extraction processing of the eyelid as image preprocessing to search for the eyelid color data. The retrieved color data is temporarily recorded in the internal memory of the control unit 17 as, for example, retrieved color data D. When all image preprocessing is completed, the control unit 17 selects the selected search category character data A, search image data B as search target image data, search image data C as search auxiliary information data, and search color data. D is transferred to the server 20 side by controlling the transmission / reception unit 16 (step 117).

  On the server 20 side, when the search object data is received from the camera 10 side (step 208), the search unit 25 performs a search process while comparing with the data in the category-specific image database unit and relates to the image data at the time of the search. The target name information linked to the attached output is searched from the target name information and relation information DB unit 24 (step 209), and the content information related to those other than the name is delivered to the camera 10 side as result data together with the name. In the search processing by the search unit 25, for example, a search is performed based on each search result data, and a final search result (name) is extracted based on the search results. For example, based on the search image data B, the names “Kawarahiwa”, “Canary”, “Inco” and “Tsugumi” are searched, and on the search image data C, “Canary” and “Inco” are searched and searched. When “Yamagara” and “Canary” are searched based on the color data D, the name “Canary” common to all search results is extracted as a final search result.

  On the camera 10 side, when the transmission / reception unit 16 receives the result data (step 118), the control unit 17 displays the name as the result data on the display screen of the display unit 12 (step 119). End the operation. If the search result cannot be narrowed down to one based on the search result data acquired by the search unit 25 of the server 20, the search unit 25 outputs, for example, two or more similar names or similar images. Alternatively, an additional search auxiliary instruction set may be transferred to the camera 10 to further narrow down the search.

  As described above, in this embodiment, when searching for information related to the search target imaged by the imaging unit 11, the menu information for search is wirelessly transmitted from the server 20 side to the camera 10 side, and this menu information is used. Search category data, search target image data, and search auxiliary information data of the obtained search target are wirelessly transmitted from the camera 10 side to the server 20 side, and the received search category data, search target image data, and search auxiliary information data are received. The server 20 searches for information (for example, a name) related to the search object, so that the search object can be photographed and the name of the object can be searched remotely by a simple operation.

(Embodiment 2)
FIG. 5 is a block diagram showing a configuration of Embodiment 2 of the camera according to the present invention, FIG. 6 is a diagram showing an example of an image taken by the camera shown in FIG. 5, and FIG. It is a figure for calculating | requiring the size of the search target image | photographed with the camera shown in FIG. FIG. 5 is a diagram showing only components different from the configuration of the camera 10 shown in FIG. 1, and other configurations are the same as those of the camera 10 shown in FIG.

  The camera of this embodiment searches for the size of the search object as search result data using the focus function and zoom function that the camera itself originally has. In FIG. 5, a camera 30 detects an imaging unit 31 (similar to the imaging unit 11 shown in FIG. 1) as an imaging unit, a memory unit 32 that stores captured image data, and a focus distance with a search target. A focus distance detection unit 33, a zoom magnification information detection unit 34 for detecting zoom magnification information of the photographing unit 31, a target image size instruction unit 35 for instructing an image size of a photographed search target, and a size of the search target The object size calculation unit 36 is configured to calculate.

  In this embodiment, the image P5 shown in FIG. 6 photographed by the photographing unit 31 is stored in the memory unit 32, and as in the first embodiment, the image processing unit and The whole image cutout process 1 is performed by the auxiliary information data processing unit 14 to cut out the whole bird image shown in the image P5.

  Further, in this embodiment, as shown in FIG. 7, a bird is CCD (photographing element) 31b using a camera 30 with a lens 31a having a focal length of 135 mm (35 mm equivalent, angle of view: about 18 degrees) as field angle information. A case will be described in which the image of the bird appears in the size of about 1/10 of the screen width of the display unit 12 when the image is taken. In FIG. 5, the zoom magnification information detection unit 34 detects this focal length information and outputs it to the object size calculation unit 36, and the focus distance detection unit 33 selects the focus distance information between the search object and the lens 31a. The focus distance value is detected as 8 m and is output to the object size calculator 36.

  Next, in the image display after imaging by the camera, the image area designation input unit 13 points the bird's heel tip and tail tip so that the length between these points is used as the bird length information. This is given to the size calculator 36. In the camera 30, in this case, on the image display, the length of the bird appears as 1/10 of the display width, the length between the point-indicated points becomes 1/10 at the same ratio, and the total width of the CCD 31b is 36 mm. Therefore, the bird is reflected in 1/10, that is, about 3.6 mm. The object image size instructing unit 35 instructs the object size calculating unit 36 about the image size of the search object.

  The object size calculator 36 calculates the length (size) X of the search object based on these data. That is, since X = (focus distance value) × (object image size) / (focal length), the object size calculator 36 substitutes these values into this equation, and X = 8 × 3.6 / 135 = 0.213 m can be obtained. Thereby, it is obtained that the length of the search object is a bird of about 21 cm.

  The control unit 17 sends the search result data of this bird length along with the selected search category character data A, search image data B, search image data C and search color data D shown in the first embodiment to the server 20 side. , And the image search process is performed by the server 20, whereby the name of the bird is further easily and reliably searched. The searched name data is transferred to the camera 30 and displayed on the display unit 12 of the camera 30.

  As described above, in this embodiment, in addition to the various data for searching for the search object of the first embodiment, the size of the object calculated using the lens focus distance information and the lens angle-of-view information. Therefore, it is possible to take a picture of a search object and search for the name of the object from a remote location with a simpler operation.

(Embodiment 3)
FIG. 8 is a block diagram showing a configuration of Embodiment 3 of the camera according to the present invention, FIG. 9 is a diagram showing an example of an image taken by the camera shown in FIG. 8, and FIG. It is a figure which similarly shows an example of the image of the state in which one part was selected. FIG. 8 is a diagram showing only components that are different from the configuration of the camera 10 shown in FIG. 1, and other configurations are the same as those of the camera 10 shown in FIG.

  The camera of this embodiment detects color information of a search object (Japanese traditional color name) as search result data using a calibration function originally provided in the camera itself. In FIG. 8, a camera 40 includes a photographing unit 41 (similar to the photographing unit 11 shown in FIG. 1) as an imaging unit, and a memory unit 42 (similar to the memory unit 32 shown in FIG. 5) for storing photographed image data. ), A color information detection unit 43 as a sensor for detecting color information of the photographed image, that is, spectral information relating to the ambient light of the camera 40, and a white plate photographing color detection unit for detecting color information at the time of photographing the white plate part 50 44, an object image partial instruction input unit, a temporary memory, a color balance detection unit, and a color correction processing unit 45. The object image partial instruction input unit, the temporary memory, the color balance detection unit, and the color correction processing unit 45 are functions of the control unit 17 shown in FIG. 1 and will be described below for each function.

  Also in this embodiment, the image P6 of the kimono shown in FIG. 9 photographed by the photographing unit 41 is stored in the memory unit 42, and in the same way as in the first embodiment, the Japanese traditional color name retrieved by the search category menu is stored. Then, the image cropping process 1 of the entire kimono by the image processing unit and the auxiliary information data processing unit 14 is performed to cut out the entire image of the kimono shown in the image P6.

  Next, as shown in FIG. 10, the kimono portion in the image is designated by the in-object image portion instruction input unit, for example, by a circle in FIG. 10, and the color information is detected by the color information detection unit 43. . The color information of the kimono portion detected by the color information detection unit 43 is stored in a temporary memory, for example. In this case, in order to reduce the influence of the color change caused by the environmental illumination, for example, the calibration white plate portion 50 provided on the camera cap or the like is photographed, and the color information of the white plate portion photographed image is used as the color detection portion during white plate photographing. 44. At the same time, based on this color information, the color balance of the white board image is detected by the color balance detection unit, and the color of the kimono detected by the previous color information detection unit 43 is corrected by the color correction processing unit. Thus, the corrected color information is obtained.

  The control unit 17 transfers the corrected color information to the server 20 side, and the search unit 25 performs image search processing from the DB unit previously associated with the color data value and the Japanese traditional color name by the server 20. By doing so, the names of traditional Japanese colors, such as “Aokichiba” and “Akashiro Tsurubami” are searched, and the character data is transferred to the camera 40 side to On the 40 side, the control unit 17 causes the display unit 12 to display characters of color names. Note that the color name DB section can search for color names in each country, color names used by designers, color names that can be understood by children, etc., so that the user can select each DB. preferable.

  In addition, in order to accurately grasp the color of the photographed search object image, it is possible to perform a name search with high accuracy as the search auxiliary information data composed of the three primary colors of RGB by using the above-described method. is there. Here, for example, when trying to know a traditional color name of a kimono such as ocher, when this kimono is photographed and color is detected by the color information detection unit 43, for example, R: G: B = C1: 98: 33 is obtained. When the part 50 is photographed, the color is detected by the color detection part 44 during white board photography, the color balance information is detected by the color balance detection part, and the color correction processing part performs color correction, R: G: B = BA: 9E: Assume that color information corrected to 3B is obtained. When the corrected color information is transferred to the server 20 side and the server 20 retrieves a DB previously associated with the data values of the three primary colors and the Japanese traditional color name, for example, a name output of “Aotsukiha” can be obtained. it can. Further, by storing the kimono pattern and the like as pattern data in the DB unit, it is possible to search for the name of the kimono pattern to be searched.

  As described above, in this embodiment, in addition to the various data for searching for the search target object of the first embodiment, the color of the search target object as the spectral information related to the ambient light detected by the color information detection unit is used. Since correction means are provided and color information close to the color of the actual search target is added to the data, the search target is photographed, and the color and name of the target can be searched remotely by a simpler operation. Can do.

  Note that the present invention is not limited to the above-described embodiment. For example, when a building is photographed from a communication access point using GPS (positioning system), the location of the building is detected and the name of the building is specified. It is also possible. It is also possible to provide a compass for measuring the orientation on the camera side and specify the name of the photographed mountain, for example, from the measured orientation. It is also possible to provide a recording function for recording audio data on the camera side, for example, to record a photographed bird's voice and specify a bird's name from a voiceprint or the like. It is also possible to provide a sensor for detecting infrared rays on the camera side and take an infrared image of the search object, thereby detecting the body temperature and the like to specify the name of the animal. Furthermore, a moving image recording function can be provided on the camera side, and the name of the object can be specified from the movement of the search object.

  In the above description, the server 20 is described assuming a single server. However, the present invention is not limited to this. For example, a plurality of servers may cooperate to perform a search, or a terminal may be used. A relay server may be arranged between the camera 10 on the side and the server 20, and this relay server may be responsible for a part of the search function. Furthermore, the search in the server is not limited to a search using only a computer, and for example, an operator can intervene to improve the search accuracy.

It is a block diagram which shows the structure of Embodiment 1 of the search system concerning this invention. It is a figure which shows an example of the category memorize | stored in the image DB part classified by category shown in FIG. It is a figure for demonstrating the procedure for pinpointing a search target object. 5 is a flowchart for explaining a search target object search operation by the search system shown in FIG. 1. It is a block diagram which shows the structure of Embodiment 2 of the camera concerning this invention. It is a figure which shows an example of the image image | photographed with the camera shown in FIG. It is a figure for calculating | requiring the size of the search target image | photographed with the camera shown in FIG. It is a block diagram which shows the structure of Embodiment 3 of the camera concerning this invention. It is a figure which shows an example of the image image | photographed with the camera shown in FIG. Similarly, it is a figure which shows an example of the image of the state in which one part was selected.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Search system 10, 30, 40 Camera 11, 31, 41 Image pick-up part 12 Display part 13 Image area designation | designated input part 14 Auxiliary information data processing part 15 Category selection input part 16, 21 Transmission / reception part 17, 26 Control part 20 Server 22 Category Separate image DB section 23 Search menu information and search auxiliary instruction set information DB section 24 Target name information and relation information DB section 25 Search section 31a Lens 31b CCD
32, 42 Memory unit 33 Focus distance detection unit 34 Zoom magnification information detection unit 35 Object image size instruction unit 36 Object size calculation unit 43 Color information detection unit 44 White plate shooting color detection unit 45 Object image internal instruction input unit, Temporary memory, color balance detection unit and color correction processing unit 50 Calibration white plate part P0 to P6 Image

Claims (7)

A search system that includes a terminal and a server and searches for information related to a search object,
The terminal
Imaging means for imaging the search object;
Search auxiliary data input means for inputting search auxiliary data used when searching using the menu transmitted from the server;
Terminal side transmission means for transmitting search auxiliary data input by the search auxiliary data input means together with image information captured by the imaging means to the server;
Terminal-side receiving means for receiving menu information transmitted from the server and information related to search results searched by the server;
Display means for displaying information on the search result received by the terminal-side receiving means;
And the server has
Menu transmission means for transmitting menu information used by the search auxiliary data input means to the terminal;
Receiving means for receiving information transmitted by the terminal-side transmitting means;
Search means for searching for information relating to a search object using image information and search auxiliary data received by the receiving means;
Search result transmission means for transmitting information related to the search results searched by the search means to the terminal;
A search system comprising:   The menu information transmitted by the menu transmission means is at least one search auxiliary data among the shape, color, size, number, orientation, and position of a part of the image relative to the whole or part of the search object. The search system according to claim 1.   The search according to claim 2, wherein the size of the whole or a part of the search object is calculated using focus distance information of an imaging lens included in the imaging unit and field angle information of the photographing lens. system. The terminal further includes a sensor that detects spectrum information related to the ambient light of the terminal;
3. The device according to claim 2, wherein when the menu information transmitted by the menu transmission unit is a color, the terminal-side transmission unit also transmits spectrum information related to the ambient light detected by the sensor. Search system.   The search system according to claim 2, wherein the menu information includes an application for obtaining information on a part of an image of the search object.   2. The search system according to claim 1, wherein the menu information transmitted by the menu transmission means is a search category menu that allows an operator of the terminal to select a category to which a search object belongs.   The menu transmission means transmits a search category menu based on at least one information of image information captured by the imaging means received by the reception means and search auxiliary data input by the search auxiliary data input means. The search system according to claim 6, wherein the search system is characterized.

Images