JP6115673B2 - Apparatus and program - Google Patents

Description

  The present invention includes an imaging unit that captures an image of a predetermined subject, and acquires information related to the subject by transmitting image data of the subject captured by the imaging unit to a search support system via a communication network. It relates to the invention to do.

  There is a limit to the enlargement ratio when viewing landscapes such as mountains that can be seen with a telescope with a camera installed on the observatory. For this reason, when the enlargement rate reaches the limit, it cannot be enlarged further. That is, when the enlargement value has reached the maximum, even if the user wants to see more details, it has not been possible to obtain more detailed information. Therefore, conventionally, a computer graphics image of the subject (object) is stored in advance in the telescope, and when the enlargement ratio reaches the limit, it can be used by switching the object that looks real to a computer graphics image. Has been disclosed (Patent Document 1).

  However, in the invention described in Patent Document 1, since the scenery that can be seen with the telescope installed on the observation platform is determined to some extent, it is relatively easy to prepare a computer graphics image stored in the telescope. However, in the case of shooting an object found while walking in a city, a mountain, etc., it is necessary to prepare computer graphics images of various objects in the world, so in reality, The problem of being impossible arises.

  The present invention has been made in view of the above circumstances, and can acquire image data of an object related to the image data of the object even if there are various objects that are captured subjects in the world. The purpose is to provide.

The invention according to claim 1 is an apparatus having an imaging unit, a display unit that displays an image of image data, and a reception unit that receives a reduced display operation on the image displayed by the display unit; A determination unit that determines whether or not the reduced display can be supported, and when it is determined that the reduced display cannot be supported, requests image data of a satellite image at a position where the image data is captured from another device different from the device. Requesting means, and the display means displays an image of the image data acquired based on the request.

  As described above, according to the present invention, it is possible to obtain image data of an object related to the image data of the object even if there are various objects that are captured objects in the world. .

FIG. 1 is a schematic diagram of an image search system according to the first embodiment of the present invention. It is. FIG. 2 is a hardware configuration diagram of each device configuring the image search system according to the first embodiment of the present invention. FIG. 3 is a front view of the imaging apparatus according to the first embodiment of the present invention. FIG. 4 is a functional block diagram of each device constituting the image search system according to the first embodiment of the present invention. FIG. 5 is a detailed functional block diagram of the image recognition unit in the search support apparatus. FIG. 6 is a conceptual diagram showing a search engine management table. FIG. 7 is a sequence diagram showing processing in each device and processing between each device constituting the image search system according to the first embodiment of the present invention. FIG. 8 is a process flow diagram illustrating a request reception process from a user in the imaging apparatus. FIG. 9 is a process flow diagram showing search engine selection processing in the search support apparatus. FIG. 10 is a diagram illustrating an operation example of the imaging apparatus. FIG. 11 is a diagram illustrating the operability of the imaging apparatus. FIG. 12 is a diagram illustrating transition of screens displayed on the display of the imaging apparatus. FIG. 13 is a perspective view of an imaging apparatus according to the second embodiment of the present invention.

[First Embodiment]
Hereinafter, the first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a schematic diagram of an image search system according to the first embodiment of the present invention. First, the outline of the present embodiment will be described with reference to FIG.

  An imaging apparatus 10a shown in FIG. 1 has an imaging function such as a digital camera that images a predetermined subject. For example, a user of the imaging apparatus 10a can photograph a subject found in a city, a mountain, or the like. it can. Then, the image data of the photographed subject is transmitted to the search support device 20a via the communication network. The search support device 20a manages URLs such as a pictorial book search engine corresponding to the subject name and category, and selects an optimal search engine based on image data sent from the imaging device 10a. . In the search support apparatus 20a, the search is started by transmitting the search key data to the search server 30a having the selected search engine. The search server 30a performs a search based on the search key data sent from the search support device 20a, and sends image data as a search result to the imaging device 10a via the communication network. Thus, for example, when the subject is “Otamajakushi”, if the image data of “Otamajakushi” captured by the imaging device 10a is transmitted to the search support device 20a, the search support device 20a sends the search server 30a the future of “Otamajakushi”. The search server 30a transmits the image data of “蛙” as a future creature of “Otamajakushi” to the imaging device 10a as a search result. Thereby, in the imaging device 10a, the image of “蛙” can be displayed on the display, and the image data of “蛙” that is an object related to “Otama Jakushi” that is the subject can be easily acquired. In this way, the user of the imaging device 10a can easily acquire image data of an object such as the future of the subject. Therefore, when a rare creature or the like is found in a city, a mountain, or the like, We can respond quickly to the curiosity of how it will change in the future.

  Next, the first embodiment of the present invention will be described in more detail with reference to FIGS. FIG. 2 is a hardware configuration diagram of each device configuring the image search system according to the present embodiment. First, as shown in FIG. 2, the image search system of the present embodiment is constructed by an imaging device 10a, a search support device 20a, and a search server 30a. The search support device 20a and the search server 30a can communicate with each other via the Internet 2. The imaging device 10a, the search support device 20a, and the search server 30a can communicate with each other via a communication network constructed by the Internet 2, the gateway 3, the mobile phone network 4, and the base station 5.

  Among these, the imaging apparatus 10a includes a CPU (Central Processing Unit) 101 that controls the overall operation of the imaging apparatus 10a, a ROM (Read Only Memory) 102 that stores basic input / output programs, and a RAM ( Random Access Memory) 103, EEPROM (Electrically Erasable and Programmable ROM) 104 that reads and writes data according to the control of the CPU 101, CCD (Charge Coupled Device) 105 that captures the subject and obtains image data according to the control of the CPU 101, and geomagnetism There are provided various acceleration / direction sensors 106 such as an electronic magnetic compass, a gyrocompass and an acceleration sensor to be detected, and a media drive 108 for controlling reading or writing (storage) of data to a recording medium 107 such as a flash memory. Under the control of the media drive 108, the data that has already been recorded is read, or the recording medium 107 in which data is newly written and stored is detachable.

  Note that the EEPROM 104 stores an operating system (OS) executed by the CPU 101, other programs, and various data. The CCD 105 is a charge-coupled device that converts light into electric charge and digitizes the image of the subject, and images the subject, but is not limited to the CCD. CMOS (Complementary Metal Oxide Semiconductor) may be used.

  Furthermore, the imaging apparatus 10a includes a voice input unit 111 that converts voice into a voice signal, a voice output unit 112 that converts voice signal into voice, an antenna 113a, and a wireless communication signal that uses the antenna 113a to obtain the nearest base station. A communication unit 113 that communicates with the station 5; a GPS reception unit 114 that receives a GPS signal including position information (latitude, longitude, and altitude) of the imaging device 10a from a GPS (Global Positioning Systems) satellite; A display 115 such as a liquid crystal display or an organic EL display for displaying an icon, etc., is mounted on the display 115 and is configured by a pressure-sensitive or electrostatic panel, and detects a touch position on the display 115 by touching with a finger or a touch pen. The touch panel 116 and an address bus and data for electrically connecting the above-described units. And a bus line 110 such as a bus.

  Note that the voice input unit 111 includes a microphone that inputs voice, and the voice output unit 112 includes a speaker that outputs voice. The base station 5 communicates with the mobile phone network 4, the mobile phone network 4 communicates with the Internet 2 via the gateway 3, and the Internet 2 communicates with the search support device 20a and the search server 30a. . Thereby, the imaging device 10a can communicate with the search support device 20a and the search server 30a. Here, the wireless communication signal transmitted / received by the communication unit 113 is a signal including voice data, character data, image data, and the like.

  On the other hand, the search support apparatus 20a includes a CPU 201 that controls the overall operation of the search support apparatus 20a, a ROM 202 that stores basic input / output programs, a RAM 203 that is used as a work area for the CPU 201, and an HD (Hard Disk) 205 that is controlled by the CPU 201. HDD (Hard Disk Drive) 204 that controls the reading or writing of data to the HDD, the HD 205 that stores data written according to the control of the HDD 204, and the data reading or writing (storage) to the FD (Flexible Disk) 207 according to the control of the CPU 201 An FDD (Flexible Disk Drive) 206 to be controlled is provided. Then, under the control of the FDD 206, the already stored data is read, or the FD 207 as an example of a recording medium on which data is newly written and stored is detachable.

  Further, the search support device 20a includes a display 208 such as a liquid crystal display, an organic EL display, a CRT (Cathode-ray Tube) such as a cursor, menu, window, character, or image, a LAN (not shown), and the Internet 2. A communication interface unit 209 is provided for data transmission using it. Furthermore, the search support device 20a includes a keyboard 211 having a plurality of keys for inputting characters, numerical values, various instructions, a mouse 212 for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. A CD-ROM drive 214 that controls reading or writing of data with respect to a CD-ROM 213 as an example of a detachable recording medium, and a bus line 210 such as an address bus or a data bus for electrically connecting the above-described units. I have. The program stored in the RAM 203 is a file in an installable or executable format, and is a CD-ROM (Compact Disc Read Only Memory), FD, CD-R (Compact Disc Recordable), DVD (Digital Versatile Disk). ) Or the like may be recorded and provided on a computer-readable recording medium. Since the search server 30a has the same hardware configuration as the search support apparatus 20a, the same components (each unit) are assigned the same reference numerals, and the description thereof is omitted.

  Next, the function of each device that constructs the image search system of the present embodiment will be described with reference to FIG. FIG. 3 is a functional block diagram of each device constituting the image search system of the present embodiment.

  First, the imaging apparatus 10a includes a transmission / reception unit 11, a request reception unit 12, an imaging unit 13, a display unit 14, a correspondence determination unit 15, an imaging state detection unit 16, and a storage / reading processing unit 19. 2 is a function or means realized by the CPU 101 shown in FIG. 2 operating in accordance with a program stored in the ROM 102. The imaging device 10a has a storage unit 1000 constructed by the EEPROM 104 shown in FIG.

  Among these, the transmission / reception unit 11 is mainly executed by the communication unit 113 shown in FIG. 2, and transmits / receives a wireless communication signal (including various data / information) to / from the nearest base station 5 via the antenna 113a. The request receiving unit 12 is mainly executed by the voice input unit 111 and the touch panel 116 illustrated in FIG. 2, and an image data of an object indicating the future or past of the subject, or enlargement or reduction of the subject is performed by a user (operator). The request information such as the received image data is received and request information is created. The image in which the subject is magnified is not only an enlarged image when the subject itself is magnified, but also when the subject is viewed with a microscope by reducing the distance between the subject and the imaging device 10a. Enlarged images are also included. In addition, the reduced image of the subject is not only a reduced image when the subject itself is reduced and viewed, but also a reduction when viewed from an airplane or a satellite by increasing the distance between the subject and the imaging device 10a. Images are also included.

  The imaging unit 13 is mainly executed by the CCD 105 shown in FIG. 2 and images a subject to obtain image data. The display unit 14 is executed mainly by the display 115 shown in FIG. 2, and displays request information indicating a request received from the user, an image related to image data such as a subject shown in FIG. 3, an autofocus frame, and the like. The correspondence determination unit 15 is executed mainly by the programs developed in the CPU 101, the ROM 102, and the RAM 103 shown in FIG. 2, and whether the request from the user received by the request reception unit 12 can be handled by the imaging apparatus 10a alone. to decide.

  Further, the imaging state detection unit 16 is executed mainly by the GPS reception unit 114 and the acceleration / direction sensor 106 shown in FIG. 2, and detects the situation when the subject is imaged by the imaging unit 13, and the detection result is obtained. Create included metadata. Examples of the imaging situation include the position and acceleration of the imaging device 10a on the earth, the angle and direction in which the imaging unit 13 is facing, the imaging time (year, month, day, time), and the like. Each piece of information is included in the metadata. The storage / reading processing unit 19 is mainly executed by the CPU 101 and the ROM 102 shown in FIG. 2, and stores various data in the storage unit 1000 and reads various data stored in the storage unit 1000.

  The storage unit 1000 stores subject image data in association with metadata created when the subject is photographed. It is also possible to store image data sent from the search server, other image data, audio data, and the like.

  As described above, the imaging device 10a sends the image data (D1) of the subject imaged by the imaging unit 13 and stored in the storage unit 1000 to the search support device 20a, and the request received from the user by the request receiving unit 12. The request information (i1) to be shown and the metadata (d1) created by the imaging state detection unit and stored in the storage unit 1000 can be transmitted. Further, the imaging device 10a can receive image data (D2) of an object related to the subject as a search result sent from the search support device 20a.

  FIG. 3 shows a front view of the image pickup apparatus 3. As shown in FIG. 3, the imaging device 10a is provided in a main body 10a-1, a “menu screen display button” 10a-2 provided in the main body, a display unit 10a-3 provided in the main body, and the main body. Speaker 10a-5. Among these, the “menu screen display button” 10a-2 is a button for displaying a menu screen on which an icon indicating an application is displayed. Further, the display unit 10a-3 includes a shooting button 10a-4 for shooting a subject, and an autofocus frame 10a- pressed by the user when instructing autofocusing and capturing to the subject 10a-6. 7 is displayed.

  Next, various functions of the search support device 20a will be described. As shown in FIG. 4, the search support device 20a includes a transmission / reception unit 21, a specific request determination unit 22, an image recognition unit 23, a search engine selection unit 24, and a storage / read processing unit 29. Each unit is a function or means realized by the CPU 201 illustrated in FIG. 2 operating according to a program stored in the ROM 202. Further, the search support apparatus 20a has a storage unit 2000 constructed by the HD 205 shown in FIG. The storage unit 2000 includes a search engine management unit 2001 configured by a search engine management table as shown in FIG. 6 and an identification dictionary file management unit described later used when the image recognition unit 23 recognizes an image. 2002 is built. As shown in FIG. 6, the search engine management table includes search engine specifying information for specifying the name or category of a predetermined subject and a search server (search engine) to be used for each name or category. Are stored in association with each other. Here, the URL of the search engine is shown as the search engine specifying information. However, the search engine specifying information is not limited to this, and may be a unique identifier for specifying the search engine. In this case, a table that associates the identifier of the search engine and the URL of the search engine is required separately. In this case, the search engine management unit 2001 is configured.

  The transmission / reception unit 21 is mainly executed by the communication interface unit 203 shown in FIG. 2 and transmits / receives various data to / from the Internet 2. The transmission / reception unit 21 receives image data (D1) of the subject, request information (i1), and metadata (d1) sent from the imaging device 10a. In addition, the transmission / reception unit 21 uses the image data (D1) as a search key from the search support device 20a to the search server 30a (which may be the search server 30b shown in FIG. 7), and requests related to the request information (i1). It has a function as a search start part which performs communication for starting search corresponding to. Further, the search start unit uses the search key as position information included in the metadata (d1) instead of the image data (D1), and performs communication for starting the search corresponding to the situation information (i1). You can also.

  Further, the specific requirement determination unit 22 is executed mainly by a program developed in the CPU 201, the ROM 202, and the RAM 203 illustrated in FIG. 2, and a request related to the request information (i1) received by the transmission / reception unit 21 from the imaging device 10a is as follows. It is determined whether the request is a predetermined specific request. This specific request is, for example, a request for a reduced image when viewed from an airplane or a satellite by increasing the distance between the subject and the imaging device 10a. In other words, if a user's request cannot be handled by a search using a pictorial book search engine, but can only be handled by a search engine that provides a virtual globe constructed from satellite photos from around the world, a specific search engine can be used. You need to determine whether to use this particular search engine.

  The image recognition unit 23 is executed mainly by a program developed in the CPU 201, the ROM 202, and the RAM 203 shown in FIG. 2, and performs image recognition processing on the image data received by the transmission / reception unit 21. The name or category of the subject related to the data is output. Here, the image recognition unit 23 will be described in more detail with reference to FIG. FIG. 5 is a detailed functional block diagram of the image recognition unit 23.

  As shown in FIG. 5, the image recognition unit 23 includes an image input unit 231, a density conversion unit 232, a position normalization processing unit 233, a feature pattern extraction unit 234, a matching processing unit 235, and a determination processing unit 236. have.

  Among these, the image input unit 231 has a function or means for converting the image data of the subject sent from the specific request determination unit 22 into digital image data in a format suitable for the subsequent processing and sending it to the density conversion unit 232. . The density conversion unit 232 has a function or means for sending the image data of the subject to the position normalization processing unit 233 after performing density conversion processing such as luminance value correction (illuminance value normalization). The position normalization processing unit 233 normalizes the position, inclination, and size of the shape pattern of the day subject to be collated from the image data, and extracts the normalization pattern of the subject to be collated. It has a function or means for sending it to the feature pattern extraction hand part 234. Here, as the configuration of the position normalization processing unit 233, for example, an embodiment shown in Japanese Patent Application No. 2-219675 can be used.

  Subsequently, the feature pattern extraction unit 234 extracts a feature pattern to be compared with the standard pattern at the time of matching with respect to the normalized pattern of the subject sent from the position normalization processing unit 233 and sends it to the matching processing unit 235. It has a function or means. The storage unit 2000 stores in advance an identification dictionary file in which standard patterns obtained by performing processes equivalent to those of the image input unit 231 to the feature pattern extraction unit 234 described above for standard images of identification objects are managed in advance. A management department has been established.

  In addition, the matching processing unit 235 uses the feature pattern obtained by the feature pattern extraction unit 234 for the image data of the subject and the animals and insects managed by the identification dictionary file management unit 2002 obtained through the storage / reading processing unit 29. And a standard pattern such as a standard pattern, and a function or means for sending the result to the determination processing unit 236. Examples of the matching process include a method using a statistical discrimination function typified by an example of minimum distance identification of feature vectors, a method using learning using a neural network, and the like. The determination processing unit 236 follows the form of the identification function to be realized for the data group of the similarity measure between the input pattern calculated by the matching processing unit 235 and the standard pattern of each identification target object. Further, it has a function or means for performing a determination process such as a threshold process using an appropriate value and outputting an identification result obtained as a result to the search engine selection unit 24.

  Next, returning to FIG. 4, the search engine selection unit 24 is constructed in the storage unit 2000 based on the name or category of the subject related to the image data (D1) obtained by the image recognition of the image recognition unit 23. The search engine management unit 2001 is searched, and the search engine search unit 241 that reads out the corresponding search engine specifying information is included. The search engine selection unit 24 performs a search that uses the position information of the image data (D1) or metadata (d1) as a search key based on the search engine specifying information as the search result read by the search engine search unit 241. Select a search server with an engine.

  The storage / reading processing unit 29 is mainly executed by the CPU 201 and the ROM 202 shown in FIG. 2, and stores various data in the storage unit 2000 and reads various data stored in the storage unit 1000.

  As described above, the search support device 20a can transmit the image data (D1), the request information (i1), and the metadata (d1) sent from the imaging device 10a. Further, the search support device 20a sends the position information of the image data (D1) or the metadata (d1) as the search key to the search server having the search engine selected by the search engine selection unit 24 as request information ( A search corresponding to the request related to i1) can be started.

  Next, the function of the search server 30a will be described. Here, for example, the search server 30a is one of a plurality of search servers that respectively manage various picture books such as an animal picture book, an insect picture book, an amphibian picture book, a building picture book, and a vehicle picture book. Here, as an example, a search server capable of managing and searching an amphibian encyclopedia is shown. The plurality of search servers are selected by the search engine selection unit 241 in the search support apparatus 20. The categories in the search engine management table shown in FIG. 6 correspond to various search servers. The search server 30b shown in FIG. 7 is different from the pictorial book search server, and has a search engine that can search for an image from a predetermined viewpoint position in a virtual globe composed of satellite photos from all over the world. It is a server.

  Further, as shown in FIG. 4, the search server 30 a has a transmission / reception unit 31, a search unit 32, and a storage / read processing unit 39, and these units are stored in the ROM 202 by the CPU 201 shown in FIG. 2. It is a function or means realized by operating according to the program being executed. In addition, the search server 30a has a storage unit 3000 constructed by the HD 205 shown in FIG. In the storage unit 3000, image data of an object by a picture book as a search result is managed. For example, in the case of an amphibian encyclopedia, image data of an object that can be formed by a temporal shift of the tadpole, such as a tadpole egg (a past object of a tadpole), a tadpole, or a spider (a future object of a tadpole). Are related to each other and managed so that the object can be recognized as a temporally shifted object.

  The transmission / reception unit 31 is mainly executed by the communication interface unit 203 shown in FIG. 2 and transmits / receives various data to / from the Internet 2. The transmission / reception unit 21 has a function of receiving subject image data (D1) (or metadata (d1) position information) and request information (i1) as search keys sent from the search support device 10a. Have. The transmission / reception unit 31 also has a function of transmitting image data of an object as a search result from the search server 30a to the imaging device 10a.

  The search unit 32 is a so-called search engine that is executed mainly by programs developed in the CPU 201, the ROM 202, and the RAM 203 shown in FIG. The storage / reading processing unit 39 is mainly executed by the CPU 201 and the ROM 202 shown in FIG. 2 and stores various data in the storage unit 3000 and reads various data stored in the storage unit 1000.

  As described above, the search server 30a receives the image data (D1) of the subject (or the position information of the metadata (d1)) and the request information (i1) as search keys sent from the search support device 10a. The image data of the object as a search result can be transmitted to the imaging device 10a.

  In the above description, a plurality of pictorial book search servers exist. However, the present invention is not limited to this, and a single search server has a plurality of search engines that can manage and search the various pictorial books. The search engine selection unit 241 may select an optimal search engine.

  In addition, the search server 30b, except that the data managed by the search result management unit 3001 is virtual globe data instead of pictorial book data, and the search unit 32 is a dedicated search engine for virtual globes, Since it has the same structure, the description is abbreviate | omitted.

  Next, an image search method using the image search system of this embodiment will be described with reference to FIGS. FIG. 7 is a sequence diagram showing processing in each device and processing between each device constituting the image search system according to the present embodiment. FIG. 8 is a process flow diagram illustrating a request reception process from a user in the imaging apparatus. FIG. 9 is a process flow diagram showing search engine selection processing in the search support apparatus.

  First, as illustrated in FIG. 7, the imaging device 10a receives a request from a user (step S1). This process is shown in detail in FIG. As shown in FIG. 8, first, it is determined whether there has been a request for reduction or enlargement of the image data of the imaged subject (step S1-1). If it is determined that there is a request (YES), the subject is captured and imaging is started (step S1-2). Further, the captured image data (D1) and the metadata (d1) acquired at the time of imaging are associated with each other and stored in the storage unit 1000 (step S1-3). Next, it is determined whether there is a request for reduction or enlargement of the image (step S1-4). If it is determined that there is a request for reduction or enlargement (YES), it is further determined whether the limit of enlargement or reduction has been exceeded (step S1-5). If it is determined that the limit has been exceeded (YES), the image data (D1) and the associated metadata (d1) are read from the storage unit 1000 (step S1-6). On the other hand, if it is determined in step S1-4 that there is no request for reduction or enlargement, it is further determined whether there has been a request for the past or the future for the image (step S1-7). If it is determined that there has been a request in the past or the future (YES), the same processing as in step S1-6 is performed. Then, request information (i1) indicating the read image data (D1), metadata (d1), and a request from the user (desiring a reduced or enlarged image, or a past or future image). ) Is output (step 1-8).

  Here, as shown in FIG. 10, the user accepts the request for the image of the reduced or enlarged object by touching the touch panel of the display unit 10a-3 of the imaging apparatus 10a and expanding the outside to determine that the image is enlarged. However, it is performed by judging that the size is reduced when the size is narrowed. In addition, as shown in FIG. 11, the user accepts a request for an image of a past or future object by touching the touch panel of the display unit 10a-3 of the imaging device 10a and moving it to the right side. This is done by judging that it is the future, and moving it to the left to be the past.

  If it is determined in step 1-7 that there is no past or future request (NO), image data (D1), metadata (d1), and request information (i1) are not output (step 1). S1-9). Even when it is determined in step S1-5 that the limit of reduction or enlargement is not exceeded (NO), the image data (D1), metadata (d1), and request information (i1) are not output. (Step S1-10).

  The image data (D1), metadata (d1), and request information (i1) output as described above are sent to the search support device 20a (step S2). Thereby, the search support device 20a selects a search engine (step S3). This process is shown in detail in FIG. As shown in FIG. 9, first, it is determined whether the request indicated by the request information (i1) is a specific request (step S3-1). This specific request is a request for image data obtained when the distance between the subject and the imaging device 10a is increased as described above. If it is determined that the request is not a specific request (NO), image recognition processing is performed on the image data (D1) (step S3-2). Then, the search engine management unit 2001 is searched based on the name or category of the subject related to the image data obtained by the image recognition, and the corresponding search engine specifying information is read (step S3-3). Then, the image data (D1) is output as a search key (step S3-4). On the other hand, if it is determined in step 3-1 that the request is a specific request, the search server 30b having a predetermined search engine is specified (step S3-5). Then, the position information of the metadata (d1) is output as a search key (step 3-6).

  Next, when the process of S3-4 is executed, the process returns to FIG. 7 and the search support apparatus 20a transmits the image data (D1) and the request information (i1) as a search key to the search server 30a. (Step S4). Accordingly, the search server 30a performs an image search using the image data (D1) as a search key in response to the request related to the request information (i1) (step S5). Thereafter, the search server 30a transmits the image data of the object as a search result to the imaging device 10a (step S6). By this. In the imaging device 10a, the image data of the object as a search result is displayed on the monitor 10a-3 (step S7).

  On the other hand, when the process of S3-6 in FIG. 9 is executed, returning to FIG. 7, the search support apparatus 20a sends the search server 30b the location information of the metadata (d1) as the search key and the request information. (I1) is transmitted (step S4 ′). Thereby, the search server 30b performs an image search using the position information as a search key in response to the request related to the request information (i1) (step S5 '). Thereafter, the search server 30b transmits the image data of the object as a search result to the imaging device 10a (step S6). By this. In the imaging device 10a, the image data of the object as a search result is displayed on the monitor 10a-3 (step S7).

  As described above, an image of a past or future object of a subject according to a user's request, or a reduction (including a request to increase the distance from the subject) or enlargement (an image that brings a distance from the subject closer), The image of the object (including a microscope image or a chemical formula image) is an image as shown in FIG. In FIG. 12, there is a request for the positive direction of the horizontal axis “future”, the negative direction of the horizontal axis “past”, the positive direction of the vertical axis “reduction”, and the negative direction of the vertical axis “enlarge”. It is shown as an image of the object. For example, when the image (0,0) of the current subject is “Oyamajakushi”, the future image (1,0) is an image of “蛙”. The past image (-1, 0) is “egg”. On the other hand, when the image (0, 0) of the subject at the current position is reduced, the image (0, 2) is obtained when the imaging position is viewed from above. When the reduction is further advanced, the satellite images (0, 3), (0 , 4). Note that when a past request is made from the satellite image (0, 4), an image (-N, 4) showing the shape of the ancient earth is requested. Further, when the enlargement of the image (0, 0) of the subject at the current position proceeds, a microscope image (0, -2) is obtained. When the enlargement further proceeds, an image (0, -3) indicating a chemical formula is requested. become.

  As described above, according to the present embodiment, there is an effect that even if there are various objects that are captured subjects in the world, image data of the objects related to the image data of the subjects can be acquired. Play. In addition, the image data of the object related to the subject can be easily obtained.

[Second Embodiment]
The second embodiment of the present invention will be described below. Note that the imaging device 10b of the present embodiment and the imaging device 10a of the first embodiment basically differ only in the appearance and the operation input part of the user, but with the search support device 20a and the search servers 30a and 30b. Since the communication method and the communication data are the same, the description is omitted, and only the external configuration of the imaging device 10b will be described.

  As illustrated in FIG. 13, the imaging device 10b has a loupe-like configuration, and includes a main body 10b-1, a rotation input unit 10b-2 that is rotatably provided on the upper part of the main body, and a main body 10b. -1 and the rotation / push-down input unit 10b-4 provided on the side surface. The rotation input unit 10b-2 is provided with a display 10b-6 that displays an image. The display 10b-6 displays an autofocus frame 10b-7 having the same function as in the first embodiment, and performs autofocus and capturing by touching with a user's finger or the like. Further, when the rotation input unit 10b-2 is rotated in the direction in which the right screw of the arrow is tightened, it is determined that the enlargement of the image is requested, and when the rotation input unit 10b-2 is rotated in the direction of removing the right screw of the arrow, the image reduction is requested. to decide. Further, when the rotation / push-down input unit 10b-4 is turned in the direction in which the right screw of the arrow is tightened (the direction in which the clock hand is advanced), it is determined that an image of the future object has been requested, and the right screw of the arrow is removed. When it is turned (in the direction of returning the clock hand), it is determined that an image of a past object has been requested.

  As described above, according to the present embodiment, since the request inputs for the past, future, reduction, and enlargement are ergonomically matched, the effect that the imaging apparatus is easy to use in addition to the effect of the above embodiment. Play.

In each of the above embodiments, the search support device 20a is separate from the search server. However, the search support device 20a is not limited thereto, and the search engines of the search servers 30a and 30b may be installed. Further, the search support device 20a may be constructed by a single computer or may be constructed by a plurality of computers. In the present invention, the search support apparatus 20a includes both a single computer and a plurality of computers, and includes the case where the search engine is installed and the case where the search engine is not installed as described above. And a search support system. Moreover, the invention shown below is disclosed when each said embodiment is put together.
An imaging apparatus that has imaging means for imaging a predetermined subject, and acquires information related to the subject by transmitting image data of the subject imaged by the imaging means to a search support system via a communication network. And a request receiving unit that receives a request for image data of an object related to the subject from a user, and a correspondence determining unit that determines whether or not the imaging device alone can handle the request from the user. If determined, transmission means for transmitting request information indicating a request from the user and image data of the captured subject to the search support system via the communication network, the request information, and the request information Display means for displaying an image related to the image data of a predetermined object acquired based on the transmission of the image data on a predetermined display unit. Imaging device according to claim.

DESCRIPTION OF SYMBOLS 10a Imaging device 10b Imaging device 11 Transmission / reception part 12 Request reception part 13 Imaging part 14 Display part 15 Correspondence judgment part 16 Imaging condition detection part 20a Search support apparatus 20a (an example of a search support system)
30a Search server 30b Search server 21 Transmission / reception unit 22 Specific request determination unit 23 Image recognition unit 24 Search engine selection unit 241 Search engine search unit

JP 2003-143478 A

Claims (4)

An apparatus having imaging means,
Display means for displaying an image of the image data;
Accepting means for accepting a reduced display operation on the image displayed by the display means;
Determining means for determining whether the reduced display can be handled;
Requesting means for requesting image data of a satellite image at a position where the image data is captured, to another device different from the device when it is determined that it is not possible to handle,
Have
The display means displays an image of the image data acquired based on the request. The apparatus of claim 1, comprising:
The reduced display operation is an operation in which a finger touches two points on a touch panel of the device to narrow an interval between the two points. The apparatus according to claim 1 or 2, comprising:
The accepting means accepts an operation for enlarging the image of the other image data displayed by the display means,
The display device displays an image of the image data upon receiving an operation for the enlarged display. There is a program executed by an apparatus having an imaging means,
A display step for displaying an image of the image data;
An accepting step for accepting a reduced display operation for the displayed image;
A determination step of determining whether the reduced display can be handled;
A requesting step for requesting image data of a satellite image at a position where the image data is captured, to another device different from the device when it is determined that it cannot be handled;
To the device,
The display step includes a process of displaying an image of the image data acquired based on the request.

Images