JP2006527575A - Object identification system and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an object specifying system and method by which a user can find an object reliably and easily.
In an object identification system, an optical transmitter (100) is assigned to at least one object and transmits invisible light having straightness. The control device 200 is installed around the object and instructs the optical transmitter 100 assigned to the object selected by the user to transmit information that uniquely identifies the object or the imaging device. In response to this instruction, the optical transmitter 100 transmits invisible light on which the first information is superimposed. In addition, the imaging device 300 is carried by the user and transmits from the optical transmitter 100, a storage unit that stores the second information that uniquely identifies the target selected by the user or the object selected by the user in order to capture an image. Receiving the received invisible light and extracting the first information superimposed on the received light, the first information sent from the light receiving unit, and the second information stored in the storage unit An optical transmitter that has a light receiving element and a determination unit that determines whether or not to capture an image based on information and that currently transmits invisible light when the determination unit determines to capture an image An image input unit that captures a peripheral image of the assigned object and a display unit that displays the peripheral image of the target captured by the image input unit. Here, the sensitive area of the light receiving element included in the image input unit includes the wavelength of invisible light, and the display unit displays the target object and the light emission of the optical transmitter assigned to the target object.

Description

  The present invention relates to an object specifying system and method, and more specifically, to an object specifying system and method for notifying a place where an object targeted by a user is located.

  In recent years, digital devices (hereinafter referred to as imaging devices) that have an imaging function and can be carried by users have become widespread. Typical examples of such an imaging device include a digital still camera, a mobile phone with a camera, or a PDA (Personal Digital Assistant) equipped with a camera module. Users use such portable devices in various situations. For example, a user takes an image easily taken using a portable device into a personal computer to create an electronic album or send it attached to an e-mail. In business situations, electronic images taken with a digital still camera are often pasted or attached to reports or presentation materials.

  For example, in an exhibition, it is a natural situation for a user to photograph an exhibit with an imaging device and explain the electronic image to a person who did not go to the exhibition. However, in such a usage method, an image of the target exhibit can be taken, but the user is prepared on the spot for relevant information represented by the features and / or specifications of the exhibit. It was necessary to obtain it from a pamphlet or to make a note of the information heard from the explanation staff. That is, there is a problem that the user cannot obtain images and related information about the target exhibit at the same time.

  In order to solve such problems, the following photographing information input system has been proposed. In the present photographing information input system, a transmission device that transmits relevant information of the photographing target is installed in the vicinity of the target photographing target. The camera as the imaging device acquires the related information transmitted by the transmission device, and records the acquired related information and the image of the shooting target object in association with each other.

  As another background art, when a user approaches a bookshelf at a bookstore, for example, a system that automatically distributes book review data of popular books to mobile terminal devices typified by mobile phones or notebook computers (hereinafter, books) Also referred to as an information distribution system).

  However, in the above-described photographing information input system, although the user can automatically acquire related information, there is a problem that an object that the user wants to photograph must be searched for by himself / herself.

  In the book information distribution system, the mobile terminal device can display whether there is a target book or in which corner, but the user pinpoints where the desired book is. There is a problem that you can not.

  Therefore, an object of the present invention is to provide an object identification system and method that allow a user to find an object reliably and easily.

  In order to achieve the above object, a first aspect of the present invention is a method for detecting invisible light in cooperation with an optical transmitter that is installed around at least one object and emits invisible light having straightness. An imaging device that identifies an object using a light receiving element including a wavelength in a sensitive region. Here, the first information for uniquely specifying the object or the imaging device is superimposed on the invisible light. In addition, the imaging device receives the object selected by the user, or a storage unit that stores second information that uniquely identifies itself, and invisible light transmitted from the optical transmitter, and superimposes it on the received light. Whether to capture an image based on the first information received from the optical receiver, the first information sent from the optical receiver, and the second information stored in the storage unit The image input unit that captures an image representing the light emission and surroundings of the optical transmitter, and the light emission and periphery of the optical transmitter that are captured by the image input unit when the determination unit determines to capture the image. A display unit that displays an image to be displayed.

  Further, a synchronization signal for controlling the imaging device is further superimposed on the invisible light, and the image input unit stores the captured peripheral image in the frame memory according to the synchronization signal.

  In addition, when a control device that controls light emission of the optical transmitter is installed around the object, the imaging device transmits the first information that identifies the object selected by the user or itself via the network. And a communication unit for transmitting to the control device. Here, the control device instructs the optical transmitter to transmit the first information sent from the communication unit.

  Further, the optical transmitter further includes a plurality of light emitting elements, and when the related information of the object is output by light emission of the predetermined light emitting elements, the display unit further includes the predetermined light emitting elements in the optical transmitter. Light emission is displayed, thereby displaying related information of the object.

  In addition, when the related information of the object is further superimposed on the invisible light, the light receiving unit extracts the related information from the invisible light transmitted from the optical transmitter. The imaging device further includes an image processing unit that combines the related information extracted by the light receiving unit with the image captured by the image input unit. Here, the display unit displays an image in which the related information is synthesized by the image processing unit.

  In addition, when a wireless communication apparatus that transmits area information indicating that each object is in the vicinity is installed in the vicinity of each object, the imaging device further includes an area sent from the wireless communication apparatus. A wireless communication unit that receives information and an output unit that outputs area information received by the wireless communication unit.

  The second aspect of the present invention includes the wavelength of invisible light in the sensitive region in cooperation with an optical transmitter that is installed around at least one object and transmits invisible light having straightness. This is an object specifying method for an imaging device to specify an object using a light receiving element. Here, the first information for uniquely specifying the object or the imaging device is superimposed on the invisible light. In addition, the object specifying method receives the invisible light transmitted from the optical transmitter and the storage step of storing the second information for uniquely specifying the object selected by the user or itself, and receives the received light. Determining whether to capture an image based on the optical reception step for extracting the first information superimposed on the optical information, the first information extracted in the optical reception step, and the second information stored in the storage step A determination step, an image input unit that captures an image representing the light emission and surroundings of the optical transmitter when the determination step determines that an image is captured, and the light emission and peripherals of the optical transmitter that are captured by the image input unit And a display unit for displaying an image representing.

  The third aspect of the present invention includes the wavelength of invisible light in the sensitive region in cooperation with an optical transmitter that is installed around at least one object and transmits invisible light having straightness. It is a computer program mounted on an imaging device that identifies an object using a light receiving element. Here, the first information for uniquely specifying the object or the imaging device is superimposed on the invisible light. In addition, the computer program receives the received light when the imaging device receives the storage step for storing the object selected by the user or the second information for uniquely identifying itself and the invisible light transmitted from the optical transmitter. Whether to capture an image based on the information acquisition step for extracting the first information superimposed on the first information, the first information extracted in the information acquisition step, and the second information stored in the storage step A determination step, an image acquisition step for capturing an image representing the light emission and periphery of the optical transmitter when the determination step determines that an image is to be captured, and the light emission and periphery of the optical transmitter captured in the image acquisition step A transfer step of transferring an image representing the above to a display unit included in the imaging device.

  According to the above 1st-3rd aspects, the optical transmitter which emits the invisible light which has rectilinear advance property is allocated to a target object. Each optical transmitter emits invisible light on which first information that can identify an object or an imaging device is superimposed. Does the imaging device capture an image based on the first information superimposed on the invisible light? Judge whether or not. When a positive determination is made, the imaging device captures an image. However, since the sensitive area of the light receiving element includes the wavelength of invisible light, the light emission of the optical transmitter is displayed on the display unit. As a result, the user can reliably and easily find the target object.

  The above and other objects, features, aspects and advantages of the present invention will become more apparent when the detailed description of the present invention described below is understood in conjunction with the accompanying drawings.

(First embodiment)
A first embodiment of an object specifying system and an object specifying method according to the present invention will be described with reference to the schematic diagram of FIG. 1, the block diagram of FIG. 2, and the sequence chart of FIG.

  As shown in FIG. 1 and FIG. 2, the object identification system is provided corresponding to one or more objects (in FIG. 1, three objects A, B, and C are shown as examples). An optical transmitter 100 (100A-100C), a control device 200 that controls each optical transmitter 100, and an imaging device capable of establishing a communication link with the control device 200 via a communication network such as a public line, for example. 300.

  A typical example of the control device 200 is a personal computer, and a typical example of the imaging device 300 is a digital camera or a camera-equipped mobile phone. In addition, the control device 200 and the imaging device 300 perform wired communication or wireless communication. Although it does not specifically limit as a target object, For example, there are a book put on a bookshelf of a bookstore, or an exhibit displayed in an exhibition hall.

  The optical transmitter 100 (100A-100C) emits invisible light under the control of the control device 200. Invisible light is not recognized by the human eye, but has a wavelength included in the sensitive region of a light receiving element (not shown) such as a CCD (Charge Coupled Device) provided in the imaging device 300. A typical example of such invisible light is infrared rays. Invisible light exists in addition to infrared rays, for example, ultraviolet rays. However, invisible light is preferably infrared because it can be easily applied to data communication. It is more preferable that the invisible light has a straight traveling property. As for the above-mentioned infrared rays, although there is a certain extent of light spread, for example, it is much more straight ahead than radio waves. Because of such straightness, even if the optical transmitter 100 is provided on many objects, infrared rays emitted from one optical transmitter 101 are subject to interference from infrared rays from other optical transmitters 101. It becomes difficult.

  The control device 200 includes a communication unit 201 and a control unit 202. Further, the imaging device 300 includes a communication unit 301, a storage unit 302, a light reception unit 303, a shooting determination unit 304, an image input unit 305, an image processing unit 306, and an image display unit 307.

The communication unit 301 of the imaging device 300 transmits selection information for selecting an object to the control device 200 via the communication network.
The storage unit 302 stores selection information for selecting an object.
The light receiving unit 303 receives invisible light transmitted from the optical transmitter 100. Here, the synchronization signal and the selection information are superimposed on the invisible light.

The imaging determination unit 304 compares the selection information included in the invisible light received by the light reception unit 303 with the selection information stored in the storage unit 302 and determines whether or not they match.
When the shooting determination unit 304 determines that the selection information matches, the image input unit 305 captures an image using an optical system and a light receiving element (both not shown) constituting the image input unit 305, and inputs the image processing unit 306. hand over. Here, the sensitive area of the light receiving element includes the wavelength of invisible light emitted by the optical transmitter 100.

  The image processing unit 306 passes the image sent from the image input unit 305 to the image display unit 307. At this time, the image processing unit 306 preferably processes the image so that the light emission of the optical transmitter 100 is conspicuous. Note that the function of the image processing unit 306 can also be provided to the image input unit 305 or the image display unit 307.

  The image display unit 307 displays the image sent from the image processing unit 306. Here, since the wavelength of the invisible light is included in the sensitive area of the image input unit 305, the user can visually recognize the light emission of the optical transmitter 100 by referring to the display image.

In the control device 200, the communication unit 201 receives selection information for selecting an object transmitted from the communication unit 301 of the imaging device 300. In addition, the control unit 202 instructs only the optical transmitter 100 provided on the object specified by the received selection information to transmit the synchronization signal and the selection information. For example, if the reception selection information is for selecting the object A, the control unit 202 instructs only the optical transmitter 100A installed corresponding to the object A to transmit the synchronization signal and the selection information. .

  Further, the optical transmitter 100 generates and transmits invisible light on which the synchronization signal and the selection information are superimposed in accordance with an instruction from the control device 200. That is, the optical transmitter 100 emits light in response to an instruction from the control device 200. In FIG. 1, for example, only the optical transmitter 100A emits light and transmits invisible light.

Next, the object specifying method will be described based on the sequence chart of FIG.
First, the user inputs information about a target object (for example, the object A) from the control device 200 to the imaging device 300 via a key operation or a communication network. The input object information is stored in the storage unit 302 of the imaging device 300 as selection information for specifying the object (step ST1).

  Next, the imaging device 300 reads the selection information stored in the storage unit 302 and transmits the selection information from the communication unit 301 to the control device 200 via the communication network (sequence SQ1).

  Next, when receiving a signal from the imaging device 300, the control device 200 selects only the optical transmitter 100 (for example, 100A) assigned to the object (for example, the object A) corresponding to the received selection information. And an instruction to transmit the photographing synchronization signal (step ST2, sequence SQ2).

  In response to an instruction from control device 200, optical transmitter 100 (for example, 100A) transmits invisible light in which selection information and a synchronization signal are superimposed (sequence SQ3).

  In this state, when the user brings the imaging device 300 closer to the object side, the light receiving unit 303 of the imaging device 300 receives invisible light transmitted from the optical transmitter 100 (for example, 100A) (step ST3). ).

  The imaging determination unit 304 of the imaging device 300 compares the selection information superimposed on the received invisible light with the selection information stored in advance in the storage unit 302 and determines whether or not they match. (Step ST4).

  If YES is determined in step ST4, the image input unit 305 captures an image (step ST5). Preferably, the image input unit 305 stores an image in an internal frame memory based on a synchronization signal sent together with the selection information. Such an image is stored in a storage medium such as an SD card (R) in accordance with a user operation. If NO is determined in step ST4, the image input unit 305 does not capture an image.

  Thereafter, the image display unit 307 receives and displays the captured image of the image input unit 305 via the image processing unit 306 (step ST6).

  As described above, according to the present embodiment, the image display unit 307 of the imaging device 300 automatically displays the captured image related to the target object (for example, the target object A) desired by the user based on the selection information. At this time, since the light emission of the optical transmitter 100 is automatically displayed at the same time, the identification of the target is obvious to the user.

  In the present embodiment, infrared light as invisible light plays three roles: a transmission medium for synchronization signals and selection information, and identification of an object. Infrared rays are used for transmission of control signals and data communication in, for example, a remote controller or IrDA, but are not visible to human eyes because they are not visible light. However, in the light receiving element provided in the imaging device 300, since infrared rays are also included in the sensitive region, even if the infrared rays received by the CCD are displayed on the image display unit 307 as they are, the state in which the optical transmitter 100 emits light is displayed. Is done. In addition, since invisible light is used, the light emitted from the optical transmitter 100 is not visually recognized except by the user, so that surrounding people are less likely to feel inconvenience.

(Second Embodiment)
Next, a second embodiment of the object specifying system and the object specifying method according to the present invention will be described with reference to the block diagram of FIG. 4 and the sequence chart of FIG. Compared with the one described in the first embodiment, this object specifying system has the same configuration except for the following points. Therefore, in FIG. 4, the same components as those shown in FIG. Add a reference sign. The difference between the two embodiments is that a terminal identifier having 300 imaging devices is transmitted and received in the object identification system.

That is, in the imaging device 300, the communication unit 301 transmits not only the above-described selection information but also a terminal identifier to the control device 200 via the communication network.
The storage unit 302 further stores a terminal identifier in addition to the selection information described above.

The light receiving unit 303 receives invisible light transmitted from the optical transmitter 100. Here, in addition to the selection information described above, a terminal identifier is further superimposed on the invisible light.
The imaging determination unit 304 compares the terminal identifier included in the invisible light received by the light receiving unit 303 with the terminal identifier stored in the storage unit 302 and determines whether or not they match.

The image input unit 305 captures an image and passes it to the image processing unit 306 when the shooting determination unit 304 determines that they match. Similar to the above, the sensitive area of the light receiving element constituting the image input unit 305 includes the wavelength of invisible light.
As in the case of the first embodiment, the image processing unit 306 performs necessary processing on the image sent from the image input unit 305, and then passes the processed image to the image display unit 307.

  The image display unit 307 displays the image sent from the image processing unit 306 as in the case of the first embodiment.

  In the control device 200, the communication unit 201 receives selection information and a terminal identifier transmitted from the communication unit 301 of the imaging device 300. Further, as in the case of the first embodiment, the control unit 202 transmits the synchronization signal and the terminal identifier only to the optical transmitter 100 provided in the target specified by the received selection information. Instruct.

  Further, the optical transmitter 100 generates and transmits invisible light on which the synchronization signal and the terminal identifier are superimposed in accordance with an instruction from the control device 200. That is, the optical transmitter 100 emits light in response to an instruction from the control device 200.

Next, the object specifying method will be described based on the sequence chart of FIG.
First, as in the case of the above-described step ST1, the user inputs information on a target object (for example, the object A) from the control device 200 via key operation or a communication network. The input object information is stored in the storage unit 302 of the imaging device 300 as selection information (step ST11).

  Further, as described above, the storage unit 302 also stores a terminal identifier having 300 imaging devices. After step ST11, the imaging device 300 reads the selection information and the terminal identifier stored in the storage unit 302 from the storage unit 302, and then transmits the selection information and the terminal from the communication unit 301 to the control device 200 via the communication network. The identifier is transmitted (sequence SQ11).

  When the control device 200 receives the signal from the imaging device 300, only the optical transmitter 100 (for example, 100A) assigned to the target (for example, the target A) corresponding to the received selection information is transmitted to the terminal identifier and the synchronization signal. Is transmitted (step ST12, sequence SQ12).

  In response to the instruction from control device 200, optical transmitter 100 (for example, 100A) transmits invisible light in which the terminal identifier and the synchronization signal are superimposed (sequence SQ13).

  In this state, when the user brings the imaging device 300 closer to the target, the light receiving unit 303 of the imaging device 300 receives invisible light transmitted from the optical transmitter 100 (for example, 100A) (step ST13). .

  In the imaging apparatus 300, the imaging determination unit 304 compares the terminal identifier superimposed on the received invisible light with the terminal identifier stored in advance in the storage unit 302, and determines whether or not they match. (Step ST14).

  If YES is determined in step ST14, the image input unit 305 captures an image (step ST15). Preferably, the image input unit 305 stores an image in an internal frame memory based on a synchronization signal sent together with the selection information. Such an image is stored in a storage medium such as an SD card (R) in accordance with a user operation. If NO is determined in step ST14, the image input unit 305 does not capture an image. Thereafter, the image display unit 307 receives and displays the image captured by the image input unit 305 via the image processing unit 306 (step ST16).

  As described above, according to the present embodiment, as in the case of the first embodiment, the image display unit 307 of the imaging device 300 relates to an object (for example, the object A) that the user desires based on the selection information. The captured image is automatically displayed. At this time, since the light emission of the optical transmitter 100 is automatically displayed at the same time, the identification of the target is obvious to the user.

  Further, according to the second embodiment, by superimposing the terminal identifier on the invisible light, it becomes easy for one imaging device 300 to identify and photograph a plurality of objects.

(Third embodiment)
Next, a third embodiment of the object specifying system and the object specifying method according to the present invention will be described with reference to the block diagram of FIG. 6, the sequence chart of FIG. 7, and the timing chart of FIG. Compared with the one described in the first embodiment, the object identification system has the same configuration except for the following points. Therefore, in FIG. 6, the same component as the configuration shown in FIG. Add a reference sign. The difference between the two embodiments is that the imaging device 300 does not include the communication unit 301 and the control device 200 does not include the communication unit 201. Further, all the optical transmitters 100 transmit the invisible light on which the selection information and the synchronization signal are superimposed accompanying the difference in the configuration.

First, in the imaging device 300, the storage unit 302 stores selection information for selecting an object.
The optical receiver 303 receives invisible light transmitted from all the optical transmitters 100 (100A-100C). Here, the invisible light is typically infrared as described in the first embodiment, and includes a synchronization signal and selection information.

The imaging determination unit 304 compares the selection information included in the invisible light received by the light reception unit 303 with the selection information stored in the storage unit, and determines whether or not they match.
The image input unit 305 captures an image as in the case of the first embodiment, and passes it to the image processing unit 306.

As in the case of the first embodiment, the image processing unit 306 performs necessary processing on the image sent from the image input unit 305, and then passes the processed image to the image display unit 307.
The image display unit 307 displays the image sent from the image processing unit 306 as in the case of the first embodiment.

  In the control device 200, the control unit 202 instructs the all-optical transmitter 100 of the target object specifying system to transmit the synchronization signal and the selection information.

  The optical transmitter 100 is assigned to an object as described in the first embodiment, and generates and transmits invisible light on which a synchronization signal and selection information are superimposed according to an instruction from the control device 200. . That is, the optical transmitter 100 emits light in response to an instruction from the control device 200.

  Next, the object specifying method will be described based on the sequence chart of FIG.

  First, the user inputs information about a target object (for example, the object A) to the imaging device 300 by a key operation. The input information is stored in the storage unit 302 of the imaging device 300 as selection information for specifying the object (step ST21).

  Next, the control device 200 instructs the all-optical transmitter 100 assigned to all objects to transmit the selection information and the synchronization signal (step ST22, sequence SQ22).

  In response to an instruction from control device 200, all-optical transmitter 100 transmits invisible light on which selection information and a synchronization signal are superimposed at different times as shown in FIG. 8 (sequence SQ23).

  In such a state, when the user brings the imaging device 300 close to the target, the light receiving unit 303 of the imaging device 300 receives invisible light transmitted from the optical transmitter 100 assigned to the target approached this time. (Step ST23).

  In the imaging apparatus 300, the imaging determination unit 304 compares the selection information superimposed on the received invisible light with the selection information stored in advance in the storage unit 302, and determines whether or not they match. (Step ST24).

  If YES is determined in step ST24, the image input unit 305 captures an image (step ST25). Preferably, the image input unit 305 stores an image in an internal frame memory based on a synchronization signal sent together with the selection information. Such an image is stored in a storage medium such as an SD card (R) in accordance with a user operation. If NO is determined in step ST24, the image input unit 305 does not capture an image.

  Thereafter, the image display unit 307 receives and displays the image captured by the image input unit 305 via the image processing unit 306 (step ST26).

  As described above, according to the present embodiment, as in the case of the first embodiment, the image display unit 307 of the imaging device 300 relates to an object (for example, the object A) that the user desires based on the selection information. The captured image is automatically displayed. At this time, since the light emission of the optical transmitter 100 is automatically displayed at the same time, the identification of the target is obvious to the user.

  Further, according to the third embodiment, the control device 200 causes the all-optical transmitter 100 to emit light at different times. That is, the control device 200 does not need to emit light only from the optical transmitter 100 required by the user, so that it is not necessary to receive selection information from the imaging device 300. This eliminates the need to provide the communication units 201 and 301 in the control device 200 and the imaging device 300 as in the first embodiment, thereby reducing various costs of the object identification system.

(Fourth embodiment)
Next, a fourth embodiment of the object specifying system and the object specifying method according to the present invention will be described with reference to the block diagram of FIG. 9 and the sequence chart of FIG.

  As shown in FIG. 9, the object identification system includes an optical transmitter 100 provided corresponding to each object, and an imaging device 300 that can establish a communication link with each optical transmitter 100. ing. A representative example of the imaging device 300 is a digital camera or a camera-equipped mobile phone. The optical transmitter 100 and the imaging device 300 perform wired communication or wireless communication.

  Each optical transmitter 100 includes a storage unit 101, a communication unit 102, a control unit 103, and an optical transmission unit 104.

The storage unit 101 stores in advance selection information for objects assigned to each optical transmitter 100.
The communication unit 102 receives selection information transmitted from the imaging device 300.
The control unit 103 compares the selection information received by the communication unit 102 with the selection information stored in the storage unit 101 and determines whether or not they match.

  The light transmission unit 104 transmits invisible light on which a synchronization signal is superimposed when the control unit 103 determines that the selection information matches. Invisible light has the characteristics as described in the first embodiment.

  The imaging device 300 includes a communication unit 301, a storage unit 302, a light receiving unit 303, an image input unit 305, an image processing unit 306, and an image display unit 307.

After establishing a communication link with the communication unit 102 on the optical transmitter 100 side, the communication unit 301 transmits selection information for selecting an object to the communication unit 102.
The storage unit 302 stores selection information for selecting an object.
The light receiving unit 303 receives invisible light transmitted from the optical transmitter 100. Here, a synchronization signal is superimposed on the invisible light.

  When the image input unit 305 receives the synchronization signal superimposed on the invisible light received by the light receiving unit 303, the image input unit 305 captures an image using an optical system and a light receiving element (both not shown) constituting the image input unit 305. The data is passed to the processing unit 306. Here, the sensitive area of the light receiving element includes the wavelength of invisible light emitted by the optical transmitter 100.

  The image processing unit 306 passes the image sent from the image input unit 305 to the image display unit 307. At this time, the image processing unit 306 preferably processes the image so that the light emission of the optical transmitter 100 is conspicuous. Note that the function of the image processing unit 306 can also be provided to the image input unit 305 or the image display unit 307.

  The image display unit 307 displays the image sent from the image processing unit 306. Here, since the wavelength of the invisible light is included in the sensitive area of the image input unit 305, the user can visually recognize the light emission of the optical transmitter 100 by referring to the display image.

  Next, the object specifying method will be described based on the sequence chart of FIG.

  First, the user inputs information about a target object to the imaging device 300 by a key operation. The input object information is stored in the storage unit 302 of the imaging apparatus 300 as selection information for specifying the object (step ST31).

  Next, the imaging device 300 reads the selection information stored in the storage unit 302, and transmits the selection information from the communication unit 301 to each optical transmitter 100 (sequence SQ31).

  Next, in each optical transmitter 100, when the communication unit 101 receives a signal from the imaging device 300, the control unit 103 selects the received selection information stored in advance in the storage unit 302 of the optical transmitter 100. The information is compared to determine whether or not they match (step ST32).

  If it is determined as YES in step ST32, light transmission unit 104 transmits invisible light on which the synchronization signal is superimposed (sequence SQ32). In addition, when it determines with NO, the optical transmission part 104 does not send out invisible light.

  In the imaging device 300, the light receiving unit 303 receives the invisible light transmitted from the light transmitting unit 104, and passes the synchronization signal superimposed on the received invisible light to the image input unit 305 (step ST33). As described in the first embodiment, the image input unit 305 inputs an image based on the synchronization signal (step ST34), and the image display unit 307 is also described in the first embodiment. Similarly, the image processed by the image processing unit 306 is displayed (step ST35).

  As described above, according to the present embodiment, as in the case of the first embodiment, the image display unit 307 of the imaging device 300 relates to an object (for example, the object A) that the user desires based on the selection information. The captured image is automatically displayed. At this time, since the light emission of the optical transmitter 100 is automatically displayed at the same time, the identification of the target is obvious to the user.

  Furthermore, according to the present embodiment, since each optical transmitter 100 directly communicates with the imaging device 300 to determine whether to transmit invisible light, it is not necessary to provide the control device 200. Thereby, the structure of the present object specifying system is simplified as compared with that according to the first embodiment, and various costs can be reduced.

(Fifth embodiment)
Next, a fifth embodiment of the object specifying system and the object specifying method according to the present invention will be described with reference to the block diagram of FIG. 11 and the sequence chart of FIG. Compared with the one described in the first embodiment, this object specifying system has the same configuration except for the following points. Therefore, in FIG. 11, the same reference numerals are given to the configuration shown in FIG. The difference in configuration between the two embodiments is that the transmitter 100 (100A and 100B in the figure) transmits invisible light from the display unit 105 (105A and 105B in the figure), and the control device 200 stores the storage unit 203. It is a point to prepare. In addition, due to such a general difference in configuration, the operations of the respective configurations of the optical transmitter 100, the control device 200, and the imaging device 300 are also as follows as compared to the first embodiment. Is different.

  The communication unit 301 of the imaging device 300 transmits selection information for selecting an object and display request information to the control device 200 via a communication network. Here, the display request information is information for requesting the control device 200 to display the display information pre-assigned to the object on the display unit 105 on the display unit 105.

The storage unit 302 stores selection information for selecting an object.
The optical receiver 303 receives invisible light (see the first embodiment) transmitted from the optical transmitter 100.
The imaging determination unit 304 compares the selection information included in the invisible light received by the light reception unit 303 with the selection information stored in the storage unit 302 and determines whether or not they match.

The image input unit 305 captures an image as in the case of the first embodiment, and passes it to the image processing unit 306.
As in the first embodiment, the image processing unit 306 performs necessary processing on the image sent from the image input unit 305 and then passes the processed image to the image display unit 307.

  The image display unit 307 displays the image sent from the image processing unit 306 as in the first embodiment.

  In the control device 200, the communication unit 201 receives selection information and display request information transmitted from the communication unit 301 of the imaging device 300, and displays the display assigned to the object specified by the received display request information. Information is received from another place (for example, a Web server) via a communication network. The received display information and selection information are stored in the storage unit 203 of the control device 200.

  Also, the control unit 202 instructs the optical transmitter 100 assigned to the object specified by the selection information stored in the storage unit 203 to transmit the synchronization signal and the selection information and display the display information. . For example, if the selection information selects the object A, only the optical transmitter 100A installed corresponding to the object A is instructed as described above.

  In the optical transmitter 100, the display unit 105 is, for example, a display panel in which light emitting elements that emit invisible light on which a synchronization signal and selection information are superimposed are arranged in a grid pattern. In such a display unit 105, a predetermined light emitting element emits light in accordance with display information sent from the control unit 202. Thus, when a predetermined light emitting element emits light, for example, it is possible to display a simple description or price of an object on the imaging device 300 side. FIG. 11 shows that only the optical transmitter 100A emits invisible light and outputs information on the object.

Next, the object specifying method will be described based on the sequence chart of FIG.
First, the user inputs information about a target object to be identified (for example, the object A) to the imaging device 300 by, for example, a key operation. The input information is stored in the storage unit 302 as selection information for specifying the object (step ST41).

  Next, the imaging device 300 reads the selection information stored in the storage unit 302 from the storage unit 302, and transmits the read selection information and display request information from the communication unit 301 to the control device 200 via the communication network. (Sequence SQ41).

  Next, when receiving a signal from the imaging device 300, the control device 200 receives display information assigned to the target specified by the display request information from the communication network and stores it in the storage unit 302 (step ST42). . Here, the display information is obtained by being received from another place via the communication network, but the display information may be stored in advance in the control device 200 or the optical transmitter 100. .

  The control unit 202 instructs only the optical transmitter 100 (for example, 100A) installed on the object (for example, the object A) corresponding to the received selection information to transmit the selection information, the synchronization signal, and the display information ( Step ST43, sequence SQ42).

  In the optical transmitter 100 (eg, 100A), the display unit 105 (eg, 105A) outputs invisible light on which selection information and a synchronization signal are superimposed from a predetermined light emitting element in response to an instruction from the control unit 202. . Thereby, the optical transmitter 100 also outputs information on the object (step ST44). Furthermore, as in the first embodiment, optical transmitter 100 transmits invisible light on which selection information and synchronization information are superimposed (sequence SQ43).

  In this state, when the user brings the imaging device 300 close to the object, the light receiving unit 303 of the imaging device 300 receives invisible light transmitted from the optical transmitter 100 (for example, 100A) (step ST45). .

  Next, the imaging determination unit 304 of the imaging device 300 compares the selection information superimposed on the received invisible light with the selection information stored in advance in the storage unit 302, and determines whether or not they match. Is determined (step ST46).

  When YES is determined in step ST46, the image input unit 305 captures an image (step ST47). Preferably, the image input unit 305 stores an image in an internal frame memory based on a synchronization signal sent together with the selection information. Such an image is stored in a storage medium such as an SD card (R) in accordance with a user operation. If NO is determined in step ST46, the image input unit 305 does not capture an image.

  Thereafter, the image display unit 307 receives and displays the image captured by the image input unit 305 via the image processing unit 306 (step ST48). As described above, since the light receiving element on the imaging device 300 side is sensitive to the wavelength of invisible light, information on the object output from the display unit 105 is reflected in the display image in a state that can be visually recognized by the user.

  As described above, according to the present embodiment, the image display unit 307 of the imaging device 300 automatically displays the captured image related to the target object (for example, the target object A) desired by the user based on the selection information. At this time, since the light emission of the optical transmitter 100 is automatically displayed at the same time, the identification of the target is obvious to the user.

  Furthermore, according to the present embodiment, the display unit 105 causes the predetermined light emitting element to emit light as compared with the first embodiment, so that the user can view the image displayed on the imaging device 300. Further, information (display information) related to the object can be obtained.

  In the object specifying system and the object specifying method according to the fifth embodiment, information related to the object is displayed on the imaging device 300 side. However, the object according to the first to fourth embodiments is displayed. In the identification system and the object identification method, the optical transmitter 100 superimposes the information related to the object on the invisible light and transmits the information on the invisible light, and as shown in FIG. 2, the image captured by the image input unit 305 and the related information superimposed on the invisible light received by the light receiving unit 303 may be combined (steps ST51 to ST54). In this case, as shown in FIG. 14, the display image in the image display unit 307 includes an object, a state in which a certain optical transmitter 100 emits light, and related information. Further, the image processing unit 306 may create an image that can highlight an object by surrounding the object with a line or pointing with an arrow.

  Further, in the object specifying system and the object specifying method according to the first to fifth embodiments, as illustrated in FIG. 15, the image input unit 305 of the imaging device 300 is not based on a case based on a synchronization signal. These two images are input, and the image processing unit 306 performs a process of taking the difference between the two captured images and leaving only the portion representing the light emission of the optical transmitter 100. Furthermore, the image processing unit 306 synthesizes the related information acquired as described above in the vicinity of the light emission location of the optical transmitter 100. Thereby, the image display unit 307 of the imaging device 300 displays only the light emission of the optical transmitter 100 and related information (steps ST61 to ST66). Thereby, the user can find the target object in the direction in which the optical system of the imaging apparatus 300 faces.

  In the object specifying system and the object specifying method according to the first to fifth embodiments, one optical transmitter 100 has been described as being assigned to one object. The number of optical transmitters 100 may be allocated.

(Sixth embodiment)
FIG. 16 is a block diagram showing the overall configuration of the object identification system 1 according to the sixth embodiment of the present invention. In FIG. 1, the system 1 includes at least one optical transmitter 11, at least one wireless communication device 12, a control device 13, an information distribution device 14, and an imaging device 15. Most of the configurations of the system 1 are installed in a place where the user needs to search for an object (that is, an object) such as a store or an exhibition. At the installation location of the system 1, at least one optical transmitter 11, at least one wireless communication device 12, and a control device 13 are installed. FIG. 16 exemplarily shows three optical transmitters 11 a-11 c as the optical transmitter 11 and three wireless communication devices 12 a-12 c as the wireless communication device 12.

  Next, each component installed in the place as described above will be described in detail.

  Each optical transmitter 11 emits invisible light on which a synchronization signal described later is superimposed under the control of the control device 13. Here, the invisible light is not recognized by the human eye, but has a wavelength included in the sensitive range of a light receiving element (for example, a CCD (Charge Coupled Device)) provided in the imaging device 15. A typical example of such invisible light is infrared rays. Although invisible light exists other than infrared rays such as ultraviolet rays, for example, the optical transmitter 11 preferably emits infrared rays because it can be easily applied to data communication (for example, IrDA).

  Here, FIG. 17 is a schematic diagram illustrating an installation example of the optical transmitter 11 when the system 1 is laid in a store. In FIG. 17, the optical transmitter 11 is assigned to an object (object) intended by the user. In order to assign the optical transmitter 11 to an object, in this embodiment, the optical transmitter 11 is installed in the vicinity of the object. Further, the light emitting surface of the optical transmitter 101 is directed to a position that is assumed to stop when the user looks at the object. For example, the optical transmitter 11a is installed in the vicinity of an object called tomato A, and its light emitting surface is directed to a position that is assumed to stop when the user looks at tomato A. Moreover, the optical transmitter 11b is installed in the vicinity of the tomato B as another object, and the light emitting surface is directed to a position assumed to stop when the user looks at the tomato B. Furthermore, the optical transmitter 11c is installed in the vicinity of the low-malt beer A as another object, and its light emitting surface is directed to a position that is assumed to stop when the user views the low-malt beer A.

  For convenience of explanation, it is assumed that the present tomato A is one that has been organically cultivated without agricultural chemicals. Further, it is assumed that tomato B and sparkling liquor A are bargain items.

  Here, it is more preferable that the above-mentioned invisible light has a straight traveling property. As for the above-mentioned infrared rays, although there is a certain extent of light spread, for example, it is much more straight ahead than radio waves. Because of such straightness, the infrared rays emitted from one optical transmitter 11 are unlikely to receive interference from the infrared rays from other optical transmitters 11 near the position where the user is supposed to stop. With such straightness, the optical transmitter 11 can be assigned to each of a plurality of objects displayed close to each other. For example, in the example of FIG. 17, the optical transmitters 11a and 11b exist close to each other, but the infrared rays emitted from each of them have a straightness. Therefore, for example, the imaging device 15 of a user who is interested in the target object called “tomato A” receives interference from the infrared rays emitted from the optical transmitter 11b by the synchronization signal superimposed on the infrared rays emitted from the optical transmitter 11a. It becomes possible to receive correctly.

  Refer to FIG. 16 again. In FIG. 16, each wireless communication device 12 performs wireless communication with the imaging device 15 existing in its own communication area under the control of the control device 13. Here, typically, each wireless communication device 12 transmits an area signal to be described later to the imaging device 15. This wireless communication device 13 is not assigned to the object itself like the optical transmitter 11 but is installed to notify the user's imaging device 15 that there is an object near the user. It is preferable to cover a relatively wide communication area. Examples of such a wireless communication device 12 include devices that comply with IEEE (Institute of Electrical and Electronics Engineers) 802.11 or Bluetooth (R) standards.

  Here, FIG. 17 is a schematic diagram illustrating an installation example of the wireless communication device 12. In FIG. 17, the wireless communication device 12 covers an area with a lot of traffic at the installation location of the system 1 as a communication area. For example, the wireless communication device 12a has a periphery of the front entrance E1 as a communication area in a store as an installation place of the system 1. In addition, the wireless communication device 102b covers the vicinity of the west entrance E2 and the stairs E4 and E5 as a communication area in the store. Further, the wireless communication apparatus 102c covers the communication area around the south entrance E3, ascending escalator E6, staircase E7, and descending escalator E8 in the store.

  Refer to FIG. 16 again. In FIG. 16, the control device 13 mainly controls light emission of the optical transmitter 11 and communication of the wireless communication device 12. Here, FIG. 18 is a block diagram showing a detailed configuration of the control device 13. Hereinafter, with reference to FIG. 18, each structure of the control apparatus 13 is demonstrated. In FIG. 18, the control device 13 includes an object information storage unit 131, a reception unit 132, an update unit 133, an area information creation unit 134, a light emission instruction unit 135, and a communication unit 136.

  The object information storage unit 131 stores an object database DB as shown in FIG. The object database DB includes an object record R composed of a combination of one identification information IDp, at least one identification information IDq, and an object flag F for each object to which the optical transmitter 11 is assigned. In FIG. 19, three object records Ra-Rc for the objects A-C are illustrated as the object records R.

  The identification information IDp is information that uniquely identifies the object. In the illustrated example, the object records Ra-Rc include identification information IDpa-IDpc of the objects AC.

  The identification information IDq is information that uniquely identifies the wireless communication apparatus 102. Specifically, the identification information IDq identifies the wireless communication device 12 installed near the object identified by the same set of identification information IDp. Moreover, the one target object record R should just contain several identification information IDb. In the illustrated example, each of the object records Ra-Rc includes identification information IDqa-IDqc of the wireless communication device 12c. The object record R may include the identification information IDq of the wireless communication device 12 that is installed closest to the object specified by the same set of identification information IDp.

  The object flag F is information indicating whether selection information has been transmitted from the imaging device 15 carried by the user to the information distribution device 14 for the objects specified by the same set of identification information IDp. Such an object flag F is updated by the updating unit 133. In the present embodiment, “0” as the object flag F indicates that the information distribution apparatus 14 has not received selection information for the object, and “1” as the object flag F is selected for the object. It shows that the information delivery apparatus 14 received information. In the example of FIG. 19, the case where the information distribution apparatus 14 receives selection information only for the object A is shown.

  The receiving unit 132 receives the selection information transmitted from the information distribution device 14 and passes it to the update unit 133.

  The update unit 133 extracts the identification information IDp included in the received selection information every time selection information is sent from the reception unit 132. Thereafter, the update unit 133 accesses the object database DB and updates the value of the object flag F of the same set as the extracted identification information IDp to “1”. Although details will be described later, the light emission instruction unit 135 refers to the object flag F, creates a synchronization signal for each object, and passes it to the communication unit 136. After such a synchronization signal is generated at least once, the updating unit 133 updates the value of the object flag F referred to this time to “0”.

  The area signal creation unit 134 creates area information indicating that the user is near an object of interest, and creates the area information for the wireless communication device 12 that is currently communicating with the imaging device 15 of the user. The communication unit 136 is instructed to transmit the area information.

  The light emission instructing unit 135 is a signal for causing the display unit 153 (see FIG. 21) of the imaging device 15 to display the presence of an object that the user is interested in. Further, as a preferred example in the present embodiment, the synchronization signal is also a signal for notifying the imaging device 15 of the timing at which the imaging device 15 takes in the image of the object. The light emission instruction unit 135 instructs the communication unit 136 to transmit the generated synchronization signal to the optical transmitter 11 assigned to the target object.

  In response to an instruction from the area signal generation unit 134 or the light emission instruction unit 135, the communication unit 136 transmits the area signal or the synchronization signal generated by each to the target wireless communication device 12 or the optical transmitter 11. .

Here, FIG. 16 will be referred to again. In FIG. 16, the information distribution device 14 preferably distributes menu information for all objects existing at the place where the system 1 is installed to the imaging device 15 through the network 106. Here, as shown in FIG. 20, the menu information is configured so that the necessity of the user can be specified for each object. In the example of FIG. 20, the menu information is configured so that the necessity of the user can be specified for each of tomato A, tomato B, happoshu A, and happoshu B as objects. The information distribution device 14 further acquires information (hereinafter referred to as selection information) for specifying an object required by the user through the network 16 using the menu information as described above. The information distribution device 14 transmits the selection information acquired in this way to the control device 13.

  In FIG. 16 again, the imaging device 15 is carried by the user and has at least a data communication function using invisible light and an imaging function. A typical example of such an imaging device 15 is a mobile phone or a digital camera. Preferably, the imaging device 15 has a function of connecting to the network 16. Here, FIG. 21 is a block diagram showing a detailed configuration of the imaging device 15. Hereinafter, each configuration of the imaging device 15 will be described with reference to FIG. In FIG. 21, the imaging device 15 includes a communication unit 151, a light reception unit 152, an image input unit 153, a wireless communication unit 154, an arithmetic processing unit 155, a display unit 156, and a storage unit 157. The arithmetic processing unit 155 includes a communication processing unit 158, an optical communication processing unit 159, an image processing unit 1510, and a wireless communication processing unit 1511.

  The communication unit 151 sends various data generated by the arithmetic processing unit 155 to the network 16. The communication unit 151 receives various data transmitted via the network 16 and passes the data to the arithmetic processing unit 155. The data received by the communication unit 151 is typically menu information sent from the information distribution device 14, and the data sent by the communication unit 151 is typically a transmission request or selection information for the menu information. is there.

  The light receiving unit 152 receives the invisible light transmitted from the optical transmitter 11 and extracts various data superimposed on the received invisible light. The optical receiving unit 152 passes the extracted various data to the arithmetic processing unit 155.

  Although not shown, the image input unit 153 includes an optical system and a light receiving element (for example, a CCD). With such a configuration, the image input unit 153 captures an image in the direction in which the lens of the imaging device 15 is facing, and passes the captured image to the arithmetic processing unit 155. Here, the light receiving element of the image input unit 153 is sensitive to invisible light emitted from the optical transmitter 100. In the image input unit 153, the lens is preferably disposed near the light receiving unit 152. More specifically, when data communication using visible light is performed between the optical receiver 152 and the optical transmitter 11, the lens faces the direction of the object to which the optical transmitter 11 is assigned. The optical receiver 152 and the lens are arranged at the position. As a result, even if the invisible light has straightness, the image input unit 153 can capture an image representing the object.

  The wireless communication unit 154 transmits various data generated by the arithmetic processing unit 155 via a wireless link established with the wireless communication device 12. In addition, the wireless communication unit 154 receives various data (for example, area information) transmitted from the wireless communication device 12 via the wireless link and passes the data to the arithmetic processing unit 155.

  In the arithmetic processing unit 155, the communication processing unit 158 processes various data received by the communication unit 151 and creates various data to be transmitted by the communication unit 151. The optical communication processing unit 159 processes various data (for example, a synchronization signal and selection information) transmitted from the optical receiving unit 152. The image processing unit 1510 processes the image signal sent from the image input unit 153. The wireless communication processing unit 1511 processes various data (for example, area information) sent from the wireless communication unit 154.

  The display unit 156 displays images according to various data (menu information or captured images) sent from the arithmetic processing unit 155.

  The storage unit 157 stores various data (for example, selection information or captured images) sent from the arithmetic processing unit 155. The storage unit 157 preferably stores identification information that uniquely identifies the imaging device 15.

  Next, the operation of the object identification system 1 shown in FIG. 16 will be described with reference to the sequence charts of FIGS. 22A and 22B.

  First, in the imaging device 15, the communication processing unit 158 generates a menu information transmission request to the information distribution apparatus 14 according to a user operation, and sends the menu information transmission request to the network 16 via the communication unit 151 (FIG. 22A; step ST71, Sequence SQ71). When receiving the transmission request from the imaging device 15 via the network 16, the information distribution device 14 transmits the menu information held by itself (sequence SQ72). When receiving the menu information via the communication unit 151, the communication processing unit 158 displays the received menu information (see FIG. 20) on the display unit 156 (step ST72).

  With reference to the menu information displayed as described above, the user operates the imaging device 15 to select at least one favorite target object and stores it as selection information including the target object selected by the user. Stored in the unit 157. The communication processing unit 158 sends the same selection information to the network 16 via the communication unit 151 (step ST73, sequence SQ73). Here, preferably, the selection information includes identification information that can uniquely identify the imaging device 15. When receiving the selection information from the imaging device 15 via the network 16, the information distribution device 14 transfers the received selection information to the control device 13 (sequence SQ74).

  When receiving the selection information from the information distribution device 14, the control device 13 updates the object database DB (see FIG. 19) (step ST74). Specifically, when receiving the selection information from the information distribution device 14 through the receiving unit 132, the updating unit 133 selects the target record R assigned to the target specified by the received selection information. Thereafter, the update unit 133 sets the object flag F included in the object record R selected this time to “1”. In a preferred example, the identification information of the imaging device 15 is registered in the object record R selected this time.

  Thereafter, the user carries the imaging device 15 and heads for the installation location of the system 1 (see FIG. 17). When the user enters the installation location from one of the entrances E1-E3, the wireless communication unit 154 of the imaging device 15 and one of the wireless communication devices 12 (any of 12a-12c) establish a wireless communication link. . Thereafter, in the imaging device 15, the wireless communication processing unit 1511 extracts the identification information stored in the storage unit 157, and transmits the identification information to the wireless communication device 12 that is currently communicating via the wireless communication unit 154 (sequence SQ75). ). When wireless communication apparatus 12 receives the identification information from imaging device 15, wireless communication apparatus 12 transfers the received identification information to control apparatus 13 (sequence SQ76).

  In the control device 13, when the area information creation unit 134 receives the identification information from the imaging device 15 via the communication unit 136, the area information creation unit 134 accesses the object information storage unit 131. Thereafter, the area information creation unit 134 determines whether to create area information (step ST75). Specifically, as described above, the identification information of the imaging device 15 is registered in the object record R assigned to the object selected by the user. In addition, the object record R includes identification information IDq that identifies the wireless communication device 12 installed in the vicinity of each object. Furthermore, the control device 13 can specify the wireless communication device 12 that has transferred the identification information this time. From the above points, the area information creation unit 134 determines whether or not the imaging device 15 is located near the object selected by the user based on the information. If there is an object near the imaging device 15, the area information creation unit 134 determines to create area information. Otherwise, the area information creation unit 134 waits for the next reception of identification information.

  The area information creation unit 134 creates area information indicating that the user is near the selected object, and then transmits the area information to the wireless communication device 12 currently in communication with the imaging device 15 through the communication unit 136 (step). ST76, sequence SQ76). Radio communication apparatus 12 transmits area information sent from control apparatus 13 to imaging device 15 (sequence SQ77).

  The transmission of the identification information as described above is performed each time the imaging device 15 enters the communication area of each wireless communication device 12. Here, since the user freely moves around the installation location, the wireless communication processing unit 1511 establishes a wireless link with the wireless communication device 12 installed near the object selected by the user.

  In the imaging device 15, when receiving the area information via the wireless communication unit 154, the wireless communication processing unit 1511 displays the content represented by the received area information on the display unit 156 (step ST77). Note that the content represented by the area information may be output by voice or may be output by vibration. Through the above-described step ST77, the user can recognize that he / she is near the object selected by the user.

  Further, in the control device 13, the light emission instruction unit 135 passes the selection information and the synchronization signal to the optical transmitter 11 assigned to the object record R (that is, the object) used for creating the area information, so that the invisible light is transmitted. (FIG. 23B; step ST78, sequence SQ78). In response to the instruction from the light emission instruction unit 135, the optical transmitter 11 transmits invisible light on which the selection information and the synchronization signal are superimposed (step ST79, sequence SQ79).

  In this state, when the user brings the imaging device 15 close to the object, the light receiving unit 152 in the imaging device 15 receives invisible light transmitted from the optical transmitter 11 (for example, 11a) (step ST710). ). In the arithmetic processing unit 155, the optical communication processing unit 159 receives the selection information and the synchronization signal superimposed on the invisible light received by the light receiving unit 152, and has already been stored in the received selection information and the storage unit 157. The selected information is compared to determine whether or not they match (step ST711).

  If it is determined as YES in step ST711, the optical communication processing unit 159 passes the received synchronization signal to the image processing unit 1510 and instructs to capture an image (step ST712). If NO is determined in step ST711, the optical communication processing unit 159 does not give an instruction.

  In response to the above instruction, the image processing unit 1510 temporarily stores the image sent from the image input unit 153 in an internal frame memory (not shown) and displays the image on the display unit 156. (Step ST713). The image processing unit 1510 may store an image stored in the frame memory in the storage unit 157 in response to a user operation.

  As described above, according to the present embodiment, on the display unit 156 of the imaging device 15, a captured image relating to an object desired by the user (for example, the object A) is automatically displayed based on the selection information. In addition, since the light receiving element of the image input unit 153 is sensitive to invisible light, the display unit 156 naturally displays the state in which the optical transmitter 11 emits light. The object can be easily found.

  For example, it is assumed that the user has selected tomato A as an object in step ST73. Under this assumption, when the user moves around in the system installation location, the imaging device 15 receives area information from the wireless communication device 12c (see FIG. 17) installed near the tomato A in sequence SQ77. . Thereafter, when the user brings the imaging device 15 close to the tomato A, invisible light from the optical transmitter 11a is sent to the imaging device 15. The imaging device 15 captures the light emission of the optical transmitter 11 a and the image of the tomato A and displays them on the display unit 156. As a result, the user can specify tomato A.

  In the present embodiment, infrared light as invisible light plays three roles: a transmission medium for synchronization signals and selection information, and identification of an object. Infrared rays are used for transmission of control signals and data communication in, for example, a remote controller or IrDA, but are not visible to human eyes because they are not visible light. However, in the light receiving element provided in the imaging device 300, since infrared rays are also included in the sensitive region, even if the infrared rays received by the CCD are displayed on the image display unit 307 as they are, the state in which the optical transmitter 100 emits light is displayed. Is done. In addition, since invisible light is used, the light emitted from the optical transmitter 100 is not visually recognized except by the user, so that surrounding people are less likely to feel inconvenience.

  In addition, according to the present embodiment, the system 1 includes the wireless communication device 12 so that the user can easily determine whether or not the user is near the object.

  Note that the features described in the second to fifth embodiments can be easily incorporated into the object identification system 1 according to the present embodiment.

  Further, in the present embodiment, for the sake of clarity, the imaging device 15 has been described as sending selection information indicating an object. You can just send it to In this case, the information distribution device 14 selects an object targeted by the user based on the user's preference, and transmits the invisible light as described above from the optical transmitter 11 assigned to the selected object. .

  In addition, the processing of each imaging device in each of the above embodiments may be realized by a computer program installed therein. Further, each computer program is not limited to being stored in a memory included in each imaging device, but may be distributed in a state recorded in a distribution medium represented by a CD-ROM, or represented by the Internet. It may be distributed through the network.

  Although the present invention has been described in detail, the above description is in all respects illustrative and not restrictive. It will be appreciated that many other modifications and variations are possible without departing from the scope of the invention.

  The object specifying system and method according to the present invention are installed in a store or an exhibition hall where an effect that a user can easily find an object is required.

The schematic diagram which shows schematic structure of the target object identification system which concerns on the 1st Embodiment of this invention. The block diagram which shows the detailed structure of the target object identification system shown in FIG. The sequence chart which shows the communication procedure in the target object identification system shown in FIG. The block diagram which shows the detailed structure of the target object identification system which concerns on the 2nd Embodiment of this invention. The sequence chart which shows the communication procedure in the target object identification system shown in FIG. The block diagram which shows the detailed structure of the target object identification system which concerns on the 3rd Embodiment of this invention. The sequence chart which shows the communication procedure in the target object identification system shown in FIG. The figure which shows the light emission timing of the optical transmitter 100 shown in FIG. The block diagram which shows the detailed structure of the target object identification system which concerns on the 4th Embodiment of this invention. The sequence chart which shows the communication procedure in the target object identification system shown in FIG. The block diagram which shows the detailed structure of the target object identification system which concerns on the 5th Embodiment of this invention. The sequence chart which shows the communication procedure in the target object identification system shown in FIG. The flowchart which shows the 1st modification about the process of the imaging device 300 Schematic diagram illustrating an image displayed on the image display unit 307 by the processing shown in FIG. The flowchart which shows the 2nd modification about the process of the imaging device 300 The block diagram which shows the whole structure of the target object identification system 1 which concerns on the 6th Embodiment of this invention. The schematic diagram which shows the example of installation of the target object identification system 1 shown in FIG. The block diagram which shows the detailed structure of the control apparatus 13 shown in FIG. Schematic diagram illustrating the configuration of the object database DB stored in the object information storage unit 131 shown in FIG. Schematic diagram illustrating menu information distributed by information distribution apparatus 14 shown in FIG. The block diagram which shows the detailed structure of the imaging device 15 shown in FIG. First half of sequence chart showing communication procedure between components shown in FIG. The second half of the sequence chart showing the communication procedure between the components shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Optical transmitter 101 Memory | storage part 102 Communication part 103 Control part 104 Light transmission part 200 Control apparatus 201 Communication part 202 Control part 300 Imaging device 301 Communication part 302 Storage part 303 Light reception part 304 Image | photographing determination part 305 Image input part 306 Image processing Section 307 Image display section

Claims (8)

In cooperation with an optical transmitter that is installed around at least one object and emits invisible light having straightness, the object is identified using a light receiving element that includes the wavelength of the invisible light in a sensitive region. An imaging device,
The invisible light is superimposed with first information for uniquely identifying the object or the imaging device,
The imaging device is
An object selected by the user, or a storage unit that stores second information that uniquely identifies the object;
An optical receiver that receives invisible light transmitted from the optical transmitter and extracts first information superimposed on the received light;
A determination unit that determines whether to capture an image based on the first information sent from the light receiving unit and the second information stored in the storage unit;
An image input unit that captures an image representing light emission and surroundings of the optical transmitter when the determination unit determines to capture an image; and
An imaging device comprising: a display unit configured to display an image representing light emission and surroundings of the optical transmitter captured by the image input unit. The invisible light is further superimposed with a synchronization signal for controlling the imaging device,
The imaging apparatus according to claim 1, wherein the image input unit stores a captured peripheral image in a frame memory in accordance with the synchronization signal. A control device for controlling the light emission of the optical transmitter is installed around the object,
The imaging device further includes a communication unit that transmits first information for identifying an object selected by a user or itself to the control device via a network,
The imaging apparatus according to claim 1, wherein the control device instructs the optical transmitter to transmit first information transmitted from the communication unit. The optical transmitter further includes a plurality of light emitting elements, and outputs information related to the object by light emission of the predetermined light emitting elements,
The imaging device according to claim 1, wherein the display unit further displays related information of the object. The invisible light is further superimposed with relevant information on the object,
The optical receiver extracts related information from invisible light transmitted from the optical transmitter,
The imaging device further includes an image processing unit that synthesizes the related information extracted by the light receiving unit with the image captured by the image input unit,
The imaging device according to claim 1, wherein the display unit displays an image in which related information is synthesized by the image processing unit. Near each of the objects, a wireless communication device that transmits area information indicating that each of the objects is nearby is installed,
The imaging device further includes
A wireless communication unit for receiving area information transmitted from the wireless communication device;
The imaging device according to claim 1, further comprising: an output unit that outputs area information received by the wireless communication unit. An imaging device is installed using a light receiving element including a wavelength of the invisible light in a sensitive area in cooperation with an optical transmitter that is installed around at least one object and transmits invisible light having rectilinearity. An object identification method for identifying
The invisible light is superimposed with first information for uniquely identifying the object or the imaging device,
The object specifying method includes:
A storage step for storing the object selected by the user, or second information for uniquely identifying the object;
An optical reception step of receiving invisible light transmitted from the optical transmitter and extracting first information superimposed on the received light;
A determination step of determining whether to capture an image based on the first information extracted in the light receiving step and the second information stored in the storage step;
An image input unit that captures an image representing light emission and surroundings of the optical transmitter when it is determined to capture an image in the determination step;
An object specifying method comprising: a display unit configured to display an image representing light emission and surroundings of the optical transmitter captured by the image input unit. In cooperation with an optical transmitter that is installed around at least one object and transmits invisible light having straightness, the object is specified using a light receiving element that includes the wavelength of the invisible light in a sensitive region. A computer program implemented in an imaging device,
The invisible light is superimposed with first information for uniquely identifying the object or the imaging device,
The computer program is
A storage step for storing the object selected by the user, or second information for uniquely identifying the object;
When the imaging device receives invisible light transmitted from the optical transmitter, an information acquisition step of extracting first information superimposed on the received light;
A determination step of determining whether to capture an image based on the first information extracted in the information acquisition step and the second information stored in the storage step;
An image acquisition step of capturing an image representing light emission and surroundings of the optical transmitter when it is determined to capture an image in the determination step;
A computer program comprising: a transfer step of transferring an image representing light emission and surroundings of the optical transmitter captured in the image acquisition step to a display unit included in the imaging device.

Images