WO2005117304A1 - 情報受信装置、情報伝送システム及び情報受信方法 - Google Patents
情報受信装置、情報伝送システム及び情報受信方法 Download PDFInfo
- Publication number
- WO2005117304A1 WO2005117304A1 PCT/JP2005/010290 JP2005010290W WO2005117304A1 WO 2005117304 A1 WO2005117304 A1 WO 2005117304A1 JP 2005010290 W JP2005010290 W JP 2005010290W WO 2005117304 A1 WO2005117304 A1 WO 2005117304A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- light
- image
- luminance
- light receiving
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
- H04B10/112—Line-of-sight transmission over an extended range
- H04B10/1123—Bidirectional transmission
- H04B10/1125—Bidirectional transmission using a single common optical path
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/60—Receivers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/21—Combinations with auxiliary equipment, e.g. with clocks or memoranda pads
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
- H04N23/634—Warning indications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
- H04N23/635—Region indicators; Field of view indicators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
- H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
- H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
- H04M1/2753—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips providing data content
- H04M1/2755—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips providing data content by optical scanning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
- H04N2007/145—Handheld terminals
Definitions
- the present invention relates to, for example, building architecture
- this prior art 1 uses an electronic still-powered camera to photograph and record an optical tag device attached near a product arranged on a display shelf in chronological order.
- the light source for example, disturbing light such as the flickering force of a fluorescent light
- the information receiving apparatus information is designed to always extract information correctly while avoiding the adverse effects of disturbance light. Transmission systems and m-report transmission methods are being considered.
- m is a light emitting unit existing in the field of view of the image sensor using a light receiving unit having an image sensor such as a CCD (equivalent to the optical tag device in the prior art 1). ), The degree of change in the luminance is detected, the degree of change in the luminance is binarized into a bit pattern sequence as modulation information, and a bit pattern sequence that has been digitized is prepared in advance. It is determined whether or not the bit pattern matches any of the bit pattern sequences that are not correlated with each other.
- the transmission information from the light emitting unit is reproduced by generating (1/0), and the light emitting pattern of the light emitting unit is made to be a unique one. And reduce the influence of disturbance light.
- the present invention aims at speeding up the information restoration process by acquiring an area necessary for detecting the luminance A section of the shooting angle of view.
- the purpose is to facilitate position adjustment of the luminance modulation area. Disclosure of the invention
- the invention described in claim 1 includes an image pickup unit, and any information whose luminance is modulated.
- the invention according to claim 2 further comprises: a display means for displaying the content of the image captured by the image capturing means, specifically, a finger; and a moving means for moving an index displayed on the display means to a sound.
- the worm is characterized in that the moving means moves the ⁇ target by the moving means to specify the luminance modulation area.
- the invention according to claim 3 is characterized in that, when light reception is instructed by the light reception instruction means for instructing light reception in the luminance modulation area designated by the mBS designating means, the luminance change B A control means for controlling the light receiving means so that the optical axis is aligned with the peripheral region.
- the light receiving means includes a light receiving element, and an optical system that collects light incident on the light receiving element, according to any one of claims 1 to 3, An information receiving device according to (1).
- the invention of claim 5 is characterized in that the sd light receiving means includes a two-dimensional image sensor and an optical system for condensing light incident on the image sensor. Is an information receiving device listed in one of the
- the invention according to claim 6 is a fixing means for attaching an image filter captured by the eye IJB self-imaging means and arbitrary information restored by the eye IJB self-recovery means. Attached image gi — Evening and ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇
- the information receiving apparatus according to any one of claims 1 to 3, further comprising a storage means for storing
- the invention described in the claim 7 is further provided with a first determining means for determining whether or not the light receiving means has received the light in the luminance modulation area, and the H'J ⁇ 1.
- the linking means outputs the image data captured by the eye J self-imaging means and the recovery means.
- the invention described in the scope of claim 8 is a means for informing when the first judging means in the description J indicates that light reception in the luminance modulation area has failed, and a method after the informing by the notifying means. 'J recording The second judgment means for judging whether or not re-light reception in the modulation area has been instructed, and when the second judgment means judges that re-light reception has been instructed, the image is picked up by the imaging means. Claims characterized in that the apparatus further comprises a light receiving control means for starting light reception in the five-circumference region by the light receiving means while holding the captured image.
- the luminance in m and the B-period are the repetition of turning on and off the specific wavelength light.
- the information receiving apparatus according to any one of claims 6 and 7, further comprising an imaging control means for controlling the imaging means.
- the brightness of the light received by the IJ light receiving means changes the contents of the changes in the five-period area to less ⁇ and two types of bit patterns that are relatively incompatible with each other.
- Blffl logic ih corresponding to two types of bi-pattern sequences with low phase difference, which are converted by the conversion means, and the conversion means which are converted by the conversion means.
- the information receiving apparatus characterized in that the output by the processing signal output means ('
- An information output device comprising: output means for outputting information on the sound that has been subjected to the luminance change five times; imaging means; light receiving means for receiving arbitrary luminance-modulated information; and the imaging means Specifying means for specifying a luminance modulation area included in the shooting angle of view of the camera;
- the light receiving control means for controlling the light receiving means so as to receive the brightness modulation area, and the variation B circumference of the brightness modulation area received by the light receiving control means are at least mutually compatible.
- Conversion means for converting into two types of bit-pattern sequences having only low bit rates, and two types of bit-pattern sequences having low degrees of mutual change converted by the conversion means. Output the e-symbol
- the invention according to claim 12 which is an information transmission system characterized by including an information receiving apparatus including: a luminance variation B included in an angle of view captured by an imaging unit; A step for designating a surrounding area; a light receiving control step for controlling a light receiving section to receive a luminance change 5 area designated by the designated step; and a light receiving control step.
- the two types of bit-pass series that have a small ⁇ and a low degree of relevance to each other
- a logic signal output step for outputting a logical signal corresponding to two types of bipartite sequences that have low correlation with each other and are converted by the conversion step.
- the designating means designates a luminance change area included in the imaging angle of view of the imaging means, and restores the information. Controls the light receiving means so as to receive the luminance modulation area designated by the designation means and restores any information from the luminance circumference content included in the area, and the reproducing means performs the restoration. Regenerate any information restored by means
- the actual processing is performed by changing the brightness included in the angle of view of the imaging means.
- a display means for displaying the content of the image picked up by the image pickup means, in particular, a finger, and a moving means for arbitrarily moving the mark displayed on the display means are further provided.
- a moving means for arbitrarily moving the mark displayed on the display means are further provided.
- light receiving instruction means for instructing light reception in the luminance modulation area designated by the designation means, and when light reception is instructed by the light reception instruction means, the optical axis is aligned with the luminance modulation area.
- Control means for controlling the light receiving means And may be further provided. This makes it easier to align the region o
- the light receiving means may include a light receiving element and an optical system for condensing light incident on the light receiving element, or the light receiving means may be a one-dimensional image sensor. And an optical system for condensing the light incident on the image sensor.
- the point is, ⁇ It is sufficient if the light receiving means has an arbitrary angle of view that receives the light in the brightness modulation area J included in the angle of view of the image capturing means. It is desirable that the image includes a one-dimensional image sensor, as long as the imaging position of the intensity-modulated light is within the light-receiving surface of the two-dimensional image sensor. This is because they can be corrected by the processing, and do not require a mechanical camera shake mechanism such as that performed by Actu Yue.
- An associating means for associating the image data picked up by the image pickup means with the arbitrary information restored by the restoring means; and a storage for storing the associated image data and the arbitrary information. Means may be further provided. In this way, it can be applied to various usage styles, for example, management of the number of times of printing of an image, copyright management, and the like.
- a first judging means for judging whether or not the light receiving of the luminance modulation area is completed by the first judging means. Then, the image data captured may be associated with arbitrary information based on the luminance modulation area restored by the restoration means.
- a notifying means for notifying the completion, and after the notifying by the notifying means, 3 [: A second determination means for determining whether re-light reception in the brightness variation ah area has been instructed, and when the second determination means determines that re-light reception has been instructed, Light receiving control means for starting reception of the luminance modulation area by the light receiving means while holding the image taken by the camera.
- FIG. 1 is a use state diagram of the information transmission system in the first embodiment.
- FIG. 2 is a front view and a rear view of the camera-equipped portable electronic device 22 corresponding to the information transmission system in the first embodiment.
- FIG. 3 is a sequence diagram showing a relationship between a user operation on the camera-equipped telephone 22 and the internal operation of the camera-equipped mobile device 22.
- FIG. 4 is a view showing a display example of the display unit 27 and a display example of the display unit 27 when the sighting frame 40 is superimposed on the lighting device 18.
- FIG. 5 shows the display unit when the information acquisition from the optical tag device 18 has failed.
- FIG. 27 is a diagram showing a display example of 27 and a diagram showing a display example of the display unit 27 when information from the optical tag device 18 is successfully acquired.
- the sixth zozo is a diagram showing a display example of the display unit 27 when the coupon image file is downloaded, and a diagram showing a coupon image.
- FIG. 7 shows the power camera with the first embodiment.
- AT Phone 2 2 It is a block diagram.
- FIG. 8 is a conceptual diagram of the hand press correction in the mobile phone with a force camera 22 of the first embodiment.
- FIG. 9 is a conceptual diagram of camera shake correction in the mobile phone 22 with the power of the first embodiment.
- Figure 10 shows the angle of view of the camera optical system (for example, 32 degrees X 32 degrees)
- FIG. 1 A first figure.
- Figure 11 shows the angle of view of the optical system of the photodetector system (for example, 2 degrees).
- FIG. 12 is a block diagram of an internal block of the optical tag device 18.
- the 13th country is a diagram showing the front h77 and the reflective LCD shutter 78.
- FIG. 14 is a graph showing the results of calculating the luminance of an optical tag.
- Fig. 15 is a conceptual diagram of the detection of photodetection 61.
- Fig. 16 is a format diagram of the data format.
- FIG. 17 is a diagram showing the storage codes of the command part 87 and the meanings of the codes.
- FIG. 18 is a diagram showing an example of data.
- FIG. 19 is a process diagram of the optical tag device 18.
- FIG. 20 is an explanatory diagram of the pattern diffusion method.
- FIG. 21 is a structural diagram of the photodetector section 56 of the camera-attached ⁇ machine 22.
- FIG. 23 is a state diagram when the detected phases match.
- FIG. 24 is a flowchart showing a process from the time when the FIF is 0 to the time when the CPU determines a 0/1 bit and stores the bit in the decoded bit notch 50.
- FIG. 25 is a block diagram showing the internal packing of the camera-equipped mobile phone 22 ′ according to the second embodiment.
- FIG. 26 shows the imaging angle of view (wide angle of view of about 26 degrees X 39 degrees) of the communication image sensor 57 in the camera-equipped mobile phone 220 of the second embodiment. It is a figure.
- the 27th country is a diagram showing the detection angle of view (a narrow angle of view of about 6 degrees X 6 degrees) of the communication image sensor 610 in the camera-equipped mobile phone 220 of the second embodiment. I can do it.
- FIG. 28 is a diagram showing the apparent dot size at each distance of the area (lOcmXIO.cm) of the illumination part of the optical tag device 1.8.
- FIG. 29 is a conceptual diagram of the second embodiment that does not require a camera shake mechanism.
- FIG. 30 is a schematic diagram of a corresponding limit of a movement that can capture a pattern.
- the third country is a diagram (1/3) showing a flow chart of a preferred control program (photographing mode program) applied to the camera-equipped cellular phone 220 of the second embodiment. You.
- FIG. 32 is a diagram (23) showing a flow chart of a preferred control program (photographing mode program) applied to the camera-equipped cellular phone 220 of the second embodiment. .
- FIG. 33 shows the mobile phone with a camera 22 of the second embodiment.
- FIG. 3 (3/3). BEST MODE FOR CARRYING OUT THE INVENTION
- various examples without specifying details and examples of numerical values, character strings, and other symbols are merely for reference to clarify the idea of the present invention and are not limited thereto. It is clear that the idea of the present invention is not limited by all or parts of the present invention.
- well-known methods, well-known procedures, well-known architectures, and well-known circuit configurations (hereinafter, “well-known matters”) will not be described in detail, but are also intended to simplify the description. Such well-known matters are not intended to exclude all or part of the well-known matters. Such well-known matters can be known by those skilled in the art at the time of filing the present invention, and therefore, are naturally included in the following description. I have.
- the first country is a use state diagram of the information transmission system in the first embodiment.
- (a.) Will be described.
- a plaque 15 is installed on the roof of a dyeing material 14 such as a building.
- this advertising signboard 15 has an arbitrary description string (in the figure,
- X-department special cell in progress! A signboard that draws an electronic coupon that can be used when you visit the store.
- the optical tag device 18 is installed at the position (approximately the center in the example shown).
- the optical tag device 18 flashes in a series of two patterns, and the light source By simply looking at the evening device 18, it can be seen only as a flashing light.
- the flashing light of 18 is received, the information on the location of the site (for example, the electronic Information) can be played back and displayed on the information receiving device.
- the target object of the optical tag device 18 is, for example, “Incentives are given to a user who comes to a certain (relatively large) area to attract customers to that area. "I want to give users incentives when I see certain advertisements on the spot” and “I want to give more detailed information (or resources there) than information such as signboards. , Etc., to the user at the end of the website automatically. ”For those who have come to a certain nearby area (a few to several hundred meters), the physical entity (illustration Sign in the example
- FIG. 2 is a front view and a rear view of the force-measureable opening device 22 corresponding to the information transmission system in the first embodiment.
- the charging telephone 22 with this force mail has a small disk 23 composed of a foldable lid 23 1 and a main body 23 2, and the main body 23 2 has an antenna 24.
- 2 3 1 is a status display such as a status indicator 25, speaker 26, liquid crystal display
- a photographing lens 34 and a condenser lens 35 are provided.
- the lens 34 and the condenser lens 35 are arranged as close as possible to the distance L in order to eliminate parallax.
- Fig. 3 is a sequence diagram showing the relationship between the user's operation on the force-measurement device 2 and the internal operation of the lightning device with the force-measurement device.
- the code tag of the optical tag device 18 is assumed to have been input in advance by the provider as desired.
- a media such as a television commercial or a loudspeaker or the mobile phone with the camera 22 may be provided in advance. Attention to outdoor signage at XXX! A variety of services are being provided by light tags.
- X is any letter or any number or ⁇ is any symbol.
- an access ⁇ 1 that can be used by anyone may be input instead of a method of inputting an individual access code.
- step S 11 when the user of the mobile phone 22 with a force mail finds the signboard 16 having the optical tag clothing 18, he enters an access code (step S 11), and enters the power code. Press the camera 1 2 8 on the mobile phone 2 (step S 12).
- the telephone switches from the normal equipment usage state (standby state or call state) to the optical tag detection and reception state ( Step S 13, step S 14), the image taken with the force camera is displayed on the display unit 27, and a small index (fourth zono (a )) (See step S)
- the fourth country (a) is a diagram showing a display example of the display unit 27.
- a reception status indicator 36 of the mobile phone ⁇ occupancy, a current time indicator 37, and a battery remaining amount indicator 38 are displayed.
- an operation guide message 39 is displayed at the lower end of the display section 27.
- a through image (a video of several tens of frames per second) of the camera of the cellular phone with a camera 22 is displayed.
- a through-image including the signboard 16 in FIG. 1 (a) is displayed.
- the star symbol in the image is the first country
- FIG. 1 (a) schematically shows the optical tag device 18, and the blinking of the light of the optical tag device 18 is information to be acquired.
- the contents of the information just by watching the flashing light.
- a predetermined terminal powered telephone 22
- the content of the information is reproduced inside the powered telephone 22 and the content is reproduced. It is displayed on the display section 27 of the cellular phone 22 with a camera.
- the camera-equipped mobile phone 22 in the first embodiment processes the entire through image displayed on the display unit 27 to reproduce the above information.
- the above-mentioned information is reproduced by processing only a specific part surrounded by a simple aiming frame 40, thereby avoiding unnecessary processing and responding to information reproduction. It is trying to improve the quality. That is, unlike the above-mentioned prior art 2, the specific range in the through image is different. And the information of the optical tag device 18 is reproduced.
- the aiming frame 40 is not on the light-glowing device 18 indicated by the star symbol.
- the outline arrow 4 1 and the broken line frame 42 indicate the direction of movement of the camera-equipped mobile phone 22 necessary to superimpose the aiming frame 40 on the optical tag device 18 and the camera after the movement.
- the shooting range is shown for convenience.
- FIG. 4 (b) is a diagram showing a display example of the display unit 27 when the aiming frame 40 is overlaid on the optical tag device 18.
- FIG. 4 (b) is a diagram showing a display example of the display unit 27 when the aiming frame 40 is overlaid on the optical tag device 18.
- the user operates the force-solki 31 to superimpose the aiming frame 40 on the optical tag device 18 (step S16), and the camera-equipped mobile phone 22
- the status indicator 25 is turned on or blinks, or the center part of the cursor key 31 is detected to be pressed, and the information detection process of the optical tag device 18 is started (step S 17).
- FIG. 5 (a) is a diagram showing a display example of the display unit 27 when information acquisition from the optical tag device 18 has failed. For example, there is a case where information cannot be obtained after a predetermined time has elapsed, or a case where correct information cannot be obtained due to the influence of disturbance light or camera shake. In such a case, as shown in the figure, together with the information acquisition failure message 43, balloon messages 44 and 45 for each failure cause are generated and displayed on the display unit 27.
- FIG. 5 (b) is a diagram showing a display example of the display section 27 when information acquisition from the optical tag device 18 is successful.
- an information acquisition success message Along with 46, a balloon message 47 containing the character information obtained from the optical tag device 18 is generated and displayed on the display unit 27.
- the camera-equipped mobile phone 22 displays the detection result (step S18), and displays an error such as garbled characters in the detection result. Is determined (step S22).
- the detection result is an error, that is, when No is found in the step V 22, the camera is attached j3 ⁇ 4-3 ⁇ 4 as-d3 ⁇ 4 fl? ⁇ occupancy 22 is a standby state after performing this processing.
- step S20 the processing in step S20 described later is performed to confirm the start of the action and perform the operation of the execution instruction according to the result in step S18 (step S19 and step S19). If the information acquisition is successful, for example, execute the specified command, log in to the web service, and display the execution result of the command such as the information download.
- Step S20 The user uses the acquired information (for example, using a coupon) (Step S21) .
- Figure 6 (a) shows the image file of the cup.
- FIG. 6 is a diagram showing a display example of the display unit 27 when downloading is performed
- FIG. 6 (a) is a diagram showing an image of a coubon; FIG. Show the screen of (a) to the clerk at X department and use the coupon.
- FIG. 7 is a block diagram showing the internal block of the cellular phone with a camera 22 in the first embodiment (in the figure), the cellular phone with a cellular phone 22 has an antenna 24.
- Operation button section 51 including buttons such as data communication section 48, data buffer 49, decoding bit buffer 50, force key 28, etc.
- Voice input / output unit including peak power 26 and microphone 33 3
- Display unit 2 7 CPU 5 3 Acceleration sensor 54, Image stabilization function 55, Photodetector unit 56 , Shooting lens 3 4 C
- the light tech evening section 56 consists of a condenser lens 35, a photo detector 6 1, Amplification and A / D conversion is 62, Timing generator 63, Matching, Filter 64, Filter buffer 65.
- the camera section including the imaging lens 34 and the imaging image sensor 57.
- a finder-like device that allows the user to aim at an optical tag intended by the user.
- a function and a function to display the position of the information light source in the actual image are sufficient. Therefore, even if the frame rate of the camera part is, for example, several tens of bits Z seconds or several hundred bits seconds, there is no problem in aiming confirmation. For example,
- An image acquisition capacity of about 10 ⁇ m / sec is sufficient.
- information such as gain control of the camera section is used for setting the gain control port of the photodetector section 56 without closing the camera inside the power camera section. It may be diverted.
- Fore-eye technology evening section 5 6. This is a block that digitizes the luminance fluctuation signal of the optical tag and performs the correlation evaluation. Details will be described later.
- FIGS. 8 and 9 show the camera-equipped mobile phone 22 of the first embodiment.
- 'It is a conceptual diagram of the camera shake correction. As shown in Fig. 8 (a), the photo
- the lens 61 is located on the optical axis of the condenser lens 35.
- the position of the photo-detector 61 is changed by the actuator 55 attached to the photo-detector 61 to change the position of the optical tag device 1.
- the photodetector 61 is arranged so that the light A of 8 and the detection point B are aligned on the optical axis a.
- the photodetector 61 when the actuator 55 is not provided, as shown in FIG. 8 (b), the optical axis shifts due to camera shake, and the photodetector 61 is not located at the detection point B.
- a photo detector 61 is provided with a photo detector 55 to change the position of the photo detector 61. If this is done, the photo-detector 61 can be moved in the C direction, and the optical axis deviation can be corrected. Therefore, the photodetector 61 can reliably capture the light A from the optical tag device 18 even if slight camera shake is detected by the user ⁇
- the acceleration sensor 54 detects camera shake caused by a user's operation in two axial directions.
- the CPU 53 generates a camera shake correction control signal of a magnitude corresponding to the detection signal of the acceleration sensor 54, and drives the actuator 55 with the camera shake correction control signal. In this way, by detecting the acceleration of the two axes, it is possible to perform the correction for the camera shake while aiming at the optical tag.
- the detection angle of the photodetector 61 will be described as a narrow angle of view of 2 degrees X 2 degrees, and the capturing range will be set to 1 degree for convenience. It is said that beginners who are not very familiar with the operation of a power camera can experience camera shake at a camera angular speed of about 5 degrees / second and within about 1 degree. Normally, this level of image stabilization function is provided in general digital cameras and binoculars, etc., so that it can be illuminated with the narrow angle of view (2 degrees X 2 degrees) of the photo detector 61. It is considered sufficient to match. As will be described later, this camera shake correction can be omitted depending on the standard of the sensitivity detection angle of view, the distance to the optical tag, and the size.
- the configuration of the photographing lens 34 (photographing image sensor 57) and the photodetector unit 56 in the camera-equipped mobile phone 22 specifically realizes the operation of the present invention.
- FIG. 10 is a diagram showing the angle of view of the imaging lens 34 (image sensor 57 for imaging) of the cellular phone 22 with a force camera (elevation angle-wide angle of depression of about 32 degrees).
- FIG. 11 is a diagram showing a detection angle of view (a narrow angle of view of about 1 degree of elevation and 1 degree of depression) of the photodetector unit 56 in the camera-equipped mobile phone 22.
- FIG. Typical usage distance is several meters to 100 meters
- the deviation of the angle of view due to the arrangement of the optical systems is not considered to have an effect and is ignored, and the optical axes of 2 are assumed to be parallel.
- the angles of the optical axes of the two optical systems may be appropriately adjusted by biasing the camera shake correction.
- the photographic lenses 34 and the like are designed to make it easier for the user to aim from the image range hand-held and to operate in normal camera mode.
- the normal camera angle of view is used. In this case, specifically, an elevation angle, a depression angle of 32 degrees, a right and left angle of 32 degrees, and 480 dots X 4
- the angle of view is set to an elevation angle, a depression angle of 2 degrees, and a left and right angle of 2 degrees. This angle of view corresponds to the size of the aiming frame 40
- the aiming frame 40 is displayed at a position slightly above the center of the camera image at the angle of view of the camera image in consideration of the usability of the user, and the optical system is adapted to the aiming frame.
- the photodetector 61 is disposed at a position slightly shifted from the center of the optical axis.
- FIG. 10 and FIG. 1 ⁇ have a “collimated lens” configuration, but this is, for example, for the purpose of explaining clearly that the object is telephoto.
- the optical system for example, a single lens
- the optical lens requires a complex lens group to secure the image quality.
- details thereof are omitted because they are known for various purposes.
- the optical system of the photodetector 61 does not accurately form an image of the area to be aimed, but simply sets the corresponding angle-of-view area to the photodetector 61 (necessary brightness).
- the lens should be focused, and aberrations, depth of field, and required degree can be made low. Therefore, materials and materials are very simple and low cost. 7 ⁇ ⁇ For pans, pan-focus considering the usage distance is sufficient.
- Fig. 12 (a (b) is a block diagram of the internal structure of the optical tag device 18; the optical tag device 18 is used for the evening generator 6 6 1 ZN divider 6 7 , A transmission memory 68, a pattern data generation unit 69, a first control Z drive unit 70, and a second control drive unit 71.
- the second control / drive unit 71 is composed of a front panel 77, a reflective liquid crystal shutter 78, and a power unit. Become.
- FIG. 13 (a) shows a phantom 77 and a reflective liquid crystal shutter 78.
- FIG. It is only necessary that the D-light 7.7 illuminates the reflective liquid crystal shutter 78.
- the light source of the optical tag device 18 is not limited to the example shown in FIG.
- a configuration including a light source 80 that emits light directly and a hood 81 that ensures the lowest possible brightness when ambient light is turned on and off is provided.
- the connection shown in Fig. 13 (a) can be configured more sparsely. It is desirable because it has potential.
- the optical tag device 18 is composed of a front light 77 and a reflective panel 78 as shown in FIG. 13, and as an environment, It can be used from outdoors on a sunny day to outdoors at night.
- the size of the reflective panel 78 is 1 square meter and the front light
- the reflection coefficient when 77 is in the light emitting state is 30%, and the reflection coefficient when the front light 77 is not emitting light is 2%. Also, the front light 77 can uniformly irradiate the light of 1000 lumens (about one household bulb) to the entire surface (one square mail) of the reflection panel 78.
- luminance reflection coefficient X illuminance / ⁇
- Luminance is XA (Ambient environment: sunny outdoor)
- Luminance is XB (Ambient environment: under night street light)
- Fig. 14 shows the case where the brightness of the light tag was calculated under both extreme conditions.
- the 14th country is a graph showing the results of calculating the brightness of optical tags.
- a-2 Luminance when the irradiation of front light 77 is added (B (Point) It is assumed that the light of 1000 lumens irradiated by spotlight 77 on a square meter is 100lux. In this case, the flow The brightness increase due to the light 7 7
- the present embodiment is a method that can configure a terminal at low cost even with the current printing path by controlling the gain (and, in some cases, the lens aperture) of the printer as well. As shown by the trapezoidal figure frame 81 in Fig. 4, the following gain adjustment is performed.
- the gain In the darkness, where the movement is small at night, etc., the gain can be increased by increasing the gain depending on the environmental lighting conditions, so that the dynamic range of about 20 db is about 8 bits.
- a / D control can be used for control.Information for controlling the gain of the camera is obtained by the force camera system, but it is possible to shoot normally with a much smaller dynamic range. It is possible to control the gain detection system by diverting the gain so that the gain control is performed finely.
- the brightness of the light source device 18 is far away (the mobile phone 22 with a power camera). Evening 61 is a single unit, so it is usually smaller than the image diode used in the image sensor (image sensor 57 for shooting).
- the light-receiving device 18 is capable of ensuring that the size of the light-receiving sensor can be sufficiently large, several times to several tens of times, and that sufficient sensitivity can be ensured even at high speed operation.
- the first 5 zozo is a schematic diagram of the detection of the photo: r tech 61. As shown in the figure, even if the angle of view at evening 6 1 'is 2 degrees X 2 degrees, at short distances (approximately within 30 meters), the variation in angle of view is detected. You can do this. Further, if the distance is longer than, for example, a distance of 60 meters, a panel having a size of 1 square meter will have a variation in luminance of 1/4 because the surrounding luminance and the panel are averaged. More distance, for example,
- the 90 meter In the 90 meter, it becomes 1 ⁇ 9. In practice, it depends on the gain control and the degree of AZD. However, when viewed under the condition where the change ft of the original optical tag device 18 itself is ⁇ 15: 1 ”And“ 32: 1J ”, so it is possible to set it to about 100 meters even with a panel of 1 square meter in size. For example, even at the level of a T-camera, if the exposure is set properly, it is possible to distinguish white and black paper even at very long distances if the target has an area larger than the number of pixels. In addition, stable detection is possible at a longer distance.
- Source—Evening block 82 is a fixed-length head block 83 followed by a variable-length parameter block following the head block D (the first block in the figure). 3rd to 3rd parameter D-blocks, the number of which is an example.) 8 4 to 8
- the top block 83 is the command code F section 8
- the block length storage unit 89 consisting of the third parameter block length storage unit 90, is stored in the first to third parameter tab length storage units 88 to 90. Stores the actual length (byte length) of the first to third parameter tab blocks 84 to 8.
- FIG. 17 is a diagram showing a command code stored in a command code, a part 87, and the meaning of the code.
- the command code unit 87 can store, for example, a code of “0” 6, and these codes are stored in the terminal and the mobile phone.
- a command for instructing the operation of the phone e.g., a W U access mail or scheduler for an m W telephone, such as a W e-mail or scheduler, is obtained.
- a W U access mail or scheduler for an m W telephone such as a W e-mail or scheduler
- FIG. 18 is a diagram showing an example of an evening.
- the code is set in the F section 87.
- the first and third parameters are stored in the block length storage section 8890, respectively.
- the display information (“Information 'Can I connect?')” In FIG. 5 (b) above and the access / sw C) is stored. In the example shown, evening block 86 is not used.
- FIG. 199 is a process diagram of the optical tag device 18.
- the optical tag device 18 Upon receiving the software block D 2, the optical tag device 18 performs data compression, error correction, and addition of a flag sequence, and performs data block processing.
- the terminal is a cellular phone with a camera, and the terminal has a communication IP5 function. It is easy to ensure independent synchronization with the required accuracy or more, or at the terminal side in a fixed phase step until detection is successful. It is also possible to shift the detection tyng by
- V-field filter is used as a suitable period and detection method. It is assumed that the start evening of one cycle of the pattern is obtained by using a pictogram. This is, for example, CDMA ('Code ⁇ Division
- Fig. 21 shows the force measurement
- the luminance value within the target angle of view observed by gain control is equal to 4.times.
- the period of the pattern code time slot that is, 4 kHz.
- the phase of the sample clock of the / D sampled and put into the FIF buffer may be asynchronous with the light source (lighting device 18), but the period error is kept constant. O
- the length of the buffer is such that 60 samples are sequentially stored in the FIF ⁇ because 15 bits, which are the code pattern, are sampled at 4 times the period.
- the specific address of the FIF ⁇ is extracted as 4 and the group of codes corresponding to code bit 1 and the group of data corresponding to code bit h0 are weighted and summed. Make a match H file. Note that the sampled F
- the CPU may take in IF 0 data one after the other, so that it can be softly measured.
- the value range in this field indicates the correlation value of the input signal
- the graph in the figure shows the time-series change of the data sample value stored in FIFO.
- Actual observations show small signal fluctuations as compared to the actual detection scale (MAX 255) as shown in the figure. In actuality, noise appears in the observation data overnight as shown in the figure.
- MAX 255 the actual detection scale
- noise appears in the observation data overnight as shown in the figure.
- the output of the filter that assumes that the level is "140" at one level and "120" at two levels is about 1.
- FIG. 23 is a state diagram when the detection phases match.
- the output force outputs the fluctuation width "2.0" of the applied pattern.
- this peak is almost maintained, and the output sharply decreases.
- the observed signal can be detected as “140” in a bright state and “120” in a dark state, for example, if the output at each sample time is calculated, the phases match. Only four sample times indicate the peak "20", after which it becomes "1.4". In this way, peaks can be detected very easily, and subsequent detections can be easily adjusted.
- the filter output is stored in the FIFO for four samples as shown in Fig. 21.
- FIG. 24 is a flow chart showing the process from the FIF 0 to the CPU judging the 0/1 bit and storing it in the decoding bit buffer 50.
- the frame detection is performed in the data processing for the normal bit string. (In this embodiment, the data frame starts and ends with 1s consecutively.) Then, the error correction is performed, the transmitted source data block is restored, and processing is performed according to the restored data block.
- step S31 the data of the filter buffer 65 is read (step S31), and in order to perform stable extraction of "1", four consecutive sample times are performed. Determine whether the threshold has been exceeded (step S32)
- Step S33 Take out the data (the middle of the evening sampling, which is stable from the sampled data). (Can be 12) (Step S33), and output the filter. It is determined whether or not the value exceeds the threshold (step S34). If the filter output value exceeds the threshold, the decoding bit buffer 5 is output. "1" is stored in 0 (step S35), and if the filter output value has not reached the threshold value, the filter output value has reached the threshold value X (-1). It is determined whether or not it is (Step S36).
- the light modulation process is a buffering / arithmetic process for one data, so that a very simple processing configuration can be achieved.
- the method of transmitting a bit at a high S / N ratio from a discrete and complete image data on the final B-cycle of the light source is as follows.
- a spread modulation method can be performed, in the present embodiment, a method using the photodetector 61 enables high-speed and continuous measurement, so that if the characteristics of the detection filter can be secured, a simple modulation method, for example, , Pulse modulation at the frequency of a specific carrier (10 KHZ), etc.o Others, the same applies to pulse frequency switching modulation
- the photodetector 61 is used as the light receiving means for receiving the bright spot of the optical tag device 18.
- the present invention is not limited to this. Any device having an angle of view corresponding to the size of the (optical device 18) may be used.
- it may be an image sensor such as CCD or cM ⁇ S, or may be one in which a plurality of image sensors are arranged on a plane.
- FIG. 25 is an internal block diagram of the camera-equipped mobile phone 220 in the second embodiment. In this figure, the camera-equipped mobile phone 22 is shown.
- 0 is an image sensor (hereinafter referred to as a “communication image sensor 61 0” in order to distinguish it from the imaging image sensor 57) instead of the photodetector 61 of the above embodiment. It is characterized by the fact that 0 ) is used.
- the camera-equipped mobile phone 220 in the first embodiment has a data communication unit 48 including an antenna 24, a data buffer 49, and a decoding bit buffer 50 camera.
- Operation buttons 5 1 (2 8 3 2) including various buttons such as 2 8, and audio input / output sections including speech force 26 and microphone 33
- imaging sensor 57 such as CCD and CM ⁇ S
- image buffer 58 display buffer 59, storage unit 60, etc.
- Power supply but omitted to avoid surface congestion
- the communication image sensor section 560 is a condensing lens 35, the communication image sensor 610 Amplification and A / D conversion 62
- the shooting lens 34 and the shadow image sensor are used.
- the configuration of the camera part including 57. It would be nice if there was a finder-like function that allows the user to aim at the light intended by the user and a function that displays the position of the information light source in the actual image. For this reason, the frame rate of the force camera section is aimed even if the signal speed of the transmission is, for example, several tens of bits per second to several hundreds of hits / second. There is no problem in confirmation, for example, an image acquisition capability of about 10 frames / second is sufficient.
- the information such as the gain control center of the force-measuring section is not closed inside the force-measuring section, and the information of the gain-generating section of the general-purpose image sensor section 560 is maintained.
- the communication image sensor unit 560 blocks the brightness fluctuation signal of the optical tag device 18 and performs the evaluation up to the 1st phase evaluation. Basically, the function is the same as that of the fifth embodiment (see FIG. 7) of the first embodiment, but the same operation as that of the fifth embodiment is performed.
- the communication sensor section 560 of the present embodiment is a CCD or C ⁇ 0S or the like.
- a two-dimensional sensor consisting of a plurality of photoelectric conversion elements (pixels)
- Both the photo technology 61 and the communication image sensor 610 are both
- the communication image sensor 610 is composed of a plurality of photoelectric conversion elements (a plurality of pixels). O However, the number of pixels of the communication image sensor 610 may be smaller than the number of pixels of the photographing image sensor 57. In other words, the M-trusted image sensor 610, which only needs to detect a bright spot within a narrow angle of view, compared to the photographic image sensor 5.7 which requires photographic image quality, Low-resolution (for example, 30 dots X 30 dots, dots) may be used.o
- the light source (optical tag device 18) that emits information is the same as in the above-described embodiment.
- the sampling frequency of the 1 kHz base span signal shall be quadrupled.o Therefore, the frame rate of the communication image sensor 61 'is
- the distance between the optical tag device 18 and the terminal (portable electronic device with camera 222) is 50 m, and the size of the light source of the optical tag device 18 is 10 cm X 10 cm rectangle. (10 cm square).
- the second 6 zozo is an image-taking angle of view (approximately 26 degrees X 39 degrees) of the photographing lens 34 (the photographing image sensor 57) in the camera-equipped mobile phone 220 of the second embodiment.
- FIG. 21 is a diagram illustrating a detection image (a narrow angle of view of 6 degrees X 6 degrees individuality) of the communication image sensor 610 in 220.
- the range of 5 m ahead of 50 m is set as the sensor angle of view (angle of view of communication image sensor 610 • 6 degrees X 6 degrees).
- I do. 6 degrees is a tangent (5 m / 50 m) given by an angle of view 6 degrees square and a 30 x 30 dot communication image sensor.
- FIGS. 28 (a) to (d) are diagrams showing apparent dot sizes G at respective distances of the area (10 cm ⁇ 10 cm) of the illumination portion of the optical tag device 18. .
- the optical tag device 18 when the optical tag device 18 is 5 m away from the camera-equipped cellular phone 220, that is, at lOcm ⁇ l.
- the optical tag device 18 is a mobile phone equipped with a camera.
- the power becomes 14 ⁇ : L / about 16.
- the signal strength is less than 14 at a location 50 m away from the optical tag device 18 (the location of the camera-equipped mobile phone 220), but this degree of signal reduction is inconvenient. Do not invite.
- the dynamic range per dot is about 30 to 50 dB, so the 0 N light source with one dot covered If the detection level is 50% of the dynamic range to the saturation level, there is no inconvenience even if the detection voltage drops by 1/4 (that is, -6 dB).
- the shutter speed is 0.25 milliseconds.
- the absolute luminance of the light source is generally almost constant and is extremely high with respect to the surroundings due to visibility requirements.
- Operate the communication image sensor 610 at the above-mentioned 400 frame seconds (about 0.25 milliseconds shutter time) Even if this is done, it is possible to easily cope with the lens diameter and the gain, so that it is possible to sufficiently acquire the blinking information of the light source.
- the angle of view of the communication main sensor 610 is set to "6 degrees 6 degrees", but this is only an example. In view of camera shake resistance, a larger angle of view can be used.
- FIG. 29 is a conceptual view of the second embodiment, which does not require a camera shake mechanism. As shown in FIG. 1 0 is the condenser lens 3
- the image of the light spot A forms an image on the light receiving surface of the communication image sensor 610 through the condenser lens 35.
- the image of the light spot A is almost equal to the light receiving surface of the communication image sensor 610.
- Image at center position B when the light point ⁇ is positioned off the optical axis of the optical lens 35 as shown in (b), the image of the light point A is also not located on the optical axis of the condenser lens 35.
- the image at the position A is of course included if it is large enough to include the pinch position B.
- the image at position B and the image at position B are also taken and aligned (overlaid on the image at position A ').
- Image stabilization can now be performed by image processing. O It is not necessary to have a mechanism
- the following method can be used as an image processing method for camera shake correction.
- the 30th country is a schematic diagram of the corresponding limit of the movement that can capture the pattern.
- Each domain of the sensor 610 is processed in parallel. As shown in [3 ⁇ 41] of 3 ⁇ 4, multiple frames in two series of sequences (for example,
- Equation (1) is a general equation of the corresponding limit of the movement that can capture the pattern.o
- n Spreading code length (or one block length)
- the resolution of the communication image sensor 610 should be increased to allow camera shake.
- the angle of view of the communication image sensor 610 can be reduced to make it possible to cope with a smaller area. You may want to raise the frame rate even further to respond to severe shake. By the way, raising the frame rate does not mean that the communication speed will increase.
- the communication image can reveal the characteristics of two-dimensional communication.
- the communication image can reveal the characteristics of two-dimensional communication.
- a plurality of signals can be received simultaneously by the sensor 610, and each signal can be discriminated in position (discrimination based on the pixel position of the communication image sensor 610).
- the range of the detection sight is set to 6 ⁇ 6 degrees. Therefore, the area of the detection sight is expanded to 9 times the same range (2 degrees ⁇ 2 degrees) of the above embodiment, and the minimum The light source area can be reduced to less than 0.2 degrees and 9 times. Therefore, if the same light source is used, detection can be performed even at a distance three times that of the above-described embodiment, or if the same light source is used, a light source having a small size of 1Z9 of the above-described embodiment can be used.
- the range of the aiming area performed by the user can be maintained at the detection limit angle. Can be larger. Therefore, rough aiming can be performed, and operability at the time of acquiring information can be improved.
- the mechanism can be simplified. That is, when aiming for a narrow limit detection angle, the camera shake correction mechanism (actuator 55) as shown in the above embodiment can be dispensed with.
- the number of pixels of the communication image sensor 610 is smaller than that of the photographing image sensor 57, and a low-resolution (low-priced) one can be used.
- the cost can be reduced because the precision of the optical system is not required.
- the adjustment and design of the sensor sensitivity are extremely simple.
- the general scenery has a dynamic range with extremely high illuminance from night to clear daytime, so the camera that captures the scenery is a sunset Combining speed, lens aperture, gain, etc., must cover the real world illuminance and brightness range of several tens to 100 d ⁇ .
- an image sensor dedicated to communication (communication image sensor 610) is used as in the second embodiment, it becomes a sensor only for optical communication. It is not necessary to consider processing such as monitor image acquisition at all.On the other hand, since the information light source side has a certain absolute luminance, the gain can only be performed for the target signal. Adjustment and design are extremely simple.
- Fig. 31 to Fig. 33 zo are the camera with the camera of the second embodiment.
- Control program (shooting mode program) that is preferable to apply to 0
- step S.5 the camera unit such as the image sensor 5.7 for photographing is started.
- the user instructs to display a predetermined submenu.
- Step S53 is a menu for receiving information from the optical device 18 and a button for selecting the menu is provided in the operation unit 51 in advance.
- step S54 the normal processing for the shooting mode is executed (step S54), while if the sub-menu display instruction has been issued, the following processing is performed. Execute.
- the predetermined sub-menu is displayed on the display unit 27 (step S55), the information from the optical tag device 18 is received in the sub-menu, and the information is displayed as a photographed image. Ask the user whether or not to memorize them together (step S56) If the user makes a negative (does not store information) selection, the process returns to the above-described normal processing (step S55) and selects a positive (stores information). Is performed, a predetermined "grid" is displayed in the through image being displayed on the display section 27 (step S57).
- the “grid” is a rectangular frame line representing the angle of view (6 degrees ⁇ 6 degrees) of the communication image sensor 61, and is the aiming frame 40 of the above embodiment.
- step S58 If no bright spot is detected in the grid (when the result of the determination in step S58 is "N0"), the shutter button (not shown) of the operation unit 51 is pressed. The lowering operation is determined (step S59), and if the shutter operation is not performed, the process returns to step S57 again. When the shutter operation was performed, the image captured by the image sensor 57 at that time was captured.
- step S60 a predetermined message for warning that the information from the optical tag device 18 has not been received is displayed on the display unit 27 (step S6). 1), an image save instruction from the user is detected (step S62), and if there is no save instruction, the captured image is discarded (step S62).
- step S58 when a bright spot is detected in the grid (when the determination result of step S58 is “YES”), the bright spot portion in the group F is differentiated and displayed (step S58).
- Step S66 The user checks the illuminated area that has been differentiated and displays the illuminated area within the grid. Fine-tune the orientation (shooting direction) of the mobile phone 2
- Step S67 it is determined whether the shutter button (not shown) of the operation section 51 is pressed down. If the shutter operation is not performed, the process returns to step S66 again. If the shutter operation is performed, the captured image of the image sensor 57 for capturing at that time is captured. (Step S 6
- the photographing image sensor 57 continuously generates and outputs several tens of frames of images per second, but the bright spots in the grid (the occupancy of the light-glowing device 18) are also reduced by the number of frames per second. Since the rotation is light that blinks several tens of times, the imaging image sensor 57 generates and outputs two types of images, one with and without a bright spot. Become . It is desirable to use an image that does not include a bright point as a captured image for storage and storage. When an image that includes a bright point is saved, the bright point interferes with the appearance of the image. For this reason, in the second embodiment, when capturing an image for storage in step S68, an image that does not include a bright point is selected.
- Step S69 it is determined whether the information reception from the optical tag device 18 has been completed. If not finished, an icon or symbol or a message such as an hourglass indicating that information is being received is displayed on the display unit 27 (Step S70), and Step S70 is performed. Repeat 6 9
- step S68 the image not including the bright spot
- step S71 association means
- step S7 display means
- step S74 operation receiving means, re-receiving executing means. If there is a request to re-receive information, it is considered that an error has been found in the information displayed on the display unit 27, and the process from step S69 is repeated.
- the image is not taken in (step S68). This is because there is no inconvenience in the image captured in step S68, and there is no problem in receiving information from the optical tag device 18 simply. ) Can reduce the processing load and reduce the processing time when information is re-received.
- step S74 discards the image file generated in step S71 (step S74) and ends the flow chart (main (If the reception of the blue report is normal and an instruction to save the image is detected. ⁇ (“YES” in step S73)), the program returns to the program.
- the image file generated in step S71 that is, the image file containing the image (the image not including the bright spots) captured in step S68 and the reception information Save the file in the storage section 60 and end the game (U-go to the main program)
- the file name Exif (Exchangeable image file format), which is a general-purpose image file of the camera.
- a general-purpose file format that allows various auxiliary information and other optional information at the time of shooting to be stored along with the main image data. You can use any of the image files in the MTF ( tf ) file.
- Exif file an optional storage space for the text information is defined, and the received information from the optical device 18 is written to the stored X-ray. With this, it is possible to put the image data and received information in one image file.
- information received from the optical tag device 18 can be stored and stored in one image file together with the photographed image. Accordingly, various services are realized by finding out the information at the time of reproducing the image file, for example, using a coupon such as an application example in the above embodiment. It becomes possible.
- the image data contained in the image file is a ghost image that does not include the bright spot of the optical tag device 18, the appearance during image reproduction may be degraded.
- the image acquisition (step S68) is passed, so that useless image acquisition processing is not performed.
- the processing load can be reduced and the processing time can be shortened.
- the images captured in step S68 are not limited to still images. It may be a simple video.
- the image generated and output from the image sensor for shooting 57 is an image of several tens of frames per second, and the images are still images.
- a movie is played back automatically, it looks like a moving image, so frame images taken during an arbitrary period of time may be captured continuously as simple movie data.
- images containing bright spots are removed from the pair in order to avoid deterioration in the appearance of the playback video.
- the information receiving apparatus of the present invention performs the actual processing in a limited manner on the “luminance modulation area included in the imaging angle of view of the imaging unit”. By obtaining an area necessary for detecting the information, it is possible to speed up the information restoration processing.
- the information receiving apparatus, the information transmitting system, and the information receiving method of the present invention include, for example, landmark display of buildings, advertisement display, guidance of amusement facilities such as amusement parks, and congestion.
- Status display store quotient It is suitable for various uses such as product explanations, exhibition descriptions in museums and exhibitions.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Computer Networks & Wireless Communication (AREA)
- Studio Devices (AREA)
- Optical Communication System (AREA)
- Indication In Cameras, And Counting Of Exposures (AREA)
- Exposure Control For Cameras (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP05745839.0A EP1744475B1 (en) | 2004-05-31 | 2005-05-30 | Information reception device, information transmission system, and information reception method |
US11/435,229 US7308194B2 (en) | 2004-05-31 | 2006-05-16 | Information reception device, information transmission system, and information reception method |
HK07102656.4A HK1095219A1 (en) | 2004-05-31 | 2007-03-12 | Information reception device, information transmission system, and information reception method |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004-162521 | 2004-05-31 | ||
JP2004162521 | 2004-05-31 | ||
JP2005157048A JP4258491B2 (ja) | 2004-05-31 | 2005-05-30 | 情報受信装置、情報伝送システム、情報受信方法、及び、情報受信プログラム |
JP2005-157048 | 2005-05-30 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/435,229 Continuation US7308194B2 (en) | 2004-05-31 | 2006-05-16 | Information reception device, information transmission system, and information reception method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005117304A1 true WO2005117304A1 (ja) | 2005-12-08 |
Family
ID=35451227
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2005/010290 WO2005117304A1 (ja) | 2004-05-31 | 2005-05-30 | 情報受信装置、情報伝送システム及び情報受信方法 |
Country Status (6)
Country | Link |
---|---|
US (1) | US7308194B2 (ja) |
EP (1) | EP1744475B1 (ja) |
JP (1) | JP4258491B2 (ja) |
KR (1) | KR100818392B1 (ja) |
HK (1) | HK1095219A1 (ja) |
WO (1) | WO2005117304A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022045080A1 (ja) * | 2020-08-24 | 2022-03-03 | ソフトバンク株式会社 | 光通信によるデジタルサイネージ及びled照明を利用したサプリメンタルダウンリンク装置と方法 |
Families Citing this family (67)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4627084B2 (ja) * | 2005-04-12 | 2011-02-09 | パイオニア株式会社 | 通信システム、通信装置及び方法、並びにコンピュータプログラム |
WO2008004309A1 (fr) * | 2006-07-07 | 2008-01-10 | Panasonic Corporation | Appareil émetteur, appareil récepteur, procédé de transmission et procédé de réception |
JP2008258987A (ja) * | 2007-04-05 | 2008-10-23 | Sony Corp | 光情報処理システム、端末装置、光情報処理方法、プログラム及び記録媒体 |
JP4859761B2 (ja) * | 2007-06-13 | 2012-01-25 | パナソニック株式会社 | 光空間伝送装置 |
US8121917B2 (en) * | 2008-03-03 | 2012-02-21 | The Coca-Cola Company | Systems for implementing a loyalty program |
KR101508272B1 (ko) * | 2009-01-16 | 2015-04-08 | 삼성전자주식회사 | 단말기, 디스플레이 장치 및 이에 적용되는 데이터 송수신 방법 |
JP5540612B2 (ja) * | 2009-09-07 | 2014-07-02 | 沖電気工業株式会社 | 案内表示システム及び案内表示方法 |
CN102726123B (zh) * | 2010-01-15 | 2015-02-18 | 皇家飞利浦电子股份有限公司 | 用于对局部化光贡献进行2d检测的方法和系统 |
JP2011254317A (ja) * | 2010-06-02 | 2011-12-15 | Sony Corp | 送信装置、送信方法、受信装置、受信方法、通信システムおよび通信方法 |
JP5670798B2 (ja) * | 2011-03-30 | 2015-02-18 | フェリカネットワークス株式会社 | 通信端末、通信方法、及びプログラム |
JP5903821B2 (ja) | 2011-09-30 | 2016-04-13 | カシオ計算機株式会社 | 情報伝達効果出力システム及び情報伝達効果出力方法 |
JP5488583B2 (ja) | 2011-12-27 | 2014-05-14 | カシオ計算機株式会社 | 情報提供システム、サーバ、情報提供方法、及び、プログラム |
US20130317916A1 (en) * | 2011-12-29 | 2013-11-28 | Intel Corporation | Location based technology for smart shopping services |
WO2013108146A1 (en) * | 2012-01-20 | 2013-07-25 | Koninklijke Philips N.V. | Light detector |
JP5936902B2 (ja) | 2012-04-13 | 2016-06-22 | 株式会社東芝 | 伝送システム、送信装置および受信装置 |
PT2858269T (pt) | 2012-05-24 | 2018-05-28 | Panasonic Ip Corp America | Método de comunicação de informações |
US11049344B2 (en) | 2012-07-26 | 2021-06-29 | John C. S. Koo | Dual-mode commercial messaging systems |
US10068396B2 (en) | 2016-01-15 | 2018-09-04 | John C. S. Koo | Light-based security systems |
US9270627B1 (en) | 2012-07-26 | 2016-02-23 | John C. S. Koo | Light-based messaging systems |
US10395453B1 (en) | 2012-07-26 | 2019-08-27 | John C. S. Koo | Light-based vehicle messaging systems |
US8924255B1 (en) | 2012-07-26 | 2014-12-30 | John C. S. Koo | Light-based commercial messaging system |
US10395290B1 (en) | 2015-11-10 | 2019-08-27 | John C. S. Koo | Location-based remote customer service |
US10679448B2 (en) | 2012-07-26 | 2020-06-09 | John C. S. Koo | Light-based commercial messaging systems |
US11727737B2 (en) | 2012-07-26 | 2023-08-15 | John C. S. Koo | Retail light-based sensor-driven messaging systems |
JP5648664B2 (ja) | 2012-09-21 | 2015-01-07 | カシオ計算機株式会社 | 情報処理システム、情報処理方法、端末装置及びプログラム |
JP5960836B2 (ja) * | 2012-10-31 | 2016-08-02 | 擴張世界有限公司 | 画像表示システム、電子機器、プログラムおよび画像表示方法 |
US8798926B2 (en) * | 2012-11-14 | 2014-08-05 | Navteq B.V. | Automatic image capture |
US8988574B2 (en) | 2012-12-27 | 2015-03-24 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information using bright line image |
US10530486B2 (en) | 2012-12-27 | 2020-01-07 | Panasonic Intellectual Property Corporation Of America | Transmitting method, transmitting apparatus, and program |
EP2940889B1 (en) | 2012-12-27 | 2019-07-31 | Panasonic Intellectual Property Corporation of America | Visible-light-communication-signal display method and display device |
WO2014103161A1 (ja) | 2012-12-27 | 2014-07-03 | パナソニック株式会社 | 情報通信方法 |
US9560284B2 (en) | 2012-12-27 | 2017-01-31 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information specified by striped pattern of bright lines |
CN107395977B (zh) * | 2012-12-27 | 2019-12-17 | 松下电器(美国)知识产权公司 | 信息通信方法 |
US9088360B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
CN104137521A (zh) * | 2012-12-27 | 2014-11-05 | 松下电器产业株式会社 | 电子设备 |
US8913144B2 (en) | 2012-12-27 | 2014-12-16 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US9608725B2 (en) | 2012-12-27 | 2017-03-28 | Panasonic Intellectual Property Corporation Of America | Information processing program, reception program, and information processing apparatus |
US10951310B2 (en) | 2012-12-27 | 2021-03-16 | Panasonic Intellectual Property Corporation Of America | Communication method, communication device, and transmitter |
MX343578B (es) | 2012-12-27 | 2016-11-10 | Panasonic Ip Corp America | Metodo de comunicacion de informacion. |
US9608727B2 (en) | 2012-12-27 | 2017-03-28 | Panasonic Intellectual Property Corporation Of America | Switched pixel visible light transmitting method, apparatus and program |
US8922666B2 (en) | 2012-12-27 | 2014-12-30 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10523876B2 (en) | 2012-12-27 | 2019-12-31 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10303945B2 (en) | 2012-12-27 | 2019-05-28 | Panasonic Intellectual Property Corporation Of America | Display method and display apparatus |
EP2940901B1 (en) | 2012-12-27 | 2019-08-07 | Panasonic Intellectual Property Corporation of America | Display method |
US9087349B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
CN104871453B (zh) | 2012-12-27 | 2017-08-25 | 松下电器(美国)知识产权公司 | 影像显示方法和装置 |
JP2014138324A (ja) | 2013-01-17 | 2014-07-28 | Casio Comput Co Ltd | 情報提供システム、サーバシステム、端末装置、情報提供方法及びプログラム |
JP5839018B2 (ja) * | 2013-11-07 | 2016-01-06 | カシオ計算機株式会社 | 情報端末、通信システム、サーバ、通信方法及びプログラム |
JP6285954B2 (ja) * | 2013-11-21 | 2018-02-28 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | 情報通信方法 |
CN105723631B (zh) | 2013-11-22 | 2018-10-16 | 松下电器(美国)知识产权公司 | 通信方法、通信装置及记录介质 |
JP6011569B2 (ja) * | 2014-03-13 | 2016-10-19 | カシオ計算機株式会社 | 撮像装置、被写体追尾方法及びプログラム |
JP6452223B2 (ja) * | 2014-06-30 | 2019-01-16 | カシオ計算機株式会社 | 端末装置、端末制御方法及び端末制御プログラム |
JP6434724B2 (ja) * | 2014-07-01 | 2018-12-05 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | 情報通信方法 |
WO2016006152A1 (ja) * | 2014-07-11 | 2016-01-14 | パナソニックIpマネジメント株式会社 | 蓄電池パック、及び、蓄電池パックの動作方法 |
US10798428B2 (en) * | 2014-11-12 | 2020-10-06 | Sony Corporation | Method and system for providing coupon |
US9564027B2 (en) | 2015-03-24 | 2017-02-07 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Modulating brightness of optical element conveying human-discernible information to also convey machine-discernible information |
EP3343933A1 (en) * | 2015-08-24 | 2018-07-04 | Sharp Kabushiki Kaisha | Reception device, broadcast system, reception method, and program |
US9742492B2 (en) | 2015-12-30 | 2017-08-22 | Surefire Llc | Systems and methods for ad-hoc networking in an optical narrowcasting system |
CN105744079A (zh) * | 2016-04-06 | 2016-07-06 | 上海斐讯数据通信技术有限公司 | 一种自动识别电话号码的方法及系统 |
US9818269B1 (en) * | 2016-12-16 | 2017-11-14 | Ninad H. Ghodke | Status light data transmission |
US10812195B2 (en) | 2017-01-05 | 2020-10-20 | Sony Corporation | Optical communication device |
US9853740B1 (en) | 2017-06-06 | 2017-12-26 | Surefire Llc | Adaptive communications focal plane array |
US10250948B1 (en) | 2018-01-05 | 2019-04-02 | Aron Surefire, Llc | Social media with optical narrowcasting |
US10236986B1 (en) | 2018-01-05 | 2019-03-19 | Aron Surefire, Llc | Systems and methods for tiling free space optical transmissions |
US10473439B2 (en) | 2018-01-05 | 2019-11-12 | Aron Surefire, Llc | Gaming systems and methods using optical narrowcasting |
EP3928443B1 (en) | 2019-02-18 | 2022-10-12 | Signify Holding B.V. | Method and system for communicating via light signals |
JP2021131234A (ja) * | 2020-02-18 | 2021-09-09 | 富士フイルムビジネスイノベーション株式会社 | 発光装置およびプログラム |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07307891A (ja) * | 1994-05-11 | 1995-11-21 | Fuji Photo Film Co Ltd | ビデオカメラの手振れ補正装置 |
JPH10200810A (ja) * | 1997-01-10 | 1998-07-31 | Sony Corp | 画像駆動装置 |
JP2001119611A (ja) * | 1999-10-19 | 2001-04-27 | Matsushita Electric Ind Co Ltd | 電子カメラ |
JP2003179556A (ja) * | 2001-09-21 | 2003-06-27 | Casio Comput Co Ltd | 情報伝送方式、情報伝送システム、撮像装置、および、情報伝送方法 |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6437544A (en) * | 1987-08-03 | 1989-02-08 | Konishiroku Photo Ind | Camera with television |
US5706049A (en) * | 1995-11-30 | 1998-01-06 | Eastman Kodak Company | Camera that records an active image area identifier with an image |
US7092012B2 (en) * | 1996-11-15 | 2006-08-15 | Canon Kabushiki Kaisha | Image processing apparatus and method, storage medium, and communication system |
JP3374175B2 (ja) * | 2000-01-27 | 2003-02-04 | 名古屋大学長 | 位置表示用データ送信機能付きデータ送信装置、(以下[発明の名称の続き]欄に記載) |
JP3750132B2 (ja) * | 2000-03-01 | 2006-03-01 | カシオ計算機株式会社 | 撮像装置 |
JP4236372B2 (ja) * | 2000-09-25 | 2009-03-11 | インターナショナル・ビジネス・マシーンズ・コーポレーション | 空間情報利用システムおよびサーバシステム |
US6999112B2 (en) * | 2001-10-31 | 2006-02-14 | Hewlett-Packard Development Company, L.P. | System and method for communicating content information to an image capture device |
JP2003323239A (ja) * | 2002-05-08 | 2003-11-14 | Sony Corp | 情報処理装置及び情報処理方法、記憶媒体、並びにコンピュータ・プログラム |
JP4110514B2 (ja) * | 2002-05-15 | 2008-07-02 | ソニー株式会社 | データ符号化装置及び方法、データ復号化装置及び方法、データ送信装置、データ受信装置、記憶媒体、並びにコンピュータ・プログラム |
JP2004048674A (ja) * | 2002-05-24 | 2004-02-12 | Olympus Corp | 視野一致型情報呈示システム、並びに、それに用いられる携帯情報端末及びサーバ |
EP1858179A1 (en) * | 2002-10-24 | 2007-11-21 | Nakagawa Laboratories, Inc. | Illumination light communication device |
US20060256007A1 (en) * | 2005-05-13 | 2006-11-16 | Outland Research, Llc | Triangulation method and apparatus for targeting and accessing spatially associated information |
-
2005
- 2005-05-30 KR KR1020067006191A patent/KR100818392B1/ko not_active IP Right Cessation
- 2005-05-30 WO PCT/JP2005/010290 patent/WO2005117304A1/ja not_active Application Discontinuation
- 2005-05-30 EP EP05745839.0A patent/EP1744475B1/en not_active Ceased
- 2005-05-30 JP JP2005157048A patent/JP4258491B2/ja not_active Expired - Fee Related
-
2006
- 2006-05-16 US US11/435,229 patent/US7308194B2/en not_active Expired - Fee Related
-
2007
- 2007-03-12 HK HK07102656.4A patent/HK1095219A1/xx not_active IP Right Cessation
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07307891A (ja) * | 1994-05-11 | 1995-11-21 | Fuji Photo Film Co Ltd | ビデオカメラの手振れ補正装置 |
JPH10200810A (ja) * | 1997-01-10 | 1998-07-31 | Sony Corp | 画像駆動装置 |
JP2001119611A (ja) * | 1999-10-19 | 2001-04-27 | Matsushita Electric Ind Co Ltd | 電子カメラ |
JP2003179556A (ja) * | 2001-09-21 | 2003-06-27 | Casio Comput Co Ltd | 情報伝送方式、情報伝送システム、撮像装置、および、情報伝送方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP1744475A4 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022045080A1 (ja) * | 2020-08-24 | 2022-03-03 | ソフトバンク株式会社 | 光通信によるデジタルサイネージ及びled照明を利用したサプリメンタルダウンリンク装置と方法 |
JP2022036740A (ja) * | 2020-08-24 | 2022-03-08 | ソフトバンク株式会社 | 光通信によるデジタルサイネージ及びled照明を利用したサプリメンタルダウンリンク装置と方法 |
JP7084967B2 (ja) | 2020-08-24 | 2022-06-15 | ソフトバンク株式会社 | 光通信によるデジタルサイネージ及びled照明を利用したサプリメンタルダウンリンク装置と方法 |
US11974078B2 (en) | 2020-08-24 | 2024-04-30 | Softbank Corp. | Digital signage by optical communication and supplemental downlink device and method using LED illumination |
Also Published As
Publication number | Publication date |
---|---|
KR100818392B1 (ko) | 2008-04-02 |
HK1095219A1 (en) | 2007-04-27 |
JP2006020294A (ja) | 2006-01-19 |
EP1744475B1 (en) | 2017-07-26 |
KR20060056409A (ko) | 2006-05-24 |
JP4258491B2 (ja) | 2009-04-30 |
US7308194B2 (en) | 2007-12-11 |
US20060239675A1 (en) | 2006-10-26 |
EP1744475A4 (en) | 2013-05-08 |
EP1744475A1 (en) | 2007-01-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2005117304A1 (ja) | 情報受信装置、情報伝送システム及び情報受信方法 | |
US9438806B2 (en) | Photographing apparatus and photographing method for displaying combined avatar and map information related to a subject | |
KR100696351B1 (ko) | 합초 상태 표시 장치 | |
US8675096B2 (en) | Image capturing device for setting one or more setting values for an imaging mechanism based on acquired sound data that includes information reflecting an imaging environment | |
US9252879B2 (en) | Visible light receiving method and apparatus using the same | |
JP4640483B2 (ja) | 撮像装置、及び、プログラム | |
CN101310519A (zh) | 摄像装置、显示控制方法以及程序 | |
CN101635797A (zh) | 摄像装置 | |
CN105681652A (zh) | 摄影装置和摄影装置的控制方法 | |
KR101495079B1 (ko) | 장면 정보 표시 방법 및 장치, 및 이를 이용한 디지털 촬영장치 | |
JP2012529831A (ja) | フラッシュを用いた写真撮影のためのカメラシステムおよび方法 | |
TW200826675A (en) | Image correction device, image correction method, and computer readable medium | |
JPWO2017047012A1 (ja) | 撮像装置および撮像装置とサーバとを含むシステム | |
JP6480419B2 (ja) | 可視光受信方法 | |
JP2006332774A (ja) | 端末装置 | |
JP2004120277A (ja) | 電子カメラ | |
JP2008035154A (ja) | 画像処理装置、画像処理方法、及び、画像処理プログラム | |
JP2013169003A (ja) | 表情データベース登録方法及び表情データベース登録装置 | |
JP4865631B2 (ja) | 撮像装置 | |
JP2008011346A (ja) | 撮像システム | |
JP2017123696A (ja) | 可視光受信方法 | |
JP5270744B2 (ja) | 撮像装置及び撮像方法 | |
JP5711296B2 (ja) | 撮像方法及び撮像装置 | |
JP4692931B2 (ja) | 画像処理装置、画像処理方法、及び、画像処理プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200580001018.2 Country of ref document: CN |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 1020067006191 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11435229 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 1020067006191 Country of ref document: KR |
|
WWP | Wipo information: published in national office |
Ref document number: 11435229 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2005745839 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2005745839 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 2005745839 Country of ref document: EP |