WO2005036113A1 - マルチバンドカメラの制御装置及び制御方法 - Google Patents
マルチバンドカメラの制御装置及び制御方法 Download PDFInfo
- Publication number
- WO2005036113A1 WO2005036113A1 PCT/JP2004/014845 JP2004014845W WO2005036113A1 WO 2005036113 A1 WO2005036113 A1 WO 2005036113A1 JP 2004014845 W JP2004014845 W JP 2004014845W WO 2005036113 A1 WO2005036113 A1 WO 2005036113A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- band
- band camera
- parameter
- bands
- computer
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 77
- 239000003086 colorant Substances 0.000 claims abstract description 9
- 230000008859 change Effects 0.000 claims description 52
- 230000006870 function Effects 0.000 claims description 40
- 230000004044 response Effects 0.000 claims description 6
- 238000003384 imaging method Methods 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 17
- 238000012545 processing Methods 0.000 description 14
- 238000002474 experimental method Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 11
- 230000000694 effects Effects 0.000 description 9
- 238000012937 correction Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 3
- 230000007257 malfunction Effects 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 238000013341 scale-up Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B33/00—Colour photography, other than mere exposure or projection of a colour film
- G03B33/04—Colour photography, other than mere exposure or projection of a colour film by four or more separation records
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
- G03B7/08—Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0264—Electrical interface; User interface
Definitions
- the present invention relates to a control device and a control method for controlling a multiband camera.
- a multi-band camera generally refers to a camera that captures images with a plurality of bands having more specific wavelength transmission characteristics than the R, G, and B filters of a normal three-band color camera.
- a wavelength tunable filter as disclosed in Japanese Patent Application Laid-Open No. 2001-99710 or a rotary filter as disclosed in USP 6,549,653 is used.
- a structure in which a band is formed by light emission of one or more LEDs having a narrow band spectral characteristic has been proposed.
- the transmittance characteristics of each band are as shown in FIG. 2 of, for example, JP-A-2001-99710.
- FIG. 2 of JP-A-2001-99710 discloses 16 images of 16 bands, which are shown in FIG. 5B of USP 6,549,653. With such a rotation filter, there are 10 images in 10 bands.
- a graphical user interface for selecting one of the 18 bands.
- a method of displaying and switching can be considered.
- a method in which a GUI having various setting items is displayed, and a band is switched by using, for example, a selection item of “FilterZBand” in the GUI may be considered.
- a selection item of “FilterZBand” in the GUI may be considered.
- a user who wants to shoot a multi-band image while switching bands using the latter GUI needs to set parameters that may change each time the bands are switched.
- “Shutter Speed” item can be considered as such a parameter. This is to switch and control the exposure time of the multi-band camera. Generally, since the exposure time is variable for each band, the user is required to change the exposure time every time the band is switched. I have to reset the time.
- the purpose of a multi-band camera is to respond to the need to accurately retain information on a large number of color information, such as paintings, historical sites, and people. It is desirable to adjust the setting items as strictly as possible. That is, in a multi-band camera, the setting items are generally changed independently for each band. In addition, the number of bands often exceeds 3 bands. Strict setting for each band and memorizing accurate setting values place a considerable load on the user using the multi-band camera. Become.
- the present invention has been made in view of the above points, and provides a control device and a control method of a multi-band camera that can reduce a load on a user and can more accurately and quickly shoot a multi-band image.
- the purpose is to provide.
- a control device for a multi-band camera includes:
- a multi-band camera unit that can shoot bands of multiple colors
- a user interface for transmitting instruction information for the control from a user to the computer
- a parameter for controlling a corresponding band for each of the plurality of bands, and a control device for a multi-band camera comprising:
- the user interface includes switching instruction means for switching the plurality of bands,
- the computer controls the multi-band camera unit using a parameter corresponding to a band selected in response to the switching instruction of the plurality of bands from the switching instruction unit.
- a method for controlling a multi-band camera according to another aspect of the present invention includes:
- a multi-band camera unit that can shoot bands of multiple colors
- the user interface issues a switching instruction for switching the plurality of bands
- the computer selects the band selected in response to the instruction to switch the plurality of bands.
- the multi-band camera unit is controlled using a parameter corresponding to
- a control device for a multiband camera includes:
- a combi unit configured to be connectable to a multi-band camera capable of shooting multiple color bands
- a user interface for transmitting instruction information for the control from a user to the computer
- a parameter for controlling a corresponding band for each of the plurality of bands is a parameter for controlling a corresponding band for each of the plurality of bands
- the user interface includes switching instruction means for switching the plurality of bands,
- the computer controls a multi-band camera connected to the computer using a parameter corresponding to a band selected in response to the switching instruction of the plurality of bands from the switching instruction unit.
- FIG. 1 is a diagram showing a system configuration of a control device for a multiband camera according to a first embodiment of the present invention.
- FIG. 7 is a diagram showing a flowchart in which a part of a band switching function, which is a part of a program for performing comprehensive processing, is cut out.
- FIG. 3 is a diagram showing a system configuration of a control device for a multiband camera according to a second embodiment of the present invention.
- FIG. 4 is a diagram showing another system configuration of the control device of the multi-band camera according to the second embodiment.
- FIG. 5 is a diagram showing an example of a GUI for setting a focus position and an exposure time for each band.
- FIG. 6 is a diagram showing an example of a GUI for controlling a multi-band camera.
- FIG. 7 is a diagram showing a system configuration of a control device for a multiband camera according to a third embodiment of the present invention.
- FIG. 8 is a diagram showing a system configuration of a control device for a multiband camera according to a fourth embodiment of the present invention.
- FIG. 9 is a diagram showing an example of a GUI for controlling a multi-band camera in which a key icon is in a “key closed state”.
- FIG. 10 is a diagram showing a system configuration of a control device for a multiband camera according to a fifth embodiment of the present invention.
- FIG. 11 is a diagram showing a system configuration of a control device for a multiband camera according to a sixth embodiment of the present invention.
- FIG. 12 is a diagram showing a system configuration of a control device for a multiband camera according to a seventh embodiment of the present invention.
- FIG. 13 is a diagram showing an example of a GUI for controlling a multi-band camera as an example of a range determination pass / fail output screen.
- FIG. 14 is a diagram showing a system configuration of a control device for a multiband camera according to an eighth embodiment of the present invention.
- FIG. 15 is a diagram showing an ID input screen.
- FIG. 16 is a diagram showing a system configuration of a control device for a multiband camera according to a ninth embodiment of the present invention.
- the multiband camera 10 is controlled by a computer 21.
- the multi-band camera 10 has a built-in CCD which is an image sensor, and sends image data to a computer 21 by taking an image and converting it into electronic data.
- Various settings must be made in the multiband camera 10 in order to obtain an image intended by the user. For example, consider settings such as exposure time (shutter speed), aperture, and focus position. available. The user changes the above parameter settings while checking the live (raw) image transmitted from the multi-band camera 10 on a display (not shown) attached to the computer 21.
- the multi-band camera 10 has a plurality of bands, and that the parameters be set independently. Therefore, when controlling, the parameter 22 is held in the memory associated with the computer 21. This parameter is held independently for each band.
- the stored parameters 22 can be stored in the parameter storage unit 23 as needed, or can be stored and read out.
- the computer 21 (and the parameter 22 and the parameter storage unit 23) may be provided integrally in the multiband camera 10.
- a personal computer is used as the computer 21 and the multiband camera 10 is connected to the multiband camera 10 via an interface such as a USB to acquire image data from the multiband camera 10 or to connect to the multiband camera 10. It may be configured to transmit necessary control signals.
- the parameter storage unit 23 is often a hard disk drive (HDD).
- this flowchart is a part of a program that is executed by the computer 21 and performs comprehensive processing such as image acquisition, live image confirmation, and post-processing when the multi-band camera 10 is used. Some of the switching functions have been cut out.
- This band switching request may be given by a user designation by a user interface as described later, or may be given by a user operation of a predetermined switching switch of the multi-band camera 10. I don't know.
- the band is switched (step S12).
- the actual band switching method differs depending on the type of the multi-band camera 10. For example, when using a rotation filter as disclosed in the above-mentioned USP 6,549,653, that is, when switching is performed using a narrow band-pass filter having a wavelength, the filter rotation unit is switched. A control signal for rotation is transmitted to the multi-band camera 10.
- the parameter 22 is retrieved from the parameter storage unit 23, and it is determined whether or not the parameter 22 controls the multi-band camera 10 (step S13). Note that, depending on the system, it is not necessary to depend on the information in the parameter storage unit 23, and the computer 21 may make its own judgment. Alternatively, the setting process based on the parameter 22 is always performed, and the determination process in step S13 may be omitted.
- the multi-band camera 10 is controlled by the parameter 22, the multi-band camera 10 is controlled according to the parameter (step S14).
- the parameter 22 may be moved from the parameter storage unit 23 to a temporary memory or the like of the computer before band switching or at another timing.
- step S14 or if it is determined in step S13 that the multi-band camera 10 is not controlled by the parameter 22, the process returns to step S11 and waits for the next band switching.
- step S12 if either or both of them have a long processing time, the two can be controlled simultaneously. May be.
- the process in step S12 is an asynchronous process, and programming may be performed so as to proceed to steps S13 and S14 even if the operation is not completed immediately after sending the band switching command.
- the system configuration depends on the type of the multiband camera 10, the computer 21, and the storage medium at that time. Therefore, the multiband camera 10 itself may not have a CCD element. In addition, there is separation of automatic control from the computer 21 and manual control from the user. Therefore, the parameters for each band are not always the exposure time (shutter speed), aperture, and focus position, and some or all of them may not be applicable. Depending on the camera, other setting items may not be applicable. May be necessary. Therefore, the power that a new setting item not listed here may enter may be considered as the scope of the present invention if it is the same as that in FIG.
- the computer 21 displays the set value on the display device, and the user can confirm and set the value. If the multiband camera 10 has display means, the computer 21 may send the parameter information to the multiband camera 10, and the user may check and make settings there.
- the parameter 22 is a content that is held independently for each band in principle. However, parameters common to some or all bands may be held for each band or in one place. In such a case, if these parameters should be processed at the timing of band switching in the flowchart of FIG. 2, it may be performed as part of band-specific control using the parameters in step S14.
- step S12 and the processing in steps S13 and S13 are performed.
- the order of the processing in S14 may be reversed.
- the method of determining the nometer 22 is such that the image actually output from the multi-band camera 10 is not shown live (raw)! It is determined while checking it on the display, and the value is stored in the parameter storage unit 23. It is common to save them. Of course, different methods are conceivable. For example, when the exposure time is calculated or the focal position is physically determined, it may not be necessary to confirm those images by writing those values directly into the parameter storage unit 23. In any case, if the parameter 22 is stored as text data such as comma-separated or tab-delimited, even if the computer 21 accesses it, the user or the manufacturer can directly confirm or edit it with a text editor. It is convenient.
- the detailed setting unique to the band of the multi-band camera 10 can be performed in each band. it can. Also, the user does not need to memorize some or all of the parameters that are good enough to concentrate on switching bands. In addition, since it is possible to omit the time for obtaining an appropriate parameter at the time of band switching, there is an effect that a user's labor is saved and a multi-band image is accurately captured or controlled in a short time.
- the multi-band camera 10 can be disassembled into a multi-band camera body 11 and a focus control unit 12, as shown in FIG. Alternatively, as shown in FIG. 4, it can be disassembled into a multi-band camera body 11 and an exposure control unit 13. Thus, either one of the focus control unit 12 and the exposure control unit 13 may be used, or both may be mounted on the multi-band camera 10.
- the multi-band camera 10 also has other functions, which may be controlled by the parameters.
- the parameter 22 includes focus information 22A and Z or exposure information 22B. Since the user wants to set the focal position and the exposure time for each band, for example, the values are set for each band using a GUI as shown in FIG. In the example of FIG. 5, the number of bands is 6, and the focus position, exposure time, and aperture information are set for each band. The setting may be made without looking at the image, but usually, the live (raw) image sent from the multiband camera 10 is checked on the display (not shown) attached to the computer 21. While setting these three parameters for all six bands.
- the parameters 22 are held in a memory associated with the computer 21.
- the parameters 22 focus information 22A and Z or exposure information 22B
- the parameters 22 are held in a memory associated with the computer 21.
- this task monitors whether there is a band switching request (step Sl). If there is a request, the band is switched (step S12).
- step S13 the focal position (focus information 22A) and the Z or exposure time (exposure information 22B) are extracted from the parameter storage unit 23 (focus information storage units 23A and Z or the exposure information storage unit 23B).
- the parameter storage unit 23 focus information storage units 23A and Z or the exposure information storage unit 23B.
- step S 14 the focus position and the Z or exposure time are read from the parameter storage unit 23, and the focus control unit 12 and the Z or the exposure control unit 13 of the multi-band camera 10 are controlled according to the values. .
- the focal position, the Z or the exposure time may be moved from the parameter storage unit 23 to a temporary memory or the like of the computer 21 before band switching or at another timing.
- step S12 In the band switching in step S12 and the band-specific control in step S14, if either or both of them have a long processing time, the two can be controlled simultaneously. May be.
- the process in step S12 is an asynchronous process, and programming may be performed so as to proceed to steps S13 and S14 even if the operation is not completed immediately after sending the band switching command.
- the user may manually set the focal point by turning the lens. An implementation method in this case will be described.
- the camera has a lens housing, which is manually turned to focus. Also, if the shortest focal length is approximately 0.5m, but roughly, here, the setting scale up to ⁇ is attached. In this case, the user turns the lens housing by hand while watching the image during live display to adjust the position to the optimum focus. After completing the setting, read the scale value and write the value to the focus position in the GUI in Fig. 5. Do this for all bands.
- the value may be stored in the focus information storage unit 23A.
- step S14 based on the focus information 22A stored in the focus information storage unit 23A on the screen of the computer 21, FIG. Display a GUI like The user only has to read the set focal point written on the band, and adjust the focal point while looking at the scale attached to the camera lens.
- the exposure time (exposure information 22B) and the aperture value can be controlled in a similar manner, even if manual control is performed.
- the focal position is set to an independent value for each band of the multi-band camera.
- Focus information 22A and Z or exposure time can be set. Also, the user can reproduce the correct focus position and Z or exposure time simply by switching the band, and does not need to be conscious of the value. In addition, the time required for finding an appropriate focal position and Z or exposure time when switching bands can be omitted, which saves the user's labor and has the effect of accurately capturing or controlling multiband images in a short time.
- FIG. 6 shows an example of a GUI for controlling the multiband camera 10.
- the “Active Window” change list 101 is used to select an active window to be displayed at the top when a plurality of images are displayed.
- the “FilterZBand” change list 102 is for selecting a band.
- the “Shutter Speed” change list 103 is for setting and confirming the exposure time for each band.
- an exposure time suitable for the band is set in the “Shutter Speed” change list 103.
- use the “Auto Exposure” button 104 below to automatically set the exposure time for all or some of the bands.
- FIG. 7 is a diagram showing a system configuration of a control device for a multi-band camera according to the third embodiment.
- a multiband camera 10 there are a multiband camera 10, a computer 21, parameters 22, and a parameter storage unit 23.
- the GUI shown in Fig. 6 is displayed on this parameter input / output screen 24, and the “Auto Exposure button 104, the“ Capture ”button 105, the“ Shutter Speed ”change list 103, and other GUIs are displayed. You can achieve that goal.
- a use number counting unit 25 realized by a program of the computer 21, and can count the number of times of accessing a GUI item of interest.
- the number of presses of the “Auto Exposure button 104 and the“ Capture ”button 105 is counted, and the number is stored in the use count storage unit 26.
- the screen control unit 27 works on the parameter input / output screen 24 using the method described below to change the visual effect of the GUI of interest.
- the visual effects refer to changes in size, emphasized characters, colors, shapes, blinking states, and the like.
- it is assumed that the size of the “Auto Exposure button 104 and the button of the“ Capture ”button 105 are changed in accordance with the number of times the button is pressed.
- FIG. 6 is a GUI for changing settings while viewing a live image. After confirming the exposure time, the user captures all bands. As described above, the exposure time can be adjusted manually for each band, but can also be automatically adjusted for all bands by pressing the "Auto Exposure" button 104.
- the “Capture” button 105 is pressed each time a picture is taken. Therefore, it is preferable to display the “Capture” button 105 larger than the “Auto Exposure button 104” as shown in Fig. 6. The method is described below.
- the width aW and height aH of the “Auto ExposureJ button 104 are determined as follows:
- the sizes of the “Capture” button 105 and the “Auto Exposure button 104” are obtained.
- the size is determined in an allowable range, that is, a minimum width and a height and a maximum width and a height are determined. If you exceed the range, return it to the range so that the button does not become larger or smaller than necessary.
- the size of the button does not have to be changed every rotation every time the software is started. For example, before shipping to the end user, the software development maker experimentally determines the button usage frequency by the method described above, and according to that frequency, the size of the button is fixed and the size of the button is relatively changed in shipping It is also possible to keep it.
- the button can be used for an autofocus function that requires band parameters.
- FIG. 6 shows an example of a GUI for controlling the multiband camera 10.
- the description from the “Active Window” change list 101 to the “Auto Exposure button 104” is as described in the third embodiment above, below which there are “ShiftX” and “ShiftY”. It has a function to shift pixels in the direction and y-axis direction. Numerical values can be entered in the edit boxes (white frames) 106 and 107 on the right side. Pixels are shifted by one pixel by entering an integer. Although not shown here, for example, a method using sub-pixels in units of 0.1 pixels may be used as the pixel shift.
- the multi-band camera 10 performs imaging by changing the center wavelength and the band for each band. If an optical system switching member such as a band-pass filter is used as a means, the image may shift in the plane direction perpendicular to the optical axis due to a slight difference in the optical path each time the filter is changed. . Assuming that the coordinate axes of the surface are X and y, a method of correcting the shift between the bands by shifting the pixels can be considered. In addition, the fact that the center wavelength is different for each band may indicate that the magnification of the target image is slightly shifted, and a target portion in the image may be shifted for each band. To correct this, adjust the pixels in each band while shifting them in the X-axis and y-axis directions.
- an optical system switching member such as a band-pass filter
- the pixel shift described above is highly likely to be caused by the optical system. Even when used by an end user, the number of bands of the multiband camera 10 is determined, and if the wavelength switching means is determined, the pixel shift amount is also determined. It is highly likely that Therefore, it is essential for the end user to correct the pixel shift in the settings of these devices. If the number of bands and the wavelength selection means are fixed once, it is not necessary to perform this correction each time imaging is performed. On the other hand, the exposure time and the focal position described in the third embodiment are likely to be changed each time shooting is performed. In this embodiment, a procedure for solving such a demand by a method different from that of the third embodiment will be described. As shown in FIG.
- the control device for a multi-band camera includes a multi-band camera 10, a computer 21, parameters 22, and a parameter storage unit 23 as in FIG.
- a parameter input / output screen 24 is provided, and a timing for confirming and setting the parameter 22 can be input.
- the GUI shown in Fig. 6 is displayed here, and there are a “ShiftX” function, a “ShiftY” function, and a pixel shift amount setting lock function described later.
- the key icon 108 Click to change the key icon 108 to “the key is closed” as shown in FIG.
- the visibility is improved by keeping the state of pressing the button of the key icon 108 in the “key closed state”.
- the pixel shift amount already set cannot be changed, but since the set value itself is valid, the pixel shift Perform the shift.
- the key icon 108 is always switched to “key open / open state” / “key open / open state”. Is open ”.
- the multi-band camera 10, the computer 21, the parameter 22, and the parameter storage unit 23 in the control device for the multi-band camera according to the fifth embodiment of the present invention are the same as those in FIG.
- It has a parameter storage section "n". Note that n is an integer of 2 or more, and the maximum number depends on the system and user requirements.
- a parameter selection unit 28 is provided to perform these selections.
- a user using the software for controlling the multiband camera 10 selects which parameter set is better when the software is started or when the nomometer 22 is used.
- the user is allowed to select the parameter as a parameter storage unit 23, the parameter storage unit "2" 23-2, the parameter storage unit "3" 23-3,...
- the selected parameter can be replaced with the parameter 22, after the selection, the target processing can be achieved in the same flow as in the first embodiment.
- the user may change part or all of the parameter 22. If the changed parameters are not reused, the program for controlling the multiband camera 10 may be terminated. When reusing the program, immediately before changing the The parameter 22 may be stored in the parameter storage unit 23 at some point immediately before the end. If the existing saved location is overwritten, it can be regarded as a change of the parameter set. If a new save is performed, the number of saved parameter sets in the parameter storage unit can be increased accordingly. .
- a plurality of sets of parameters are stored, and the user can select the parameters, so that the band-specific fineness and setting of the multi-band camera 10 can be performed in each band, and However, even when there are multiple parameters, a set of parameters can be regarded as one set and can be changed in sets. By freely selecting the stored parameter set, the user has the effect of making accurate settings for each complex band in a short time.
- the exposure information storage unit 23B is the same as FIG. 4 described in the second embodiment.
- the multi-band camera control program operated on the computer 21 has a function 29 for obtaining a change amount of exposure information and a function 30 for changing exposure information of another band.
- the function 29 for obtaining the change amount of the exposure information is a function of performing relative comparison of the exposure information 22B between the respective bands and calculating the change amount.
- the function 30 for changing the exposure information of the other bands is performed in advance by changing the exposure information 22B of the remaining bands while referring to the change amount obtained in the function 29 for calculating the change amount of the exposure information.
- Rewrite 22B The rewritten exposure information 22B is transmitted by the computer 21 to the exposure control unit 13 of the multi-band camera 10, so that the value set in the multi-band camera 10 can be rewritten.
- the multiband camera 10 has four bands.
- the user sets an appropriate exposure time for each band.
- a reference image for obtaining a standard spectral reflectance such as a standard white plate as a subject for which an exposure time is set is suitable.
- the function 29 for obtaining the change amount of the exposure information holds the ratio of the exposure time between the bands as ⁇ 1Z2, 1, 1/4, 1Z8 ⁇ .
- band 4 is in the selected state. If an appropriate exposure time is set at this time, it is assumed that 1Z120 is reached. At this time, referring to the exposure time ratio ⁇ 1Z2, 1, 1/4, 1Z8 ⁇ set earlier, a new exposure time is obtained by the function 30 for changing the exposure information of other bands, and ⁇ 1/30, 1 / 15, 1/60, 1/120 ⁇ .
- the band can be switched in step S11 up to 114.
- the band is switched in step S12, and the band is switched in step S14.
- To change the exposure time every time refer to ⁇ 1Z30, 1/15, 1/60, 1Z120 ⁇ obtained as above, and if it is switching to band 1, 1Z30 and band 2
- the exposure time can be changed, such as 1Z15.
- the ratio between the bands is calculated from the exposure time once set and stored, and the exposure time of one band of interest in a new photographing is changed to obtain the entire band. Exposure time can be set correctly. Since there is no need for the user to recalculate the exposure time for all bands every time the brightness of the light source and the subject are changed, there is an effect that parameters such as the exposure time until shooting are accurately set in a short time.
- the multi-band camera 10 is divided into a multi-band camera main body 11, an exposure control unit 13, and a photographing unit 14.
- the imaging unit 14 converts an image captured by the multi-band camera body 11 into an image signal such as an electric signal that can be recognized by the computer 21 and outputs the image signal.
- the multi-band camera control program that operates on the computer 21 has an image luminance information acquisition function 31 and converts the image signal digitized by the imaging unit 14 of the multi-band camera 10 into pixel-by-pixel luminance ( Signal strength). Further, the program has a luminance information range determination function 32, and determines whether the luminance falls within a given range. The judgment result is displayed on the range judgment pass / fail output screen 33 and the result is displayed to the user. Inform.
- the multiband camera 10 has 18 bands.
- the image is output to a display attached to the computer 21.
- the luminance is output in the range of O-255 as the output of Red, Green, and Blue.
- (Red, Green, Blue) (0, 0, 0) is black, and (255, 255, 255) is white, and the intermediate color is expressed. Since Red, Green, and Blue are independent, (255, 0, 0) indicates red, and (0, 255, 0) indicates that green can be displayed.
- the display colors are reproduced in 256 * 256 * 256 combinations, such as (0, 255, 255) representing yellow.
- the imaging unit 14 includes an imaging element and an AZD converter (not shown).
- the imaging element converts a video signal into an electric signal, and then converts the video signal into a digital signal value using the AZD converter.
- the A / D converter has a resolution of 8 bits, 10 bits, 12 bits, 16 bits, etc. Here, it is assumed that a 16-bit resolution is used. In that case, each pixel is converted into 16-bit data, which is recognized by the image luminance information acquisition function 31. When displaying, this data must be within the range of 0 to 255 so that it can be represented by the above 256 display colors.
- the simplest method of converting 16-bit data into 256 gradations, that is, 8-bit gradation, is to regard only the upper 8 bits of 16-bit data as 8 bit gradations. That is, the upper 8 bits of 16 bits are used as 8 bit data for display, and the lower 8 bits of the 16 bit data are discarded.
- the value is rounded to a value exceeding 65280 (hexadecimal FF00), that is, 65281 (hexadecimal FF01)-65535 (16itOFFFF) 255 (hexadecimal FF).
- 65280 hexadecimal FF00
- 65281 hexadecimal FF01-65535
- (16itOFFFF) 255
- hexadecimal FF hexadecimal FF
- the range judgment pass / fail output screen 33 in the case of an image of 118 bands, for example, when the band 17 is overexposed, the number 17 indicating the band is indicated by a white background with a red background.
- An overexposed band is represented by highlighting 110, such as by displaying it in characters.
- the brightness information range determination function 32 exposes the exposure under on the screen of FIG. 13 in another expression as 1000 or less data obtained by the brightness information acquisition function 31 of the image. An under status can also be displayed.
- the over-exposure and under-exposure thresholds are set in the range of the luminance information according to the manufacturer that provides the multi-band camera 10 and the user who uses it, such as setting the overexposure to 60,000 or more without being caught by the AZD converter bit expression. It can be set in the judgment function 32.
- a threshold value is set, and an on / under of the exposure time is obtained by the determination, and is displayed on a screen. At a glance, the exposure time for all the bands is correctly set. You can check. Since the user does not need to check the exposure time over and under for each band one by one, there is an effect that the parameters of the exposure time until the photographing are accurately set in a short time.
- the control device for a multi-band camera includes an ID input / output management unit 34.
- the ID input / output management unit 34 associates an ID input by the user with a plurality of parameter sets stored in the parameter storage unit 23.
- the user of the software that controls the multi-band camera 10 must have a unique parameter at least once at the start of the software or before or after saving the nomometer 22. Enter the ID (Identification) to distinguish between Figure 15 is used for the input screen.
- an identification number such as the name of the user is input as the “user ID”.
- a “password” can be entered to protect the parameter when it concerns sensitive user information. Of course, this "password” may be omitted depending on the purpose.
- the parameter selection unit 28 searches the parameter storage unit 23 for the user ID, updates the parameter if there is a saved example in the past, and updates the parameter set if there is no saved example. Create with. If the user wants to set another parameter set, it can be switched again by inputting the user ID shown in Fig. 15.
- the user ID is input twice when reading the existing one and when saving it, for example, when new or changed, and the user is required to control the multiband camera 10. If the parameter set is not changed until the software is started and the process ends, the input on the screen shown in Fig. 15 can be made only when the software is started, and these two operations can be omitted once.
- the parameter set does not have to be a user unit.
- the user it is possible to arbitrarily set the user as a unit having a certain unit, such as a target subject unit, an experiment project unit, an experiment classroom unit, and an experiment date unit.
- the band-specific fineness and settings of the multi-band camera 10 can be set for each band, and However, even when there are multiple parameters, a set of parameters can be regarded as one set and can be changed in sets.
- the meaning of the ID can be determined arbitrarily by the user, such as the name of the individual, the name of the experiment, the date and time of the experiment, and the parameter set can be used on a one-to-one basis or one-to-many basis. The user can freely select these uniquely determined parameter sets, which has the effect of making complex band-specific settings accurately in a short time.
- a control device for a multi-band camera according to a ninth embodiment of the present invention is shown.
- the multiband camera 10, the computer 21, the parameter 22, the parameter storage unit 23, the parameter selection unit 28, and the ID input / output management unit 34 are the same as those in FIG. 14, and are as described in the eighth embodiment.
- the control device for the multi-band camera according to the present embodiment has an OS login function 35.
- the ID input / output management unit 34 obtains the OS (operating system) login information, rather than inputting the user power D on the ID input screen or the like, and assigns the login ID to the multiband camera 10.
- the parameter set is regarded as the ID of the program to be controlled, and a plurality of parameter sets stored in the parameter storage unit 23 are associated with each other.
- the computer 21 is a personal computer that satisfies the conditions for operating a Windows (R) 2000 and an operating system (OS), and the personal computer is turned on. After a while, the OS starts up and a login is required. If you do not log in here, the user cannot use the personal computer through the OS. After login, the user activates the software for controlling the multiband camera 10.
- This ID can be regarded as the user input of the ID described in the eighth embodiment by the ID input / output management unit 34 querying the OS login function 35 to access the parameter 22. You.
- the parameter selection unit 28 retrieves the user ID from the parameter storage unit 23, updates the parameter if there is a saved example in the past, and newly sets the parameter set otherwise. create.
- the OS login ID described in the above procedure means a user's individual ID, and corresponds to a parameter set switching method by setting the parameter storage unit 23 for an individual user.
- the set of force parameters need not be per user.
- the user can arbitrarily set a unit such as a target subject, an experiment project unit, an experiment classroom unit, and an experiment date unit. Therefore, the OS login is not necessarily limited to the login intended for the user's individual ID, and IDs such as subject units, experiment project units, experiment classroom units, experiment date units, etc., are registered in the OS. To access the required parameters in this unit You may be aware that this is a login operation.
- the meaning of the ID can be determined arbitrarily by the user, such as the name of the individual, the name of the experiment, and the date and time of the experiment.
- this ID is associated with the ID of the OS login, it is not only possible to use the software that controls the multi-band camera 10 for each OS login unit, and that the ID is not It is also possible to operate the software by controlling the multi-band camera 10 in association with the software while controlling the environment such as the desktop environment, e-mail, and Internet browser provided by the user. Therefore, the user can freely select these independently determined nomometer sets, which has the effect of making complex band-specific settings quickly and accurately.
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP04792142A EP1672339A4 (en) | 2003-10-07 | 2004-10-07 | MULTI-BAND CAMERA CONTROL DEVICE AND MULTI-BELT CAMERA CONTROL PROCEDURE |
US11/397,971 US7768560B2 (en) | 2003-10-07 | 2006-04-05 | multiband camera control apparatus and multiband camera control method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2003-348622 | 2003-10-07 | ||
JP2003348622A JP4112469B2 (ja) | 2003-10-07 | 2003-10-07 | マルチバンドカメラの制御装置及び制御方法 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/397,971 Continuation US7768560B2 (en) | 2003-10-07 | 2006-04-05 | multiband camera control apparatus and multiband camera control method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005036113A1 true WO2005036113A1 (ja) | 2005-04-21 |
Family
ID=34430972
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2004/014845 WO2005036113A1 (ja) | 2003-10-07 | 2004-10-07 | マルチバンドカメラの制御装置及び制御方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US7768560B2 (ja) |
EP (1) | EP1672339A4 (ja) |
JP (1) | JP4112469B2 (ja) |
WO (1) | WO2005036113A1 (ja) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8587681B2 (en) * | 2008-11-21 | 2013-11-19 | Omnivision Technologies, Inc. | Extended depth of field for image sensor |
JP5185151B2 (ja) * | 2009-02-09 | 2013-04-17 | オリンパス株式会社 | 顕微鏡観察システム |
JP5546166B2 (ja) * | 2009-06-19 | 2014-07-09 | キヤノン株式会社 | 撮像装置、信号処理方法、及びプログラム |
KR101632748B1 (ko) * | 2009-09-24 | 2016-07-04 | 삼성전자주식회사 | 맞춤형 원격 사용자 인터페이스 페이지를 제공하기 위한 장치 및 방법 |
JP5475057B2 (ja) * | 2012-04-20 | 2014-04-16 | 株式会社 オフィス・カラーサイエンス | 変角分光イメージング測定方法およびその装置 |
US9219866B2 (en) * | 2013-01-07 | 2015-12-22 | Ricoh Co., Ltd. | Dynamic adjustment of multimode lightfield imaging system using exposure condition and filter position |
US20150042758A1 (en) * | 2013-08-09 | 2015-02-12 | Makerbot Industries, Llc | Laser scanning systems and methods |
US9813601B2 (en) * | 2014-05-06 | 2017-11-07 | Urugus S.A. | Imaging device for scenes in apparent motion |
JP6448334B2 (ja) * | 2014-12-02 | 2019-01-09 | キヤノン株式会社 | 表示制御装置及び表示制御装置の制御方法 |
JP7126936B2 (ja) | 2018-12-20 | 2022-08-29 | 矢崎総業株式会社 | 金属端子、及び、端子付き電線 |
KR102598764B1 (ko) * | 2023-06-26 | 2023-11-06 | 주식회사 큐리오시스 | 교정용 테이블을 이용하여 이미지의 밝기를 보정하는미세입자 계수 장치 및 방법 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS559153A (en) * | 1978-07-05 | 1980-01-23 | Nec Corp | Multi-band photographic device |
JPH04172789A (ja) * | 1990-11-07 | 1992-06-19 | Canon Inc | 撮像装置 |
JPH05183916A (ja) * | 1991-06-10 | 1993-07-23 | Eastman Kodak Co | イメージセンサの位置合わせシステム及び位置合わせ方法 |
JPH068897A (ja) * | 1992-06-25 | 1994-01-18 | Nec Corp | 宇宙航行体搭載撮像装置 |
JP2000196965A (ja) * | 1998-12-28 | 2000-07-14 | Fuji Photo Film Co Ltd | Ccd撮像デバイス及びその駆動方法、並びにフイルムスキャナ― |
JP2001005046A (ja) * | 1999-06-23 | 2001-01-12 | Fuji Photo Film Co Ltd | マルチバンドカメラ |
JP2002112101A (ja) * | 2000-09-28 | 2002-04-12 | Canon Inc | デジタルカメラおよびプリントシステム |
JP2004147287A (ja) * | 2002-08-30 | 2004-05-20 | Fuji Photo Film Co Ltd | マルチバンド画像撮影方法及び装置及びプログラム |
Family Cites Families (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0534202A (ja) | 1991-07-30 | 1993-02-09 | Juki Corp | 色差表示装置 |
JPH06241905A (ja) | 1993-02-22 | 1994-09-02 | Takenaka Syst Kiki Kk | 色判定装置 |
US5640468A (en) | 1994-04-28 | 1997-06-17 | Hsu; Shin-Yi | Method for identifying objects and features in an image |
JPH08233658A (ja) | 1995-02-24 | 1996-09-13 | Olympus Optical Co Ltd | 分光装置及び分光画像記録装置 |
US6404920B1 (en) | 1996-09-09 | 2002-06-11 | Hsu Shin-Yi | System for generalizing objects and features in an image |
US7212229B2 (en) * | 1997-04-04 | 2007-05-01 | Eastman Kodak Company | Digital camera providing image processing for an attachable printer |
US6111692A (en) * | 1997-07-28 | 2000-08-29 | Litton Systems, Inc. | Multi-function day/night observation, ranging, and sighting device and method of its operation |
JPH1196333A (ja) | 1997-09-16 | 1999-04-09 | Olympus Optical Co Ltd | カラー画像処理装置 |
JP3483108B2 (ja) | 1997-11-25 | 2004-01-06 | 株式会社日立製作所 | 多スペクトル画像処理装置およびそのためのプログラムを記録した記録媒体 |
US6256409B1 (en) | 1998-10-19 | 2001-07-03 | Sony Corporation | Method for determining a correlation between images using multi-element image descriptors |
US6211971B1 (en) | 1999-03-11 | 2001-04-03 | Lockheed Martin Missiles & Space Co. | Method and apparatus to compress multi-spectral images to a single color image for display |
JP2000329617A (ja) | 1999-03-18 | 2000-11-30 | Minolta Co Ltd | 分光画像入力システム |
US6307586B1 (en) | 1999-07-20 | 2001-10-23 | Intevac, Inc. | Electron bombarded active pixel sensor camera incorporating gain control |
JP3819187B2 (ja) | 1999-09-28 | 2006-09-06 | 富士写真フイルム株式会社 | マルチバンド画像の分光反射率のスペクトル推定方法およびスペクトル推定システム |
US6477326B1 (en) * | 2000-08-31 | 2002-11-05 | Recon/Optical, Inc. | Dual band framing reconnaissance camera |
JP2002149148A (ja) | 2000-11-08 | 2002-05-24 | Telecommunication Advancement Organization Of Japan | 色再現システム |
US6912322B2 (en) | 2000-12-14 | 2005-06-28 | Itt Manufacturing Enterprises Inc. | Adaptive process for removing streaks in multi-band digital images |
FI113132B (fi) * | 2001-06-28 | 2004-02-27 | Nokia Corp | Menetelmä ja laite kuvanparannukseen |
US8161144B2 (en) | 2001-08-15 | 2012-04-17 | National Instruments Corporation | Defining a switch device route based on required signal characteristics and resource dependencies |
JP4174703B2 (ja) | 2001-10-22 | 2008-11-05 | 独立行政法人情報通信研究機構 | スペクトル・色再現システム |
JP2004005566A (ja) | 2002-04-23 | 2004-01-08 | Matsushita Electric Ind Co Ltd | 色編集装置および色編集方法 |
US7312816B2 (en) * | 2002-07-24 | 2007-12-25 | Freestone Systems, Inc. | Digital observation system |
JP2004219092A (ja) | 2003-01-09 | 2004-08-05 | Univ Waseda | リアルタイム分光画像分析装置及び分析方法 |
JP4072108B2 (ja) | 2003-10-07 | 2008-04-09 | オリンパス株式会社 | 画像表示装置及び画像表示方法 |
JP2005114530A (ja) | 2003-10-07 | 2005-04-28 | Olympus Corp | 画像表示装置及び画像表示方法 |
US20060122954A1 (en) | 2004-12-03 | 2006-06-08 | Podlasek Robert J | Medical simulator apparatus and method |
JP4976654B2 (ja) * | 2005-01-31 | 2012-07-18 | キヤノン株式会社 | 通信装置及びコンピュータプログラム |
-
2003
- 2003-10-07 JP JP2003348622A patent/JP4112469B2/ja not_active Expired - Fee Related
-
2004
- 2004-10-07 EP EP04792142A patent/EP1672339A4/en not_active Withdrawn
- 2004-10-07 WO PCT/JP2004/014845 patent/WO2005036113A1/ja active Application Filing
-
2006
- 2006-04-05 US US11/397,971 patent/US7768560B2/en not_active Expired - Fee Related
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS559153A (en) * | 1978-07-05 | 1980-01-23 | Nec Corp | Multi-band photographic device |
JPH04172789A (ja) * | 1990-11-07 | 1992-06-19 | Canon Inc | 撮像装置 |
JPH05183916A (ja) * | 1991-06-10 | 1993-07-23 | Eastman Kodak Co | イメージセンサの位置合わせシステム及び位置合わせ方法 |
JPH068897A (ja) * | 1992-06-25 | 1994-01-18 | Nec Corp | 宇宙航行体搭載撮像装置 |
JP2000196965A (ja) * | 1998-12-28 | 2000-07-14 | Fuji Photo Film Co Ltd | Ccd撮像デバイス及びその駆動方法、並びにフイルムスキャナ― |
JP2001005046A (ja) * | 1999-06-23 | 2001-01-12 | Fuji Photo Film Co Ltd | マルチバンドカメラ |
JP2002112101A (ja) * | 2000-09-28 | 2002-04-12 | Canon Inc | デジタルカメラおよびプリントシステム |
JP2004147287A (ja) * | 2002-08-30 | 2004-05-20 | Fuji Photo Film Co Ltd | マルチバンド画像撮影方法及び装置及びプログラム |
Non-Patent Citations (1)
Title |
---|
See also references of EP1672339A4 * |
Also Published As
Publication number | Publication date |
---|---|
EP1672339A4 (en) | 2010-02-17 |
JP4112469B2 (ja) | 2008-07-02 |
EP1672339A1 (en) | 2006-06-21 |
US7768560B2 (en) | 2010-08-03 |
US20060181681A1 (en) | 2006-08-17 |
JP2005114529A (ja) | 2005-04-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7768560B2 (en) | multiband camera control apparatus and multiband camera control method | |
US7110032B2 (en) | Setting control of bracketing image sensing operation in image sensing apparatus | |
US7619651B2 (en) | Electronic camera having finish setting function and processing program for customizing the finish setting function | |
KR101316716B1 (ko) | 촬상 장치 | |
KR101120027B1 (ko) | 셔터 반누름 시에 osd 처리 장치 및 방법 | |
US7522208B2 (en) | Electronic equipment and digital camera | |
US7864226B2 (en) | Image sensing apparatus and control method thereof | |
US7834924B2 (en) | Photographic apparatus | |
US8773567B2 (en) | Image capturing apparatus having display control of information and frames on displayed images and display control method | |
US8542303B2 (en) | Digital camera having a display menu used to select either color photographing operation or a black/white photographing operation | |
US8896742B2 (en) | Image pickup apparatus, and control method and program thereof | |
US20060152612A1 (en) | Imaging apparatus and its control method | |
KR101550107B1 (ko) | 촬상 장치, 촬상 방법 및 프로그램을 기록한 기록 매체 | |
KR101381617B1 (ko) | 촬상 장치 | |
US20050254811A1 (en) | Digital camera and portable device | |
JP2010181725A (ja) | デジタルカメラおよびプログラム | |
JP4931769B2 (ja) | 撮像装置および撮像制御方法 | |
JP2009130464A (ja) | 画像処理装置、画像処理装置の制御方法、及び、コンピュータプログラム | |
JP5132184B2 (ja) | デジタルカメラ、ホワイトバランス調整方法及びプログラム | |
JP4077683B2 (ja) | カメラ及び表示制御方法 | |
JP5370034B2 (ja) | 表示装置およびこれを用いたカメラ | |
US20220417432A1 (en) | Imaging device, imaging method, and program | |
JP4811468B2 (ja) | 電子機器及びディジタルスチルカメラ | |
JP4277713B2 (ja) | 電子機器及びディジタルスチルカメラ | |
JP5742206B2 (ja) | 撮像装置および画質設定プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 11397971 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2004792142 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2004792142 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 11397971 Country of ref document: US |