WO2019163373A1 - Imaging system, imaging method, camera adaptor, and program - Google Patents

Imaging system, imaging method, camera adaptor, and program Download PDF

Info

Publication number
WO2019163373A1
WO2019163373A1 PCT/JP2019/002002 JP2019002002W WO2019163373A1 WO 2019163373 A1 WO2019163373 A1 WO 2019163373A1 JP 2019002002 W JP2019002002 W JP 2019002002W WO 2019163373 A1 WO2019163373 A1 WO 2019163373A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
skin
camera adapter
light source
optical system
Prior art date
Application number
PCT/JP2019/002002
Other languages
French (fr)
Japanese (ja)
Inventor
山▲崎▼ 岩男
Original Assignee
ヤーマン株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ヤーマン株式会社 filed Critical ヤーマン株式会社
Publication of WO2019163373A1 publication Critical patent/WO2019163373A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/21Polarisation-affecting properties
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/27Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands using photo-electric detection ; circuits for computing concentration
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N27/00Investigating or analysing materials by the use of electric, electrochemical, or magnetic means
    • G01N27/02Investigating or analysing materials by the use of electric, electrochemical, or magnetic means by investigating impedance
    • G01N27/04Investigating or analysing materials by the use of electric, electrochemical, or magnetic means by investigating impedance by investigating resistance
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B11/00Filters or other obturators specially adapted for photographic purposes
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00Special procedures for taking photographs; Apparatus therefor
    • G03B15/02Illuminating scene
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00Special procedures for taking photographs; Apparatus therefor
    • G03B15/02Illuminating scene
    • G03B15/03Combinations of cameras with lighting apparatus; Flash units
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00Special procedures for taking photographs; Apparatus therefor
    • G03B15/02Illuminating scene
    • G03B15/03Combinations of cameras with lighting apparatus; Flash units
    • G03B15/05Combinations of cameras with electronic flash apparatus; Electronic flash units
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/02Bodies
    • G03B17/12Bodies with means for supporting objectives, supplementary lenses, filters, masks, or turrets
    • G03B17/14Bodies with means for supporting objectives, supplementary lenses, filters, masks, or turrets interchangeably
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/56Accessories

Definitions

  • the present invention relates to a technique for measuring a skin condition.
  • the skin condition is optically measured.
  • a lens adapter attached to a general-purpose smartphone it is possible to construct a shooting environment for performing skin measurement easily.
  • the shooting function and lighting function of the smartphone are used, if the minimum optical module is installed, the lens adapter side does not require a power source, and a shooting environment for skin shooting can be realized at low cost. .
  • the skin (skin) state has various elements such as texture, dirt, and spots, and in order to know the skin state in more detail, it is preferable to measure based on a plurality of viewpoints.
  • the optimum optical arrangement usually varies depending on the viewpoint.
  • the optical arrangement is typically defined by a combination of incident light wavelength, change, intensity, and received light (polarization state, intensity, wavelength of reflected or scattered light).
  • polarization state polarization state
  • wavelength of reflected or scattered light For example, it is preferable to construct an optical arrangement that uses white light as incident light and can receive only reflected light having the same polarization state as the incident light for the so-called texture (skin surface condition). .
  • a lens adapter with a mechanism capable of switching a plurality of optical arrangement patterns in accordance with the measurement purpose in order to obtain detailed information on the skin condition.
  • a mechanism capable of switching a plurality of optical arrangement patterns in accordance with the measurement purpose in order to obtain detailed information on the skin condition.
  • the measurement target region for example, near the nose or cheek
  • the lens adapter to the skin. Variations in the target region and distance contribute to lower skin condition determination accuracy.
  • Document 1 starts the portable photographing device in conjunction with the detection of the flash in the attachment of the portable photographing device that does not have the flash function. It is described to do.
  • the portable imaging device if the user operates the portable imaging device, there is no need to perform any special operation on the attachment, and flash photography can be realized.
  • An object of this invention is to obtain the detailed information about skin easily.
  • the present invention provides an attachment portion for attachment to an imaging device, an optical system that guides at least received light to the imaging device, a reception portion that receives a control signal from the imaging device, and the reception portion. And a controller that adjusts the optical system based on the received control signal.
  • FIG. 1 is an external view of the camera adapter 100
  • FIG. 2 is a figure which shows the state in which the camera adapter 100 was attached.
  • FIG. 2 is a functional block diagram of the measurement system 10.
  • Example (1) of contents displayed on screen of smartphone 200 Example of contents displayed on the screen of the smartphone 200 (part 2) Example of contents displayed on the screen of the smartphone 200 (part 3) Example of contents displayed on the screen of the smartphone 200 (part 4) Example of contents displayed on screen of smartphone 200 (part 5) Example of contents displayed on the screen of the smartphone 200 (part 6) Example of contents displayed on screen of smartphone 200 (part 7) Example of contents displayed on screen of smartphone 200 (part 8) 1 is an external view of a measurement system 20.
  • vibration generation , 233, speaker, 211, light source, 212, lens, 213, light receiving element, 214, imaging control unit, 215, image processing unit, 191, wireless communication module 192 ... Battery, 1 3 ... Charging plug, 194 ... CPU, 300 ... Scope camera, 400 ... PC, 500 ... Communication cable, 350 ... Control unit, 370 ... Switch, 330 ... Elasticity measurement unit, 320 ... moisture content measurement unit, 380 ... storage unit, 341 ... first communication unit, 342 ... second communication unit, 360 ... imaging unit, 361 ... light source , 362... Lens, 363... Light receiving element, 364... Imaging control unit, 365... Image processing unit, 366. Communication unit, 412 ... second communication unit, 420 ... display unit, 430 ... storage unit, 450 ... input unit, 390 ... notification unit
  • FIG. 1A shows the appearance of the camera adapter 100.
  • FIG. 5B shows a state where the camera adapter 100 is attached.
  • the measurement system 10 includes a camera adapter 100 and a smartphone 200.
  • the camera adapter 100 includes a clip unit 101 and an optical system 110.
  • the optical system 110 is a plurality of optical systems that can be selected according to the type of optical measurement, and is for assisting or extending the imaging function of the smartphone 200.
  • the clip unit 101 is a mechanism for detachably fixing the camera adapter 100 to the smartphone 200.
  • a fixing method a mechanical or magnetic method such as a magnet may be employed instead of the clip-in method. In short, it may be fixed to 200.
  • the smartphone 200 is an information processing terminal having a communication function and a photographing function that is used by a user who wants to measure his / her skin, and details of the function are not limited.
  • the user positions the optical system 110 so as to match the optical axis of the optical system 110 and the optical axis of 200 camera lenses (not shown).
  • FIG. 2 shows the functions of the measurement system 10.
  • the camera adapter 100 includes an optical system 110, an elasticity measurement unit 130, a moisture content measurement unit 120, a communication unit 140, a control unit 150, a storage unit 160, and an attachment unit 170.
  • the attachment part 170 is realized by the clip part 101 and is a mechanism for attaching the camera adapter 100 to the smartphone 200.
  • the communication unit 140 receives a control signal from the smartphone 200 by wire or wireless.
  • the optical system 110 includes a filter group 111, a light source group 112, and a lens 113.
  • the light source group 112 includes a plurality of light sources having different wavelength characteristics.
  • the light source group 112 includes a visible light source and an ultraviolet light source (eg, 360 to 380 nm).
  • the light source group 112 may further include a white light source and a blue light source.
  • the filter group 111 includes a plurality of polarizing filters each having a different polarization characteristic.
  • the lens 113 is provided on an optical path that transmits infrared to ultraviolet light and guides the received light to the smartphone 200.
  • the control unit 150 controls the optical system 110 based on a control signal received from the smartphone 200 via the communication unit 140.
  • the control unit 150 includes at least one of a light source constituting the optical system 110, a polarizing filter that controls polarization of the one light source, and a filter group 111 that is applied to received light. Select one of them.
  • the control signal includes a first mode of detecting reflected light from the surface of the skin of the visible light source irradiated to the skin to be imaged, and the skin of the visible light source irradiated to the skin.
  • the first mode is a mode for photographing using only the reflection of light from the surface of the skin for the purpose of photographing the texture.
  • the second mode is a mode in which the reflection on the surface of the skin is cut and the scattered light inside the skin is used for shooting spots (hidden spots).
  • the third mode is a mode for detecting smudges on the square plugs by fluorescent coloration by irradiating with ultraviolet light.
  • the moisture amount measuring unit 120 is realized by a mechanism that applies an electric current to the skin to measure the electrical resistance and a processing circuit that calculates the moisture content of the skin based on the electrical resistance value.
  • the elasticity measuring unit 130 is realized by a pressure sensor, and measures the degree of skin elasticity (repulsive force).
  • the smartphone 200 includes an imaging unit 210, a notification unit 230, a communication unit 240, a control unit 250, and an input unit 260, and is a general-purpose portable device that has voice communication and data communication functions in addition to a shooting function. Description of general functions that the smartphone 200 has as an information processing device is omitted.
  • the imaging unit 210 includes a light source 211, a lens 212, a light receiving element 213, an imaging control unit 214, and an image processing unit 215.
  • the light source 211 is realized by an LED or the like.
  • the light receiving element 213 is an optical device such as a CCD.
  • the imaging control unit 214 is realized by a processor and executes various types of control related to imaging such as exposure and focus.
  • the image processing unit 215. Realized by an image processor to generate image data.
  • the storage unit 220 is a storage element such as a semiconductor memory, and stores an application for performing a cooperative operation with the camera adapter 100 described later in addition to the OS of the smartphone 200.
  • image data captured by the imaging unit 210, data measured by the water content measurement unit 120 or the elasticity measurement unit 130, and data acquired via the communication unit 240 are stored.
  • the notification unit 230 includes a display unit 231, a vibration generation unit 232, and a speaker 233, and notifies the user of the measurement result.
  • the display unit 231 is realized by a liquid crystal display and notifies information using characters and images.
  • the vibration generating unit 232 is realized by a small motor or the like, and performs notification by vibration.
  • the speaker 233 performs information notification by voice.
  • the communication unit 240 is realized as a wireless communication module such as WiFi (registered trademark) or Bluetooth (registered trademark).
  • the control unit 250 is a processor such as a CPU.
  • the input unit 260 is a touch panel or an operation switch, and is operated by the user to input information and instructions.
  • FIG. 3 is a conceptual diagram of the internal structure of the camera adapter 100. Each module is mounted on a substrate (not shown).
  • the wireless communication module 191 is a wireless communication module for realizing the communication unit 140. Note that a wired communication module may be used instead of the wireless communication module.
  • the battery 192 supplies power to each module of the camera adapter 100.
  • the charging plug 193 is a device for charging the camera adapter 100.
  • the CPU 194 realizes the function of the control unit 150.
  • the optical system 110 includes a lens 113 that is an optical module for enlarging and photographing the skin by guiding light from the skin to the light receiving unit of the camera adapter 100 to form an image.
  • a lens 113 that is an optical module for enlarging and photographing the skin by guiding light from the skin to the light receiving unit of the camera adapter 100 to form an image.
  • one or more ultraviolet light sources each having the same wavelength (in this example, a total of four LEDs 112B-1, LED 112B-2, LED 112B-3, and LED 112B-4) and a plurality of visible light sources
  • Light source for example, one white light source, preferably a plurality of blue light sources each having the same wavelength (in this example, LED 112A-1, LED 112A-2, LED 112A-3, LED 112A-4, LED 112A-5, LED 112A-6) 6) are arranged.
  • the first visible light source for example, LED 112A-1
  • the lens 113 are closer to the skin side (+ X direction in the figure) and the change characteristics of each visible light source and the common polarization characteristics (for example, laterally polarized light ) Having a first filter (filter 111-1).
  • a second filter having a polarization characteristic (for example, longitudinally polarized light) perpendicular to the first filter is provided on the skin side of the second visible light source (for example, LED 112A-5). Is provided.
  • the control unit 150 selectively turns on a plurality of visible light sources and one or more ultraviolet light sources. Specifically, in the first mode, the LEDs 112A-1, 112A-2, 112A-3, and 112A-4 are turned on. In the second mode, the LEDs 112A-5 and 112A-6 are turned on, and the third In this mode, the four LEDs 112B-1 to 112B-4 are turned on.
  • optical arrangement described above is merely an example.
  • a mechanism to move the position of the light source and filter is provided, or the polarization characteristics are controlled using a polarizer, thereby realizing a plurality of optical arrangements corresponding to each mode. May be.
  • FIG. 4 shows an operation example of the camera adapter 100 and the smartphone 200.
  • the user operates the smartphone 200 and activates an application program (hereinafter referred to as an application) for controlling the camera adapter 100.
  • an application information for specifying measurement contents (types of measurement items and execution order thereof) (hereinafter referred to as setting information) is input or read from the storage unit 220, and an instruction to start imaging is input (S501).
  • a guidance screen as shown in FIG. 5A may be displayed on the smartphone 200.
  • the measurement execution order may be specified by the user.
  • the control unit 250 may determine according to a predetermined algorithm according to a plurality of designated measurement items. Further, after that, a guidance screen as shown in FIG. 5B may be displayed. Further, during measurement, guidance as shown in FIG. 5C may be displayed.
  • the setting information specifies that three types of optical measurements and two types of non-optical measurements are performed will be described as an example.
  • the smartphone 200 transmits a control signal indicating a mode to be executed first to the camera adapter 100 (S503).
  • the camera adapter 100 performs setting or switching of the optical arrangement of the optical system 110 according to this control signal, waits for a predetermined period (for example, 0.5 seconds) (S505), and confirms that the preparation for photographing is ready.
  • a signal ACK is transmitted to the smartphone 200 (S507). The reason for waiting for a predetermined period is to perform processing for the optical module to exhibit optimum performance, such as preheating the light source.
  • the smartphone 200 executes the image capturing upon receipt of the confirmation signal ACK and stores the generated image data (S509). Subsequently, in order to execute the next measurement item according to the setting information, the smartphone 200 transmits a mode switching command to the camera adapter 100 (S511). Upon receiving the switching command, the camera adapter 100 performs mode switching and necessary standby (S513), and transmits a confirmation signal ACK to the smartphone 200 when preparation for measurement is completed (S515). When receiving the confirmation signal ACK, the smartphone 200 performs imaging in the second mode and stores the image data (S517).
  • a switching command is transmitted to the camera adapter 100 to perform the next shooting according to the setting information (S519).
  • the camera adapter 100 performs mode switching and necessary standby (S521), and transmits a confirmation signal ACK to the smartphone 200 when preparation is completed (S523).
  • the smartphone 200 that has received the confirmation signal ACK performs imaging in the third mode and stores image data (S525).
  • 200 determines that the next measurement item is water content measurement according to the setting information, and transmits a water content measurement command to the camera adapter 100 (S527).
  • the camera adapter 100 Upon receiving the moisture content measurement command, the camera adapter 100 performs moisture content measurement (S529), and transmits the measurement result data to the smartphone 200 (S531).
  • the smartphone 200 stores the received measurement data (S533).
  • the smartphone 200 transmits an elasticity measurement command to the camera adapter 100 according to the setting information (S535).
  • the camera adapter 100 Upon receiving the elasticity measurement command, the camera adapter 100 performs elasticity measurement (S537), and transmits the measurement result data to the smartphone 200 (S539).
  • the smartphone 200 stores the received measurement data (S541).
  • the smartphone 200 determines that the measurement of all items has been completed based on the setting information
  • the smartphone 200 analyzes the measurement data acquired in a series of measurements, processes and edits as necessary, and displays the measurement results on the screen ( S543).
  • the user may be notified of the end of measurement by displaying a screen as shown in FIG. Note that the end notification may be performed using voice or vibration.
  • FIG. 5E is an example of the display of the measurement result.
  • the skin condition is scored for each measurement item, and a comprehensive index (score) is shown in the chart.
  • the control application when the control application is activated on the smartphone 200, the control of the camera adapter 100 (change in optical arrangement) and the control of the smartphone 200 (shooting execution timing) are performed in conjunction.
  • the user does not need to perform a switching operation.
  • This makes it possible to acquire detailed skin information based on the results of a plurality of types of optical measurements, which was difficult to acquire with a general-purpose imaging device.
  • achieve by attaching the camera adapter 100 to a general purpose portable terminal it is easy.
  • by using a non-optical measurement method in combination with optical measurement it is possible to acquire information about skin that cannot be acquired by a general-purpose information communication terminal device having a camera function.
  • a plurality of sites may be measured. Specifically, when setting information is generated before the start of measurement, a screen as shown in FIG. 5F is displayed, and the user is allowed to specify a measurement target region and a measurement order. In this example, the position and the order can be specified by specifying the positions of the objects OB21 to OB24.
  • a screen as shown in FIG. 5G is displayed, or guidance is given to adjust the position to which 100 is applied and confirm the position by a voice message. May be.
  • the evaluation of each item may be displayed for each part as shown in FIG. In the figure, an object OB1 representing a face and OB2 to OB4 corresponding to three measurement sites are displayed, and the evaluation is expressed as a score.
  • a camera adapter includes an attachment portion for attachment to an imaging device, an optical system that guides at least received light to the imaging device, a reception portion that receives a control signal from the imaging device, and the reception portion. And a control unit that adjusts the optical system based on the received control signal.
  • the present invention includes a step of transmitting a control signal to a computer of a terminal having a data transmission unit and an imaging unit to a camera adapter attached to the terminal, and the received control signal in the camera adapter.
  • a program for executing the step of adjusting the optical system based on the information and the step of notifying the terminal that the adjustment of the optical system is completed by the camera adapter is provided.
  • FIG. 6 is a schematic diagram of the measurement system 20.
  • the measurement system 20 includes a PC 400 and a scope camera 300.
  • the scope camera 300 is provided with a switch 370 and a notification unit 390.
  • the scope camera 300 and the PC 400 are connected via a communication cable 500 so that information can be exchanged.
  • FIG. 7 is a functional block diagram of the measurement system 20.
  • the scope camera 300 includes a moisture amount measurement unit 320, an elasticity measurement unit 330, a control unit 350, an imaging unit 360, a switch 370, a storage unit 380, a first communication unit 341, and a second communication unit 342.
  • the switch 370 is a physical switch provided in the casing of the scope camera 300 and accepts a user operation.
  • the user can operate the switch 370 to instruct the scope camera 300 to start, end, interrupt, and change modes.
  • a signal representing the input operation is transmitted to the PC 400 via the first communication unit 341.
  • the operation signal includes at least a signal indicating switching of the measurement mode.
  • the PC 400 that has received the operation signal can recognize which measurement item corresponds to the operation performed by the scope camera 300 and the data received immediately after that by referring to the setting information. is there.
  • the operation of the scope camera 300 based on only the operation signal even if the PC 400 does not have setting information. Information can be grasped.
  • an operation signal may be supplied from the scope camera 300 to the PC 400 so that the PC 400 can grasp the operation state of the scope camera 300.
  • the first communication unit 341 is a communication module for exchanging information related to control with the PC 400 in accordance with a communication standard such as WiFi or Bluetooth (registered trademark). Specifically, the first communication unit 341 transmits the operation signal input by the switch 370 and receives the confirmation signal ACK from the PC 400.
  • the second communication unit 342 is a communication module for transferring data measured by the scope camera 300 to the PC 400 using the communication cable 500 according to a communication standard such as USB or Ethernet. Realized as a connection terminal.
  • the first communication unit 341 and the second communication unit 342 may be wired communication or wireless communication, respectively, but at least the skin image data generated by the imaging unit 360 is transmitted via the second communication unit 342. Sent. Therefore, it is preferable that the second communication unit 342 has a higher capability in data transfer speed and transfer amount than the first communication unit 341.
  • the imaging unit 360 includes a light source group 361, a lens 362, a light receiving element 363, an imaging control unit 364, an image processing unit 365, and a filter group 366, and has a plurality of switchable optical systems.
  • the imaging unit 360 has a function equivalent to that obtained by integrating the imaging unit 210 and the optical system 110. In short, it is sufficient that a plurality of measurement modes are facilitated and can be switched by the user.
  • the control unit 350 instructs the light source group 361 and the filter group 366 to set and change the setting, and instructs the imaging control unit 364 and the lens 362 to perform imaging.
  • the notification unit 390 is realized by a light emitting device such as an LED, a liquid crystal display, or the like, and notifies the user that a mode switching command has been received from the PC 400.
  • the storage unit 380 is a storage device such as a semiconductor memory, and stores setting information.
  • the water content measuring unit 320 has the same function as the water content measuring unit 120.
  • the elasticity measuring unit 330 has the same function as the elasticity measuring unit 130.
  • the scope camera 300 has a configuration in which the camera adapter 100 is added with an imaging function of the smartphone 200, a function of accepting a user operation, and a two-system communication function.
  • the PC 400 is a general-purpose PC, for example.
  • the PC 400 includes a first communication unit 411, a second communication unit 412, a control unit 440, a storage unit 430, and a display unit 420.
  • the first communication unit 411 is a communication module for exchanging information related to control with the scope camera 300 in accordance with a communication standard such as WiFi or Bluetooth (registered trademark).
  • 441 transmits an operation signal and transmits a confirmation signal ACK to the scope camera 300.
  • the second communication unit 412 is realized as a communication module or a connection terminal for receiving measurement data from the scope camera 300 via the communication cable 500 in accordance with a communication standard such as USB or Ethernet.
  • the display unit 420 is a display, and is used for input and reading of setting information, notification of processing status being executed, display of measurement results, and the like.
  • the storage unit 430 is a hard disk or a semiconductor and stores setting information and measurement data.
  • the control unit 440 is a processor, and performs processing such as analysis / editing on the measurement data to generate drawing data.
  • the input unit 450 is a keyboard or a mouse, and is used by a user to input setting information.
  • FIG. 8 shows an operation example of the measurement system 20.
  • the broken line of the figure shows that the communication is wireless, and the solid line shows that the communication is wired.
  • the user reads the setting information by operating the PC 400 to activate a predetermined application.
  • the PC 400 is in a state of receiving an operation signal from the scope camera 300 (S600).
  • S601 an operation signal is transmitted to the PC 400 via the first communication unit 341 (S603). Since the PC 400 has received the operation signal for the first time, it is determined that the measurement based on the setting information has started.
  • the scope camera 300 executes shooting by applying the mode specified by the user using the switch 370 (S605).
  • the image data image is transmitted to the PC 400 via the second communication unit 342 (S607).
  • the PC 400 recognizes that the received measurement data is the data obtained in the first measurement described in the setting information based on the previously received operation signal and setting information.
  • An index indicating the second measurement item (for example, “stain measurement”) is attached, and the measurement data is stored (S609).
  • the PC 400 refers to the setting information, and when there is a next measurement item, the PC 400 transmits a mode switching command to the scope camera 300 via the first communication unit 411 (S611).
  • the scope camera 300 notifies the user, and the user who receives this notification recognizes that the switching operation is necessary.
  • an operation signal is transmitted to the PC 400 and the switching is executed in S614 (S615).
  • measurement is executed (S616), and measurement data is transmitted to the PC 400 (S617).
  • the PC 400 stores the received measurement data with an index indicating that it is the second measurement result described in the setting information (S618).
  • the PC 400 confirms the setting information, and if there is a next measurement item, transmits a switching command (S619).
  • steps S612, S613, S615, S616, S617, S618, and S619 are repeated until the PC 400 determines that all measurement items have been completed.
  • the PC 400 determines that all items have been completed (S630), or receives an operation signal instructing the end of measurement input through the switch 370 (S629), one folder is associated with the measurement date and time.
  • the stored series of data is stored in association with each other.
  • the scope camera 300 and the PC 400 operate in conjunction with each other, and the user only has to operate the scope camera 300 in accordance with the notification. Therefore, various types of measurements can be easily performed.
  • the PC 400 reliably determines which type of measurement results the measurement data sent from the scope camera 300 indicates. I can grasp it.
  • control signals with a relatively small amount of data are transmitted by wireless communication, while image data having a relatively large amount of data is transmitted by wired communication, thereby efficiently transferring data. be able to.
  • an existing data transfer driver program such as a USB connection can be used for the image data transmission / reception processing portion, a control program for communicating with the scope camera 300 by the PC 400 can be easily created.
  • an imaging apparatus includes an information processing apparatus, an imaging unit capable of switching a plurality of optical systems, an operation unit for switching the optical systems, and a notification unit, and the information processing.
  • a measurement system including an imaging device including a communication unit that communicates with the device, a step of transmitting an operation signal to the information processing device when a user operation is accepted by the imaging device, and based on the received operation signal And a step of transmitting a signal instructing switching of the optical system to the imaging apparatus.
  • the optical systems shown in the first and second examples are only examples. Specifically, the type, number, and characteristics of the optical modules constituting the optical system are arbitrary. In addition, the measurement type, method, and number of items are arbitrary. What is necessary is just to set a measurement means according to the objective. For example, some of the three types of optical measurements may be omitted, or a new mode may be set. Similarly, a sensor for measuring the oil content of the skin may be further provided as a measurement item, or execution of some measurement items may be omitted.

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Chemical & Material Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Analytical Chemistry (AREA)
  • Immunology (AREA)
  • Biochemistry (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Theoretical Computer Science (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Electrochemistry (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Accessories Of Cameras (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Investigating Or Analyzing Materials By The Use Of Electric Means (AREA)
  • Stroboscope Apparatuses (AREA)
  • Blocking Light For Cameras (AREA)
  • Structure And Mechanism Of Cameras (AREA)

Abstract

This camera adaptor (100) has: a mounting unit (170) for mounting onto an imaging apparatus (200); an optical system (110) which guides at least received light to the imaging apparatus; a receiving unit (140) which receives a control signal from the imaging apparatus; and a control unit (150) which adjusts the optical system on the basis of the control signal received by the receiving unit.

Description

撮像システム、撮像方法、カメラアダプタ及びプログラムImaging system, imaging method, camera adapter, and program
 本発明は、肌の状態を測定する技術に関する。 The present invention relates to a technique for measuring a skin condition.
 肌の状態を光学的に測定することが行われている。特に、汎用のスマートフォンに取り付けるレンズアダプタを用いると、簡易的に肌測定を行うための撮影環境を構築できる。この場合、スマートフォンの撮影機能や照明機能を利用するので、最小限の光学モジュールを搭載していれば、レンズアダプタ側は電源が不要であり、低コストで肌撮影用の撮影環境が可能となる。 The skin condition is optically measured. In particular, when a lens adapter attached to a general-purpose smartphone is used, it is possible to construct a shooting environment for performing skin measurement easily. In this case, since the shooting function and lighting function of the smartphone are used, if the minimum optical module is installed, the lens adapter side does not require a power source, and a shooting environment for skin shooting can be realized at low cost. .
特開2013-257518号公報JP2013-257518A
 スマートフォンに内蔵されているLEDモジュールなどの撮影機能は肌測定には十分でない場合がある。また、スマートフォンによってもカメラの性能が異なるので、同じレンズアダプタを用いたとしても、スマートフォンが異なると撮影画像の品質に差が出てしまう。この結果、肌状態の判定結果の信頼性が担保できないことになる。 * Shooting functions such as LED modules built into smartphones may not be sufficient for skin measurement. Moreover, since the performance of a camera differs also with a smart phone, even if it uses the same lens adapter, if a smart phone differs, a difference will appear in the quality of a picked-up image. As a result, the reliability of the skin condition determination result cannot be guaranteed.
 さらに、肌(皮膚)の状態は、キメ、汚れ、シミなどの種々の要素があり、肌状態をより詳細に知るためには、複数の観点に基づいて測定することが好ましい。しかし、通常、観点に応じて最適な光学配置が異なる。光学配置は、典型的には、入射光の、波長、変更、強度、受信した光(反射光または散乱光の偏光状態、強度、波長)の組み合わせによって規定される。例えば、いわゆるキメ(肌の表面の状態)の撮影に関しては、入射光として白色光を用い、且つ入射光の偏光状態と同じ偏光状態を有する反射光のみが受光できる光学配置を構築することが好ましい。 Furthermore, the skin (skin) state has various elements such as texture, dirt, and spots, and in order to know the skin state in more detail, it is preferable to measure based on a plurality of viewpoints. However, the optimum optical arrangement usually varies depending on the viewpoint. The optical arrangement is typically defined by a combination of incident light wavelength, change, intensity, and received light (polarization state, intensity, wavelength of reflected or scattered light). For example, it is preferable to construct an optical arrangement that uses white light as incident light and can receive only reflected light having the same polarization state as the incident light for the so-called texture (skin surface condition). .
 この観点から、肌状態の詳細な情報を得るべく、測定目的に応じて複数の光学配置パターンを切替ることができる機構をレンズアダプタに設けることは考えられる。しかし、このような機構を設けたとしても、ユーザがアダプタの光学配置の切替え操作と撮影実行操作を複数回(例えば、キメ、汚れ、シミという目的に応じて3回)行う必要があり、手間がかかる。加えて、この一連の測定の最中、測定対象領域(例えば鼻筋付近なのか頬なのか)やレンズアダプタとの肌までの距離を一定に保つことが難しい。対象領域や距離にバラつきが生じると、肌状態の判定精度を下げる一因となる。 From this viewpoint, it is conceivable to provide a lens adapter with a mechanism capable of switching a plurality of optical arrangement patterns in accordance with the measurement purpose in order to obtain detailed information on the skin condition. However, even if such a mechanism is provided, it is necessary for the user to perform the switching operation of the optical arrangement of the adapter and the photographing execution operation a plurality of times (for example, three times according to the purpose of texture, dirt, and stain). It takes. In addition, during this series of measurements, it is difficult to maintain a constant distance from the measurement target region (for example, near the nose or cheek) and the lens adapter to the skin. Variations in the target region and distance contribute to lower skin condition determination accuracy.
 携帯型撮影装置の制御とカメラアタッチメントにおける光学配置の設定との連携に関し、文献1には、フラッシュ機能を有しない携帯型撮影装置のアタッチメントにおいて、フラッシュの検知に連動して携帯型撮影装置を起動することが記載されている。文献1の発明では、ユーザは携帯型撮影装置の操作を行えばアタッチメントについて特段操作を行う必要がなく、フラッシュ撮影を実現できる。しかし、肌状態を多様な観点から計測すべく複数の光学配置パターンを実現するといったことはできない。 Regarding the cooperation between the control of the portable photographing device and the setting of the optical arrangement in the camera attachment, Document 1 starts the portable photographing device in conjunction with the detection of the flash in the attachment of the portable photographing device that does not have the flash function. It is described to do. In the invention of Document 1, if the user operates the portable imaging device, there is no need to perform any special operation on the attachment, and flash photography can be realized. However, it is impossible to realize a plurality of optical arrangement patterns in order to measure the skin condition from various viewpoints.
 このように、従来技術においては、肌についての詳細な情報を手軽に得ることが難しかった。
 本発明は、肌についての詳細な情報を手軽に得ることを目的とする。
As described above, in the prior art, it is difficult to easily obtain detailed information about the skin.
An object of this invention is to obtain the detailed information about skin easily.
 本発明は、一の態様において、撮像装置へ取り付けるための取付部と、少なくとも受光した光を前記撮像装置へ導く光学系と、前記撮像装置から制御信号を受信する受信部と、前記受信部にて受信された制御信号に基づいて前記光学系を調整する制御部とを有するカメラアダプタを提供する。 In one aspect, the present invention provides an attachment portion for attachment to an imaging device, an optical system that guides at least received light to the imaging device, a reception portion that receives a control signal from the imaging device, and the reception portion. And a controller that adjusts the optical system based on the received control signal.
 本発明によれば、肌についての詳細な情報を手軽に得ることができる。 According to the present invention, detailed information about the skin can be obtained easily.
(a)はカメラアダプタ100の外観図、(b)はカメラアダプタ100が取り付けられた状態を示す図。(A) is an external view of the camera adapter 100, (b) is a figure which shows the state in which the camera adapter 100 was attached. 測定システム10の機能ブロック図。2 is a functional block diagram of the measurement system 10. FIG. カメラアダプタ100の内部構造を示す図。The figure which shows the internal structure of the camera adapter. カメラアダプタ100およびスマートフォン200動作例。Operation example of the camera adapter 100 and the smartphone 200. スマートフォン200の画面に表示される内容の例(その1)Example (1) of contents displayed on screen of smartphone 200 スマートフォン200の画面に表示される内容の例(その2)Example of contents displayed on the screen of the smartphone 200 (part 2) スマートフォン200の画面に表示される内容の例(その3)Example of contents displayed on the screen of the smartphone 200 (part 3) スマートフォン200の画面に表示される内容の例(その4)Example of contents displayed on the screen of the smartphone 200 (part 4) スマートフォン200の画面に表示される内容の例(その5)Example of contents displayed on screen of smartphone 200 (part 5) スマートフォン200の画面に表示される内容の例(その6)Example of contents displayed on the screen of the smartphone 200 (part 6) スマートフォン200の画面に表示される内容の例(その7)Example of contents displayed on screen of smartphone 200 (part 7) スマートフォン200の画面に表示される内容の例(その8)Example of contents displayed on screen of smartphone 200 (part 8) 測定システム20の外観図。1 is an external view of a measurement system 20. FIG. 測定システム20の機能ブロック図。The functional block diagram of the measurement system 20. FIG. 測定システム20動作例。An operation example of the measurement system 20.
10、20・・・測定システム、100・・・カメラアダプタ、200・・・スマートフォン、101・・・クリップ部、110・・・光学系、113・・・レンズ、111・・・フィルタ群、112A、112B・・・LED、112・・・光源群、130・・・弾力測定部、120・・・水分量測定部、140・・・通信部、170・・・取付部、150・・・制御部、210・・・撮像部、220・・・記憶部、250・・・制御部、260・・・入力部、230・・・通知部、231・・・表示部、232・・・振動発生部、233・・・スピーカ、211・・・光源、212・・・レンズ、213・・・受光素子、214・・・撮像制御部、215・・・画像処理部、191・・・無線通信モジュール、192・・・バッテリ、193・・・充電プラグ、194・・・CPU、300・・・スコープカメラ、400・・・PC、500・・・通信ケーブル、350・・・制御部、370・・・スイッチ、330・・・弾力測定部、320・・・水分量測定部、380・・・記憶部、341・・・第1通信部、342・・・第2通信部、360・・・撮像部、361・・・光源、362・・・レンズ、363・・・受光素子、364・・・撮像制御部、365・・・画像処理部、366・・・フィルタ群、361・・・光源群、411・・・第1通信部、412・・・第2通信部、420・・・表示部、430・・・記憶部、450・・・入力部、390・・・通知部 DESCRIPTION OF SYMBOLS 10, 20 ... Measurement system, 100 ... Camera adapter, 200 ... Smartphone, 101 ... Clip part, 110 ... Optical system, 113 ... Lens, 111 ... Filter group, 112A 112B ... LED, 112 ... light source group, 130 ... elasticity measuring unit, 120 ... moisture content measuring unit, 140 ... communication unit, 170 ... mounting unit, 150 ... control 210, imaging unit, 220 ... storage unit, 250 ... control unit, 260 ... input unit, 230 ... notification unit, 231 ... display unit, 232 ... vibration generation , 233, speaker, 211, light source, 212, lens, 213, light receiving element, 214, imaging control unit, 215, image processing unit, 191, wireless communication module 192 ... Battery, 1 3 ... Charging plug, 194 ... CPU, 300 ... Scope camera, 400 ... PC, 500 ... Communication cable, 350 ... Control unit, 370 ... Switch, 330 ... Elasticity measurement unit, 320 ... moisture content measurement unit, 380 ... storage unit, 341 ... first communication unit, 342 ... second communication unit, 360 ... imaging unit, 361 ... light source , 362... Lens, 363... Light receiving element, 364... Imaging control unit, 365... Image processing unit, 366. Communication unit, 412 ... second communication unit, 420 ... display unit, 430 ... storage unit, 450 ... input unit, 390 ... notification unit
<第1実施例>
 図1(a)はカメラアダプタ100の外観を示す。同図(b)はカメラアダプタ100が取り付けられた状態を示す。測定システム10はカメラアダプタ100とスマートフォン200を含む。カメラアダプタ100は、クリップ部101および光学系110を含む。光学系110は、光学測定の種類に応じて選択可能な複数の光学系であり、スマートフォン200の有する撮像機能を補助ないし拡張するためのものである。クリップ部101はカメラアダプタ100をスマートフォン200に着脱可能に固定するための機構である。なお、固定の方式として、クリップのような挟み込み方式に替えて、マグネットなどの機械的・磁気的な方法を採用してもよい。要するに、200に固定できればよい。
<First embodiment>
FIG. 1A shows the appearance of the camera adapter 100. FIG. 5B shows a state where the camera adapter 100 is attached. The measurement system 10 includes a camera adapter 100 and a smartphone 200. The camera adapter 100 includes a clip unit 101 and an optical system 110. The optical system 110 is a plurality of optical systems that can be selected according to the type of optical measurement, and is for assisting or extending the imaging function of the smartphone 200. The clip unit 101 is a mechanism for detachably fixing the camera adapter 100 to the smartphone 200. As a fixing method, a mechanical or magnetic method such as a magnet may be employed instead of the clip-in method. In short, it may be fixed to 200.
 スマートフォン200は、自分の肌を測定したいユーザによって使用される、通信機能および撮影機能を有する情報処理端末であって、機能の詳細は問わない。
 ユーザは、光学系110の光軸と200のカメラレンズ(図示せず)の光軸に合致するよう、に光学系110の位置決めを行う。
The smartphone 200 is an information processing terminal having a communication function and a photographing function that is used by a user who wants to measure his / her skin, and details of the function are not limited.
The user positions the optical system 110 so as to match the optical axis of the optical system 110 and the optical axis of 200 camera lenses (not shown).
 図2は測定システム10の機能を示す。カメラアダプタ100は、光学系110と弾力測定部130と水分量測定部120と通信部140と制御部150と記憶部160と取付部170を含む。取付部170は、クリップ部101によって実現され、カメラアダプタ100をスマートフォン200へ取り付けるための機構である。通信部140は、有線または無線によって、スマートフォン200から制御信号を受信する。 FIG. 2 shows the functions of the measurement system 10. The camera adapter 100 includes an optical system 110, an elasticity measurement unit 130, a moisture content measurement unit 120, a communication unit 140, a control unit 150, a storage unit 160, and an attachment unit 170. The attachment part 170 is realized by the clip part 101 and is a mechanism for attaching the camera adapter 100 to the smartphone 200. The communication unit 140 receives a control signal from the smartphone 200 by wire or wireless.
 光学系110は、フィルタ群111と光源群112とレンズ113とを含む。光源群112には、波長特性の異なる複数の光源が含まれる。好ましくは、光源群112は可視光光源と紫外光光源(例えば360~380nm)とを含む。加えて、光源群112には、白色光源と青色光源とが更に含まれていてもよい。フィルタ群111は、各々偏光特性が異なる複数の偏光フィルタからなる。レンズ113は、赤外~紫外光を透過し、受光した光をスマートフォン200へ導く光路上に設けられる。 The optical system 110 includes a filter group 111, a light source group 112, and a lens 113. The light source group 112 includes a plurality of light sources having different wavelength characteristics. Preferably, the light source group 112 includes a visible light source and an ultraviolet light source (eg, 360 to 380 nm). In addition, the light source group 112 may further include a white light source and a blue light source. The filter group 111 includes a plurality of polarizing filters each having a different polarization characteristic. The lens 113 is provided on an optical path that transmits infrared to ultraviolet light and guides the received light to the smartphone 200.
 制御部150は、通信部140を介してスマートフォン200から受信された制御信号に基づいて光学系110を制御する。具体的には、制御部150は、光学系110を構成する一の光源と、当該一の光源の偏光を制御する偏光フィルタと、受光した光に対して適用するフィルタ群111とのうち、少なくともいずれか一つを選択する。
 好ましくは、制御信号は、撮影対象の肌に照射された可視光光源の、当該肌の表面からの反射光を検出する第1のモードと、前記肌に照射された可視光光源の、当該肌の内部からの散乱光を検出する第2のモードと、前記肌に照射された紫外光光源の、当該肌の表面からの反射光を検出する第3のモードのいずれか一つを指定する。
The control unit 150 controls the optical system 110 based on a control signal received from the smartphone 200 via the communication unit 140. Specifically, the control unit 150 includes at least one of a light source constituting the optical system 110, a polarizing filter that controls polarization of the one light source, and a filter group 111 that is applied to received light. Select one of them.
Preferably, the control signal includes a first mode of detecting reflected light from the surface of the skin of the visible light source irradiated to the skin to be imaged, and the skin of the visible light source irradiated to the skin. One of a second mode for detecting scattered light from the inside of the skin and a third mode for detecting reflected light from the surface of the skin of the ultraviolet light source irradiated on the skin.
 第1のモードは、キメを撮影することを目的とした、肌の表面からの光の反射のみを用いて撮影するモードである。第2のモードは、シミ(隠れジミ)を撮影することを目的とした、肌の表面の反射をカットして肌の内部の散乱光を用いて撮影するモードである。第3のモードは、紫外光を照射することで角栓の汚れを蛍光発色により検出するためのモードである。 The first mode is a mode for photographing using only the reflection of light from the surface of the skin for the purpose of photographing the texture. The second mode is a mode in which the reflection on the surface of the skin is cut and the scattered light inside the skin is used for shooting spots (hidden spots). The third mode is a mode for detecting smudges on the square plugs by fluorescent coloration by irradiating with ultraviolet light.
 水分量測定部120は、肌に電流を印加して電気抵抗を測定する機構と電気抵抗値に基づいて肌の水分量を算出する処理回路とによって実現される。
 弾力測定部130は、圧力センサによって実現され、肌の弾力の度合い(反発力)を計測する。
The moisture amount measuring unit 120 is realized by a mechanism that applies an electric current to the skin to measure the electrical resistance and a processing circuit that calculates the moisture content of the skin based on the electrical resistance value.
The elasticity measuring unit 130 is realized by a pressure sensor, and measures the degree of skin elasticity (repulsive force).
 スマートフォン200は、撮像部210と通知部230と通信部240と制御部250と入力部260を含み、撮影機能に加え、音声通信やデータ通信機能を有する汎用の携帯型デバイスである。スマートフォン200が情報処理機器として有する一般的な機能については、説明を省略する。 The smartphone 200 includes an imaging unit 210, a notification unit 230, a communication unit 240, a control unit 250, and an input unit 260, and is a general-purpose portable device that has voice communication and data communication functions in addition to a shooting function. Description of general functions that the smartphone 200 has as an information processing device is omitted.
 撮像部210は、光源211とレンズ212と受光素子213と撮像制御部214と画像処理部215を含む。光源211は、LED等によって実現される。受光素子213は、CCD等の光学デバイスである。撮像制御部214は、プロセッサによって実現され、露光、ピント等の撮影に関する各種制御を実行する。画像処理部215は。画像処理プロセッサによって実現され、画像データを生成する。 The imaging unit 210 includes a light source 211, a lens 212, a light receiving element 213, an imaging control unit 214, and an image processing unit 215. The light source 211 is realized by an LED or the like. The light receiving element 213 is an optical device such as a CCD. The imaging control unit 214 is realized by a processor and executes various types of control related to imaging such as exposure and focus. The image processing unit 215. Realized by an image processor to generate image data.
 記憶部220は、半導体メモリ等の記憶素子であって、スマートフォン200のOSのほか、後述するカメラアダプタ100と連携動作を行うためのアプリが記憶される。加えて、撮像部210にて撮影した画像データ、水分量測定部120または弾力測定部130にて測定され、通信部240を介して取得したデータが記憶される。 The storage unit 220 is a storage element such as a semiconductor memory, and stores an application for performing a cooperative operation with the camera adapter 100 described later in addition to the OS of the smartphone 200. In addition, image data captured by the imaging unit 210, data measured by the water content measurement unit 120 or the elasticity measurement unit 130, and data acquired via the communication unit 240 are stored.
 通知部230は、表示部231と振動発生部232とスピーカ233を含み、測定の結果をユーザ通知する。表示部231は、液晶ディスプレイによって実現され、文字や画像で情報を通知する。振動発生部232は、小型モーター等によって実現され、振動によって通知を行う。スピーカ233は、音声によって情報通知を行う。 The notification unit 230 includes a display unit 231, a vibration generation unit 232, and a speaker 233, and notifies the user of the measurement result. The display unit 231 is realized by a liquid crystal display and notifies information using characters and images. The vibration generating unit 232 is realized by a small motor or the like, and performs notification by vibration. The speaker 233 performs information notification by voice.
 通信部240は、WiFi(登録商標)やBluetooth(登録商標)などの無線通信モジュールとして実現される。制御部250は、CPU等のプロセッサである。入力部260は、タッチパネルや操作スイッチであってユーザが操作して情報や指示を入力する。 The communication unit 240 is realized as a wireless communication module such as WiFi (registered trademark) or Bluetooth (registered trademark). The control unit 250 is a processor such as a CPU. The input unit 260 is a touch panel or an operation switch, and is operated by the user to input information and instructions.
 図3は、カメラアダプタ100の内部構造の概念図である。各モジュールは基板上(図示せぬ)に実装される。無線通信モジュール191は、通信部140を実現するための無線通信モジュールである。なお、無線通信モジュールに替えて有線通信モジュールであってもよい。バッテリ192は、カメラアダプタ100の各モジュールに電力を供給する。充電プラグ193は、カメラアダプタ100へ充電するためのデバイスである。CPU194は、制御部150の機能を実現する。 FIG. 3 is a conceptual diagram of the internal structure of the camera adapter 100. Each module is mounted on a substrate (not shown). The wireless communication module 191 is a wireless communication module for realizing the communication unit 140. Note that a wired communication module may be used instead of the wireless communication module. The battery 192 supplies power to each module of the camera adapter 100. The charging plug 193 is a device for charging the camera adapter 100. The CPU 194 realizes the function of the control unit 150.
 光学系110は、肌からの光をカメラアダプタ100の受光部へ導いて結像させ、肌を拡大撮影するための光学モジュールであるレンズ113を含む。
 レンズ113の近傍には、好ましくはそれぞれ波長が同一の1以上の紫外光光源(この例では、LED112B-1、LED112B-2、LED112B-3、LED112B-4の計4つ)と、複数の可視光光源(例えば一つの白色光源と、好ましくはそれぞれ波長が同一の複数の青色光源(この例ではLED112A-1、LED112A-2、LED112A-3、LED112A-4、LED112A-5、LED112A-6の計6つ))が配置される。
 そして、複数の可視光源のうち第1の可視光源(例えばLED112A-1)およびレンズ113よりも肌側(同図の+X方向)に、各可視光源の変更特性と共通の偏光特性(例えば横偏光)を有する第1フィルタ(フィルタ111-1)が設けられる。当該複数の可視光光源のうち第2の可視光源(例えばLED112A-5)の肌側には、前記第1フィルタと直行する偏光特性(例えば縦偏光)を有する第2フィルタ(フィルタ111-2)が設けられる。
The optical system 110 includes a lens 113 that is an optical module for enlarging and photographing the skin by guiding light from the skin to the light receiving unit of the camera adapter 100 to form an image.
In the vicinity of the lens 113, preferably one or more ultraviolet light sources each having the same wavelength (in this example, a total of four LEDs 112B-1, LED 112B-2, LED 112B-3, and LED 112B-4) and a plurality of visible light sources Light source (for example, one white light source, preferably a plurality of blue light sources each having the same wavelength (in this example, LED 112A-1, LED 112A-2, LED 112A-3, LED 112A-4, LED 112A-5, LED 112A-6) 6)) are arranged.
Then, among the plurality of visible light sources, the first visible light source (for example, LED 112A-1) and the lens 113 are closer to the skin side (+ X direction in the figure) and the change characteristics of each visible light source and the common polarization characteristics (for example, laterally polarized light ) Having a first filter (filter 111-1). Of the plurality of visible light sources, a second filter (filter 111-2) having a polarization characteristic (for example, longitudinally polarized light) perpendicular to the first filter is provided on the skin side of the second visible light source (for example, LED 112A-5). Is provided.
 この例の光学配置において、制御部150は、複数の可視光光源および1以上の紫外光光源を選択的に点灯させる。具体的には、第1のモードにおいては、LED112A-1、LED112A-2、LED112A-3、LED112A-4を点灯させ、第2のモードにおいてはLED112A-5およびLED112A-6を点灯させ、第3のモードにおいては、LED112B-1~LED112B-4の4個を点灯させる。 In the optical arrangement of this example, the control unit 150 selectively turns on a plurality of visible light sources and one or more ultraviolet light sources. Specifically, in the first mode, the LEDs 112A-1, 112A-2, 112A-3, and 112A-4 are turned on. In the second mode, the LEDs 112A-5 and 112A-6 are turned on, and the third In this mode, the four LEDs 112B-1 to 112B-4 are turned on.
 上述した光学配置は例示にすぎない。例えば、適用する偏光フィルタを切替えるのではなく、光源やフィルタの位置を移動させる機構を設け、あるいは偏光子を用いて偏光特性を制御することによって、各モードに対応する複数の光学配置を実現してもよい。 The optical arrangement described above is merely an example. For example, instead of switching the polarization filter to be applied, a mechanism to move the position of the light source and filter is provided, or the polarization characteristics are controlled using a polarizer, thereby realizing a plurality of optical arrangements corresponding to each mode. May be.
 図4はカメラアダプタ100およびスマートフォン200の動作例である。まずユーザはスマートフォン200を操作し、カメラアダプタ100を制御するためのアプリケーションプログラム(以下、アプリという)を起動させておく。そして、測定内容(測定項目の種類とその実行順序)を規定する情報(以下、設定情報という)を入力するないし記憶部220から読み出すなどして、撮影開始の指示を入力する(S501)。この際、図5(a)に示すような案内画面がスマートフォン200に表示されてもよい。
 なお、測定項目に加えて、測定の実行順序をユーザが指定できるようにしてもよい。あるいは、制御部250は、指定された複数の測定項目に応じて所定のアルゴリズムに従って決定してもよい。
 さらに、その後、図5(b)のような案内画面を表示してもよい。また、測定実行中は、図5(c)のような案内を表示してもよい。
FIG. 4 shows an operation example of the camera adapter 100 and the smartphone 200. First, the user operates the smartphone 200 and activates an application program (hereinafter referred to as an application) for controlling the camera adapter 100. Then, information for specifying measurement contents (types of measurement items and execution order thereof) (hereinafter referred to as setting information) is input or read from the storage unit 220, and an instruction to start imaging is input (S501). At this time, a guidance screen as shown in FIG. 5A may be displayed on the smartphone 200.
In addition to the measurement items, the measurement execution order may be specified by the user. Alternatively, the control unit 250 may determine according to a predetermined algorithm according to a plurality of designated measurement items.
Further, after that, a guidance screen as shown in FIG. 5B may be displayed. Further, during measurement, guidance as shown in FIG. 5C may be displayed.
 以下、設定情報が、光学的測定を3種類、非光学的測定を2種類行うことを規定している場合を例にとって説明する。 Hereinafter, the case where the setting information specifies that three types of optical measurements and two types of non-optical measurements are performed will be described as an example.
 上記設定情報に基づいて、スマートフォン200はカメラアダプタ100へ最初に実行すべきモードを示す制御信号を送信する(S503)。ここでは第1モードが指定されたと仮定する。カメラアダプタ100は、この制御信号に従って、光学系110の光学配置の設定ないし切替を実行し、所定期間(例えば0.5秒間)待機した後(S505)、撮影の準備が整ったことを示す確認信号ACKをスマートフォン200へ送信する(S507)。所定期間待機するのは、光源を予熱するなど光学モジュールが最適な性能を発揮するための処理を行うためである。 Based on the setting information, the smartphone 200 transmits a control signal indicating a mode to be executed first to the camera adapter 100 (S503). Here, it is assumed that the first mode is designated. The camera adapter 100 performs setting or switching of the optical arrangement of the optical system 110 according to this control signal, waits for a predetermined period (for example, 0.5 seconds) (S505), and confirms that the preparation for photographing is ready. A signal ACK is transmitted to the smartphone 200 (S507). The reason for waiting for a predetermined period is to perform processing for the optical module to exhibit optimum performance, such as preheating the light source.
 スマートフォン200は、確認信号ACKを受信したことを契機として、撮像を実行し、生成した画像データを記憶する(S509)。続いて、設定情報に従って次の測定項目を実行すべく、スマートフォン200はモードの切替命令をカメラアダプタ100へ送信する(S511)。切替命令を受信すると、カメラアダプタ100は、モードの切替および必要な待機を行い(S513)、測定の準備が完了すると確認信号ACKをスマートフォン200へ送信する(S515)。スマートフォン200は、確認信号ACKを受信すると、第2モードでの撮像を行ってその画像データを記憶する(S517)。 The smartphone 200 executes the image capturing upon receipt of the confirmation signal ACK and stores the generated image data (S509). Subsequently, in order to execute the next measurement item according to the setting information, the smartphone 200 transmits a mode switching command to the camera adapter 100 (S511). Upon receiving the switching command, the camera adapter 100 performs mode switching and necessary standby (S513), and transmits a confirmation signal ACK to the smartphone 200 when preparation for measurement is completed (S515). When receiving the confirmation signal ACK, the smartphone 200 performs imaging in the second mode and stores the image data (S517).
 続いて、設定情報に従って次の撮影を行うべく、切替命令をカメラアダプタ100へ送信する(S519)。カメラアダプタ100において同様にモード切替および必要な待機を行い(S521)、準備が完了すると確認信号ACKをスマートフォン200へ送信する(S523)。確認信号ACKを受信したスマートフォン200では、第3モードにて撮像を行われ、画像データが記憶される(S525)。
 続いて、200は設定情報に従って、次の測定項目が水分量測定であると判定し、水分量測定命令をカメラアダプタ100へ送信する(S527)。水分量測定命令を受信すると、カメラアダプタ100は、水分量測定を実行し(S529)、その測定結果のデータをスマートフォン200へ送信する(S531)。スマートフォン200は受信した測定データを記憶する(S533)。
Subsequently, a switching command is transmitted to the camera adapter 100 to perform the next shooting according to the setting information (S519). Similarly, the camera adapter 100 performs mode switching and necessary standby (S521), and transmits a confirmation signal ACK to the smartphone 200 when preparation is completed (S523). The smartphone 200 that has received the confirmation signal ACK performs imaging in the third mode and stores image data (S525).
Subsequently, 200 determines that the next measurement item is water content measurement according to the setting information, and transmits a water content measurement command to the camera adapter 100 (S527). Upon receiving the moisture content measurement command, the camera adapter 100 performs moisture content measurement (S529), and transmits the measurement result data to the smartphone 200 (S531). The smartphone 200 stores the received measurement data (S533).
 続いて、スマートフォン200は設定情報に従って弾力測定命令をカメラアダプタ100へ送信する(S535)。弾力測定命令を受信すると、カメラアダプタ100は弾力測定を実行し(S537)、その測定結果のデータをスマートフォン200に送信する(S539)。スマートフォン200は、受信した測定データを記憶する(S541)。 Subsequently, the smartphone 200 transmits an elasticity measurement command to the camera adapter 100 according to the setting information (S535). Upon receiving the elasticity measurement command, the camera adapter 100 performs elasticity measurement (S537), and transmits the measurement result data to the smartphone 200 (S539). The smartphone 200 stores the received measurement data (S541).
 スマートフォン200は、設定情報に基づいて全ての項目の測定が終了したと判定すると、一連の測定において取得した測定データを解析し、必要に応じて加工・編集し、測定結果を画面に表示する(S543)。なお、図5(d)のような画面を表示してユーザに測定終了を通知してもよい。なお、終了の通知は、音声や振動を用いても行われてもよい。 When the smartphone 200 determines that the measurement of all items has been completed based on the setting information, the smartphone 200 analyzes the measurement data acquired in a series of measurements, processes and edits as necessary, and displays the measurement results on the screen ( S543). Note that the user may be notified of the end of measurement by displaying a screen as shown in FIG. Note that the end notification may be performed using voice or vibration.
 図5(e)は測定結果の表示の一例である。この例では、肌状態は、測定項目ごとに点数化され総合的な指標(点数)がチャートで示されている。 FIG. 5E is an example of the display of the measurement result. In this example, the skin condition is scored for each measurement item, and a comprehensive index (score) is shown in the chart.
 上記実施例によれば、スマートフォン200で制御アプリを起動すると、カメラアダプタ100の制御(光学配置の変更)とスマートフォン200の制御(撮影の実行タイミング)が連動して行われる。この結果、一連の測定のなかに複数種類の測定が含まれている場合であっても、ユーザが切替操作を行う必要がない。これにより、汎用の撮影装置では取得が難しかった、複数種類の光学測定の結果に基づく詳細な肌情報を取得することができる。また、切替操作が不要であるか、手振れによる判定精度の低下の心配もない。また、汎用の携帯端末にカメラアダプタ100を取り付けることで実現することができるので、手軽である。
 さらに、非光学的測定手法を光学測定と併せて用いることで、カメラ機能を有する汎用の情報通信端末機器では取得できない肌に関する情報を取得することができる。
According to the above-described embodiment, when the control application is activated on the smartphone 200, the control of the camera adapter 100 (change in optical arrangement) and the control of the smartphone 200 (shooting execution timing) are performed in conjunction. As a result, even when a plurality of types of measurements are included in a series of measurements, the user does not need to perform a switching operation. This makes it possible to acquire detailed skin information based on the results of a plurality of types of optical measurements, which was difficult to acquire with a general-purpose imaging device. In addition, there is no fear that the switching operation is unnecessary or the determination accuracy is lowered due to camera shake. Moreover, since it can implement | achieve by attaching the camera adapter 100 to a general purpose portable terminal, it is easy.
Furthermore, by using a non-optical measurement method in combination with optical measurement, it is possible to acquire information about skin that cannot be acquired by a general-purpose information communication terminal device having a camera function.
 肌は場所によってその状態が異なり得ることを踏まえ、複数の部位を測定できるようにしてもよい。
 具体的には、測定開始前において設定情報を生成する際に、図5(f)のような画面を表示し、ユーザに測定対象の部位や測定順序を指定させる。この例ではオブジェクトOB21~OB24の位置を指定することで、部位と順序を指定することができるようになっている。
 なお、同一の測定項目で複数の部位について測定を行う場合、図5(g)のような画面を表示し、または音声メッセージによって、100を当てる位置の調整およびその位置の確定を行うように案内してもよい。
 また、複数部位を測定した場合、図5(h)のように、部位ごとに、各項目の評価を表示してもよい。同図では、顔を表すオブジェクトOB1と、3つの測定部位に対応するOB2~OB4を表示し、評価を点数として表現している。
Based on the fact that the state of the skin may differ depending on the location, a plurality of sites may be measured.
Specifically, when setting information is generated before the start of measurement, a screen as shown in FIG. 5F is displayed, and the user is allowed to specify a measurement target region and a measurement order. In this example, the position and the order can be specified by specifying the positions of the objects OB21 to OB24.
When measuring a plurality of parts with the same measurement item, a screen as shown in FIG. 5G is displayed, or guidance is given to adjust the position to which 100 is applied and confirm the position by a voice message. May be.
When a plurality of parts are measured, the evaluation of each item may be displayed for each part as shown in FIG. In the figure, an object OB1 representing a face and OB2 to OB4 corresponding to three measurement sites are displayed, and the evaluation is expressed as a score.
 要するに、本発明に係るカメラアダプタは、撮像装置へ取り付けるための取付部と、少なくとも受光した光を前記撮像装置へ導く光学系と、前記撮像装置から制御信号を受信する受信部と前記受信部にて受信された制御信号に基づいて前記光学系を調整する制御部とを有していればよい。
 換言すると、本発明は、データ送信部および撮像部を備えた端末のコンピュータに、当該端末に取り付けられたカメラアダプタに対して制御信号を送信するステップと、前記カメラアダプタにおいて、受信した制御信号に基づいて前記光学系を調整するステップと、前記カメラアダプタが、前記光学系の調整が完了したことを前記端末へ通知するステップとを実行させるためのプログラムを提供する。
In short, a camera adapter according to the present invention includes an attachment portion for attachment to an imaging device, an optical system that guides at least received light to the imaging device, a reception portion that receives a control signal from the imaging device, and the reception portion. And a control unit that adjusts the optical system based on the received control signal.
In other words, the present invention includes a step of transmitting a control signal to a computer of a terminal having a data transmission unit and an imaging unit to a camera adapter attached to the terminal, and the received control signal in the camera adapter. A program for executing the step of adjusting the optical system based on the information and the step of notifying the terminal that the adjustment of the optical system is completed by the camera adapter is provided.
 <第2実施例>
 図6は測定システム20の概要図である。測定システム20は、PC400とスコープカメラ300を含む。スコープカメラ300には、スイッチ370と通知部390とが設けられている。スコープカメラ300とPC400とは通信ケーブル500を介して接続され、情報の授受ができるようになっている。
<Second embodiment>
FIG. 6 is a schematic diagram of the measurement system 20. The measurement system 20 includes a PC 400 and a scope camera 300. The scope camera 300 is provided with a switch 370 and a notification unit 390. The scope camera 300 and the PC 400 are connected via a communication cable 500 so that information can be exchanged.
 図7は測定システム20の機能ブロック図である。スコープカメラ300は、水分量測定部320と弾力測定部330と制御部350と撮像部360とスイッチ370と記憶部380と第1通信部341と第2通信部342とを含む。 FIG. 7 is a functional block diagram of the measurement system 20. The scope camera 300 includes a moisture amount measurement unit 320, an elasticity measurement unit 330, a control unit 350, an imaging unit 360, a switch 370, a storage unit 380, a first communication unit 341, and a second communication unit 342.
 スイッチ370は、スコープカメラ300の筐体に設けられた物理的スイッチであって、ユーザの操作を受付ける。ユーザはスイッチ370を操作して、測定の開始、終了、中断、モードの切替えなどをスコープカメラ300に指示することができる。入力された操作を表す信号は、第1通信部341を介してPC400へ送信される。これにより、400がスコープカメラ300の動作状態を把握することができる。
 従って、PC400が上述の設定情報を有している場合は、操作信号には、少なくとも測定モードの切替を示す信号が含まれていれば足りる。操作信号を受け取ったPC400は、設定情報を参照することにより、スコープカメラ300にて行われた操作およびこの直後に受信するデータがどの測定項目に対応するデータなのかを認識することができるからである。
The switch 370 is a physical switch provided in the casing of the scope camera 300 and accepts a user operation. The user can operate the switch 370 to instruct the scope camera 300 to start, end, interrupt, and change modes. A signal representing the input operation is transmitted to the PC 400 via the first communication unit 341. Thereby, 400 can grasp the operating state of the scope camera 300.
Therefore, when the PC 400 has the above setting information, it is sufficient that the operation signal includes at least a signal indicating switching of the measurement mode. The PC 400 that has received the operation signal can recognize which measurement item corresponds to the operation performed by the scope camera 300 and the data received immediately after that by referring to the setting information. is there.
 なお、操作信号に、測定項目の切替えや切替え後の測定項目を示す情報が含まれている場合は、PC400が設定情報を有していなくても、操作信号のみに基づいてスコープカメラ300の動作情報を把握することができる。
 要するに、スコープカメラ300の動作状態をPC400が把握できるように、操作信号がスコープカメラ300からPC400に供給されるようになっていればよい。
When the operation signal includes information indicating measurement item switching or measurement item after switching, the operation of the scope camera 300 based on only the operation signal even if the PC 400 does not have setting information. Information can be grasped.
In short, an operation signal may be supplied from the scope camera 300 to the PC 400 so that the PC 400 can grasp the operation state of the scope camera 300.
 第1通信部341は、WiFiやBluetooth(登録商標)などの通信規格に従って、PC400との間で制御に関する情報の授受を行うための通信モジュールである。具体的には、第1通信部341はスイッチ370にて入力された操作信号を送信するとともに、PC400から確認信号ACKを受信する。
 第2通信部342は、USBやイーサーネット等の通信規格に従って、通信ケーブル500を用いて、PC400との間で、スコープカメラ300にて測定されたデータをPC400へ転送を行うための通信モジュールや接続端子として実現される。
 なお、第1通信部341および第2通信部342は、各々、有線通信でも無線通信でも構わないが、少なくとも撮像部360にて生成された肌画像のデータについては、第2通信部342を介して送信される。よって、第2通信部342は、第1通信部341よりもデータ転送速度や転送量における能力が高いことが好ましい。
The first communication unit 341 is a communication module for exchanging information related to control with the PC 400 in accordance with a communication standard such as WiFi or Bluetooth (registered trademark). Specifically, the first communication unit 341 transmits the operation signal input by the switch 370 and receives the confirmation signal ACK from the PC 400.
The second communication unit 342 is a communication module for transferring data measured by the scope camera 300 to the PC 400 using the communication cable 500 according to a communication standard such as USB or Ethernet. Realized as a connection terminal.
The first communication unit 341 and the second communication unit 342 may be wired communication or wireless communication, respectively, but at least the skin image data generated by the imaging unit 360 is transmitted via the second communication unit 342. Sent. Therefore, it is preferable that the second communication unit 342 has a higher capability in data transfer speed and transfer amount than the first communication unit 341.
 撮像部360は、光源群361とレンズ362と受光素子363と撮像制御部364と画像処理部365とフィルタ群366とを含み、切替え可能な複数の光学系を有する。一例において、撮像部360は、撮像部210と光学系110とを統合したものと同等の機能を有する。要するに、複数の測定モードが容易されていて、ユーザにより切替可能となっていればよい。 The imaging unit 360 includes a light source group 361, a lens 362, a light receiving element 363, an imaging control unit 364, an image processing unit 365, and a filter group 366, and has a plurality of switchable optical systems. In one example, the imaging unit 360 has a function equivalent to that obtained by integrating the imaging unit 210 and the optical system 110. In short, it is sufficient that a plurality of measurement modes are facilitated and can be switched by the user.
 制御部350は、光源群361およびフィルタ群366に対して、設定および設定の切替指示を行うとともに、撮像制御部364およびレンズ362に対して撮像の実行タイミングを命令する。 The control unit 350 instructs the light source group 361 and the filter group 366 to set and change the setting, and instructs the imaging control unit 364 and the lens 362 to perform imaging.
 通知部390は、LED等の発光デバイスや液晶ディスプレイ等によって実現され、PC400からモードの切替命令を受信したことをユーザに報知する。 The notification unit 390 is realized by a light emitting device such as an LED, a liquid crystal display, or the like, and notifies the user that a mode switching command has been received from the PC 400.
 記憶部380は、半導体メモリ等の記憶デバイスであって、設定情報が記憶される。 The storage unit 380 is a storage device such as a semiconductor memory, and stores setting information.
 水分量測定部320は、水分量測定部120と同等の機能を有する。弾力測定部330は、弾力測定部130と同等の機能を有する。 The water content measuring unit 320 has the same function as the water content measuring unit 120. The elasticity measuring unit 330 has the same function as the elasticity measuring unit 130.
 すなわち、スコープカメラ300は、カメラアダプタ100に、スマートフォン200の撮像機能とユーザの操作を受付ける機能と2系統による通信機能を加えた構成であると把握できる。 That is, it can be understood that the scope camera 300 has a configuration in which the camera adapter 100 is added with an imaging function of the smartphone 200, a function of accepting a user operation, and a two-system communication function.
 PC400は、例えば汎用PCであって、PC400は、第1通信部411と第2通信部412と制御部440と記憶部430と表示部420を含む。
 第1通信部411は、WiFiやBluetooth(登録商標)などの通信規格に従って、スコープカメラ300との間で制御に関する情報の授受を行うための通信モジュールである。具体的には、441は操作信号を送信するとともに、スコープカメラ300へ確認信号ACKを送信する。
 第2通信部412は、USBやイーサーネット等の通信規格に従って、通信ケーブル500を介して、スコープカメラ300から測定データを受信するための通信モジュールや接続端子として実現される。
The PC 400 is a general-purpose PC, for example. The PC 400 includes a first communication unit 411, a second communication unit 412, a control unit 440, a storage unit 430, and a display unit 420.
The first communication unit 411 is a communication module for exchanging information related to control with the scope camera 300 in accordance with a communication standard such as WiFi or Bluetooth (registered trademark). Specifically, 441 transmits an operation signal and transmits a confirmation signal ACK to the scope camera 300.
The second communication unit 412 is realized as a communication module or a connection terminal for receiving measurement data from the scope camera 300 via the communication cable 500 in accordance with a communication standard such as USB or Ethernet.
 表示部420は、ディスプレイであって、設定情報の入力、読み出し、実行されている処理状況の通知、測定結果の表示等に用いられる。記憶部430は、ハードディスクや半導体であって、設定情報および測定データを記憶する。制御部440は、プロセッサであって、測定データに対して解析・編集等の処理行って、描画用データを生成する。
 入力部450は、キーボードやマウスであって、ユーザが設定情報の入力等に行うために用いられる。
The display unit 420 is a display, and is used for input and reading of setting information, notification of processing status being executed, display of measurement results, and the like. The storage unit 430 is a hard disk or a semiconductor and stores setting information and measurement data. The control unit 440 is a processor, and performs processing such as analysis / editing on the measurement data to generate drawing data.
The input unit 450 is a keyboard or a mouse, and is used by a user to input setting information.
 図8は測定システム20の動作例である。なお、同図の破線は無線による通信であることを、実線は有線による通信であることを示す。
 ユーザは、PC400を操作して所定のアプリを起動するなどして、設定情報を読み出しておく。PC400は、スコープカメラ300から操作信号を受付ける状態となる(S600)。次に、ユーザがスイッチ370を操作して、測定を開始するための操作を行うと(S601)、操作信号がPC400へ第1通信部341を介して送信される(S603)。PC400は操作信号を初めて受信したので、設定情報に基づく測定が開始されたと判定する。
FIG. 8 shows an operation example of the measurement system 20. In addition, the broken line of the figure shows that the communication is wireless, and the solid line shows that the communication is wired.
The user reads the setting information by operating the PC 400 to activate a predetermined application. The PC 400 is in a state of receiving an operation signal from the scope camera 300 (S600). Next, when the user operates the switch 370 to perform an operation for starting measurement (S601), an operation signal is transmitted to the PC 400 via the first communication unit 341 (S603). Since the PC 400 has received the operation signal for the first time, it is determined that the measurement based on the setting information has started.
 スコープカメラ300は、ユーザがスイッチ370を用いて指定したモードを適用して撮影を実行する(S605)。撮影が完了すると、その画像データ画像が第2通信部342を介してPC400へ送信される(S607)。
 PC400は、先に受信した操作信号および設定情報に基づいて、受信した測定データが、設定情報に記述された第1番目の測定にて得られたデータであると認識しているから、第1番目の測定項目(例えば「シミ測定」)を示すインデックスを付して、当該測定データを保存する(S609)。
The scope camera 300 executes shooting by applying the mode specified by the user using the switch 370 (S605). When shooting is completed, the image data image is transmitted to the PC 400 via the second communication unit 342 (S607).
The PC 400 recognizes that the received measurement data is the data obtained in the first measurement described in the setting information based on the previously received operation signal and setting information. An index indicating the second measurement item (for example, “stain measurement”) is attached, and the measurement data is stored (S609).
 PC400は、設定情報を参照し、次の測定項目が存在する場合、第1通信部411を介してスコープカメラ300にモードの切替命令を送信する(S611)。スコープカメラ300は、切替命令を受信するとユーザへ通知し、この通知をうけたユーザは、切替操作が必要であると認識する。ユーザは、必要に応じてPC400の画面を見ながら、スイッチ370を操作することによってモードを切替ると、操作信号がPC400へ送信されるとともにS614、切替えが実行され(S615)、切替え後のモードで測定が実行され(S616)、測定データがPC400へ送信される(S617)。
 PC400は設定情報に記述された2番目の測定結果であることを示すインデックスを付与して受信した測定データを保存する(S618)。
 PC400は設定情報を確認して、次の測定項目が存在する場合、切替命令を送信する(S619)。
The PC 400 refers to the setting information, and when there is a next measurement item, the PC 400 transmits a mode switching command to the scope camera 300 via the first communication unit 411 (S611). When receiving the switching command, the scope camera 300 notifies the user, and the user who receives this notification recognizes that the switching operation is necessary. When the user switches the mode by operating the switch 370 while viewing the screen of the PC 400 as necessary, an operation signal is transmitted to the PC 400 and the switching is executed in S614 (S615). Then, measurement is executed (S616), and measurement data is transmitted to the PC 400 (S617).
The PC 400 stores the received measurement data with an index indicating that it is the second measurement result described in the setting information (S618).
The PC 400 confirms the setting information, and if there is a next measurement item, transmits a switching command (S619).
 このように、全ての測定項目が終了したとPC400が判定するまで、S612、S613、S615、S616、S617、S618、S619のステップが繰り返される。
 PC400は、全ての項目が終了したと判定した場合(S630)、あるいはスイッチ370にて入力された、測定の終了を指示する操作信号を受信した場合(S629)、測定日時に関連付けて一つのフォルダに纏めるなどして、保存した一連のデータを関連付けて保存する。
In this way, steps S612, S613, S615, S616, S617, S618, and S619 are repeated until the PC 400 determines that all measurement items have been completed.
When the PC 400 determines that all items have been completed (S630), or receives an operation signal instructing the end of measurement input through the switch 370 (S629), one folder is associated with the measurement date and time. For example, the stored series of data is stored in association with each other.
 第2実施例によれば、スコープカメラ300とPC400が連動して動作し、ユーザは通知に従ってスコープカメラ300の操作を行えばよいので、多様な種類の測定を簡単に行うことができる。一方、PC400は一連の測定に複数種類の測定項目が含まれている場合であっても、スコープカメラ300から送られてきた測定データがどの種類の測定の結果を示すものであるかを確実に把握することができる。 According to the second embodiment, the scope camera 300 and the PC 400 operate in conjunction with each other, and the user only has to operate the scope camera 300 in accordance with the notification. Therefore, various types of measurements can be easily performed. On the other hand, even if a plurality of types of measurement items are included in a series of measurements, the PC 400 reliably determines which type of measurement results the measurement data sent from the scope camera 300 indicates. I can grasp it.
 また、通信経路を2系統設け、データ量の比較的小さい制御信号は無線通信によって送信する一方、データ量の比較的大きい画像データの送信は有線通信によって行うことにより、効率的にデータ転送を行うことができる。加えて、画像データの送受信処理部分については、USB接続等の既存のデータ転送用ドライバプログラムを利用することができるので、PC400でスコープカメラ300と通信を行うための制御プログラムが容易に作成できる。 In addition, two communication paths are provided, and control signals with a relatively small amount of data are transmitted by wireless communication, while image data having a relatively large amount of data is transmitted by wired communication, thereby efficiently transferring data. be able to. In addition, since an existing data transfer driver program such as a USB connection can be used for the image data transmission / reception processing portion, a control program for communicating with the scope camera 300 by the PC 400 can be easily created.
 上述したスコープカメラ300を用いた測定の内容、種類、項目数は、例示にすぎない。要するに、本発明に係る撮像装置は、情報処理装置と、複数の光学系を切替え可能な撮像部と、当該光学系を切替えるための操作部と、報知部とを有する撮影装置と、当該情報処理装置と通信を行う通信部とを備えた撮像装置とを備えた測定システムにおいて、撮像装置にてユーザの操作を受付けると操作信号を情報処理装置に送信するステップと、受信した操作信号に基づいて光学系の切替を指示する信号を撮像装置に送信するステップとが行われていればよい。 The measurement content, type, and number of items using the scope camera 300 described above are merely examples. In short, an imaging apparatus according to the present invention includes an information processing apparatus, an imaging unit capable of switching a plurality of optical systems, an operation unit for switching the optical systems, and a notification unit, and the information processing. In a measurement system including an imaging device including a communication unit that communicates with the device, a step of transmitting an operation signal to the information processing device when a user operation is accepted by the imaging device, and based on the received operation signal And a step of transmitting a signal instructing switching of the optical system to the imaging apparatus.
 <変形例>
 第1実施例および第2実施例において示した光学系は一例にすぎない。具体的には、光学系を構成する光学モジュールの種類、数、特性は任意である。また、測定の種類、方式、項目数は任意である。目的に応じて測定手段を設定すればよい。例えば、光学的測定の3つもモード種類のうち、一部を省略してもよいし、新たなモードを設定してもよい。同様に、測定項目として肌の油分量を測定するセンサをさらに設けてもよいし、一部の測定項目の実行を省略してもよい。
<Modification>
The optical systems shown in the first and second examples are only examples. Specifically, the type, number, and characteristics of the optical modules constituting the optical system are arbitrary. In addition, the measurement type, method, and number of items are arbitrary. What is necessary is just to set a measurement means according to the objective. For example, some of the three types of optical measurements may be omitted, or a new mode may be set. Similarly, a sensor for measuring the oil content of the skin may be further provided as a measurement item, or execution of some measurement items may be omitted.

Claims (10)

  1.  撮像装置へ取り付けるための取付部と、
     少なくとも受光した光を前記撮像装置へ導く光学系と、
     前記撮像装置から制御信号を受信する受信部と、
     前記受信部にて受信された制御信号に基づいて前記光学系を調整する制御部と
     を有するカメラアダプタ。
    A mounting portion for mounting to the imaging device;
    An optical system for guiding at least received light to the imaging device;
    A receiving unit for receiving a control signal from the imaging device;
    And a controller that adjusts the optical system based on a control signal received by the receiver.
  2.  前記光学系は、波長特性の異なる複数の光源と、偏光特性の異なる複数の偏光フィルタとを含み、
     前記制御部は、一の光源と、当該一の光源の偏光フィルタと、受光した光に対して適用する偏光フィルタとのうち、少なくともいずれか一つを選択する、
     請求項1に記載のカメラアダプタ。
    The optical system includes a plurality of light sources having different wavelength characteristics and a plurality of polarizing filters having different polarization characteristics,
    The control unit selects at least one of one light source, a polarizing filter of the one light source, and a polarizing filter applied to received light.
    The camera adapter according to claim 1.
  3.  前記光学系は、可視光光源と紫外光光源とを含み、
     前記制御信号は、撮影対象の肌に照射された前記可視光光源の、当該肌の表面からの反射光を検出する第1のモードと、前記肌に照射された前記可視光光源の、当該肌の内部からの散乱光を検出する第2のモードと、前記肌に照射された前記紫外光光源の、当該肌の表面からの反射光を検出する第3のモードのいずれか一つを指定する、
     請求項1に記載のカメラアダプタ。
    The optical system includes a visible light source and an ultraviolet light source,
    The control signal includes a first mode of detecting reflected light from the surface of the skin of the visible light source irradiated to the skin to be imaged, and the skin of the visible light source irradiated to the skin. One of a second mode for detecting scattered light from the inside of the skin and a third mode for detecting reflected light from the surface of the skin of the ultraviolet light source irradiated on the skin. ,
    The camera adapter according to claim 1.
  4.  前記肌の水分量を計測する手段を更に備える
     請求項3記載のカメラアダプタ。
    The camera adapter according to claim 3, further comprising means for measuring the moisture content of the skin.
  5.  前記肌の弾力を計測する手段を更に備える
     請求項3または4に記載のカメラアダプタ。
    The camera adapter according to claim 3, further comprising means for measuring the elasticity of the skin.
  6.  前記可視光光源には、白色光光源と青色光源とが含まれる、
     請求項3~5のいずれか一つに記載のカメラアダプタ。
    The visible light source includes a white light source and a blue light source.
    The camera adapter according to any one of claims 3 to 5.
  7.  前記光学系は、
     検出した光を前記撮像装置へ導くレンズと、
     前記レンズの近傍に配置された、1以上の紫外光光源と複数の可視光光源と、
     前記複数の可視光源のうち第1の可視光源および前記レンズの肌側に設けられた、共通の偏光特性を有する第1フィルタと、
     前記複数の可視光光源のうち第2の可視光源の前記肌側に設けられた、前記第1フィルタと直行する変更特性を有する第2フィルタと
     を有し、
     前記制御部は、前記複数の可視光光源および前記1以上の紫外光光源を選択的に点灯させる
     請求項3~6のいずれか一つに記載のカメラアダプタ。
    The optical system is
    A lens for guiding the detected light to the imaging device;
    One or more ultraviolet light sources and a plurality of visible light sources disposed in the vicinity of the lens;
    A first filter having a common polarization characteristic provided on a skin side of the first visible light source and the lens among the plurality of visible light sources;
    A second filter provided on the skin side of a second visible light source among the plurality of visible light sources, and having a change characteristic orthogonal to the first filter;
    The camera adapter according to any one of claims 3 to 6, wherein the control unit selectively turns on the plurality of visible light sources and the one or more ultraviolet light sources.
  8.  データ送信部および撮像部を備えた端末と、
     前記端末に取り付けられるカメラアダプタと
     を備え、
     前記カメラアダプタは、
     少なくとも受光した光を前記端末へ導く、複数の光学系と、
     前記端末から送信された制御信号を受信する受信部と
     前記受信部にて受信された制御信号に基づいて前記光学系を調整する制御部と
     を有する
     撮像システム。
    A terminal including a data transmission unit and an imaging unit;
    A camera adapter attached to the terminal,
    The camera adapter is
    A plurality of optical systems for guiding at least received light to the terminal;
    An imaging system comprising: a receiving unit that receives a control signal transmitted from the terminal; and a control unit that adjusts the optical system based on the control signal received by the receiving unit.
  9.  データ送信部および撮像部を備えた端末から、当該端末に取り付けられたカメラアダプタに対して制御信号を送信するステップと、
     前記カメラアダプタにおいて、受信した制御信号に基づいて光学系を調整するステップと、
     前記カメラアダプタが、前記光学系の調整が完了したことを前記端末へ通知するステップと
     を有する撮像方法。
    Transmitting a control signal from a terminal including a data transmission unit and an imaging unit to a camera adapter attached to the terminal;
    Adjusting the optical system based on the received control signal in the camera adapter;
    And a step of notifying the terminal that the adjustment of the optical system is completed by the camera adapter.
  10.  無線通信部および撮像部を備えた端末のコンピュータに、
     当該端末に取り付けられ、無線通信機能を有し、光学系の調整が可能なカメラアダプタに対して、制御信号を送信するステップと、
     前記カメラアダプタにおいて該送信された制御信号に従って前記光学系の調整が完了したことを示す信号を、前記カメラアダプタから受信するステップと を実行させるためのプログラム。
    To the computer of the terminal equipped with a wireless communication unit and an imaging unit,
    Transmitting a control signal to a camera adapter attached to the terminal and having a wireless communication function and capable of adjusting an optical system;
    Receiving from the camera adapter a signal indicating that the adjustment of the optical system is completed in accordance with the transmitted control signal in the camera adapter.
PCT/JP2019/002002 2018-02-21 2019-01-23 Imaging system, imaging method, camera adaptor, and program WO2019163373A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-028431 2018-02-21
JP2018028431A JP6966953B2 (en) 2018-02-21 2018-02-21 Imaging system, imaging method and program

Publications (1)

Publication Number Publication Date
WO2019163373A1 true WO2019163373A1 (en) 2019-08-29

Family

ID=67686793

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/002002 WO2019163373A1 (en) 2018-02-21 2019-01-23 Imaging system, imaging method, camera adaptor, and program

Country Status (2)

Country Link
JP (1) JP6966953B2 (en)
WO (1) WO2019163373A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6891360B1 (en) * 2021-01-05 2021-06-18 アイティアクセス株式会社 Shooting assistance jig and skin shooting device

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023018259A1 (en) * 2021-08-11 2023-02-16 고려대학교 산학협력단 Diagnosis method and apparatus for remotely diagnosing skin disease by using augmented reality and virtual reality
KR20230100508A (en) * 2021-12-28 2023-07-05 삼성전자주식회사 An electronic device for providing information on skin oil and/or moisture by using at least one image obtained using visible light and method for controlling the same

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003210416A (en) * 2002-01-28 2003-07-29 Wave Cyber:Kk Comprehensive skin measuring instrument
WO2006049192A1 (en) * 2004-11-05 2006-05-11 Ya-Man Ltd. Skin treatment apparatus
JP2009000494A (en) * 2007-05-23 2009-01-08 Noritsu Koki Co Ltd Porphyrin detection method, porphyrin display method, and porphyrin detector
WO2014103954A1 (en) * 2012-12-27 2014-07-03 日立マクセル株式会社 Lens module and portable photography device
JP2015197617A (en) * 2014-04-02 2015-11-09 株式会社Cmサイト close-up adapter

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015060376A1 (en) * 2013-10-23 2015-04-30 日立マクセル株式会社 Information management system for surface condition measurement and analysis and information management method for surface condition measurement and analysis
JP6566240B2 (en) * 2015-04-16 2019-08-28 ソニー株式会社 Information processing apparatus, information processing method, and program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003210416A (en) * 2002-01-28 2003-07-29 Wave Cyber:Kk Comprehensive skin measuring instrument
WO2006049192A1 (en) * 2004-11-05 2006-05-11 Ya-Man Ltd. Skin treatment apparatus
JP2009000494A (en) * 2007-05-23 2009-01-08 Noritsu Koki Co Ltd Porphyrin detection method, porphyrin display method, and porphyrin detector
WO2014103954A1 (en) * 2012-12-27 2014-07-03 日立マクセル株式会社 Lens module and portable photography device
JP2015197617A (en) * 2014-04-02 2015-11-09 株式会社Cmサイト close-up adapter

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6891360B1 (en) * 2021-01-05 2021-06-18 アイティアクセス株式会社 Shooting assistance jig and skin shooting device
WO2022149193A1 (en) * 2021-01-05 2022-07-14 アイティアクセス株式会社 Imaging assistance tool and skin imaging device

Also Published As

Publication number Publication date
JP2019141321A (en) 2019-08-29
JP6966953B2 (en) 2021-11-17

Similar Documents

Publication Publication Date Title
WO2019163373A1 (en) Imaging system, imaging method, camera adaptor, and program
JP5447364B2 (en) Interchangeable lens, camera body and camera system
EP3151553A1 (en) A self-calibrating projection apparatus and process
JP5030462B2 (en) Digital camera system
JP5423716B2 (en) Head mounted display
US9792710B2 (en) Display device, and method of controlling display device
US20110267432A1 (en) Camera and camera system
US20160269578A1 (en) Head mounted display apparatus and method for connecting head mounted display apparatus to external device
US9426368B2 (en) Communication system and camera system
US10712636B2 (en) Polarization acquisition apparatus, image capturing apparatus and image capturing system
WO2013146862A1 (en) Head-mounted display and computer program
US11580639B2 (en) Electronic device for measuring skin condition of user and method for operating same
JP6295995B2 (en) Job instruction method to information processing apparatus and image processing apparatus
KR102512839B1 (en) Electronic device and method obtaining image using cameras through adjustment of position of external device
US20170191827A1 (en) Measuring system and operating method thereof
CN109478225A (en) Reading device, program and unit
JP6444024B2 (en) Drive unit and system having the drive unit
EP2833353B1 (en) Display processing terminal device, photosensor-equipped unit, and photometric system
JP2019053644A (en) Head mounted display device and control method for head mounted display device
KR102600509B1 (en) Electronic Device and the Method for Guiding information related to Shooting thereof
JP5542461B2 (en) Vibration isolator
JP6779753B2 (en) Imaging system, imaging device, and its control method
KR20210058363A (en) Electronic device for using depth information and operating method thereof
US11079274B2 (en) Spectroscopic system
JP2019008176A (en) Imaging device and control method of the same, lens device and control method of the same, and imaging system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19757818

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19757818

Country of ref document: EP

Kind code of ref document: A1