WO2020241655A1 - Human skin tactile presentation device and method for setting vibration source signal in human skin tactile presentation device - Google Patents

Human skin tactile presentation device and method for setting vibration source signal in human skin tactile presentation device Download PDF

Info

Publication number
WO2020241655A1
WO2020241655A1 PCT/JP2020/020806 JP2020020806W WO2020241655A1 WO 2020241655 A1 WO2020241655 A1 WO 2020241655A1 JP 2020020806 W JP2020020806 W JP 2020020806W WO 2020241655 A1 WO2020241655 A1 WO 2020241655A1
Authority
WO
WIPO (PCT)
Prior art keywords
human skin
vibration
skin
finger
tactile
Prior art date
Application number
PCT/JP2020/020806
Other languages
French (fr)
Japanese (ja)
Inventor
直輝 齋藤
孝平 松森
建堯 張
優人 小林
裕之 梶本
Original Assignee
株式会社資生堂
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社資生堂 filed Critical 株式会社資生堂
Priority to JP2021522794A priority Critical patent/JP7457013B2/en
Publication of WO2020241655A1 publication Critical patent/WO2020241655A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones

Definitions

  • the present invention relates to a human skin tactile presentation device and a method for setting a vibration source signal in the human skin tactile presentation device.
  • Patent Document 1 proposes to mount a vibration device that generates vibrations in two directions on a hard resin operating device in order to give a more realistic tactile sensation in a game machine. Has been done.
  • Patent Document 2 also proposes a tactile reproduction method in which a reaction force, which is a sensation grasped by a game, is applied to a simulation device such as a game.
  • Patent Document 3 in order to convey the tactile sensation of a product including a soft product, a tactile sensation reproduction method is a communication tool that prepares an actual product, causes the device to detect it, and transmits the detected tactile sensation by vibration or the like via the device. Has been proposed.
  • human skin gel that is a sample that imitates human skin as an expression of the texture of the skin, but in order to express various skin conditions, a large number of human skin gels had to be prepared. .. In addition, even if a large number of human skin gels were prepared, there were cases where the skin quality to be expressed was not exactly the same.
  • the present invention is capable of reproducing an arbitrary skin condition with the same touching method as when actually touching the skin without preparing a large number of human skin gels.
  • the purpose is to provide the device.
  • a human skin gel that is provided on a propagating member that propagates vibration and that the subject's finger touches, A movement speed acquisition unit that acquires the movement speed of the finger on the human skin gel, A source signal storage unit that stores the source signal that is the source of vibration associated with human skin, A vibration adjusting unit that adjusts the magnitude of the amplitude of the original signal according to the moving speed of the finger. It is provided with a vibration output unit that converts the adjusted original signal into physical vibration and outputs it, and gives vibration to the human skin gel via the propagation member.
  • a human skin tactile presentation device that converts the adjusted original signal into physical vibration and outputs it, and gives vibration to the human skin gel via the propagation member.
  • the human skin tactile sensation presenting device it is possible to reproduce an arbitrary skin condition in the same way as when actually touching the skin without preparing a large number of human skin gels.
  • the front view of the human skin feeling presenting apparatus which concerns on 1st Embodiment of this invention is a side view of the human skin feeling presentation device of FIG.
  • the control sequence diagram in the human skin feeling presenting apparatus which concerns on 1st Embodiment of this invention.
  • FIG. 6 is a measurement diagram when acquiring vibration data when touching human skin as an actually measured value in the setting procedure of the original signal of FIG.
  • FIG. 6 is a measurement diagram when acquiring vibration data on a human skin gel in the setting procedure of the original signal of FIG.
  • a side perspective view of the human skin feeling presenting device according to the second embodiment of the present invention.
  • the schematic diagram which presents the human skin touch to a subject by the human skin touch presenting apparatus which concerns on 1st Embodiment of this invention.
  • the front view explaining the arrangement of the slide volume and the human skin gel in the human skin touch presenting apparatus which concerns on 2nd Embodiment of this invention.
  • the block diagram of the human skin feeling presenting apparatus which concerns on 2nd Embodiment of this invention.
  • the sequence diagram in the human skin touch presenting apparatus which concerns on 2nd Embodiment of this invention.
  • FIG. 6 is a schematic diagram in which a beauty advisor presents skin quality to a customer in counseling using the human skin tactile presentation device according to the third embodiment of the present invention.
  • the schematic diagram of the human skin feeling presentation network system which concerns on embodiment of this invention.
  • FIG. 1 is a side perspective view of the human skin touch presentation device 100 according to the first embodiment of the present invention.
  • the human skin tactile presentation device 100 includes a human skin gel 1, a camera 2, a PC 3, an amplifier 4, and a speaker 5.
  • the human skin gel 1 is a skin model (artificial skin) that imitates a predetermined state of human skin, which is a target to be touched by the finger F of the subject S (see FIG. 3), and has a softness similar to that of human skin. It is an ultra-soft urethane resin to express.
  • human skin gel 1 for example, Bioskin (registered trademark) (manufactured by Beaulux) is used.
  • the human skin gel 1 is attached and fixed to the propagation plate (propagation member) 11.
  • the propagation plate 11 is a member that supports the human skin gel 1 and propagates vibration, and is made of, for example, an acrylic plate.
  • the camera 2 is an example of an imaging device that acquires movement information of the finger F of the subject S (see FIG. 3) on the human skin gel 1.
  • the camera 2 is composed of, for example, Leap Motion (registered trademark), and functions as at least a part of a moving speed acquisition unit. Further, in this configuration, the camera 2 is supported by the camera support 22 above the human skin gel 1 at a position where it does not come into contact with the subject's hand.
  • the PC (Personal Computer) 3 is an example of an information processing device that is connected to the camera 2 and the amplifier 4 by wire or wirelessly. Based on the position of the finger acquired by the camera 2, the movement speed of the finger is calculated and obtained, and the strength of vibration is output.
  • the PC3 also has a function of a source signal storage unit that stores the source signal of vibration corresponding to the skin quality (tactile sensation) of human skin.
  • the original signal is a signal that is a source of vibration for generating vibration by the speakers 5A and 5B, and is a signal in the form of an audio signal that is associated with the skin type. Therefore, the PC 3 outputs to the amplifier 4 information on the strength of the original signal (audio signal) selected according to the skin type to be expressed and the signal intensity corresponding to the moving speed of the finger. That is, the PC3 is a vibration adjusting unit that adjusts the strength (amplitude value) of vibration when outputting vibration according to the original signal set according to the moving speed of the finger.
  • the amplifier (acoustic amplifier) 4 amplifies the original signal output from the PC 3 according to the intensity information.
  • the speaker 5 is connected to the amplifier 4 and is configured as a pair of left and right speakers 5A and 5B.
  • the speakers 5A and 5B are vibration output units that convert the adjusted audio signal into physical vibration and output it, and vibrate the human skin gel 1 via the propagation plate 11.
  • the speakers 5A and 5B are connected to the amplifier 4 by wire or wirelessly. Further, the speakers 5A and 5B are in contact with the propagation plate 11 of the device pedestal of the human skin gel 1 and are sandwiched so as to propagate the vibration to support the propagation plate 11.
  • the structure of the device pedestal that supports the speakers 5A and 5B and the human skin gel 1 will be described below together with FIG.
  • FIG. 2 is a front view of the human skin touch presentation device 100 of FIG. In FIG. 2, the PC 3 and the amplifier 4 are not shown.
  • the camera 2 is attached to the camera support 22 via the camera fixing portion 21.
  • a propagation plate 11 which is an upper acrylic plate
  • a fixing plate 12 which is a lower acrylic plate
  • a base 13 which is a base 13
  • a cushioning material 14 are provided.
  • the human skin gel 1 is attached to the propagation plate 11 which is the upper acrylic plate, and the vibration is propagated.
  • the speakers 5A and 5B have a circular diaphragm 51 in which physical vibration is generated, a frame 52 which is a frame surrounding the diaphragm 51, and a housing 53 to which the frame 52 is mounted.
  • slits 54 that are notched from the surfaces of the diaphragm 51 and the frame 52, which generate vibration, are formed in the center of the facing surfaces of the speakers 5A and 5B in the vertical direction.
  • the propagation plate 11 to which the human skin gel 1 was attached was inserted into the slits 54A and 54B, and the speakers 5A and 5B were sandwiched between the diaphragms 51 from the left and right, so that the transmission plate 11 was generated. The vibration propagates to the propagation plate 11.
  • the lower surface of the housing 53 of the speakers 5A and 5B is fixed to the upper surface of the fixing plate 12 which is the lower acrylic plate.
  • the lower surface of the lower fixing plate 12 is attached to the upper surface of the base 13 via the cushioning material 14. Since the vibrations of the speakers 5A and 5B are not propagated to the base 13 due to the cushioning material 14, even if the human skin tactile presentation device 100 is installed on the desk D (see FIG. 3), the vibrations on the surface of the desk D. Is not propagated and is less likely to be scratched.
  • the shooting range of the camera 2 can be fixed around the human skin gel 1.
  • FIG. 3 is a schematic view showing the human skin touch to the subject S by the human skin touch presentation device 100 according to the first embodiment of the present invention.
  • the subject S brings the pad of the finger F into contact with the human skin gel 1 and moves (slides) the finger F on the human skin gel 1. Then, the human skin tactile sensation presenting device 100 gives a tactile sensation when the finger is slid.
  • the beauty advisor selects and sets the source signal of vibration so that the subject (customer) can reproduce the feel of the bare skin or the feel of the skin after application of cosmetics, beauty agents, oils, etc. Then, vibration is presented to the subject's finger.
  • the human skin tactile presentation device 100 acquires the original signal, which is the original data of the vibration corresponding to a plurality of skins, in advance in the PC3. I will remember it.
  • the function of the PC3 to be operated it has a function of operating so as to select the skin condition of the bare skin to be reproduced on the human skin gel, and a function of selecting the original signal based on the selection of the skin condition. ing.
  • the original signal stored in the memory 302 of the PC 3 (see FIG. 4) is assigned a name, a code, a property, etc. for each signal, and the display unit 308 displays the name corresponding to the signal. Then, by operating the input unit 307, the original signal used for the vibration presentation at that time is selected.
  • the PC3 when the subject S wants to reproduce the tactile sensation of the bare skin, the PC3 causes the display unit 308 to display a screen for selecting a plurality of types of cosmetics, and causes the subject S to reproduce the skin condition of the bare skin.
  • the selection is made via the input unit 307, which is the skin condition selection unit.
  • the PC 3 stores the original signal of the vibration associated with the skin condition of the bare skin, and selects the original signal according to the cosmetics selected by the input unit 307.
  • the human skin tactile presentation device 100 of the present invention can reproduce not only the tactile sensation of bare skin but also the tactile sensation of applying something to the skin.
  • the reference solution R is dropped onto the human skin gel 1.
  • the PC 3 causes the display unit 308 to display a screen for selecting a plurality of types of cosmetics, and the cosmetic selection unit determines the skin condition of the subject S with a specific cosmetic to be reproduced as a tactile sensation.
  • the selection is made via the input unit 307.
  • the PC3 stores the original signals corresponding to the vibrations associated with the skin condition when a plurality of types of cosmetics are applied, and selects the cosmetics selected by the input unit 307. Select the source signal accordingly.
  • the tactile sensation of the skin changes depending on the condition of the bare skin, so the original signal is used to reproduce the skin condition when the prescribed cosmetics are applied in consideration of the condition of the bare skin. May be subdivided and prepared.
  • FIG. 4 is a block diagram of the human skin tactile sensation presenting device 100 according to the first embodiment of the present invention.
  • the PC 3 includes a USB interface 301, a memory 302, an operation system (OS) 303, a sound controller 304, an audio equipment connection unit 305, a system bus 306, an input unit 307, a display unit 308, and the like.
  • the input unit 307 is a mouse, a keyboard, a touch pad, a touch panel input surface, etc.
  • the display unit 308 is an LCD (liquid crystal display), an organic EL display, or the like.
  • USB interface 301 The USB interface 301, the memory 302, the operation system 303, the sound controller 304, the audio equipment connection unit 305, the input unit 307, and the display unit 308 are connected via the system bus 306.
  • the input unit 307 and the display unit 308 may be provided as separate bodies so as to be connected to the main body by the USB interface 301.
  • the USB interface 301 receives the finger position information captured by the camera 2.
  • the memory 302 stores in advance the original signal, which is an audio signal that is the source of vibration according to the human skin, as the original signal storage unit.
  • the operation system (OS) 303 has, for example, a CPU (Central Processing Unit) 331, an FPGA (Field-Programmable Gate Array) 332, a RAM (Random Access Memory) 333, a ROM (Read Only Memory) 333, and the like.
  • the CPU 331 and the FPGA 332 use the RAM 333 as a work area to execute various control programs stored in the ROM 334, and output control commands for controlling various operations in the PC 3.
  • the CPU 331 is a movement speed calculation unit that calculates the speed of finger movement based on the image of the finger position taken by the camera 2.
  • a library associated with the camera 2 for example, Leap Motion (registered trademark) P5 is used to detect the movement of the finger, and the movement speed of the finger is calculated by time differentiation.
  • the FPGA 332 calls the original signal stored in the memory 302.
  • the sound controller 304 adjusts the volume of the called original signal (voice signal) according to the movement of the finger. For example, it is adjusted so that it does not vibrate while the finger is stationary, but vibrates after the finger starts to move, and outputs an audio signal whose amplitude increases as the movement speed increases.
  • the audio device connection unit 305 is a terminal for connecting to the amplifier 4, and outputs an audio signal adjusted by the sound controller 304 to the amplifier 4.
  • the sound controller 304 and the audio equipment connection unit 305 function as a vibration adjustment unit that outputs the adjustment value of the amplitude of the waveform of the original signal and the original signal which is the movement speed of the finger and the voice signal.
  • FIG. 5 is a control sequence diagram of the human skin touch presentation device 100 according to the first embodiment of the present invention.
  • subject S selects the skin type to be reproduced for PC3 (S101), and the original signal (FIG.) corresponding to the selected skin type to be presented at the time of tactile presentation on PC3. 6 to 9C, which will be described later), are called in the PC3 (step S102).
  • the camera 2 detects the position of the finger on the human skin gel 1 (S104) and outputs the finger position data to the PC3. ..
  • the PC3 outputs the original signal (audio signal) and the amplitude adjustment instruction of the original signal based on the finger position data. Specifically, in S105, the PC 3 detects the movement speed of the finger from the position of the finger based on the information received from the camera 2, adjusts the volume according to the movement, and adjusts the audio signal to the amplifier 4. The audio signal of the instructed volume) is output (S106).
  • the amplifier 4 amplifies the original signal (audio signal) with the intensity set in association with the movement of the finger, and outputs the amplified audio signal to the speakers 5A and 5B.
  • Speakers 5A and 5B exhibit vibration in S108. At this time, the vibration is presented only when the finger moves. The faster the movement, the larger the amplitude. Due to this vibration presentation, vibration is presented to the human skin gel 1 via the propagation plate 11 (S109), and when the subject senses the vibration with the finger F on the human skin gel 1 via the propagation plate 11 (S110). , Produces a more natural texture.
  • FIG. 6 is a flowchart illustrating a procedure for setting the original signal in the human skin tactile sensation presenting device 100 according to the first embodiment of the present invention.
  • 7A and 7B are measurement diagrams when measuring vibration data on human skin and on human skin gel using acceleration in the setting procedure of the original signal of FIG.
  • FIG. 8 is an example of vibration data actually measured on human skin using an acceleration sensor.
  • 9A to 9C are graphs obtained by converting the measured vibration data into a frequency distribution via voice data.
  • the original signal finally set will be an audio signal, and the audio signal in the middle stage will be described as audio data.
  • the setting procedure shown in FIG. 6 is a part of a preparatory step in which the human skin tactile sensation presenting device 100 prepares in advance before presenting the tactile sensation to the subject as shown in FIGS. 3 and 11.
  • FIG. 7A shows the state when the vibration data is acquired on the human skin H in step S901
  • FIG. 7B shows the state when the vibration data is acquired on the human skin gel 10 in S904 and S909.
  • the information processing device used to set the original signal may be the same as or different from the PC3 shown in FIG. However, in order to ensure consistency in frequency characteristics and the like, it is preferable to use the amplifier 4, the speakers 5A and 5B, the human skin gel 1, the propagation plate 11, and the like included in the human skin touch presenting device 100.
  • the acceleration sensor A is attached to the fingernail of the sample provider, and the vibration data when touching the human skin is acquired as an actually measured value.
  • the state of the measurement in S901 is shown in FIG. 7A.
  • the acceleration sensor A installed on the fingernail collects vibration data (sample data) by touching the skin (human skin) H of the human arm while moving.
  • a high-precision acceleration sensor (A3AX-SENSOR, AX2609B-01, manufactured by TecGihan) was used as the acceleration sensor A.
  • the accelerometer A attached to the tip of the middle finger, we traced the real "rough skin", one of the sample providers.
  • the area to be traced is a sample of 50 mm ⁇ 20 mm where the downy hair on the outside of the left forearm grows, and the finger F is moved so as to move in one direction in 4 seconds, and the vibration data during the tracing. was acquired.
  • FIG. 8 shows an example of vibration data actually measured using an acceleration sensor on the human skin H.
  • the acceleration sensor A With the acceleration sensor A, data vibrations in the three directions of X, Y, and Z shown in FIG. 7A can be obtained.
  • the horizontal axis represents time [seconds] and the vertical axis represents acceleration [g (G)].
  • the vibration data in the shear direction is suitable for tactile presentation this time, and the horizontal acceleration data (vibration data in the X direction) is converted into voice data in S902 below.
  • the vibration data to be used is used.
  • the information processing apparatus incorporates the sample data (acceleration data in the X direction (measured value of vibration data)) acquired in S901 into audio software (for example, Audacity®) and voice data (measured value). ).
  • FIG. 9A is a frequency characteristic graph showing a frequency distribution (measured value) obtained by Fourier transforming the voice data converted from the vibration data of the measured value.
  • the horizontal axis shows the frequency (Hz) and the vertical axis shows the amplification degree (dB).
  • the measured audio data is given to the amplifier 4, played back by the speakers 5A and 5B, and the human skin gel 1 is vibrated at the same speed as when the human skin gel 1 is touched.
  • the vibration data when the acceleration sensor A is attached to the fingernail at the same distance and touched is acquired as a reproduced value.
  • the state of measurement in S904 is shown in FIG. 7B.
  • the vibration data of the reproduced value acquired in S904 is taken into the audio software by the information processing device and converted into the voice data of the reproduced value.
  • FIG. 9B is a frequency characteristic graph showing a frequency distribution (reproduced value) obtained by Fourier transforming the voice data converted from the vibration data of the reproduced value generated in S104 in the information processing apparatus.
  • the equalizer (frequency adjustment filter) is designed based on the difference between the frequency distribution (actual measurement value) generated in S903 and the frequency distribution (reproduced value) generated in S906. Specifically, ideally, it is desirable that these two frequency distributions match, but different results will be obtained depending on the filter characteristics of the amplifier 4 and speakers 5A and 5B included during playback, and the characteristics of the human skin gel 1. .. In order to correct this, an equalizer in increments of 10 Hz was created in this example by the amplitude ratios of FIGS. 9A and 9B (differences in dB display). This equalizer matches the difference between "frequency distribution when in direct contact with the skin" and "frequency distribution when a signal is sent to the amplifier and vibration is presented to the skin through the speaker, propagation plate, and human skin gel". Acts as an inverse filter.
  • a pass-through filter is applied, and it changes from the tactile sensation you want to feel.
  • a reverse filter that is, a filter that enhances the high frequency side to some extent is applied to bring the tactile sensation on the human skin gel 1 closer to the tactile sensation of the real skin.
  • the voice data (measured value) calculated in S902 is corrected by applying the equalizer (inverse filter) created in S907 to create voice data (correction value).
  • the voice data (correction value) created in S908 is input to the amplifier 4, and the final value of the vibration data is acquired by the acceleration sensor A provided on the fingernail on the human skin gel 1. To do.
  • the state of measurement in S909 is shown in FIG. 7B.
  • FIG. 9C is a frequency characteristic graph showing a frequency distribution (final value) obtained by Fourier transforming the voice data (final value) converted from the vibration data of the final value generated in S911 in the information processing apparatus.
  • the frequency distribution (actual measurement value) created in S903 and the frequency distribution (final value) created in S911 are compared and confirmed.
  • the waveform in FIG. 9C is relatively consistent with the waveform in FIG. 9A, suggesting that the equalizer worked correctly.
  • the frequency distribution (actual measurement value) and the frequency distribution (final value) are compared, and if the matching rate is low, the equalizer step set in S907 is changed, or the data by the acceleration sensor A is used. It is preferable to adjust so that the measured value on the human skin H and the vibration frequency of the final value on the human skin gel 1 are substantially matched by retaking.
  • the voice data (correction value) created in S908 in S913 is set as the original signal in the voice signal format according to the human skin before amplification, and the source of the PC3. It is stored in the memory 302 which is a signal storage unit.
  • the human skin tactile presentation device of the present invention can actually be used without preparing a large number of human skin gels. Any skin condition can be reproduced with the same touching method as when touching the skin.
  • FIG. 10 is a side perspective view of the human skin tactile sensation presenting device 200 according to the second embodiment of the present invention.
  • FIG. 11 is a schematic view showing the human skin touch to the subject S by the human skin touch presenting device 200 according to the second embodiment of the present invention.
  • the human skin tactile presentation device 200 of the present embodiment includes a human skin gel 10, a slide volume 6, a microcontroller 7, a switch 75, and a motor driver IC 8.
  • the slide volume 6 is arranged on the front side close to the subject S with respect to the human skin gel 10.
  • the slide volume 6 is a movement speed acquisition unit that acquires the movement speed of the finger on the human skin gel 10, and adds resistance to the movement (brake) when the finger moves in the lateral direction (rail extension direction). Or, it also functions as a finger movement assisting unit that assists (accelerates) movement.
  • the microcontroller 7 is configured by combining one IC (Integrated Circuit) or a circuit on an electronic board, for example, calculates the movement speed of a finger, and calculates the movement speed of a finger, and uses resistance / acceleration data to obtain 1 for each time according to the movement speed. By selecting a control value, it is output to the motor driver IC 8 so as to adjust the resistance or propulsion acceleration (slide tactile sensation) of the motor 63 (see FIG. 12) of the slide volume 6.
  • IC Integrated Circuit
  • the load resistance and propulsion acceleration given to the slider 64 (ring 66) on the rail 61 may be collectively referred to as the slide tactile sensation.
  • the original data of the slide tactile sensation that generates resistance / acceleration stored in the microcontroller 7 is called a slide tactile sensation signal.
  • the motor driver IC 8 is a part of the finger movement control unit that controls the motor 63 (see FIG. 11) of the slide volume 6 so as to give the finger on the human skin gel 10 a human skin feel.
  • the human skin tactile presentation device 200 stores slide tactile signals corresponding to a plurality of skins in order to reproduce a normal skin condition, a desired skin condition, and the like, and for example, a switch 75 is pressed. It is preferable that the microcontroller 7 can output a slide tactile signal corresponding to any skin by operating it or remotely controlling it from a smartphone or the like.
  • the microcontroller 7 has a function of selecting a slide tactile signal based on the skin type selection information set by the switch 75.
  • the original signal stored in the memory 701 (see FIG. 13) of the microcontroller 7 is assigned a name, a code, a property, etc. for each signal, and by operating the switch 75, the slide of that time is performed.
  • the slide tactile signal used for tactile presentation is selected.
  • Subject S selects a specific skin condition of the bare skin by operating the switch 75 when he / she wants to reproduce the tactile sensation of the bare skin.
  • the microcontroller 7 stores the slide tactile signals corresponding to the slide tactile sensations associated with a plurality of types of bare skin, and selects the slide tactile sensation signals according to the bare skin selected by the switch 75.
  • Subject S drops the reference solution R onto the human skin gel when he / she wants to reproduce the tactile sensation of the applied state of cosmetics or the like. Then, the subject S selects a skin condition to which a specific cosmetic is applied by operating the switch 75.
  • the microcontroller 7 stores a slide tactile signal corresponding to the slide tactile sensation associated with the skin condition when a plurality of types of cosmetics are applied, and slides according to the cosmetics selected by the switch 75. Select a tactile signal.
  • a slide tactile signal that takes into consideration the condition of the bare skin and reproduces the skin condition when a predetermined cosmetic is applied. May be subdivided and prepared.
  • FIGS. 15A to 15C An example of a slide tactile signal for reproducing the state of bare skin and the state of the skin when a cosmetic is applied on the human skin gel 10 will be described later together with FIGS. 15A to 15C.
  • FIG. 12 is a front view illustrating the arrangement of the slide volume 6 and the human skin gel 10 in the human skin touch presentation device 200.
  • the slide volume 6 has a rail 61, a support frame 62 for supporting the rail 61, a motor 63, a slider 64 which is an operation terminal for the rail 61, and a variable resistor 65.
  • a ring 66 which serves as an annular operation knob, is attached to the 64.
  • variable resistor 65 has terminals 651 and 652 at both ends of the rail 61 and movable terminals 653 associated with the positions of the slider 64, and corresponds to the position of the slider 64 with respect to the rail 61.
  • the resistance value changes according to the position of the movable terminal 653.
  • the slide volume 6 is a motor-driven slide volume that gives a slide tactile sensation by applying a load (decelerating) or accelerating (promoting movement) the movement of the slider 64 on the rail 61 by the motor 63. Is.
  • Subject S touches the human skin gel 10, which is a skin model, with the finger F inserted into the ring 66.
  • the finger pad of the fingertip is moved to the left or right along the human skin gel 10
  • the base of the finger F comes into contact with the ring 66, and the ring 66 also moves together.
  • the slider 64 moves on the rail 61
  • the resistance value of the variable resistor 65 attached to the slider 61 changes.
  • the position and moving speed of the finger can be calculated by reading the change in the resistance value by the microcontroller 7 in the subsequent stage.
  • the human skin gel 10 is provided long in the left and right direction.
  • the human skin gel 10 is attached to the entire upper surface of the propagation plate 11 which is the upper acrylic plate.
  • the position of the inner peripheral surface of the ring 66 of the slide volume 6 is substantially the same as that of the human skin gel 10 with which the fingertips come into contact in the vertical direction, or slightly above the position of the human skin gel 10. Arranged like this. Therefore, the lower surface of the slide volume 6 is fixed to the upper surface of the fixing plate 12 which is the lower acrylic plate.
  • the upper acrylic plate 11 to which the human skin gel 10 is attached is supported by being sandwiched between the support side plates 15A and 15B, and the support side plates 15A, 15B is fixed to the fixing plate 12 which is the lower acrylic plate.
  • the lower surface of the base 13 prevents the slide volume 6 from being displaced in the left-right direction with respect to the desk so that the support frame 62 on the rail 61 side of the slide volume 6 does not move when the ring 66 moves left and right.
  • Non-slip 16A and 16B are provided.
  • FIG. 13 is a block diagram of the human skin tactile sensation presenting device 200 according to the second embodiment of the present invention.
  • the microcontroller 7 has a memory 701, a first ASIC 702, a second ASIC 703, a connection terminal 704, and the like.
  • the memory 701 is a slide tactile signal storage unit that stores resistance / acceleration data corresponding to friction and smoothness of human skin, that is, slide tactile signals corresponding to lateral skin reproduction data.
  • the first ASIC 702 reads the change in the voltage value of the motor 63 of the slide volume 6, and calculates the speed at which the finger moves in the left-right direction from the time derivative of the position indicated by the motor 63. Then, the ASIC 702 selects a control value in the slide tactile signal according to the movement speed of the finger, and adjusts the resistance or acceleration of the motor 63 which is a finger movement assisting portion, thereby rubbing the finger on the human skin gel 10. Gives a smooth and smooth feel to the human skin.
  • the ASIC 702 functions as a part of the auxiliary operation control unit.
  • the second ASIC703 functions as a slide tactile signal selection unit that reads the selection information on the switch 75, selects and outputs the slide tactile signal associated with the selection information.
  • connection terminal 704 is a terminal for connecting the microcontroller 7 to the slide volume 6, the switch 75, and the motor driver IC 8.
  • FIG. 14 is a sequence diagram of the human skin tactile sensation presenting device 200 according to the second embodiment of the present invention. The sequence in the human skin tactile sensation presenting device 200 will be described with reference to FIG.
  • the subject S selects the skin type to be reproduced for the switch 75 (S201), the microcontroller 7 reads the selection information on the switch 75 (S202), and the microcontroller 7 is selected.
  • a slide tactile signal (see FIGS. 15A to 15C) corresponding to the skin type is called (S203).
  • the resistance value of the variable resistor 65 of the slide volume 6 changes according to the position of the ring 66 in S205. That is, in S204 to S206, the slide volume 6 outputs information on the time change of the finger position. At this time, for example, the position of the finger is sampled every 1 kHz.
  • the microcontroller 7 reads the change in the resistance value of the variable resistor 65 of the slide volume 6, and in S208, the finger movement speed is calculated from the time derivative of the position.
  • the microcontroller 7 instructs the motor driver IC8 by selecting a value that reflects the moving speed of the finger from the slide tactile signal so as to give a predetermined load resistance or acceleration.
  • the motor driver IC8 controls the motor 63 of the slide volume 6 according to the load resistance or acceleration instructed in S207.
  • the motor 63 presents the adjusted regulation (load) or acceleration to the moving finger, and in S212, the subject feels friction when tracing the skin from the load or acceleration of the slide volume 6. And sense smoothness.
  • FIGS. 15A to 15C show examples of slide tactile signals according to the skin type, which are called and set in S203 and output in S209 to S211.
  • FIG. 15A is an example of setting a slide tactile signal corresponding to rough skin
  • FIG. 15B is an example of setting a slide tactile signal corresponding to smooth skin
  • FIG. 15C is an example of setting a slide tactile signal of sticky skin. ..
  • FIG. 15A is an example of tactile sensation setting corresponding to the bare skin of rough skin, and the horizontal axis shows the speed of the finger and the vertical axis shows the load resistance.
  • the finger is judged to be "resting” and the static frictional force is presented. Specifically, the position control is performed so that the finger is returned to the original position. Then, when the speed at which the finger moves exceeds a certain threshold value, it is determined as "movement” and a constant frictional force is presented.
  • the frictional force presented here specifically presents a constant reaction force that does not depend on the speed.
  • FIG. 15B is an example of tactile sensation setting corresponding to the bare skin of smooth skin, and the horizontal axis shows the speed of the finger and the vertical axis shows the propulsion acceleration.
  • a force propulsion acceleration
  • the finger feels as if it slides more smoothly, and the human skin gel 10, which is the object, gives a feeling as if it becomes smoother.
  • 15A and 15B show examples of slide tactile data that reproduces bare skin, but in this configuration, it is also possible to show the state after applying cosmetics, beauty essence, oil, etc. to the skin. Is.
  • FIG. 15C shows an example of tactile setting that reproduces the state of sticky skin after applying a highly viscous cosmetic such as oil or ointment to the skin (for example, smooth skin). Shown.
  • the horizontal axis represents the speed of the finger and the vertical axis represents the load resistance.
  • viscosity is exhibited by presenting a reaction force proportional to the velocity.
  • the reaction force is increased by changing the voltage applied to the motor 63, which is a general motor control method, or changing the pulse ratio of the PWM (Pulse Width Modulation) pulse applied to the motor 63.
  • PWM Pulse Width Modulation
  • viscous skin in the above example, stickiness when an ointment-like coating applied to the skin is applied has been described, but even when the coating is not applied, it occurs when the body is in a bad condition. Even when expressing the skin condition in which highly viscous sticky sweat covers the skin, the slide tactile sensation can be expressed by the reaction force exhibiting "viscosity" as shown in FIG. 15C.
  • the microcontroller 7 gives an instruction to the motor driver IC8 in S209 of FIG. 14, for example, when the slide tactile sensation as shown in FIG. 15A is output, the load resistance is not changed regardless of the speed.
  • the load resistance of any one of the two values is output only by comparing with the speed threshold value.
  • the load resistance is used in FIGS. 15A and 15C, and the propulsion acceleration is used in FIG. 15B, but one skin type is expressed.
  • a signal that gives both load resistance and propulsion acceleration may be set with the velocity threshold as a boundary.
  • FIG. 16 is a side perspective view of the human skin tactile sensation presenting device 300 according to the third embodiment of the present invention.
  • the human skin tactile presentation device includes a PC 30, a digital potentiometer 9, an amplifier 4, and speakers 5A and 5B in addition to the configuration of the second embodiment.
  • both the vibration of the fingertip to the finger pad and the slide tactile sensation when the base of the finger is moved in the left-right direction can be performed.
  • FIG. 17 is a top view of the human skin tactile presentation device 300 according to the third embodiment of the present invention, excluding the PC30.
  • the propagation plate 11 which is an acrylic plate provided with the human skin gel 10 is sandwiched between the pair of speakers 5A and 5B as in the first embodiment. Is supported.
  • the fingertip of the subject S is moved to the left and right, so it is preferable that the human skin gel 10 is provided long in the left and right direction.
  • FIG. 18 is a block diagram of the human skin touch presentation device 300 according to the third embodiment of the present invention. Only the differences from the second embodiment will be described.
  • the microcontroller 7 calculates the finger movement speed based on the finger movement on the slide volume 6, the PC 30 does not have to have the finger movement speed calculation function. Further, since the PC 30 has a skin type selection function, the switch 75 is not provided.
  • the memory 302 of the PC 30 functions as a source signal storage unit for storing the source signal (audio signal) corresponding to the vibration associated with the human skin.
  • the PC 30 may be connected wirelessly.
  • the PC 30 since the PC 30 does not need to calculate the speed of the finger, it may be a smartphone or another memory, or an HDD operated by a remote controller or a switch to selectively output the original signal.
  • the memory alone may be used.
  • the slide tactile signal expressing the skin quality is also transmitted via the PC 30.
  • the input unit 307 of the PC 30 functions as a skin condition selection unit and a cosmetic selection unit for selecting the original signal and the slide tactile signal that are the sources of vibration.
  • the subject S wants to reproduce the tactile sensation of the bare skin, he / she selects one skin from the names of the skin displayed on the display unit 308, and the PC 30 is selected from a plurality of bare skin states.
  • the predetermined bare skin information is output to the microcontroller 7.
  • the subject S wants to reproduce the tactile sensation of the applied state of cosmetics or the like, first, the reference solution R is dropped on the human skin gel. Then, the PC 30 causes the display unit 308 to display a screen for selecting a plurality of types of cosmetics, and causes the subject to select a skin condition to which a specific cosmetic is applied. The PC 30 outputs information on the skin quality with the type of cosmetic selected from the plurality of types of cosmetics to the microcontroller 7.
  • the PC30 stores the correlation tables as shown in Tables 1 and 2 described above, which associate the skin condition with the original signal that is the source of vibration, the correlation between the skin condition and the slide tactile signal is stored.
  • the table is stored in the microcontroller 7.
  • the digital potentiometer 9 adjusts the magnitude of voice data.
  • the digital potentiometer 9 functions as a vibration adjusting unit that adjusts the strength (amplitude width) of vibration when outputting the original signal (voice signal) according to the moving speed of the finger.
  • the amplifier 4 amplifies the amplitude value of the vibration of the original signal output from the PC 3 according to the intensity information (volume value) of the digital potentiometer 9.
  • the speakers 5A and 5B convert the adjusted audio signal into physical vibration and output it, and vibrate the human skin gel 10 via the propagation plate 11.
  • the speakers 5A and 5B function as vibration output units.
  • FIG. 19 is a sequence diagram of the human skin touch presentation device 300 according to the third embodiment of the present invention.
  • the subject S selects the skin type to be reproduced for the PC30 (S301)
  • the information of the selected skin type is output to the microcontroller 7 in S302, and the microcontroller 7 in S303.
  • the original signal of the vibration of the skin to be expressed corresponding to the selected skin type is called in the PC 30 and output to the digital potentiometer 9.
  • the resistance value of the variable resistor 65 of the slide volume 6 changes according to the position of the ring 66 in S305. That is, in S305 to S307, the slide volume 6 outputs information on the time change of the finger position. At this time, for example, the position of the finger is sampled every 1 kHz.
  • the microcontroller 7 reads the change in the resistance value of the variable resistor 65, and in S307, calculates the speed of the finger from the time derivative of the position.
  • the finger speed information calculated in S310 is output to the digital potentiometer 9.
  • the digital potentiometer 9 adjusts the volume according to the original signal and the speed of the finger instructed in S302, and outputs the volume to the amplifier 4.
  • the amplifier 4 outputs the amplified audio signal of the called original signal at the set volume.
  • the speakers 5A and 5B output the amplified audio signal as physical vibration.
  • the subject S senses the vibration to the finger F by exhibiting the vibration only when the finger moves.
  • the microcontroller 7 selects a control value in the slide tactile signal according to the moving speed of the finger, and instructs the motor driver IC8 to give a predetermined load resistance or acceleration (slide tactile sensation). To do.
  • the motor driver IC8 controls the motor 63 of the slide volume 6 according to the load resistance or acceleration instructed in S302 to S305.
  • the motor 63 presents regulation or acceleration (slide tactile sensation) with respect to the movement of the ring 66 in the left-right direction.
  • processing is executed in parallel with the control operation related to the vertical vibration of S310 to S313 and the control operation related to the lateral slide tactile sensation of S314 to S316 at the same time.
  • the subject senses friction when tracing the skin from the load and acceleration (addition of slide tactile sensation) of the slide volume 6 in S316.
  • a heating unit HT that heats the skin gel 1 (10) to 15 ° C. to 37 ° C. may be provided.
  • FIG. 20 is a schematic diagram in which a beauty advisor presents skin quality to a customer by using the human skin tactile sensation presenting device 300 according to the third embodiment of the present invention in counseling.
  • the original signals of vibration corresponding to a plurality of skins for example, Table 1 and Table 2 above
  • a plurality of original data of the slide tactile sensation for example, slide tactile sensation signals as shown in FIGS. 15A to 15C
  • the beauty advisor B has S301 in the sequence of FIG. 19 so as to reproduce the feel of the bare skin or the feel of the skin after application of cosmetics, beauty agents, oils, etc. to the subject S (customer). Then, enter the selection of the skin type to be presented. Then, in the human skin tactile sensation presenting device 300, the original signal of vibration and the original data of slide tactile sensation are set according to the selected skin type, and the vibration and slide tactile sensation are presented to the finger of the subject (customer).
  • the beauty advisor reproduces the current skin condition of the subject with a human skin tactile presentation device by counseling the subject who is the customer or by directly touching the subject's skin, and the subject's finger.
  • the ideal skin or the desired skin condition is reproduced by the human skin tactile presentation device 300 and presented to the finger of the subject.
  • the state that can be realized by using a specific cosmetic is, for example, the reference solution R is dropleted on a human skin gel, reproduced by the human skin touch presenting device 300, and presented to the subject's finger. Then, when the cosmetic is used, if the surface changes over time, for example, it melts at body temperature over time, the skin after 10 minutes, 20 minutes, and 30 minutes can be treated even if it does not reach that time. It can be reproduced and presented by a human skin tactile presentation device. Alternatively, if you want to explain the effects of the skin that appear when you continue to use the cosmetic, for example, you can use the cosmetic twice a day continuously for 1 day, 3 days, 1 week, etc. The skin after 2 weeks or the like is reproduced and presented by the human skin tactile presentation device even if it is not the time.
  • the beauty advisor will be able to give advice corresponding to the reproduced skin quality, and will be able to actively promote purchasing.
  • FIG. 21 is a schematic view of the human skin touch presentation network system 1000 according to the embodiment of the present invention.
  • the subject S is an input terminal (an example of an information processing device, such as a smartphone, a tablet, a mobile phone, etc.) 400 for inputting skin information using the human skin touch presentation device 300A. It is a system connected to the advice PC 500 and / and the analysis PC 600 via the network N.
  • the human skin touch presentation device 300A can be rented, purchased, or obtained, placed at home, and used without a beauty advisor.
  • the human skin tactile presentation device 300A in the hands of the subject stores a plurality of variations in vibration and lateral movement intensity as a number of skin patterns.
  • the subject touches his / her skin and then touches the human skin tactile sensation presenting device 300A to select or adjust the tactile sensation close to his / her skin condition.
  • the input terminal 400 such as a smartphone or PC
  • the advice PC 500 via the network N such as the Internet or an intranet.
  • the advice PC 500 analyzes vibration and slide tactile sensation based on the skin pattern information transmitted from the subject's input terminal 400, and refers to the correlation between the plurality of memorized skin patterns and the vibration / slide tactile sensation. , Send a comment such as advice to the input terminal 400 of the subject S.
  • the advice PC 500 may be manually operated by the beauty advisor B, or the advice software may be incorporated inside the advice PC 500 and programmed to automatically respond.
  • the analysis PC 600 has a built-in tabulation software that collects and analyzes the response results from the subjects. Further, when the input terminal 400 and the advice PC 500 are not connected, the advice software may be incorporated inside the analysis PC 600.
  • the subject S inputs data corresponding to the tactile sensation presented by the human skin tactile sensation presenting device 300A to the input terminal 400, so that the change in the skin condition as an effect of the cosmetics is regarded as the change in the tactile sensation of the skin. Tactilely, it becomes possible to share a different space with a plurality of people through a human skin tactile presentation device.
  • the human skin feeling presenting device of the present invention in a public space such as a shopping center or a resting place, it may be possible to use it without a beauty advisor.
  • the input terminal 700 connected to the tactile sensation presenting part of the human skin sensation presenting device arranged in a public space has a built-in function of PC30, and has a number of skin patterns such as vibration and lateral movement intensity. Various variations of are remembered. Further, it is preferable that the input terminal 700 has a built-in guidance program so that it can be used comfortably without a beauty advisor. Further, it is preferable that the input terminal 700 has a built-in a program for advice that gives advice on the skin condition when the state close to one's own skin is reproduced by the human skin touch presentation device 300.
  • the accumulated data of the skin conditions of a plurality of subjects accumulated in the input terminal 700 is transferred to the analysis PC 600 via the network N at predetermined intervals and utilized for the analysis of the cosmetics developer C. Can be done.
  • the means for detecting the speed of the finger may be, for example, an acceleration sensor.
  • the amplifier 4 and the speakers 5A and 5B are configured separately has been described, but the amplifier and the speaker may be integrally configured as a speaker with a built-in amplifier.
  • the speakers 5A and 5B are arranged on the left and right to transmit vibration to the human skin gel via the propagation plate, but the surface of the diaphragm of the speaker is arranged upward. Then, the human skin gel may be attached and brought into contact with the lower surface of the propagation plate to propagate the vibration from below.
  • the slide volume concurrently serves two roles of acquiring the movement of the finger and assisting the movement of the finger is shown, but as a means of acquiring the movement information of the finger,
  • an acceleration sensor, a camera, or the like may be provided separately.

Abstract

The human skin tactile presentation device according to the present invention is provided with: a human skin gel 1 that is provided on a propagation member 11 in which vibration propagates, and with which the finger of a subject makes contact; a moving velocity acquisition unit 2 that acquires moving velocity of the finger on the human skin gel 1; a source signal storage unit 302 that stores a source signal to be a source of vibration made to correspond to human skin; a vibration adjustment unit 304 that adjusts the size of an amplitude of the source signal in accordance with the moving velocity of the finger; and vibration output units 5A and 5B that convert the adjusted source signal to a physical vibration and output the converted vibration, and apply the vibration to the human skin gel 1 through the propagation member 11. The present invention reproduces an arbitrary skin state by a similar touching manner to when actually touching skin, without preparing many human skin gels.

Description

人肌触感呈示装置および人肌触感呈示装置における振動の元信号の設定方法How to set the original signal of vibration in the human skin tactile display device and the human skin tactile display device
 本発明は、人肌触感呈示装置および人肌触感呈示装置における振動の元信号の設定方法に関する。 The present invention relates to a human skin tactile presentation device and a method for setting a vibration source signal in the human skin tactile presentation device.
 近年、ゲーム機器や携帯端末等の電子機器のほとんどにおいて、着信や受信の通知のための振動や、ゲーム機やアプリのゲームでの触覚フィードバック用の振動に利用される振動発生装置が搭載されている。例えば、特許文献1には、ゲーム機において、より臨場感のある触覚を与えるために、2方向に振動等が発生する振動装置を、硬質の樹脂製の操作装置に対して搭載することが提案されている。 In recent years, most electronic devices such as game machines and mobile terminals are equipped with vibration generators used for vibration for notification of incoming calls and receptions and vibration for tactile feedback in games of game machines and apps. There is. For example, Patent Document 1 proposes to mount a vibration device that generates vibrations in two directions on a hard resin operating device in order to give a more realistic tactile sensation in a game machine. Has been done.
 また、特許文献2では、ゲーム等のシミュレーション装置において、操作部に対して掴んだ感覚である反力を与える触覚再現方法も提案されている。 Further, Patent Document 2 also proposes a tactile reproduction method in which a reaction force, which is a sensation grasped by a game, is applied to a simulation device such as a game.
 しかし、特許文献1、2の技術では、硬質の装置に振動や反力を与えるものであり、装置の表面が硬いため、その装置を肌の再現に応用しようとすると、使用者は肌に触れている実感が少なく、肌の触感の再現としては程遠かった。 However, in the techniques of Patent Documents 1 and 2, vibration and reaction force are applied to a hard device, and the surface of the device is hard. Therefore, when the device is applied to skin reproduction, the user touches the skin. There was little realization that it was, and it was far from reproducing the tactile sensation of the skin.
 一方、特許文献3では、柔らかいものを含む商品の触感を伝えるために、実物を準備して装置に検知させ、検知した触感を、装置を介して振動等で伝達するコミュニケーションツールである触感再現方法が提案されている。 On the other hand, in Patent Document 3, in order to convey the tactile sensation of a product including a soft product, a tactile sensation reproduction method is a communication tool that prepares an actual product, causes the device to detect it, and transmits the detected tactile sensation by vibration or the like via the device. Has been proposed.
日本国特許6253157号公報Japanese Patent No. 6253157 日本国再公表2017/006670号公報Republication of Japan 2017/006670 日本国特許第4769342号公報Japanese Patent No. 4769342
 しかし、特許文献3による触覚再現では、指を動かさず、対象物が動くことで触感を知覚させる「受動触」であるが、実際の肌は指で触れて移動させることで肌質を確かめるため、特許文献3で肌質を再現しようとすると、指の触れ方が異なるため、肌の再現としては違和感が生じる。 However, in the tactile reproduction according to Patent Document 3, it is a "passive tactile" in which the tactile sensation is perceived by moving the object without moving the finger, but in order to confirm the skin quality by touching and moving the actual skin with the finger. When trying to reproduce the skin quality in Patent Document 3, since the way of touching the fingers is different, a feeling of strangeness occurs in the reproduction of the skin.
 また、肌の質感の表現として、人肌を模したサンプルである人肌ゲルが存在するが、様々な肌の状態を表現するためには、多数の人肌ゲルを準備しなければならなかった。また、多数の人肌ゲルを準備しても、表現したい肌質に丁度よいものが存在しないこともあった。 In addition, there is a human skin gel that is a sample that imitates human skin as an expression of the texture of the skin, but in order to express various skin conditions, a large number of human skin gels had to be prepared. .. In addition, even if a large number of human skin gels were prepared, there were cases where the skin quality to be expressed was not exactly the same.
 そこで、本発明は上記事情に鑑み、人肌ゲルを多数準備することなく、実際に肌に触れる場合と同じような触り方で、任意の肌の状態を再現することができる、人肌触感呈示装置の提供を目的とする。 Therefore, in view of the above circumstances, the present invention is capable of reproducing an arbitrary skin condition with the same touching method as when actually touching the skin without preparing a large number of human skin gels. The purpose is to provide the device.
 上記課題を解決するため、本発明の一態様では、
 振動が伝播する伝播部材上に設けられ、被験者の指が接触する人肌ゲルと、
 前記人肌ゲル上の前記指の移動速度を取得する移動速度取得部と、
 人肌に対応づけた振動の元となる元信号を記憶しておく元信号記憶部と、
 前記指の移動速度に応じて、前記元信号に対して、振幅の大きさを調整する振動調整部と、
 調整された元信号を物理振動に変換して出力し、前記伝播部材を介して前記人肌ゲルに振動を与える振動出力部と、を備える、
 人肌触感呈示装置、を提供する。
In order to solve the above problems, in one aspect of the present invention,
A human skin gel that is provided on a propagating member that propagates vibration and that the subject's finger touches,
A movement speed acquisition unit that acquires the movement speed of the finger on the human skin gel,
A source signal storage unit that stores the source signal that is the source of vibration associated with human skin,
A vibration adjusting unit that adjusts the magnitude of the amplitude of the original signal according to the moving speed of the finger.
It is provided with a vibration output unit that converts the adjusted original signal into physical vibration and outputs it, and gives vibration to the human skin gel via the propagation member.
Provided is a human skin tactile presentation device.
 一態様によれば、人肌触感呈示装置において、人肌ゲルを多数準備することなく、実際に肌に触れる場合と同じような触り方で、任意の肌の状態を再現することができる。 According to one aspect, in the human skin tactile sensation presenting device, it is possible to reproduce an arbitrary skin condition in the same way as when actually touching the skin without preparing a large number of human skin gels.
本発明の第1実施形態に係る人肌触感呈示装置の正面図。The front view of the human skin feeling presenting apparatus which concerns on 1st Embodiment of this invention. 図1の人肌触感呈示装置の側面図。It is a side view of the human skin feeling presentation device of FIG. 本発明の第1実施形態に係る人肌触感呈示装置によって、被験者に人肌触感を呈示している模式図。The schematic diagram which presents the human skin touch to a subject by the human skin touch presenting apparatus which concerns on 1st Embodiment of this invention. 本発明の第1実施形態に係る人肌触感呈示装置のブロック図。The block diagram of the human skin feeling presenting apparatus which concerns on 1st Embodiment of this invention. 本発明の第1実施形態に係る人肌触感呈示装置における制御シーケンス図。The control sequence diagram in the human skin feeling presenting apparatus which concerns on 1st Embodiment of this invention. 本発明の第1実施形態に係る人肌触感呈示装置における振動の元信号の設定手順を説明するフローチャート。The flowchart explaining the setting procedure of the original signal of vibration in the human skin feeling presenting apparatus which concerns on 1st Embodiment of this invention. 図6の元信号の設定手順において、人肌を触る際の振動データを実測値として取得する際の測定図。FIG. 6 is a measurement diagram when acquiring vibration data when touching human skin as an actually measured value in the setting procedure of the original signal of FIG. 図6の元信号の設定手順において、人肌ゲル上での振動データを取得する際の測定図。FIG. 6 is a measurement diagram when acquiring vibration data on a human skin gel in the setting procedure of the original signal of FIG. 人肌上で加速度センサを用いて実測した振動データの例。An example of vibration data measured using an accelerometer on human skin. 実測値の振動データから変換した音声データを、フーリエ変換した周波数分布(実測値)を示す、周波数特性グラフ。A frequency characteristic graph showing a frequency distribution (measured value) obtained by Fourier transforming voice data converted from vibration data of measured values. 情報処理装置で生成した再現値の振動データから変換した音声データを、フーリエ変換した周波数分布(再現値)を示す周波数特性グラフ。A frequency characteristic graph showing a frequency distribution (reproduced value) obtained by Fourier transforming audio data converted from vibration data of reproduced values generated by an information processing device. 情報処理装置で生成した最終値の振動データから変換した音声データ(最終値)を、フーリエ変換した周波数分布(最終値)を示す周波数特性グラフ。A frequency characteristic graph showing a frequency distribution (final value) obtained by Fourier transforming audio data (final value) converted from vibration data of the final value generated by an information processing device. 本発明の第2実施形態に係る人肌触感呈示装置の側面斜視図。A side perspective view of the human skin feeling presenting device according to the second embodiment of the present invention. 本発明の第1実施形態に係る人肌触感呈示装置によって、被験者に人肌触感を呈示している模式図。The schematic diagram which presents the human skin touch to a subject by the human skin touch presenting apparatus which concerns on 1st Embodiment of this invention. 本発明の第2実施形態に係る人肌触感呈示装置におけるスライドボリューム及び人肌ゲルの配置を説明する正面図。The front view explaining the arrangement of the slide volume and the human skin gel in the human skin touch presenting apparatus which concerns on 2nd Embodiment of this invention. 本発明の第2実施形態に係る人肌触感呈示装置のブロック図。The block diagram of the human skin feeling presenting apparatus which concerns on 2nd Embodiment of this invention. 本発明の第2実施形態に係る人肌触感呈示装置におけるシーケンス図。The sequence diagram in the human skin touch presenting apparatus which concerns on 2nd Embodiment of this invention. 本発明の第2実施形態に係る人肌触感呈示装置で記憶される、粗い肌に対応するスライド触感信号の設定例のグラフ。The graph of the setting example of the slide tactile sensation signal corresponding to the rough skin memorized by the human skin sensation presenting apparatus which concerns on 2nd Embodiment of this invention. 本発明の第2実施形態に係る人肌触感呈示装置で記憶される、滑らかな肌に対応するスライド触感信号の設定例のグラフ。The graph of the setting example of the slide tactile sensation signal corresponding to smooth skin stored in the human skin sensation presenting apparatus which concerns on 2nd Embodiment of this invention. 本発明の第2実施形態に係る人肌触感呈示装置で記憶される、べたついている肌のスライド触感信号の設定例のグラフ。The graph of the setting example of the slide tactile sensation signal of sticky skin stored in the human skin sensation presenting apparatus which concerns on 2nd Embodiment of this invention. 本発明の第3実施形態に係る人肌触感呈示装置の側面斜視図。The side perspective view of the human skin feeling presenting apparatus which concerns on 3rd Embodiment of this invention. 本発明の第3実施形態に係る人肌触感呈示装置の上面図。Top view of the human skin tactile presentation device according to the third embodiment of the present invention. 本発明の第3実施形態に係る人肌触感呈示装置のブロック図。The block diagram of the human skin feeling presenting apparatus which concerns on 3rd Embodiment of this invention. 本発明の第3実施形態に係る人肌触感呈示装置におけるシーケンス図。The sequence diagram in the human skin touch presenting apparatus which concerns on 3rd Embodiment of this invention. ビューティーアドバイザーがカウンセリングにおいて、本発明の第3実施形態に係る人肌触感呈示装置を用いて、カスタマーに肌質を呈示している模式図。FIG. 6 is a schematic diagram in which a beauty advisor presents skin quality to a customer in counseling using the human skin tactile presentation device according to the third embodiment of the present invention. 本発明の実施形態に係る人肌触感呈示ネットワークシステムの概略図。The schematic diagram of the human skin feeling presentation network system which concerns on embodiment of this invention.
 以下、図面を参照して本発明を実施するための形態について説明する。なお、すべての図面において、同様の構成要素には同一の符号を付し、重複する説明は適宜に省略する。 Hereinafter, a mode for carrying out the present invention will be described with reference to the drawings. In all drawings, similar components are designated by the same reference numerals, and duplicate description will be omitted as appropriate.
 <第1実施形態>
 まず、図1~図3を用いて、本発明の第1実施形態に係る人肌触感呈示装置100の全体構成について説明する。
<First Embodiment>
First, the overall configuration of the human skin tactile sensation presenting device 100 according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 3.
 図1は、本発明の第1実施形態に係る人肌触感呈示装置100の側面斜視図である。図1に示すように、人肌触感呈示装置100は、人肌ゲル1と、カメラ2と、PC3と、アンプ4と、スピーカー5と、を備えている。 FIG. 1 is a side perspective view of the human skin touch presentation device 100 according to the first embodiment of the present invention. As shown in FIG. 1, the human skin tactile presentation device 100 includes a human skin gel 1, a camera 2, a PC 3, an amplifier 4, and a speaker 5.
 人肌ゲル1は、被験者S(図3参照)の指Fが接触する対象であり、人の肌の所定の状態を模した皮膚モデル(人工皮膚)であって、人肌そっくりの柔らかさを表現する超軟質ウレタン樹脂である。人肌ゲル1は、例えば、バイオスキン(登録商標)(ビューラックス社製)を使用する。 The human skin gel 1 is a skin model (artificial skin) that imitates a predetermined state of human skin, which is a target to be touched by the finger F of the subject S (see FIG. 3), and has a softness similar to that of human skin. It is an ultra-soft urethane resin to express. For human skin gel 1, for example, Bioskin (registered trademark) (manufactured by Beaulux) is used.
 人肌ゲル1は、伝播板(伝播部材)11に貼りつけられて固定されている。伝播板11は、人肌ゲル1を支持し、振動を伝播する部材であって、例えば、アクリル板で構成されている。 The human skin gel 1 is attached and fixed to the propagation plate (propagation member) 11. The propagation plate 11 is a member that supports the human skin gel 1 and propagates vibration, and is made of, for example, an acrylic plate.
 カメラ2は、人肌ゲル1上の、被験者S(図3参照)の指Fの移動情報を取得する、撮影装置の一例である。カメラ2は、例えばLeapMotion(登録商標)によって構成されており、移動速度取得部の少なくとも一部として機能する。また、本構成では、カメラ2は、人肌ゲル1の上方に、被験者の手と接触しない位置に、カメラ支柱22によって支持されている。 The camera 2 is an example of an imaging device that acquires movement information of the finger F of the subject S (see FIG. 3) on the human skin gel 1. The camera 2 is composed of, for example, Leap Motion (registered trademark), and functions as at least a part of a moving speed acquisition unit. Further, in this configuration, the camera 2 is supported by the camera support 22 above the human skin gel 1 at a position where it does not come into contact with the subject's hand.
 PC(Personal Computer)3は、カメラ2及びアンプ4と、有線又は無線で接続されている、情報処理装置の一例である。カメラ2が取得した指の位置を基に、指の移動速度を演算して求め、振動の強さを出力する。 The PC (Personal Computer) 3 is an example of an information processing device that is connected to the camera 2 and the amplifier 4 by wire or wirelessly. Based on the position of the finger acquired by the camera 2, the movement speed of the finger is calculated and obtained, and the strength of vibration is output.
 さらに、PC3は、人肌の肌質(触感)に対応づけた振動の元信号を記憶しておく元信号記憶部の機能も有している。下記において、元信号とは、スピーカー5A,5Bによって振動を発生させるための、振動の元となる信号であって、肌質に対応づけられた、音声信号形式の信号である。よって、PC3は、表現する肌質によって選択された元信号(音声信号)と、指の移動速度に対応づけられた信号の強度に関する情報をアンプ4に出力する。即ち、PC3は、指の移動速度に応じて設定された元信号に応じて振動を出力する際の、振動の強さ(振幅値)を調整する振動調整部である。 Furthermore, the PC3 also has a function of a source signal storage unit that stores the source signal of vibration corresponding to the skin quality (tactile sensation) of human skin. In the following, the original signal is a signal that is a source of vibration for generating vibration by the speakers 5A and 5B, and is a signal in the form of an audio signal that is associated with the skin type. Therefore, the PC 3 outputs to the amplifier 4 information on the strength of the original signal (audio signal) selected according to the skin type to be expressed and the signal intensity corresponding to the moving speed of the finger. That is, the PC3 is a vibration adjusting unit that adjusts the strength (amplitude value) of vibration when outputting vibration according to the original signal set according to the moving speed of the finger.
 アンプ(音響アンプ)4は、PC3から出力された元信号を、強度情報に応じて増幅する。 The amplifier (acoustic amplifier) 4 amplifies the original signal output from the PC 3 according to the intensity information.
 スピーカー5は、アンプ4に接続されており、左右のスピーカー5A,5Bの対となって構成されている。スピーカー5A,5Bは、調整された音声信号を物理振動に変換して出力し、伝播板11を介して人肌ゲル1に振動を与える振動出力部である。スピーカー5A,5Bは、有線又は無線でアンプ4に接続されている。また、スピーカー5A,5Bは人肌ゲル1の装置台座の伝播板11と接触した状態で、振動が伝播するように挟み込んで伝播板11を支持している。スピーカー5A,5B及び人肌ゲル1を支持する装置台座の構造については、図2と共に下記説明する。 The speaker 5 is connected to the amplifier 4 and is configured as a pair of left and right speakers 5A and 5B. The speakers 5A and 5B are vibration output units that convert the adjusted audio signal into physical vibration and output it, and vibrate the human skin gel 1 via the propagation plate 11. The speakers 5A and 5B are connected to the amplifier 4 by wire or wirelessly. Further, the speakers 5A and 5B are in contact with the propagation plate 11 of the device pedestal of the human skin gel 1 and are sandwiched so as to propagate the vibration to support the propagation plate 11. The structure of the device pedestal that supports the speakers 5A and 5B and the human skin gel 1 will be described below together with FIG.
 図2は、図1の人肌触感呈示装置100の正面図である。図2では、PC3及びアンプ4の図示は省略している。 FIG. 2 is a front view of the human skin touch presentation device 100 of FIG. In FIG. 2, the PC 3 and the amplifier 4 are not shown.
 図1及び図2に示すように、カメラ2は、カメラ固定部21を介して、カメラ支柱22に取り付けられている。 As shown in FIGS. 1 and 2, the camera 2 is attached to the camera support 22 via the camera fixing portion 21.
 また、人肌ゲル1及びスピーカー5A,5Bを支持する装置台座として、上側のアクリル板である伝播板11、下側のアクリル板である固定板12、ベース13、及び緩衝材14を有している。上側のアクリル板である伝播板11には、人肌ゲル1が貼りつけられ、振動が伝播される。 Further, as a device pedestal for supporting the human skin gel 1 and the speakers 5A and 5B, a propagation plate 11 which is an upper acrylic plate, a fixing plate 12 which is a lower acrylic plate, a base 13, and a cushioning material 14 are provided. There is. The human skin gel 1 is attached to the propagation plate 11 which is the upper acrylic plate, and the vibration is propagated.
 スピーカー5A,5Bは、物理的な振動が発生する円形の振動板51、振動板51を取り囲む枠であるフレーム52、及びフレーム52が装着される筐体53を有している。 The speakers 5A and 5B have a circular diaphragm 51 in which physical vibration is generated, a frame 52 which is a frame surrounding the diaphragm 51, and a housing 53 to which the frame 52 is mounted.
 また、スピーカー5A、5Bの対向する面の上下方向の中央であって、振動が発生する振動板51及びフレーム52の表面から奥側に向かって、切れ込んでいるスリット54(54A,54B)が形成されている。人肌ゲル1が貼りつけられた伝播板11が、スリット54A、54Bに挿入された状態で、スピーカー5A,5Bが、振動板51の部分で左右から挟み込んでいるため、振動板51で発生した振動は伝播板11に伝播する。 Further, slits 54 (54A, 54B) that are notched from the surfaces of the diaphragm 51 and the frame 52, which generate vibration, are formed in the center of the facing surfaces of the speakers 5A and 5B in the vertical direction. Has been done. The propagation plate 11 to which the human skin gel 1 was attached was inserted into the slits 54A and 54B, and the speakers 5A and 5B were sandwiched between the diaphragms 51 from the left and right, so that the transmission plate 11 was generated. The vibration propagates to the propagation plate 11.
 また、スピーカー5A,5Bの筐体53の下面は、下側のアクリル板である固定板12の上面に固定されている。 Further, the lower surface of the housing 53 of the speakers 5A and 5B is fixed to the upper surface of the fixing plate 12 which is the lower acrylic plate.
 装置台座において、下側の固定板12の下面は、ベース13の上面に、緩衝材14を介して取りつけられている。緩衝材14により、スピーカー5A,5Bの振動は、ベース13には伝播しないため、人肌触感呈示装置100を、机D(図3参照)上に設置しても、机Dの表面には振動は伝播されず、傷つきにくくする。 In the device pedestal, the lower surface of the lower fixing plate 12 is attached to the upper surface of the base 13 via the cushioning material 14. Since the vibrations of the speakers 5A and 5B are not propagated to the base 13 due to the cushioning material 14, even if the human skin tactile presentation device 100 is installed on the desk D (see FIG. 3), the vibrations on the surface of the desk D. Is not propagated and is less likely to be scratched.
 また、カメラ支柱22は、下側の固定板12又は/及びベース13に対して固定されていることで、カメラ2の撮影範囲を、人肌ゲル1周辺に固定することができる。 Further, since the camera support column 22 is fixed to the lower fixing plate 12 and / and the base 13, the shooting range of the camera 2 can be fixed around the human skin gel 1.
 図3は、本発明の第1実施形態に係る人肌触感呈示装置100によって、被験者Sに人肌触感を呈示している模式図である。 FIG. 3 is a schematic view showing the human skin touch to the subject S by the human skin touch presentation device 100 according to the first embodiment of the present invention.
 図3に示すように、被験者Sは、人肌ゲル1上に指Fの腹を接触させ、指Fを人肌ゲル1上で動かす(滑らせる)。そして、人肌触感呈示装置100は、指を滑らせる際に、触覚を与える。 As shown in FIG. 3, the subject S brings the pad of the finger F into contact with the human skin gel 1 and moves (slides) the finger F on the human skin gel 1. Then, the human skin tactile sensation presenting device 100 gives a tactile sensation when the finger is slid.
 例えば、ビューティーアドバイザーは、被験者(顧客)に対して、素肌の感触、あるいは、化粧料、美容料、オイル等の塗布後の肌の感触を再現するように、振動の元信号を選択して設定して、被験者の指に対して振動を呈示する。 For example, the beauty advisor selects and sets the source signal of vibration so that the subject (customer) can reproduce the feel of the bare skin or the feel of the skin after application of cosmetics, beauty agents, oils, etc. Then, vibration is presented to the subject's finger.
 例えば、人肌触感呈示装置100は、普段の肌の状態や、なりたい肌の状態等を再現するため、予め、複数の肌に対応する振動の元データである元信号を取得し、PC3内に記憶させておく。 For example, in order to reproduce the normal skin condition, the desired skin condition, and the like, the human skin tactile presentation device 100 acquires the original signal, which is the original data of the vibration corresponding to a plurality of skins, in advance in the PC3. I will remember it.
 そして、操作するPC3の機能として、人肌ゲル上で再現する素肌の肌状態を選択させるように操作させる機能と、その肌状態の選択に基づいて、元信号を選択する機能を、を有している。 Then, as the function of the PC3 to be operated, it has a function of operating so as to select the skin condition of the bare skin to be reproduced on the human skin gel, and a function of selecting the original signal based on the selection of the skin condition. ing.
 例えば、PC3のメモリ302(図4参照)に記憶された元信号は、信号毎に、例えば名称や符号や性質等が振られており、表示部308にその信号に対応する名称等を表示させて、入力部307を操作することで、その回の振動呈示に用いる元信号が選択される。 For example, the original signal stored in the memory 302 of the PC 3 (see FIG. 4) is assigned a name, a code, a property, etc. for each signal, and the display unit 308 displays the name corresponding to the signal. Then, by operating the input unit 307, the original signal used for the vibration presentation at that time is selected.
 詳しくは、被験者Sは、素肌の触感を再現したい場合は、PC3は、表示部308に、複数の種類の化粧料を選択させる画面を表示させ、被験者Sに、再現する素肌の肌状態を、肌状態選択部である入力部307を介して選択させる。PC3は、表1に示すように、素肌の肌状態に対応づけられた振動の元信号を記憶しておき、入力部307によって選択された化粧料に応じて、元信号を選択する。 Specifically, when the subject S wants to reproduce the tactile sensation of the bare skin, the PC3 causes the display unit 308 to display a screen for selecting a plurality of types of cosmetics, and causes the subject S to reproduce the skin condition of the bare skin. The selection is made via the input unit 307, which is the skin condition selection unit. As shown in Table 1, the PC 3 stores the original signal of the vibration associated with the skin condition of the bare skin, and selects the original signal according to the cosmetics selected by the input unit 307.
Figure JPOXMLDOC01-appb-T000001
 さらに、本発明の人肌触感呈示装置100は、素肌の触感の再現に加えて、肌に何かを塗布した触感も再現することもできる。
Figure JPOXMLDOC01-appb-T000001
Further, the human skin tactile presentation device 100 of the present invention can reproduce not only the tactile sensation of bare skin but also the tactile sensation of applying something to the skin.
 被験者Sは、化粧品(化粧料)等の塗布した状態の触感を再現したい場合は、まず、基準液Rを人肌ゲル1に滴下する。そして、PC3は、表示部308に、複数の種類の化粧料を選択させる画面を表示させ、被験者Sに、触感を再現する対象となる特定の化粧料を付した肌状態を、化粧料選択部である入力部307を介して選択させる。PC3では、表2に示すように、複数の種類の化粧料を付した際の肌状態に対応づけられた振動に対応する元信号を記憶しておき、入力部307によって選択された化粧料に応じて、元信号を選択する。 When the subject S wants to reproduce the tactile sensation in the applied state of cosmetics (cosmetics) or the like, first, the reference solution R is dropped onto the human skin gel 1. Then, the PC 3 causes the display unit 308 to display a screen for selecting a plurality of types of cosmetics, and the cosmetic selection unit determines the skin condition of the subject S with a specific cosmetic to be reproduced as a tactile sensation. The selection is made via the input unit 307. As shown in Table 2, the PC3 stores the original signals corresponding to the vibrations associated with the skin condition when a plurality of types of cosmetics are applied, and selects the cosmetics selected by the input unit 307. Select the source signal accordingly.
Figure JPOXMLDOC01-appb-T000002
 また、同じ化粧料等を塗布した場合でも素肌の状態によって、肌の触感が変化するため、素肌の状況を考慮した、所定の化粧料を付した際の肌状態を再現するように、元信号を細分化して準備してもよい。
Figure JPOXMLDOC01-appb-T000002
In addition, even if the same cosmetics are applied, the tactile sensation of the skin changes depending on the condition of the bare skin, so the original signal is used to reproduce the skin condition when the prescribed cosmetics are applied in consideration of the condition of the bare skin. May be subdivided and prepared.
 なお、人肌ゲル上で、素肌の状態や、化粧料を付した際の肌状態を再現するための、振動の元信号の取得方法については、図6~図9Cとともに説明する。 The method of acquiring the original vibration signal for reproducing the condition of the bare skin and the condition of the skin when the cosmetic is applied on the human skin gel will be described with reference to FIGS. 6 to 9C.
 図4は、本発明の第1実施形態に係る人肌触感呈示装置100のブロック図である。
PC3は、USBインターフェース301と、メモリ302と、オペレーションシステム(OS)303と、サウンドコントローラ304と、オーディオ機器接続部305と、システム・バス306と、入力部307と、表示部308等を備えている。入力部307は、マウス、キーボード、タッチパッド、タッチパネル入力面等であり、表示部308は、LCD(liquid Crystal display)、有機ELディスプレイ等である。
FIG. 4 is a block diagram of the human skin tactile sensation presenting device 100 according to the first embodiment of the present invention.
The PC 3 includes a USB interface 301, a memory 302, an operation system (OS) 303, a sound controller 304, an audio equipment connection unit 305, a system bus 306, an input unit 307, a display unit 308, and the like. There is. The input unit 307 is a mouse, a keyboard, a touch pad, a touch panel input surface, etc., and the display unit 308 is an LCD (liquid crystal display), an organic EL display, or the like.
 USBインターフェース301と、メモリ302と、オペレーションシステム303と、サウンドコントローラ304と、オーディオ機器接続部305と、入力部307と、表示部308とは、システム・バス306を介して接続されている。あるいは、PC3がデスクトップ型パソコンである場合は、入力部307及び表示部308は、USBインターフェース301によって本体と接続されるように、別体として設けられていてもよい。 The USB interface 301, the memory 302, the operation system 303, the sound controller 304, the audio equipment connection unit 305, the input unit 307, and the display unit 308 are connected via the system bus 306. Alternatively, when the PC 3 is a desktop personal computer, the input unit 307 and the display unit 308 may be provided as separate bodies so as to be connected to the main body by the USB interface 301.
 USBインターフェース301は、カメラ2で撮影された指の位置情報を受信する。 The USB interface 301 receives the finger position information captured by the camera 2.
 メモリ302は、元信号記憶部として、人肌に応じた振動の元となる音声信号である元信号を事前に記憶しておく。 The memory 302 stores in advance the original signal, which is an audio signal that is the source of vibration according to the human skin, as the original signal storage unit.
 オペレーションシステム(OS)303は、例えば、CPU(Central Processing Unit)331、FPGA(Field-Programmable Gate Array)332、RAM(Random Access Memory)333、ROM(Read Only Memory)333等を有している。CPU331及びFPGA332は、RAM333を作業領域として利用して、ROM334に格納された各種の制御プログラムを実行し、PC3における各種動作を制御するための制御指令を出力する。 The operation system (OS) 303 has, for example, a CPU (Central Processing Unit) 331, an FPGA (Field-Programmable Gate Array) 332, a RAM (Random Access Memory) 333, a ROM (Read Only Memory) 333, and the like. The CPU 331 and the FPGA 332 use the RAM 333 as a work area to execute various control programs stored in the ROM 334, and output control commands for controlling various operations in the PC 3.
 OS303において、例えばCPU331は、カメラ2で撮影された指の位置の画像を基に、指の動きの速度を算出する移動速度算出部となる。詳しくは、例えば、カメラ2に対応づけられたライブラリ、例えば、LeapMotion(登録商標)P5を用いて指の動きを検出し、指の移動速度を時間微分により算出する。また、FPGA332は、メモリ302に記憶された元信号を呼び出す。 In the OS 303, for example, the CPU 331 is a movement speed calculation unit that calculates the speed of finger movement based on the image of the finger position taken by the camera 2. Specifically, for example, a library associated with the camera 2, for example, Leap Motion (registered trademark) P5 is used to detect the movement of the finger, and the movement speed of the finger is calculated by time differentiation. Further, the FPGA 332 calls the original signal stored in the memory 302.
 サウンドコントローラ304は、呼び出された元信号(音声信号)に対して、指の動きに応じたボリューム調整を行う。例えば、指が静止中は振動を与えず、指が動き始めてから振動を与えるように、また、動きが速いほど振幅が大きくなるような音声信号を出力するように調整する。 The sound controller 304 adjusts the volume of the called original signal (voice signal) according to the movement of the finger. For example, it is adjusted so that it does not vibrate while the finger is stationary, but vibrates after the finger starts to move, and outputs an audio signal whose amplitude increases as the movement speed increases.
 オーディオ機器接続部305は、アンプ4と接続する端子でありサウンドコントローラ304で調整された音声信号を、アンプ4に出力する。 The audio device connection unit 305 is a terminal for connecting to the amplifier 4, and outputs an audio signal adjusted by the sound controller 304 to the amplifier 4.
 サウンドコントローラ304及びオーディオ機器接続部305は、指の移動速度および音声信号である元信号と、元信号の波形の振幅の調整値を出力する振動調整部として機能する。 The sound controller 304 and the audio equipment connection unit 305 function as a vibration adjustment unit that outputs the adjustment value of the amplitude of the waveform of the original signal and the original signal which is the movement speed of the finger and the voice signal.
 図5は、本発明の第1実施形態に係る人肌触感呈示装置100における制御シーケンス図である。 FIG. 5 is a control sequence diagram of the human skin touch presentation device 100 according to the first embodiment of the present invention.
 まず、呈示する前の準備として、被験者SがPC3に対して再現したい肌質を選択し(S101)、PC3において、触感呈示の際に呈示する選択された肌質に対応する、元信号(図6~図9Cで後述)を、PC3内で呼び出しておく(ステップS102)。 First, as a preparation before presentation, subject S selects the skin type to be reproduced for PC3 (S101), and the original signal (FIG.) corresponding to the selected skin type to be presented at the time of tactile presentation on PC3. 6 to 9C, which will be described later), are called in the PC3 (step S102).
 そして、被験者Sが、指Fで人肌ゲル1を触ると(S103)、カメラ2は、人肌ゲル1上の指の位置を検出し(S104)、その指位置データを、PC3に出力する。 Then, when the subject S touches the human skin gel 1 with the finger F (S103), the camera 2 detects the position of the finger on the human skin gel 1 (S104) and outputs the finger position data to the PC3. ..
 PC3は、元信号(音声信号)と、指位置データを基にした元信号の振幅調整指示を出力する。詳しくは、S105で、PC3において、カメラ2から受信した情報を基に、指の位置から指の移動速度を検出し、その動きに応じたボリューム調整を行い、アンプ4に調整された音声信号(指示されたボリュームの音声信号)を出力する(S106)。 The PC3 outputs the original signal (audio signal) and the amplitude adjustment instruction of the original signal based on the finger position data. Specifically, in S105, the PC 3 detects the movement speed of the finger from the position of the finger based on the information received from the camera 2, adjusts the volume according to the movement, and adjusts the audio signal to the amplifier 4. The audio signal of the instructed volume) is output (S106).
 S107で、アンプ4は、元信号(音声信号)を、指の動きに対応づけられて設定された強度で増幅して、増幅した音声信号を、スピーカー5A,5Bに出力する。 In S107, the amplifier 4 amplifies the original signal (audio signal) with the intensity set in association with the movement of the finger, and outputs the amplified audio signal to the speakers 5A and 5B.
 S108でスピーカー5A,5Bは振動を呈示する。この際、指が動いて初めて振動が提示する。そして、動きが速いほど振幅が大きくする。この振動呈示により、伝播板11を介して人肌ゲル1に振動が呈示され(S109)、被験者は、伝播板11を介して人肌ゲル1上で指Fによって振動を感知する際(S110)、より自然なテクスチャ感を生じる。 Speakers 5A and 5B exhibit vibration in S108. At this time, the vibration is presented only when the finger moves. The faster the movement, the larger the amplitude. Due to this vibration presentation, vibration is presented to the human skin gel 1 via the propagation plate 11 (S109), and when the subject senses the vibration with the finger F on the human skin gel 1 via the propagation plate 11 (S110). , Produces a more natural texture.
 <元信号の事前設定>
 次に、図6~図9Cを用いて、第1実施形態に係る人肌触感呈示装置100における元信号の取得方法について説明する。
<Pre-setting of original signal>
Next, a method of acquiring the original signal in the human skin tactile sensation presenting device 100 according to the first embodiment will be described with reference to FIGS. 6 to 9C.
 図6は、本発明の第1実施形態に係る人肌触感呈示装置100における元信号の設定手順を説明するフローチャートである。図7A,図7Bは、図6の元信号の設定手順において、加速度を用いて、人肌上及び人肌ゲル上の振動データを実測する際の測定図である。図8は、人肌上で加速度センサを用いて実測した振動データの例である。図9A~図9Cは、測定した振動データを、音声データを介して周波数分布に変換したグラフである。なお、元信号の事前設定において、最終的に設定される元信号は音声信号とし、途中段階の音声の信号を音声データとして説明する。 FIG. 6 is a flowchart illustrating a procedure for setting the original signal in the human skin tactile sensation presenting device 100 according to the first embodiment of the present invention. 7A and 7B are measurement diagrams when measuring vibration data on human skin and on human skin gel using acceleration in the setting procedure of the original signal of FIG. FIG. 8 is an example of vibration data actually measured on human skin using an acceleration sensor. 9A to 9C are graphs obtained by converting the measured vibration data into a frequency distribution via voice data. In the preset setting of the original signal, the original signal finally set will be an audio signal, and the audio signal in the middle stage will be described as audio data.
 図6に示す設定手順は、人肌触感呈示装置100が被験者に対して、図3、図11に示すように、触感を呈示する前に、予め準備する準備工程の一部である。 The setting procedure shown in FIG. 6 is a part of a preparatory step in which the human skin tactile sensation presenting device 100 prepares in advance before presenting the tactile sensation to the subject as shown in FIGS. 3 and 11.
 図7Aは、ステップS901での人肌H上での振動データ取得時、図7Bは、S904、S909の人肌ゲル10上での振動データ取得時の様子を示している。なお、元信号の設定に用いる情報処理装置は、図1のPC3と共通であってもよいし、異なるものであってもよい。しかし、周波数特性等の整合性をとるため、アンプ4、スピーカー5A,5B、人肌ゲル1、及び伝播板11等は、人肌触感呈示装置100に含まれるものを使用すると好適である。 FIG. 7A shows the state when the vibration data is acquired on the human skin H in step S901, and FIG. 7B shows the state when the vibration data is acquired on the human skin gel 10 in S904 and S909. The information processing device used to set the original signal may be the same as or different from the PC3 shown in FIG. However, in order to ensure consistency in frequency characteristics and the like, it is preferable to use the amplifier 4, the speakers 5A and 5B, the human skin gel 1, the propagation plate 11, and the like included in the human skin touch presenting device 100.
 まず、S901で、サンプル提供者の指の爪に加速度センサAを付して、人肌を触る際の振動データを実測値として取得する。S901での測定の様子を図7Aに示す。 First, in S901, the acceleration sensor A is attached to the fingernail of the sample provider, and the vibration data when touching the human skin is acquired as an actually measured value. The state of the measurement in S901 is shown in FIG. 7A.
 図7Aに示すように、指の爪上に設置された加速度センサAで、人の腕の皮膚(人肌)Hを移動しながらさわることで、振動データ(サンプルデータ)を収集する。本例では、加速度センサAとして、高精度加速度センサ(A3AX-SENSOR, AX2609B-01, TecGihan社製)を用いた。 As shown in FIG. 7A, the acceleration sensor A installed on the fingernail collects vibration data (sample data) by touching the skin (human skin) H of the human arm while moving. In this example, a high-precision acceleration sensor (A3AX-SENSOR, AX2609B-01, manufactured by TecGihan) was used as the acceleration sensor A.
 詳しくは、加速度センサAを、中指の先の爪に装着している状態で、サンプル提供者の一人である、本物の「荒い状態の皮膚」をなぞった。なぞる領域は、図7Aに示すように、左前腕外側のうぶ毛が生える50mm×20mmの部分をサンプルとし、指Fを4秒間で一方向に移動するように動かし、なぞっている間の振動データを取得した。 Specifically, with the accelerometer A attached to the tip of the middle finger, we traced the real "rough skin", one of the sample providers. As shown in FIG. 7A, the area to be traced is a sample of 50 mm × 20 mm where the downy hair on the outside of the left forearm grows, and the finger F is moved so as to move in one direction in 4 seconds, and the vibration data during the tracing. Was acquired.
 図7Aに示すように、人肌H上で加速度センサを用いて実測した振動データの一例を図8に示す。加速度センサAでは、図7Aに示すX、Y、Zの3方向のデータ振動が得られる。図8において、横軸は時間[秒]、縦軸は加速度[g(ジー)]を示す。ここで、指先皮膚の粘弾性により、今回はせん断方向の振動データが触覚提示には適していると考え、水平方向の加速度データ(X方向の振動データ)を、下記のS902で音声データに変換される対象となる振動データとした。 As shown in FIG. 7A, FIG. 8 shows an example of vibration data actually measured using an acceleration sensor on the human skin H. With the acceleration sensor A, data vibrations in the three directions of X, Y, and Z shown in FIG. 7A can be obtained. In FIG. 8, the horizontal axis represents time [seconds] and the vertical axis represents acceleration [g (G)]. Here, due to the viscoelasticity of the fingertip skin, it is considered that the vibration data in the shear direction is suitable for tactile presentation this time, and the horizontal acceleration data (vibration data in the X direction) is converted into voice data in S902 below. The vibration data to be used is used.
 そして、S902で、情報処理装置は、S901で取得したサンプルデータ(X方向の加速度データ(振動データ実測値))をオーディオソフト(例えば、Audacity(登録商標))に、取り込み、音声データ(実測値)にする。 Then, in S902, the information processing apparatus incorporates the sample data (acceleration data in the X direction (measured value of vibration data)) acquired in S901 into audio software (for example, Audacity®) and voice data (measured value). ).
 S903で、実測値の振動データの周波数分布を算出する。詳しくは、S902で生成した音声データをフーリエ変換することで、周波数特性グラフを生成する。図9Aは、実測値の振動データから変換した音声データを、フーリエ変換した周波数分布(実測値)を示す、周波数特性グラフである。図9A~図9Cにおいて、横軸に周波数(Hz)、縦軸に増幅度(dB)を示す。 In S903, the frequency distribution of the vibration data of the measured value is calculated. Specifically, the frequency characteristic graph is generated by Fourier transforming the voice data generated in S902. FIG. 9A is a frequency characteristic graph showing a frequency distribution (measured value) obtained by Fourier transforming the voice data converted from the vibration data of the measured value. In FIGS. 9A to 9C, the horizontal axis shows the frequency (Hz) and the vertical axis shows the amplification degree (dB).
 S904で、実測値の音声データを、アンプ4に与え、スピーカー5A,5Bで再生して人肌ゲル1に振動を呈示した状態で、人肌ゲル1を、人肌を触る際と同じ速さで同じ距離、指爪に加速度センサAを付して触った際の振動データを再現値として取得する。S904における測定の状況を、図7Bに示す。 In S904, the measured audio data is given to the amplifier 4, played back by the speakers 5A and 5B, and the human skin gel 1 is vibrated at the same speed as when the human skin gel 1 is touched. The vibration data when the acceleration sensor A is attached to the fingernail at the same distance and touched is acquired as a reproduced value. The state of measurement in S904 is shown in FIG. 7B.
 S905で、S904で取得した再現値の振動データを、情報処理装置でオーディオソフトに取り込み、再現値の音声データにする。 In S905, the vibration data of the reproduced value acquired in S904 is taken into the audio software by the information processing device and converted into the voice data of the reproduced value.
 S906において、再現値の振動データから変換したS905の音声データに、フーリエ変換をして、周波数分布を算出する。図9Bは、情報処理装置において、S104で生成した再現値の振動データから変換した音声データをフーリエ変換した周波数分布(再現値)を示す周波数特性グラフである。 In S906, the frequency distribution is calculated by performing a Fourier transform on the voice data of S905 converted from the vibration data of the reproduced value. FIG. 9B is a frequency characteristic graph showing a frequency distribution (reproduced value) obtained by Fourier transforming the voice data converted from the vibration data of the reproduced value generated in S104 in the information processing apparatus.
 S907で、S903で生成した周波数分布(実測値)と、S906で生成した周波数分布(再現値)との差によって、イコライザ(周波数調整フィルタ)を設計する。詳しくは、本来理想的にはこの2つの周波数分布は一致することが望ましいが、再生時に含まれるアンプ4やスピーカー5A,5Bのフィルタ特性、および人肌ゲル1の特性により、異なった結果となる。これを補正するため、図9Aと図9Bの振幅比率(dB表示では差分)によって、本例では10Hz刻みのイコライザを作成した。このイコライザは、「皮膚を直接触るときの周波数分布」と「アンプに信号を送り、スピーカー、伝播板、及び人肌ゲルを介して皮膚に振動が提示されたときの周波数分布」の違いを一致させる逆フィルタとして機能する。 In S907, the equalizer (frequency adjustment filter) is designed based on the difference between the frequency distribution (actual measurement value) generated in S903 and the frequency distribution (reproduced value) generated in S906. Specifically, ideally, it is desirable that these two frequency distributions match, but different results will be obtained depending on the filter characteristics of the amplifier 4 and speakers 5A and 5B included during playback, and the characteristics of the human skin gel 1. .. In order to correct this, an equalizer in increments of 10 Hz was created in this example by the amplitude ratios of FIGS. 9A and 9B (differences in dB display). This equalizer matches the difference between "frequency distribution when in direct contact with the skin" and "frequency distribution when a signal is sent to the amplifier and vibration is presented to the skin through the speaker, propagation plate, and human skin gel". Acts as an inverse filter.
 例えば、記録した振動の元信号(音声波形)を再生する際、スピーカー5A,5Bやアンプ4の特性や、人肌ゲル1経由で振動を感じるために生じる減衰などの影響で、基本的に低域通過フィルタがかかり、感じてほしい触感から変化する。これを補正するために逆のフィルタ、すなわち、ある程度高域側を増強するようなフィルタをかけることで、人肌ゲル1上の触感を本物の肌の触感に近づけている。 For example, when reproducing the original signal (audio waveform) of the recorded vibration, it is basically low due to the characteristics of the speakers 5A and 5B and the amplifier 4, and the attenuation caused by feeling the vibration via the human skin gel 1. A pass-through filter is applied, and it changes from the tactile sensation you want to feel. In order to correct this, a reverse filter, that is, a filter that enhances the high frequency side to some extent is applied to bring the tactile sensation on the human skin gel 1 closer to the tactile sensation of the real skin.
 そして、S908において、S902で算出した音声データ(実測値)に、S907で作成したイコライザ(逆フィルタ)を掛けて補正し、音声データ(補正値)を作成する。 Then, in S908, the voice data (measured value) calculated in S902 is corrected by applying the equalizer (inverse filter) created in S907 to create voice data (correction value).
 その後、確認のため、S909で、S908で作成した音声データ(補正値)をアンプ4に入力し、人肌ゲル1上で指の爪に設けられた加速度センサAによって、振動データ最終値を取得する。S909における測定の状況を、図7Bに示す。 After that, for confirmation, in S909, the voice data (correction value) created in S908 is input to the amplifier 4, and the final value of the vibration data is acquired by the acceleration sensor A provided on the fingernail on the human skin gel 1. To do. The state of measurement in S909 is shown in FIG. 7B.
 S910で、振動データ最終値を音声データ(最終値)に変換し、S911で再度、音声データ(最終値)をフーリエ変換し、周波数分布(最終値)算出する。図9Cは、情報処理装置において、S911で生成した最終値の振動データから変換した音声データ(最終値)を、フーリエ変換した周波数分布(最終値)を示す周波数特性グラフである。 In S910, the final value of the vibration data is converted into voice data (final value), and in S911, the voice data (final value) is Fourier-transformed again to calculate the frequency distribution (final value). FIG. 9C is a frequency characteristic graph showing a frequency distribution (final value) obtained by Fourier transforming the voice data (final value) converted from the vibration data of the final value generated in S911 in the information processing apparatus.
 S912で、S903で作成した周波数分布(実測値)と、S911で作成した周波数分布(最終値)とを比較して確認する。本例では、図9Cの波形は、図9Aの波形に比較的一致しており、イコライザが正しく機能したことを示唆している。 In S912, the frequency distribution (actual measurement value) created in S903 and the frequency distribution (final value) created in S911 are compared and confirmed. In this example, the waveform in FIG. 9C is relatively consistent with the waveform in FIG. 9A, suggesting that the equalizer worked correctly.
 なお、S912で、周波数分布(実測値)と、周波数分布(最終値)とを比較して、一致率が低い場合は、S907で設定したイコライザの刻みを変更したり、加速度センサAによるデータを取り直すことで、人肌H上の実測値と、人肌ゲル1上の最終値の振動の周波数を略一致させるように、調整すると好適である。 In S912, the frequency distribution (actual measurement value) and the frequency distribution (final value) are compared, and if the matching rate is low, the equalizer step set in S907 is changed, or the data by the acceleration sensor A is used. It is preferable to adjust so that the measured value on the human skin H and the vibration frequency of the final value on the human skin gel 1 are substantially matched by retaking.
 そして、S912での確認で問題が無い場合、S913で、S908で作成した音声データ(補正値)を、増幅前の、人肌に応じた、音声信号形式の元信号として設定し、PC3の元信号記憶部であるメモリ302に、記憶しておく。 Then, if there is no problem in the confirmation in S912, the voice data (correction value) created in S908 in S913 is set as the original signal in the voice signal format according to the human skin before amplification, and the source of the PC3. It is stored in the memory 302 which is a signal storage unit.
 このように実際の人の肌を用いて予めサンプルを収集して、振動の元信号を設定することで、本発明の人肌触感呈示装置において、人肌ゲルを多数準備することなく、実際に肌に触れる場合と同じような触り方で、任意の肌の状態を再現することができる。 By collecting samples in advance using actual human skin and setting the source signal of vibration in this way, the human skin tactile presentation device of the present invention can actually be used without preparing a large number of human skin gels. Any skin condition can be reproduced with the same touching method as when touching the skin.
 なお、図8、図9A~図9Cのグラフは、サンプル提供者が1人(n=1)で、「荒れた肌」のサンプルの一例であるが、サンプル提供者の数を増やすことで、より振動の元信号の信頼性を向上させることができる。さらに、サンプルの提供者として肌質の異なる人を集めたり、年代や性別の異なるサンプルを収集することで、本発明の人肌触感呈示装置で呈示する肌の種類を増やすことができる。 The graphs of FIGS. 8 and 9A to 9C are examples of a sample of "rough skin" with one sample provider (n = 1), but by increasing the number of sample providers, The reliability of the vibration source signal can be further improved. Furthermore, by collecting people with different skin types as sample providers or by collecting samples of different ages and genders, it is possible to increase the types of skin presented by the human skin tactile presentation device of the present invention.
 <第2実施形態>
 次に、図10~図14を用いて、第2実施形態の人肌触感呈示装置200について説明する。
<Second Embodiment>
Next, the human skin tactile sensation presenting device 200 of the second embodiment will be described with reference to FIGS. 10 to 14.
 図10は、本発明の第2実施形態に係る人肌触感呈示装置200の側面斜視図である。図11は、本発明の第2実施形態に係る人肌触感呈示装置200によって、被験者Sに人肌触感を呈示している模式図である。 FIG. 10 is a side perspective view of the human skin tactile sensation presenting device 200 according to the second embodiment of the present invention. FIG. 11 is a schematic view showing the human skin touch to the subject S by the human skin touch presenting device 200 according to the second embodiment of the present invention.
 本実施形態の人肌触感呈示装置200は、人肌ゲル10と、スライドボリューム6と、マイクロコントローラ7と、スイッチ75と、モータドライバIC8を備えている。 The human skin tactile presentation device 200 of the present embodiment includes a human skin gel 10, a slide volume 6, a microcontroller 7, a switch 75, and a motor driver IC 8.
 図10、図11に示すようにスライドボリューム6は、人肌ゲル10に対して、被験者Sに近い、手前側に配置される。 As shown in FIGS. 10 and 11, the slide volume 6 is arranged on the front side close to the subject S with respect to the human skin gel 10.
 スライドボリューム6は、人肌ゲル10上の指の移動速度を取得する移動速度取得部であるとともに、横方向(レール延伸方向)の指の移動時に、移動に抵抗を付加する(ブレーキをかける)、あるいは移動をアシスト(加速)する指移動補助部としても機能する。 The slide volume 6 is a movement speed acquisition unit that acquires the movement speed of the finger on the human skin gel 10, and adds resistance to the movement (brake) when the finger moves in the lateral direction (rail extension direction). Or, it also functions as a finger movement assisting unit that assists (accelerates) movement.
 マイクロコントローラ7は、例えば、電子基板上に1つのIC(Integrated Circuit)又は、回路を組み合わせて構成され、指の移動速度を算出し、抵抗・加速データから移動速度に応じた時間毎の1の制御値を選択することで、スライドボリューム6のモータ63(図12参照)の抵抗又は推進加速度(スライド触感)を調整するように、モータドライバIC8に出力する。 The microcontroller 7 is configured by combining one IC (Integrated Circuit) or a circuit on an electronic board, for example, calculates the movement speed of a finger, and calculates the movement speed of a finger, and uses resistance / acceleration data to obtain 1 for each time according to the movement speed. By selecting a control value, it is output to the motor driver IC 8 so as to adjust the resistance or propulsion acceleration (slide tactile sensation) of the motor 63 (see FIG. 12) of the slide volume 6.
 なお、レール61上のスライダー64(指輪66)に対して与える負荷抵抗と推進加速度のことを、まとめてスライド触感と呼ぶ場合がある。そして、マイクロコントローラ7内に記憶される、抵抗・加速を発生させるスライド触感の元データを、スライド触感信号と呼ぶ。 Note that the load resistance and propulsion acceleration given to the slider 64 (ring 66) on the rail 61 may be collectively referred to as the slide tactile sensation. Then, the original data of the slide tactile sensation that generates resistance / acceleration stored in the microcontroller 7 is called a slide tactile sensation signal.
 モータドライバIC8は、人肌ゲル10上の指に人肌触感を与えるように、スライドボリューム6のモータ63(図11参照)を制御する、指移動制御部の一部である。 The motor driver IC 8 is a part of the finger movement control unit that controls the motor 63 (see FIG. 11) of the slide volume 6 so as to give the finger on the human skin gel 10 a human skin feel.
 本実施形態において、人肌触感呈示装置200は、普段の肌の状態や、なりたい肌の状態等を再現するため、複数の肌に対応するスライド触感信号を記憶しておき、例えば、スイッチ75を操作したり、あるいはスマートフォン等から遠隔操作することで、マイクロコントローラ7からいずれかの肌に対応するスライド触感信号を出力可能にすると好適である。 In the present embodiment, the human skin tactile presentation device 200 stores slide tactile signals corresponding to a plurality of skins in order to reproduce a normal skin condition, a desired skin condition, and the like, and for example, a switch 75 is pressed. It is preferable that the microcontroller 7 can output a slide tactile signal corresponding to any skin by operating it or remotely controlling it from a smartphone or the like.
 即ち、マイクロコントローラ7において、スイッチ75で設定された肌質の選択情報に基づいて、スライド触感信号を選択する機能を、を有している。 That is, the microcontroller 7 has a function of selecting a slide tactile signal based on the skin type selection information set by the switch 75.
 例えば、マイクロコントローラ7のメモリ701(図13参照)に記憶された元信号は、信号毎に、例えば名称や符号や性質等が振られており、スイッチ75を操作することで、その回のスライド触感呈示に用いるスライド触感信号が選択される。 For example, the original signal stored in the memory 701 (see FIG. 13) of the microcontroller 7 is assigned a name, a code, a property, etc. for each signal, and by operating the switch 75, the slide of that time is performed. The slide tactile signal used for tactile presentation is selected.
 被験者Sは、素肌の触感を再現したい場合は、スイッチ75を操作することで、特定の素肌の肌状態を選択する。マイクロコントローラ7では、複数の種類の素肌に対応づけられたスライド触感に対応するスライド触感信号を記憶しておき、スイッチ75で選択された素肌に応じて、スライド触感信号を選択する。 Subject S selects a specific skin condition of the bare skin by operating the switch 75 when he / she wants to reproduce the tactile sensation of the bare skin. The microcontroller 7 stores the slide tactile signals corresponding to the slide tactile sensations associated with a plurality of types of bare skin, and selects the slide tactile sensation signals according to the bare skin selected by the switch 75.
 被験者Sは、化粧料等の塗布した状態の触感を再現したい場合は、基準液Rを人肌ゲルに滴下する。そして、被験者Sは、スイッチ75を操作することで、特定の化粧料を付した肌状態を選択する。マイクロコントローラ7では、複数の種類の化粧料を付した際の肌状態に対応づけられたスライド触感に対応するスライド触感信号を記憶しておき、スイッチ75で選択された化粧料に応じて、スライド触感信号を選択する。 Subject S drops the reference solution R onto the human skin gel when he / she wants to reproduce the tactile sensation of the applied state of cosmetics or the like. Then, the subject S selects a skin condition to which a specific cosmetic is applied by operating the switch 75. The microcontroller 7 stores a slide tactile signal corresponding to the slide tactile sensation associated with the skin condition when a plurality of types of cosmetics are applied, and slides according to the cosmetics selected by the switch 75. Select a tactile signal.
 また、同じ化粧料を塗布した場合でも素肌の状態によって、肌の触感が変化するため、素肌の状況を考慮した、所定の化粧料を付した際の肌状態を再現するように、スライド触感信号を細分化して準備してもよい。 In addition, even if the same cosmetic is applied, the tactile sensation of the skin changes depending on the condition of the bare skin, so a slide tactile signal that takes into consideration the condition of the bare skin and reproduces the skin condition when a predetermined cosmetic is applied. May be subdivided and prepared.
 なお、人肌ゲル10上において、素肌の状態や、化粧料を付した際の肌状態を再現するための、スライド触感信号の例は、図15A~図15Cとともに後述する。 An example of a slide tactile signal for reproducing the state of bare skin and the state of the skin when a cosmetic is applied on the human skin gel 10 will be described later together with FIGS. 15A to 15C.
 図12は、人肌触感呈示装置200における、スライドボリューム6及び人肌ゲル10の配置を説明する正面図である。 FIG. 12 is a front view illustrating the arrangement of the slide volume 6 and the human skin gel 10 in the human skin touch presentation device 200.
 図12に示すように、スライドボリューム6は、レール61と、レール61を支持する支持フレーム62と、モータ63と、レール61に対する操作端子であるスライダー64と、可変抵抗65とを有し、スライダー64には、環状の操作つまみとなる指輪66が装着されている。 As shown in FIG. 12, the slide volume 6 has a rail 61, a support frame 62 for supporting the rail 61, a motor 63, a slider 64 which is an operation terminal for the rail 61, and a variable resistor 65. A ring 66, which serves as an annular operation knob, is attached to the 64.
 可変抵抗65は、図12に示すように、レール61の両端部の端子651,652と、スライダー64の位置に対応付けられた可動端子653を有し、レール61に対するスライダー64の位置に相当する可動端子653の位置に応じて、抵抗値が変化する。 As shown in FIG. 12, the variable resistor 65 has terminals 651 and 652 at both ends of the rail 61 and movable terminals 653 associated with the positions of the slider 64, and corresponds to the position of the slider 64 with respect to the rail 61. The resistance value changes according to the position of the movable terminal 653.
 また、スライドボリューム6は、レール61上のスライダー64の移動を、モータ63によって負荷をかけたり(減速させたり)、加速(移動を促進)したりすることでスライド触感を与える、モータ駆動スライドボリュームである。 Further, the slide volume 6 is a motor-driven slide volume that gives a slide tactile sensation by applying a load (decelerating) or accelerating (promoting movement) the movement of the slider 64 on the rail 61 by the motor 63. Is.
 被験者Sは、指輪66に指Fを挿入した状態で、肌モデルである人肌ゲル10を触る。指先の指腹を、人肌ゲル10に沿って左右に移動させると、指Fの根元が指輪66に接触し、指輪66も一緒に移動する。その際、レール61上を、スライダー64が移動することで、スライダー61付属の可変抵抗65の抵抗値が変化する。この抵抗値の変化を、後段のマイクロコントローラ7が読み取ることで、指の位置および移動速度を計算することができる。 Subject S touches the human skin gel 10, which is a skin model, with the finger F inserted into the ring 66. When the finger pad of the fingertip is moved to the left or right along the human skin gel 10, the base of the finger F comes into contact with the ring 66, and the ring 66 also moves together. At that time, as the slider 64 moves on the rail 61, the resistance value of the variable resistor 65 attached to the slider 61 changes. The position and moving speed of the finger can be calculated by reading the change in the resistance value by the microcontroller 7 in the subsequent stage.
 なお、本実施形態では、被験者の指先は左右に移動させることを前提としているため、人肌ゲル10は、左右方向に長く設けられていると好適である。本例では、人肌ゲル10は、上側のアクリル板である伝播板11の上面全体に貼りつけられている例を示している。 Since the present embodiment is premised on moving the fingertips of the subject to the left and right, it is preferable that the human skin gel 10 is provided long in the left and right direction. In this example, the human skin gel 10 is attached to the entire upper surface of the propagation plate 11 which is the upper acrylic plate.
 また、本実施形態では、スライドボリューム6は、指輪66の内周面の位置が、上下方向において、指先が接触する人肌ゲル10と略同じ又は人肌ゲル10の位置よりも少し上方にくるように配置される。そのため、スライドボリューム6の下面は、下側のアクリル板である固定板12の上面に固定される。 Further, in the present embodiment, the position of the inner peripheral surface of the ring 66 of the slide volume 6 is substantially the same as that of the human skin gel 10 with which the fingertips come into contact in the vertical direction, or slightly above the position of the human skin gel 10. Arranged like this. Therefore, the lower surface of the slide volume 6 is fixed to the upper surface of the fixing plate 12 which is the lower acrylic plate.
 また、本実施形態では、スピーカーを設けないため、人肌ゲル10が取りつけられた上側のアクリル板である11は、支持側板15A,15Bに挟まれることによって支持されており、その支持側板15A,15Bは、下側のアクリル板である固定板12に固定されている。 Further, in the present embodiment, since the speaker is not provided, the upper acrylic plate 11 to which the human skin gel 10 is attached is supported by being sandwiched between the support side plates 15A and 15B, and the support side plates 15A, 15B is fixed to the fixing plate 12 which is the lower acrylic plate.
 下側のアクリル板である固定板12の下面は、ベース13の上面に、取りつけられている。 The lower surface of the fixing plate 12, which is the lower acrylic plate, is attached to the upper surface of the base 13.
 本実施形態では、指輪66が左右に移動する際、スライドボリューム6のレール61側の支持フレーム62が移動しないように、ベース13の下面は、机に対して、左右方向の位置ずれを防止する滑り止め16A,16Bが設けられている。 In the present embodiment, the lower surface of the base 13 prevents the slide volume 6 from being displaced in the left-right direction with respect to the desk so that the support frame 62 on the rail 61 side of the slide volume 6 does not move when the ring 66 moves left and right. Non-slip 16A and 16B are provided.
 図13は、本発明の第2実施形態に係る人肌触感呈示装置200のブロック図である。
本構成では、マイクロコントローラ7は、メモリ701と、第1のASIC702と、第2のASIC703と、接続端子704等を有している。
FIG. 13 is a block diagram of the human skin tactile sensation presenting device 200 according to the second embodiment of the present invention.
In this configuration, the microcontroller 7 has a memory 701, a first ASIC 702, a second ASIC 703, a connection terminal 704, and the like.
 メモリ701は、人の肌の摩擦や滑らかさに対応する抵抗・加速データ、即ち横方向の肌の再現データに相当するスライド触感信号を記憶しておく、スライド触感信号記憶部である。 The memory 701 is a slide tactile signal storage unit that stores resistance / acceleration data corresponding to friction and smoothness of human skin, that is, slide tactile signals corresponding to lateral skin reproduction data.
 第1のASIC702では、スライドボリューム6のモータ63の電圧値の変化を読み取り、左右方向に指が移動する速度を、モータ63が示す位置の時間微分から算出する。そして、ASIC702は、指の移動速度に応じて、スライド触感信号における制御値を選択し、指移動補助部であるモータ63の抵抗又は加速を調整することで、人肌ゲル10上の指に摩擦や滑らかさの人肌触感を与える。ASIC702は、補助動作制御部の一部として機能する。 The first ASIC 702 reads the change in the voltage value of the motor 63 of the slide volume 6, and calculates the speed at which the finger moves in the left-right direction from the time derivative of the position indicated by the motor 63. Then, the ASIC 702 selects a control value in the slide tactile signal according to the movement speed of the finger, and adjusts the resistance or acceleration of the motor 63 which is a finger movement assisting portion, thereby rubbing the finger on the human skin gel 10. Gives a smooth and smooth feel to the human skin. The ASIC 702 functions as a part of the auxiliary operation control unit.
 第2のASIC703は、スイッチ75での選択情報を読み込んで、選択情報に対応付けられたスライド触感信号を選択して出力する、スライド触感信号選択部として機能する。 The second ASIC703 functions as a slide tactile signal selection unit that reads the selection information on the switch 75, selects and outputs the slide tactile signal associated with the selection information.
 接続端子704は、マイクロコントローラ7を、スライドボリューム6、スイッチ75、及びモータドライバIC8と接続する端子である。 The connection terminal 704 is a terminal for connecting the microcontroller 7 to the slide volume 6, the switch 75, and the motor driver IC 8.
 図14は、本発明の第2実施形態に係る人肌触感呈示装置200におけるシーケンス図である。図14を用いて、人肌触感呈示装置200におけるシーケンスの説明をする。 FIG. 14 is a sequence diagram of the human skin tactile sensation presenting device 200 according to the second embodiment of the present invention. The sequence in the human skin tactile sensation presenting device 200 will be described with reference to FIG.
 まず、事前準備として、被験者Sがスイッチ75に対して再現したい肌質を選択し(S201)、マイクロコントローラ7は、スイッチ75での選択情報を読み込み(S202)、マイクロコントローラ7は、選択された肌質に対応するスライド触感信号(図15A~図15C参照)を呼び出す(S203)。 First, as a preliminary preparation, the subject S selects the skin type to be reproduced for the switch 75 (S201), the microcontroller 7 reads the selection information on the switch 75 (S202), and the microcontroller 7 is selected. A slide tactile signal (see FIGS. 15A to 15C) corresponding to the skin type is called (S203).
 S204で、被験者Sの指Fが人肌ゲル10上に触れて、指Fが移動すると、スライドボリューム6のスライダー64に取りつけられた指輪66も一緒に移動する(S205)。 In S204, when the finger F of the subject S touches the human skin gel 10 and the finger F moves, the ring 66 attached to the slider 64 of the slide volume 6 also moves (S205).
 S206で、S205での指輪66の位置に応じて、スライドボリューム6の可変抵抗65の抵抗値が変化する。即ち、S204~S206で、スライドボリューム6は、指の位置の時間変化の情報を出力する。この際、例えば、指の位置は、1kHz毎にサンプリングする。 In S206, the resistance value of the variable resistor 65 of the slide volume 6 changes according to the position of the ring 66 in S205. That is, in S204 to S206, the slide volume 6 outputs information on the time change of the finger position. At this time, for example, the position of the finger is sampled every 1 kHz.
 S207で、マイクロコントローラ7は、スライドボリューム6の可変抵抗65の抵抗値の変化を読み取り、S208で、指の移動速度を、位置の時間微分から算出する。 In S207, the microcontroller 7 reads the change in the resistance value of the variable resistor 65 of the slide volume 6, and in S208, the finger movement speed is calculated from the time derivative of the position.
 そして、S209で、マイクロコントローラ7は、モータドライバIC8に対して、所定の負荷抵抗又は加速を与えるよう、スライド触感信号から、指の移動速度を反映した値を選択して指示する。 Then, in S209, the microcontroller 7 instructs the motor driver IC8 by selecting a value that reflects the moving speed of the finger from the slide tactile signal so as to give a predetermined load resistance or acceleration.
 S210で、モータドライバIC8は、S207で指示された負荷抵抗又は加速に応じて、スライドボリューム6のモータ63を制御する。 In S210, the motor driver IC8 controls the motor 63 of the slide volume 6 according to the load resistance or acceleration instructed in S207.
 そして、S211で、モータ63が移動する指に対して、調整された規制(負荷)又は加速を呈示することで、S212で、被験者は、スライドボリューム6の負荷や加速から肌をなぞる時の摩擦や滑らかさを感知する。 Then, in S211, the motor 63 presents the adjusted regulation (load) or acceleration to the moving finger, and in S212, the subject feels friction when tracing the skin from the load or acceleration of the slide volume 6. And sense smoothness.
 ここで、S203で呼び出されて設定され、S209~S211で出力する肌質に応じたスライド触感信号の例を、図15A~図15Cに示す。図15Aは、粗い肌に対応するスライド触感信号の設定例、図15Bは、滑らかな肌に対応するスライド触感信号の設定例、図15Cは、べたついている肌のスライド触感信号の設定例である。 Here, FIGS. 15A to 15C show examples of slide tactile signals according to the skin type, which are called and set in S203 and output in S209 to S211. FIG. 15A is an example of setting a slide tactile signal corresponding to rough skin, FIG. 15B is an example of setting a slide tactile signal corresponding to smooth skin, and FIG. 15C is an example of setting a slide tactile signal of sticky skin. ..
 図15Aは粗い肌の素肌に対応する触感設定例であって、横軸に、指の速度、縦軸に負荷抵抗を示す。本例では、指は移動する速度がある閾値より小さい場合は「静止」と判断し、静止摩擦力を提示する。具体的には指を、元の位置に戻すような位置制御を行う。そして、指が移動する速度がある閾値を超えた場合には「動き」と判断し、一定の摩擦力を提示する。ここで呈示する摩擦力は、具体的には速度に依存しない一定の反力を提示する。 FIG. 15A is an example of tactile sensation setting corresponding to the bare skin of rough skin, and the horizontal axis shows the speed of the finger and the vertical axis shows the load resistance. In this example, when the moving speed is smaller than a certain threshold value, the finger is judged to be "resting" and the static frictional force is presented. Specifically, the position control is performed so that the finger is returned to the original position. Then, when the speed at which the finger moves exceeds a certain threshold value, it is determined as "movement" and a constant frictional force is presented. The frictional force presented here specifically presents a constant reaction force that does not depend on the speed.
 図15Bは、なめらかな肌の素肌に対応する触感設定例であって、横軸に指の速度、縦軸に推進加速度を示す。本例では、指が移動する速度がある閾値を超えた場合に、速度の方向に押すような力(推進加速度)を加える。これによって指がよりなめらかに滑るような感触を与え、対象物である人肌ゲル10がよりなめらかになったような感覚を与える。 FIG. 15B is an example of tactile sensation setting corresponding to the bare skin of smooth skin, and the horizontal axis shows the speed of the finger and the vertical axis shows the propulsion acceleration. In this example, when the speed at which the finger moves exceeds a certain threshold value, a force (propulsion acceleration) that pushes the finger in the direction of the speed is applied. As a result, the finger feels as if it slides more smoothly, and the human skin gel 10, which is the object, gives a feeling as if it becomes smoother.
 図15A、図15Bは、素肌を再現するスライド触感データの例を示したが、本構成では、肌に対して、化粧料や、美容液、オイル等を塗布した後の状態を示すことも可能である。 15A and 15B show examples of slide tactile data that reproduces bare skin, but in this configuration, it is also possible to show the state after applying cosmetics, beauty essence, oil, etc. to the skin. Is.
 図15Cは、肌(例えば、滑らかな肌)に対して、粘性が高い化粧料、例えば、オイルや軟膏のような粘性のものを塗布した後のべたついた肌の状態を再現する触感設定例を示す。図15Cにおいて、横軸は指の速度、縦軸は、負荷抵抗を示す。本例では、速度に比例した反力を呈示することで、「粘性」を呈示する。例えば一般的なモータ制御方式である、モータ63に加える電圧を変える、又はモータ63に加えるPWM(Pulse Width Modulation)パルスのパルス比率を変えることで、反力を増加させいく。 FIG. 15C shows an example of tactile setting that reproduces the state of sticky skin after applying a highly viscous cosmetic such as oil or ointment to the skin (for example, smooth skin). Shown. In FIG. 15C, the horizontal axis represents the speed of the finger and the vertical axis represents the load resistance. In this example, "viscosity" is exhibited by presenting a reaction force proportional to the velocity. For example, the reaction force is increased by changing the voltage applied to the motor 63, which is a general motor control method, or changing the pulse ratio of the PWM (Pulse Width Modulation) pulse applied to the motor 63.
 粘性を有する肌の例として、上記例では、肌に塗った軟膏状の塗布物を塗布した場合のべたつきを説明したが、塗布物を塗布しない場合であっても、身体が不調の際に発生する粘性の高いべたついた汗が肌を覆っている肌状態を表現する場合も、上記図15Cのように、「粘性」を呈示する反力によって、スライド触感を表現することができる。 As an example of viscous skin, in the above example, stickiness when an ointment-like coating applied to the skin is applied has been described, but even when the coating is not applied, it occurs when the body is in a bad condition. Even when expressing the skin condition in which highly viscous sticky sweat covers the skin, the slide tactile sensation can be expressed by the reaction force exhibiting "viscosity" as shown in FIG. 15C.
 ここで、図14のS209でマイクロコントローラ7が、モータドライバIC8に対して指示する際、例えば図15Aのようなスライド触感を出力する場合は、速度に依らず、負荷抵抗は変更せずに、速度閾値との比較のみで2値のうちいずれか1つの負荷抵抗を出力する。 Here, when the microcontroller 7 gives an instruction to the motor driver IC8 in S209 of FIG. 14, for example, when the slide tactile sensation as shown in FIG. 15A is output, the load resistance is not changed regardless of the speed. The load resistance of any one of the two values is output only by comparing with the speed threshold value.
 一方、例えば図15B、図15Cのようなスライド触感を出力する場合は、速度に応じて、推進加速度や、負荷抵抗が変化するため、位置の微分により算出した指の移動速度に相当する、推進加速度や、負荷抵抗に相当する値を、リアルタイムにグラフ内で抽出して反映して出力する。 On the other hand, when the slide tactile sensation as shown in FIGS. 15B and 15C is output, the propulsion acceleration and the load resistance change according to the speed, so that the propulsion corresponds to the finger movement speed calculated by differentiating the position. Values corresponding to acceleration and load resistance are extracted and reflected in a graph in real time for output.
 なお、上記の例では、1つの肌質を表現するスライド触感信号として、図15A、図15Cでは負荷抵抗を用い、図15Bでは、推進加速度を用いる例をしたが、1つの肌質を表現するスライド触感として、速度閾値を境界として、負荷抵抗と推進加速の両方を与えるような信号を設定してもよい。 In the above example, as the slide tactile signal expressing one skin type, the load resistance is used in FIGS. 15A and 15C, and the propulsion acceleration is used in FIG. 15B, but one skin type is expressed. As the slide tactile sensation, a signal that gives both load resistance and propulsion acceleration may be set with the velocity threshold as a boundary.
 <第3実施形態>
 次に、図16~図19を用いて、第3実施形態の人肌触感呈示装置300について説明する。
<Third Embodiment>
Next, the human skin tactile sensation presenting device 300 of the third embodiment will be described with reference to FIGS. 16 to 19.
 図16は、本発明の第3実施形態に係る人肌触感呈示装置300の側面斜視図である。
人肌触感呈示装置は、第2実施形態の構成に加えて、PC30と、デジタルポテンショメータ9と、アンプ4と、スピーカー5A,5Bを備えている。
FIG. 16 is a side perspective view of the human skin tactile sensation presenting device 300 according to the third embodiment of the present invention.
The human skin tactile presentation device includes a PC 30, a digital potentiometer 9, an amplifier 4, and speakers 5A and 5B in addition to the configuration of the second embodiment.
 そのため、被験者Sの指Fに対して、指先の指腹への振動と、指の根元の左右方向の移動の際のスライド触感の両方を実施することができる。 Therefore, for the finger F of the subject S, both the vibration of the fingertip to the finger pad and the slide tactile sensation when the base of the finger is moved in the left-right direction can be performed.
 図17は、本発明の第3実施形態に係る人肌触感呈示装置300においてPC30を除いた上面図である。 FIG. 17 is a top view of the human skin tactile presentation device 300 according to the third embodiment of the present invention, excluding the PC30.
 本実施形態では、スピーカー5A,5Bが設けられているため、第1実施形態と同様に、人肌ゲル10が設けられたアクリル板である伝播板11は、1対のスピーカー5A,5Bによって挟まれて支持されている。 In the present embodiment, since the speakers 5A and 5B are provided, the propagation plate 11 which is an acrylic plate provided with the human skin gel 10 is sandwiched between the pair of speakers 5A and 5B as in the first embodiment. Is supported.
 なお、本実施形態では、第2実施形態と同様に、被験者Sの指先は左右に移動させることを前提としているため、人肌ゲル10は、左右方向に長く設けられていると好適である。 In the present embodiment, as in the second embodiment, it is assumed that the fingertip of the subject S is moved to the left and right, so it is preferable that the human skin gel 10 is provided long in the left and right direction.
 図18は、本発明の第3実施形態に係る人肌触感呈示装置300のブロック図である。第2実施形態との相違点のみ説明する。 FIG. 18 is a block diagram of the human skin touch presentation device 300 according to the third embodiment of the present invention. Only the differences from the second embodiment will be described.
 本実施形態では、マイクロコントローラ7が、スライドボリューム6での指の移動を基に、指の移動速度を計算するため、PC30において、指の移動速度演算機能は有していなくてもよい。また、PC30において、肌質の選択機能を有しているため、スイッチ75は有していない。 In the present embodiment, since the microcontroller 7 calculates the finger movement speed based on the finger movement on the slide volume 6, the PC 30 does not have to have the finger movement speed calculation function. Further, since the PC 30 has a skin type selection function, the switch 75 is not provided.
 また、PC30のメモリ302は、人肌に対応づけた振動に対応する元信号(音声信号)を記憶しておく元信号記憶部として機能する。 Further, the memory 302 of the PC 30 functions as a source signal storage unit for storing the source signal (audio signal) corresponding to the vibration associated with the human skin.
 なお、本例では、有線で接続されたPC内にメモリを設ける例を説明したが、PC30は、無線で接続されてもよい。本実施形態では、PC30は、指の速度を演算する必要がないため、スマートフォンや、他のメモリであってもよく、あるいはリモコンやスイッチによって操作されて選択的に元信号を出力するHDD等のメモリ単体であってもよい。 In this example, the example in which the memory is provided in the PC connected by wire has been described, but the PC 30 may be connected wirelessly. In the present embodiment, since the PC 30 does not need to calculate the speed of the finger, it may be a smartphone or another memory, or an HDD operated by a remote controller or a switch to selectively output the original signal. The memory alone may be used.
 なお、第2実施形態では、スイッチ75を用いて再現する肌質を選択する例を用いたが、本実施形態では、PC30を含む場合、肌質を表現するスライド触感信号についても、PC30を介して選択することができる。本実施形態では、PC30の入力部307は、振動の元となる元信号及びスライド触感信号を選択するための、肌状態選択部、化粧料選択部として機能する。 In the second embodiment, an example of selecting the skin quality to be reproduced by using the switch 75 was used, but in the present embodiment, when the PC 30 is included, the slide tactile signal expressing the skin quality is also transmitted via the PC 30. Can be selected. In the present embodiment, the input unit 307 of the PC 30 functions as a skin condition selection unit and a cosmetic selection unit for selecting the original signal and the slide tactile signal that are the sources of vibration.
 この構成では、被験者Sは、素肌の触感を再現したい場合は、表示部308に表示された肌の名称の中から、1つの肌を選択すると、PC30は、複数の素肌の状態から選択される所定の素肌の情報を、マイクロコントローラ7に出力する。 In this configuration, when the subject S wants to reproduce the tactile sensation of the bare skin, he / she selects one skin from the names of the skin displayed on the display unit 308, and the PC 30 is selected from a plurality of bare skin states. The predetermined bare skin information is output to the microcontroller 7.
 また、被験者Sは、化粧品等の塗布した状態の触感を再現したい場合は、まず、基準液Rを人肌ゲルに滴下する。そして、PC30は、表示部308に、複数の種類の化粧料を選択させる画面を表示させ、被験者に、特定の化粧料を付した肌状態を選択させる。PC30では、複数の種類の化粧料の中から、選択される化粧料の種類を付した肌質の情報を、マイクロコントローラ7に出力する。 Further, when the subject S wants to reproduce the tactile sensation of the applied state of cosmetics or the like, first, the reference solution R is dropped on the human skin gel. Then, the PC 30 causes the display unit 308 to display a screen for selecting a plurality of types of cosmetics, and causes the subject to select a skin condition to which a specific cosmetic is applied. The PC 30 outputs information on the skin quality with the type of cosmetic selected from the plurality of types of cosmetics to the microcontroller 7.
 なお、PC30では、肌状態と振動の元となる元信号とを対応づける、上述の表1、表2のような相関テーブルは記憶しているが、肌状態とスライド触感信号とを対応づける相関テーブルは、マイクロコントローラ7に記憶されている。 Although the PC30 stores the correlation tables as shown in Tables 1 and 2 described above, which associate the skin condition with the original signal that is the source of vibration, the correlation between the skin condition and the slide tactile signal is stored. The table is stored in the microcontroller 7.
 また、デジタルポテンショメータ9は、音声データの大小を調整する。本実施形態では、デジタルポテンショメータ9は、指の移動速度に応じて、元信号(音声信号)を出力する際の振動の強さ(振幅の幅)を調整する振動調整部として機能する。 In addition, the digital potentiometer 9 adjusts the magnitude of voice data. In the present embodiment, the digital potentiometer 9 functions as a vibration adjusting unit that adjusts the strength (amplitude width) of vibration when outputting the original signal (voice signal) according to the moving speed of the finger.
 アンプ4は、PC3から出力された元信号の振動の振幅値を、デジタルポテンショメータ9の強度情報(ボリューム値)に応じて、増幅する。 The amplifier 4 amplifies the amplitude value of the vibration of the original signal output from the PC 3 according to the intensity information (volume value) of the digital potentiometer 9.
 スピーカー5A,5Bは、調整された音声信号を物理振動に変換して出力し、伝播板11を介して人肌ゲル10に振動を与える。本実施形態では、スピーカー5A,5Bが、振動出力部として機能する。 The speakers 5A and 5B convert the adjusted audio signal into physical vibration and output it, and vibrate the human skin gel 10 via the propagation plate 11. In this embodiment, the speakers 5A and 5B function as vibration output units.
 図19は、本発明の第3実施形態に係る人肌触感呈示装置300におけるシーケンス図である。 FIG. 19 is a sequence diagram of the human skin touch presentation device 300 according to the third embodiment of the present invention.
 事前の準備として、被験者SがPC30に対して再現したい肌質を選択すると(S301)、S302で、その選択された肌質の情報をマイクロコントローラ7に出力し、S303で、マイクロコントローラ7は、選択された肌質に対応するスライド触感信号(元データ)を呼び出す。また、S304で、PC30内で、選択された肌質に対応する、表現する肌の振動の元信号を呼び出して、デジタルポテンショメータ9に出力しておく。 As a preliminary preparation, when the subject S selects the skin type to be reproduced for the PC30 (S301), the information of the selected skin type is output to the microcontroller 7 in S302, and the microcontroller 7 in S303. Call the slide tactile signal (original data) corresponding to the selected skin type. Further, in S304, the original signal of the vibration of the skin to be expressed corresponding to the selected skin type is called in the PC 30 and output to the digital potentiometer 9.
 S305で、被験者Sの指Fが人肌ゲル10上に触れて、指Fが移動すると、S306でスライドボリューム6のスライダー64に取りつけられた、指輪66も一緒に移動する。 In S305, when the finger F of the subject S touches the human skin gel 10 and the finger F moves, the ring 66 attached to the slider 64 of the slide volume 6 in S306 also moves together.
 S307で、S305での指輪66の位置に応じて、スライドボリューム6の可変抵抗65の抵抗値が変化する。即ち、S305~S307で、スライドボリューム6は、指の位置の時間変化の情報を出力する。この際、例えば、指の位置は、1kHz毎にサンプリングする。 In S307, the resistance value of the variable resistor 65 of the slide volume 6 changes according to the position of the ring 66 in S305. That is, in S305 to S307, the slide volume 6 outputs information on the time change of the finger position. At this time, for example, the position of the finger is sampled every 1 kHz.
 S308で、マイクロコントローラ7は、可変抵抗65の抵抗値の変化を読み取り、S307で、指の速度を、位置の時間微分から算出する。 In S308, the microcontroller 7 reads the change in the resistance value of the variable resistor 65, and in S307, calculates the speed of the finger from the time derivative of the position.
 S310で、算出した指の速度情報を、デジタルポテンショメータ9に出力する。 The finger speed information calculated in S310 is output to the digital potentiometer 9.
 S311で、デジタルポテンショメータ9は、S302で指示された元信号及び指の速度に応じて、ボリュームを調整して、アンプ4に出力する。 In S311 the digital potentiometer 9 adjusts the volume according to the original signal and the speed of the finger instructed in S302, and outputs the volume to the amplifier 4.
 そしてS312で、アンプ4は、設定されたボリュームで、呼び出した元信号である音声信号を、増幅した音声信号を出力する。 Then, in S312, the amplifier 4 outputs the amplified audio signal of the called original signal at the set volume.
 S313で、スピーカー5A,5Bは、増幅された音声信号を物理振動として出力する。この際、指が動いて初めて、振動を呈示することで、被験者Sは、指Fに振動を感知する。 In S313, the speakers 5A and 5B output the amplified audio signal as physical vibration. At this time, the subject S senses the vibration to the finger F by exhibiting the vibration only when the finger moves.
 一方、S314で、マイクロコントローラ7は、指の移動速度に応じて、スライド触感信号における制御値を選択し、モータドライバIC8に対して、所定の負荷抵抗又は加速(スライド触感)を与えるように指示する。 On the other hand, in S314, the microcontroller 7 selects a control value in the slide tactile signal according to the moving speed of the finger, and instructs the motor driver IC8 to give a predetermined load resistance or acceleration (slide tactile sensation). To do.
 S315で、モータドライバIC8は、S302~S305で指示された負荷抵抗又は加速に応じて、スライドボリューム6のモータ63を制御する。 In S315, the motor driver IC8 controls the motor 63 of the slide volume 6 according to the load resistance or acceleration instructed in S302 to S305.
 S316で、スライドボリューム6において、モータ63が、左右方向の指輪66の移動に対して規制又は加速(スライド触感)を呈示する。 In S316, at the slide volume 6, the motor 63 presents regulation or acceleration (slide tactile sensation) with respect to the movement of the ring 66 in the left-right direction.
 なお、S310~S313の上下方向の振動に関する制御動作と、S314~S316の横方向のスライド触感に関する制御動作とは同時に並行して処理が実行される。 Note that the processing is executed in parallel with the control operation related to the vertical vibration of S310 to S313 and the control operation related to the lateral slide tactile sensation of S314 to S316 at the same time.
 S317で、被験者は、S316でのスライドボリューム6の負荷や加速(スライド触感の付加)から、肌をなぞる時の摩擦を感知する。 In S317, the subject senses friction when tracing the skin from the load and acceleration (addition of slide tactile sensation) of the slide volume 6 in S316.
 S318で、S313でのスピーカー5A,5Bからの振動が伝播して、人肌ゲル10において振動が呈示され、S319で、被験者は指で振動を感知する。 In S318, the vibration from the speakers 5A and 5B in S313 propagates, and the vibration is presented in the human skin gel 10, and in S319, the subject senses the vibration with his / her finger.
 なお、本実施形態では、指先が接触する人肌ゲルからの振動と、指の根元に加える負荷又は推進力を組み合わせることにより、より多彩な種類の肌を再現でき、より肌に近い感覚を被験者に与えることができる。 In this embodiment, a wider variety of types of skin can be reproduced by combining the vibration from the human skin gel that the fingertips come into contact with and the load or propulsive force applied to the base of the finger, and the subject feels closer to the skin. Can be given to.
 なお、上記第1~第3実施形態では、人肌ゲルは室温と同じである例を説明したが、人肌ゲルの触感をよりリアルな人肌に近づけるため、伝播板11の裏側に、人肌ゲル1(10)を15℃~37℃に加熱する加熱部HT(図17参照)を設けてもよい。 In the first to third embodiments, the example in which the human skin gel is the same as room temperature has been described. A heating unit HT (see FIG. 17) that heats the skin gel 1 (10) to 15 ° C. to 37 ° C. may be provided.
 <使用例1:カウンセリング>
 図20は、ビューティーアドバイザーが、カウンセリングにおいて、本発明の第3実施形態に係る人肌触感呈示装置300を用いて、カスタマーに肌質を呈示している模式図である。
<Usage example 1: Counseling>
FIG. 20 is a schematic diagram in which a beauty advisor presents skin quality to a customer by using the human skin tactile sensation presenting device 300 according to the third embodiment of the present invention in counseling.
 例えば、人肌触感呈示装置300において、普段の肌の状態や、なりたい肌の状態等を再現するため、予め、複数の肌に対応する振動の元信号(例えば、上記の表1や、表2のようなもの)や、スライド触感の元データ(例えば、図15A~図15Cのようなスライド触感信号)を複数取得し、PC30内に記憶させておく。 For example, in the human skin tactile presentation device 300, in order to reproduce the normal skin condition, the desired skin condition, and the like, the original signals of vibration corresponding to a plurality of skins (for example, Table 1 and Table 2 above) (Such as) and a plurality of original data of the slide tactile sensation (for example, slide tactile sensation signals as shown in FIGS. 15A to 15C) are acquired and stored in the PC 30.
 ここで、ビューティーアドバイザーBは、被験者S(カスタマー)に対して、素肌の感触、あるいは、化粧料、美容料、オイル等の塗布後の肌の感触を再現するように、図19のシーケンスにおけるS301で、呈示する肌質の選択を、入力する。そして人肌触感呈示装置300において、選択された肌質に沿った、振動の元信号や、スライド触感の元データが設定され、被験者(カスタマー)の指に対して振動やスライド触感を呈示する。 Here, the beauty advisor B has S301 in the sequence of FIG. 19 so as to reproduce the feel of the bare skin or the feel of the skin after application of cosmetics, beauty agents, oils, etc. to the subject S (customer). Then, enter the selection of the skin type to be presented. Then, in the human skin tactile sensation presenting device 300, the original signal of vibration and the original data of slide tactile sensation are set according to the selected skin type, and the vibration and slide tactile sensation are presented to the finger of the subject (customer).
 一例として、ビューティーアドバイザーは、顧客である被験者のカウンセリングをすること、又は被験者の肌を直接触れることで、現在の被験者の現在の肌の状態を、人肌触感呈示装置で再現して被験者の指に呈示する。あるいは、理想の肌や、なりたい肌の状態を、人肌触感呈示装置300で再現して、被験者の指に呈示する。 As an example, the beauty advisor reproduces the current skin condition of the subject with a human skin tactile presentation device by counseling the subject who is the customer or by directly touching the subject's skin, and the subject's finger. Present to. Alternatively, the ideal skin or the desired skin condition is reproduced by the human skin tactile presentation device 300 and presented to the finger of the subject.
 さらに、特定の化粧料を使用することで、実現できる状態を、例えば、基準液Rを人肌ゲルに滴化して人肌触感呈示装置300で再現して、被験者の指に呈示する。そして、その化粧料を使った場合に、例えば体温で時間とともに溶ける等、表面が経時変化する場合は、10分後、20分後、30分後の肌を、その時間にならなくても、人肌触感呈示装置によって再現し、呈示することができる。あるいは、その化粧料を継続的に使用する場合に出てくる肌の効果等を説明したい場合に、その化粧料を例えば1日2回継続使用して、1日後、3日後、1週間後、2週間後等の肌を、その時間にならなくても、人肌触感呈示装置によって再現し、呈示する。 Further, the state that can be realized by using a specific cosmetic is, for example, the reference solution R is dropleted on a human skin gel, reproduced by the human skin touch presenting device 300, and presented to the subject's finger. Then, when the cosmetic is used, if the surface changes over time, for example, it melts at body temperature over time, the skin after 10 minutes, 20 minutes, and 30 minutes can be treated even if it does not reach that time. It can be reproduced and presented by a human skin tactile presentation device. Alternatively, if you want to explain the effects of the skin that appear when you continue to use the cosmetic, for example, you can use the cosmetic twice a day continuously for 1 day, 3 days, 1 week, etc. The skin after 2 weeks or the like is reproduced and presented by the human skin tactile presentation device even if it is not the time.
 このようにすることで、被験者の化粧料を塗布した際の未来の肌の状態等を、人肌触感呈示装置にて具体的に触感で提案することが可能になるため、パンフレット等の視覚に加えて、触感を刺激することで、被験者であるカスタマーの感性に多角的に働きかけることができる。よってカスタマーは、より肌の状態に対して理解を深めることが出来る。一方、ビューティーアドバイザーは、再現した肌質に対応したアドバイスが可能になり、積極的な購買促進が可能となる。 By doing so, it becomes possible to specifically propose the future skin condition when the subject's cosmetics are applied by the human skin tactile sensation presenting device, so that the pamphlet or the like can be visually appealed. In addition, by stimulating the tactile sensation, it is possible to work on the sensibilities of the customer who is the subject from various angles. Therefore, the customer can deepen the understanding of the skin condition. On the other hand, the beauty advisor will be able to give advice corresponding to the reproduced skin quality, and will be able to actively promote purchasing.
 <応用例2:ネットワークシステム>
 図21は、本発明の実施形態に係る人肌触感呈示ネットワークシステム1000の概略図である。
<Application example 2: Network system>
FIG. 21 is a schematic view of the human skin touch presentation network system 1000 according to the embodiment of the present invention.
 人肌触感呈示ネットワークシステム1000は、被験者Sが、人肌触感呈示装置300Aを用いた肌情報を入力する入力端末(情報処理装置の一例であって、スマートフォン、タブレット、携帯電話等)400が、ネットワークNを介して、アドバイス用PC500、又は/及び分析用PC600に接続されるシステムである。 In the human skin touch presentation network system 1000, the subject S is an input terminal (an example of an information processing device, such as a smartphone, a tablet, a mobile phone, etc.) 400 for inputting skin information using the human skin touch presentation device 300A. It is a system connected to the advice PC 500 and / and the analysis PC 600 via the network N.
 被験者Sは、使い方を理解した後は、人肌触感呈示装置300Aを、貸出、購入、あるいは貰うことで、自宅に配置して、ビューティーアドバイザー抜きでも、使用することができる。 After understanding how to use the subject S, the human skin touch presentation device 300A can be rented, purchased, or obtained, placed at home, and used without a beauty advisor.
 例えば、被験者が特定の化粧品のサンプルを配布された場合、図20に示すようにビューティーアドバイザーから化粧品を購入した場合、あるいはビューティーアドバイザーがいない他の販売店又はネットショップから化粧品を購入した場合等において、化粧品と一緒に人肌触感呈示装置300Aを取得した場合について説明する。 For example, when a subject is distributed a sample of a specific cosmetic product, when the cosmetic product is purchased from a beauty advisor as shown in FIG. 20, or when the cosmetic product is purchased from another store or an online shop without a beauty advisor. , The case where the human skin touch presentation device 300A is acquired together with the cosmetics will be described.
 被験者の手元にある人肌触感呈示装置300Aは、いくつもの肌パターンとして、振動や、横方向の移動の強度のバリエーションが複数記憶されているものとする。 It is assumed that the human skin tactile presentation device 300A in the hands of the subject stores a plurality of variations in vibration and lateral movement intensity as a number of skin patterns.
 例えば、被験者は、特定の化粧品の使用前と、使用後について、自分の肌を触れた後、人肌触感呈示装置300Aに触れ、自分の肌の状態に近い触感を選択し、あるいは、調整により生成し、スマートフォンやPC等の入力端末400に肌の状態に対応する肌パターン情報、又は振動、横方向の移動補助情報を入力し、インターネット又はイントラネット等のネットワークNを介してアドバイス用PC500に送信する。 For example, before and after using a specific cosmetic, the subject touches his / her skin and then touches the human skin tactile sensation presenting device 300A to select or adjust the tactile sensation close to his / her skin condition. Generate and input skin pattern information corresponding to the skin condition or vibration and lateral movement assistance information to the input terminal 400 such as a smartphone or PC, and transmit it to the advice PC 500 via the network N such as the Internet or an intranet. To do.
 アドバイス用PC500は、被験者の入力端末400から送信された肌パターンの情報を基に、振動やスライド触感を分析し、記憶された複数の肌パターンと、振動・スライド触感との相関を参照して、被験者Sの入力端末400に対して、アドバイス等のコメントを送付する。なお、アドバイス用PC500は、ビューティーアドバイザーBによって手動で操作してもよいし、あるいは、アドバイス用PC500の内部にアドバイス用ソフトを組み込んで自動応答するようにプログラムしてあってもよい。 The advice PC 500 analyzes vibration and slide tactile sensation based on the skin pattern information transmitted from the subject's input terminal 400, and refers to the correlation between the plurality of memorized skin patterns and the vibration / slide tactile sensation. , Send a comment such as advice to the input terminal 400 of the subject S. The advice PC 500 may be manually operated by the beauty advisor B, or the advice software may be incorporated inside the advice PC 500 and programmed to automatically respond.
 分析用PC600は、被験者からの回答結果を収集、分析する集計ソフトが組み込まれている。また、入力端末400とアドバイス用PC500とが接続されない場合は、分析用PC600の内部にアドバイス用ソフトが組み込まれていてもよい。 The analysis PC 600 has a built-in tabulation software that collects and analyzes the response results from the subjects. Further, when the input terminal 400 and the advice PC 500 are not connected, the advice software may be incorporated inside the analysis PC 600.
 このように、被験者Sが、入力端末400に人肌触感呈示装置300Aで呈示する触感に対応するデータを入力することで、化粧品の効果としての肌状態の変化を、肌の触感の変化として、触覚的に、人肌触感呈示装置を介して異なる空間、複数の人で共有することが可能になる。 In this way, the subject S inputs data corresponding to the tactile sensation presented by the human skin tactile sensation presenting device 300A to the input terminal 400, so that the change in the skin condition as an effect of the cosmetics is regarded as the change in the tactile sensation of the skin. Tactilely, it becomes possible to share a different space with a plurality of people through a human skin tactile presentation device.
 あるいは、本発明の人肌触感呈示装置をショッピングセンターや、休憩所等の公共スペースに設けることで、ビューティーアドバイザー抜きでも、使用できるようにしてもよい。 Alternatively, by providing the human skin feeling presenting device of the present invention in a public space such as a shopping center or a resting place, it may be possible to use it without a beauty advisor.
 公共スペースに配置されている人肌触感呈示装置の触感呈示部と接続される入力端末700には、PC30の機能が内蔵されており、いくつもの肌パターンとして、振動や、横方向の移動の強度の様々なバリエーションが記憶されている。さらに、入力端末700には、ビューティーアドバイザー抜きで快適に使用できるように、ガイダンス用のプログラムを内蔵していると好適である。さらに、入力端末700には、自分の肌と近い状態を人肌触感呈示装置300によって再現させると、肌状態についてアドバイスを行う、アドバイス用のプログラムを内蔵していると好適である。 The input terminal 700 connected to the tactile sensation presenting part of the human skin sensation presenting device arranged in a public space has a built-in function of PC30, and has a number of skin patterns such as vibration and lateral movement intensity. Various variations of are remembered. Further, it is preferable that the input terminal 700 has a built-in guidance program so that it can be used comfortably without a beauty advisor. Further, it is preferable that the input terminal 700 has a built-in a program for advice that gives advice on the skin condition when the state close to one's own skin is reproduced by the human skin touch presentation device 300.
 その場合は、例えば、入力端末700に蓄積された複数の被験者の肌状態の蓄積データは、所定期間毎に、ネットワークNを介して分析用PC600に転送され、化粧品開発者Cの分析に活用されることができる。 In that case, for example, the accumulated data of the skin conditions of a plurality of subjects accumulated in the input terminal 700 is transferred to the analysis PC 600 via the network N at predetermined intervals and utilized for the analysis of the cosmetics developer C. Can be done.
 以上、本発明の好ましい実施形態について詳述したが、本発明は上記した特定の実施形態に限定されるものではなく、特許請求の範囲に記載された本発明の要旨の範囲内において、種々の変形・変更が可能なものである。 Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the above-mentioned specific embodiments, and various aspects are within the scope of the gist of the present invention described in the claims. It can be transformed and changed.
 例えば、上述の第1実施形態では、カメラを用いて、指の速度を検知する例を説明したが、指の速度を検知する手段は、例えば、加速度センサであってもよい。 For example, in the first embodiment described above, an example of detecting the speed of a finger using a camera has been described, but the means for detecting the speed of the finger may be, for example, an acceleration sensor.
 また、第1、第3実施形態では、アンプ4とスピーカー5A,5Bとは別々に構成する例を説明したが、アンプとスピーカーが一体的に構成される、アンプ内蔵スピーカーであってもよい。 Further, in the first and third embodiments, an example in which the amplifier 4 and the speakers 5A and 5B are configured separately has been described, but the amplifier and the speaker may be integrally configured as a speaker with a built-in amplifier.
 また、第1、第3実施形態では、スピーカー5A,5Bを左右に配置して伝播板を介して人肌ゲルに振動を伝達する例を説明したが、スピーカーの振動板の面を上向き配置して、人肌ゲルが貼りつけられ伝播板の下面と接触させて、下から振動を伝播させてもよい。 Further, in the first and third embodiments, an example in which the speakers 5A and 5B are arranged on the left and right to transmit vibration to the human skin gel via the propagation plate has been described, but the surface of the diaphragm of the speaker is arranged upward. Then, the human skin gel may be attached and brought into contact with the lower surface of the propagation plate to propagate the vibration from below.
 さらに、第2、第3実施形態では、スライドボリュームで、指の移動の取得と、指への移動補助の2つの役割を兼任する例を示したが、指の移動情報を取得する手段として、例えば、加速度センサやカメラ等を別途設けてもよい。 Further, in the second and third embodiments, an example in which the slide volume concurrently serves two roles of acquiring the movement of the finger and assisting the movement of the finger is shown, but as a means of acquiring the movement information of the finger, For example, an acceleration sensor, a camera, or the like may be provided separately.
 本出願は、2019年5月31日に日本国特許庁に出願された特願2019-103226号に基づく優先権を主張するものであり、特願2019-103226号の全内容を本出願に援用する。 This application claims priority based on Japanese Patent Application No. 2019-103226 filed with the Japan Patent Office on May 31, 2019, and the entire contents of Japanese Patent Application No. 2019-103226 are incorporated in this application. To do.
 1,10 人肌ゲル(肌モデル)
 2,カメラ(Leap Motion、撮影装置、移動速度取得部)
 3,30 PC(情報処理装置)
 4 アンプ(信号増幅部)
 5(5A,5B) スピーカー
 6 スライドボリューム
 7 マイクロコントローラ
 8 モータドライバIC(指移動制御部)
 9 デジタルポテンショメータ(振動調整部)
 11 伝播板(上側のアクリル板、伝播部材)
 12 固定板(下側のアクリル板)
 13 ベース
 21 カメラ固定部
 22 カメラ支柱
 51 振動板
 52 フレーム
 53 筐体
 61 レール
 62 支持フレーム
 63 モータ(指移動補助部)
 64 スライダー(操作端子)
 65 可変抵抗
 66 指輪
 75 スイッチ(肌状態選択部、化粧料選択部)
 100,200,300 人肌触感呈示装置
 302 メモリ(元信号記憶部)
 303 オペレーションシステム
 304 サウンドコントローラ(振動調整部)
 307 入力部(肌状態選択部、化粧料選択部)
 308 表示部
 331 CPU(移動速度算出部)
 332 FPGA(元信号選択部)
 701 メモリ
 702 第1のASIC(補助動作制御部)
 703 第2のASIC(スライド触感信号選択部)
 1000 人肌触感呈示ネットワークシステム
 400,700 入力端末
 A 加速度センサ
 B ビューティーアドバイザー
 F 指
 H 人肌
 S 被験者
 HT 加熱部
1,10 human skin gel (skin model)
2, Camera (Leap Motion, shooting device, moving speed acquisition unit)
3,30 PC (information processing device)
4 Amplifier (signal amplifier)
5 (5A, 5B) Speaker 6 Slide volume 7 Microcontroller 8 Motor driver IC (finger movement control unit)
9 Digital potentiometer (vibration adjustment unit)
11 Propagation plate (upper acrylic plate, propagation member)
12 Fixing plate (lower acrylic plate)
13 Base 21 Camera fixing part 22 Camera support 51 Diaphragm 52 Frame 53 Housing 61 Rail 62 Support frame 63 Motor (finger movement assisting part)
64 Slider (operation terminal)
65 Variable resistance 66 Ring 75 Switch (skin condition selection part, cosmetic selection part)
100, 200, 300 Human skin tactile presentation device 302 Memory (original signal storage unit)
303 Operation system 304 Sound controller (vibration adjustment unit)
307 Input section (skin condition selection section, cosmetic selection section)
308 Display unit 331 CPU (moving speed calculation unit)
332 FPGA (original signal selection unit)
701 Memory 702 First ASIC (auxiliary operation control unit)
703 Second ASIC (slide tactile signal selection unit)
1000 Human skin touch presentation network system 400,700 Input terminal A Accelerometer B Beauty advisor F Finger H Human skin S Subject HT Heating unit

Claims (15)

  1.  振動が伝播する伝播部材上に設けられ、被験者の指が接触する人肌ゲルと、
     前記人肌ゲル上の前記指の移動速度を取得する移動速度取得部と、
     人肌に対応づけた振動の元となる元信号を記憶しておく元信号記憶部と、
     前記指の移動速度に応じて、前記元信号に対して、振幅の大きさを調整する振動調整部と、
     調整された元信号を物理振動に変換して出力し、前記伝播部材を介して前記人肌ゲルに振動を与える振動出力部と、を備える
     人肌触感呈示装置。
    A human skin gel that is provided on a propagating member that propagates vibration and that the subject's finger touches,
    A movement speed acquisition unit that acquires the movement speed of the finger on the human skin gel,
    A source signal storage unit that stores the source signal that is the source of vibration associated with human skin,
    A vibration adjusting unit that adjusts the magnitude of the amplitude of the original signal according to the moving speed of the finger.
    A human skin tactile presentation device including a vibration output unit that converts the adjusted original signal into physical vibration and outputs it, and vibrates the human skin gel via the propagation member.
  2.  被験者の指が接触する人肌ゲルと、
     前記人肌ゲル上の前記指の移動速度を取得する移動速度取得部と、
     前記指の移動時の抵抗を付加あるいは移動をアシストする指移動補助部と、
     人肌の摩擦や滑らかさに対応する抵抗・加速を発生させるスライド触感信号を記憶しておくスライド触感信号記憶部と、
     前記指の移動速度に応じた前記スライド触感信号における制御値を選択し、前記指移動補助部での抵抗・加速を調整することで、前記人肌ゲル上の前記指に人肌触感を与える補助動作制御部と、を備える
     人肌触感呈示装置。
    The human skin gel that the subject's finger touches,
    A movement speed acquisition unit that acquires the movement speed of the finger on the human skin gel,
    A finger movement assisting unit that adds resistance or assists the movement of the finger,
    A slide tactile signal storage unit that stores slide tactile signals that generate resistance and acceleration corresponding to the friction and smoothness of human skin,
    By selecting a control value in the slide tactile signal according to the movement speed of the finger and adjusting resistance / acceleration in the finger movement assisting portion, an assist for giving the finger a human skin feel on the human skin gel. A human skin tactile presentation device including a motion control unit.
  3.  前記人肌ゲルは、振動が伝播する伝播部材上に設けられ、
     人肌に対応づけた振動の元となる元信号を記憶しておく元信号記憶部と、
     前記指の移動速度に応じて、前記元信号に対して、振幅の大きさを調整する振動調整部と、
     調整された元信号を物理振動に変換して出力し、前記伝播部材を介して前記人肌ゲルに振動を与える振動出力部と、をさらに備える
     請求項2に記載の人肌触感呈示装置。
    The human skin gel is provided on a propagation member through which vibration propagates.
    A source signal storage unit that stores the source signal that is the source of vibration associated with human skin,
    A vibration adjusting unit that adjusts the magnitude of the amplitude of the original signal according to the moving speed of the finger.
    The human skin tactile presentation device according to claim 2, further comprising a vibration output unit that converts the adjusted original signal into physical vibration and outputs the vibration to the human skin gel via the propagation member.
  4.  前記移動速度取得部は、前記人肌ゲル上の前記指の動きを撮影する撮影装置を含む
     請求項1に記載の人肌触感呈示装置。
    The human skin tactile presentation device according to claim 1, wherein the moving speed acquisition unit includes a photographing device for photographing the movement of the finger on the human skin gel.
  5.  前記移動速度取得部および前記指移動補助部は、レールに沿って移動するスライダーを有し、前記被験者の指が前記スライダーに装着されることで、前記レールの延伸方向の前記人肌ゲル上の指の動きを検出すると共に、前記レールに対する前記スライダーの負荷を調整しうるスライドボリュームを含む
     請求項2又は3に記載の人肌触感呈示装置。
    The movement speed acquisition unit and the finger movement assisting unit have a slider that moves along the rail, and when the subject's finger is attached to the slider, the rail is on the human skin gel in the extending direction. The human skin tactile presentation device according to claim 2 or 3, which includes a slide volume capable of detecting the movement of a finger and adjusting the load of the slider on the rail.
  6.  人肌を直接触るときに検出される振動データの周波数分布と、前記人肌を直接触るときに検出された前記振動データを当該人肌触感呈示装置で再現して前記人肌ゲルに振動を呈示した際に検出される振動データの周波数分布との、違いを一致させるような逆フィルタを、
     前記人肌を直接触るときに検出された前記振動データから変換した音声信号に掛けて、補正した音声信号を、前記元信号記憶部において、前記人肌に対応づけた元信号として記憶する
     請求項1又は3に記載の人肌触感呈示装置。
    The frequency distribution of the vibration data detected when the human skin is in direct contact and the vibration data detected when the human skin is in direct contact are reproduced by the human skin tactile presentation device to present vibration to the human skin gel. An inverse filter that matches the difference with the frequency distribution of the vibration data detected when
    The claim that the corrected audio signal is stored as the original signal associated with the human skin in the original signal storage unit by multiplying the audio signal converted from the vibration data detected when the human skin is in direct contact. The human skin tactile presentation device according to 1 or 3.
  7.  前記振動調整部は、指が動いて初めて振動を呈示するように調整する
     請求項1、3、6のいずれか一項に記載の人肌触感呈示装置。
    The human skin touch presenting device according to any one of claims 1, 3 and 6, wherein the vibration adjusting unit adjusts so as to exhibit vibration only when a finger moves.
  8.  前記振動調整部は、指が動きの速さが早いほど、振幅が大きい振動を呈示するように調整する
     請求項1、3、6、7のいずれか一項に記載の人肌触感呈示装置。
    The human skin tactile presentation device according to any one of claims 1, 3, 6, and 7, wherein the vibration adjusting unit adjusts so that the faster the finger moves, the larger the amplitude of the vibration.
  9.  前記振動出力部はスピーカーであり、
     前記振動調整部は情報処理装置である、
     前記元信号記憶部で記憶される元信号は音声信号である
     請求項1、3、6~8のいずれか一項に記載の人肌触感呈示装置。
    The vibration output unit is a speaker.
    The vibration adjusting unit is an information processing device.
    The human skin tactile presentation device according to any one of claims 1, 3, 6 to 8, wherein the original signal stored in the original signal storage unit is an audio signal.
  10.  人肌ゲル上で再現する素肌の肌状態を選択する肌状態選択部と、
     元信号選択部と、を備え、
     前記元信号記憶部は、複数の素肌の状態に対応づけられた振動に対応する元信号を記憶しておき、
     前記元信号選択部は、選択される素肌の状態に応じて、前記元信号を選択する
     請求項1又は3、6~9のいずれか一項に記載の人肌触感呈示装置。
    The skin condition selection part that selects the skin condition of the bare skin to be reproduced on the human skin gel,
    Equipped with a source signal selection unit
    The original signal storage unit stores original signals corresponding to vibrations associated with a plurality of bare skin states.
    The human skin tactile sensation presenting device according to any one of claims 1 or 3, 6 to 9, wherein the original signal selection unit selects the original signal according to the condition of the selected bare skin.
  11.  基準液を前記人肌ゲルに滴下し、
     人肌ゲル上で再現する、化粧料を付した際の肌状態を選択する化粧料選択部と、
     元信号選択部と、を備え、
     前記元信号記憶部は、複数の種類の化粧料を付した際の肌状態に対応づけられた振動に対応する元信号を記憶しておき、
     前記元信号選択部は、選択される化粧料の種類に応じて、前記元信号を選択する
     請求項1又は3、6~9のいずれか一項に記載の人肌触感呈示装置。
    The reference solution is dropped onto the human skin gel,
    A cosmetic selection section that selects the skin condition when applying cosmetics, which is reproduced on human skin gel,
    Equipped with a source signal selection unit
    The original signal storage unit stores the original signal corresponding to the vibration associated with the skin condition when a plurality of types of cosmetics are applied.
    The human skin tactile sensation presenting device according to any one of claims 1 or 3, 6 to 9, wherein the original signal selection unit selects the original signal according to the type of cosmetic to be selected.
  12.  人肌ゲル上で再現する素肌の肌状態を選択する肌状態選択部と、
     スライド触感信号選択部と、を備え、
     前記スライド触感信号記憶部は、複数の素肌の状態ごとの摩擦に対応づけられる抵抗・加速を発生させるスライド触感信号を記憶しておき、
     前記スライド触感信号選択部は、選択される素肌の状態に応じて、前記スライド触感信号を選択する
     請求項2、3に記載の人肌触感呈示装置。
    The skin condition selection part that selects the skin condition of the bare skin to be reproduced on the human skin gel,
    Equipped with a slide tactile signal selection unit
    The slide tactile signal storage unit stores slide tactile signals that generate resistance / acceleration associated with friction for each of a plurality of bare skin states.
    The human skin tactile display device according to claim 2 or 3, wherein the slide tactile signal selection unit selects the slide tactile signal according to the selected bare skin condition.
  13.  基準液を前記人肌ゲルに滴下し、
     人肌ゲル上で再現する、化粧料を付した際の肌状態を選択する化粧料選択部と、
     スライド触感信号選択部と、を備え、
     前記スライド触感信号記憶部は、複数の種類の化粧料を付した際の肌状態の摩擦に対応づけられた抵抗・加速を発生させるスライド触感信号を記憶しておき、
     前記スライド触感信号選択部は、選択される化粧料の種類に応じて、前記スライド触感信号を選択する
     請求項2、3に記載の人肌触感呈示装置。
    The reference solution is dropped onto the human skin gel,
    A cosmetic selection section that selects the skin condition when applying cosmetics, which is reproduced on human skin gel,
    Equipped with a slide tactile signal selection unit
    The slide tactile signal storage unit stores slide tactile signals that generate resistance and acceleration associated with friction in the skin state when a plurality of types of cosmetics are applied.
    The human skin tactile display device according to claim 2 or 3, wherein the slide tactile signal selection unit selects the slide tactile signal according to the type of cosmetic to be selected.
  14.  前記人肌ゲルを15℃~37℃に加熱する加熱部をさらに備える
     請求項1乃至13のいずれか一項に記載の人肌触感呈示装置。
    The human skin tactile sensation presenting device according to any one of claims 1 to 13, further comprising a heating portion for heating the human skin gel to 15 ° C. to 37 ° C.
  15.  人肌触感呈示装置における元信号の設定方法であって、
     指爪に加速度センサを付して、人肌を触る際の振動データを実測値として取得するステップと、
     前記実測値の振動データの周波数分布を算出するステップと、
     前記実測値の周波数分布を有する振動データを、前記人肌触感呈示装置で再生して人肌ゲルに振動を呈示した状態で、前記人肌ゲルを、前記人肌を触る際と同じ速さで同じ距離、前記指爪に前記加速度センサを付して触った際の振動データを再現値として取得するステップと、
     前記再現値の振動データの周波数分布を算出するステップと、
     前記実測値の振動データの周波数分布と、前記再現値の振動データの周波数分布との差分を補正する逆フィルタを算出するステップと、
     前記実測値の振動データから変換した音声信号に、逆フィルタをかけて補正したデータを、元信号記憶部に、人肌に応じた元信号として記憶しておくステップと、を有する
     人肌触感呈示装置における元信号の設定方法。
    It is a method of setting the original signal in the human skin tactile presentation device.
    A step of attaching an acceleration sensor to the fingernail and acquiring vibration data when touching human skin as an actual measurement value,
    The step of calculating the frequency distribution of the vibration data of the measured value and
    In a state where the vibration data having the frequency distribution of the measured value is reproduced by the human skin touch presentation device and the vibration is presented to the human skin gel, the human skin gel is applied at the same speed as when the human skin is touched. A step of acquiring vibration data as a reproduced value when the acceleration sensor is attached to the fingernail at the same distance and touched.
    The step of calculating the frequency distribution of the vibration data of the reproduced value and
    A step of calculating an inverse filter for correcting the difference between the frequency distribution of the vibration data of the measured value and the frequency distribution of the vibration data of the reproduced value.
    A human skin tactile presentation having a step of storing the data corrected by applying an inverse filter to the audio signal converted from the vibration data of the measured value in the original signal storage unit as the original signal corresponding to the human skin. How to set the original signal in the device.
PCT/JP2020/020806 2019-05-31 2020-05-26 Human skin tactile presentation device and method for setting vibration source signal in human skin tactile presentation device WO2020241655A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2021522794A JP7457013B2 (en) 2019-05-31 2020-05-26 Human skin tactile presentation device and method for setting the source signal of vibration in the human skin tactile presentation device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-103226 2019-05-31
JP2019103226 2019-05-31

Publications (1)

Publication Number Publication Date
WO2020241655A1 true WO2020241655A1 (en) 2020-12-03

Family

ID=73552234

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/020806 WO2020241655A1 (en) 2019-05-31 2020-05-26 Human skin tactile presentation device and method for setting vibration source signal in human skin tactile presentation device

Country Status (2)

Country Link
JP (1) JP7457013B2 (en)
WO (1) WO2020241655A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7426362B2 (en) 2021-09-10 2024-02-01 花王株式会社 Makeup motion support system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018008250A (en) * 2016-07-15 2018-01-18 国立大学法人電気通信大学 Force sense and vibration sense presentation device
WO2019003466A1 (en) * 2017-06-29 2019-01-03 株式会社フジクラ Method for manufacturing optical device
JP2019032239A (en) * 2017-08-08 2019-02-28 学校法人近畿大学 Fingertip contact state measurement device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7088940B2 (en) 2017-08-25 2022-06-21 株式会社 資生堂 A method for evaluating the tactile sensation of cosmetics and a device for evaluating the tactile sensation of cosmetics.

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018008250A (en) * 2016-07-15 2018-01-18 国立大学法人電気通信大学 Force sense and vibration sense presentation device
WO2019003466A1 (en) * 2017-06-29 2019-01-03 株式会社フジクラ Method for manufacturing optical device
JP2019032239A (en) * 2017-08-08 2019-02-28 学校法人近畿大学 Fingertip contact state measurement device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7426362B2 (en) 2021-09-10 2024-02-01 花王株式会社 Makeup motion support system

Also Published As

Publication number Publication date
JPWO2020241655A1 (en) 2020-12-03
JP7457013B2 (en) 2024-03-27

Similar Documents

Publication Publication Date Title
Seo et al. Initial study for creating linearly moving vibrotactile sensation on mobile device
JP6264542B2 (en) Information processing apparatus, information processing program, information processing system, and information processing method
Schloerb et al. BlindAid: Virtual environment system for self-reliant trip planning and orientation and mobility training
EP2846221A1 (en) Method, system and computer program product for transforming haptic signals
JP6664145B2 (en) Information processing apparatus, information processing program, information processing system, and information processing method
Rantala et al. The role of gesture types and spatial feedback in haptic communication
Berdahl et al. The firefader: Simple, open-source, and reconfigurable haptic force feedback for musicians
KR20160036383A (en) Apparatus for providing tactile touch service
WO2020241655A1 (en) Human skin tactile presentation device and method for setting vibration source signal in human skin tactile presentation device
JP7276334B2 (en) Information processing device, information processing method, and program
Lee et al. Rich pinch: Perception of object movement with tactile illusion
Weber et al. Towards a framework for ubiquitous audio-tactile design
WO2023189404A1 (en) Input/output device
WO2023189405A1 (en) Input/output device
JP5912940B2 (en) Evaluation apparatus, evaluation method, program, and system
JP6115932B2 (en) Sound generating apparatus and sound generating program
Müller Designing with haptic feedback
Usui et al. Sound presentation method for touch panel regarding the use of visually impaired people
Kurzweg et al. Assignment of a Vibration to a Graphical Object Induced by Resonant Frequency
US20240160289A1 (en) Control device and program
Bernard Perception of audio-haptic textures for new touchscreen interactions
JP2023150607A (en) Input-output device
Vega et al. vARitouch: Back of the Finger Device for Adding Variable Compliance to Rigid Objects
JP2023150608A (en) Haptic sound providing system, haptic sound providing program, and haptic sound providing method
JP2024059525A (en) Hearing assistance device, hearing assistance system, and hearing assistance program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20815410

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021522794

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20815410

Country of ref document: EP

Kind code of ref document: A1