JP6218221B2 - Hairy and flexible user interface - Google Patents

Description

  The present invention relates to a user interface of an information device, and more particularly to a user interface having a hairy and flexible actuator using a shape memory alloy.

  Examples of the background art of the present invention include the following.

1. Devices that control irregularities and express arbitrary surface shapes Many similar devices that can control irregularities on the surface have been developed. Many of them control the vertical movement of the pins and bars, and express the irregularities by their enveloping lines. (For example, non-patent documents 1 to 5)

2. Control body combined with self-luminous video display device Display based computing is known as a technique similar to control based on video information from a self-luminous video display device including a liquid crystal display. Here, an object physically arranged on the display is controlled in accordance with luminance information from the display. (For example, non-patent documents 6 to 7)

3. What utilizes the touch recognition function of a capacitive touch panel There are systems that recognize the touch via another device by applying the principle of a capacitive touch panel. This applies to so-called touch panel compatible pens and gloves. (For example, Non-Patent Document 8)

4. Actuators using shape memory alloys There are many devices that use shape memory alloys (SMAs) as drive sources (for example, Non-Patent Document 2). In addition, motion that can express soft movement and biological movement by arranging hair-like actuators using SMA two-dimensionally and bending and extending the actuator according to the user's gesture. There are also displays (for example, Patent Document 1 and Non-Patent Document 9). In addition, it has an artificial flower that uses a shape memory alloy for the petal skeleton and a circuit that energizes the heating element when the light sensor detects light, and deforms the shape memory alloy with the heat generated in the heating element in response to the light detection. The thing which made the petal of a bud state open by making it be proposed is also proposed (patent document 2).

JP 2011-187050 A Japanese Utility Model Publication No. 4-136298

Taylor, PM, Moser, A., & Creed, A., `` A sixty-four element tactile display using shape memory alloy wires '', Displays, 18 (3), 163-168, 1998, <URL: http: // dx.doi.org/10.1016/S0141-9382 (98) 00017-1> Nakatani, Kajimoto, Sekiguchi, Kawakami, Tachi, `` 3D Form Display with Shape Memory Alloy '', Proc. Of International Conference on Artificial Reality and Telexistence 2003. (ICAT 2003), 2003. Poupyrev, I., Nashida, T., Maruyama, S., Rekimoto, J., & Yamaji, Y., `` Lumen: interactive visual and shape display for calm computing '', ACM SIGGRAPH 2004 Emerging technologies on-SIGGRAPH '04, p. 17, New York, USA: ACM Press, 2004, <http://dl.acm.org/citation.cfm?id=1186155.1186173> Kanai, T., Kikukawa, Y., Suzuki, T., Baba, T., & Kushiyama, K., `` PocoPoco: a tangible device that allows users to play dynamic tactile interaction '', ACM SIGGRAPH 2011 Emerging Technologies on-SIGGRAPH '11, p. Article No. 12, New York, USA: ACM Press, 2011, <http://dl.acm.org/citation.cfm?id=2048259.2048271> Leithinger, D., Lakatos, D., DeVincenzi, A., Blackshaw, M., & Ishii, H., `` Direct and gestural interaction with relief: a 2.5D shape display '', Proceedings of the 24th annual ACM symposium on User interface software and technology-UIST '11, p. 541, New York, USA: ACM Press, 2011, <http://dl.acm.org/citation.cfm?id=2047196.2047268> Kojima, M., Sugimoto, M., Nakamura, A., Tomita, M., Inami, M., & Nii, H., `` Augmented Coliseum: An Augmented Game Environment with Small Vehicles. '', First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06), pp. 3-8, IEEE, 2006, <http://dl.acm.org/citation.cfm?id=1109723.1110608> Tomonari Ariga, Noriyoshi Shimizu, Masahiro Hamada, Masaki Sugimoto, Continent Sekiguchi, & Masahiko Inami, "Stickable Bear: Portable Robotic User Interface", Proceedings of Entertainment Computing 2007, pp. 107-110, 2007 Wang, J., D'Alessandro, N., Fels, S., & Pritchard, B., `` SQUEEZY: Extending a Multi-touch Screen with Force Sensing Objects for Controlling Articulatory Synthesis '', In AR Jensenius, A. Tveit, RI Godoy, & D. Overholt (Eds.), Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 531-532, University of Oslo and Norwegian Academy of Music, 2011, <http: //www.nime2011. org / proceedings / papers / N03-Wang.pdf> Nakayasu Next, & Tomimatsu Kiyoshi, “plant: Shape Memory Alloy Motion Display for Expression of Leaf Rush (<Special Issue> Art & Entertainment 2)”, Transactions of the Virtual Reality Society of Japan, 15 (3), 289-296, Japan Virtual Reality Society, 2010, <http://ci.nii.ac.jp/naid/10026691889/>

However, in the technique of the preceding paragraph, since the pins and bars are moved up and down, the entire presentation device tends to become larger in the vertical direction, and it is necessary to connect and control individual actuators in an integrated manner. It is impossible to increase or decrease the number of pins and bars later. In many cases, it is difficult to implement contact detection on the uneven surface, and few have a contact detection function.
Further, in the technique of the preceding item 2, the position and direction of the robot on the screen are controlled by using a change in image brightness on the screen. As a video for controlling, a monochromatic image is assumed, and an input from an object on the screen to the screen side is not assumed.
The technique of the preceding item 3 is based on point contact on another device, and no attention is paid to how the user touches another device.
In the technique of the preceding item 4, the arrangement of the actuators is fixed and does not have a touch recognition function.

The present invention has been made in view of such a situation, and a first object thereof is to provide a hairy flexible interface that is extremely easy to expand.
It is a second object of the present invention to provide a hairy flexible interface that realizes a new output interaction for the user.
It is a third object of the present invention to provide a hairy flexible interface that realizes a new input interaction for the user.

In order to solve the above problems, a user interface device according to the present invention is disposed on a display surface of a display device that emits light, is provided on a surface facing the display surface of the display device, A light detection unit that detects light emission, a housing unit that includes a drive circuit that is energized when light is detected by the light detection unit, and a shape memory alloy that is deformed by resistance heat generated when the drive circuit is energized. A unit having a hair-like actuator arranged in the longitudinal direction, and the shape memory alloy of the actuator is bent with a bending amount corresponding to the light amount or luminance of the light detected by the light detection unit. To do.
According to another aspect of the present invention, a user interface device is disposed on a display surface of a display device whose display surface emits light, and is provided on a surface facing the display surface of the display device, and detects light emission of the display surface. And a shape memory alloy that is deformed by resistance heat generated when the drive circuit is energized in the longitudinal direction, and a housing unit that includes a drive circuit that is energized when light is detected by the light detection unit. And a plurality of sets of the light detection unit, the drive circuit, and the shape memory alloy are installed in one unit, and light detection of each set of the units is performed. The units detect light of different colors, and the shape memory alloy of each set of the units is deformed according to the color of the light detected by the corresponding light detection unit.
A user interface device according to another aspect of the present invention is provided on a touch panel on which a display surface emits light, provided on a surface facing the touch panel, and a light detection unit that detects light emission of the touch panel, and the light detection A housing having a drive circuit that is energized when light is detected in the unit, and a hair-like actuator in which a shape memory alloy that is deformed by resistance heat generated when the drive circuit is energized is disposed in the longitudinal direction; A unit disposed on the actuator and electrically connected to a bottom portion of the casing unit, and the touch panel is configured such that an electric charge is generated when the user contacts the conductor. When reaching the bottom of the substrate, light is emitted at a position corresponding to the conductor.
According to another aspect of the present invention, there is provided a user interface device that is disposed on a display surface of a touch panel on which a display surface emits light, is provided on a surface facing the display surface of the touch panel , and detects light emitted from the display surface. A detection unit, a casing unit including a drive circuit that is energized when light is detected by the light detection unit, and a shape memory alloy that is deformed by resistance heat generated when the drive circuit is energized are arranged in the longitudinal direction. And a plurality of sets of the light detection unit, the drive circuit, and the shape memory alloy are installed in one unit, and the housings correspond to the respective sets. a plurality of conductors connected to the bottom at different positions of the body portion is mounted on the actuator, the touch panel positions corresponding to the conductive member touched by the user Is light, the light emission by the light detecting portion is detected corresponding to the light emitting positions on the touch panel, the shape memory alloy corresponding to the light detector, characterized in that the deformation.
According to another aspect of the present invention, there is provided a user interface device that is disposed on a display surface of a display device that emits light, is provided on a surface that faces the display surface of the display device, and detects light emission of the display surface. And a shape memory alloy that is deformed by resistance heat generated when the drive circuit is energized in the longitudinal direction, and a housing unit that includes a drive circuit that is energized when light is detected by the light detection unit. It is composed of a unit having a hair-like actuator arranged, and a plurality of sets of the light detection unit, drive circuit, and shape memory alloy are installed in one unit, and the light detection unit of each set of the unit is Each of the light detection units is covered with a polarization filter that polarizes light in different directions, and changes according to the rotation operation when the unit is rotated on the display surface of the display device. Depending on the amount of light detected is transmitted through the corresponding polarization filters, the corresponding shape memory alloy characterized by deformation.
Hereinafter, various aspects of the present invention will be described.

1. Easy-to-expand surface-distributed unevenness expression device A first user interface device according to the present invention includes a housing unit having a drive circuit that is energized by a predetermined trigger, and resistance heat that is generated when the drive circuit is energized. A user interface device composed of a single unit or a plurality of units having a hair-like actuator in which a shape memory alloy that expands and contracts is disposed in the longitudinal direction, and the housing unit electrically connects the units. The unit has a connecting portion that can be attached to and detached from each other.

  One embodiment of the present invention is an assembly of units each including a small drive circuit housing and a hairy flexible actuator using SMA (shape memory alloy), and is provided on a self-luminous video display device such as a liquid crystal display. Use it in the place. By controlling the bending of each actuator, the entire unevenness and movement are expressed. The degree of bending can be controlled by detecting a luminance signal from the bottom of the actuator, that is, an image displayed on the self-luminous image display device with a sensor (see the next section 2). Further, the actuator itself is highly independent and is configured to be operable only by supplying power to each other. For example, a connector that can supply electric power to each other when the casings of the actuators come into contact with each other is provided on the casing of each actuator. As a result, the unit can be separated and scattered freely.

2. Control of deformation direction of flexible actuator A second user interface device according to the present invention includes a housing portion having a drive circuit that is energized by a predetermined trigger, and a shape that expands and contracts due to resistance heat generated when the drive circuit is energized. A user interface device composed of a single unit or a plurality of units having a hair-like actuator in which a memory alloy is arranged in a longitudinal direction. The user interface device is a display surface of a display device that emits light on a display surface. The housing unit has a light detection unit that detects light on a surface facing the display surface of the display device, and triggers that light is detected by the light detection unit. The drive circuit is energized.

  SMA usually expands and contracts by applying heat. Therefore, the SMA was placed in the longitudinal direction of the flexible actuator by passing the SMA through a tubular body such as a silicon tube, and the bending of the silicon tube was changed by controlling the expansion and contraction of the SMA by heat. Moreover, bending control including the direction can be performed by passing a plurality of SMAs inside. In one embodiment of the present invention, color information is used for controlling the bending direction. Specifically, after displaying a full-color image on the screen, the bending direction of the SMA is controlled by associating the intensity of each color with the bending direction through an RGB filter before the sensor. That is, one SMA and one drive circuit / sensor are set as one set, and a plurality of sets are provided in one unit, and a filter that allows light of different colors to pass is provided in the front stage of each set of sensors. . Thereby, each set of sensors can detect light of a different color. Then, heat is generated in the drive circuit including the sensor in which the light is detected, and the SMA included in the same set as the generated drive circuit expands and contracts due to the heat, and the bending of the silicon tube changes.

3. Touch recognition mechanism A third user interface device according to the present invention is a user interface device configured by a single unit or a plurality of units including a hair-like input receiving unit disposed on a capacitive touch panel. The input receiving unit is configured such that a plurality of insulated conductors are arranged in the longitudinal direction of the input receiving unit, and the lower ends of the conductive units are in contact with the touch panel at different positions. In addition, the upper end portion of the conductive portion is configured so that the user can contact at different positions of the input receiving portion.

  In the explanations in the preceding paragraphs 1 and 2, the hairy flexible actuator is used by being placed on the self-luminous video display device. Instead, in one embodiment of the present invention, the liquid crystal touch panel is placed on a capacitive liquid crystal touch panel. A conductor is disposed on the upper portion of the hairy flexible actuator, and a conductive wire is disposed from the conductor to the bottom, thereby electrically connecting the upper portion of the actuator and the bottom of the housing. Thereby, it is possible to detect the contact of the upper part of the actuator by using the function of the capacitive touch panel. That is, when the user touches the conductor on the top of the actuator, the contact is transmitted to the bottom of the housing through the conductor connected to the conductor, and the end of the conductor on the bottom of the casing touches the touch panel. Then, it is recognized as a touch to the touched point. Furthermore, a plurality of conductors are arranged in an insulated manner in the axial direction on the hair-like flexible actuator. Here, each conductor is located at a different position in the axial direction of the actuator, and the lower end portion on the bottom side of the casing of the conductive wire connected to each conductor is located at a different position on the bottom surface. Each of the upper end portions can be recognized as a different point on the touch panel. Accordingly, it is possible to recognize a complicated operation such as stroking the actuator.

4. Other input methods Because it is possible to recognize the touch of the actuator, it is possible to detect movement while the actuator is held on the screen while holding the actuator (corresponding to the sliding operation of the touch panel).
A polarizing film is attached to the bottom of the drive circuit housing. Thereby, the light quantity from a display apparatus changes according to rotation of a housing | casing part. That is, the bending can be controlled according to the rotation.
Also, two touch recognition conductors are prepared at the bottom of the drive circuit housing. Then, the rotation can be recognized from the movement of these two points.

  According to the present invention, easiness of expansion and new interaction with the user are realized by the hairy flexible interface device.

It is the figure showing a mode that the prototype of the hairy flexible interface (1 unit) which is embodiment of this invention was arrange | positioned on the tablet terminal. It is the figure which represented typically a mode that the hair-like flexible interface (plural units) which is an embodiment of the present invention was arranged on a visual display, and the composition of the case bottom of a hair-like flexible interface. It is the figure which represented typically the mode of operation | movement of the hairy flexible interface (1 unit) which is embodiment of this invention. It is the figure which represented typically the circuit structure of the hairy flexible interface (1 unit) which is embodiment of this invention. It is a figure showing an example of the bending amount change of the actuator part according to the screen brightness | luminance of a display. It is the figure which represented typically the mechanism of the touch recognition of the hairy flexible interface (1 unit) which is embodiment of this invention. FIG. 7 is a diagram illustrating an example in which a plurality of units of the hairy flexible interface illustrated in FIG. 6 are arranged on a capacitive touch panel. It is a figure which shows an example of the side division | segmentation touch detection method by the hair-like flexible interface (1 unit) which is embodiment of this invention. It is a figure which shows another example of the axial direction division | segmentation touch detection method by the capillary flexible interface (1 unit) which is embodiment of this invention. It is the figure which represented typically the hairy flexible interface which changes the bending direction according to rotation which is embodiment of this invention. It is a figure which shows the visual tactile sense conversion apparatus using the hairy flexible interface which is embodiment of this invention. It is a figure which shows the other example of the visual tactile sensation conversion apparatus using the hairy flexible interface which is embodiment of this invention.

  FIG. 1 is a diagram showing a state in which a prototype of a hairy flexible interface (1 unit) according to the first embodiment of the present invention is arranged on a tablet terminal. As shown in the figure, one unit of the hairy flexible interface of the present embodiment is composed of a single hairy flexible actuator part, and a housing part including an optical sensor and a drive circuit. The surface of the actuator part is a silicon tube and SMA is built in. This is the part where the actuator part bends.

  FIG. 2 is a diagram schematically showing a state in which the hairy flexible interface (a plurality of units) of the present invention is arranged on a visual display (liquid crystal screen) and the configuration of the bottom of the case of the hairy flexible interface. FIG. 3 is a diagram schematically showing the operation of the hairy flexible interface (1 unit) of the present embodiment. As shown in the figure, the hairy flexible actuator receives the luminance information from the LCD screen of the visual display by the optical sensor of the housing part, and the SMA of the actuator part expands and contracts, thereby deforming the silicon tube of the actuator part (Bend).

  FIG. 4 is a diagram schematically showing a circuit configuration of the hairy flexible interface (1 unit) of the present embodiment. As shown in the figure, this circuit includes a phototransistor and an amplifying unit (two transistors). When light is detected from the liquid crystal screen by the phototransistor, a current corresponding to the amount of light flows to the amplifying unit. The current amplified by the amplifying unit flows in the SMA, and resistance heat corresponding to the current is generated in the SMA. This resistance heat causes the SMA to bend.

  FIG. 5 is a diagram illustrating an example of a change in the amount of bending of the actuator unit according to the screen brightness of the display. The vertical axis in the figure indicates the amount of bending from the non-energized state (upright state), and the greater the value on the vertical axis, the greater the bending. The horizontal axis represents the screen brightness of the display. As shown in the figure, the amount of bending of the actuator portion increases as the screen brightness of the display increases.

  Next, a hairy flexible interface having a touch recognition function, which is a second embodiment of the present invention, will be described. The hair-like flexible interface of the present embodiment is assumed to be used by being placed on a capacitive touch panel. At this time, as schematically shown in FIG. 6, a conductor such as conductive rubber is disposed on the top of the actuator, and the conductor and the bottom of the housing are electrically connected. As a result, when the user contacts the conductive rubber, the charge moves through the conductive wire to the bottom of the housing, and reaches the end of the conductive wire in contact with the touch panel surface on the bottom side of the housing. In other words, contacting the conductive rubber is electrically equivalent to directly contacting the touch panel. This is the same principle as a so-called touch pen for a touch panel.

  FIG. 7 shows an example in which a plurality of hairy flexible interfaces shown in FIG. 6 are arranged on a capacitive touch panel. As shown in FIG. 7A, when the user contacts the conductors on the top of the plurality of hair-like flexible interfaces, the contacted hair-like flexible interfaces are bent as shown in FIG. 7B. This movement is realized as follows. That is, the touch panel recognizes a touch at each end on the bottom side of the contacted hairy flexible interface, and accordingly, as shown in FIG. The position of the photosensor is caused to emit light with a predetermined luminance. As a result, resistance heat is generated in the drive circuit of the contacted hairy flexible interface, and the SMA bends according to the heat. In this way, the hairy flexible interface can be bent according to the user's touch operation.

  The hair-like flexible interface of this embodiment is further expanded, and a plurality of conductors are arranged on the hair-like flexible actuator (surface). For example, FIG. 8 shows a side-division touch detection method, in which a plurality of conductors are installed at different positions in the circumferential direction of the actuator while being insulated from each other, and are installed at different positions on the bottom surface of the casing. . In the figure, the finger contact part (1), which is a conductor installed in the actuator, and the panel side contact part (1) of the housing part are combined into one set, and the finger contact part (2) and the panel side contact of the housing part This shows an example in which three sets are installed while being insulated from each set of the part (2), the finger contact part (3), and the panel side contact part (3) of the housing part. In each set, the finger contact portion and the panel side contact portion are electrically connected. As a result, when the user touches the finger contact portion (1), for example, a touch is detected at the contact position with the panel side contact portion (1) on the touch panel. Similarly, for the contact with the finger contact portions (2) and (3), a touch is detected at the contact position with the panel side contact portions (2) and (3), respectively. In this way, the actuator can distinguish and recognize the contact direction (finger contact portion).

  In the figure, SMA (1) to (3) are the same as those in the first embodiment, and the optical sensor and the drive circuit of the housing portion not shown are provided independently for each SMA. It has been. As a result, the SMA corresponding to the optical sensor that detects light from the image displayed on the touch panel is deformed, so that the bending direction of the actuator can be controlled. If an RGB filter that allows light of different colors to pass is provided in front of the optical sensor, each sensor can detect light of different colors and can control the bending direction according to the color. In addition, if the SMA in the same set as the set of the finger contact part and the panel side contact part (the same number in parentheses) is associated, the actuator part can be deformed according to the touch of the actuator part. Is possible. For example, when the user touches the finger contact portion (1), the touch panel recognizes the touch at the contact position with the panel side contact portion (1). Here, by the control on the touch panel side, the touch panel is caused to emit light with a predetermined luminance or color at the installation position of the optical sensor corresponding to the SMA (1) according to the recognized touch. On the side of the hairy flexible interface, when the light sensor corresponding to the SMA (1) detects the light, the drive circuit of the housing section corresponding to the light sensor generates heat, and the SMA (1 ) Bends.

On the other hand, FIG. 9 shows an axially divided touch detection method. As shown in the figure, a plurality of conductors (finger contact portions (1) to (3)) are installed in the axial direction of the actuator. Each conductor is designed to be recognized as a different point on the touch panel. That is, the lower end part (panel side contact part (1)-(3)) electrically connected with each conductor (finger contact part (1)-(3)) is a housing | casing which is a contact surface with a touch panel. It is in a different position on the bottom surface. Each finger contact portion and each panel side contact portion set (the same numbers in parentheses) are insulated from each other. Thereby, a user's touch operation at a different position in the axial direction of the actuator can be detected as a touch operation at a different position on the touch panel. For example, when the part of the finger contact part (1) is touched, the touch is detected at the contact position between the panel side contact part (1) electrically connected to the finger contact part (1) and the touch panel. This makes it possible to detect an action such as stroking in the axial direction. That is, when the user performs a stroke operation on the actuator, the finger contact portion (1) that is the conductor on the tip end side in the axial direction of the actuator changes from the finger contact portion (2) (3) that is the conductor on the root side. After the touch is started, the touch is ended from the finger contact portion (3) that is the conductor on the base side of the actuator toward the finger contact portion (2) and (1) that is the conductor on the tip side. Along with this, on the touch panel, the start of touch is detected in order at the panel side contact portions (1), (2), and (3) that are corresponding contact positions of the bottom portion of the casing of each conductor, and then the touch of each conductor is detected. The end of the touch is sequentially detected at the panel side contact portions (3), (2), and (1) that are corresponding contact positions on the bottom of the casing. The touch detection pattern from the start to the end of the series of touches may be mounted so as to be recognized as a gesture stroked on the touch panel side.
Further, as shown in FIG. 9, the degree of bending of the actuator may be changed depending on which finger contact portion is touched. Specifically, on the touch panel, the installation position of the optical sensor on the housing unit depends on which contact part of the panel side contact parts (1), (2), and (3) is touched. What is necessary is just to change the brightness | luminance to light-emit with. For example, using the example of FIG. 5, the luminance is lowest when a touch is recognized at the position of contact with the panel-side contact portion (1), and when the touch is recognized at the panel-side contact portion (3). Should be the highest. As a result, when the finger contact part (1) connected to the panel side contact part (1) is touched, the bending of the actuator becomes the smallest, and when the finger contact part (3) is touched, the bending becomes the largest. . In this example, it is assumed that one set of SMA, a drive circuit, and an optical sensor are provided.

  FIG. 10 is a diagram schematically illustrating a hairy flexible interface that changes the bending direction in accordance with the rotation according to the third embodiment of the present invention. This hair-like flexible interface has a plurality (two in this case) of optical sensors in the casing, and has a drive circuit and an SMA corresponding to each of the optical sensors. Further, as shown in the figure, each optical sensor is covered with polarizing filters (in this case, longitudinally polarized light and laterally polarized light) having different directions. When this hairy flexible interface is placed on a liquid crystal display, the light from the liquid crystal display is polarized by the polarizing filter, so the amount of light that passes through each polarizing filter differs. Accordingly, since the amount of light detected by each optical sensor is different, the amount of resistance heat generated in each drive circuit is also different. As a result, the bending amount of the SMA corresponding to each drive circuit also changes, and the bending direction of the hairy flexible interface also changes according to the bending amount of each SMA. As shown in the figure, when the user rotates the capillary flexible interface, the amount of light transmitted through each polarizing filter changes depending on the orientation of the bottom of the casing of the capillary flexible interface. The amount of light received by each optical sensor changes, the resistance heat generated in each drive circuit changes, and as a result, the amount of bending of each SMA also changes, and the bending direction of the hairy flexible interface changes. Thereby, it becomes possible to change the bending direction of a hairy part according to rotation operation of a hairy flexible interface.

The above description has focused on the operation of a single capillary flexible interface unit. However, in principle, this capillary flexible interface unit requires no electrical connection to the outside other than the power supply. Since the power is small enough, it is possible to use a battery to incorporate the power supply.) Therefore, by providing a connector that can supply power to each other when the casing of the actuator comes into contact between a plurality of units, it is possible to operate by simply arranging the actuators as shown in FIG. Become. In other words, it is possible to express the unevenness of the required area simply by arranging them.
As a method for connecting each unit, for example, the following four methods are conceivable.

The first is like a block toy, where the housings are fitted to each other with irregularities. A metal terminal is attached to a contact portion where the units contact each other, and power is supplied between the units via the metal terminal.
The second is a method of attaching units to each other using a magnet and attaching a terminal for supplying power to the contact portion, like a power connector of a notebook PC.
The third is a method in which cables with connectors for power feeding and power transmission are taken out from each unit.
The fourth method is to arrange each unit on a transparent conductive film.

In the first and second methods, it is possible to achieve a state of being in close contact with each other like blocks. On the contrary, since the contact is tight, the degree of freedom of arrangement is slightly reduced. Therefore, a curved arrangement such as a circle is difficult.
Since the third and fourth methods are basically methods that connect each other with a line, the degree of freedom of arrangement such as a circle is extremely high.
In the fourth method, since a transparent film is used, light from the display surface under the film is not hindered.

  Next, application examples of the present invention will be described.

1. Visual / tactile sensation conversion device By arranging the hair-like flexible interface of the present invention on the touch panel of a tablet terminal, an arbitrary still image or video displayed on the display surface of the touch panel can be unevenly formed by the hair-like flexible interface of the present invention. It can be expressed as information. In other words, the interface enables visual / tactile conversion. Here, when the camera is mounted on the terminal, the still image or the moving image may be taken by the camera or stored in the storage device of the terminal. FIG. 11 shows a state where the line-shaped flexible actuator is expressed in a concave shape by the line segment displayed on the display surface of the touch panel from the initial state on the left side of the drawing, as shown on the right side of the drawing. This is realized by bending the SMA of the hair-like flexible actuator arranged on the line segment according to the luminance information of the displayed line segment. FIG. 12 schematically shows an example of tactilely expressing an image obtained by a camera connected to the tablet terminal by wire or a built-in camera of the tablet terminal using a hairy flexible interface. For example, when a gray scale image representing depth information is acquired using a depth camera (depth sensor) as a camera, the depth information is obtained by bending the SMA of the hairy flexible actuator using the luminance information of the image as it is. The unevenness information of the subject photographed with can be expressed as it is with the hairy flexible interface.

  Such a visual / tactile sensation conversion device can also be used as a communication tool between a healthy person and a visually handicapped person. For example, suppose healthy person A is watching a picture on a tablet terminal or drawing a map for directions. And when telling the contents to visually impaired person B, Mr. B is drawn from the unevenness of the hairy flexible interface by placing this hairy flexible interface (multiple units) on Mr. A's tablet terminal. Can understand the contents. In addition, Mr. A may draw a guide map on Mr. B's own tablet terminal.

2. Painting expression by unevenness When using the combination of the hairy flexible interface of the first and second embodiments (see FIG. 8), the touch to the hair tip or the side is via the touch recognition function of the touch panel. And sent to the panel side. This makes it possible to change the degree of bending when touched according to the contact with the hairy flexible actuator. That is, it is possible to change the amount of bending by touching and draw a picture with unevenness.

3. Two-dimensional painting expression by contact Like the hairy flexible interface of the second embodiment of the present invention, by enabling communication between each unit of the interface and the touch panel side, the hairy flexible actuator can be used by hand. It can be used as an input interface with a higher degree of freedom. For example, by arranging a plurality of hair-like flexible actuators shown in FIG. 8 on the touch panel and bending a particular hair-like flexible actuator, it is possible to change the brightness or color to a specific point on the touch panel. As a result, drawing using contact with the hairy flexible actuator and command input with a high degree of freedom are possible.

4. Remote communication The bending information of the hair-like flexible actuator of the present invention can be communicated with the same type of device at a remote place, and the bending state of each can be controlled according to the bending information at the remote place. . That is, tactile communication between remote locations is possible. Here, as a specific example of the bending information, it can be information on luminance and color of the display position of the touch panel on which the hairy flexible interface is installed. In this case, it is conceivable to use a hairy flexible interface in which the first and second embodiments are combined, as in the previous item 2. For example, when the transmission source user touches the actuator unit, the user's actuator unit bends accordingly. At the same time, the light emission information (position, brightness, color) of the touch panel that causes the bending is transmitted to the touch panel terminal of the partner user, and the touch panel terminal emits light according to the received light emission information. I do. If the user at the other end places the hairy flexible interface on his / her touch panel, the actuator unit of the hairy flexible interface of the other user will be the same as the same interface of the user at the source according to this light emission. Bend to.

  In addition, when the optical fiber is fitted along the SMA and the SMA is bent in that state, light according to the amount of bending leaks from the optical fiber. Can be measured. Therefore, this leakage amount can be used as bending information. Or it is also possible to acquire bending information using a strain gauge. In this case, the physical quantity that changes due to the bending of the SMA is not the amount of light leakage but the resistance value. That is, the resistance value changes by the amount of deformation of the SMA, and is measured. Furthermore, SMA uses the fact that a proportional relationship is established between its length and resistance value (see Non-Patent Document 1, etc.), so that the amount of bending can be estimated from the resistance value. Can also be used as bending information.

5. Musical performance device The hair-like flexible actuator of the second embodiment is placed at a specific location, and the pitch and tone are continuously changed by the rotation of the actuator itself, the direction and amount of bending, or the movement in the axial direction. It becomes possible to make it. That is, it can be configured as an input device such as a synthesizer. On the other hand, by using a video that changes in accordance with the sound, the hairy flexible actuator of the first embodiment can be danced to music. That is, it can be configured as a music expression device.

6. Virtual pet For example, only one unit of the hairy flexible interface of the first embodiment is extracted and fixed on a smart phone or a tablet terminal (hereinafter referred to as a smart phone or the like). Then, based on the user's behavior record stored in a smart phone or the like, the user's fatigue level or mental state is estimated, and brightness information and color information corresponding to the estimated fatigue level and mental state are converted to hairy flexibility. The interface is presented at a fixed position, and is expressed by the movement of the hairy flexible actuator according to the luminance information and color information. Because it can be made to move very biologically, it is configured as a virtual pet. Furthermore, the contact recognition mechanism (FIGS. 8 and 9) for the side surface portion of the hairy flexible interface of the second embodiment enables the interaction that is said to be stroked.

7. Communication tool For example, the hair-like flexible interface of the first embodiment is attached to a smart phone or the like. And the application for communication with others, such as a short message service, a short sentence contribution service, and SNS, is performed, and a hair-like flexible interface is bent in conjunction with the message from others. Specifically, when a predetermined image, character, symbol, icon, stamp, or the like is received from another person, the light at the bottom of the casing of the hairy flexible interface on the screen of a smart phone or the like is controlled by the application. The position of the sensor is caused to emit light with a predetermined luminance. Thereby, the hairy flexible interface can be bent.
Further, by moving the hairy flexible interface of the second and third embodiments, a message can be input by the application. Specifically, when the user on the transmission side performs touching, stroking operation, rotation operation, etc. on the hairy flexible interface, the transmission side smartphone recognizes this operation and sends a message indicating the content on the reception side. By transmitting light to the smart phone on the receiving side and emitting light at a predetermined luminance on the bottom of the housing of the hairy flexible interface on the receiving side based on the received message in the receiving smart phone, etc. Move the flexible interface.
As described above, by using the hair-like flexible interface together with the communication tool, more various communications are realized.

8. Lure (pseudo bait)
Create a hairy flexible interface in the shape of a lure. That is, the core portion of the lure is a hairy flexible interface, and the optical sensor can detect external light. The lure with such a configuration is dropped into the water, and the light is illuminated by the projector from the surface of the water, so the light sensor of the lure detects the projected light, and the resistance heat corresponding to the light detected in the drive circuit is generated. Generate and bend the SMA to make the lure move.

9. Game tool The hair-like flexible interface is used as a game player (character, piece). A plurality of hairy flexible interfaces (for example, the number of players) are arranged on a screen of a smart phone or the like. In the game application, a GUI that emits a screen with a desired luminance is provided at the position of the photosensor at the bottom of the casing of each hairy flexible interface. The user can use this GUI to bend the hair SMA of the hair-like flexible interface in the desired amount and direction (when the hair-like flexible interface is provided with a plurality of sets of SMAs, drive circuits, and optical sensors). A player configured with a flexible interface can be moved. Therefore, a plurality of users can enjoy a battle-type game such as chamara or finger sumo by moving their hairy flexible interface using their GUIs. The game application is executed on a (second) smart phone or the like that is different from the (first) smart phone or the like on which the hairy flexible interface is arranged, and the operation contents by the GUI on the second smart phone or the like are displayed. By transmitting to the first smart phone or the like, the hairy flexible interface arranged on the first smart phone or the like can be moved by remote control from the second smart phone or the like.

10. Digital signage The hairy flexible interface is attached to the display surface of the digital signage according to the brightness information at the position of the optical sensor at the bottom of the housing of the hairy flexible interface that is output to the digital signage. You may make it express a motion. As a result, not only two-dimensional expression by digital signage but also three-dimensional movement expression by a hairy flexible interface provided therein contributes to the improvement of the advertising effect that attracts human eyes.

11. Addition of light emission / display function using optical fiber Place a flexible capillary interface and an optical fiber (for example, the same length as the flexible capillary interface) on the display. As a result, part of the light displayed on the display is incident on the optical fiber, and the tip of the optical fiber emits light. This enables a new expression in which the light emission by the optical fiber and the movement of the hairy flexible interface are fused. The optical fiber may be integrated with the hairy flexible interface.

12. Object transportation by the hair-like soft interface By arranging many hair-like soft interfaces on the display and controlling the light output on the display, the object placed on the surface of the hair-like soft interface can be moved. In addition, a display having a large number of hairy flexible interfaces arranged upside down, that is, with the tip of the hairy flexible interface being in contact with the floor surface, and controlling the light output on the display, the hair The display can be moved using the flexible interface as a leg.

13. Design Variations The hairy flexible interface can be designed in various ways by changing the number, shape, surface material, etc. For example, it is conceivable to imitate insects and animals by using the display as the torso and multiple hairy flexible interfaces as the legs and wings. It is also conceivable that one hairy flexible interface can be used like an accessory such as a smart phone by making the tail or ear shape. Furthermore, it may be possible to more realistically represent an animal whose body surface is covered with hair by using one or more hairy soft interfaces whose surfaces are covered with hair.

14. Utilization of sensor other than optical sensor In the above embodiment, resistance heat is generated in the drive circuit triggered by detection of light displayed on the display by the optical sensor, and the SMA is bent by the resistance heat. However, resistance depends on the results obtained by various sensors such as pressure sensors, microphones, temperature sensors, color sensors, depth cameras, and devices that measure biological information such as eye movements, cerebral blood flow, brain waves, pulse, blood pressure, etc. Heat may be generated.
For example, as an application in the entertainment field, the eyeglasses are provided with a small eye movement measuring device and a hairy soft interface simulating eyelashes, and the eyelashes of the hairy soft interface are moved according to eye movements. Can be considered. It is also conceivable that a hairy flexible interface imitating hair is planted in a wig, and a cerebral blood flow rate or brain wave measuring device is provided to move the hair of the hairy flexible interface according to the measurement result.
Further, the SMA itself may be used as an antenna for detecting a microwave, and the SMA may be bent by heat generated by the detected microwave. In this case, there is no need to provide a separate sensor or power source.

The above embodiment is merely an example, and all the above description should not be used to limit the technical scope of the present invention. In addition, the technical scope of the present invention includes various modifications made to the hardware configuration, control, processing contents, and the like in the above embodiments without departing from the spirit of the present invention.

Claims (9)

A user interface device disposed on a display surface of a display device whose display surface emits light,
A housing provided with a light detection unit that is provided on a surface facing the display surface of the display device and detects light emission of the display surface; and a drive circuit that is energized when light is detected by the light detection unit; And a unit having a hair-like actuator in which a shape memory alloy deformed by resistance heat generated during energization of the drive circuit is arranged in the longitudinal direction,
The user interface device, wherein the shape memory alloy of the actuator is bent with a bending amount corresponding to the light amount or luminance of light detected by the light detection unit. A user interface device disposed on a display surface of a display device whose display surface emits light,
A housing provided with a light detection unit that is provided on a surface facing the display surface of the display device and detects light emission of the display surface; and a drive circuit that is energized when light is detected by the light detection unit; And a unit having a hair-like actuator in which a shape memory alloy deformed by resistance heat generated during energization of the drive circuit is arranged in the longitudinal direction, and the light detection unit and the drive circuit are included in one unit. And a plurality of sets of the shape memory alloy are installed,
The light detection unit of each set of the units detects light of different colors,
The shape memory alloy of each set of the units is deformed according to the color of light detected by the corresponding light detection unit. A user interface device arranged on a touch panel on which a display surface emits light,
A light detection unit that is provided on a surface facing the touch panel and that detects light emission of the touch panel; a housing unit that includes a drive circuit that is energized when light is detected by the light detection unit; and A hair-like actuator in which a shape memory alloy that is deformed by resistance heat generated during energization is disposed in the longitudinal direction, and a conductor that is disposed on the actuator and is electrically connected to the bottom of the housing. Composed of units,
The touch panel causes a position corresponding to the conductor to emit light when an electric charge reaches the bottom of the casing due to a user touching the conductor. A plurality of the conductors are disposed on the actuator,
Each of the plurality of conductors is connected to a different position on the bottom of the housing part ,
The user interface device according to claim 3, wherein the touch panel emits light at a position corresponding to a conductor contacted by a user. The touch panel changes the light emission luminance of the corresponding position for each conductor,
5. The user interface device according to claim 4, wherein the shape memory alloy is bent with a bending amount corresponding to the luminance of light detected by a corresponding light detection unit. A user interface device disposed on a display surface of a touch panel on which a display surface emits light,
A light detection unit that is provided on a surface facing the display surface of the touch panel , detects a light emission of the display surface, and a housing unit including a drive circuit that is energized when light is detected by the light detection unit; A unit having a hair-like actuator in which a shape memory alloy deformed by resistance heat generated when the drive circuit is energized is arranged in a longitudinal direction, and the light detection unit, the drive circuit, and A plurality of sets of shape memory alloys are installed, and corresponding to each set, a plurality of conductors connected to different positions on the bottom of the housing unit are installed on the actuator,
The touch panel emits light at a position corresponding to a conductor contacted by a user,
A user interface device, wherein when light emission is detected by a light detection unit corresponding to a light emission position on the touch panel, a shape memory alloy corresponding to the light detection unit is deformed. The light detection unit of each set of the units detects light of different colors,
7. The user interface device according to claim 6, wherein the shape memory alloy of each set of the units is deformed according to the color of light detected by a corresponding light detection unit. The user interface device according to claim 6 or 7, wherein the plurality of conductors are installed at different circumferential positions of the actuator or at different longitudinal positions of the actuator. A user interface device disposed on a display surface of a display device whose display surface emits light,
A housing provided with a light detection unit that is provided on a surface facing the display surface of the display device and detects light emission of the display surface; and a drive circuit that is energized when light is detected by the light detection unit; And a unit having a hair-like actuator in which a shape memory alloy deformed by resistance heat generated during energization of the drive circuit is arranged in the longitudinal direction, and in one unit, the light detection unit, the drive circuit, And multiple sets of shape memory alloys,
The light detection unit of each set of the units is covered with a polarization filter that polarizes light in different directions,
When the unit is rotated on the display surface of the display device, corresponding to the amount of light detected by transmitting through the corresponding polarizing filter in each light detection unit, which changes according to the rotation operation. A user interface device in which a shape memory alloy is deformed.