JP2013024931A - Tactile sense presentation device and tactile sense presentation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve user's intelligibility of presented information.SOLUTION: A tactile sense presentation device presents information of an object such that a user can obtain it by the tactile sense. The tactile sense presentation device includes: screen layout data setting means for setting a layout of data to be presented on a screen; vibration pattern generating means for generating vibration patterns that are different for every object contained in the layout of one screen set by the screen layout data setting means or for every group including a plurality of objects; screen display pattern generating means for generating a screen display pattern on the basis of the layout and the vibration pattern; and screen presentation means for presenting the screen data generated by the screen display pattern generating means, on the screen.

Description

  The present invention relates to a tactile presentation device and a tactile presentation program, and more particularly to a tactile presentation device and a tactile presentation program for improving the degree of understanding of presentation information for a user.

  2. Description of the Related Art Conventionally, a method of displaying a selected object using a figure, a GUI (Graphical User Interface), or the like by a tactile means such as a tactile display is known. As the tactile means described above, for example, a method in which a large number of micro-piezoelectric actuators are two-dimensionally mounted, a screen drawn with a bitmap or the like is binarized, and static unevenness corresponding to the screen is formed and presented. (Hereinafter referred to as “first presentation method”) is widely used. As a specific example of the first presentation method, there is KGS dot view (registered trademark), for example. In the tactile display used as the first presentation method, for example, the stimulation pin is driven up and down according to the layout information of the screen, and the user (user) touches the object represented by the unevenness by the stimulation pin. Understand the layout and shape of the screen.

  As a display method other than the above, for example, an electromagnetic solenoid that drives an iron core with an electromagnet is used as a stimulation element, a method of stimulating a wide area of the back and abdomen with static unevenness, and a stepping motor for driving the stimulation element. A three-dimensional tactile display or the like (hereinafter referred to as “second presentation method”) that can be used and displayed with multi-level irregularities having a height of about 10 mm is known (for example, see Non-Patent Document 1).

  Further, as a display method other than the above, for example, a method of converting image information such as characters and figures into vibration stimuli using a piezoelectric element and presenting it on a finger (hereinafter referred to as “third presentation method”) is known. (For example, refer nonpatent literature 2). In addition, as a 3rd presentation method, there exists an optical contact (Optical to tactile converter) etc., for example. In the opticon, minute stimulation pins that are driven by piezoelectric elements are mounted in a grid pattern on the area of the fingertip, and a pattern such as characters on the screen is converted into vibration of vertical movement by the stimulation pins and presented to the fingertip. The vibration pattern is formed using information obtained by binarizing an image photographed by a camera.

  Here, in the electronic tactile diagram creation using the first presentation method described above, for example, the position information of a touch pen or the like that touches the presentation surface of the tactile display is extracted, and the touched portion is convexly displayed (hereinafter, referred to as “contact”). "Fourth presentation method") is known. Furthermore, conventionally, a method has been developed that enables interactive operation by touching an object presented on a tactile display and presents text data of the object in braille (for example, see Non-Patent Document 3).

C. C. Collins: "Tactile Television-Mechanical and Electrical Image Projection", IEEE Trans. On Mam-Machine Syst. , No. 1, pp. 72-79 (1970) J. et al. C. Bliss, M.M. H. Katcher, C.I. H. Rogers, R.A. P. Shape: “Optical-to-Tactile Image Conversion for the Blind”, IEEE Trans. On Mam-Machine Syst. , No. 1, pp. 58-65 (1970)) Handa, Sakai, Misono, Morita, Ito, “Braille Presentation Method on Tactile Display”, IEICE Technical Committee on Welfare Information Engineering, WIT2007-94, pp. 23-26 (2008)

  However, the conventional methods as described above can only statically express the objects constituting the screen for a certain period of time when the GUI menu or chart is presented using a tactile presentation device for two-dimensional information. there were. For this reason, conventionally, for example, a plurality of items and objects (for example, menu items, map landmarks, charts) displayed on one screen cannot be presented with physically different stimuli. I could not understand the objects and get information quickly and efficiently.

  Here, in the first presentation method described above, as described above, information such as the screen layout could be statically displayed with binary irregularities for a certain period of time, but depending on the individual object An effective means of making different presentations was not considered.

  Further, in the second presentation method described above, it is possible to present different information depending on the height difference by controlling the height of the stimulus pin with respect to the attribute of the object and the important position information. The level that can be discriminated by tactile sensation is limited within a range of about 10 mm in which can be operated, and there is a problem in transmitting various states.

  Moreover, since the type of the optacon, which is the third presentation method described above, is a method of driving the stimulation pin by vibration, it has the same problem as the first presentation method described above.

  Furthermore, the fourth presentation method described above is an application of the presentation method using the first type of haptic presentation device, extracts position information of the touch pen on the haptic display, and projects the touched portion in a convex manner. Thereby, in the 4th presentation method, although real time drawing is possible, it was not considered presenting the information corresponding to an attribute or a position.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide a haptic presentation device and a haptic presentation program for improving an understanding degree of presentation information for a user.

  In order to solve the above problems, the present invention employs means for solving the problems having the following characteristics.

  A haptic presentation device according to an aspect of the disclosure is a haptic presentation device that presents information about an object so that the information can be acquired by haptic sense. A screen layout data setting unit that sets a layout of data to be presented on a screen; and the screen layout data setting unit A vibration pattern generating means for generating a different vibration pattern for each object or group having a plurality of objects included in the one-screen layout set by the method, and generating a screen display pattern based on the layout and the vibration pattern Screen display pattern generation means for performing display, and screen display means for presenting the screen data generated by the screen display pattern generation means on the screen.

  ADVANTAGE OF THE INVENTION According to this invention, the understanding level of the presentation information with respect to a user can be improved.

It is a figure which shows an example of schematic structure of the tactile sense presentation apparatus in 1st Embodiment. It is a figure which shows the specific example of the vibration system using a tactile display. It is a figure for demonstrating the vibration pattern of each object which comprises 1 screen in the specific example 1. FIG. It is a figure for demonstrating the vibration pattern of each object which comprises 1 screen in the specific example 2. FIG. It is a figure which shows the example of a description of the object by XML. It is a figure which shows an example of schematic structure of the tactile sense presentation apparatus in 2nd Embodiment. It is a figure which shows an example of schematic structure of the tactile sense presentation apparatus in 3rd Embodiment. It is a figure which shows an example of the time control of the intermittent vibration pattern in 3rd Embodiment. It is a figure which shows an example of schematic structure of the tactile sense presentation apparatus in 4th Embodiment. It is a flowchart which shows an example of the tactile sense presentation process procedure in 1st Embodiment. It is a flowchart which shows an example of the tactile sense presentation process procedure in 2nd Embodiment. It is a flowchart which shows an example of the tactile sense presentation process procedure in 3rd Embodiment. It is a flowchart which shows an example of the tactile sense presentation process procedure in 4th Embodiment.

<About the present invention>
The present invention, for example, in a tactile presentation device that transmits information expressed in a two-dimensional manner to a user (user) or the like in a situation where visual information is interrupted or in a situation where visual information is blocked, improves understanding of information, searches, etc. Realize a presentation that supports Specifically, in the present invention, for example, for each object constituting the layout of a two-dimensional screen, a tactile sense target object (vibration target object) such as a plurality of stimulation pins corresponding to the object, a selection button, an icon, etc. Provided is a presentation method that can be driven at different vibration frequencies set for each object.

  As a result, in the present invention, for example, it is possible to drive stimulation pins and the like at different frequencies in an arbitrary range in the screen, and it is possible to present corresponding to each attribute and the like on an object basis. It is possible to improve the degree of understanding of the position of the type, the landmark of the figure (for example, a geographical feature), and more quickly and efficiently grasp the two-dimensional information.

  Next, a preferred embodiment of the tactile sense presentation device and the tactile sense presentation program according to the present invention having the above-described features will be described in detail with reference to the drawings.

<First Embodiment: Tactile Presentation Device: Outline Configuration>
FIG. 1 is a diagram illustrating an example of a schematic configuration of a tactile sense presentation device according to the first embodiment. 1 includes a screen layout data setting unit 11, a vibration pattern generation unit 12, a screen display pattern generation unit 13, a tactile display display drive buffer (screen data storage unit) 14, and a tactile display. (Tactile sense presenting means) 15. In the example of FIG. 1, the tactile display 15 is configured inside the tactile presentation device 10. However, the present invention is not limited to this. For example, the tactile display 15 is connected to the tactile presentation device 10. You may comprise outside.

  The screen layout data setting means 11 sets the layout of screen data to be displayed on the tactile display 15 as shown in FIG. The screen layout data setting means 11 is composed of, for example, a plurality of objects (for example, items such as selection buttons and icons, landmarks in the figure, characters, etc. (Items)) as shown in the screen layout 20 shown in FIG. Generate a screen layout.

  In the first embodiment, as an example, among the plurality of objects included in the screen layout 20 illustrated in FIG. 1, four items A to D are driven at different vibration frequencies and presented. . When a plurality of items belong to the same group (for example, when items A and B belong to group a and items C and D belong to group b), they may be driven at different vibration frequencies for each group. Good.

  In other words, the screen layout data setting unit 11 sets layout data to be displayed on the screen based on input settings by a user and the like, and to which object or group is driven by what vibration or the like. Set up. In the first embodiment, as shown in FIG. 1, a plurality of objects are arranged at preset positions by an instruction input by a user or the like, but the number and arrangement of objects (items) in the present invention The position is not limited to this. The item includes, for example, characters, words, sentences, symbols, landmarks, and the like.

  The screen layout data setting means 11 describes, for example, the position coordinates, size, shape, etc. of each object using a description language such as XML (Extensible Markup Language) based on the set screen layout. Describes the frequency to vibrate the object.

  The screen layout data setting unit 11 outputs the set screen layout to the screen display pattern generation unit 13. Further, the screen layout data setting means 11 provides the vibration pattern generating means 12 with the number of items and the number of groups corresponding to the set screen, the frequency information set for each item or group, or the maximum vibration frequency fmax to be used. Output. The maximum vibration frequency fmax is a maximum frequency for updating one screen. When the maximum vibration frequency fmax (minimum time cycle) is set, the maximum vibration frequency fmax does not exceed the maximum vibration frequency that can be driven in terms of performance of the tactile display 15. Set the value.

  The vibration pattern generation means 12 generates a vibration pattern for each screen for the set object. Here, the vibration pattern is, for example, a process of generating irregularities with different time periods for each object included in one screen layout or for each group having a plurality of objects, and the screen is continuously updated every minimum time period. By doing so, it is defined as a pattern of vibration generated by unevenness of each object according to a set time period. Actually, one screen is formed in the screen display pattern generation means 13, and the screen is continuously updated at the minimum time period. Specifically, the vibration pattern generation unit 12 generates a different number of vibration patterns for each item or each group based on the above-described frequency information obtained from the screen layout data setting unit 11, the maximum vibration frequency fmax, or the like. Let The object to be vibrated is, for example, an actuator (a tactile sense presentation object, a vibration object) such as a stimulation pin constituting the tactile display 15.

  When the vibration pattern generation unit 12 receives information on the number of items and the maximum vibration frequency fmax from the screen layout data setting unit 11, for example, the vibration pattern generation unit 12 has different vibration frequencies (for example, f1, f2,... , Fmax) is generated. In the first embodiment, the maximum vibration frequency fmax is used as one of the different vibration frequencies described above, and a frequency exceeding the maximum vibration frequency fmax is not used as one of the vibration frequencies. Is not limited to this.

  Moreover, the vibration pattern mentioned above may be a vibration pattern which consists of a fixed period, for example, and may be a vibration pattern which changes with progress of time, the content of an item, etc. Note that the fluctuation of the vibration pattern includes, for example, changing the rhythm and tempo, gradually increasing or decreasing the vibration, but the present invention is not limited to this. The vibration pattern generation means 12 manages all vibration patterns, and when the vibration pattern fluctuates with the passage of time or the content of the item as described above, the same vibration pattern as other items and groups is the same. Avoid being generated at the time.

  Further, the vibration pattern generation unit 12 outputs the generated frequency signal of each vibration pattern to the screen display pattern generation unit 13. Further, the vibration pattern generation means 12 uses a vibration pattern output for a predetermined frequency such as the maximum vibration frequency fmax as a screen update trigger, and outputs the trigger signal to the tactile display display drive buffer 14.

  The screen display pattern generation means 13 is based on the setting information obtained from the screen layout data setting means 11 and the vibration pattern for each item or group obtained from the vibration pattern generation means 12. A screen display pattern such as a group is generated.

  Specifically, the screen display pattern generation unit 13 applies different repetition frequencies (for example, f1 to f1) generated by the vibration pattern generation unit 12 to the items or groups set as targets to be vibrated by the screen layout data setting unit 11. A vibration pattern based on f4 (f4 = fmax, etc.) is assigned to generate a display pattern on one screen. Here, in the first embodiment, each object includes, for example, a plurality of stimulation pins (actuators).

  In the first embodiment, for example, which item or group is assigned with one of different frequencies among a plurality of items and groups, for example, is set in advance by a signal from the vibration pattern generation unit 12, for example. Alternatively, it may be set by a signal from the screen layout data setting means 11.

  Further, the screen display pattern generation means 13 is not limited to a single screen display pattern, and may generate a display pattern in units of a plurality of screens. For example, when there are a number of objects that do not fit on one screen, a display pattern corresponding to the number of screens (for example, two screens, three screens, etc.) in which the objects fit in the screen can be generated. In this case, the vibration pattern generation unit 12 generates the same vibration pattern for the same object as the previous screen. In other words, by making the vibration pattern for the same object the same on multiple screens, the user can easily grasp the identity and relationship of the objects on the previous screen and the current screen by vibration. Can improve the level of understanding.

  The screen display pattern generation unit 13 outputs screen display pattern information including vibration pattern information to the tactile display display drive buffer 14 which is a screen data storage unit.

  The tactile display display drive buffer 14 stores the screen pattern obtained by the screen display pattern generation unit 13 in the buffer, and generates information about the vibration pattern having a predetermined frequency such as the maximum vibration frequency fmax, Using the reception from the means 12 as a trigger, the screen pattern stored in the buffer is output to the tactile display 15 at the timing. Note that the predetermined frequency is not limited to the maximum vibration frequency fmax, and may be, for example, the minimum vibration frequency fmin or a frequency exceeding a preset threshold value.

  The tactile display 15 drives a tactile presentation object (vibration object) such as a stimulation pin (actuator) based on the display drive information of the tactile display 15 obtained from the tactile display display drive buffer 14 to allow the user to Make a tactile presentation.

  As described above, in the first embodiment, for each object data constituting an arbitrary image layout, each object is vibrated and displayed at different repetition cycles, and according to information on each object. Data that presents one screen per unit time is generated. In the first embodiment, the generated screen presentation data is buffered, and the screen is switched and controlled using the maximum vibration frequency as a trigger. Accordingly, in the first embodiment, when tactile presentation of two-dimensional information is performed, the difference in vibration assigned to each item or each group can be recognized by the user. It is possible to improve the level of understanding of the presented information by clarifying the distinction of the information.

<Specific example of vibration method considered using tactile display 15>
Here, an example in which the above-described tactile display 15 is caused to vibrate by being driven independently at a different frequency for each item using the above-described arbitrary actuator (for example, a stimulation pin) as a specific example of the vibration method will be described. To do.

  FIG. 2 is a diagram illustrating a specific example of a vibration method using a tactile display. In the example shown in FIG. 2, the display areas of items A to D for the screen layout 20 are set by the screen layout data setting unit 11. At this time, the vibration pattern generating means 12 is provided with a signal generator 21 for generating vibration, and the signal generators 21a to 21d corresponding to the number of items are used for the vibration patterns ( For example, f1 to f4) are generated and combined with different vibration patterns corresponding to each item by the mixers 22a to 22d. That is, the mixers 22a to 22d mix different vibration patterns with respect to the respective areas (for example, convex portions) of the items A to D with respect to the screen layout 20 shown in FIG. 2 and output them to the tactile display.

  In this case, a transmitter that individually vibrates and drives the piezoelectric elements that move up and down the respective stimulation pins constituting the object and a function that controls the vibration of the object may be provided. Furthermore, when driving at different vibration frequencies for each object, control such as switching of a transmitter to be driven or a vibration drive signal may be performed according to the position of each object on the screen.

<Specific examples of vibration patterns of individual objects constituting one screen>
Next, specific examples of vibration patterns of individual objects constituting one screen in the first embodiment will be described with reference to the drawings.

<Specific example 1>
FIG. 3 is a diagram for explaining a vibration pattern of each object constituting one screen in the first specific example. FIG. 3 shows an example in which items (Items) A to D displayed on the screen layout 20 are vibrated and presented at different frequencies set to each other as described above. 3 (1) to (4) show examples in which presentation patterns for realizing the set frequencies f1 to f4 correspond to the passage of time on the time axis t, and the HIGH level of the frequency signal is shown. Indicates that the corresponding actuator is convex, and the LOW level indicates that the corresponding actuator is not convex (hereinafter referred to as “concave”).

  In the screen display pattern generation means 13, the dot unit actuators constituting the objects (items) A to D obtained from the screen layout data setting means 11 have the vibration frequencies f 1 to f 4 obtained from the vibration pattern generation means 12. Corresponding logical product (AND) is taken and a presentation pattern is generated. Moreover, in the specific example 1, the logical sum (OR) of each presentation pattern object is taken. As a result, in the first specific example, data of one screen composed of the objects A to D can be generated for each dot of the tactile display 15.

Specifically, for example, in the interval t ₁ in FIG. 3, the actuator corresponding to the area of all objects of A~D becomes convex display, the screen data for the next interval t ₂ the object A Nomiga凹pattern Generate. In this way, one-screen data obtained in a short time is accumulated in the tactile display display drive buffer 14 and sequentially output to the tactile display 15 at the timing of the maximum vibration frequency fmax. Thereby, each pattern of the object is driven with unevenness so that the desired vibration frequency set for each object is obtained. Therefore, for example, the attribute information of an item (object) can be more accurately determined using the item vibration described above.

In the example of FIG. 3, four different vibration patterns f1 to f4 are generated corresponding to the four objects A to D. Specifically, f1 = fmax, f2 = fmax / 2, f3 = fmax / 3, f4 = fmax / 4, and a frequency divided with respect to fmax are set, and a time axis t (t _{1 to} t ₁₆ ). On the other hand, frequencies as shown in FIGS. 3 (1) to (4) are generated. Then, 3 (5) - as shown in (8), the vibration frequency f1~f4 and is multiplied is a signal region of items to D, the screen layout 20 every time _t 1 _{~t 16} is Generated. The white area of the screen layout 20 indicates an area where the dot-unit actuator of the tactile display 15 is convex (1), and the black area is an area where the actuator is concave (0).

  As described above, the items A to D are caused to vibrate the actuators (stimulation pins) in dot units corresponding to the items at different periods, thereby allowing the user to accurately determine each of the items A to D. The understanding level of the presented information can be improved.

  In the example of FIG. 3, the vibration frequency of the item A is fmax, the vibration frequency of the item B is divided by 2 of the maximum vibration frequency fmax (fmax / 2), and the vibration frequency of the item C is divided by 3 (fmax / 3). ), The vibration frequency of the item D is set to 4 (fmax / 4), but the present invention is not limited to this. In the example of FIG. 3, different frequencies are set for each item. However, the present invention is not limited to this. For example, the same vibration is set for each group of related items. You may make it vibrate with a frequency. For example, in the example of FIG. 3, when the items A and B are information relating to the same genre (for example, news, sports, etc.), the items A and B are grouped together, and the actuator is operated with the same vibration frequency. The (stimulation pin) may be vibrated.

  In the first specific example, the maximum vibration frequency is set to, for example, the maximum vibration frequency at which the tactile display 15 can vibrate in performance, and therefore the frequency value varies depending on the device. In the present embodiment, the maximum vibration frequency depending on the performance of the device is not set as described above, but the user may arbitrarily set the vibration frequency within a range not exceeding the maximum vibration frequency in performance. Good.

  In the specific example 1 described above, a certain frequency is set as the maximum vibration frequency fmax, and is ½ times, １ ／ times, ¼ depending on the number of items (for example, the number of groups) to be presented based on the frequency fmax. Each item (each group) can be vibrated at a frequency corresponding to each item (each group) by setting the frequency value divided by two. In the specific example 1, different frequency values are set according to a predetermined frequency division ratio. However, the present invention is not limited to this. For example, different types of frequencies set in advance according to the number of items may be set. Good. Further, the screen display pattern generation unit 13 may perform control such that the frequency is gradually increased or decreased by changing the frequency division ratio with the passage of time.

<Specific example 2>
Next, a vibration pattern different from the specific example 1 described above will be described as a specific example 2. FIG. 4 is a diagram for explaining vibration patterns of individual objects constituting one screen in the specific example 2.

  The example of FIG. 4 shows a presentation method in which when one screen data is generated, two one screen presentation patterns for each item (Item) are prepared in advance, and they are switched and combined.

  As shown in FIG. 4, items A to D have two patterns for generating vibration in each object. Further, arrows (1) to (3) shown in FIG. 4 indicate the principle of vibration generation for each object, and the white area of the screen layout 20 is convex and the actuator in dot units of the tactile display 15 is convex (1). The black region is a region where the black region is concave (0).

  For example, the arrow (1) is a basic pattern for generating vibration corresponding to the object. For example, the item A has two patterns A-1 and A-2. These two patterns are patterns reversed to each other.

  An arrow (2) is one-screen data when there is no vibration composed of all objects. Further, an arrow (3) indicates the logical product (AND) screen data of the patterns A-1, B-1, C-1, and D-1 and the static screen configuration pattern, and the pattern A-2. , B-2, C-2, D-2 and the screen data of the logical sum (OR) of the static screen configuration pattern. Further, an arrow (4) indicates a function (switching) for switching between the two patterns.

  That is, in the second specific example, the screen display pattern generation unit 13 registers the above two patterns in an internal memory or the like provided in the screen display pattern generation unit 13 for each item (object) to be vibrated. 4, the logical product of one pattern (for example, pattern A-1) and a static screen configuration, and the other pattern (for example, pattern A-2) and the static screen configuration. The output pattern of the logical sum of is switched with the period (time) of the frequencies f1 to f4 set for each object. In addition, although the frequency f1-f4 in FIG. 4 has set the frequency similar to the specific example 1 mentioned above, the setting method of a frequency is not limited to this.

  Thereby, in the specific example 2, each object can repeat an unevenness | corrugation sequentially with the preset vibration frequency. Further, the single screen display data generated by the screen display pattern generation means 13 is accumulated in the tactile display display drive buffer 14 and can be presented on the tactile display 15 at a predetermined timing by a screen update trigger or the like.

  In the second specific example, for example, even when there are a large number of objects, only switching is required, so that the control of the vibration signal is not complicated, and easy control can be realized. In the second specific example, the same processing can be realized by setting two patterns for each group, not for each item but for each group.

<Example of object description in XML>
Next, a description example of an object in XML set by the screen layout data setting unit 11 in the first embodiment will be described with reference to the drawings. FIG. 5 is a diagram illustrating a description example of an object in XML. In the example of FIG. 5, as an XML for one item, for example, an item identification number (<NO>) for identifying an item, a group identification number (<ID>) for identifying a group, and a tactile display 15 are displayed on one screen. Coordinate position and size as a base point, <LEFT>, <TOP>, <WIDTH>, <HEIGHT>, etc.), vibration frequency (<FREQEQUY1>), vibration time (<VIBRATION1>), pause time (<INTERVAL1>) Is set as metadata. Note that a pause time of 0 means that it continues to vibrate (no pause (intermittent) time).

  That is, in the example of FIG. 5, it is possible to set a vibration time and a pause time for each item displayed on one screen, and it is possible to vibrate with a predetermined vibration pattern only during that time. Moreover, in this embodiment, it is not limited for every item, It can be made to vibrate with the same vibration pattern with respect to several items with the same group identification number (<ID>).

  By setting a frequency that is defined in the XML shown in FIG. 5 and different from other frequencies for each item or group, as described above, it is vibrated at a different frequency for each item or group, and the user Different or identical parts of items and groups can be easily understood.

<Second Embodiment: Tactile Presentation Device: Outline Configuration>
Next, a second embodiment of the tactile sense presentation device will be described with reference to the drawings. FIG. 6 is a diagram illustrating an example of a schematic configuration of a tactile sense presentation device according to the second embodiment. In the haptic presentation device 30 shown in FIG. 6, functional blocks having substantially the same configuration as the haptic presentation device 10 shown in FIG. 1 described above are given the same numbers, and specific examples here are described. Is omitted.

  6 includes a screen layout data setting unit 11, a vibration pattern generation unit 12, a screen display pattern generation unit 13, a tactile display display drive buffer 14, a tactile display 15, and parallel / serial. The conversion means 31, the data transmission means 32, the maximum transfer rate detection means 33, and the maximum vibration frequency setting means 34 are comprised.

  In the second embodiment, for example, a method that enables presentation on an object on a screen that could not be realized when transmitting data of one screen by serial transmission at different vibration frequencies is shown.

  In FIG. 6, the display data of one screen created by the screen display pattern generation unit 13 is transmitted to the tactile display display driving buffer 14 that drives the tactile display 15 via a data transmission path 31 such as serial.

  The screen display pattern generation unit 13 generates a vibration pattern for one screen, for example, as in the first embodiment described above. At this time, the screen display data to be switched is limited by the transmission speed of the transmission path in the data transmission means 32.

  Therefore, in the second embodiment, in order to update the vibration pattern, the parallel / serial conversion unit 31 first converts the parallel signal from the screen display pattern generation unit 13 into a serial signal and outputs the serial signal to the data transmission unit 32. . The data transmission unit 32 transmits the obtained parallel signal to the tactile display display driving buffer 14 and also to the maximum transfer rate detection unit 33. The maximum transfer rate detection means 33 detects the maximum transfer rate of the transmission path for transmitting the layout data of one screen from the signal transmitted from the data transmission means 32. Further, the maximum transfer rate detection unit 33 outputs the detected maximum transfer rate to the maximum vibration frequency setting unit 34.

  The maximum vibration frequency setting unit 34 sets the maximum vibration frequency fmax for updating the pattern of one screen based on the maximum transfer rate detected by the maximum transfer rate detection unit 33. The range of the maximum vibration frequency is controlled so as not to exceed a frequency that can be processed by the tactile display 15. Thereby, in 2nd Embodiment, in the screen display pattern production | generation means 13, an individual object can be shown with a different vibration by switching a pattern with the set maximum vibration frequency fmax.

<Third Embodiment: Tactile Presentation Device: Outline Configuration>
Next, a third embodiment of the tactile presentation device will be described with reference to the drawings. FIG. 7 is a diagram illustrating an example of a schematic configuration of a haptic presentation device according to the third embodiment. In the haptic presentation device 40 shown in FIG. 7, functional blocks having substantially the same configuration as the haptic presentation device 10 shown in FIG. 1 described above are given the same numbers, and specific examples here are described. Is omitted.

  7 includes a screen layout data setting unit 11, a vibration pattern generation unit 12, a screen display pattern generation unit 13, a tactile display display drive buffer 14, a tactile display 15, and an intermittent vibration time. And a control means 41.

  In the third embodiment, in addition to the first embodiment described above, the time is compared with the basic vibration generation pattern of each item (Item) obtained by controlling the vibration pattern at the maximum vibration frequency fmax. An intermittent vibration time (rest time) can be provided by applying a gate on the shaft, and each item can have more detailed attribute information.

  Specifically, in the third embodiment, the intermittent vibration time control unit 41 extracts information for setting a gate period described separately from the vibration pattern obtained from the screen layout data setting unit 11.

  Here, FIG. 8 is a diagram illustrating an example of time control of the intermittent vibration pattern in the third embodiment. For example, the vibration frequencies fe1 to fe4 corresponding to the items A to D shown in FIGS. 8 (2) to (5) are generated corresponding to the period of the basic vibration pattern fm shown in FIG. 8 (1). The

  In the third embodiment, an intermittent vibration pattern with vibration of each item A to D can generate an intermittent vibration pattern with vibration of the entire screen by taking a logical sum (OR).

For example, fe1 to fe4 shown in FIGS. 7 (2) to (5) are time charts showing timings for obtaining an intermittent vibration pattern on the time axis t. T _{2 to} T ₄ indicate periods in which a vibration pattern exists, and T _{2L to} T _4L indicate gate periods for generating a pause period.

  In the third embodiment, the screen layout data setting unit 11 sets the layout data to be displayed on the screen by the input setting by the user or the like, and at what vibration with respect to which object or group. In addition to setting whether to perform driving or the like, a gate period is set.

  The intermittent vibration time control means 41 extracts information for setting a gate period described separately from the vibration pattern obtained by the screen layout data setting means 11, and as shown in FIG. The gate is controlled on the time axis t with respect to the basic vibration pattern fm generated in D. Intermittent vibration patterns with vibrations of items A to D are intermittent with respect to the vibration pattern of each item for one screen as shown in FIGS. 8 (6) to (9) by taking a logical sum (OR). Control can be performed.

  In the third embodiment, for example, in the intermittent vibration time control means 41, the intermittent time for one item can be made earlier or later in stages, or earlier or later can be repeated. Note that the intermittent vibration time control means 41 manages the vibration (frequency) of each item so that the intermittent time does not become the same as the vibration of other items even when the intermittent time is controlled as described above. A different frequency is set for each item.

  As described above, according to the third embodiment, for example, in addition to the basic function that enables vibration at the maximum vibration frequency fmax, by adding a gate to the vibration pattern on the time axis, each item can be further attributed. You can have information.

<Fourth Embodiment: Tactile Presentation Device: Outline Configuration>
Next, a fourth embodiment of the tactile sense presentation device will be described with reference to the drawings. FIG. 9 is a diagram illustrating an example of a schematic configuration of a tactile sense presentation device according to the fourth embodiment. In the haptic presentation device 50 shown in FIG. 9, functional blocks having substantially the same configuration as the haptic presentation device 10 shown in FIG. 1 described above are given the same numbers, and specific examples here are described. Is omitted.

  9 includes a screen layout data setting unit 11, a vibration pattern generation unit 12, a screen display pattern generation unit 13, a tactile display display drive buffer 14, a tactile display 15, and finger position detection. Means 51 and finger position time detection control means 52 are provided.

  In the fourth embodiment, the position of the finger when the user uses the tactile display 15 is detected, and vibration is controlled based on the position information. That is, in the first to third embodiments described above, a preset vibration is repeatedly performed at a certain time, but in the fourth embodiment, when the user's finger stops at a predetermined position. Then, control is performed to stop subsequent vibrations.

  Specifically, the finger position detection unit 51 detects the coordinates of the finger position on the tactile display 15. Further, the finger position detection unit 51 outputs the detected finger position information to the finger position time detection control unit 52.

  As for the finger position detection method, for example, as shown in Non-Patent Document 3, one or a plurality of camera units (imaging means) are installed on the surface of the tactile display 15, and the reflection pattern of the finger up and down movement is detected. Although it is possible to detect the position of the finger on the touch surface due to a change and whether or not the finger is stopped, the present invention is not limited to this.

  The finger position time detection control unit 52 outputs a vibration stop signal to stop the vibration to the screen display pattern generation unit 13 when the finger is stationary on the object for a certain period of time. That is, the finger position time detection control means 52 detects the time when the coordinates detected at the finger position are in the coordinate range where the item (Item) exists, and stops the vibration of the item or all items. Take control. As a result, when the user has already selected an item and the finger is stopped, the power saving effect is improved in order to prevent unnecessary vibration, and there is no vibration. The contents of items can be easily recognized.

  According to the above-described embodiment, in the situation where the visually impaired person or the visual information is blocked by the presentation to the tactile sense, the degree of understanding of the presentation information for the user can be improved. In addition, each embodiment mentioned above can also combine several suitably.

<Execution program (tactile presentation program)>
Here, some of the tactile sense presentation devices described above include a CPU (Central Processing Unit), a volatile storage medium such as a RAM (Random Access Memory), a nonvolatile storage medium such as a ROM (Read Only Memory), a mouse, It can be configured by a computer including an input device such as a keyboard and a pointing device, display means for displaying images and data, and an interface for communicating with the outside.

  Accordingly, the above-described functions of the tactile sense presentation device can be realized by causing the CPU to execute a program describing these functions. These programs can also be stored and distributed in a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, or the like.

  That is, by generating an execution program (tactile presentation program) for causing a computer to execute the processes in the above-described configurations and installing the program in, for example, a general-purpose personal computer, the tactile presentation process can be realized. . Next, the processing procedure by the execution program in this invention is demonstrated using a flowchart.

<Tactile sense presentation processing procedure in the first embodiment>
FIG. 10 is a flowchart illustrating an example of a tactile sense presentation process procedure according to the first embodiment. In FIG. 10, first, screen layout data to be displayed on the tactile display 15 set by the user or the like is acquired (S01). Next, a vibration pattern is generated based on a frequency set in advance for each object (item) or each group included in the screen layout (S02).

  Next, a display pattern of one screen or a plurality of screens is generated from various information obtained in the processes of S01 and S02 according to the number of items and groups (S03), and the generated display screen is buffered (for example, It is temporarily stored in the tactile display display driving buffer 14) or the like (S04). Here, for example, it is determined whether an update trigger corresponding to the maximum vibration frequency or the like has been received (S05). When the update trigger is received (YES in S05), the screen data stored in the buffer or the like is output to the tactile display 15 (S06). If no update trigger has been received (NO in S05), the process waits until an update trigger is received.

  Next, it is determined whether or not to terminate the tactile sense presentation process in the first embodiment (S07). If not terminated (NO in S07), the process returns to S01 to perform the subsequent processes. Further, when the process ends due to an end instruction from the user or the like, or an event such as the output of all screen layout data (YES in S07), the tactile sense presentation process in the first embodiment is ended.

<Tactile sense presentation processing procedure in the second embodiment>
Next, a tactile sense presentation process procedure according to the second embodiment will be described with reference to a flowchart. FIG. 11 is a flowchart illustrating an example of a tactile sense presentation process procedure according to the second embodiment. In FIG. 11, screen layout data to be displayed on the tactile display 15 set by the user or the like is first acquired (S11), and then a screen display pattern is generated (S12).

  Next, the maximum transfer rate in the data transmission of the screen data corresponding to the screen display pattern obtained in the process of S12 is detected (S13), and the maximum vibration frequency is set based on the detected maximum transfer rate (S14). . Note that the range of the maximum vibration frequency set in S14 is controlled so as not to exceed a frequency that the tactile display 15 can achieve in terms of performance.

  Further, based on the maximum vibration frequency set in the process of S14, a vibration pattern is generated according to the number of items and groups (S15), and one or a plurality of screen display patterns are generated (S16), The displayed display screen is temporarily stored in a buffer or the like (S17). Here, it is determined whether an update trigger corresponding to the maximum vibration frequency or the like has been received (S18). When the update trigger is received (YES in S18), the screen data stored in the buffer or the like is output to the tactile display 15 (S19). If an update trigger has not been received (NO in S18), the process waits until an update trigger is received.

  Next, it is determined whether or not the tactile sense presentation process in the second embodiment is to be terminated (S20). If not terminated (NO in S20), the process returns to S11 to perform subsequent processes. Further, when the process ends due to an end instruction from the user or the like or an event such as the output of all screen layout data (YES in S20), the tactile sense presentation process in the second embodiment is ended.

<Tactile sense presentation processing procedure in the third embodiment>
FIG. 12 is a flowchart illustrating an example of a tactile sense presentation process procedure according to the third embodiment. In FIG. 12, first, screen layout data to be displayed on the tactile display 15 set by the user or the like is acquired (S31). Next, a vibration pattern is set based on a frequency set in advance for each object (item) or each group included in the screen layout (S32). Furthermore, in the third embodiment, the above-described intermittent vibration time control is performed (S33). As the intermittent vibration time control, for example, vibration control corresponding to a preset pause time is performed.

  Next, one or a plurality of screen display patterns are generated according to the number of items or groups from the various information obtained in the processes of S31 to S33 (S34), and the generated display screen is temporarily used as a buffer or the like. (S35). Here, it is determined whether an update trigger corresponding to the maximum vibration frequency or the like has been received (S36). When the update trigger is received (YES in S36), the screen data stored in the buffer or the like is output to the tactile display 15 (S37). If no update trigger has been received (NO in S36), the process waits until an update trigger is received.

  Next, it is determined whether or not to terminate the tactile sense presentation process in the third embodiment (S38). If not terminated (NO in S38), the process returns to S31 to perform subsequent processes. Further, when the process ends due to an end instruction from the user or the like, or an event such as the output of all screen layout data (YES in S38), the tactile sense presentation process in the third embodiment is ended.

<Tactile sense presentation processing procedure in the fourth embodiment>
FIG. 13 is a flowchart illustrating an example of a tactile sense presentation process procedure according to the fourth embodiment. In FIG. 13, first, screen layout data to be displayed on the tactile display 15 set by the user or the like is acquired (S41). Next, a vibration pattern is set based on a frequency set in advance for each object (item) or each group included in the screen layout (S42).

  Next, one or a plurality of screen display patterns are generated according to the number of items and groups from the various information obtained in the processing of S41 and S42 (S43), and the generated display screen is temporarily used as a buffer or the like. (S44). Here, it is determined whether an update trigger corresponding to the maximum vibration frequency or the like has been received (S45). When the update trigger is received (YES in S45), the screen data stored in the buffer or the like is output to the tactile display 15 (S46). If no update trigger has been received (NO in S45), the process waits until an update trigger is received.

  Next, in the fourth embodiment, it is determined whether or not the user's finger position control is performed (S47), and when the finger position control is performed (YES in S47), the predetermined tactile display 15 is displayed. The position of the user's finger is detected by a camera (imaging means) or the like (S48), and the vibration stopping operation is controlled according to the stop time of the detected finger position (S49). As the control in the processing of S49, for example, when the stop time of the finger position is 3 seconds or more, control is performed such as stopping the vibration of the object corresponding to the stopped finger position or all objects on the screen. However, the present invention is not limited to this. For example, control may be performed so that the vibration cycle of the corresponding object is delayed or intermittent operation is performed. Thereafter, the process returns to S43 to perform subsequent processing.

  Further, in the above-described processing of S47, when finger position control is not performed (NO in S47), it is determined whether or not to terminate the tactile sense presentation processing in the fourth embodiment (S50), and when not finished (S50). In step S41, the process returns to step S41 to perform subsequent processing. Further, when the process is terminated due to an end instruction from the user or the like, or an event such as the output of all screen layout data (YES in S50), the tactile sense presenting process in the fourth embodiment is terminated.

  As described above, according to the present invention, it is possible to improve the degree of understanding of the information presented to the user. Specifically, according to the present invention, it is possible to present at different vibration frequencies for each object or group constituting one screen of the tactile display. Furthermore, according to the present invention, by adding an intermittent vibration pattern of the time axis, various stimuli for the user are possible, and information corresponding to the attributes of the object at a glance and position information such as a map or a graph can be obtained. It is possible to grasp and effective presentation of two-dimensional information becomes possible.

  Further, according to the present invention, objects on the screen can be presented at different vibration frequencies even in a form including serial transmission. In addition, for example, when an item has text data and the text data is presented in characters such as Braille, vibration is stopped when the item is touched for a certain period of time, and characters such as Braille are blocked by vibration. It becomes possible to touch without any problems.

  The present invention can also be applied to, for example, data broadcasting, EPG (Electronic Program Guide), and the case where individual objects constituting a two-dimensional screen layout represented on the Web are presented by a tactile presentation device.

  In the example of vibration in each of the above-described embodiments, the control of the unevenness of the actuator such as the stimulation pin has been described. However, the present invention is not limited to this, and for example, the convex level can be adjusted in several stages. In the case of a tactile display, the level may be adjusted to vibrate. In addition to the vibration of the stimulation pin, different sounds and electrical stimulation may be given to each object (item) and each group together with the vibration.

  Although the preferred embodiment of the present invention has been described in detail above, the present invention is not limited to the specific embodiment, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

10, 30, 40, 50 Tactile sense presentation device 11 Screen layout data setting means 12 Vibration pattern generation means 13 Screen display pattern generation means (screen display pattern generation means)
14 Tactile display display drive buffer (screen data storage means)
15 Tactile display (tactile presentation means)
20 Screen layout 31 Parallel / serial conversion means 32 Data transmission means 33 Maximum transfer rate detection means 34 Maximum vibration frequency setting means 41 Intermittent vibration time control means 51 Finger position detection means 52 Finger position time detection control means

Claims (8)

In a tactile presentation device that presents information about an object so that it can be acquired by tactile sense,
Screen layout data setting means for setting the layout of data to be presented on the screen;
Vibration pattern generating means for generating different vibration patterns for each object or group having a plurality of objects included in the layout of one screen set by the screen layout data setting means;
Screen display pattern generation means for generating a screen display pattern based on the layout and the vibration pattern;
A tactile sensation presentation apparatus comprising screen presentation means for presenting screen data generated by the screen display pattern generation means on a screen. Screen data storage means for storing the screen data generated by the screen display pattern generation means for a predetermined time;
When the screen data storage means receives a signal indicating that a vibration pattern of a predetermined frequency has been generated by the vibration pattern generation means, the screen data storage means outputs the screen data stored so far to the screen presentation means. The tactile sense presentation device according to claim 1, wherein The vibration pattern generating means includes
The tactile sensation presentation apparatus according to claim 1, wherein a vibration pattern for generating vibrations at different frequencies based on a preset maximum vibration frequency is generated for each object or each group. The screen display pattern generation means includes
Two contradictory basic patterns for generating vibration are set in advance for each object or for each group, and the two set basic patterns are set based on the frequency set for each object or for each group. The tactile sensation presentation apparatus according to claim 1, wherein the screen display pattern is generated by switching. Maximum transfer rate detection means for detecting a maximum transfer rate at the time of transmission of screen data output from the screen display pattern generation means;
Maximum vibration frequency setting means for setting a maximum vibration frequency corresponding to the maximum transfer rate detected by the maximum transfer rate detection means,
5. The vibration pattern generation unit generates a vibration pattern for each object or each group based on the maximum vibration frequency obtained by the maximum vibration frequency setting unit. 6. A tactile sensation presentation device according to claim 1.   6. The tactile sense presentation device according to claim 1, further comprising intermittent vibration time control means for performing time control for intermittently vibrating the vibration pattern for each object or group. Finger position detection means for detecting the finger position of the user during the presentation of the object;
Finger position time detection control means for performing time control so as to stop the vibration by the vibration pattern when the user's finger is stopped for a predetermined time or more from the detection result by the finger position detection means. The tactile sense presentation device according to claim 1, wherein:   A haptic presentation program for causing a computer to function as each unit included in the haptic presentation apparatus according to any one of claims 1 to 7.

Images