JP2012226482A - Portable information terminal, tactile server, tactile service system, and communicating method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To give a desired tactile feel corresponding to vibration information without being influenced by a terminal type, an individual difference, secular changes, or the like.SOLUTION: A portable information terminal 10 includes: a display unit 103; a touch sensor 101; a vibration generating unit 107 for vibrating a touch surface of the touch sensor 101; a transmitting/receiving unit 104 for communicating with a tactile server 30; and a control unit 105. The control unit 105 transmits display information and terminal information from the transmitting/receiving unit 104 to the tactile server 30, and then, displays the display information in the display unit 103 when the transmitting/receiving unit receives vibration information from the tactile server 30, and generates a vibration by the vibration generating unit 107 on the basis of the vibration information when an input is received through the touch sensor 101.

Description

  The present invention relates to a portable information terminal, a tactile server, a tactile service system, and a communication method that generate vibration by receiving an input via a touch sensor.

  In recent years, portable information terminals having a touch sensor such as a touch panel or a touch switch that accepts an input by an operator are widely used. Various types of touch sensors such as a resistive film type, a capacitance type, and an optical type are known. However, any type of touch sensor accepts a touch input by a finger or a stylus pen, and the touch sensor itself is not physically displaced like a push button switch even when touched.

  As described above, even when the touch sensor is touched, the touch sensor itself is not physically displaced, so that the operator cannot obtain feedback for the input even if the input is accepted. For this reason, the operator is likely to repeatedly input such as touching the same position many times, and may stress the operator. As a technique for preventing such repeated input, a technique has been proposed in which when an operator operates a touch sensor, the touch surface is vibrated to present a tactile sensation to the operator (for example, Patent Document 1). .

Japanese Patent No. 4633183

  If a technique for presenting a tactile sensation as disclosed in Patent Document 1 is used, the operator feels the touch of the surface of an object displayed on the Web screen in a pseudo manner while the Web browser is activated on the portable information terminal. It is possible to make it.

  However, even if the portable information terminal is vibrated with the same vibration information, the generated vibration may differ depending on the terminal type, individual difference, secular change, or the like. For this reason, even if vibration information is set for image data or the like on the Web screen, a desired tactile sensation may not be presented to the operator.

  Accordingly, an object of the present invention made in view of such points is to provide a desired tactile sensation corresponding to vibration information without being affected by terminal type, individual difference, secular change, or the like. It is to provide a tactile service system and a communication method.

The invention of the portable information terminal according to the first aspect of achieving the above object is as follows:
A display unit;
A touch sensor;
A vibration generator for vibrating the touch surface of the touch sensor;
A transceiver that communicates with the tactile server;
A control unit,
The controller is
Display information and terminal information are transmitted from the transceiver to the tactile server, and then
When the transmission / reception unit receives vibration information from the tactile server, the display information is displayed on the display unit, and when input is received via the touch sensor, the vibration generation unit generates vibration based on the vibration information. It is characterized by making it.

The invention of the portable information terminal according to the second aspect to achieve the above object is as follows:
A display unit;
A touch sensor;
A vibration generator for vibrating the touch surface of the touch sensor;
A transceiver that communicates with the tactile server;
A control unit,
The controller is
The terminal information and the access request for the display information and the vibration information stored in the web server are transmitted from the transmission / reception unit to the tactile server, and then
When the transmission / reception unit receives the display information and the vibration information from the tactile server, the display information is displayed on the display unit, and when the input is received via the touch sensor, the vibration information is generated by the vibration generation unit. It is characterized by generating vibration based on the above.

The invention of the tactile server according to the third aspect to achieve the above object is as follows:
A transceiver that communicates with the portable information terminal;
A control unit,
The controller is
When display information and terminal information are received from the portable information terminal by the transmission / reception unit, vibration information is generated based on the display information and the terminal information, and the vibration information is transmitted from the transmission / reception unit to the portable information terminal. It is characterized by.

The invention according to a fourth aspect is the haptic server according to the third aspect,
A storage unit that stores a plurality of terminal type information in association with vibration information, respectively,
The terminal information includes terminal type information,
The controller is
When the display information and the terminal type information are received from the portable information terminal by the transmission / reception unit, vibration information is generated based on the display information, and the vibration information is associated with the terminal type information by the storage unit. The information is converted into information, and the vibration information is transmitted from the transmission / reception unit to the portable information terminal.

The invention according to a fifth aspect is the haptic server according to the fourth aspect,
The storage unit further stores an evaluation input signal and a vibration reference value for the evaluation input signal,
The terminal information includes terminal identification information,
The controller is
The evaluation input signal is transmitted from the transmission / reception unit to the portable information terminal, and then
When receiving the vibration measurement value and the terminal identification information from the portable information terminal in the transceiver unit, to generate correction information based on the evaluation input signal and the vibration measurement value,
When the display unit receives the display information and the terminal identification information from the portable information terminal, the transmission / reception unit generates vibration information based on the display information, and corrects the vibration information based on the correction information corresponding to the terminal identification information. Then, the vibration information is transmitted from the transmission / reception unit to the portable information terminal.

The invention of the haptic server according to the sixth aspect for achieving the above object is as follows:
A transceiver that communicates with the portable information terminal;
A storage unit for storing an evaluation input signal and a vibration reference value for the evaluation input signal;
When the display information and terminal information are received from the portable information terminal by the transmission / reception unit, vibration information is generated based on the display information and the terminal information, and the vibration information is transmitted from the transmission / reception unit to the portable information terminal. And comprising
The terminal information includes terminal identification information,
The controller is
The evaluation input signal is transmitted from the transmission / reception unit to the portable information terminal, and then
When receiving the vibration measurement value and the terminal identification information from the portable information terminal in the transceiver unit, to generate correction information based on the evaluation input signal and the vibration measurement value,
When the display unit receives the display information and the terminal identification information from the portable information terminal, the transmission / reception unit generates vibration information based on the display information, and corrects the vibration information based on the correction information corresponding to the terminal identification information. Then, the vibration information is transmitted from the transmission / reception unit to the portable information terminal.

The invention of the tactile server according to the seventh aspect for achieving the above object is as follows:
A transmission / reception unit communicating with the portable information terminal and the web server;
A control unit,
The controller is
When the terminal information and an access request for display information and vibration information stored in the Web server are received from the portable information terminal by the transmission / reception unit, the display information and the vibration information are acquired from the Web server,
The display information and the vibration information are transmitted from the transmission / reception unit to the portable information terminal.

The invention of the tactile service system according to the eighth aspect to achieve the above object is as follows:
A tactile service system comprising a portable information terminal according to a first aspect and a tactile server according to any one of the third to sixth aspects,
The portable information terminal transmits display information and terminal information to the tactile server,
Upon receiving the display information and the terminal information from the portable information terminal, the tactile server generates vibration information based on the display information and the terminal information, and transmits the vibration information to the portable information terminal.
The portable information terminal displays the display information when receiving the vibration information from the tactile server, and generates vibration based on the vibration information when receiving an input to the portable information terminal. It is.

The invention of the haptic service system according to the ninth aspect to achieve the above object is as follows:
A tactile service system comprising a portable information terminal according to a second aspect and a tactile server according to a seventh aspect,
The portable information terminal transmits the terminal information and an access request for display information and vibration information stored in the Web server to the tactile server,
Upon receiving the display information and the terminal information from the portable information terminal, the tactile server acquires the display information and the vibration information from the Web server, and sends the display information and the vibration information to the portable information terminal. Send
When the portable information terminal receives the display information and the vibration information from the tactile server, the portable information terminal displays the display information, and when receiving an input to the portable information terminal, generates a vibration based on the vibration information. It is a feature.

The invention of the communication method according to the tenth aspect for achieving the above object is as follows:
A communication method comprising the portable information terminal according to the first aspect and the tactile server according to any one of the third to sixth aspects,
The portable information terminal transmitting display information and terminal information to the tactile server;
When the tactile server receives the display information and the terminal information from the portable information terminal, generates vibration information based on the display information and the terminal information, and transmits the vibration information to the portable information terminal; ,
When the portable information terminal receives the vibration information from the tactile server, the display information is displayed, and upon receiving an input to the portable information terminal, generating vibration based on the vibration information;
It is characterized by comprising.

The invention of the communication method according to the eleventh aspect for achieving the above object is as follows:
A communication method comprising a portable information terminal according to a second aspect and a tactile server according to a seventh aspect,
The portable information terminal transmits the terminal information and an access request for display information and vibration information stored in the Web server to the tactile server;
When the tactile server receives the display information and the terminal information from the portable information terminal, it acquires the display information and the vibration information from the Web server, and sends the display information and the vibration information to the portable information terminal. Sending, and
When the portable information terminal receives the display information and the vibration information from the tactile server, the display information is displayed, and when an input to the portable information terminal is received, a vibration based on the vibration information is generated. ,
It is characterized by comprising.

  According to the present invention, there is provided a portable information terminal, a tactile server, a tactile service system, and a communication method capable of presenting a desired tactile sensation corresponding to vibration information without being affected by terminal type, individual difference, secular change, or the like Can be provided.

It is explanatory drawing of the upload operation | movement of the web page information of the tactile service system which concerns on 1st Embodiment. It is explanatory drawing of the access operation to the web page information of the haptic service system which concerns on 1st Embodiment. It is a sequence diagram which shows the access operation to the web page information of FIG. It is a functional block diagram which shows the structure of the principal part of the portable information terminal of FIG. It is a block diagram which shows an example of the mounting structure of the portable information terminal of FIG. It is a functional block diagram which shows the structure of the principal part of the tactile server of FIG. 2 is a flowchart showing processing of a portable information terminal when display information is image data in the Web page upload operation of FIG. 1. 3 is a flowchart showing processing of the portable information terminal when display information is character string data in the Web page upload operation of FIG. 1. It is a flowchart which shows the process of the portable information terminal in the access operation to the web page information of FIG. In the process of FIG. 9, it is a figure which shows the example of an image displayed on the display part of a portable information terminal. It is a flowchart which shows the process of the tactile server in the access operation to the web page information of FIG. It is explanatory drawing of the upload operation | movement of the web page information of the tactile service system which concerns on 2nd Embodiment. It is explanatory drawing of the access operation to the web page information of the tactile service system which concerns on 2nd Embodiment. It is a sequence diagram which shows the access operation to the web page information of FIG. It is a functional block diagram which shows the structure of the principal part of the portable information terminal of FIG. It is a block diagram which shows an example of the mounting structure of the portable information terminal of FIG. It is a functional block diagram which shows the structure of the principal part of the tactile server of FIG. It is a sequence diagram which shows the capability evaluation operation | movement of the tactile service system which concerns on 2nd Embodiment. It is a flowchart which shows the process of the tactile server in the capability evaluation operation | movement of the tactile service system which concerns on 2nd Embodiment. It is explanatory drawing of the evaluation input signal group of capability evaluation. 13 is a flowchart showing processing of the portable information terminal when display information is image data in the Web page upload operation of FIG. 12. It is a flowchart which shows the process of the tactile server in the access operation to the web page information of FIG.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
1 to 11 show a first embodiment of the present invention. First, an overview of the haptic service system 1 according to the first embodiment will be described with reference to FIGS. The tactile service system 1 includes portable information terminals 10a and 10b, radio base stations 15a and 15b, a Web server 20, and a tactile server 30. The radio base stations 15 a and 15 b, the web server 20, and the tactile server 30 are connected via a network 40. In the haptic service system 1, after the Web page information upload operation described with reference to FIG. 1, an access operation to the Web page information described with reference to FIGS. 2 and 3 is performed.

  FIG. 1 is an explanatory diagram of an operation of uploading Web page information in the haptic service system 1. In the upload operation of the Web page information, the mobile information terminal 10a of the terminal type “type A” uses the Web server information that associates display information such as image data, image information, or character string data with vibration information, to the Web server. Upload to 20. Therefore, first, the portable information terminal 10a captures an image of the object A and acquires the image data A. Next, the portable information terminal 10a transmits the terminal type information “type A” of the portable information terminal 10a to the tactile server 30 (step 1).

  The tactile server 30 stores a plurality of terminal type information and stores a plurality of sample tactile data groups in association with the terminal type information. The sample tactile data group includes a plurality of sample tactile data. The sample tactile data is data in which a tactile signal such as voltage and amplitude is associated with a tactile number for identifying the tactile signal. When the tactile server 30 receives the terminal type information “type A” from the portable information terminal 10a, the tactile server 30 reads the sample tactile data group associated with the terminal type information “type A” and transmits it to the portable information terminal 10a ( Step 2).

  Thereafter, the portable information terminal 10a sequentially generates vibrations based on the sample tactile data group received from the tactile server 30 and presents a tactile sensation to the operator. The operator selects the tactile number of one sample tactile data from the sample tactile data group based on the vibration sequentially generated by the portable information terminal 10a. After that, the portable information terminal 10a displays Web page information in which the image data A (display information), the tactile number “1a” (vibration information) of the selected sample tactile data, and the terminal type information “type A” are associated with each other. Upload to the Web server 20 (step 3).

  FIG. 2 is an explanatory diagram of an operation of accessing the Web page information of the haptic service system 1. FIG. 3 is a sequence diagram showing an access operation to the Web page information of FIG. In the access operation to the web page information, the mobile information terminal 10b of the terminal type “type B” accesses the web page information uploaded by the mobile information terminal 10a in the upload operation of FIG. Therefore, first, the portable information terminal 10b transmits the terminal type information “type B” (terminal information) of the portable information terminal 10b to the tactile server 30 (step 4). Furthermore, the portable information terminal 10b transmits an access request to the web page information stored in the web server 20 to the tactile server 30 (step 5).

  When receiving the access request from the portable information terminal 10b, the tactile server 30 acquires the Web page information from the Web server 20 (step 6). Next, the tactile server 30 determines the tactile number “1a” and the terminal type information “type A” included in the Web page information acquired from the Web server 20 based on the terminal type information “type B” of the portable information terminal 10 b. Each is converted into a tactile number “1b” and terminal type information “type B”. Then, the tactile server 30 sends Web page information in which the image data A (display information), the converted tactile number “1b” (vibration information), and the terminal type information “type B” are associated with each other to the portable information terminal 10b. Transmit (step 7). Based on the Web page information received from the tactile server 30, the portable information terminal 10b displays the image data A, generates vibration corresponding to the tactile number “1b”, and presents a tactile sensation to the operator.

  Next, with reference to FIGS. 4-6, the structure of the portable information terminal 10a, 10b and the tactile server 30 which comprise the tactile service system 1 which concerns on 1st Embodiment is demonstrated. FIG. 4 is a functional block diagram showing a configuration of a main part of the portable information terminals 10a and 10b. Since the portable information terminals 10a and 10b can have the same configuration, they are shown as the portable information terminal 10 in FIG. The portable information terminal 10 includes a touch sensor 101, an imaging unit 102, a display unit 103, a transmission / reception unit 104, a control unit 105, a vibration generation unit 107, and a storage unit 108.

  The touch sensor 101 is disposed on the front surface of the display unit 103, and detects the position of a touch input on the touch surface when an operator's finger or the like touches the touch surface of the touch sensor 101. The touch sensor 101 is composed of, for example, a resistive film type, a capacitance type, an optical type touch panel, a touch switch, or the like.

  The imaging unit 102 captures an image of an external object or the like according to the operation of the operator, and acquires image data. In the case of the portable information terminal 10b that performs an access operation to Web page information, the imaging unit 102 can be omitted.

  The display unit 103 displays images, characters, and the like. The display unit 103 is configured using, for example, a liquid crystal display panel or an organic EL display panel.

  The transmission / reception unit 104 wirelessly transmits / receives signals to / from the web server 20 and the tactile server 30 via the external network 40.

  The control unit 105 is realized by, for example, a central processing unit (CPU) (not shown) executing a program stored in the storage unit 108. The control unit 105 controls the touch sensor 101, the imaging unit 102, the display unit 103, the transmission / reception unit 104, the vibration generation unit 107, and the storage unit 108. The control unit 105 has the function of the Web screen configuration unit 110. The web screen configuration unit 110 configures a web screen to be displayed on the display unit 103 based on display information such as image data, image information, or character string data included in the web page information received from the tactile server 30. Here, the image information is information such as a URL of image data, for example.

  The vibration generation unit 107 is configured using a piezoelectric vibrator or the like, and generates vibration on the touch surface of the touch sensor 101 or the housing of the portable information terminal 10, so that an operator's finger touching the touch surface, etc. The tactile sensation is stimulated, thereby presenting a tactile sensation.

  The storage unit 108 stores a program executed by a central processing unit (not shown), and stores a plurality of tactile signals in association with tactile numbers. The tactile signal is, for example, a signal such as voltage, current, amplitude, or frequency, and is a signal that defines a vibration pattern.

  FIG. 5 is a configuration diagram showing an example of a mounting structure of the portable information terminal 10 of FIG. 5A is a cross-sectional view of a main part, and FIG. 5B is a plan view of the main part. The display unit 103 is housed and held in the housing 120. The touch sensor 101 is held on the display unit 103 via insulators 121 provided at four corners outside the display area A of the display unit 103 indicated by a two-dot chain line in FIG.

  The casing 120 is provided with an upper cover 122 so as to cover the touch surface 101 a of the touch sensor 101 outside the display area A of the display unit 103, and an elastic member is provided between the upper cover 122 and the touch sensor 101. An insulator 123 made of

  Furthermore, on the back surface of the touch sensor 101, a vibration generating unit 107 for vibrating the touch sensor 101 is provided in the vicinity of two opposing sides by bonding or the like. Then, the touch surface 101a is vibrated by vibrating the touch sensor 101 by the vibration generating unit 107. Note that in FIG. 5B, the housing 120, the upper cover 122, and the insulator 123 illustrated in FIG. 5A are not illustrated.

  FIG. 6 is a functional block diagram illustrating a configuration of a main part of the tactile server 30. The tactile server 30 includes a transmission / reception unit 301, a control unit 302, a terminal information database 303, and a tactile database 304.

  The transmission / reception unit 301 transmits / receives signals to / from the portable information terminal 10 and the Web server 20 via the external network 40.

  The terminal information database 303 stores a plurality of terminal type information of the portable information terminal 10.

  The tactile database 304 stores a sample tactile data group including a plurality of sample tactile data in association with terminal type information stored in the terminal information database 303. Each sample tactile data is data in which a tactile signal is associated with a tactile number for identifying the tactile signal. Each tactile number in the sample tactile data group is associated with each tactile number in another sample tactile data group.

  The control unit 302 is realized by, for example, a central processing unit (CPU) (not shown) executing a program stored in advance. The control unit 302 controls the transmission / reception unit 301, the terminal information database 303, and the haptic database 304. The control unit 302 has functions of a web page analysis unit 310 and a vibration information conversion unit 311.

  When the control unit 302 acquires Web page information stored in the Web server 20, the Web page analysis unit 310 of the control unit 302 analyzes the Web page information. Specifically, the Web page analysis unit 310 determines whether or not the tactile number is included in the Web page information, and the terminal type information and the Web page of the portable information terminal 10 that has transmitted an access request to the Web page information. It is determined whether or not the terminal type information included in the information matches.

  In the vibration information conversion unit 311 of the control unit 302, the web page analysis unit 310 does not match the terminal type information of the portable information terminal 10 to which the access request to the web page information is transmitted and the terminal type information included in the web page information. If it is determined, the tactile number of the Web page information and the terminal type information are converted. At this time, the vibration information conversion unit 311 converts the tactile number and the terminal type information of the Web page information so as to correspond to the terminal type information of the portable information terminal 10 that has transmitted the access request. The terminal type information is information for specifying the manufacturer, model (model number), year of manufacture, etc. of the portable information terminal, and is expressed as “type ○” in the present embodiment.

  Next, the Web page information upload operation of FIG. 1 will be described in more detail with reference to the flowcharts shown in FIGS. As described above, the portable information terminal 10a can upload display information such as image data or character string data and vibration information in association with each other as Web page information. Hereinafter, the process of the portable information terminal 10a when uploading image data and vibration information in association with each other will be described with reference to FIG. 7, and character string data and vibration information will be uploaded in association with each other with reference to FIG. The process of the portable information terminal 10a in the case of performing will be described.

  When the display information is image data, as shown in FIG. 7, first, when the operator makes an image data upload request to the portable information terminal 10 a, the control unit 105 prompts the operator to capture an image. . And the control part 105 images the image of the external object A with the imaging part 102 according to an operator's operation, and acquires the image data A (step S10).

  Next, the control unit 105 determines whether or not there is a tactile sense setting request from the operator (step S11). When there is no tactile sensation setting request from the operator, the control unit 105 uploads the image data A as Web page information from the transmission / reception unit 104 to the Web server 20 (step S12), and ends the process.

  On the other hand, when there is a tactile sense setting request from the operator in step S11, the control unit 105 prompts the operator to input a keyword related to the image data A. When a keyword is input by the operator (step S13), the control unit 105 transmits the terminal type information “type A” of the portable information terminal 10a and the keyword input in step S13 from the transmission / reception unit 104 to the tactile server 30. (Step S14).

  After step S14, upon receiving the terminal type information “type A” and the keyword from the portable information terminal 10a, the tactile server 30 reads a sample tactile data group corresponding to the terminal type information “type A” from the tactile database 304. Further, the tactile server 30 extracts a sample tactile data group related to this keyword from the sample tactile data group corresponding to the terminal type information “type A”. Then, the tactile server 30 transmits the extracted sample tactile data group to the portable information terminal 10a.

  When the control unit 105 of the portable information terminal 10a receives the sample tactile data group from the tactile server 30 by the transmission / reception unit 104 (step S15), each time the operator's finger or the like is touching the touch sensor 101, Based on the tactile signal of the sample tactile data, the vibration generation unit 107 sequentially generates vibrations (step S16). Here, the operator searches for vibrations to be set for the image data A while feeling the vibrations sequentially generated from the vibration generation unit 107 with a finger or the like through the touch sensor 101, and if found, a sample corresponding to the vibrations is found. Select the tactile number of the tactile data. For example, if there is a vibration closest to the touch of the object A indicated by the image data A among the vibrations felt through the touch sensor 101, the operator selects the tactile number of the sample tactile data corresponding to the vibration.

  After step S16, the control unit 105 determines whether or not the operator has selected the tactile number of the sample tactile data to be set for the image data A (step S17). In step S17, when the tactile number is not selected because the operator has not found a vibration to set for the image data A, the control unit 105 transmits and receives the image data A as Web page information. Upload from the unit 104 to the Web server 20 (step S18), and the process ends.

  On the other hand, when the operator selects a tactile number for setting with respect to the image data A in step S17, the control unit 105 displays the image data A, the selected tactile number “1a”, and the terminal of the portable information terminal 10a. The type information “type A” is uploaded as web page information from the transmission / reception unit 104 to the web server 20 (step S19), and the process ends.

  When the operator inputs a keyword related to the image data A in step S13, the portable information device 10a acquires only the sample tactile data group related to the image data A in step S15. Thereby, it is possible to efficiently search for vibrations for the operator to set in the image data A.

  On the other hand, when the display information is character string data, as shown in FIG. 8, first, when the operator makes a request for uploading character string data to the portable information terminal 10a, the control unit 105 sends the character information to the operator. Prompt for When the operator inputs / edits characters (step S30), the control unit 105 then determines whether or not there is a tactile setting request from the operator (step S31). If there is no tactile sense setting request from the operator, the control unit 105 confirms with the operator whether character input / editing is complete (step S32). If the operator selects that character input / editing cannot be ended in step S32, the control unit 105 returns to step S30 to allow the operator to continue character input / editing. On the other hand, when the operator has selected whether or not the input / editing of characters can be ended in step S32, the control unit 105 generates character string data based on the characters input / edited by the operator in step S30. Data is uploaded as Web page information from the transmission / reception unit 104 to the Web server 20 (step S33), and the process ends.

  On the other hand, if there is a tactile sense setting request from the operator in step S31, the control unit 105 extracts a phrase including the character string input / edited immediately before by the operator in step S30, and character string data based on this phrase. Is generated (step S34). Next, the control unit 105 transmits the terminal type information “type A” of the portable information terminal 10a from the transmission / reception unit 104 to the tactile server 30 (step S35).

  After step S35, upon receiving the terminal type information “type A” from the portable information terminal 10a, the tactile server 30 reads a sample tactile data group corresponding to the terminal type information “type A” from the tactile database 304. Then, the tactile server 30 transmits the read sample tactile data group to the portable information terminal 10a.

  When the control unit 105 of the portable information terminal 10a receives the sample tactile data group from the tactile server 30 by the transmission / reception unit 104 (step S36), each time the operator's finger or the like is touching the touch sensor 101, Based on the tactile signal of the sample tactile data, the vibration generation unit 107 sequentially generates vibrations (step S37). Here, the operator searches for vibrations to be set for the character string data while feeling the vibrations sequentially generated from the vibration generation unit 107 with a finger or the like through the touch sensor 101, and if found, a sample corresponding to the vibrations is found. Select the tactile number of the tactile data.

  After step S37, the control unit 105 determines whether or not the operator has selected a tactile number for setting the character string data (step S38). In step S38, if the tactile number is not selected because the operator has not found a vibration for setting the character string data, the control unit 105 ends the input / editing of characters to the operator. Whether or not it is possible is confirmed (step S32). If the operator selects that character input / editing cannot be ended in step S32, the control unit 105 returns to step S30 to allow the operator to continue character input / editing. On the other hand, when the operator has selected whether the input / editing of characters can be ended in step S32, the control unit 105 uploads the character string data generated in step S34 from the transmission / reception unit 104 to the web server 20 as web page information. (Step S33), the process ends.

  On the other hand, when the operator selects a tactile number for setting the character string data in step S38, the control unit 105 causes the character string data generated in step S34, the tactile number selected in step S38, and the mobile phone number. The terminal type information “type A” of the information terminal 10a is associated (step S39). Thereafter, the control unit 105 confirms with the operator whether or not the input / editing of character string data is complete (step S32). If the operator selects that character string data input / editing cannot be ended in step S32, the control unit 105 returns to step S30 to allow the operator to continue to input / edit character string data. On the other hand, when the operator selects whether or not to end the input / editing of the character string data in step S32, the control unit 105 displays the character string data, the tactile number, and the terminal type information “type A” associated in step S39 on the Web. The page information is uploaded from the transmission / reception unit 104 to the Web server 20 (step S33), and the process ends.

  Next, an operation for accessing the Web page information of FIG. 2 will be described with reference to FIGS. Hereinafter, the process of the portable information terminal 10b in the access operation to the Web page information will be described with reference to FIGS. 9 and 10, and the process of the tactile server 30 in the access operation to the Web page information will be described with reference to FIG. To do.

  FIG. 9 is a flowchart showing processing of the portable information terminal 10b in the operation of accessing the Web page information of FIG. FIG. 10 is a diagram illustrating an example of an image displayed on the display unit 103 of the portable information terminal 10b in the process of FIG. In FIG. 9, first, when the operator starts a Web browser on the display unit 103 (step S50), the control unit 105 of the portable information terminal 10b sends the terminal type information of the portable information terminal 10b from the transmission / reception unit 104 to the tactile server. 30 (step S51). When the transmission / reception unit 301 receives the terminal type information from the portable information terminal 10b, the tactile server 30 registers this in the terminal information database 303.

  Next, when the operator requests the mobile information terminal 10b to access the Web page information, the control unit 105 transmits the access request from the transmission / reception unit 104 to the tactile server 30 (step S52).

  When the transmission / reception unit 301 receives an access request from the portable information terminal 10b, the tactile server 30 acquires information on the Web page from the Web server 20. If the acquired web page information includes vibration information, the tactile server 30 corresponds to the terminal type information if the vibration information does not correspond to the terminal type information of the portable information terminal 10b. To convert. Then, the tactile server 30 transmits Web page information including vibration information corresponding to the terminal type information to the portable information terminal 10b. The processing of the tactile server 30 will be described in detail later.

  After step S52, when the transmission / reception unit 104 receives Web page information from the tactile server 30 (step S53), the Web screen configuration unit 110 of the control unit 105 configures a Web screen based on the Web page information, and configures the configured Web A screen is displayed on the display unit 103 (step S54).

  Next, the control unit 105 determines whether or not a tactile number is included in the Web page information (step S55). When the tactile number is not included in the web page information in step S55, the control unit 105 ends the process. In this case, since the Web page information includes only display information such as image data or character string data, an image as shown in FIG. In FIG. 10A, the display information is blanket image data, and only the blanket image is displayed on the display unit 103.

  On the other hand, if the tactile number is included in the web page information in step S55, the control unit 105 determines whether the terminal type information included in the web page information matches the terminal type information of the portable information terminal 10b. (Step S56). If the terminal type information does not match in step S56, the control unit 105 ends the process. In this case, since the portable information terminal 10b does not store the tactile number included in the Web page information in the storage unit 108 and cannot generate vibration, the display unit 103 displays the tactile number as illustrated in FIG. The correct image.

  On the other hand, when the terminal type information included in the Web page information matches the terminal type information of the portable information terminal 10b in step S56, the control unit 105 generates vibration based on the tactile number included in the Web page information. It is determined whether or not it is possible (step S57). Here, the control unit 105 reads out a tactile signal corresponding to the tactile number from the storage unit 108 and determines whether vibration can be generated based on the read out tactile signal. For example, the control unit 105 determines that vibration cannot be generated if the read tactile signal exceeds the maximum value Imax of the input to the vibration generation unit 107, and generates vibration if the tactile signal is equal to or less than the maximum input value Imax. Judge that it is possible.

  If it is determined in step S57 that vibration can be generated, the control unit 105 displays an image as shown in FIG. 10B on the display unit 103 to notify the operator that vibration can be generated. Then, when the operator touches the touch sensor 101 and the contact position is within the region corresponding to the image, the control unit 105 causes the vibration generation unit 107 to generate vibration based on the tactile signal (step S58). ). In FIG. 10B, the display information is blanket image data, and a pointing mark is displayed on the display unit 103 so as to overlap the blanket image. After step S58, the control unit 105 ends the process.

  On the other hand, when it is determined in step S57 that vibrations cannot be generated, the control unit 105 displays an image as shown in FIG. 10C on the display unit 103 to notify the operator that vibrations cannot be generated. (Step S59), the process ends. In FIG. 10C, the display information is blanket image data, and a pointing mark is superimposed on the blanket image on the display unit 103 and further a cross mark is displayed thereon.

  FIG. 11 is a flowchart showing processing of the tactile server 30 in the access operation to the Web page information of FIG. First, when the transmission / reception unit 301 receives the terminal type information “type B” from the portable information terminal 10 b (step S <b> 70), the control unit 302 of the tactile server 30 registers this in the terminal information database 303.

  Next, when the transmission / reception unit 301 receives an access request to the Web page from the portable information terminal 10b (Step S71), the control unit 302 acquires information on the Web page from the Web server 20 (Step S72). Next, the web page analysis unit 310 of the control unit 302 analyzes the web page information acquired in step S72, and determines whether or not a tactile number is included (step S73).

  In step S73, when the tactile number is not included in the web page information, the control unit 302 transmits the web page information from the transmission / reception unit 301 to the portable information terminal 10b (step S74), and ends the process.

  On the other hand, when the tactile number is included in the web page information in step S73, the web page analysis unit 310 reads the terminal type information of the portable information terminal 10b received in step S70 from the terminal information database 303, and the read terminal type. It is determined whether or not the information “type B” matches the terminal type information included in the Web page information (step S75). If the terminal type information matches in step S75, the control unit 302 transmits the web page information from the transmission / reception unit 301 to the portable information terminal 10b (step S74), and the process ends.

  On the other hand, when the terminal type information “type B” of the portable information terminal 10b does not match the terminal type information included in the web page information in step S75, the vibration information conversion unit 311 of the control unit 302 displays the tactile number of the web page information. “1a” and terminal type information “type A” are converted to correspond to the terminal type information “type B” of the portable information terminal 10b (step S76).

  Here, the vibration information conversion unit 311 first reads a sample tactile data group associated with the terminal type information “type B” of the portable information terminal 10b from the tactile database 304, and selects a Web page from the sample tactile data group. The tactile number “1b” corresponding to the tactile number “1a” included in the information is read out. Then, the vibration information conversion unit 311 replaces the tactile number “1a” included in the Web page information with the tactile number “1b” read from the tactile database 304. Further, the vibration information conversion unit 311 replaces the terminal type information “type A” included in the Web page information with the terminal type information “type B” of the portable information terminal 10 b.

  After step S76, the control unit 302 transmits and receives Web page information in which display information such as image data and character string data, the tactile number “1b” converted in step S76, and the terminal type information “type B” are associated with each other. It transmits to the portable information terminal 10b from the part 301 (step S74), and complete | finishes a process.

  In the first embodiment, when the tactile server 30 transmits vibration information to the portable information terminal 10, if the vibration information does not correspond to the terminal type of the portable information terminal 10, the vibration information is stored in the portable information terminal 10. It is changed so as to correspond to 10 terminal types. Thereby, the difference in tactile output among a plurality of portable information terminals related to different terminal types can be reduced.

(Second Embodiment)
12 to 22 show a second embodiment of the present invention. The haptic service system 1 according to the present embodiment further reduces the difference in tactile output due to individual differences and aging changes at the time of shipment among a plurality of portable information terminals related to the same terminal type in the first embodiment. To do.

  First, an overview of the haptic service system 1 according to the second embodiment will be described with reference to FIGS. The tactile service system 1 includes portable information terminals 10a and 10b, radio base stations 15a and 15b, a Web server 20, and a tactile server 30 as in the first embodiment. The radio base stations 15 a and 15 b, the web server 20, and the tactile server 30 are connected via a network 40. In the haptic service system 1, after the Web page information upload operation described with reference to FIG. 12, the access operation to the Web page information described with reference to FIGS. 13 and 14 is performed. Further, in the tactile service system 1, tactile output capability evaluation is performed by the portable information terminals 10 a and 10 b, and the evaluation result is registered in the tactile server 30. The web page information upload operation and the web page information access operation are performed using the evaluation result registered in the tactile server 30.

  FIG. 12 is an explanatory diagram of the upload operation of the Web page information of the haptic service system 1. In the upload operation of Web page information, as in the case of the first embodiment, the mobile information terminal 10a first captures an image of the object A and acquires image data A. Next, the portable information terminal 10a transmits the terminal type information “type A” and the terminal identifier “identifier A” of the portable information terminal 10a to the tactile server 30 (step 1).

  The tactile server 30 stores a plurality of terminal type information and terminal identifiers, stores a plurality of sample tactile data groups in association with terminal type information, and stores a plurality of evaluation result groups in association with terminal identifiers. To do. When the tactile server 30 receives the terminal type information “type A” from the portable information terminal 10a, the tactile server 30 reads the sample tactile data group associated with the terminal type information “type A”, and carries the read sample tactile data group. Correction is performed based on the evaluation result group associated with the terminal identifier of the information terminal 10a. Then, the tactile server 30 transmits the corrected sample tactile data group to the portable information terminal 10a (step 2). Thereafter, the portable information terminal 10a sequentially generates vibrations based on the corrected sample tactile data group received from the tactile server 30 and presents the operator with a tactile sensation. The operator selects the tactile number of one sample tactile data from the sample tactile data group based on the vibration sequentially generated by the portable information terminal 10a. After that, the portable information terminal 10a displays Web page information in which the image data A (display information), the tactile number “1a” (vibration information) of the selected sample tactile data, and the terminal type information “type A” are associated with each other. Upload to the Web server 20 (step 3).

  FIG. 13 is an explanatory diagram of an operation of accessing the Web page information of the haptic service system 1. FIG. 14 is a sequence diagram showing an access operation to the Web page information of FIG. In the access operation to the web page information, the mobile information terminal 10b of the terminal type “type B” accesses the web page information uploaded by the mobile information terminal 10a in the upload operation of FIG. Therefore, first, the portable information terminal 10b transmits the terminal type information “type B” and the terminal identifier “identifier B” (terminal information) of the portable information terminal 10b to the tactile server 30 (step 4). Furthermore, the portable information terminal 10b transmits an access request to the web page information stored in the web server 20 to the tactile server 30 (step 5).

  When receiving the access request from the portable information terminal 10b, the tactile server 30 acquires the Web page information from the Web server 20 (step 6). Next, the tactile server 30 determines the tactile number “1a” and the terminal type information “type A” included in the Web page information acquired from the Web server 20 based on the terminal type information “type B” of the portable information terminal 10 b. Each is converted into a tactile number “1b” and terminal type information “type B”. Furthermore, the tactile server 30 corrects the tactile signal “S (1b)” corresponding to the converted tactile number “1b” based on the evaluation result corresponding to the terminal identifier “identifier B”. The tactile server 30 replaces the tactile number “1b” included in the Web page information with the corrected tactile signal “Srev”. Thereafter, the tactile server 30 transmits Web page information in which the image data A (display information), the corrected tactile signal “Srev” (vibration information), and the terminal type information “type B” are associated with each other to the portable information terminal 10 b. (Step 7). The portable information terminal 10b displays the image data A based on the Web page information received from the tactile server 30 and generates vibration based on the tactile signal “Srev” to present a tactile sensation to the operator.

  Next, with reference to FIGS. 15-17, the structure of the portable information terminal 10a, 10b and the tactile server 30 which comprise the tactile service system 1 which concerns on 2nd Embodiment is demonstrated. In the description of FIGS. 15 to 17, the description will focus on the parts different from FIGS. 4 to 6 described in the first embodiment, and the detailed description of the other parts will be omitted. FIG. 15 is a functional block diagram illustrating a configuration of a main part of the portable information terminals 10a and 10b. Since the portable information terminals 10a and 10b can have the same configuration, they are shown as the portable information terminal 10 in FIG. The portable information terminal 10 in FIG. 15 is different from the portable information terminal 10 in FIG. 4 in that it further includes a tactile output measuring unit 109.

  When the vibration generation unit 107 generates vibration on the touch surface of the touch sensor 101 or the housing of the portable information terminal 10, the tactile output measurement unit 109 measures a tactile output such as voltage, current, or frequency. The tactile output measuring unit 109 is constituted by, for example, a piezoelectric element or a strain gauge sensor.

  When receiving the capability evaluation request from the tactile server 30, the control unit 105 performs a tactile output capability evaluation using the vibration generation unit 107 and the tactile output measurement unit 109, and transmits an evaluation result group to the tactile server 30.

  FIG. 16 is a configuration diagram showing an example of a mounting structure of the portable information terminal 10 of FIG. 16A is a cross-sectional view of a main part, and FIG. 16B is a plan view of the main part. The portable information terminal 10 in FIG. 16 is different from the portable information terminal 10 in FIG. 5 in that the tactile output measurement unit 109 is provided. The vibration generating unit 107 and the tactile output measuring unit 109 are made of piezoelectric elements, and are provided on the surface of the touch sensor 101 by adhesion or the like in the vicinity of one side covered with the upper cover 122. When vibration is generated on the touch surface 101a of the touch sensor 101 by the vibration generation unit 107, the tactile output measurement unit 109 outputs a voltage value as a measurement value based on the deflection generated in the touch sensor 101 due to the vibration.

  FIG. 17 is a functional block diagram illustrating a configuration of a main part of the tactile server 30. The tactile server 30 in FIG. 17 is different from the tactile server 30 in FIG. 6 in that the control unit 302 further has a function of the vibration information correcting unit 312.

  The terminal information database 303 stores a plurality of terminal type information of the portable information terminal 10. The terminal information database 303 stores a plurality of evaluation input signal groups and vibration reference values in association with terminal type information. The evaluation input signal is, for example, a signal such as current, voltage, frequency, amplitude, or waveform pattern. Further, when the terminal information database 303 receives the terminal identifier and the evaluation result group from the portable information terminal 10, the terminal information database 303 stores the received terminal identifier and the evaluation result group in association with each other and updates the evaluation date to store in association with the terminal identifier. To do.

  The vibration information correction unit 312 of the control unit 302 reads out a haptic signal corresponding to the haptic number included in the web page information acquired by the control unit 302 from the web server 20 from the haptic database 304 and requests access to the web page information. The evaluation result group corresponding to the transmitted terminal identifier of the portable information terminal 10 is read from the terminal information database 303. Then, the vibration information correction unit 312 corrects the tactile signal read from the tactile database 304 with this evaluation result group. This correction process will be described in detail later.

  Next, the ability evaluation operation will be described in more detail with reference to FIGS. FIG. 18 is a sequence diagram showing a capability evaluation operation of the haptic service system 1 according to the second embodiment. FIG. 19 is a flowchart showing processing of the tactile server 30 in the ability evaluation operation of FIG. This capability evaluation operation is started when a terminal identifier is transmitted as an access request from the portable information terminal 10 to the tactile server 30. In addition, since all the portable information terminals 10a and 10b perform capability evaluation operation | movement, it shows as the portable information terminal 10 in FIG.

  In FIG. 19, first, when a terminal identifier is received from the portable information terminal 10 (step S90), the control unit 302 of the tactile server 30 determines whether or not this terminal identifier is stored in the terminal information database 303 (step S91). ). When this terminal identifier is not stored in the terminal information database 303 in step S91, the tactile server 30 further sends a terminal type request from the transmission / reception unit 301 to the portable information terminal 10 in order to obtain terminal type information from the portable information terminal 10. (Step S92). When receiving the terminal type request from the tactile server 30, the portable information terminal 10 transmits the terminal type information to the tactile server 30 in association with the terminal identifier. After step S92, when the transmission / reception unit 301 receives the terminal type information and the terminal identifier from the portable information terminal 10, the control unit 302 registers the terminal type information in the terminal information database 303 in association with the terminal identifier (step S93). ). After step S93, the controller 302 proceeds to step S94.

  On the other hand, when the terminal identifier received in step S90 is stored in the terminal information database 303 in step S91, the tactile server 30 determines whether or not the evaluation date corresponding to this terminal identifier is stored in the terminal information database 303. Is determined (step S97). If the evaluation date corresponding to the terminal identifier is not stored in the terminal information database 303 in step S97, the control unit 302 proceeds to step S94.

  On the other hand, when the evaluation date corresponding to the terminal identifier received in step S90 is stored in the terminal information database 303, the control unit 302 takes the difference between the current date and the evaluation date and obtains the number of days elapsed from the evaluation date. (Step S98). Next, the control unit 302 determines whether or not the elapsed days obtained in step S98 is smaller than the first threshold (step S99), and if the elapsed days is greater than or equal to the first threshold, the process proceeds to step S94. On the other hand, if the number of days elapsed is smaller than the first threshold value in step S99, the process proceeds to step S100.

  In step S94, the control unit 302 of the tactile server 30 transmits a capability evaluation request from the transmission / reception unit 301 to the portable information terminal 10 (step S94). This capability evaluation request includes an evaluation input signal group corresponding to the terminal type information of the portable information terminal 10. When receiving the capability evaluation request from the tactile server 30, the portable information terminal 10 performs capability evaluation based on the evaluation input signal group included in the capability evaluation request, and transmits the evaluation result group to the tactile server 30 in association with the terminal identifier. To do.

  After receiving the evaluation result group and the terminal identifier from portable information terminal 10 after step S94, control unit 302 of tactile server 30 registers the evaluation result group in association with the terminal identifier in terminal information database 303 (step S95). ). Thereafter, the control unit 302 updates the evaluation date to the current date, registers the updated evaluation date in the terminal information database 303 in association with the terminal identifier (step S96), and then ends the process.

  In step S100, the control unit 302 determines whether or not the elapsed days obtained in step S98 is smaller than a second threshold value (second threshold value <first threshold value) (step S100). When the elapsed days are equal to or greater than the second threshold value in step S100, the control unit 302 transmits a capability evaluation reservation request from the transmission / reception unit 301 to the portable information terminal 10 (step S101). This capability evaluation reservation request includes an evaluation input signal group corresponding to the terminal type information of the portable information terminal 10. When the portable information terminal 10 receives the ability evaluation reservation request from the tactile server 30, it performs the ability evaluation after the operator has not operated for a predetermined time or more, and thereafter, the evaluation result group and the evaluation date are displayed. The data is temporarily stored in the storage unit 108. Thereafter, when the mobile information terminal 10 transmits an access request to the tactile server 30, the evaluation result group and the evaluation date are read from the storage unit 108, and are associated with the terminal identifier and transmitted to the tactile server 30. Thereafter, the portable information terminal 10 deletes the evaluation result group and the evaluation date from the storage unit 108.

  When the control unit 302 of the tactile server 30 receives the evaluation result group, the evaluation date, and the terminal identifier from the portable information terminal 10 in the transmission / reception unit 301 after step S101, the control result 302 stores the evaluation result group and the evaluation date in the terminal information database 303. Registration is performed in association with the terminal identifier (step S102), and then the process ends.

  On the other hand, if it is determined in step S100 that the number of elapsed days obtained in step S98 is smaller than the second threshold, the control unit 302 ends the process without transmitting a capability evaluation request to the portable information terminal 10.

  Here, with reference to FIG. 20, the capability evaluation performed by the portable information terminal 10 in the capability evaluation operation of FIG. 19 will be described. FIG. 20 is an explanatory diagram of an evaluation input signal group used when the portable information terminal 10 performs capability evaluation. In FIG. 20, the rows corresponding to “type 0” to “type n” correspond to the evaluation input signals, respectively. In the example of FIG. 20, each evaluation input signal includes a waveform pattern and a voltage value. “Waveform pattern 0” to “waveform pattern n” are composed of voltage waveforms having different frequencies. “Voltage 0” to “voltage n” mean the amplitudes of “waveform pattern 0” to “waveform pattern n”, respectively.

  Then, when receiving the evaluation input signal group of FIG. 20 from the tactile server 30, the control unit 105 of the portable information terminal 10 first sequentially inputs the evaluation input signal group to the vibration generation unit 107 and causes the vibration generation unit 107 to vibrate. Generate sequentially. Then, based on the vibrations sequentially generated by the vibration generation unit 107, the tactile output measurement unit 109 sequentially outputs voltage values as measurement values. The control unit 105 transmits the measurement value group sequentially output by the tactile output measurement unit 109 to the tactile server 30 as an evaluation result group.

  Next, the Web page information upload operation of FIG. 12 will be described in more detail with reference to the flowchart shown in FIG. As described above, the portable information terminal 10a can upload display information such as image data or character string data and vibration information in association with each other as Web page information. Hereinafter, the process of the portable information terminal 10a when uploading image data and vibration information in association with each other will be described with reference to FIG.

  When the display information is image data, as shown in FIG. 21, first, when the operator makes a request for uploading image data to the portable information terminal 10a, the control unit 105 prompts the operator to capture an image. . Then, the control unit 105 captures an image of the external object A by the imaging unit 102 in accordance with the operation of the operator, and acquires the image data A (step S110).

  Next, the control unit 105 determines whether or not there is a tactile sense setting request from the operator (step S111). If there is no tactile setting request from the operator, the control unit 105 uploads the image data A as Web page information from the transmission / reception unit 104 to the Web server 20 (step S112), and ends the process.

  On the other hand, when there is a tactile sense setting request from the operator in step S111, the control unit 105 prompts the operator to input a keyword related to the image data A. When the keyword is input by the operator (step S113), the control unit 105 sets the terminal type information “type A”, the terminal identifier “identifier A” of the portable information terminal 10a, and the keyword input in step S113. Then, the data is transmitted from the transmission / reception unit 104 to the tactile server 30 (step S114).

  After step S114, when the tactile server 30 receives the terminal type information “type A”, the terminal identifier “identifier A”, and the keyword from the portable information terminal 10a, the tactile server 30 starts the already described capability evaluation operation process of FIG. . 19, when the evaluation result group corresponding to the terminal identifier “identifier A” is not registered in the terminal information database 303, or even if the evaluation result group is registered, the number of elapsed days from the update date is When it is equal to or greater than the second threshold, the tactile server 30 transmits a capability evaluation request or a capability evaluation reservation request to the portable information terminal 10a. Thereafter, when the tactile server 30 receives the evaluation result group of the capability evaluation from the portable information terminal 10, the tactile server 30 associates it with the terminal identifier “identifier A” and registers it in the terminal information database 303.

  The tactile server 30 reads a sample tactile data group corresponding to the terminal type information “type A” from the tactile database 304 based on the terminal type information “type A” received from the portable information terminal 10 a. Further, the tactile server 30 extracts a sample tactile data group related to this keyword from the sample tactile data group corresponding to the terminal type information “type A”. Thereafter, the tactile server 30 reads the evaluation result group corresponding to the terminal identifier “identifier A” from the terminal information database 303, and corrects each tactile signal of the extracted sample tactile data group based on the evaluation result group. Then, the tactile server 30 transmits a sample tactile data group in which each corrected tactile signal is associated with a tactile number to the portable information terminal 10a.

  On the other hand, after step S114, the control unit 105 of the portable information terminal 10a determines whether the transmission / reception unit 104 has received a capability evaluation request or a capability evaluation reservation request from the tactile server 30 (step S115). When the capability evaluation request or the capability evaluation reservation request is received in step S115, the control unit 105 executes the capability evaluation and transmits the evaluation result group to the tactile server 30 (step S116). After step S116, the portable information terminal 10a receives the corrected sample tactile data group from the tactile server 30 (step S117), and proceeds to step S118. On the other hand, when the ability evaluation request or the ability evaluation reservation request is not received in step S115, the control unit 105 receives the corrected sample tactile data group without executing the ability evaluation (step S117), Proceed to step S118.

  In step S118, while the operator's finger or the like is touching the touch sensor 101, the control unit 105 causes the vibration generation unit 107 to sequentially generate vibration based on the tactile signal of each sample tactile data (step S118). Here, the operator searches for vibrations to be set for the image data A while feeling the vibrations sequentially generated from the vibration generation unit 107 with a finger or the like through the touch sensor 101, and if found, a sample corresponding to the vibrations is found. Select the tactile number of the tactile data. For example, if there is a vibration closest to the touch of the object A indicated by the image data A among the vibrations felt through the touch sensor 101, the operator selects the tactile number of the sample tactile data corresponding to the vibration.

  After step S118, the control unit 105 determines whether or not the operator has selected the tactile number of the sample tactile data to be set for the image data A (step S119). In step S119, when the tactile number is not selected because the operator has not found vibration to set for the image data A, the control unit 105 transmits and receives the image data A as Web page information. Upload from the unit 104 to the Web server 20 (step S120), and the process ends.

  On the other hand, when the operator selects a tactile number for setting with respect to the image data A in step S119, the control unit 105 displays the image data A, the selected tactile number “1a”, and the terminal of the portable information terminal 10a. The type information “type A” is uploaded as web page information from the transmission / reception unit 104 to the web server 20 (step S121), and the process ends.

  When the operator inputs a keyword related to the image data A in step S113, the portable information device 10a acquires only the sample tactile data group related to the image data A in step S115. Thereby, it is possible to efficiently search for vibrations for the operator to set in the image data A.

  Note that the processing of the portable information terminal 10a when uploading the character string data and the vibration information in association with each other is based on replacing step S36 in FIG. 8 with the processing in steps S115 to S117 in FIG. Description is omitted.

  Next, an access operation to the Web page information of FIG. 13 will be described with reference to FIG. Hereinafter, the processing of the tactile server 30 in the operation of accessing the Web page information will be described with reference to FIG. Note that the processing of the portable information terminal 10b in the operation of accessing the Web page information is the same as that of the first embodiment shown in FIG. 9, and thus detailed description thereof is omitted.

  FIG. 22 is a flowchart showing processing of the tactile server 30 in the access operation to the Web page information of FIG. First, when the control unit 302 of the tactile server 30 receives the terminal type information “type B” and the terminal identifier “identifier B” from the portable information terminal 10b by the transmission / reception unit 301 (step S130), the control unit 302 associates them with the terminal information database. It registers in 303. Further, the tactile server 30 starts the processing of the ability evaluation operation of FIG. 19 already described (step S131). Then, by the processing of FIG. 19, when the evaluation result group corresponding to this terminal identifier “identifier B” is not registered in the terminal information database 303, or even if the evaluation result group is registered, the number of days elapsed from the update date is When it is equal to or greater than the second threshold, the tactile server 30 transmits a capability evaluation request or a capability evaluation reservation request to the portable information terminal 10a. After that, when the tactile server 30 receives the evaluation result group of the capability evaluation from the portable information terminal 10, it registers this in the terminal information database 303.

  Next, when the transmission / reception unit 301 receives an access request to the Web page from the portable information terminal 10b (Step S132), the control unit 302 acquires information on the Web page from the Web server 20 (Step S133). Next, the web page analysis unit 310 of the control unit 302 analyzes the web page information acquired in step S133 and determines whether or not a tactile number is included (step S134).

  In step S134, when the tactile number is not included in the web page information, the control unit 302 transmits the web page information from the transmission / reception unit 301 to the portable information terminal 10b (step S135), and ends the process.

  On the other hand, when the tactile number is included in the web page information in step S134, the web page analysis unit 310 reads the terminal type information “type B” of the portable information terminal 10b received in step S130 from the terminal information database 303. . Then, the web page analysis unit 310 determines whether or not the read terminal type information “type B” matches the terminal type information included in the web page information (step S136). When the terminal type information matches in step S136, the vibration information correction unit 312 of the control unit 302 next detects the haptic signal S (1b) corresponding to the haptic number “1b” included in the Web page information from the haptic database 304. And an evaluation result group corresponding to the terminal identifier “identifier B” of the portable information terminal 10 b is read from the terminal information database 303. Then, the vibration information correction unit 312 corrects the tactile signal S (1b) based on the evaluation result group (step S137), and replaces the tactile number “1b” of the Web page information with the corrected tactile signal Srev. Thereafter, the control unit 302 transmits Web page information in which the image data A, the corrected tactile signal Srev, and the terminal type information “type B” are associated with each other from the transmission / reception unit 301 to the portable information terminal 10b (step S135). The process is terminated.

  On the other hand, when the terminal type information “type B” of the portable information terminal 10b does not match the terminal type information included in the Web page information in step S136, the vibration information conversion unit 311 of the control unit 302 determines that the terminal of the portable information terminal 10b. Based on the type information “type B”, the tactile number “1a” of the Web page information and the terminal type information “type A” are converted (step S138). Here, the vibration information conversion unit 311 first reads a sample tactile data group associated with the terminal type information “type B” of the portable information terminal 10b from the tactile database 304, and selects a Web page from the sample tactile data group. The tactile number “1b” corresponding to the tactile number “1a” included in the information is read out. Then, the vibration information conversion unit 311 replaces the tactile number “1a” included in the Web page information with the tactile number “1b” read from the tactile database 304. Further, the vibration information conversion unit 311 replaces the terminal type information “type A” included in the Web page information with the terminal type information “type B” of the portable information terminal 10 b.

  After step S138, the vibration information correction unit 312 of the control unit 302 reads out the haptic signal S (1b) corresponding to the haptic number “1b” included in the Web page information from the haptic database 304 and carries it from the terminal information database 303. An evaluation result group corresponding to the terminal identifier “identifier B” of the information terminal 10b is read. Then, the vibration information correction unit 312 corrects the tactile signal S (1b) based on the evaluation result group (step S137), and replaces the tactile number “1b” of the Web page information with the corrected tactile signal Srev. Thereafter, the control unit 302 transmits Web page information in which the image data A, the corrected tactile signal Srev, and the terminal type information “type B” are associated with each other from the transmission / reception unit 301 to the portable information terminal 10b (step S135). The process is terminated.

Here, an example of correction of the tactile signal performed by the vibration information correction unit 312 will be described. Assume that the vibration reference value of the output voltage value from the tactile output measuring unit 109 is Ob with respect to the input voltage value Ib to the vibration generating unit 107. On the other hand, the current portable information terminal 10b assumes that the output voltage value from the tactile output measurement unit 109 is On (On ≠ Ob) with respect to the input voltage value Ib to the vibration generation unit 107 due to secular change or the like. . Then, in order for the current portable information terminal 10b to output the vibration reference value Ob to the tactile output measuring unit 109, the following expression is established for the input voltage value In that needs to be input to the vibration generating unit 107. In the following formula, it is assumed that linearity is established.
Ob = F (Ib)
Ob = G (In)
This
In = G ⁻¹ (F (Ib))
Is obtained.

So, for example,
Ob = αIb
Ob = βIn
Assuming that
In = α / β × Ib
Is obtained. The vibration information correction unit 312 calculates the correction coefficient (correction information) α / β for each waveform pattern in FIG. 20 based on the evaluation result group received from the portable information terminal 10b.

Then, in step S137 of FIG. 22, the vibration information correction unit 312 outputs the corrected tactile signal Srev as follows.
Srev = α / β × S (1b)
Ask for.

  In the second embodiment, when the tactile server 30 transmits vibration information to the portable information terminal 10, if the performance of the portable information terminal 10 is degraded, the tactile output on the portable information terminal 10 is output. This vibration information is changed so as to satisfy a predetermined standard. Thereby, the difference in tactile output among a plurality of portable information terminals related to the same terminal type can be reduced.

  As described above, according to the present invention, it is possible to present a desired tactile sensation corresponding to vibration information without being affected by terminal type, individual difference, secular change, or the like.

  In addition, this invention is not limited only to the said embodiment, Many deformation | transformation or a change is possible. For example, the web server 20 can be removed from the haptic service system 1. In this case, first, the portable information terminal 10 transmits display information and terminal information (terminal type information or terminal identifier) to the tactile server 30. When the tactile server 30 receives the display information and the terminal information from the portable information terminal 10, the tactile server 30 generates vibration information (tactile number or tactile signal) based on the display information and the terminal information, and uses the vibration information as the portable information terminal. 10 to send. Here, the tactile server 30 stores, for example, vibration information associated with display information and terminal information in advance, and changes the stored vibration information as described in the first or second embodiment. And it transmits to the portable information terminal 10. Thereafter, when receiving the vibration information from the tactile server 30, the portable information terminal 10 displays the display information on the display unit 103 and receives an input via the touch sensor 101, based on the vibration information. Generate vibration.

  In the second embodiment, the tactile server 30 receives both the terminal type information and the terminal identifier from the portable information terminal 10, converts the vibration information based on the terminal type information, and corrects the vibration information based on the terminal identifier. I do. However, instead of this, the tactile server 30 may be configured to receive only the terminal identifier from the portable information terminal 10 and only correct the vibration information based on the terminal identifier. In this case, the terminal information database 303 of the tactile server 30 stores a plurality of evaluation input signal groups and vibration reference values in association with terminal identifiers.

  In the example of FIG. 20, the waveform pattern of the evaluation input signal is composed of a waveform of one frequency, but the waveform pattern can be composed of waveforms of a plurality of frequencies. When the waveform pattern is composed of waveforms having a plurality of frequencies, the vibration information correction unit 312 obtains a correction coefficient α / β for each frequency of each waveform constituting the waveform pattern. In step S137 of FIG. Based on the coefficient α / β, the tactile signal is corrected.

  Further, in the Web page information upload operation described with reference to FIG. 21, the tactile server 30 has the capability to the portable information terminal 10a in the predetermined case before transmitting the sample tactile data group to the portable information terminal 10a. The evaluation is executed, the sample tactile data group is corrected by the evaluation result group, and then transmitted to the portable information terminal 10a. However, the tactile server 30 can also transmit the sample tactile data group before correction and the ability evaluation request or ability evaluation reservation request together to the portable information terminal 10a. In this case, the portable information terminal 10 a sequentially generates vibrations based on the sample tactile data group received from the tactile server 30, executes capability evaluation, and transmits the evaluation result group to the tactile server 30. Thereby, it is possible to prevent the operator from waiting while the portable information terminal 10a performs the capability evaluation.

  Further, in the access operation to the Web page information described with reference to FIG. 22, the tactile server 30 has the capability to the portable information terminal 10b in the predetermined case described above before transmitting the Web page information to the portable information terminal 10b. The evaluation is executed, and the Web page information is corrected by the evaluation result group, and then transmitted to the portable information terminal 10b. However, the tactile server 30 can also transmit the Web page information before correction and the capability evaluation request or the capability evaluation reservation request together to the portable information terminal 10b. In this case, the portable information terminal 10 b generates vibration based on the Web page information from the tactile server 30, executes capability evaluation, and transmits the evaluation result group to the tactile server 30. Thereby, it is possible to prevent the operator from waiting while the portable information terminal 10b performs the capability evaluation.

  In the access operation to the Web page information described with reference to FIG. 2 and FIG. 13, the portable information terminal 10b acquires the vibration information from the Web server 20 via the tactile server 30 together with the display information. The vibration information and the display information can be acquired from different servers. In addition, when only the display information from the portable information terminal 10b is sufficient, access to the Web server 20 can be omitted.

  5 and 16, the vibration generating unit 107 is provided on the back surface of the touch sensor 101, but may be provided on the inner surface of the housing 120 instead. When the vibration generating unit 107 is provided on the inner surface of the housing 120, the vibration generating unit 107 vibrates the housing 120 to stimulate a tactile sensation such as an operator's finger that is in contact with the touch sensor 101, thereby generating a tactile sensation. Present.

  In the present invention, “vibration on the touch surface of the touch sensor by the vibration generation unit” may be any vibration that directly or indirectly vibrates the touch surface of the touch sensor. The portion 106 is a vibration motor (eccentric motor), and the touch surface 101a of the touch sensor 101 is directly vibrated, or the holding member that holds the touch sensor 101 and the casing 120 of the portable information terminal are vibrated to thereby change the touch surface 101a. You may comprise so that it may vibrate indirectly.

  The “accepting input with the touch sensor” in the present invention may be a case where the input is detected by detecting contact with the touch sensor 101 by the input object as in the first embodiment. In this embodiment, a load detection unit that detects a pressing load on the touch sensor 101 by an input target (such as a finger) is provided, and an input is received when the pressing load on the touch sensor 101 by the input target exceeds a predetermined load threshold. There may be.

  When receiving an input when the pressure load on the touch sensor 101 by the input object exceeds a predetermined load threshold, the portable information terminal 10 is provided with a load detection unit that detects the pressure load on the touch surface 101a of the touch sensor 101, When the pressing load detected by the load detection unit satisfies a predetermined criterion for receiving an input, the vibration generation unit 107 may generate vibration to the touch surface 101a. The load detection unit can be configured using an element that reacts linearly to a load such as a strain gauge sensor or a piezoelectric element. Further, when the vibration generating unit 107 is configured by a piezoelectric element provided in the touch sensor 101, the load detecting unit and the vibration generating unit 107 can be configured to share the piezoelectric element. This is because the piezoelectric element generates electric power when pressure is applied and deforms when electric power is applied. Alternatively, when the tactile output measuring unit 109 is provided as in the second embodiment, the tactile output measuring unit 109 can also be used as a load detecting unit. The time when the pressure load detected by the load detection unit satisfies the predetermined criterion for receiving input may be when the pressure load detected by the load detection unit reaches a predetermined value for receiving input. The pressing load detected by the load detection unit may exceed a predetermined value for receiving input, or may be when the predetermined value for receiving input is detected by the load detection unit.

  In addition, the touch sensor 101 and the display unit 103 can be configured as an integrated device by providing both functions of the touch sensor 101 and the display unit 103 on a common substrate. As an example of a configuration of the device in which both functions of the touch sensor 101 and the display unit 103 are integrated, a plurality of photoelectric conversion elements such as photodiodes are regularly arranged in a matrix electrode array of pixels included in a liquid crystal panel. Some are mixed. This device displays an image with a liquid crystal panel structure, while reflecting the light of a backlight for liquid crystal display at the tip of a pen that touches and inputs a desired position on the surface of the panel. The reflected light is reflected by peripheral photoelectric conversion elements. By receiving the light, the touch position can be detected.

DESCRIPTION OF SYMBOLS 1 Tactile service system 10a, 10b, 10 Portable information terminal 15a, 15b Wireless base station 20 Web server 30 Tactile server 40 Network 101 Touch sensor 101a Touch surface 102 Imaging part 103 Display part 104 Transmission / reception part 105 Control part 107 Vibration generation part 108 Storage Unit 109 haptic output measurement unit 110 web screen configuration unit 120 housing 121 insulator 122 upper cover 123 insulator 301 transmission / reception unit 302 control unit 303 terminal information database 304 haptic database 310 web page analysis unit 311 vibration information conversion unit 312 vibration information correction unit

Claims (11)

A display unit;
A touch sensor;
A vibration generator for vibrating the touch surface of the touch sensor;
A transceiver that communicates with the tactile server;
A control unit,
The controller is
Display information and terminal information are transmitted from the transceiver to the tactile server, and then
When the transmission / reception unit receives vibration information from the tactile server, the display information is displayed on the display unit, and when input is received via the touch sensor, the vibration generation unit generates vibration based on the vibration information. A portable information terminal characterized in that A display unit;
A touch sensor;
A vibration generator for vibrating the touch surface of the touch sensor;
A transceiver that communicates with the tactile server;
A control unit,
The controller is
The terminal information and the access request for the display information and the vibration information stored in the web server are transmitted from the transmission / reception unit to the tactile server, and then
When the transmission / reception unit receives the display information and the vibration information from the tactile server, the display information is displayed on the display unit, and when the input is received via the touch sensor, the vibration information is generated by the vibration generation unit. A portable information terminal characterized by generating vibration based on. A transceiver that communicates with the portable information terminal;
A control unit,
The controller is
When display information and terminal information are received from the portable information terminal by the transmission / reception unit, vibration information is generated based on the display information and the terminal information, and the vibration information is transmitted from the transmission / reception unit to the portable information terminal. A tactile server. A storage unit that stores a plurality of terminal type information in association with vibration information, respectively,
The terminal information includes terminal type information,
The controller is
When the display information and the terminal type information are received from the portable information terminal by the transmission / reception unit, vibration information is generated based on the display information, and the vibration information is associated with the terminal type information by the storage unit. The tactile server according to claim 3, wherein the tactile server converts the information into information and transmits the vibration information from the transmission / reception unit to the portable information terminal. The storage unit further stores an evaluation input signal and a vibration reference value for the evaluation input signal,
The terminal information includes terminal identification information,
The controller is
The evaluation input signal is transmitted from the transmission / reception unit to the portable information terminal, and then
When receiving the vibration measurement value and the terminal identification information from the portable information terminal in the transceiver unit, to generate correction information based on the evaluation input signal and the vibration measurement value,
When the display unit receives the display information and the terminal identification information from the portable information terminal, the transmission / reception unit generates vibration information based on the display information, and corrects the vibration information based on the correction information corresponding to the terminal identification information. The tactile server according to claim 4, wherein the vibration information is transmitted from the transmission / reception unit to the portable information terminal. A transceiver that communicates with the portable information terminal;
A storage unit for storing an evaluation input signal and a vibration reference value for the evaluation input signal;
When the display information and terminal information are received from the portable information terminal by the transmission / reception unit, vibration information is generated based on the display information and the terminal information, and the vibration information is transmitted from the transmission / reception unit to the portable information terminal. And comprising
The terminal information includes terminal identification information,
The controller is
The evaluation input signal is transmitted from the transmission / reception unit to the portable information terminal, and then
When receiving the vibration measurement value and the terminal identification information from the portable information terminal in the transceiver unit, to generate correction information based on the evaluation input signal and the vibration measurement value,
When the display unit receives the display information and the terminal identification information from the portable information terminal, the transmission / reception unit generates vibration information based on the display information, and corrects the vibration information based on the correction information corresponding to the terminal identification information. Then, the vibration information is transmitted from the transmission / reception unit to the portable information terminal. A transmission / reception unit communicating with the portable information terminal and the web server;
A control unit,
The controller is
When the terminal information and an access request for display information and vibration information stored in the Web server are received from the portable information terminal by the transmission / reception unit, the display information and the vibration information are acquired from the Web server,
The tactile server, wherein the display information and the vibration information are transmitted from the transmission / reception unit to the portable information terminal. A tactile service system comprising the portable information terminal according to claim 1 and the tactile server according to any one of claims 3 to 6,
The portable information terminal transmits display information and terminal information to the tactile server,
Upon receiving the display information and the terminal information from the portable information terminal, the tactile server generates vibration information based on the display information and the terminal information, and transmits the vibration information to the portable information terminal.
The portable information terminal displays the display information when receiving the vibration information from the tactile server, and generates vibration based on the vibration information when receiving an input to the portable information terminal. Service system. A tactile service system comprising the portable information terminal according to claim 2 and the tactile server according to claim 7,
The portable information terminal transmits the terminal information and an access request for display information and vibration information stored in the Web server to the tactile server,
Upon receiving the display information and the terminal information from the portable information terminal, the tactile server acquires the display information and the vibration information from the Web server, and sends the display information and the vibration information to the portable information terminal. Send
When the portable information terminal receives the display information and the vibration information from the tactile server, the portable information terminal displays the display information, and when receiving an input to the portable information terminal, generates a vibration based on the vibration information. Characteristic tactile service system. A communication method comprising the portable information terminal according to claim 1 and the tactile server according to any one of claims 3 to 6,
The portable information terminal transmitting display information and terminal information to the tactile server;
When the tactile server receives the display information and the terminal information from the portable information terminal, generates vibration information based on the display information and the terminal information, and transmits the vibration information to the portable information terminal; ,
When the portable information terminal receives the vibration information from the tactile server, the display information is displayed, and upon receiving an input to the portable information terminal, generating vibration based on the vibration information;
A communication method comprising: A communication method comprising the portable information terminal according to claim 2 and the tactile server according to claim 7,
The portable information terminal transmits the terminal information and an access request for display information and vibration information stored in the Web server to the tactile server;
When the tactile server receives the display information and the terminal information from the portable information terminal, it acquires the display information and the vibration information from the Web server, and sends the display information and the vibration information to the portable information terminal. Sending, and
When the portable information terminal receives the display information and the vibration information from the tactile server, the display information is displayed, and when an input to the portable information terminal is received, a vibration based on the vibration information is generated. ,
A communication method comprising:

Images