JP2012226480A - Communication terminal, server, tactile sensation feedback generation means, and communication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication terminal capable of displaying an image having a button area and tactile sensation information tied up by an analysis server even for image information in which a button area and tactile sensation information are not made to correspond to each other.SOLUTION: A communication terminal includes a display part 104, a touch sensor 106, a tactile sensation feedback generation part 110, a communication part 112, a control part 102, and an image constitution part 114 which displays image information with tactile sensation information at the display part 104 based upon image information with tactile sensation information received from the server through the communication part 112 and having the tactile sensation information given to the image information. The control part 102 controls the tactile sensation feedback generation part 110 so that the communication terminal 1 generate tactile sensation feedback once detecting input to a touch surface of the touch sensor 106 corresponding to the area to which the tactile sensation information is given in image information with tactile sensation information while the display part 104 displays the image information with the tactile sensation information.

Description

  The present invention relates to a communication terminal, a server, a haptic feedback generation method, and a communication system.

  In recent years, an increasing number of communication terminals such as mobile phones and game machines adopt a touch sensor as an interface for input by a user. The interface using the touch sensor has an advantage that the user can operate intuitively.

  In an interface using a touch sensor, a user operates a communication terminal by touching a button or the like displayed on the screen. However, since such a touch operation does not cause tactile feedback, it is difficult to determine whether or not the touched area is a button area.

  In addition, the button area may be hidden by the finger being operated, and the character string written in the button area may not be visible. In such a case, if a plurality of button areas are close to each other, a button different from the user's intention may be erroneously pressed. Thereby, for example, when the button pressed by mistake is a button related to a contract, there is a risk that the user will receive a large disadvantage.

  In order to give tactile feedback to a user, for example, a device that gives a tactile sensation such as a click feeling to a user's finger when a touch sensor receives an input has been proposed (for example, see Patent Document 1).

Japanese Patent No. 4633183

  According to the device disclosed in Patent Literature 1, when a touch operation on a button displayed on an interface using a touch sensor is received, vibration can be applied to a user's finger or the like. Accordingly, the user can obtain a feeling like a click feeling and can recognize the button area.

  In order to provide the vibration as described above, it is necessary to associate the operation button or the like in the image information displayed on the communication terminal with the vibration provided to the user. However, for example, when displaying a Web page as image information, it is not realistic to expect that vibration information is associated with all operation buttons of all Web pages. Therefore, when a user touches an operation button that is not associated with vibration information in the Web page, the user cannot obtain tactile feedback. In addition, although the Web page was mentioned as an example here as an example of the image information, the term “image information” is not limited to this, and means any information of an image that can be displayed on the communication terminal. To do.

  Therefore, an object of the present invention made in view of such a point is communication that can display an image in which a button area and tactile information are linked to image information in which the button area and tactile information are not associated with each other. The object is to provide a terminal, a server, a haptic feedback generation method, and a communication system.

The invention of the communication terminal according to the first aspect to achieve the above object is as follows:
A display unit;
A touch sensor disposed on the display unit;
A haptic feedback generator for generating haptic feedback;
A communication unit communicating with the server;
A control unit that controls the communication unit to transmit image information to be displayed on the display unit to the server;
An image configuration unit configured to display the image information with tactile information on the display unit based on the image information with tactile information added to the image information received from the server via the communication unit. ,
The control unit detects an input to the touch surface of the touch sensor corresponding to a region to which tactile information is given in the image information with tactile information while the display unit displays the image information with tactile information. The haptic feedback generation unit is controlled to generate haptic feedback for the communication terminal.

The invention according to the second aspect is the communication terminal according to the first aspect,
The control unit controls the communication unit to transmit image setting information of the display unit to the server together with the image information,
The image configuration unit displays the image information with tactile information on the display unit based on image information with tactile information obtained by adding tactile information to the image information based on the image information and the image setting information. It is characterized by.

The invention of the server according to the third aspect to achieve the above object is as follows:
A server that communicates with a communication terminal,
A communication unit communicating with the communication terminal;
Based on image information received from the communication terminal, an image analysis unit that generates image information with tactile information by associating tactile information with the image information;
And a control unit that controls the communication unit so as to transmit the image information with tactile information to the communication terminal.

The invention according to a fourth aspect is the server according to the third aspect,
The image analysis unit generates image information with tactile information by associating the tactile information with the image information based on the image information and the image setting information received from the communication terminal.

The invention according to a fifth aspect further includes a storage unit that stores tactile information corresponding to the type of the object in the server according to any one of the third and fourth aspects,
The image analysis unit generates the image information with tactile information based on tactile information corresponding to the type of the object.

  The invention according to a sixth aspect is that, in the server according to the fifth aspect, when tactile information corresponding to the type of the object is not stored in the storage unit, the control unit receives the object from the Web server. The communication unit is controlled to obtain tactile information corresponding to the type.

The invention according to a seventh aspect is the server according to any one of the third to sixth aspects,
The image analysis unit controls the communication unit to transmit the image information with tactile information to the communication terminal when the image information with tactile information is generated only for the display area of the communication terminal in the image information. And
Thereafter, image-tactile information with a tactile sensation for the remaining area of the image information is generated.

  As described above, the solution of the present invention has been described as an apparatus. However, the present invention can be realized as a method, a program, and a storage medium storing the program, which are substantially equivalent to these. It should be understood that these are also included.

For example, the invention of the haptic feedback generation method according to the eighth aspect of realizing the present invention as a method is as follows:
A tactile feedback generation method in a communication system including the communication terminal according to the first or second aspect and the server according to any one of the third to seventh aspects,
The communication terminal transmitting image information to the server;
The server generates image information with tactile information by associating tactile information with the image information based on the image information;
The server transmitting the image information with tactile information to the communication terminal;
Generating a haptic feedback to the communication terminal when the communication terminal detects an input to the communication terminal corresponding to a region to which the haptic information is given in the image information with the haptic information. .

Further, the invention of the communication system according to the ninth aspect, in which the present invention is realized as a communication system,
A communication system comprising a communication terminal according to the first or second aspect and a server according to any of the third to seventh aspects,
The communication terminal transmits image information to the server,
The server generates image information with tactile information by associating tactile information with the image information based on the image information,
The server transmits the image information with tactile information to the communication terminal,
When the communication terminal detects an input to the communication terminal corresponding to a region to which tactile information is given in the image information with tactile information, the communication terminal generates tactile feedback to the communication terminal.

  According to the present invention, it is possible to display an image in which a button region and tactile information are linked to image information in which the button region and tactile information are not associated with each other.

1 is a schematic configuration diagram of a communication system according to an embodiment of the present invention. It is a functional block diagram which shows schematic structure of the communication terminal shown in FIG. It is a schematic block diagram which shows a part of mounting structure of the communication terminal shown in FIG. It is a functional block diagram which shows schematic structure of the analysis server shown in FIG. It is a sequence diagram which shows operation | movement of the communication system shown in FIG. It is a figure which shows an example of the web page which the communication terminal shown in FIG. 1 displays. It is a figure which shows the partial area | region of the other example of the web page which the communication terminal shown in FIG. 1 displays. It is a figure which shows a mode that the communication terminal shown in FIG. 1 slide-operates a display area. It is a figure which shows a mode that the image information of the communication terminal shown in FIG. 1 is analyzed in steps. It is a flowchart which shows operation | movement of the analysis server shown in FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing a schematic configuration of a communication system according to an embodiment of the present invention. The communication terminal 1 communicates with the base station 5 by wireless communication and connects to the network 4 via the base station 5. Connected to the network 4 is a Web server 3 that is a server that provides information such as Web pages. The analysis server 2 is also connected to the network 4. The analysis server 2 associates the button area and the tactile information with respect to the web page provided by the web server 3 to be displayed by the communication terminal 1. In the present embodiment, the case where the communication terminal 1 and the base station 5 perform wireless communication is shown, but this is not limited to wireless communication, and wired communication may be used.

  FIG. 2 is a functional block diagram illustrating a schematic configuration of the communication terminal 1. The communication terminal 1 includes a control unit 102, a display unit 104, a touch sensor 106, a load detection unit 108, a tactile feedback generation unit 110, a communication unit 112, a screen configuration unit 114, and a storage unit 116.

  The control unit 102 controls and manages the entire communication terminal 1 including each functional unit of the communication terminal 1, and is configured by a suitable processor such as a CPU. The control unit 102 controls the communication unit 112 to transmit the image information and the image setting information to the analysis server 2. The image setting information includes information such as the type of browser that displays a Web page and the coordinates of an area (hereinafter referred to as “display area”) displayed on the display unit 104 among image information such as a Web page.

  The display unit 104 is configured by, for example, a liquid crystal display (LCD) or an organic EL display. On the front surface of the display unit 104, a touch sensor 106 that detects an input to the touch surface 106A (see FIG. 3) by a user's finger or the like is disposed.

  The touch sensor 106 detects an input by a finger or a stylus pen on the touch surface 106A, and outputs a known transparent two-dimensional position information such as a resistive film type, a capacitance type, and an optical type. It consists of a touch sensor and is arranged on the front surface of the display unit 104. The position information from the touch sensor 106 is supplied to the control unit 102. An object that contacts the touch surface 106A such as a user's finger or stylus is hereinafter referred to as an “input object”. Further, hereinafter, the user's finger is described as an example of the input target, but this is an example, and the input target is not limited to the user's finger. Note that it is not essential for the user's finger or the like to physically touch the touch sensor 106 when the touch sensor 106 detects an input. For example, when the touch sensor 106 is optical, the touch sensor 106 detects a position where infrared rays are blocked by a finger or the like, and therefore can detect an input even when there is no physical contact.

  The load detection unit 108 detects a pressing load on the touch surface 106A of the touch sensor 106, and is configured using, for example, a piezoelectric element, a strain gauge sensor, or the like. The load detection unit 108 outputs detected pressure load data to the control unit 102. For example, when both the haptic feedback generation unit 110 and the load detection unit 108 are configured using piezoelectric elements, the haptic feedback generation unit 110 and the load detection unit 108 can be configured integrally with a common piezoelectric element. . This is because the piezoelectric element has a property of generating electric power when pressure is applied and deforming when electric power is applied. The “detection of input” in the present invention may be a case where the touch of the input object to the touch sensor 106 is detected, and when the pressing load on the touch sensor 106 by the input object exceeds a predetermined load threshold. It may be a case of detection.

  The haptic feedback generation unit 110 transmits haptic feedback to the touch surface 106A of the touch sensor 106, and is configured using, for example, a piezoelectric element or an ultrasonic transducer. When the tactile feedback generation unit 110 vibrates, tactile feedback can be given to the finger of the user who is touching or pressing the touch sensor 106. Note that the haptic feedback generation unit 110 according to the present invention only needs to vibrate the touch surface 106A of the touch sensor 106 directly or indirectly. For example, the haptic feedback generation unit is a vibration motor (eccentric motor), and touch. The touch surface 106A of the sensor 106 may be directly vibrated, or the touch surface 106A may be indirectly vibrated by vibrating the holding member that holds the touch sensor 106 or the housing of the communication terminal. .

  In addition, the tactile feedback generation unit 110 gives different tactile feedback to the user's finger when the control unit 102 changes the drive voltage applied to the piezoelectric element. The control unit 102 can change the frequency, amplitude, waveform, and the like of the drive voltage. The frequency and amplitude can be changed in magnitude, and the waveform can be a sine wave, a rectangular wave, a triangular wave, or the like.

  The communication unit 112 is connected to the network 4 via the base station 5 and executes data transmission / reception with the analysis server 2.

  The image configuration unit 114 configures an image displayed by the display unit 104 based on image information with tactile information received from the analysis server 2 via the communication unit 112 (hereinafter referred to as “image information with tactile information”).

  The storage unit 116 stores information obtained by associating the haptic information received from the analysis server 2 with the vibration information presented by the haptic feedback generation unit 110. Here, the vibration information is defined by a vibration method (frequency, phase, vibration interval, number of vibrations, etc.), vibration intensity (amplitude, etc.), and the like. The storage unit 116 also functions as a work memory.

  FIG. 3 shows a schematic configuration example of the mounting structure of the touch sensor 106, the tactile feedback generation unit 110, and the display unit 104 shown in FIG. 2. FIG. 3 (a) is a cross-sectional view of the main part, and FIG. These are the principal part top views. The display unit 104 is housed and held in the housing 61. A touch sensor 106 is held on the display unit 104 via an insulator 62 made of an elastic member. Note that the touch sensor 106 is held on the display unit 104 via insulators 62 arranged at four corners outside the display area A of the display unit 104 indicated by virtual lines in FIG.

  The casing 61 is provided with an upper cover 63 so as to cover the surface area of the touch sensor 106 that is out of the display area A of the display unit 104. An elastic member is provided between the upper cover 63 and the touch sensor 106. A dustproof insulator 64 is provided.

  In the touch sensor 106, when the surface member having the touch surface 106A is made of, for example, a transparent film or glass, the back surface member is made of glass or acrylic, and the touch surface 106A is pressed via the insulator 64, The pressing portion is bent (distorted) by a small amount in accordance with the pressing force, and the entire touch sensor 106 including the back member is bent by a small amount.

  The tactile feedback generation unit 110 includes two piezoelectric elements 71. The piezoelectric element 71 is mounted on the back surface of the touch sensor 106 in the vicinity of the two opposing sides covered by the upper cover 63 so as to bend and displace the touch sensor 106. The piezoelectric element 71 is preferably attached to the touch sensor 106 so that the bending direction of the touch sensor 106 when pressed and the bending direction of the piezoelectric element 71 coincide. In FIG. 3, since the touch sensor 106 has a rectangular shape in plan view, the two piezoelectric elements 71 are mounted along the long sides in the vicinity of the two long sides facing each other. In FIG. 3B, the casing 61, the upper cover 63, and the insulator 64 shown in FIG. 3A are not shown.

  FIG. 4 is a functional block diagram illustrating a schematic configuration of the analysis server 2. The analysis server 2 includes a control unit 202, a page management unit 204, an image analysis unit 206, a terminal screen configuration unit 208, a communication unit 210, a terminal information management unit 212, and a storage unit 214.

  The control unit 202 controls and manages the entire analysis server 2 including each function unit of the analysis server 2, and is configured by a suitable processor such as a CPU.

  The page management unit 204 stores and manages information on Web pages that have already been analyzed by the image analysis unit 206.

  The image analysis unit 206 analyzes image information displayed on the display unit 104 by the communication terminal 1 such as a Web page, for example, and associates button areas with tactile information. Details will be described in some embodiments described later.

  The terminal screen configuration unit 208 configures a pseudo image of an image displayed on the display unit 104 by the communication terminal 1 based on the image information and the image setting information from the communication terminal 1. The image analysis unit 206 analyzes the image based on the pseudo image configured by the terminal screen configuration unit 208.

  The communication unit 210 is connected to the network 4 and executes data transmission / reception with the communication terminal 1 and the Web server 3.

  The terminal information management unit 212 manages information on the communication terminal 1. The terminal information management unit 212 stores an ID (identifier) assigned to each of a plurality of communication terminals 1 and image setting information in association with each other.

  The storage unit 214 stores tactile information associated with character strings, image types (hereinafter referred to as “objects”), and the like. The tactile information can be in accordance with the contents of the character string and give intuitive tactile feedback to the user. For example, when the character string is an important character string such as “agree and download”, tactile information that makes a warning image feel can be associated. The storage unit 214 also functions as a work memory.

  If the tactile information corresponding to the object in the image information received from the communication terminal 1 is not stored in the storage unit 214, the control unit 202 requests the tactile information corresponding to the object from the Web server.

  The operation of the communication system shown in FIG. 1 will be described below with reference to the sequence diagram shown in FIG.

  The communication terminal 1 transmits image setting information to the analysis server 2. The analysis server 2 stores the received image setting information in the terminal information management unit 212 in association with the ID of the communication terminal 1 (hereinafter referred to as “terminal ID”) (step S101).

  The communication terminal 1 transmits a Web page display request to the analysis server 2 (step S102). The analysis server 2 stores the web page in association with the terminal ID in the page management unit 204, and requests the web server 3 for data on the web page (step S103). The analysis server 2 receives the data of the web page from the web server (step S104). If the image information and the image setting information of the communication terminal 1 are information that can be analyzed by the image analysis unit 206, Step S103 and Step S105 can be omitted.

  When the analysis server 2 receives the Web page data from the Web server 3, the terminal screen configuration unit 208 configures the Web page based on the image setting information acquired from the communication terminal 1 in step S101. The image analysis unit 206 analyzes the position, shape, type, and the like of the button area on the Web page based on the configured Web page, and adds tactile information to the image information displayed by the communication terminal 1 (Step S105). ). The analysis server 2 transmits the image information with tactile information to the communication terminal 1 (step S106).

  When the communication terminal 1 receives image information with tactile information from the analysis server 2, the image forming unit 114 configures a display screen based on the image information with tactile information. The display unit 104 displays the display screen configured by the image configuration unit 114. When the touch sensor 106 detects an input to the button area, the haptic feedback generation unit 110 presents the haptic feedback to the input target based on the haptic information associated with the button area (step S107).

  The communication terminal 1 transmits the updated image setting information to the analysis server 2 when the image setting information is updated such as enlargement / reduction of the display area or change of the character font used for display ( Step S108). Upon receiving the updated image setting information, the analysis server 2 analyzes the button area in the display image again and updates the image information with tactile information (step S109). The analysis server 2 transmits the updated image information with tactile information to the communication terminal 1 (step S110).

  Next, the operation of the image analysis unit 206 of the analysis server 2 will be described with reference to the Web page shown in FIG.

  The portion shown as source 1 shows the source corresponding to the button “news” in the web page. The portion indicated as source 2 indicates the source corresponding to the button “software download” in the Web page.

  The image analysis unit 206 analyzes the description content of the source 1 and determines that the character string “news” is displayed in this button area. The image analysis unit 206 reads the tactile information corresponding to the character string “news” from the storage unit 214 and associates it with the button area displayed as “news”.

  The image analysis unit 206 analyzes the description content of the source 2 to determine that an image (support_01.jpg) is displayed in this button area and a character string “software download” is displayed. To do. The image analysis unit 206 reads the haptic information corresponding to the “image (support_01.jpg)” or the haptic information corresponding to the character string “software download” from the storage unit 214, and stores any haptic information in the button area. Associate with.

  When a plurality of objects are displayed on the same button as described above, the image analysis unit 206 assigns priorities to associate the tactile information of any object with the button area. For example, when only one of the tactile information exists, the image analysis unit 206 associates the tactile information of the object having the tactile information with the button area. When there are a plurality of tactile information, the image analysis unit 206 can give priority to a character string over an image, or give priority to an object with a high recognition rate of matching, for example. Here, “matching” refers to calculating the recognition rate by comparing the object in the button area with the object in the storage unit 214.

  When determining whether or not tactile information corresponding to an object such as a character string or an image is stored in the storage unit 214, the image analysis unit 206 determines whether or not the recognition rate exceeds a predetermined threshold. Can do.

  FIG. 7 shows a partial region of another example of the Web page. The portion indicated as source 3 indicates the source corresponding to the button “Agree and Download” in the Web page. The user needs to make a more cautious decision when pressing the button that displays “Agree and Download” than when the button that displays “News”. Therefore, a high-priority character string such as “agree and download” is associated with tactile information that prompts the user to pay attention (for example, tactile information that feels a stimulus such as strong vibration) in the storage unit 214. It is desirable to be memorized. In this way, when the user touches the area where the button “Agree and Download” is displayed on the display unit 104, the haptic feedback generation unit 110 provides haptic feedback that calls attention such as strong vibration. The user can be alerted to pressing the button.

  FIG. 8 is a diagram illustrating a state where the user performs a slide operation on the display unit 104 of the communication terminal 1. In FIG. 8A, the user places his / her finger on the display unit 104 to such an extent that the user does not press it, and slides the screen in the upper left direction as shown in FIG. 8B. FIG. 8C shows the entire Web page, of which the area indicated by symbol a is the display area before the slide operation shown in FIG. 8A, and the area indicated by symbol b is FIG. 8B. It is the display area after the slide operation shown.

  When the user performs a slide operation from the display in FIG. 8A to the display in FIG. 8B, the control unit 102 transmits image setting information updated with the slide to the analysis server 2. When the analysis server 2 receives the updated image setting information, the image analysis unit 206 associates tactile information with the button area based on the coordinate information in the received image setting information. The control unit 202 transmits the updated image information with tactile information to the communication terminal 1 via the communication unit 210.

  FIG. 9 shows how the area to be analyzed is gradually expanded when the image analysis unit 206 analyzes the image of the Web page.

  In FIG. 9, the area indicated by the symbol α is a display area in the image setting information received from the communication terminal 1. The image analysis unit 206 first generates image information with haptic information in which the button region and the haptic information are associated with each other only for the region α, and the control unit 202 transmits the image information with haptic information to the communication terminal 1. .

  After that, the image analysis unit 206 gradually expands the area to be analyzed to areas β and γ. By doing so, it is possible to speed up the response when the communication terminal 1 first displays the Web page. After that, even if the display area of the communication terminal 1 is moved by a slide operation or expanded due to enlargement, the image analysis unit 206 responds without significant delay because the analysis of the entire Web page is recommended in advance. be able to.

  FIG. 10 is a flowchart showing the operation of the analysis server 2.

  The communication terminal 1 requests access to the web page (step S201). The page management unit 204 determines whether or not the URL of the Web page requested for access is stored in the page management unit 204 (step S202). If the page management unit 204 determines Yes in step S202, the page management unit 204 determines whether the source of the URL is the same as the source stored in the page management unit 204 (step S203).

  If the page management unit 204 determines Yes in step S203, the page management unit 204 executes matching processing based on the source stored in the page management unit 204 (step S204). The page management unit 204 determines whether the matching result exceeds a predetermined threshold (step S205). When the page management unit 204 determines Yes in step S205, the control unit 202 transmits image information with tactile information to the communication terminal 1 via the communication unit 210 (step S208).

  When it is determined No in step S202, when it is determined No in step S203, and when it is determined No in step S205, the image analysis unit 206 executes matching processing from a character type having high importance. (Step S206) and stored in the page management unit 204 (Step S207). The control unit 202 executes step S208 following step S207.

  As described above, according to the present embodiment, when the communication terminal 1 displays a Web page in which the button region and the tactile information are not associated with each other, the image information with tactile information about the Web page from the analysis server 2 is displayed. And an image in which the button area and the tactile information are combined can be displayed on the display unit 104.

  Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, functions included in each member, each means, each step, etc. can be rearranged so as not to be logically contradictory, and a plurality of means, steps, etc. can be combined or divided into one. Is possible.

  In addition, the display unit 104 and the touch sensor 106 in the description of the above embodiment are configured by an integrated device, for example, by providing both functions of the display unit 104 and the touch sensor 106 on a common substrate. Also good. As an example of the configuration of the device in which both the functions of the display unit 104 and the touch sensor 106 are integrated in this manner, a plurality of photoelectric conversion elements such as photodiodes are regularly arranged in a matrix electrode array of pixel electrodes included in the liquid crystal panel. Can be mentioned. This device displays an image with a liquid crystal panel structure, while reflecting the light of a backlight for liquid crystal display at the tip of a pen that touches and inputs a desired position on the surface of the panel. The reflected light is reflected by peripheral photoelectric conversion elements. The touch position can be detected by receiving the light.

  Further, the “tactile feedback” in the present invention is not limited to applying vibration, and may be sound or light as long as it appeals to the user's senses.

DESCRIPTION OF SYMBOLS 1 Communication terminal 2 Analysis server 102 Control part 104 Display part 106 Touch sensor 108 Load detection part 110 Haptic feedback production | generation part 112 Communication part 114 Image structure part 116 Storage part 202 Control part 204 Page management part 206 Image analysis part 208 Terminal screen structure part 210 Communication unit 212 Terminal information management unit 214 Storage unit

Claims (9)

A display unit;
A touch sensor disposed on the display unit;
A haptic feedback generator for generating haptic feedback;
A communication unit communicating with the server;
A control unit that controls the communication unit to transmit image information to be displayed on the display unit to the server;
An image configuration unit configured to display the image information with tactile information on the display unit based on the image information with tactile information added to the image information received from the server via the communication unit. ,
The control unit detects an input to the touch surface of the touch sensor corresponding to a region to which tactile information is given in the image information with tactile information while the display unit displays the image information with tactile information. A communication terminal that controls the haptic feedback generation unit to generate haptic feedback for the communication terminal. The communication terminal according to claim 1,
The control unit controls the communication unit to transmit image setting information of the display unit to the server together with the image information,
The image configuration unit displays the image information with tactile information on the display unit based on image information with tactile information obtained by adding tactile information to the image information based on the image information and the image setting information. A communication terminal characterized by. A server that communicates with a communication terminal,
A communication unit communicating with the communication terminal;
Based on the image information received from the communication terminal, an image analysis unit that generates image information with tactile information by associating the tactile information with the image information;
And a control unit that controls the communication unit to transmit the image information with tactile information to the communication terminal. The server according to claim 3,
The server, wherein the image analysis unit generates image information with tactile information by associating tactile information with the image information based on the image information and image setting information received from the communication terminal. The server according to any one of claims 3 and 4, further comprising a storage unit that stores tactile information corresponding to the type of the object,
The server, wherein the image analysis unit generates the image information with tactile information based on tactile information corresponding to the type of the object.   6. The server according to claim 5, wherein when the tactile information corresponding to the object type is not stored in the storage unit, the control unit obtains the tactile information corresponding to the object type from the Web server. As described above, the server controls the communication unit. The server according to any one of claims 3 to 6,
The image analysis unit controls the communication unit to transmit the image information with tactile information to the communication terminal when the image information with tactile information is generated only for the display area of the communication terminal in the image information. And
Then, the server generates haptic image tactile information for the remaining area of the image information. A tactile feedback generation method in a communication system including the communication terminal according to claim 1 and the server according to any one of claims 3 to 7,
The communication terminal transmitting image information to the server;
The server generates image information with tactile information by associating tactile information with the image information based on the image information;
The server transmitting the image information with tactile information to the communication terminal;
Generating a haptic feedback to the communication terminal when the communication terminal detects an input to the communication terminal corresponding to a region to which the haptic information is given in the image information with the haptic information. Tactile feedback generation method. A communication system comprising the communication terminal according to claim 1 and the server according to any one of claims 3 to 7,
The communication terminal transmits image information to the server,
The server generates image information with tactile information by associating tactile information with the image information based on the image information,
The server transmits the image information with tactile information to the communication terminal,
When the communication terminal detects an input to the communication terminal corresponding to a region to which tactile information is given in the image information with tactile information, the communication terminal generates tactile feedback to the communication terminal.