201239692 六、發明說明： 【發明所屬之技術領域】 本發明是有關於一種觸感顯示裝置，且特別是有關於 一種相應於針對觸控感測器的按壓操作來顯示觸感的觸感 顯示裝置、以及該裝置的控制方法。 【先前技術】 近年來’在手機等的攜帶式終端（portable terminal) 中’作為感測用戶的接觸操作的操作部或開關等的輸入裝 置’採用了包括：觸控面板（touch panel)或觸控開關（touch201239692 VI. Description of the Invention: [Technical Field] The present invention relates to a tactile display device, and more particularly to a tactile display device corresponding to a pressing operation for a touch sensor to display a tactile sensation And the control method of the device. [Prior Art] In recent years, 'in a portable terminal such as a mobile phone', an input device as an operation portion or a switch for sensing a user's contact operation includes a touch panel or a touch panel. Control switch
Witch)專的觸控感測器的輸入裝置（touch sensor)。除播 帶式終端外’在電子計算機（electronic calculator)、售票 機等的情報機器或微波爐（microwave oven)、電視、照明 器具等的家電產品、商業用機器（工廠生產自動化（Fact〇ryWitch) The touch sensor of the touch sensor. In addition to the broadcast-type terminal, it is an information machine such as an electronic calculator or a ticket vending machine, a microwave oven, a home appliance such as a television or a lighting appliance, and a commercial machine (factory production automation (Fact〇ry)
Am〇mation，FA)機器）等中也廣泛使用包括觸控感測器 的輸入裝置。 這樣的觸控感測器中，已知有電阻膜方式、靜電容量 2、光學式等的各種方式。然而，任—種方式的觸控感 心均為感測手指或觸控筆（Styluspen)的接觸操作，即 控感測器自身被接觸，也不會像按鈕開關那樣發生物 為此，操作者即便對觸控感測器進行接觸操作， 也無 無(以―)。這樣’由於操作者 作是操作感，所以並無對該接觸操 被、、、、鳊適备感測進行確認的方法。因此，在此種 4 201239692 j 終端中，存在如下情況：操作者容易進行對相同位置多次 接觸操作等的重複的操作，從而會給操作者帶來壓力。 作為防止此種不必要的接觸操作的重複的方法，例如 已知有：當終端適當地識別出接觸操作時發出聲音的方 法。而且，例如，改變顯示形態也已為人所知，即，使與 感測到該接觸操作的位置相對應的顯示部中、用於顯示圖 像的輸入按鈕等的輸入用的用戶界面目標（以下，簡稱作 “目標”）的顯示顏色發生改變等。如果使用這些方法，則 操作者可通過聽覺或視覺來確認自己的接觸操&是否已被 終端適當地感測到。 你抵罪覚的反饋方法的情況下，噪音環境下 的操作者的確認變得困難。此外，當使用機器處於靜音模 式（manner mode )等的消音狀態時，依靠聽覺的反饋便無 法應對該情況。而且，在依靠視覺的反饋方法的情況下， 如果顯示於顯科的目標的尺寸，卜則當操作者尤 手指來進行接難㈣，目標會觀藏在手指 法確認顯示形態的變化。 7叩热 對此，提出一種不依賴於聽覺或視覺，當觸 =到接觸’則使觸控感測器振動的反饋方法（例H ,，、、專利文獻1及專利文獻2)。 ^ =利文獻1] ··日本專利特開_伽58號 ^利文獻2]:日本專利特開2齡簡55號公= 在所述專利文獻1及專利文齡9张八叫二:么報 感測到對觸控感測器的接觸時，可對操::的指 201239692 / UOV/plf 振動造成的職。因此’使収種裝置來進行接觸操作的 操作者’可通過觸覺來識別出對觸控感測器所進行的 操作已被裝置適當地感測到。 狗；隹仗用此徨装置感測到接觸時顯示觸感， 必須將相應於特定祕件來—_的處 用程式軟體（ap—softw物）（以下，簡稱作“應用卷 f”）中。也就是，在所述裝置中，如果使用已預先設想售 產生振動而開發的應雜式，則可相應於特定的條件來海 示觸感。然而，如果在所述裝置巾直接應用並未設想會肩 生振動的應用程式，則無法適當地顯示觸感。 然而 因此，為了在如上述那樣的裝置中，相應於特定的條 件來適當地顯示賊，則必須新開發應用程式，或者對既 =應用程式添加-些改變，例如追加用以顯示觸感的處 具體來說，當感測到對與觸感顯示裝置的顯示部中顯 示圖像的按鍵或按鈕等的目標的位置相對應的觸控感測器 的接觸時，該觸感顯示裝置必須將用以顯示特定的觸感的 處理追加到應用程式中。而且，即便感測到對與顯示部中 未顯示圖像_鍵或胁等的目標的位置相對應的觸控感 測器的接觸，也必須使裝置不顯示觸感。 如果以此方式來控制觸感的顯示的有無，則觸感顯示 裝置在經由採用觸控感測器及圖形用戶界面（Graphical User Interface，GUI)的用戶界面感測到接觸時，可對操作 者的指尖等顯示振動造成的觸感。也就是，觸感顯示裝置 6 201239692 J /ooupif 可通過顯示贼來告知操作者已感測到與圖像顯示出的按 鍵或按鈕等的目標對應的操作者的接觸。另一方面，即便 感測到針對不存在按鍵或按鈕等的目標的位置的接觸，觸 感顯示裝置也能夠不產生反饋。 在進行此種控制的情況下，一般來說，觸感顯示裝置 需要與如下的應用程式進行協同作用，亦即··該應用程式 管理對觸控感測器進行接觸時的GUI的狀態，也&是顯示 部中顯示的按鍵或按鈕等的目標的狀態。 以下，對觸感顯示裝置中顯示觸感時所設想的處理進 行說明。 圖7是表示所設想的觸感顯示裝置的概略構成的方塊 圖。如圖7所示，觸感顯示裝置1〇〇包括：控制部11〇、 應用程式執行部120、顯示部130、觸控感測器14〇、及觸 感顯示部150。而且，控制部110包括：顯示控制部112、 及觸感控制部114。 控制部110以觸感顯示裝置1〇〇的各功能部為首，而 對於觸感顯示裝置100的整體進行控制。應用程式執行部 120從未圖示的記憶部讀入各種應用程式，並執行基於該 應用程式的處理。另外，在以下的說明中，應用程式執行 部120所執行的應用程式中已預先追加（編入）了如下處 理，即，在與顯示部130中顯示的目標的位置相對應的觸 控感測器140感測到接觸時，顯示特定的觸感。 顯示部130由液晶顯示器或有機電激發光 (Electro-Luminescence，EL)顯示器等構成，並顯示用以 201239692 〇/ooopif ^醒操作者應接觸的部位的按鍵或按紐等的目標的圖像。 觸控感測器140通常配置在顯示部13〇的前表面，利用對 應的觸控感測器140的接觸面來感測操作者的手指等對顯 示部130中顯示的目標的接觸操作。而且，觸控感測器14〇 將接觸面上感測到的接觸的位置經由控制部11〇而通知給 應用程式執行部12〇。觸感顯示部ι5〇由小型的離心馬達 或壓電元料構成，通過使觸減㈣⑽的接觸面振 動，來對操作者的手指等的進行接觸操作的對象顯示觸感。 控制部110的顯示控制部112根據由應用程式執行部 120所供給的顯示資料，進行關於顯示的控制，即，在顯 ΐΞ SSL目標等的圖像’或者改變該圖像的顯示形 態專。觸感控制部114根據應用程式執行部12 觸感顯示部15°顯示基於特定的條二振 來顯=::::=:1°°根據接觸的感測， 在感測到針對觸控感測器14〇的接 點’對觸感顯示裝置100的觸感的間 對接觸面的接觸的二器⑽將針 _。編程式執行部12。收到蕊:;2。（步驟 觸位置是否與顯示部130中圖像顯示出判定該接 標的位置相對應（步驟s搬）。步驟 ^按紐等的目 與顯示部130㈣示彳 當接觸位置 飞妆料的目標的®像的位置不Input devices including touch sensors are also widely used in Am〇mation, FA) machines and the like. Among such touch sensors, various methods such as a resistive film method, an electrostatic capacity 2, and an optical type are known. However, any type of touch sensation is a touch operation of a sensing finger or a stylus (Styluspen), that is, the sensor itself is touched, and does not happen like a button switch. Contact operation of the touch sensor is also possible (with ―). Thus, since the operator is an operational feeling, there is no method for confirming the contact operation, the condition, and the sensing. Therefore, in such a 4 201239692 j terminal, there is a case where the operator can easily perform repeated operations such as multiple contact operations at the same position, thereby putting pressure on the operator. As a method of preventing such repeated contact operations, for example, a method of emitting a sound when the terminal appropriately recognizes a contact operation is known. Further, for example, it is known to change the display form, that is, a user interface object for inputting an input button for displaying an image or the like in a display portion corresponding to a position at which the contact operation is sensed ( Hereinafter, the display color of the "target" is referred to as a change. If these methods are used, the operator can confirm whether his or her contact operation & is properly sensed by the terminal by hearing or visual. In the case of your feedback method of sin, it is difficult for the operator to confirm in a noisy environment. In addition, when the machine is in a mute state such as a manner mode, it is impossible to cope with the situation by relying on the feedback of the hearing. Further, in the case of relying on the visual feedback method, if the size of the target displayed in the subject is displayed, the operator will be able to perform the difficulty (4), and the target will observe the change in the display form by the finger method. In the case of this, a feedback method is proposed in which the touch sensor is vibrated without touching the hearing or the vision (Example H, , , Patent Document 1 and Patent Document 2). ^ = 利篇1] ··Japanese Patent Special Open_Gam 58 No. 2 Lili Document 2]: Japanese Patent Special Open 2nd Anniversary 55 No. = in the patent document 1 and patent age 9 eight eight two: When the sensor senses the contact with the touch sensor, it can be caused by the operation of the ::201239692 / UOV/plf vibration. Therefore, the operator who causes the seeding device to perform the contact operation can recognize by touch that the operation performed on the touch sensor has been properly sensed by the device. The dog uses the device to sense the touch when it touches, and must use the software (ap-softw) (hereinafter referred to as "application volume f") corresponding to the specific secret piece. . That is, in the apparatus, if a syndrome developed by the assumption that vibration is generated in advance is used, the touch can be displayed corresponding to a specific condition. However, if an application that does not assume a shoulder vibration is directly applied to the device towel, the tactile sensation cannot be properly displayed. However, in order to appropriately display a thief in accordance with a specific condition in the device as described above, it is necessary to newly develop an application, or to add some changes to the application, for example, to add a place for displaying a tactile sensation. Specifically, when a contact with a touch sensor corresponding to a position of a target such as a button or a button for displaying an image in a display portion of the touch sensitive display device is sensed, the touch sensitive display device must be used The process of displaying a specific tactile sensation is added to the application. Further, even if the contact of the touch sensor corresponding to the position of the target in which the image_key or the threat is not displayed in the display portion is sensed, it is necessary to make the device not display the tactile sensation. If the presence or absence of the display of the tactile sensation is controlled in this way, the tactile display device can be operated to the operator when the contact is sensed via the user interface using the touch sensor and the graphical user interface (GUI). The fingertips and the like show the touch caused by the vibration. That is, the tactile display device 6 201239692 J /ooupif can be notified by the display thief that the operator has sensed the contact of the operator corresponding to the target such as the button or button displayed by the image. On the other hand, even if the contact with respect to the position of the target such as a button or a button does not exist, the touch display device can generate no feedback. In the case of such control, in general, the touch sensitive display device needs to cooperate with the following application, that is, the application manages the state of the GUI when the touch sensor is touched, & is the state of the target such as a button or a button displayed on the display unit. Hereinafter, the processing assumed when the tactile sensation is displayed on the touch sensitive display device will be described. Fig. 7 is a block diagram showing a schematic configuration of a tentacity display device assumed. As shown in FIG. 7, the touch display device 1A includes a control unit 11A, an application execution unit 120, a display unit 130, a touch sensor 14A, and a touch display unit 150. Further, the control unit 110 includes a display control unit 112 and a tactile sensation control unit 114. The control unit 110 controls the entire touch sensitive display device 100, including the respective functional units of the tactile display device 1A. The application execution unit 120 reads various applications from a memory unit (not shown) and executes processing based on the application. In addition, in the following description, the application executed by the application execution unit 120 has previously added (programmed) a touch sensor corresponding to the position of the target displayed on the display unit 130. When 140 senses the contact, it displays a specific tactile sensation. The display unit 130 is constituted by a liquid crystal display, an organic electroluminescence (EL) display, or the like, and displays an image of a target such as a button or a button for a portion to be touched by the operator at 201239692. The touch sensor 140 is generally disposed on the front surface of the display portion 13A, and senses a contact operation of an operator's finger or the like on the object displayed in the display portion 130 by the contact surface of the corresponding touch sensor 140. Further, the touch sensor 14 通知 notifies the application execution unit 12 of the position of the contact sensed on the contact surface via the control unit 11 . The tactile display portion ι5 is composed of a small centrifugal motor or a piezoelectric element, and the touch surface of the touch (4) (10) is vibrated to display a tactile sensation to an object of a contact operation of an operator's finger or the like. The display control unit 112 of the control unit 110 performs control on display based on the display material supplied from the application execution unit 120, that is, displays an image of an SSL target or the like or changes the display state of the image. The tactile sensation control unit 114 displays the touch-sensitive display unit 15° according to the specific bar-diode display by the application execution unit 12:=:::=:1°° According to the sensing of the contact, the sense of touch is sensed. The contact of the detector 14 ' 'the second device (10) that contacts the contact surface of the tactile display device 100 to the contact surface will be the pin _. Programmatic execution unit 12. Received the core:; 2. (Whether the step contact position corresponds to the position at which the image in the display unit 130 displays the determination of the joint (step s). The step of the button and the display unit 130 (4) indicates the target of the contact position of the paint. Like the location is not
S 201239692 /δδοριί 對應，則應用程式執行部120不進行關於顯示或觸感的指 不便結束動作。在該情況下，不顯示觸感。 =方面’步驟請21，當接_位置與顯示按鍵 或心紐專的目標的圖像的位置相對應，則應 對於顯示控制部112供給顯示資料，此顯示=用二 容為已感測到輸入的顯示。此處，所謂内容為已感 測到輸入的顯示是指：操作者可目視確認的顯示，例如= _間將按鍵或餘等的目標反觸^或者_表示 下按鍵或按辦的狀態的圖像等。一旦從應用程式執行 二==示資料，則顯示控制部112根據該顯； 貧料來改變顯不部130令所顯示的圖像（步驟s 然後，應用程式執行部120為 :114已感測到輸入，而進行指示； ί來=:=r顯示是指:提供可通過二: 瞬門振2 21使觸控感測器140的接觸面僅 辨間振動等。一旦接收到此種 4 制部114便依照該指示來進I ......曰不’觸感控 顯示特定_模式。由來m以f職顯示部wo 控感測器140的接觸面的接觸對=2，對接觸到觸 =(步驟·通過進行此種處===的 提醒操作___目標_==== 如以上所說明的那樣，根：觸感。 應用程式與顯示觸感的動作相對應，則可無問題地進^ 201239692 述動作。也京尤;I：，只要為預先蝙入了顯示觸感的處理的應 用程式，則可·所述的動作適當地顯示特定的觸感。 然而，所述觸感顯示裝置中，如果採用不與觸感 的顯示相對應的應用程式，則在該狀態下，即便目標的顯 不根據接_作而發生變化’也無法適當地顯示觸感。因 ^ ’觸感顯示裝置100中’為了不浪費地有效利用直至目 刚為止所開發的各種制程式資源，而必須改變各種應用 程式，追加相應於特定的條件來顯示觸感的處理。追加此 =處理的改變必須針對各種細程式來進行，從而非常費 事且成本増加。 ㈣^樣的事情之下，今後，成為妨礙各公司加入對於 ^員示裝置的應用程式的開發的主要原因，也有可能成 控感測器及GUI的平台的普及延遲的主要原因。 接觸在如上述的動作中，根據對觸控感測器140的 相對應，無的監視，來判定接觸的位置是否與目標的位置 應用程式直至目標的顯示的改變、觸感的顯示為止，均為 挤插執行部120要關注的事項。為了開發或設計進行 該應^的應用程式，*僅需要煩雜的作業’且擔心執行 〇Λ〜疋式的應用程式執行部120的處理負荷也會增大。 術中1例如所述專利文獻1及專利文獻2所公開的技 觸而使過是在觸減測减剩接觸時，相應於該接 獻2所I感測器振動。因此，所述專利文獻1及專利文 應的應=開的技術中，也設想即便採用與觸感的顯示相對 ^ 程式，也無法適當地顯示觸感的情況。尤其將像 201239692 ό/aeopif （推壓式按蝴關）這樣的按紐開關描緣 护“二二：上的裝置t，只要利用手指等輕輕地觸碰觸 顯示觸感。因此’會對僅通過操作者對觸控 進仃按壓（減）的前階段的輕輕綱的接觸操作 引起誤操作。 像（按紐）的反應不同，有可能 气地=所利文獻記載的技術中，即便操作者無意 t f f所騎的躲_(也狀較未施力〕，也會相 ::ϊΐ觸碰此觸控感測器的動作（接觸）而顯示觸感， 也會給插作者帶來不協調感器 電:骐方式的情況下，如果上部導電膜接觸== 在静電容量方式的情況下，』= 主j接觸的電仏號則顯示觸感。 預先便在総的顯示觸感的裝置中，採用了基於 Sdrr觸控感測器顯示觸感的處理的應用程 門關隨W 無法在感咖輸人時提供像機械式按叙 最多不過用以告知操作者已感測且只不 ^進Y 了使細面振動等的動作而已。因此， 觸感顯示裝置所顯示的觸感 q、 械式按_關時那樣的真實的操$操作者k供像操作機 然而，在採用觸控感測器及GUI的用戶界 2模擬現實的機械式触_等的目 在感測到對此種目標的輸入的情況下，對於給:二 201239692 «7 / oovpif 的操作感而言，仍然是顯示仿照機械式按鈕開關的真實的 觸感更佳。當感測到對顯示的目標的輸入時，只要能夠進 行像點擊現實的按鍵或按鈕等時這樣的反饋，便可提高給 操作者帶來的操作感。 在機械式按鈕開關的情況下，操作者通過施加一定程 度的按壓力而將該開關按下，可獲得例如金屬彈片開關 (metal dome switch)等彎曲時的觸感（以下，稱作點擊 觸感）。同樣地，在機械式按鈕開關的情況下，操作者在解 除，已按下關義按壓力的過程巾，通過減弱按壓力到 :定程度為止，而可獲得金屬彈片開關等回到原先的未被 按下的狀態的賊（以下’稱轉朗感）。而且，在機械 式按紐開關的情況下，操作者即便通過非常弱的按壓力觸 摸（接觸）到開關也不會顯示點擊觸感，而且，因未顯示 2觸感的狀態，從而也不顯示釋放觸感。先前的採用觸 j測器及GUI的觸感顯示裝置中，無法顯示出像所述機 械式按鈕開關那樣的點擊觸感及釋放觸感。 放觸果要在職顯稀置巾實現由轉觸感或釋 =工:真貫觸感的顯示，則為此需要將所 全 ^添加於應用程式中H為了實現此_感的顯示， 、必須對翻程式輸人❹jf|的檢測資， 指示。為了開發或設計進行此種 應的：業，而且擔心執行該應用程式的 【發明内容】 曰人 12 201239692 J /oooplf 因此，有鑑於所述情況而完 提供-種觸祕示裝置、以及料^發⑽目的在於 Λ 夂这裝置的控制方法，不會浪 費構成用戶界面的既存的應用程式資源，而相應於針對目 標的操作者的操作來顯示觸感。 達成所述目的第—觀點的發明的觸感顯示I置包 括.觸控感觸感顯示部，使所述觸控感測器的接觸 面振動；顯示部；以及控制部，根據由應雜式軟體所供 給的表示觸感的情報’來對所述顯示部中顯示的 目標設定 所述觸感顯示部顯示的觸感’當感測到對於所述目標的輸 入，則控制所述觸感顯示部、以使所述觸感顯示部對按壓 住所述接觸面的按塵對象顯示對於該目標所設定的觸感。 關於第一觀點的發明疋’在第一觀點的觸感顯示裝置 中，所述控制部根據：通過所述應用程式軟體而與顯示相 關聯的情報一起輸出的與觸感的顯示相關聯的指示，來對 所述目標設定所述觸感顯示部顯示的觸感。 關於第三觀點的發明是，在第一觀點或第二觀點的觸 感顯示裝置中更包括：負載檢測部，所述負載檢測部檢測 對所述觸控感測器的接觸面的按壓負載；所述控制部在感 測到對於所述目標的輸入的狀態下，當所述負载檢測部檢 測出滿足顯示觸感的負载基準的按壓負載，則控制所述觸 感顯示部，以使所述觸感顯示部對所述按壓對象顯示觸感。 而且，關於達成所述目的第四觀點的發明的觸感顯示 裝置的控制方法，在觸感顯示裝置的控制方法中，所述觸 感顯示裝置包括：觸控感測器’觸感顯示部’使所述觸控 13 201239692 u / ooupif 感測器的接觸面振動；以及顯示部；所述觸感顯示裝置的 控制方法根據由應用程式軟體所供給的表示觸感的情報， 來對所述顯示部中顯示的目標設定所述觸感顯示部顯示的 觸感’當感測到對於所述目標的輸入，則控制所述觸感顯 示部以使所述觸感顯示部對於按壓住所述接觸面的按壓對 象顯示對該目標所設定的觸感。 根據本發明，可提供一種可有效利用既存的應用程式 而不會造成浪費、並且使用此種應用程式以使操作性優異 的用戶界面。 為讓本發明之上述和其他目的、特徵和優點能更明顯 易懂，下文特舉較佳實施例，並配合所附圖式，作詳細說 明如下。 【實施方式】 以下’參照附圖對本發明的實施方式進行說明。 本發明是根據用以生成顯示部中顯示的用戶界面的情 報、及由應用程式軟體而供給的關於觸感的情報，來設定 對目標的觸感的觸感顯示裝置。而且，本發明在顯示觸感 時’對輕輕地觸碰（接觸）觸控感測器程度的操作並不會 顯示觸感，而對操作者有意識地按壓（推壓）觸控感測器 的操作才會顯示觸感。 圖1是表示本發明的實施形態的觸感顯示襞置的概略 構成的方塊圖。 如圖1所示’觸感顯示裝置1包括：控制部10、應用 程式執行部20、顯示部3〇、觸控感測器4〇、觸感顯示部 201239692 J /ooupif =、及負載檢測部60。而且，控制部l〇包括：顯示控制 部12、觸感控制部14、及輸入控制部16。 控制。卩10以觸感顯示裝置1的各功能部為首，而對於 觸感顯示裝置1的整齡行控制。應用程式執行部20從未 =的記憶部讀人各種顧程式，並執行基於該應用程式 在^理另外，本實施形態中，對應用程式執行部20執行 土不與觸感的顯示相對應的應用程式中對目標設定觸 忑^得的改變應用程式的情況進行說明。以後將說明在應 用程式中添加改變以與觸感的顯示相對應的處理。 j示部3〇是以圖像顯示出按鈕開關（推壓式按鈕開 故樣的目標（object)。另外，所謂按鈕開關是指：像 ^入按鈕或按鍵等（以下，僅統稱為“按鍵等，，）這樣的能 ^實際壓入的機械式按鍵。本實施形態中，顯示部30中顯 不利用圖像來模擬此種按鈕開關的目標。顯示部3〇例如利 用液b曰顯示面板或有機EL顯示面板等。應用程式執行部 20於生成用戶界面時、或改變目標的圖像時等，將構成用 戶界面的圖像等的情報（顯示資料）供給至顯示控制部 12。一旦如此而被供給了構成用戶界面的情報，則顯示控 制部12能夠使顯示部30中顯示基於該情報的顯示。另外， 附圖及以下的說明中’“用戶界面，，可適當省略記載為“Ur，。 觸控感測器40通常配置於顯示部3〇的前表面，由對 應的觸控感測器40的接觸面來感測操作者的手指等（按壓 對象）對顯示部30中顯示的目標的按壓操作（接觸）。而 且，觸控感測器40在感測對接觸面的接觸時，將該檢冽到 15 201239692 -J / 的接觸的位置經由輸入控制部16而通知給應用程式執行 部20。該觸控感測器40例如由電阻膜方式、靜電容量方 式、光學式等的公知的方式的感測器而構成。 觸感顯不部50利用壓電振動器（piez〇eiectrjc vibrator) 等而構成’使觸控感測器40的接觸面產生振動。該觸感顯 示部50通過使觸控感測器40的接觸面產生振動，而對按 壓住接觸面的按壓對象顯示觸感。按壓住接觸面的按壓對 象例如是指操作者的手指或觸控筆等。負載檢測部6〇檢測 對觸控感測器40的接觸面的按壓負載，例如使用應變計感 測器（strain gauge sensor)或壓電元件等的對負載線性地 作出反應的元件而構成。而且，負載檢測部6〇將所檢測到 的對觸控感測器40的接觸面的按壓負載通知給觸感控制 部14。 控制部10的顯示控制部12根據由應用程式執行部2〇 供給的顯示資料，來進行關於顯示的控制，例如使顯示部 p以圖像顯示出目標等或者改變該圖像顯示等。顯示控^ 部12從應用程式執行部20接收生成顯示部3〇中Γ υί時所使用目標的顯示資料。而且’顯示控制部12在 作者對觸控感測器40的接觸的位置為與開始特定的動= 的目標相對應的位置的情況下，從應用程式執行部2〇 内容為表示已接受輸入的目標的顯示資料。 輸入控制部16將操作者對觸控感測器4〇的接觸的位 置’通知給應用程式執行部20及觸感控制邹14的一立 兩方》 列一方或 201239692 本實施形態_餘制部14具有未圖示的記憶部，根 據由應用程式執行部2G執行的應用程式的指示，可至 時地記憶對各目標所設定的觸感的情報。也就是，本實施 =態中，如後述般’可在觸感控制部14中設定對目標的觸 ，。因此’當以此方式在觸感控制部14中設定對目標的觸 感時，輸人控制部16將對觸域㈣4 G接_位置通知 =觸14，從而觸感控制部14可進行關於觸感的 控制。也就是，在該情況下，應用程式執行部2〇 關於職的顯示的動作，勤接㈣觸控感測器 m置的通知以躺該位置是否為與目標相對 偏H感控制部14從輸入控制部16接到對觸控感測器 了觸;的位置的通知’關㈣接觸的位置是否與設定 1標的位置相對應。在被通知的接觸的位置與設 ;了觸感的目標的位置相對應的情況下，觸感控制部14 =制=顯示部50以使觸感顯示部5〇顯示‘定的觸 實施例中’也可通過負載檢測部⑽，在檢測 部ιΛ艏°也^1 ’觸感㈣ : 〇感測到與執戰 壓負载滿足顯示觸部6G檢測的按 部50以…Λ载基4的情況下，控制觸感顯示 顯示部50吝ί ΓΐΜ〇顯示所設定的觸感。而且，觸感 對按壓住觸特定模式（pattem)的振動’由此 觸控感別器40的接觸面的操作者的手指等的按 17 201239692^ t W WL/aJ. 壓對象顯示所設定的觸感。 圖2A與圖2B表示圖1所示的觸感顯示裝置1的安參 構造的一例，圖2A為主要部分剖面圖，圖2B是主要邱又 平面圖。顯示部30收納保持在框體61内。顯示部邓上^ 著包含彈性構件的絕緣體62、而保持著觸控感測器4〇。另 外，本實施形態的觸感顯示裝置1中，將顯示部3〇及觸押 感測器40设為平面觀察的矩形狀。而且，觸感顯示|置1 中’觸控感測器40隔著絕緣體62而保持在顯示部3〇上， 該絕緣體62配设在離開圖2Β中假想線所示的顯示部％ 的顯不區域Α的4角上。 而且，在框體61上，以覆蓋離開顯示部3〇的顯示區 域的觸控感測器40的表面區域的方式設置著頂蓋63 (upper cover)，在該頂蓋63與觸控感測器40之間，配設 著包含彈性構件的絕緣體64。另外，在圖2A與圖2B所 示的觸控感測器40中’具有接觸面4〇a的表面構件例如由 透明薄膜或玻璃而構成，背面構件由玻璃或壓克力（acrylic acid resin)而構成。觸控感測器40使用的是如果接觸面 40a被按壓，則按壓部分會相應於按壓力而發生少量撓曲 (應變）、或構造體自身發生少量撓曲的構造的感測器。 在觸控感測器40的表面上，在由頂蓋63所覆蓋的各 邊的附近，分別通過黏接等而設置著用以對施加至觸控感 測器40的負載（按壓力）進行檢測的應變計感測器51 ° 此外，在觸控感測器40的背面上，在相向的兩邊的附近’ 分別通過黏接等而設置著用以使觸控感測器40振動的壓 18 201239692 J / uu 電振動益52。也就是，圖2a與圖2B所示的觸感顯示裝 置1中’圖1所不的負載檢測部6G使用四個應變計感測器 51而構成’觸感顯不部5()使用兩個壓電振動器52而構 成。並且’觸感顯不部5〇通過使觸控感測器4〇振動而使 接觸面40a振動。另外’圖2B中省略了圖2A所示的框體 61、頂蓋63及絕緣體64的圖示。 、其次，本實施形態中，對根據與觸感的顯示相對應而 添加改變的應用程式的指示，而將與目標相應的觸感設定 於觸感控制部14的動作進行說明。 本實施形態中’如上所述，通過在應用程式中添加改 變，而在改變顧程式中預先附加：目標與相應於對該目 標的輸入而顯示的觸感的關聯的情報的對應性。其中，如 果對原本並不與職的顯示相對應的制程式，附加關於 顯示觸感的動作的所有處理（判斷或指示）來進行改變， 則一般來說必須附加各種控制情報，為此有可能 導 致成本增加。 對此，本貫施形態中，對原本應用程式所具有的情報 中的與UI的顯示相關聯的情報，附加與觸感的顯示相關 聯的情報。由此，當W最初在顯示部3G中顯示時、或瓜 的顯示發生改變時等，將與m的顯示相關聯的情報、及 與構成UI的目標的觸感的相關聯的情報—起供給。因此， 從應用程式供給與該觸感的顯示相關聯的情報，由此觸感 控制部14在UI最初顯示時或UI的顯示發生改變時，^ 對構成UI的各目標設定觸感。也就是，此時，觸感控制 201239692 4 14根據從位於控制部10的外部的應用程式執行部20 所執行的應用程式而供給的表示觸感的情報，來對顯示部 30中顯示的目標，設定觸感顯示部50顯示的觸感。 、具體來說’例如，在使用由目標構成的UI的應用程 式中通吊對目標的位置情极（也就是，表示該目標顯示 在顯示部30的顯示^^的區域中的哪一個位置的情報）進 行定義。而且，該應用程式中，通常也對目標的大小情報 (也就是，在與該目標的位置相對應的觸控感測器40申感 測接觸的範圍）進行定義^對此，進行如下改變，即，將 在感測到對該目標的輸入的情況下應顯示的觸感的種類、 及顯示觸感時的條件即按壓負的情報預先對應地附加 到該應用程式中所使㈣構成U的目標的位置、大小情 報中。 本實施形態中，僅通過對應用程式至少附加這些情 報，並根據各種條件便可對所使用的構成的目標 各種觸感。而關於其他處理，例如，正因為要顯示^感， 所以無需預先將對觸控感測器4㈣接觸的監視、或接觸的 位置是否與目標的位置相對應的判^等的處理附加在應用 程式中。 圖3是說明本實施形態的用戶界面（UI)的生成 的流程圖。該生成動作是在根據應用程式執行部加中 的應用程式的指示，而新生成應用程式提供的: 應用程式提供的UI變為新的UI時等所進行的動i、， 是’本實施形態中，在新生成應用程式提供的U時也^ 201239692 -J /ooupif f對構成m❸目標設定職i且，因根據應用程式的 才曰不’而UI的晝面顯示發生改變後，顯示的目標的配置 也發生改變’所卩在贿況下，也必須 UI的目標設定觸感。 炎J職 圖3所示的m的生成動作例如：在根據應用程式的 生成應綠錢㈣UI時、錢錄式提供的 =變為新的m時等開始進行。另外，圖3所示的流程圖 中’對從控制部1G的視點觀察到的動作進行說明。當本動 作開始時，根據由應用程式執行部2〇執行的應用程式，將 ”生成t:應用程式提供⑽的與切的顯示相關聯的情 報（顯不資料）輸出到顯示控制部12。因此，控制部10 的:頁示控㈣12接收與該以賴示相襲的情報（步驟 本實施形態使用的應用程式中，如上所述，對與饥 的顯示相關聯的情報附加與觸感的顯示相關聯的情報。因 =田從應用程式輸出與切的顯示相關聯的情報到顯示 工制部12中時’與相應於對構成UI的目標的輸入而顯示 的觸感相關聯的情報也—起被輸出。為此，控制部10的觸 ，控制。卩Η接收與相應於職目標的輸人㈣示的觸感 相關聯的情報（步驟S2 )。 -旦接收顺相應於對目標_人_示的觸感相關 聯的情報，_感控制部14對構成UI的各目標設定觸感 顯示部50顯示的觸感（步驟S3)。此時，所設定的觸感是： 依據附加在應用程式中的與__示相關聯的情報而進 21 201239692 行f種設想。例如，指定觸控感測It 4G中的接觸位置及接 =範圍’根據該位置、範_所顯示的目標，來設定觸感 2類（例如金屬彈片開關或橡膠開關的觸感）或觸感的 田如反饋的強弱）等。而且，還依據例如附加在應 用程式中的與觸感的顯示相關聯的情報，來對各目標設定 顯不觸感的貞餘準。所謂齡贼的貞祕準是指：一 f負載檢測部60檢測到滿足特定的負载基準的按壓負 便對按壓住觸控感· 4G的接觸面的按壓對象顯示觸 感時的該特定的負載基準。 具體來說，例如可對小的目標設定相對較小的（弱的 =的）觸感。例如，在該情況下，可提高產生振動的頻 二或縮短產生振動的時間。另一方面，可對大的目標設 定相對較大的（強的反饋的）賊。例如，在該情況下， 可降低產生振動的頻率，或延長產生振動的時間。而且， 在為小的目標的情況下’例如將顯示戦的負載基準設定 為相對較小，通過操作者相對較弱的按壓便可顯示觸感。 ft在為大的目標的情況下’例如將顯示觸感的負载基 準设定為相對較大，如果操作者不進行相對較強的按壓則 不會顯示觸感。另外，觸感控制部14將對各目標而設定的 觸感的情報記憶於未圖示的記憶部中。 步驟S3中在觸感的設定結束後，控制部1〇進行υι 的生成處理（步驟S4)°UI的生成處理具體來說可以為如 下的動作等：根據顯示控制部12接收到的與UI的顯示相 關聯的情報而使顯示部30描繪顯示出χπ，或與感測到對 22 201239692 目標的輸入時起動的應用程式之間建立關聯。 如上述般，通過進行本實施形態的UI的生成動作， 使顯示部30中顯示UI，對構成該UI的目標一旦感測到輸 入，便完成顯示觸感的準備。 其次，對顯示部30中顯示UI之後’觸感顯示裝置i 相應於操作者的按壓操作而顯示觸感時的動作進行說明。 本實施形態的觸感顯示裝置1在觸控感測器40感測到 操作者對顯示部30中以圖像顯示出的目標進行接觸的狀 態下，當負载檢測部60檢測到的按壓負載滿足特定的基 準，則顯示觸感。所謂在負載檢測部60檢測到的按壓負載 滿足特定的基準的情況下顯示觸感的這種情況，是指：在 操作者並非無意識地（因誤操作等）觸碰到觸控感測器 40 ’而是有意識地進行按壓（推壓）動作。 圖4是表示本實施形態的觸感顯示裝置丨的動作的流 程圓。當進行觸感顯示裝置1的動作時，依照所述Uj生 f動作，可預先在顯示部30中以圖像顯示出按鍵等的目 使得能夠感測到操作者的手指或觸控筆等的操作。也 ΐ是，以T ’顯示由經改變的應_式所供給的UI，也就 已完成觸感的設定的UI。另外，該實施例的應用 =,¾與顯示部30中顯示的目標的圖像的 器4。感测到接觸時，為了使操作者可= 接觸的感測，而設為對目標的圖像實 然^本實罐t，此嶋^顯不。 在如上述般完成準備的狀態下，本實施形態的觸感顯 23 201239692 不裝置1的動作開始。觸感 先，輸入控制部16對摔齡物作開始後，首 的接觸面祕總沾古i作者的手心等的對觸控感測器40 的接觸面的接觸的有無進行監視（步驟s 一旦感測到對觸控感測器 i 乂驟5中 16便將該接觸的位置通觸：的接觸，輸入控制部 制部14 (步驟S12)。應用程式執行部20及觸感控 後，應匕控if測器4〇中的接觸的位置的通知之 GUI中顯仃f 2G判定該接觸的位置是否與目前的 S13)。者iTL鍵等的目標的圖像的位置相對應（步驟 應用程的位置與糾目標額像的位置相對應時， 變目^^部2G將用以依據基於制程式的設定來改 該顯;資共給至顯示控制部12。在接收到 的目2 2 制部12控制顯示部30以使所顯示 置1 像發生改變（步驟S14)。也就是，觸感顯示裝 Μ顧感到對按鍵等的目標的接觸的情況下，改變該目 Sir像。當要改變目標的顯示圖像時，較佳為能夠 示出目扭目硯辨認出已觸摸到（接觸到）按鍵等，例如顯 種目押ΐ已被選擇’或者改變目標的顏色或亮度等。使此 々圖像發生改變的顯示可通過基於應用程式的設定 而亏慮各種形態。 是否-S13中，可由輸入控制部16來判定接觸的位置 中咸^ .員示目標的圖像的位置相對應。因此，在步驟S13 接^彳丨對目標的輸入後（也就是存在對按鍵等的目標的 步驟S15以後的觸感的顯示的處理可不通過應 24 201239692 r-r ίΪΪί::2::進行。步驟S15中’觸感控制部14判 器40的接;。檢測到的按-負载是否因對觸控感測 祕、、目1 按壓而增加並滿足特定的基準。另外，負 '、’。卩60例如根據四個應變計残測# 51的灼 據操作者進:通常的二=的基準的負載’較佳為根 例如1.5 N二V) Z T，負載而預先設定為 I午頓）等的值，並且其後可進行設定變更。而 該特定的基準已考慮縣_作者的意圖的按壓摔 壓負y例如平均值等），從而不會設定:: ;這樣做疋為了使操作者無意識地輕輕觸碰這樣的 況下的操作不會被識別為按m um)操作，以及後述的 為了給操作者帶來真實的觸感的按壓感。 在步驟SIS中按壓負載滿足特定的基準的情況下觸 感控制部14使觸控感測器40的接觸面產生特定的振動， 並控制觸感顯示部50以使觸感顯示部5〇顯示觸感（步驟 S16)。也就是，觸感控制部14在感測到對執行特定=處 理的目標的輸入的狀態下，當負載檢測部6〇檢測出滿足顯 示觸感的負載基準的按壓負載，則控制觸感顯示部5〇以使 觸感顯示部50顯示觸感。通過該控制，觸感顯示部5〇對 按壓住觸控感測器40的接觸面的按壓對象顯示觸感。此處 顯示的觸感如圖3中所說明的那樣，是指：根據從*應用程 式接收到情報而設定的觸感。 另外’本實施形態中，步驟S16中觸感顯示部％對 按壓對象顯示的觸感，可設為像在點擊現實的按鍵或按姐 25 201239692 等的情況下所顯示的那樣的轉誠。此處，為了對 ^顯^實的點擊觸感，觸感顯示裝置1在操作者的按 感受到刺_狀態下刺激觸覺。也就是，觸感顯示裝置！ 直至施加到觸控感測器4〇的負载滿足顯示觸 感的基準（例如UN)為止，當負載滿足該基準，則利用 特定的驅動信號來驅動壓電振動器52以使接_ 4〇a振 從而刺激觸覺。由此，賊顯示裝置1可向操作者顯示與 按下按紐開關（推壓式按_關）這樣的按_關時所^ 得的感覺相同的點擊觸感。因此，對操作者而言，即便是 觸控感測ϋ巾·繪的虛擬的按蝴關，也可獲得與操作 實際的按紐開關時相同的真實的點擊贼，並且可對觸控 感測器40進行操作，因而不會有不協調感。而且，操作^ 能夠與按下”觸控感測器4〇的意識相連動來進行操作，因 而也可防止單獨的接觸所引起的誤輸入。 顯不所述點擊觸感時的驅動信號，也就是刺激觸覺的 固定頻率、週期（波長）、波形、振幅，可根據所顯示的點 擊觸感^適當設定。例如，在顯示以攜帶式終端中所使用 的金屬彈片開關為代表的點擊觸感的情況下，例如，利用 170 Hz的固定頻率的Sin波所構成的丨週期的驅動信號來 驅動觸感顯示部50。利用此種驅動信號來驅動觸感顯示部 50，使接觸面40a在已施加滿足特定的基準的按壓負載的 狀態下以約15 μπι振動。由此，可向操作者顯示像點擊實 際的按鍵的情況下這樣的真實的點擊觸感。 而且，在步驟S15中按壓負載不滿足特定的基準的情 26 201239692 況下’觸感控制部14根據對觸控感測器40的接觸面的按 壓減弱’而判定由負載檢測部60檢測的按壓負载是否為零 (步驟S17)。在步驟S17中由負載檢測部60檢測的按壓 負載尚不為零的情況下，因操作者對觸控感測器40的操作 未被解除（釋放），所以觸感控制部14回到步驟S15中繼 續進行處理。另一方面，在步驟S17中由負載檢測部6〇 檢測的按壓負載已為零的情況下，可判定為操作者已解除 (釋放）對觸控感測器4〇的操作，觸感控制部14結束圖 4所示的動作。另外，步驟S17中的動作也可代替判定由 ^載檢测部60檢測的按壓負載是否為零的動作，而設為判 定對觸控面板4〇的接觸是否已被感測到的動作。 另—方面，在步驟S13中，接觸的位置不與顯示目標 ，圖像的位置相對應的情況下，應用程式執行部20結束圖 軸。也就是，在對碰料目翻輸入未被感 的隋况下，或感測到的輸入並不對應於按鍵等的目標 1’應:程式執行部2〇不改變目標的顯示圖像便結 it不的4理° ^ ’在該情況下，輸入控制 束處理。這樣…觸H 14發Μ容為齡觸感的指示便結 標以外的位i的裝兄 作者可識別出未感示觸感而使操 感測==形態’ ΐ對執行特定的動作的目標 情況下，顯示由特定的貞载鱗的賊負載的 王式供給且針對該目標而設定的觸 27 201239692 感°而且’根據本實施形態，通過在應用程式中附加與觸 感的顯示相關聯的情報而可對各目標設定適當的觸感，此 外’觸感的顯示的動作不需要由應用程式執行部2〇來進 行。因此，根據本實施形態的觸感顯示裝置i，當感測到 輸入時，可顯示與目標相應的觸感，並且可通過附加與觸 感的顯示相關聯的情報而應用構成UI的既存的應用程 式。而且，本實施形態的觸感顯示裝置1中，利用對按鍵 的目標進行按壓（推壓）的操作，而可通過真實的點擊 觸覺來使操作者識別出該目標的輸入已被正確識別。 其次’對觸感顯示裝置1通過在感測到操作者的接觸 的狀態下檢測滿足基準的按壓負載而顯示點擊觸感後，進 一步顯示釋放觸感時的動作進行說明。 在對通常的機械式按鈕開關進行按壓操作的情況下， 因其後對開關的按壓力會減弱，而顯示出金屬彈片開關等 回到原來的未被按下的狀態的觸感（以下，稱作釋放觸 感）。本實施形態的觸感顯示裝置1中，可相應於按壓操作 來顯不真貫的點擊觸感’因此之後在對觸控感測器的^壓 被解除（釋放）的中途顯示真實的釋放觸感，可提供整體 上一連串的更自然的操作感。 圖5表示本實施形態的觸感顯示裝置1的動作的流程 圖。圖5所示的動作，是在圖4中所說明的顯示點擊觸威 的動作（步驟S16)之後開始進行。當本動作開始時，觸 感控制部14因操作者對觸控面板40的操作的按壓力減 弱，而判定負載檢測部60檢測的按壓負載是否從特定的某 28 201239692 時，按壓負载從超過特定二是指：在按壓釋放 辑定的基準（或小於特定祕準的）狀態 爲】於中判定為按壓負載已從特定的基準以上變 觸感（步^=_部5()顯示由應用程式而設定的釋放 顯干感的負祕準也可設定為與按壓時 糊感的所述的負載基準為相同，但優選設定為比 按壓時顯示點擊觸感的負載基準低50%〜8G%的值。這樣 的f，在連續地按壓同一位置（目標）（也就是連續敲打按 鍵的情況下，依次進行的按壓及該按壓的解除與觸感顯 示時間點（timing)可良好地吻合，從而可顯示出無；協 調感的真實的操倾。也就是，通過將槪時顯示觸感的 基準的負載設為小於按壓時顯示觸感的基準的負載，而能 夠顯不沒有不協調感的觸感。此時，通過將釋放時顯示觸 感的基準的負載設為按壓時顯示觸感的基準的負載的約 50%以上，從而能夠進一步提高連續按壓操作時的操作 性。而且，通過將釋放時顯示觸感的基準的負載設為按壓 時顯示觸感的基準的負載的約80%以下’從而還可以應對 連續按壓操作時的保持狀態下的微小的負載變化^另外， 此種負載基準的設定也可作為與觸感的顯示相關聯的情報 29 201239692 而預先附加在應用程式中。 在步驟S32中顯示釋放觸感後，輸入控制部16判定 觸控感測器40是否未感測到接觸（步驟S33)。在觸控感 測器40未感測到接觸的情況下，輸入控制部16將接觸已 被解除的内容通知給應用程式執行部2〇。而且，應用程式 執行部20將依據基於應用程式的設定來改變目標的圖像 的顯示資料供給轉示控制部12。在接收_顯示資料 後，顯示控制部12控制顯示部30，以使顯示部3〇改變所 顯不的目標的圖像（步驟S34)(s也就是，一旦從按鍵等的 目標釋放了接觸，顯示控制部12便改變該目標的顯示圖 像。當要改變目標的顯示圖像時，例如可將已選擇的目標 進行如回到選擇前那樣的顯示，或者可改變目標的顏色或 壳度等。通過此種顯示的改變，可使操作者目視辨認出對 按鍵等的接觸已被釋放，因而較佳。 通過以上的動作’可顯示讓操作者感到按下時為“卡滋 (力y) ”、釋放時為“唧（于V)，’這樣的更真實的觸感。 當然，釋放觸感也可使用與點擊觸感相同的驅動信號，本 貫施形態中，可設定為與點擊觸感不同的形態的釋放觸感。 這樣’本實施形態的觸感顯示裝置1中，根據附加了 與觸感的顯示相關聯的情報的應用程式，來針對各目標設 定相應於對各目標的輸入而顯示的觸感。因此，觸感顯示 裝置1通過在既存的應用程式中實施一些改變，而能夠針 對各目標顯示適當的觸感。而且’本實施形態的觸感顯示 裝置1中，可相應於對目標的輸入來顯示點擊觸感、釋放 30 201239692 觸感等的各鋪感。因此，觸感顯示裝置1巾，能夠有效 利用既存的應用程式資源而不會造成浪費，此外，可提供 像操作現實的按鈕關時所獲得的那樣的真實的操作感:、 另外，本發明並不僅限定於所述實施形態，可進行一 些變形或變更。例如’本發明_感顯示裝置的硬件的構 成並不限定為如圖i所^的方顧的構成，還可設想各種 變形例或變更例。也就是，也可設想例如圖6所示的構成： 並未設置將對觸控感測器4〇的接觸的位置從輸入控制部 16通知給制程式執行部2()的雜，而是-直經由觸感 控制部14通知。通過以此方式構成，_夠成為將通知對觸 控感測器40的接觸的位置的部位設為一個部位以削減所 需的界面等容易硬體性地進行設計的構成。 而且，例如，所述實施形態中，已對控制部10中包括 顯示控制部12、觸感控制部14、輸入控制部16的構成進 行了說明。然而，本發明_錢示|置並不蚊於此種 構成，可根據設計時的要求而採用各種構成。例如，通過 使一功能部兼作其他功能部而發揮功能，而可省略所述其 他功能部，或將一功能部細分化為多個功能部。 此外，所述實施形態中’負載檢測部可根據觸控感測 器的接觸的檢測方式而構成。例如，在電阻膜方式的情況 下，/、要可根據基於由接觸面積所引起的電阻變化的輸出 信號的變化來檢測負載，則可不使用應變計感測器而構 成。或者，在靜電容量方式的情況下，在可根據基於靜電 容量的變化的輸出信號的變化來檢測負载的情況下，也可 31 201239692 ιΑ. 不使用應變計感測器而構成。 另外’觸感顯示部使用任意個數的壓電振動器而構 成’或者在觸控感測器的整個面設置透明壓電元件而構 成’只要可表現出顯示觸感的振動，則也可構成為使離心 馬達以驅動信號的1週期旋轉一次。此外，在負載檢測部 及觸感顯7F部使㈣電元件而構成的情況下，也可共享壓 電元件來構成負载檢測部及觸感顯示部。 所述實施形態中’設想將觸控感測器重疊配置在顯示 部的上表面的構成而進行了說明。然而，本發明的觸感顯 不裝置不必-定為此種構成，也可使觸控感測器與顯示部 在不同的部位隔開的構成。 本發明也可有效地應用於觸控感測器作為進行接通/ 斷開動作的觸摸開關而發揮功能的輸入裝置中。 而且，本發明的觸感顯示裝置在根據壓電元件的輸出 而檢測的壓貞載滿足顯示觸感的貞載基準時，驅動該壓 電兀件。此處’所謂根據壓電元件的輸出而檢賴按壓負 載滿足顯示觸感的負載基準時，可指檢測的按壓負載到達 顯示觸感的基準值時，也可指檢測的按㈣載超過顯示觸 感的基準值時，還可指根據壓電元件的輸出檢測到顯示觸 感的基準值時。 而且’就本實施形態的說日种的“顯示部，，及“觸控感測 器’’而言’也可由通過使共㈣基板等具備顯示部與觸控感 測器的兩個功能而一體化的裝置來構成。作為此種將顯示 部與觸控感測器的兩功能一體化的裝置的構成的一例，有 32 201239692, 在液晶面板所具有的矩陣狀排列的晝素電極群中有規則地 混合存在光電二極體等的多個光電轉換元件而成的裝置。 該裝置由液晶面板構造來顯示圖像，另一方面，利用接觸 輸入面板表面的所期望的位置的筆的前端來反射液晶顯示 用的背光模組的光，由周邊的光電轉換元件接收該反射 光，由此可檢測接觸位置。 雖然本發明已以較佳實施例揭露如上，然其並非用以 限定本發明，任何熟習此技藝者，在不脫離本發明之精神 和範圍内，當可作些許之更動與潤飾，因此本發明之保護 範圍當視後附之申請專利範圍所界定者為准。 【圖式簡單說明】 圖1是表示本發明的實施形態的觸感顯示裝置的概略 構成的方塊圖。 圖2A與圖2B是表示圖1所示的觸感顯示裝置的安裝 構造的一例的圖。 圖3是說明本實施形態的用戶界面的生成動作的圖。 圖4是表示圖1所示的觸感顯示裝置的點擊觸感顯示 動作的流程圖。 圖5是表示圖！所示的觸感顯示|置的釋放觸感顯示 動作的流程圖。 圖6是表示本發明的實施形態的觸感顯示裝置的概略 耩成的其他例的方塊圖。 圖。圖7是表雜想的觸感顯示裝置的概略構成的方塊 33 201239692 圖8是表示設想的觸感顯示裝置的動作的流程圖。 【主要元件符號說明】 1、2、100 :觸感顯示裝置 10、110 :控制部 12、112 :顯示控制部 14、114 :觸感控制部 16 :輸入控制部 20、120 :應用程式執行部 30、130 :顯示部 40、140 :觸控感測器 40a :接觸面 50、150 :觸感顯示部 51 :應變計感測器 52 :壓電振動器 60 :負載檢測部 61 :框體 62 :絕緣體 63 :上蓋 64 :絕緣體 A ·顯不區域 S1 〜S4、S11 〜S17、S31 〜S34、S100〜S106 :步驟 34When S 201239692 / δδοριί is associated, the application execution unit 120 does not perform the operation regarding the display or the touch. In this case, the tactile sensation is not displayed. = aspect 'step 21, when the position_corresponds to the position of the image of the display button or the target of the button, the display control unit 112 should supply the display data, and the display = the second capacity is sensed The display of the input. Here, the display in which the content is the sensed input refers to a display that can be visually confirmed by the operator, for example, a thumbnail of the button or the remaining target is reversed or _ indicates a state of the down button or the pressed state. Like waiting. Once the data is executed from the application, the display control unit 112 changes the image displayed by the display unit 130 according to the display; (step s, then the application execution unit 120 is: 114 has sensed To the input, the indication is made; ί来=:=r display means: the second pass: the instant door vibration 2 21 causes the contact surface of the touch sensor 140 to only vibrate, etc. Once received, the system 4 Department 114 proceeds to I in accordance with the instruction. . . . . . 曰Do not touch the control to display the specific _ mode. The contact angle of the contact surface of the sensor 140 is controlled to be 2, and the contact is touched by the touch position (step: the reminder operation by performing such a place === ___ target _==== As described above, the root: the touch. The application corresponds to the action of displaying the tactile sensation, and the action can be performed without any problem. 2012-69692. Also, Jing: I: As long as the touch is displayed in advance In the processed application, the action described above can appropriately display a specific tactile sensation. However, in the tactile display device, if an application that does not correspond to the tactile display is used, in this state, Even if the target does not change depending on the connection, the tactile sensation cannot be appropriately displayed. In the tactile display device 100, in order to effectively use various kinds of programming resources developed until the end of the process, It is necessary to change various applications and add processing corresponding to specific conditions to display the tactile sensation. Adding this = processing change must be performed for various fine programs, which is very laborious and costly. (4) Under the kind of things, In the future, it will become an obstacle The main reason why the company has joined the development of the application for the device is also the main reason for the popularity delay of the platform for controlling the sensor and the GUI. The contact is in the action as described above, according to the touch sensor 140. Corresponding to the lack of monitoring, it is determined whether the position of the contact and the target position application until the display of the target changes or the display of the tactile sensation are matters of interest to the squeezing execution unit 120. For development or design The application of the application is only required to be cumbersome, and the processing load of the application execution unit 120 of the execution type is increased. The intraoperative 1 is disclosed, for example, in Patent Document 1 and Patent Document 2. The technical touch is that when the contact is reduced and the contact is reduced, the sensor vibration is corresponding to the connection. Therefore, in the technique of the patent document 1 and the patent application, it is also assumed Even if you use the display with the tactile display, you can't display the tactile sensation properly. In particular, you will find the button switch like 201239692 ό/aeopif (push-type button). The device t is as long as it is gently touched by a finger or the like to display a tactile sensation. Therefore, an erroneous operation is caused by a light contact operation of a previous stage in which the operator presses (decreases) the touch. New Zealand's reaction is different. It is possible that in the technique described in the literature, even if the operator does not intend to hide by TF, it will also touch: The action (contact) of the detector shows the tactile sensation, which also brings the unintentional sensor to the inserter. In the case of the 骐 method, if the upper conductive film is in contact == in the case of the electrostatic capacitance mode, 』 = main j The electric nickname that is in contact shows the tactile sensation. In the device that displays the tactile sensation in advance, the application that uses the Sdrr touch sensor to display the tactile sensation is closed with the W. At the time, it is provided that the mechanical type is most used to inform the operator that the sensor has been sensed and that it has not been subjected to Y to vibrate the fine surface. Therefore, the tactile sensation displayed by the tactile display device, the actual operation of the operator k, and the operator k, however, simulate the reality in the user boundary 2 using the touch sensor and the GUI. In the case of the mechanical touch, etc., in the case of sensing the input of this kind of target, for the operation feeling of: 201239692 «7 / oovpif, it is still showing the true touch of the mechanical button switch. good. When the input to the displayed object is sensed, the feedback to the operator can be improved as long as the feedback such as pressing a real button or button can be performed. In the case of a mechanical push button switch, the operator presses the switch by applying a certain degree of pressing force, and a tactile sensation such as a metal dome switch can be obtained (hereinafter, referred to as a click sensation). ). Similarly, in the case of a mechanical push button switch, the operator is released, and the process towel of the Guanyi pressing force is pressed, and by reducing the pressing force to a certain degree, the metal dome switch can be returned to the original one. The thief of the state that was pressed (the following is called "turning the sensation"). Moreover, in the case of the mechanical push button switch, the operator does not display the click feeling even if the operator touches (contacts) the switch with a very weak pressing force, and the display is not displayed because the state of the 2 touch is not displayed. Release the touch. In the conventional touch display device using the touch sensor and the GUI, the click feeling and the release feeling like the mechanical button switch cannot be displayed. If you want to use it, you need to add it to the application. In order to realize the display of this sensation, it is necessary to display the sensation of the sensation. For the detection of the program input, the instruction, and instructions. In order to develop or design such a business: and worry about the implementation of the application [invention content] 12人12 201239692 J /oooplf Therefore, in view of the above circumstances, the end of the kind of device, and the material ^ The purpose of the transmission (10) is to control the control method of the device without wasting the existing application resources constituting the user interface and displaying the tactile sensation corresponding to the operation of the target operator. The tactile display I of the invention that achieves the purpose of the first aspect is included. a touch-sensing display unit that vibrates a contact surface of the touch sensor; a display unit; and a control unit that displays the information on the display unit based on the information “feeling the tactile sensation supplied by the application software” The target is set to the tactile sensation displayed by the tactile sense display portion. When the input to the target is sensed, the tactile sense display portion is controlled such that the tactile sense display portion presses the contact surface The dust object displays the tactile sensation set for the target. According to a first aspect of the invention, in the touch display device of the first aspect, the control unit is configured to display an indication associated with the display of the tactile sensation outputted together with the information associated with the display by the application software. And setting a tactile sensation displayed by the tactile display unit to the target. According to a third aspect of the invention, the first aspect or the second aspect of the touch display device further includes: a load detecting unit that detects a pressing load on a contact surface of the touch sensor; The control unit controls the tactile sense display unit to cause the load detecting unit to detect a pressing load that satisfies a load reference indicating a tactile sensation in a state in which an input to the target is sensed. The tactile sense display unit displays a tactile sensation to the pressed object. Further, in the method of controlling a touch display device according to the fourth aspect of the present invention, in the control method of the touch display device, the touch display device includes: a touch sensor 'tactile display portion' The contact surface vibration of the touch 13 201239692 u / ooupif sensor; and a display portion; the control method of the touch display device is based on the information indicating the tactile sensation supplied by the application software The target displayed in the portion sets the tactile sensation displayed by the tactile sense display portion. When the input to the target is sensed, the tactile sense display portion is controlled such that the tactile sense display portion presses the contact surface The pressed object displays the tactile sensation set for the target. According to the present invention, it is possible to provide a user interface which can effectively utilize an existing application without causing waste and which is excellent in operability by using such an application. The above and other objects, features and advantages of the present invention will become more <RTIgt; [Embodiment] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. The present invention is a tactile sensation display device that sets a tactile sensation to a target based on an emotion report for generating a user interface displayed on the display unit and information on a tactile sensation supplied by the application software. Moreover, the present invention does not display a tactile sensation when the touch is sensed, and does not display a tactile sensation, but consciously presses (pushes) the touch sensing to the operator. The operation of the device will display the touch. Fig. 1 is a block diagram showing a schematic configuration of a tactile display device according to an embodiment of the present invention. As shown in FIG. 1 , the touch display device 1 includes a control unit 10 , an application execution unit 20 , a display unit 3 , a touch sensor 4 , a tactile display unit 201239692 J /ooupif = , and a load detecting unit. 60. Further, the control unit 10 includes a display control unit 12, a tactile sensation control unit 14, and an input control unit 16. control. The 卩10 is controlled by the respective functional units of the tactile sensation display device 1 for the entire age of the tactile sensation display device 1. The application execution unit 20 reads various programs from the memory unit that has not been used, and executes the application based on the application. In addition, in the present embodiment, the application execution unit 20 executes the display corresponding to the tactile sensation. In the application, the situation in which the target setting is changed can be explained. A process of adding a change in the application to correspond to the display of the tactile sensation will be described later. The display unit 3 〇 displays the button switch in an image (the push button opens the target object). In addition, the button switch refers to: a button or a button, etc. (hereinafter, collectively referred to as a "button" In the present embodiment, the display unit 30 does not use an image to simulate the target of such a push button switch. The display unit 3 uses, for example, a liquid b 曰 display panel. Or the organic EL display panel, etc. The application execution unit 20 supplies information (display material) of an image or the like constituting the user interface to the display control unit 12 when the user interface is generated or when the image of the target is changed. When the information constituting the user interface is supplied, the display control unit 12 can display the display based on the information on the display unit 30. In the drawings and the following description, the "user interface" can be appropriately omitted as "Ur". The touch sensor 40 is generally disposed on the front surface of the display portion 3, and the touch surface of the corresponding touch sensor 40 senses an operator's finger or the like (pressing the object) to be displayed on the display portion 30. The target pressing operation (contact). Moreover, when the touch sensor 40 senses the contact with the contact surface, the position of the contact detected to 15 201239692 -J / is notified to the application via the input control unit 16 The touch sensor 40 is configured by a sensor of a known method such as a resistive film method, a capacitive method, or an optical type. The tactile sense portion 50 utilizes a piezoelectric vibrator (piez〇eiectrjc vibrator). And constituting 'the vibration of the contact surface of the touch sensor 40. The tactile display portion 50 generates a touch to the pressing object that presses the contact surface by causing the contact surface of the touch sensor 40 to vibrate. The pressing object that presses the contact surface is, for example, an operator's finger or a stylus pen, etc. The load detecting unit 6 detects a pressing load on the contact surface of the touch sensor 40, for example, using a strain gauge sensor. (strain gauge sensor) or a piezoelectric element or the like that is configured to react linearly with the load. Further, the load detecting unit 6〇 notifies the detected pressing load on the contact surface of the touch sensor 40 to the touch. Sense control unit 14 The display control unit 12 of the control unit 10 performs control on the display based on the display data supplied from the application execution unit 2, for example, causes the display unit p to display an image or the like in an image, or changes the image display or the like. The portion 12 receives the display material of the target used when generating the display unit 3 from the application execution unit 20. Further, the position of the display control unit 12 at the contact of the author with the touch sensor 40 is specific to the start. When the target of the target is the corresponding position, the application execution unit 2 reads the display data indicating the target that has received the input. The input control unit 16 sets the position of the operator's contact with the touch sensor 4A. 'Notice to the application execution unit 20 and the two sides of the tactile control system 14', or 201239692. The embodiment _ the remaining part 14 has a memory unit (not shown), and the application is executed by the application execution unit 2G. The program's instructions can instantly store information about the tactile sensations set for each target. That is, in the present embodiment, the touch of the target can be set in the tactile sensation control unit 14 as will be described later. Therefore, when the tactile sensation to the target is set in the tactile sensation control unit 14 in this manner, the input control unit 16 associates the contact area (4) with the positional notification = the touch 14 so that the tactile sensation control unit 14 can perform the touch. Sense of control. In other words, in this case, the application execution unit 2 performs the operation of the job display, and the notification of the touch sensor m is connected (4) to the position of the touch sensor. The control unit 16 receives a notification of the position of the touch sensor; the position of the 'off (four) contact corresponds to the position of the set 1 target. When the position of the notified contact corresponds to the position of the target of the touch, the touch control unit 14 = the display unit 50 causes the touch display unit 5 to display the fixed touch embodiment. 'The load detection unit (10) can also be used in the detection unit ιΛ艏°^1 'feeling sense (4): 〇 〇 与 与 与 与 〇 〇 〇 〇 〇 〇 〇 〇 〇 〇 〇 〇 满足 情况 情况 情况 情况 情况 情况 情况 情况 情况 显示 显示 显示Next, the touch display display unit 50 吝 ΓΐΜ〇 ΓΐΜ〇 displays the set tactile sensation. Further, the tactile sensation presses the vibration of the specific mode (pattem), thereby pressing the finger of the operator of the contact surface of the touch sensor 40, etc. 17 201239692^t W WL/aJ. The pressed object displays the set touch. 2A and 2B are views showing an example of an ampoule structure of the tactile display device 1 shown in Fig. 1. Fig. 2A is a cross-sectional view of a principal part, and Fig. 2B is a plan view of a main part. The display unit 30 is housed and held in the casing 61. The display unit Deng holds the insulator 62 including the elastic member while holding the touch sensor 4〇. Further, in the touch display device 1 of the present embodiment, the display unit 3A and the occlusion sensor 40 are formed in a rectangular shape in plan view. Further, in the tactile display display, the touch sensor 40 is held on the display portion 3A via the insulator 62, and the insulator 62 is disposed on the display portion % shown in the imaginary line in FIG. On the 4 corners of the area Α. Further, on the housing 61, an upper cover 63 is provided to cover the surface area of the touch sensor 40 away from the display area of the display unit 3, and the top cover 63 and the touch sensing are provided. Between the devices 40, an insulator 64 including an elastic member is disposed. In addition, in the touch sensor 40 shown in FIGS. 2A and 2B, the surface member having the contact surface 4A is composed of, for example, a transparent film or glass, and the back member is made of glass or acrylic acid resin. And constitute. The touch sensor 40 uses a sensor in which the pressing portion is subjected to a small amount of deflection (strain) corresponding to the pressing force or a small amount of deflection of the structure itself if the contact surface 40a is pressed. On the surface of the touch sensor 40, in the vicinity of each side covered by the top cover 63, a load (pressing force) applied to the touch sensor 40 is respectively provided by bonding or the like. The strain gauge sensor 51° is detected. Further, on the back surface of the touch sensor 40, a pressure 18 for vibrating the touch sensor 40 is respectively disposed in the vicinity of opposite sides of the touch sensor 40 by adhesion or the like. 201239692 J / uu Electric vibration benefit 52. That is, in the tactile display device 1 shown in FIGS. 2a and 2B, the load detecting portion 6G of FIG. 1 uses the four strain gauge sensors 51 to constitute the tactile sense portion 5 () using two The piezoelectric vibrator 52 is configured. Further, the touch sensing portion 4 is vibrated to vibrate the contact surface 40a. Further, the illustration of the frame body 61, the top cover 63, and the insulator 64 shown in Fig. 2A is omitted in Fig. 2B. Next, in the present embodiment, an operation of setting the touch corresponding to the touch to the tactile sensation control unit 14 in accordance with an instruction to add a changed application corresponding to the display of the tactile sensation will be described. In the present embodiment, as described above, by adding a change to the application, the correspondence between the target and the information related to the tactile sensation displayed corresponding to the input to the target is added in advance to the change program. In addition, if all the processes (judgments or indications) regarding the action of displaying the tactile sensation are added to the program corresponding to the display that is not in the position of the job, it is generally necessary to add various kinds of control information, and it is possible to Lead to increased costs. In the present embodiment, the information associated with the display of the UI in the information of the original application is added to the information associated with the display of the tactile sensation. Therefore, when W is first displayed on the display unit 3G or when the display of the melon is changed, the information associated with the display of m and the information associated with the tactile sensation of the target constituting the UI are supplied together. . Therefore, the information associated with the display of the tactile sensation is supplied from the application, and thus the tactile sensation control unit 14 sets the tactile sensation to each of the targets constituting the UI when the UI is first displayed or when the display of the UI is changed. In other words, at this time, the tactile sensation control 201239692 4 14 displays the target displayed on the display unit 30 based on the information indicating the tactile sensation supplied from the application executed by the application execution unit 20 located outside the control unit 10. The tactile sensation displayed on the tactile display unit 50 is set. Specifically, for example, in the application using the UI composed of the target, the position of the target is hoisted (that is, at which position in the region of the display of the display unit 30 is displayed in the display unit 30). Information) is defined. Moreover, in the application, the size information of the target (that is, the range of the touch sensor 40 corresponding to the position of the target is generally defined) is defined. In other words, the type of the tactile sensation to be displayed when the input to the target is sensed, and the condition at the time of displaying the tactile sensation, that is, the negatively pressed information are added to the application in advance, and (4) constitute U. Target location, size information. In the present embodiment, only by adding these emotions to the application, and depending on various conditions, it is possible to have various tactile sensations for the target of the configuration to be used. On the other hand, for example, just because the feeling is to be displayed, it is not necessary to attach a process of monitoring the contact of the touch sensor 4 (4), or the position of the contact corresponding to the position of the target, to the application. in. Fig. 3 is a flow chart for explaining generation of a user interface (UI) in the embodiment. The generation operation is provided by the newly generated application according to the instruction of the application added by the application execution unit: when the UI provided by the application is changed to a new UI, the operation is performed. In the newly generated U provided by the application, ^ 201239692 -J /ooupif f sets the target for the m❸ target, and the target is displayed after the UI display changes according to the application. The configuration has also changed. 'Because of the bribery situation, the UI must also set the touch. In the case of the generation of the m, the generation of the operation of the m is as follows: when the green money (four) UI is generated according to the application, and when the m is provided as a new m. In the flowchart shown in Fig. 3, the operation observed from the viewpoint of the control unit 1G will be described. When the operation is started, based on the application executed by the application execution unit 2, the information (display data) associated with the cut display of the generated t: application providing (10) is output to the display control unit 12. The page display control (4) 12 of the control unit 10 receives the information that is in accordance with the display. (In the application program used in the present embodiment, as described above, the information addition and the tactile sensation associated with the display of the hunger are displayed. The associated information is also included in the information associated with the cut display from the application output to the display unit 12, and the information associated with the touch corresponding to the input of the target constituting the UI. To this end, the control unit 10 touches, controls, and receives the information associated with the tactile sensation indicated by the input (4) of the corresponding job target (step S2). The sensation control unit 14 sets the tactile sensation displayed on the tactile display unit 50 for each target constituting the UI (step S3). At this time, the set tactile sensation is: Associated with the __ in the program In the case of the touch sensing, the contact position and the connection range in the touch sensor It 4G are set according to the position and the target displayed by the range _ to set the tactile sensation type 2 (for example, the metal dome switch) Or the touch of the rubber switch) or the strength of the touch, such as the strength of the feedback, etc. Moreover, according to the information associated with the tactile display attached to the application, for example, the target is set to be untouchable.所谓 准 。 。 。 。 。 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载 负载Specifically, for example, a relatively small (weak =) tactile sensation can be set for a small target. For example, in this case, the frequency of generating vibration can be increased or the vibration generated can be shortened. On the other hand, a relatively large (strong feedback) thief can be set for a large target. For example, in this case, the frequency at which vibration is generated can be reduced, or the time at which vibration is generated can be prolonged. Target In the case of, for example, the load reference of the display 戦 is set to be relatively small, and the touch is displayed by the operator's relatively weak pressing. ft. In the case of a large target, for example, the load reference setting for displaying the touch is displayed. In the case where the operator does not perform relatively strong pressing, the tactile sensation is not displayed. The tactile sensation control unit 14 stores the information of the tactile sensation set for each target in a memory unit (not shown). After the setting of the tactile sensation is completed in step S3, the control unit 1 performs the process of generating the UI (step S4). Specifically, the process of generating the UI may be an operation or the like according to the UI received by the display control unit 12. The associated information is displayed to cause the display unit 30 to draw an indication of χπ, or to associate with an application that is activated when an input to the 22 201239692 target is sensed. As described above, by performing the UI generation operation of the present embodiment, the UI is displayed on the display unit 30, and once the target constituting the UI is sensed, the preparation for displaying the tactile sensation is completed. Next, an operation when the tactile sensation display device i displays a tactile sensation corresponding to the pressing operation of the operator after the UI is displayed on the display unit 30 will be described. In the touch-sensing display device 1 of the present embodiment, when the touch sensor 40 senses that the operator touches the target displayed by the image in the display unit 30, the load load detected by the load detecting unit 60 is satisfied. A specific benchmark shows the tactile sensation. When the touch load detected by the load detecting unit 60 satisfies a specific criterion, the touch is sensed. The operator touches the touch sensor 40 as unintentionally (by mistake, etc.). Instead, the pressing (pushing) action is consciously performed. Fig. 4 is a flow chart showing the operation of the tactile display device 本 according to the embodiment. When the operation of the tactile sensation display device 1 is performed, in accordance with the Uj-f operation, the display unit 30 can display an image or the like in an image in advance so that the operator's finger, stylus, or the like can be sensed. operating. That is, the UI supplied by the changed response is displayed as T', and the UI of the touched setting is completed. Further, the application of this embodiment =, and the image 4 of the image of the object displayed in the display section 30. When the contact is sensed, in order to enable the operator to be able to sense the contact, the image of the target is actually set to be true, and this is not displayed. In the state in which the preparation is completed as described above, the tactile sensation 23 201239692 of the present embodiment does not start the operation of the device 1. The touch is first sensed, and the input control unit 16 monitors the presence or absence of the contact of the contact surface of the touch sensor 40, such as the palm of the first contact surface of the first contact surface of the first contact person (step s once It is sensed that the contact of the contact position of the contact sensor i in step 5 is input to the control unit 14 (step S12). After the application execution unit 20 and the touch control, In the GUI of the notification of the position of the contact in the controller 4, the f 2G determines whether the position of the contact is the current S13). When the position of the image of the target such as the iTL button corresponds (the position of the step application corresponds to the position of the target image, the change portion 2G is used to change the display according to the setting based on the program; The total amount is supplied to the display control unit 12. The received target unit 12 controls the display unit 30 to change the displayed first image (step S14). That is, the tactile display display device feels like a button, etc. In the case of the contact of the target, the image of the target Sir is changed. When the display image of the target is to be changed, it is preferable to be able to show that the button has been touched (touched), etc., for example, the display type is held. ΐ has been selected 'or to change the color or brightness of the target, etc. The display for changing the image of this image can be defied in various forms by setting based on the application. Whether or not - in S13, the contact control unit 16 can determine the contact. Location is salty ^. The position of the image indicating the target corresponds. Therefore, after the input of the target is received in step S13 (that is, the processing of the display of the touch after step S15 of the target such as the button or the like may be performed without the response 24 201239692 rr ίΪΪί::2::. The touch of the tactile sensation control unit 14 determines whether the detected push-to-load is increased by the touch sensing and the target 1 and the specific reference is satisfied. In addition, negative ', '. For example, according to the four strain gauges, the operator of the tester: the load of the normal two = reference is preferably a root such as 1. 5 N 2 V) Z T, the load is set to a value such as I n), and the setting can be changed thereafter. And this particular benchmark has taken into account the county's intention of the author's intention to suppress the negative pressure y, such as the average value, etc., so that it will not be set::; in order to make the operator unconsciously touch the operation in such a situation. It is not recognized as being operated by m um), and a feeling of pressing which is described later in order to give the operator a real tactile sensation. When the pressing load satisfies the specific reference in step SIS, the tactile sensation control unit 14 causes the contact surface of the touch sensor 40 to generate a specific vibration, and controls the tactile display portion 50 so that the tactile display portion 5 is displayed. Sense (step S16). In other words, the haptic control unit 14 controls the tactile sensation display unit when the load detecting unit 6 detects a pressing load that satisfies the load reference for displaying the tactile sensation in a state where the input to the target of the specific=processing is sensed. 5〇 to cause the tactile display unit 50 to display a tactile sensation. By this control, the tactile display unit 5 显示 displays the tactile sensation to the pressing object that presses the contact surface of the touch sensor 40. The touch feeling shown here is as described in Fig. 3, which means a tactile sensation set according to the information received from the * application. In the present embodiment, the tactile sensation displayed by the tactile sensation display unit % in the step S16 can be set as shown in the case of clicking the actual button or pressing the sister 25 201239692. Here, in order to feel the click feeling of the touch, the tactile sensation display device 1 stimulates the tactile sensation in the state where the operator feels the thorn state. That is, the touch display device! Until the load applied to the touch sensor 4〇 satisfies the reference for displaying the tactile sensation (for example, UN), when the load satisfies the reference, the piezoelectric vibrator 52 is driven by the specific driving signal to make the connection _ 4〇a The vibration stimulates the touch. Thereby, the thief display device 1 can display to the operator the same click sensation as that when pressing the button switch (push-press _ off). Therefore, for the operator, even if the virtual touch of the touch sensing wipes and the painting is performed, the same real click thief can be obtained as when the actual button switch is operated, and the touch can be sensed. The device 40 operates so that there is no sense of discomfort. Moreover, the operation can be operated in conjunction with the pressing of the "touch sensor 4", thereby preventing erroneous input caused by the individual contact. The driving signal when the touch is not displayed is also It is a fixed frequency, period (wavelength), waveform, and amplitude that stimulates the sense of touch, and can be appropriately set according to the click touch feeling displayed. For example, the click touch feeling represented by the metal dome switch used in the portable terminal is displayed. In other words, for example, the touch display unit 50 is driven by a driving signal of a chirp period of a fixed frequency of 170 Hz. The driving display unit 50 is driven by the driving signal so that the contact surface 40a is applied. When the pressing load of the specific reference is satisfied, the vibration is shaken at about 15 μm. Thereby, the actual click feeling can be displayed to the operator like when the actual button is clicked. Moreover, the pressing load is not satisfied in step S15. In the case of the specific reference 26, the tactile sensation control unit 14 determines the detection by the load detecting unit 60 based on the weakening of the pressing of the contact surface of the touch sensor 40. Whether the pressing load is zero (step S17). When the pressing load detected by the load detecting unit 60 is not zero in step S17, the operation of the touch sensor 40 by the operator is not released (released), Therefore, the tactile sensation control unit 14 returns to step S15 to continue the processing. On the other hand, if the pressing load detected by the load detecting unit 6A is zero in step S17, it can be determined that the operator has released (released). In the operation of the touch sensor 4A, the tactile sensation control unit 14 ends the operation shown in Fig. 4. Alternatively, the operation in step S17 may be performed instead of determining whether or not the pressing load detected by the load detecting unit 60 is zero. The action is set to determine whether the contact with the touch panel 4A has been sensed. In another aspect, in step S13, if the position of the contact does not correspond to the display target and the position of the image, The application execution unit 20 ends the graph axis. That is, in the case where the input of the hitting object is not sensed, or the sensed input does not correspond to the target 1' of the button or the like: the program execution unit 2〇 Does not change the display image of the target, it will not be 4 ° ° ^ 'In this case, the input control beam processing. This way ... touch H 14 hair 为 为 为 触 触 触 触 触 触 触 以外 以外 以外 以外 以外 以外 以外 14 14 可 可 可 可Operation Sensing ==Formation ΐIn the case of a target performing a specific action, the king-type supply of the thief load of the specific 贞-scale is displayed and the touch 27 set for the target is sensed and 'according to this embodiment By attaching information related to the display of the tactile sensation to the application, it is possible to set an appropriate tactile sensation for each target, and the operation of the tactile display is not required to be performed by the application execution unit 2. Therefore, The touch sensitive display device i of the present embodiment can display a tactile sensation corresponding to the target when the input is sensed, and can apply an existing application constituting the UI by adding information associated with the display of the tactile sensation. Further, in the tactile sensation display device 1 of the present embodiment, by pressing (pressing) the target of the button, the operator can recognize that the input of the target has been correctly recognized by the actual click haptic. Next, the operation of the tactile sensation display device 1 when the touch feeling is satisfied by detecting the pressing load that satisfies the reference in the state in which the touch is sensed by the operator, and then the touch feeling is released, and the tactile sensation is further displayed. When the normal mechanical push button switch is pressed, the pressing force of the switch is weakened, and the metal dome switch and the like are returned to the original untouched state (hereinafter, To release the touch). In the tactile sensation display device 1 of the present embodiment, the click touch feeling can be displayed in response to the pressing operation. Therefore, the real release touch is displayed in the middle of releasing (releasing) the touch sensor. Sense, can provide a whole series of more natural sense of operation. Fig. 5 is a flow chart showing the operation of the touch display device 1 of the embodiment. The operation shown in Fig. 5 is started after the action of displaying the touch strike (step S16) described in Fig. 4 is started. When the operation is started, the touch control unit 14 determines whether the pressing load detected by the load detecting unit 60 is from a specific one of the 28 201239692 due to the weakening of the pressing force of the operation of the touch panel 40 by the operator. Second, it means that the state in which the release of the released reference (or less than the specific secret) is determined is that the pressing load has changed from a specific reference or more (step ^=_section 5() is displayed by the application. The negative secret of the set release feeling can be set to be the same as the above-described load reference of the paste feeling at the time of pressing, but is preferably set to be 50% to 8 G% lower than the load reference for displaying the click sensation at the time of pressing. Such a value f is such that when the same position (target) is continuously pressed (that is, when the button is continuously tapped, the sequentially pressing and the releasing of the pressing are well matched with the tactile display timing, so that It shows that there is no; the true operation of the sense of coordination. That is, the load of the reference for displaying the tactile sensation at the time of 槪 is set to be less than the load of the reference for displaying the tactile sensation when pressed, and there is no sense of discomfort. In this case, by setting the load indicating the tactile sensation at the time of release to about 50% or more of the load indicating the tactile sensation at the time of pressing, the operability at the time of the continuous pressing operation can be further improved. The load indicating the tactile sensation at the time of release is set to be approximately 80% or less of the load indicating the tactile sensation at the time of pressing, and thus it is possible to cope with a slight load change in the holding state during the continuous pressing operation. The setting may be added to the application in advance as the information 29 201239692 associated with the display of the tactile sensation. After the release tactile sensation is displayed in step S32, the input control unit 16 determines whether the touch sensor 40 is not sensed. Contact (step S33). When the touch sensor 40 does not sense the contact, the input control unit 16 notifies the application execution unit 2 of the content whose contact has been released. Further, the application execution unit 20 The display data of the image to be changed by the application based on the application is supplied to the transfer control unit 12. After receiving the data, the display control unit 12 controls the display unit 30, The display unit 3 〇 changes the image of the displayed target (step S34) (sthat is, once the contact is released from the target of the button or the like, the display control unit 12 changes the display image of the target. When to change When the image is displayed on the target, for example, the selected target can be displayed as before returning to the selection, or the color or shell of the target can be changed, etc. The change of the display allows the operator to visually recognize the pair. It is preferable that the contact of the button or the like has been released, and the above operation 'can be displayed to make the operator feel that the card is pressed (force y) when pressed, and the other is "唧 (in V)," Actual touch. Of course, the release touch can also use the same driving signal as the click touch, and in the present embodiment, the release touch can be set to a form different from the click touch. In the touch display device 1 of the present embodiment, the tactile sensation corresponding to the input to each target is set for each target based on the application to which the information associated with the display of the tactile sensation is added. Therefore, the tactile sensation display device 1 can display an appropriate tactile sensation for each target by implementing some changes in the existing application. Further, in the tactile sensation display device 1 of the present embodiment, it is possible to display the touch feeling and the release feeling of the 201239692 tactile sensation in response to the input of the target. Therefore, the tactile display device 1 can effectively utilize the existing application resources without wasting waste, and can provide a real operational feeling as obtained when the button of the operation is closed: In addition, the present invention It is not limited to the above embodiment, and some modifications and changes can be made. For example, the configuration of the hardware of the present invention is not limited to the configuration of Fig. 1, and various modifications and changes are conceivable. That is, for example, a configuration shown in FIG. 6 is also conceivable: the position at which the contact with the touch sensor 4A is not set is notified from the input control portion 16 to the program execution portion 2(), but - The notification is directly notified via the touch control unit 14. In this configuration, it is possible to design a portion to notify the position of the contact with the touch sensor 40 as a single portion, and to reduce the required interface and the like, and to design it with ease. Further, for example, in the above-described embodiment, the configuration including the display control unit 12, the tactile sensation control unit 14, and the input control unit 16 in the control unit 10 has been described. However, the present invention is not limited to such a configuration, and various configurations can be employed depending on the design requirements. For example, by having one functional unit function as another functional unit, the other functional units may be omitted or a functional unit may be subdivided into a plurality of functional units. Further, in the above embodiment, the load detecting unit can be configured based on the detection method of the contact of the touch sensor. For example, in the case of the resistive film method, /, it is possible to detect the load based on a change in the output signal based on the change in resistance caused by the contact area, and it is possible to construct without using a strain gauge sensor. Alternatively, in the case of the electrostatic capacitance mode, in the case where the load can be detected based on a change in the output signal based on the change in electrostatic capacity, it is also possible to use 31 201239692 ιΑ. It is constructed without using a strain gauge sensor. In addition, the 'tactile display unit is configured by using any number of piezoelectric vibrators' or a transparent piezoelectric element is provided on the entire surface of the touch sensor to constitute 'as long as the vibration that can display the tactile sensation can be formed. In order to rotate the centrifugal motor once in one cycle of the drive signal. Further, when the load detecting unit and the tactile sense display 7F are configured as (four) electric elements, the piezoelectric detecting elements and the tactile sense display unit may be configured by sharing the piezoelectric elements. In the above embodiment, the configuration in which the touch sensors are superimposed on the upper surface of the display unit has been described. However, the tactile sensation device of the present invention does not have to have such a configuration, and the touch sensor can be separated from the display portion at a different portion. The present invention can also be effectively applied to an input device in which a touch sensor functions as a touch switch that performs an on/off operation. Further, the tactile sensation display device of the present invention drives the piezoelectric element when the pressure load detected based on the output of the piezoelectric element satisfies the load-bearing reference for displaying the tactile sensation. Here, when the load reference that satisfies the display tactile sensation is detected based on the output of the piezoelectric element, it may mean that the detected pressing load reaches the reference value for displaying the tactile sensation, and the detected (four) load exceeds the display touch. The reference value of the sense may also be when the reference value of the tactile sensation is detected based on the output of the piezoelectric element. Further, the "display portion" and the "touch sensor" of the present embodiment can be provided with two functions of a display portion and a touch sensor by using a common (four) substrate or the like. An integrated device is constructed. As an example of the configuration of the device that integrates the functions of the display unit and the touch sensor, there are 32 201239692, and the photodiodes are regularly mixed in the matrix electrode array of the liquid crystal panel. A device in which a plurality of photoelectric conversion elements such as a polar body are formed. The device is configured to display an image by a liquid crystal panel. On the other hand, the light of the backlight module for liquid crystal display is reflected by the front end of the pen that contacts the desired position on the surface of the input panel, and the reflection is received by the peripheral photoelectric conversion element. Light, whereby the contact position can be detected. While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing a schematic configuration of a touch display device according to an embodiment of the present invention. 2A and 2B are views showing an example of an attachment structure of the touch display device shown in Fig. 1. Fig. 3 is a view for explaining an operation of generating a user interface in the embodiment; Fig. 4 is a flowchart showing the click tactile display operation of the touch display device shown in Fig. 1; Figure 5 is a diagram! The illustrated tactile display | set of release tactile display action flow chart. Fig. 6 is a block diagram showing another example of the schematic configuration of the tactile sensation display device according to the embodiment of the present invention. Figure. Fig. 7 is a block diagram showing a schematic configuration of a tactile sensation display device. Fig. 8 is a flowchart showing the operation of the intended tactile display device. [Description of main component symbols] 1, 2, 100: Touch display device 10, 110: Control unit 12, 112: Display control unit 14, 114: Touch control unit 16: Input control unit 20, 120: Application execution unit 30, 130: display portion 40, 140: touch sensor 40a: contact surface 50, 150: tactile display portion 51: strain gauge sensor 52: piezoelectric vibrator 60: load detecting portion 61: frame 62 : Insulator 63 : Upper cover 64 : Insulator A · Display areas S1 to S4, S11 to S17, S31 to S34, S100 to S106: Step 34