TW201140394A - Indicated position detecting apparatus and indicated position detecting method - Google Patents

Indicated position detecting apparatus and indicated position detecting method Download PDF

Info

Publication number
TW201140394A
TW201140394A TW99135043A TW99135043A TW201140394A TW 201140394 A TW201140394 A TW 201140394A TW 99135043 A TW99135043 A TW 99135043A TW 99135043 A TW99135043 A TW 99135043A TW 201140394 A TW201140394 A TW 201140394A
Authority
TW
Taiwan
Prior art keywords
microphone
time difference
microphones
arrival time
display screen
Prior art date
Application number
TW99135043A
Other languages
Chinese (zh)
Other versions
TWI448931B (en
Inventor
Toshiharu Nishino
Tetsushi Yoshida
Kunpei Kobayashi
Makoto Iwasaki
Original Assignee
Casio Computer Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2009254511A external-priority patent/JP5024355B2/en
Priority claimed from JP2010052456A external-priority patent/JP4968353B2/en
Application filed by Casio Computer Co Ltd filed Critical Casio Computer Co Ltd
Publication of TW201140394A publication Critical patent/TW201140394A/en
Application granted granted Critical
Publication of TWI448931B publication Critical patent/TWI448931B/en

Links

Landscapes

  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An indicated position detecting apparatus includes a display module having a display screen, and a plurality of microphones to detect a contact sound to the display screen. The plurality of microphones each are arranged separately around an outer peripheral portion of the display screen. A time difference acquisition unit acquires arrival time differences of the contact sound between two microphones in each of two combinations of the plurality of microphones. A positional information acquisition unit derives a hyperbola based on each of the arrival time differences acquired by the time difference acquisition unit, each hyperbola having focal point corresponding to the arrival time differences between the two microphones in each of the two combinations of the plurality of microphones, and acquires an intersection of the two derived hyperbolas as a position information where the contact sound is generated.

Description

201140394 六、發明說明: 〔相關申請案的交互參考〕 本發明依據2009年10月16日提出申請之習知曰本專 利申請案第2009-238796號、2009年11月6日提出申請之 習知日本專利申請案第2009-254511號、2010年3月1〇曰 提出申請之習知日本專利申請案第2010-052456號’主張其 優先權,其所有內容透過引用倂入於此。 【發明所屬之技術領域】 本發明係關於檢測對顯示畫面之指示位置的技術。 【先前技術】 以往,以被設在 LCM (Liquid Crystal Panel Module) 或CRT ( cathode-ray tube )等顯示裝置,用以指示顯示裝 置之顯示畫面中之任意位置的裝置而言,已知有電阻膜方 式的觸控面板。電阻膜方式的觸控面板係例如在作爲基底 的玻璃面表面夾著間隔件黏貼薄膜,在玻璃與薄膜之兩者 的相對向面設有被稱爲IT0( Indium Tin Oxide)之透明電 極格子的構造。在該觸控面板中,以筆或手指按壓薄膜側 的表面時,ITO會在相當於該位置的場所呈導通,因此藉 由測定相當於指示位置的電阻份的電壓可檢測指示位置 (例如日本特開2009-48653號公報)。 在電阻膜方式的觸控面板中’藉由設有電極格子的薄 膜來覆蓋顯示裝置的顯示畫面乃爲不可或缺。此往往會造 成LCM等的顯示特性降低。 201140394 【發明內容】 本發明之指示位置檢測裝置之態樣之—係具備:顯示 模組,其具有顯示畫面;複數個麥克風,其彼此分離配置 在前述顯示畫面的外周部’檢測對前述顯示畫面的接觸 音;時差取得部,其對2種前述麥克風之組合,取得2個 前述麥克風間之前述接觸音的到達時間差;及位置資訊取 得部,其按照藉由前述時差取得部取得的每個前述到達時 間差,導出以與該到達時間差對應之前述麥克風作爲焦點 的雙曲線,取得該所導出的2個雙曲線的交點作爲產生前 述接觸音的位置資訊。 此外,本發明之指示位置檢測裝置之其他態樣之一係 具備:顯示模組,其具有顯示畫面;複數個麥克風,其彼 此分離配置在前述顯示畫面的外周部,檢測從前述顯示畫 面上的3次元空間所發出的指示音;時差取得部,其對3 種前述麥克風之組合’取得2個前述麥克風間之前述指示 音的到達時間差;及位置資訊取得部,其按照藉由前述時 差取得部取得的每個前述到達時間差,導出以與該到達時 間差對應之前述麥克風作爲焦點的雙曲面,將該所導出的 3個雙曲面的交點作爲發出前述指示音的位置資訊。 此外’本發明之指示位置檢測方法之態樣之—係包 含:時差取得步驟’其對2種麥克風的組合,取得彼此分 離配置在則述顯示畫面的外周部的複數個麥克風中之2個 麥克風間之前述接觸音的到達時間差,俾以檢測對於顯示 201140394 模組中之顯示畫面的接觸音;及位置資訊取得步驟,其按 照在前述時差取得步驟中所取得的每個前述到達時間差, 導出以與該到達時間差對應的前述麥克風作爲焦點的雙曲 線,取得該所導出的2個雙曲線的交點作爲產生前述接觸 音的位置資訊。 此外,本發明之指示位置檢測方法之其他態樣之一係 包含:時差取得步驟’其對4種麥克風的組合,取得彼此 分離配置在前述顯示畫面的外周部的4個麥克風中的2個 麥克風間之前述接觸音的到達時間差,俾以檢測對於顯示 模組中之顯示畫面的接觸音;及位置資訊取得步驟,其按 照在前述時差取得步驟中所取得的每個前述到達時間差, 導出以與該到達時間差對應的前述麥克風作爲焦點的雙曲 線’根據該所導出的雙曲線取得產生前述接觸音的位置資 訊。 此外’本發明之指示位置檢測方法之其他態樣之一係 包含:時差取得步驟’其對3種麥克風之組合,取得彼此 分離配置在前述顯示畫面的外周部的複數個麥克風中的2 個麥克風間之前述指示音的到達時間差,俾以檢測從顯示 模組中之顯示畫面上的3次元空間所發出的指示音;及位 置資訊取得步驟’其按照藉由前述時差取得步驟取得的每 個前述到達時間差,導出以與該到達時間差對應的前述麥 克風作爲焦點的雙曲面,取得該所導出的3個雙曲面的交 點作爲發出前述指示音的位置資訊。 201140394 此外,本發明之指示位置檢 包含:時差取得步驟,其對4種 分離配置在前述顯示畫面的外周 麥克風間之前述指示音的到達時 組中之顯不畫面上的3次元空間 資訊取得步驟,其按照在前述時 個前述到達時間差,導出以與該 克風作爲焦點的雙曲面,根據該 前述指示音的位置資訊。 本發明之優點將於以下說明 以下說明中顯然得知、或將透過 明之優點可由以下特別指出之手 【實施方式】 插入且構成本說明書之一部 實施例,且連同以上一般說明與 以闡明本發明之要素。 〔第1實施形態〕 以下,說明本發明之實施形 之指示位置檢測裝置之第1實施 .本.實施形態之指示位置檢測 或畫像的LCM1的顯示畫面中的 沏I顯示畫面上之2次元平面的指 示位置檢測裝置係由:lcmi、m 測方法之其他態樣之一係 麥克風之組合,取得彼此 部的4個麥克風中的2個 間差,俾以檢測從顯示模 所發出的指示音;及位置 差取得步驟中所取得的每 到達時間差對應的前述麥 所導出的雙曲面取得發出 中闡明,且部分優點將由 本發明之實施習得。本發 段及組合實現並獲得。 分的附圖係圖解本發明之 以下實施例詳細說明,用 態。第1圖係顯示本發明 形態的構成圖。 裝置係用以檢測顯示文字 任意指示位置。亦即,檢 示位置作爲指示位置。指 :在LCM1之顯示畫面側的 201140394 4個麥克風2A、2B、2C、2D(參照第2A圖及第2B圖)、 放大器3、A/D轉換器4、位置取得部5所構成。 第1圖所示之LCM1係透過型,具有:表面側與背面 側的2片透明玻璃基板11、12;被封入兩玻璃基板11、12 間的液晶1 3 ;及分別貼附在玻璃基板1 1、1 2之外面的偏光 板 14、15。 在背側的玻璃基板1 2的內面係形成有透明的像素電 極16的圖案,在像素電極16中與像素對應的部分分別形 成有’TFT (Thin Film Transistor) 17。在表面側之玻璃基板 11的內面,使具有預定色配列的濾色片18與透明的共用電 極19依序層積而形成圖案。 表面側之偏光板14的周圍係藉由形成有顯示窗20 a之 開口的框架蓋20所覆蓋。在以下說明中,在LCM1的顯示 面(表面側的偏光板14的表面)將可由顯示窗20a辨識的 區域稱爲LCM1的顯示畫面la。在使用LCM1時,在背面 側的偏光板15的背面設有由導光板或背光所構成的面光 源。此外,在顯示窗20a可視需要設置透明的保護蓋。此 外,顯示畫面la係形成爲矩形形狀。 另一方面,構成指示位置檢測裝置的4個麥克風2A' 2B、2C、2D係配置在顯示窗20a的內側。第2A圖係對LCM1 之顯示畫面la之各麥克風2A、2B、2C、2D的配置圖。在 以下說明中,藉由將各麥克風2A、2B、2C、2D稱爲第1 〜第4麥克風,以將各麥克風作區別。 201140394 如第2A圖所示,第1〜第4麥克風2A〜2D係以位於 顯示畫面la之外周部的方式配置在顯示畫面la的各邊。 具體說明之,第1〜第4麥克風2A〜2D係在矩形顯示畫面 la的中心Q呈正交,並且在與顯示畫面la呈平行的平面, 亦即在與顯示畫面la相對向的同一平面存在的2條直線 L、Μ上分別成對配置。亦即,第1及第3麥克風2A、2C 係在與顯示畫面la的長邊呈平行的一直線L上成對配置, 而且第2及第4麥克風2B、2D係在與顯示畫面la的短邊 平行的另一直線Μ上成對配置。 接著,第1〜第4麥克風2Α〜2D係在不同的位置個別 檢測在第2Β圖所例示之顯示畫面1 a的任意指示位置Ρ所 產生的指示音’作爲類比的音響訊號而分別輸出至放大器 3 0 第1〜第4麥克風2 A〜2D所檢測的指示音係如第1圖 所示之預定的觸控筆30所發出的指示音、或筆型的任意指 示具的前端或指尖等抵接時在顯示畫面la的表面所產生的 聲音。亦即,第1〜第4麥克風2A〜2D所檢測的指示音係 在指示者指示出顯示畫面la之任意位置時在顯示畫面 la、或顯示畫面la的附近所產生的接觸音。 其中’觸控筆30係包含,·· .感測器或開關,係用以感測 例如抵接到顯示畫面la的情況;及小型揚聲器或峰鳴器等 放音部’係設在抵接於顯示畫面1 a的前端部側,在感測到 前端部抵接到顯示畫面la的時點,發出周期性發訊音作爲 201140394 接觸音。 放大器3係將第1〜第4麥克風2A〜2D所輸出的類比 的音響訊號放大,A/D轉換器4係將藉放大器3放大後的 音響訊號轉換成數位訊號。 位置取得部5係由例如包含CPU ( Central Processing Unit )、輸出入介面等周邊電路、記憶有預定程式的記憶 體、及作業用記憶體的微電腦所構成,亦發揮作爲本發明 的時差取得部5a、及位置資訊取得部5b之功能。且,位置 取得部5係從藉A/D轉換器4被轉換成數位訊號後的第1 〜第4麥克風2A〜2D的輸出訊號(音響訊號),藉由使用 雙曲線法之後述順序來取得表示藉第1〜第4麥克風2A〜 2D檢測到的指示音發生源的指示位置資訊,並將所取得的 指示位置資訊供給至其他裝置。 如第3圖所示,位置取得部5所取得的指示位置資訊 係將顯示畫面la之特定角(第3圖中的左下角)設爲原點 0 ( 0,0 )的XY座標系的座標位置(X,y )。位置取得部5 供給指示位置資訊的對象爲任意,例如爲控制LCM 1所顯 示的資訊(文字或影像)的個人電腦。 接著,針對位置取得部5中之座標位置(X,y)的取 得順序加以說明。位置取得部5係周期性取得第1〜第4 麥克風2A〜2D中之輸出訊號中之音壓位準的變化(亦可 固定取得)。 第4A圖係方便顯示檢測到指示音時之第1〜第4麥克 -10· 201140394 風2A〜2D之輸出訊號中之音壓位準的變化圖,橫軸爲時 間’縱軸爲音壓位準。此外,音壓位準係按照預先假想的 指示音中之輸出訊號的特定頻率頻帶中的音壓位準。 接著’如第4A圖所示,位置取得部5係在第1〜第4 麥克風2A〜2D之各個麥克風中之音壓位準以些微的時間 差呈現峰値時’亦即檢測到指示音時,取得先前說明之彼 此成對的麥克風間之指示音的到達時間差。亦即,藉由時 差取得部5a來取得第1及第3麥克風2A、2C中之指示音 的到達時間差tAC、及第2及第4麥克風2B、2D中之指示 音的到達時間差tBD。 若具體說明之,時差取得部5a係對從任意時點起算的 經過時間進行計數,藉由以第3麥克風2C檢測到指示音的 時點(在音壓位準呈現峰値的時點)的經過時間,減去第 1麥克風2A檢測到指示音的時點的經過時間,而取得第1 及第3麥克風2A、2C側的到達時間差uc。 因此’第1及第3麥克風2A、2C側的到達時間差Uc 爲’指示音的發訊源(指示位置P )如第3圖所示般在比 第3麥克風2C更爲接近第1麥克風2A時成爲正値,相反 地’在比第1麥克風2A更爲接近第3麥克風2C時則成爲 負値。 此外’時差取得部5a係藉由以第4麥克風2D檢測到 指示音的時點的經過時間,減去第2麥克風2B檢測到指示 音的時點的經過時間而取得第2及第4麥克風2B、2D側的 -11 - 201140394 到達時間差tBD。 因此’第2及第4麥克風2B、2D側的到達時間差tBD 爲’當指示音的發訊源(指示位置P )如第3圖所例示般 在比第4麥克風2D更爲接近第2麥克風2B時成爲正値, 相反地,在比第2麥克風2B更爲接近第4麥克風2D時則 成爲負値。 在此’第1及第3麥克風2A、2C側的到達時間差tAC 係表示至各個麥克風中之指示位置P爲止的距離差,同樣 地’第2及第4麥克風2B、2D側的到達時間差tBD係表示 至各個麥克風中之指示位置P爲止的距離差。亦即,一組 麥克風間的指示音的到達時間差(tAC:,tBD )乘以音速的値 的絶對値是到一組麥克風間之指示位置P爲止的距離差。 與第1及第3麥克風2A、2C相距的距離的差爲一定的 點係存在於以麥克風2A、2C兩者作爲焦點的雙曲線上,同 樣地與第2及第4麥克風2B、2D相距的距離的差爲一定的 點係存在以麥克風2A、2C兩者作爲焦點的雙曲線上。 因此,如第4B圖所示,以第1及第3麥克風2A ' 2C 爲焦點的雙曲線1 〇s、i 0t中接近指示位置p之側的雙曲線 (以下稱爲第1雙曲線)l〇s、及以第2及第4麥克風2B、 2D爲焦點的雙曲線20s、20t中接近指示位置P之側的雙曲 線(以下稱爲第2雙曲線)20s的交點係成爲指示位置P。 第4B圖所示之一雙曲線i〇s、i〇t與另一雙曲線20s、20t 僅爲方便顯示者,雙曲線的形狀或位置關係與實際上不同。 •12- 3 201140394 在XY座標系中,2個焦點存在於x軸上的雙曲線係當 將從兩焦點至雙曲線上的點爲止的距離差設爲2a,將兩焦 點間的距離設爲2c時,藉由下式(1)予以表示。201140394 VI. Description of the invention: [Reciprocal reference of related application] The present invention is based on the prior art of the application of the application of the patent application No. 2009-238796, filed on November 6, 2009 Japanese Patent Application No. 2009-254511, the entire disclosure of which is hereby incorporated by reference in its entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire entire all TECHNICAL FIELD OF THE INVENTION The present invention relates to a technique for detecting an indicated position on a display screen. [Prior Art] In the related art, a device such as an LCM (Liquid Crystal Panel Module) or a CRT (Cathode-ray tube) is used to indicate an arbitrary position in the display screen of the display device. Membrane type touch panel. In the resistive film type touch panel, for example, a film is adhered to a surface of a glass surface as a substrate, and a transparent electrode grid called IT0 (Indium Tin Oxide) is provided on an opposing surface of both the glass and the film. structure. In the touch panel, when the surface of the film side is pressed by a pen or a finger, the ITO is turned on at a position corresponding to the position, and therefore the position can be detected by measuring the voltage of the resistance portion corresponding to the indicated position (for example, Japan) JP-A-2009-48653). In a resistive film type touch panel, it is indispensable to cover a display screen of a display device by a film provided with an electrode grid. This tends to cause a decrease in display characteristics such as LCM. [Invention] The aspect of the pointing position detecting device of the present invention includes: a display module having a display screen; and a plurality of microphones disposed apart from each other at an outer peripheral portion of the display screen to detect the display screen a contact sound acquisition unit that acquires a time difference of arrival of the contact sound between the two microphones for a combination of two types of microphones, and a position information acquisition unit that performs each of the foregoing by the time difference acquisition unit The arrival time difference is derived, and a hyperbola with the aforementioned microphone corresponding to the arrival time difference is derived as a focus, and an intersection of the two derived hyperbolas is obtained as position information for generating the contact sound. Further, another aspect of the pointing position detecting device of the present invention includes: a display module having a display screen; and a plurality of microphones disposed apart from each other on an outer peripheral portion of the display screen, and detecting from the display screen a command sound emitted by the three-dimensional space; a time difference acquisition unit that acquires an arrival time difference of the instruction sound between the two microphones for the combination of the three types of microphones; and a position information acquisition unit that obtains the time difference acquisition unit by the time difference acquisition unit Each of the acquired arrival time differences is derived from a hyperboloid having the microphone corresponding to the arrival time difference as a focus, and the intersection of the three hyperboloids derived is used as position information for emitting the indication sound. Further, the aspect of the indication position detecting method of the present invention includes a time difference obtaining step of combining two types of microphones, and acquiring two microphones of a plurality of microphones disposed apart from each other on the outer peripheral portion of the display screen. a difference in arrival time between the aforementioned contact sounds to detect a contact sound for displaying a display screen in the 201140394 module; and a position information obtaining step of deriving each of the aforementioned arrival time differences obtained in the time difference obtaining step The hyper-curve of the microphone corresponding to the arrival time difference is used as a hyperbola of the focus, and the intersection of the two hyperbola derived is obtained as position information for generating the contact sound. Further, in another aspect of the indication position detecting method of the present invention, the time difference obtaining step includes a combination of four kinds of microphones, and two microphones of four microphones disposed apart from each other on the outer peripheral portion of the display screen are obtained. a difference in arrival time between the contact sounds to detect a contact sound with respect to a display screen in the display module; and a position information obtaining step of deriving each of the aforementioned arrival time differences obtained in the time difference obtaining step The hyperbola of the aforementioned microphone corresponding to the arrival time difference as a focus acquires position information for generating the aforementioned contact sound based on the derived hyperbola. Further, 'one of the other aspects of the pointing position detecting method of the present invention includes a time difference obtaining step' which combines three types of microphones and acquires two microphones among a plurality of microphones which are disposed apart from each other on the outer peripheral portion of the display screen a difference in arrival time between the aforementioned indicator sounds, to detect an indication sound emitted from a 3-dimensional space on the display screen in the display module; and a position information acquisition step 'in accordance with each of the foregoing steps obtained by the aforementioned time difference obtaining step The arrival time difference is derived, and a hyperboloid with the aforementioned microphone corresponding to the arrival time difference is derived as a focal point, and the intersection of the three hyperboloids derived is obtained as position information for emitting the indication sound. 201140394 Further, the pointing position detection according to the present invention includes a time difference obtaining step of acquiring a three-dimensional space information obtaining step on the display screen of the four types of the arrival sounds of the indicator sounds disposed between the outer peripheral microphones of the display screen. According to the aforementioned arrival time difference, the hyperboloid with the gram wind as the focus is derived according to the position information of the aforementioned indication sound. Advantages of the Invention The advantages of the present invention will be apparent from the following description, or the advantages of the present invention may be inserted in the form of the following embodiments, and constitute an embodiment of the present specification, together with the above general description and The elements of the invention. [First Embodiment] Hereinafter, a first embodiment of the instruction position detecting device according to the embodiment of the present invention will be described. The second dimension plane on the display screen of the display screen of the LCM1 indicating the position detection or image of the embodiment is described. The indication position detecting device is composed of: lcmi, one of the other aspects of the m measurement method is a combination of microphones, and obtains a difference between two of the four microphones of each other to detect an indication sound emitted from the display mode; And the above-mentioned wheat-derived hyperboloid acquisition corresponding to each time difference obtained in the position difference obtaining step is explained, and some advantages will be learned by the implementation of the present invention. This issue and combination are implemented and obtained. BRIEF DESCRIPTION OF THE DRAWINGS The following drawings illustrate the following embodiments of the invention in detail. Fig. 1 is a view showing the configuration of the embodiment of the present invention. The device is used to detect any position indicated by the displayed text. That is, the detection position is used as the indication position. It is composed of four microphones 2A, 2B, 2C, and 2D (see FIGS. 2A and 2B) on the display screen side of the LCM 1, and an amplifier 3, an A/D converter 4, and a position acquisition unit 5. The LCM1 transmission type shown in Fig. 1 has two transparent glass substrates 11 and 12 on the front side and the back side, and liquid crystals 13 sealed between the two glass substrates 11 and 12, and attached to the glass substrate 1 respectively. 1, polarized plates 14, 15 outside the outer surface. A pattern of transparent pixel electrodes 16 is formed on the inner surface of the back glass substrate 12, and a portion corresponding to the pixels in the pixel electrodes 16 is formed with a 'TFT (Thin Film Transistor) 17. On the inner surface of the glass substrate 11 on the front surface side, a color filter 18 having a predetermined color arrangement and a transparent common electrode 19 are sequentially laminated to form a pattern. The periphery of the polarizing plate 14 on the front side is covered by a frame cover 20 on which an opening of the display window 20a is formed. In the following description, an area recognizable by the display window 20a on the display surface of the LCM 1 (the surface of the polarizing plate 14 on the front side) is referred to as a display screen 1a of the LCM 1. When the LCM 1 is used, a surface light source composed of a light guide plate or a backlight is provided on the back surface of the polarizing plate 15 on the back side. Further, a transparent protective cover may be provided in the display window 20a as needed. Further, the display screen la is formed in a rectangular shape. On the other hand, the four microphones 2A' 2B, 2C, and 2D constituting the pointing position detecting device are disposed inside the display window 20a. Fig. 2A is a layout view of the respective microphones 2A, 2B, 2C, and 2D of the display screen 1a of the LCM 1. In the following description, each of the microphones is distinguished by referring to each of the microphones 2A, 2B, 2C, and 2D as the first to fourth microphones. As shown in Fig. 2A, the first to fourth microphones 2A to 2D are arranged on the respective sides of the display screen 1a so as to be located outside the display screen 1a. Specifically, the first to fourth microphones 2A to 2D are orthogonal to the center Q of the rectangular display screen 1a, and exist on a plane parallel to the display screen la, that is, in the same plane as the display screen la. The two straight lines L and Μ are arranged in pairs. In other words, the first and third microphones 2A and 2C are arranged in pairs on a straight line L parallel to the long side of the display screen 1a, and the second and fourth microphones 2B and 2D are arranged on the short side of the display screen la. The other parallel lines are arranged in pairs. Next, the first to fourth microphones 2A to 2D are individually detected at different positions, and the indication sound generated by the arbitrary indication position of the display screen 1a illustrated in the second figure is output as an analog sound signal to the amplifier. 3 0 The first to fourth microphones 2 A to 2D detect the sounds indicated by the predetermined stylus 30 shown in Fig. 1, or the tip or fingertip of any type of pen type. The sound produced on the surface of the display screen la when abutting. In other words, the indicator sounds detected by the first to fourth microphones 2A to 2D are the contact sounds generated on the display screen la or the vicinity of the display screen la when the pointer indicates an arbitrary position on the display screen 1a. Wherein, the 'stylus 30 includes, for example, a sensor or a switch for sensing, for example, a contact with the display screen la; and a small speaker or a buzzer, etc. On the front end side of the display screen 1a, when the front end portion is sensed to abut on the display screen la, a periodic sound is emitted as the 201140394 contact sound. The amplifier 3 amplifies the analog audio signals output from the first to fourth microphones 2A to 2D, and the A/D converter 4 converts the audio signal amplified by the amplifier 3 into a digital signal. The position acquisition unit 5 is configured by, for example, a microcomputer including a CPU (Central Processing Unit), a peripheral circuit such as an input/output interface, a memory in which a predetermined program is stored, and a work memory, and also functions as a time difference acquisition unit 5a of the present invention. And the function of the location information acquisition unit 5b. Further, the position obtaining unit 5 obtains an output signal (audio signal) from the first to fourth microphones 2A to 2D converted into a digital signal by the A/D converter 4, and obtains the sequence by the hyperbola method described later. The indicated position information of the source of the indication sound detected by the first to fourth microphones 2A to 2D is indicated, and the obtained instruction position information is supplied to another device. As shown in FIG. 3, the position information acquired by the position acquisition unit 5 sets the specific angle of the display screen 1a (the lower left corner in FIG. 3) to the coordinates of the XY coordinate system of the origin 0 (0, 0). Position (X, y). The position acquisition unit 5 supplies an arbitrary object to the position information, and is, for example, a personal computer that controls the information (character or video) displayed by the LCM 1. Next, the order of obtaining the coordinate position (X, y) in the position obtaining unit 5 will be described. The position acquisition unit 5 periodically acquires changes in the sound pressure level in the output signals in the first to fourth microphones 2A to 2D (which can also be fixedly obtained). Fig. 4A is a diagram showing the change of the sound pressure level in the output signals of the first to fourth mics-10·201140394 wind 2A to 2D when the indication sound is detected, and the horizontal axis is the time 'the vertical axis is the sound pressure level quasi. In addition, the sound pressure level is based on the sound pressure level in a specific frequency band of the output signal in the pre-imaginary indicator sound. Then, as shown in FIG. 4A, when the sound pressure level in each of the microphones of the first to fourth microphones 2A to 2D is peaked with a slight time difference, that is, when the indicator sound is detected, The difference in arrival time of the indicator sound between the microphones paired with each other as previously described is obtained. In other words, the time difference obtaining unit 5a acquires the arrival time difference tAC of the indicator sounds in the first and third microphones 2A and 2C and the arrival time difference tBD of the indicator sounds in the second and fourth microphones 2B and 2D. Specifically, the time difference acquisition unit 5a counts the elapsed time from an arbitrary time point, and the elapsed time when the third microphone 2C detects the indication sound (the time at which the sound pressure level exhibits a peak) is The elapsed time of the time when the first microphone 2A detects the indication sound is subtracted, and the arrival time difference uc of the first and third microphones 2A and 2C is obtained. Therefore, the source of the arrival time difference Uc of the first and third microphones 2A and 2C is the source of the indication sound (the indication position P), and when it is closer to the first microphone 2A than the third microphone 2C, as shown in FIG. When it is positive, it is negative when it is closer to the third microphone 2C than the first microphone 2A. In addition, the time difference acquisition unit 5a acquires the second and fourth microphones 2B and 2D by subtracting the elapsed time when the second microphone 2B detects the indication sound by the elapsed time when the fourth microphone 2D detects the indication sound. Side -11 - 201140394 arrival time difference tBD. Therefore, the arrival time difference tBD of the second and fourth microphones 2B and 2D is 'the source of the instruction sound (instruction position P) is closer to the second microphone 2B than the fourth microphone 2D as illustrated in Fig. 3 The time is positive, and conversely, when it is closer to the fourth microphone 2D than the second microphone 2B, it becomes negative. The arrival time difference tAC on the side of the first and third microphones 2A and 2C indicates the difference in distance to the indication position P in each of the microphones. Similarly, the arrival time difference tBD on the second and fourth microphones 2B and 2D is the same. The difference in distance to the indicated position P in each microphone is indicated. That is, the absolute time 乘 of the arrival time difference (tAC:, tBD) of the indicator sound between a set of microphones multiplied by the speed of sound is the distance difference to the indicated position P between a group of microphones. The point at which the difference between the distances from the first and third microphones 2A and 2C is constant is present on the hyperbola having the focus of both of the microphones 2A and 2C, and is similarly spaced from the second and fourth microphones 2B and 2D. A point where the difference in distance is a certain point exists on the hyperbola with both microphones 2A, 2C as the focus. Therefore, as shown in FIG. 4B, a hyperbola (hereinafter referred to as a first hyperbola) which is close to the side of the indication position p among the hyperbolas 1 〇 s and i 0t focusing on the first and third microphones 2A ' 2C is taken. The intersection of the hyperbola (hereinafter referred to as the second hyperbola) 20s near the indication position P among the hyperbola 20s and 20t focusing on the second and fourth microphones 2B and 2D is the indication position P. One of the hyperbola i〇s, i〇t and the other hyperbola 20s, 20t shown in Fig. 4B is only for convenience of display, and the shape or positional relationship of the hyperbola is actually different. •12- 3 201140394 In the XY coordinate system, the hyperbola of the two focal points on the x-axis is set to 2a from the distance between the two focal points and the hyperbola, and the distance between the two focal points is set to When 2c, it is represented by the following formula (1).

(其中,b2 = c2-a2) 另一方面,由於第1及第3麥克風2A、2C間的距離(L,) 爲已知’因此由上述式(1)得知,若將至指示位置P的距 離差設爲2a, ’則以第1及第3麥克風2A、2C作爲焦點的 雙曲線10s、10t可由下式(2)表示。 (x-k/2)2 (y~Ly/2?. ax2 = ax =(l/2)C〇tAc ...(2) cx = Lx/2 ^ = ^°χ2-3χ2 在此,C。爲音速,Uc爲到達時間差。 同樣地’由於第2及第4麥克風2B、2D間的距離(L,) 爲已知,因此由上述式(1)得知,若將至指示位置P的距 離差設爲2a,,則以第2及第4麥克風2B、2D作爲焦點的 雙曲線20s、20t可由下式(3)表示。 -13- 201140394 (X-LJ2)2 (y-Ly/2)2 by2 ay2 3y = (l / 2)C〇tgD Cy = Ly/2 by — ^Cy~ 3y' …⑶ 在此,UD爲到達時間差。 因此,作爲指示音之發訊源的指示位置 位置(X)與y軸上的位置(y)只要分別計算 式(5 )即可求出。(where b2 = c2-a2) On the other hand, since the distance (L,) between the first and third microphones 2A and 2C is known, it is known from the above formula (1) that if it is to the indicated position P The distance difference is set to 2a, and the hyperbola 10s and 10t having the first and third microphones 2A and 2C as the focus can be expressed by the following formula (2). (xk/2)2 (y~Ly/2?. ax2 = ax =(l/2)C〇tAc ...(2) cx = Lx/2 ^ = ^°χ2-3χ2 Here, C. is The sound speed, Uc is the arrival time difference. Similarly, since the distance (L,) between the second and fourth microphones 2B and 2D is known, it is known from the above formula (1) that the distance difference to the indicated position P is obtained. In the case of 2a, the hyperbola 20s and 20t having the second and fourth microphones 2B and 2D as the focus can be expressed by the following formula (3). -13- 201140394 (X-LJ2) 2 (y-Ly/2) 2 By2 ay2 3y = (l / 2)C〇tgD Cy = Ly/2 by — ^Cy~ 3y' (3) Here, UD is the arrival time difference. Therefore, the position of the indicated position (X) as the source of the indication sound The position (y) on the y-axis can be obtained by calculating the equation (5).

ay2 + bx2Ay2 + bx2

VbxV-ax2V +U/2 ax2 + bv2 pxV-ax2ay2 + Ly/2 此外,在上述式(4)中,當a,爲正値, 間差tAC爲正値時,右邊第1項的値會小於( 以計算結果而言,可得到接近於第4B圖所示 2A的第1雙曲線l〇s上的位置(x)。相反地, 亦即到達時間差t AC爲負値時.右邊第1項的 /2),因此以計算結果而言,可得到接近於第 第3麥克風2C的雙曲線l〇t上的位置(X)。 同樣地,在上述式(5)中,當a,爲正値 P在}c軸上的 下列式(4 )、…⑷…⑸ 亦即,到達時 L»/ 2 ),因此 之第1麥克風 ® a X爲負値, 値會大於(L, S 4 B圖所示之 ’亦即到達時 -14· 201140394 間差Ud爲正値時,右邊第1項的値會小於(Ly/ 2),因此 以計算結果而言’可得到接近於第4B圖所示之第2麥克風 2B的第2雙曲線20s上的位置(y)。相反地,當&,爲負値, 亦即到達時間差tBD爲負値時’右邊第1項的値會大於(L, /2),因此以計算結果而頁’可得到接近於第4B圖所示之 第4麥克風2D的雙曲線20t上的位置(y)。 因此,位置取得部5係如先前所述,在利用時差取得 部5a取得一組麥克風間之指示音的到達時間差(tAC,tBD ) 後,利用位置資訊取得部5b來計算式(4 )、式(5 ),藉此 取得如第4B圖所示之以第1及第3麥克風2A、2C作爲焦 點的第1雙曲線10s、及以第2及第4麥克風2B、2D作爲 焦點的第2雙曲線20s的交點的座標位置(X,y )。亦即, 取得任意之指示位置P的座標位置(X,y )。接著,位置取 得部5將所取得的座標位置(X,y)作爲指示位置資訊而 供給至其他裝置。 亦即,第1實施形態的指示位置檢測裝置係具備有·· 具有顯示畫面的顯示模組;複數個麥克風,係彼此分離配 置在則述顯不畫面的外周部’用來檢測對前述顯示畫面之 接觸音;時差取得部,係對2種前述麥克風的組合,取得 2個即述麥克風間之前述接觸音的到達時間差;及位置資 訊取得部’係按照藉前述時差取得部取得的每個前述到達 時間差,導出以與該到達時間差對應的前述麥克風爲焦點 的雙曲線’取得該所導出的2個雙曲線的交點作爲產生前 -15- 201140394 述接觸音之位置資訊。 接著’在第1實施形態的指示位置檢測裝置中,藉由 觸控筆30等指示出LCM1的顯示畫面la的任意位置時, 藉由第1〜第4麥克風2A〜2D來檢測在指示位置p中所產 生的指示音,根據彼此成對的麥克風間之指示音的到達時 間差來特定指示位置P。因此,不需要以其他構件來覆蓋 顯示畫面la,故可在不會降低LCM1的顯示特性的情況下 檢測顯示畫面1 a中之指示位置。 此外,在實施本發明時,可將本實施形態中說明的指 示位置檢測裝置的構成等變更成如下所示。 例如分別配置有第1〜第4麥克風2A〜2D中彼此成對 者之呈正交的2條直線L、Μ亦可不一定存在於同一平面, 2條直線L、Μ亦可存在於彼此平行的不同平面。此外,2 條直線L、Μ亦可存在於彼此不平行的不同平面。 此外,如本實施形態所示,2條直線L、Μ形成正交時 在指示位置Ρ之座標位置(X,y)的計算方面較爲方便, 但是只要至少投影在顯示畫面la時於顯示畫面la內形成 交叉即可。 此外,如第5圖所示,第1〜第4麥克風2A〜2D亦可 配置在顯示畫面la的各個角部。亦即,第1〜第4麥克風 2A〜2D亦可分別成對配置在包含顯示畫面la之一對角線 的直線L1上、與包含另一對角線的直線Ml上。 此外,LCM1中之第1〜第4麥克風2A〜2D的設置部 -16 - 201140394 位爲。只要在指示者指示顯示畫面1 a之任意位置時可感測 在顯示畫面la或顯示畫面la的附近所發生的指示音即 可,可作適當變更。亦即,第1〜第4麥克風2A〜2D只要 彼此分離即可,可配置在顯示畫面la的外周部分的任意位 置。 此外,在本實施形態中,檢測出以第1及第3麥克風 2A、2C作爲焦點之雙曲線(第1雙曲線l〇s)、及以第2及 第4麥克風2B、2D作爲焦點之雙曲線(第2雙曲線20 s) 之不同的2個雙曲線的交點,作爲顯示畫面la中之指示位 置。 但是,作爲交點(指示位置P)的座標位置(X,y) 的計算對象之不同的2個雙曲線,係如第6圖所示般亦可 爲以第1及第4麥克風2A、2D作爲焦點之雙曲線30s、30t、 及以第2及第3麥克風2B、2C作爲焦點之雙曲線40s、40t。 亦即,成爲雙曲線計算對象的一組麥克風的組合可進行適 當變更,例如’亦可根據第1及第4麥克風2A、2D中之指 示音的到達時間差、及第2及第3麥克風2B、2C中之指示 音的到達時間差來特定指示位置P。此外,第6圖所示之 一雙曲線30s、30t及另一雙曲線40s、40t係與第4B圖所 示者同、.樣,.在方便上顯示者,雙曲線的形狀或位置關係與實 際上不同。 此外’作爲雙曲線計算對象的一組麥克風的組合,係 如第5圖所不,在將第1〜第4麥克風2A〜2D配置在顯示 -17- 201140394 畫面la之各個角部的情形下亦相同,可採用任意組合。 此外’位置取得部5亦可藉由附加作爲本發明中之控 制部及補正部的功能,而在檢測出指示音時透過不同於本 實施形態之以下處理,來取得任意指示位置P的座標位置 (X,y ) ° 例如使位置取得部5進行依據本實施形態中說明之順 序,運算第4B圖所示之不同的2個雙曲線的交點(指示位 置P)的座標位置(X,y),取得運算結果作爲第1指示位 置資訊之處理。接著,使位置取得部5,在將作爲雙曲線 計算對象之一組麥克風的組合變更爲例如第6圖所示之其 他組合後,按照與本實施形態相同的原理,來運算不同的 2個雙曲線的交點(指示位置P)的座標位置(X,y)。亦 即,使位置取得部5進行根據第1及第4麥克風2A、2D 中之指示音的到達時間差、與第2及第3麥克風2B、2C中 之指示音的到達時間差,來運算不同的2個雙曲線的交點 (指示位置P)的座標位置(X,y),取得運算結果作爲第 2指示位置資訊的處理。 之後,使位置取得部5計算位於第1指示位置資訊中 之X座標及第2指示位置資訊中之X座標的中間的點的X 座標,取得計算結.凍作.爲補正後的X座標。同時’使位置 取得部5計算位於第1指示位置資訊中之Y座標、及第2 指示位置資訊中之y座標的中間的點的y座標’取得計算 結果作爲補正後的y座標。換言之,使位置取得部5進行 -18 - 201140394 藉由第2指示位置資訊來補正第1指示位置資訊,取得補 正後的X座標與補正後的y座標作爲第3指示位置資訊的 處理。接著,使位置取得部5將取得作爲第3指示位置資 訊之補正後的座標位置(X,y)作爲最終指示位置資訊而 供給至其他裝置。 如上所述,若作成變換作爲雙曲線計算對象之一組麥 克風的組合而取得第1指示位置資訊與第2指示位置資 訊,並利用第2指示位置資訊來補正所取得的第1指示位 置資訊,藉此取得最終指示位置資訊(第3指示位置資 訊),則可提升顯示畫面1 a中之指示位置的檢測精度。 此外,在本實施形態中,針對使用4個麥克風來進行 指示位置之檢測的構成加以說明,但是設在顯示畫面1 a的 外周部的麥克風數量亦可爲3個。在使用3個麥克風來進 行指示位置之檢測的情況,例如亦可利用由第1麥克風與 第2麥克風所構成的第1組.、及由第1麥克風與第3麥克 風所構成的第2組來構成作爲雙曲線計算對象的二組麥克 風對。 此外’在本實施形態中,係針對取得Χγ座標系的座 標位置(X,y)作爲表示顯示畫面la中之任意指示位置的 指示位置資訊加以說明。但是,,....在,實施本發明時,亦可在 顯示畫面la的外周部僅配置彼此分離的一組麥克風,取得 可根據以一組麥克風作爲焦點之雙曲線的資訊而判斷之表 示顯示畫面1 a中之任意指示位置之示意位置的資訊,來作 -19- 201140394 爲表示任意指示位置的指示位置資訊。 作爲表示可根據以一組麥克風作爲焦點之雙曲線的資 訊而判斷之示意位置的資訊而言,是例如表示任意指示位 置位於顯示畫面la之上半部區域與下半部區域之任何區域 的資訊、或表示任意指示位置位於顯示畫面la之左半部區 域與右半部分區域之任一區域的資訊。 此外,作爲表示可根據以一組麥克風作爲焦點之雙曲 線的資訊而判斷之示意位置的資訊而言,是例如當將顯示 畫面la分割成縱橫方向的複數個方塊時,表示有存在任意 指示位置之可能性的特定方塊(複數個方塊)的資訊。 此外,在本實施形態中說明之位置取得部5可爲例如 構成具備有LCM1的任意裝置者,亦可藉由任意裝置(包 含個人電腦)所具有的微電腦等來實現。 此外,第1〜第4麥克風2A〜2D所檢測的指示音係可 爲在可聽範圍的頻率頻帶具有特性者,亦可爲在非可聽範 圔的頻率頻帶具有特性者。 此外,在本實施形態中,係針對檢測LCM1的顯示畫 面中之任意指示位置的指示位置檢測裝置加以說明,但是 本發明除了 LCM1以外,亦可使用在CRT等其他顯示機器 所具有之顯示畫面中之任意指示位置的檢測.。_ 〔第2實施形態〕 第7圖係顯示本發明之指示位置檢測裝置之第2實施 形態的示意構成圖。本實施形態之形態係關於在藉由保護 -20- 201140394 蓋60來保護顯示畫面之LCM51應用本發明之指示位置檢 測裝置時之一例。 如第7圖所示,LCM51係透過型,其由:液晶面板52、 分別貼附在液晶面板52的表面側與背面側的偏光板14、 15、及背側貼附有偏光板15之亮度提升薄膜53所構成, 表面側的偏光板14的表面被保護蓋60所覆蓋。 雖在第7圖未顯示,但是液晶面板52係由:在第1實 施形態中所說明的2片透明玻璃基板1 1、1 2、設在兩玻璃 基板1 1、12間的液晶13、像素電極16、TFT17、濾色片18、 共用電極1 9所構成。 亮度提升薄膜53係例如層積有丙烯酸樹脂的PET (Poly Ethylene Terephtalate)薄膜等,藉由將由未圖示之 導光板或背光所成之面光源所發出的光聚光,使液晶面板 52的亮度提升。 •貼附在液晶面板52之表面側的偏光板14具有如第8A 圖、第8B圖或第8C圖所示之構造。例如第8A圖所示, 偏光板14係具有在賦予偏光性能的 PVA ( Poly Vinyl Alcohol)薄膜 14a 的上下貼附 TACCTri Acetyl Cellulose) 薄膜14b、14b來作補強的3層構造,且是藉由透明接著劑 J4e而與液晶面板52及保護蓋60接著的構造。 此外’例如第8 B圖所示,偏光板1 4係具有將賦予偏 光性能的PVA薄膜141的背面貼附TAC薄膜14b來作補強 的2層構造’且是藉由透明接著劑I4e而與液晶面板52及 -21- 201140394 保護蓋60接著的構造。 此外,例如第8C圖所示,偏光板14係具有在相位差 板14c依序貼附賦予偏光性能的PVA薄膜14a、補強用TAC 薄膜14b的3層構造,藉由透明接著劑14e而與液晶面板 52及保護蓋60接著的構造。 保護蓋60係例如玻璃製或塑膠製的透明板材,被貼附 ' 在表面側的偏光板14。此外,保護蓋60係被固接在設有 LCM51的任意裝置的本體或殼體者,具有大於表面側的偏 光板14的面積。 接著,在本實施形態中,在位於比表面側的偏光板14 的周緣更靠外側的保護蓋60的周緣部60a的背面,黏附有 由第7圖所示之第1及第3麥克風2A、2C、及第7圖未顯 示之第2及第4麥克風所構成的4個麥克風。 4個麥克風在平面上的位置係與第1實施形態同樣, 位在LCM51的顯示畫面(表面側的偏光板14的表面)的 各邊的中央(參照第2A圖)。但是,4個麥克風係在存在 於與LCM51的顯示畫面(表面側的偏光板14的表面)的 背面側相對向的同一平面的2條直線上,分別成對配置。 此外,在本實施形態中,亦藉由包含第1及第3麥克 風2A、2C的4個麥克風、連接有4個麥克風的放大器3、 A/D轉換器4、及位置取得部5來構成指示位置檢測裝 置。另外,放大器3、A/D轉換器4、及位置取得部5係 具有與第1實施形態相同的構成及功能。 -22- 201140394 在由以上構成所成之本實施形態中,LCM51的顯示畫 面的任意位置被觸控筆30等指示具或指尖所指示時,係由 設在保護蓋60的周緣部60a的背面的4個麥克風來檢測指 示音。接著,位置取得部5藉由與第1實施形態相同的方 法’來運算屬於表示指示音發生源之指示位置資訊的座標 位置(X’ y)。因此’不需要以設有電極格子的薄膜來覆蓋 LCM5 1的顯示畫面,可在不會使LCM51的顯示特性降低的 情況下檢測顯示畫面中之指示位置。 其中,如本實施形態所示,即使在將4個麥克風設置 在保護蓋60的周緣部60a的背面時,4個麥克風亦與第1 實施形態同樣,可配置在LCM51之顯示畫面之外周部分的 任意位置。例如4個麥克風亦可配置在顯示畫面的各個角 部(參照第5圖)。此外,4個麥克風亦可不一定配置在同 一平面。 此外,如本實施形態所示,即使爲將4個麥克風設置 在保護蓋60的周緣部60a的背面的情形下,位置取得部5 運算表示指示音發生源的座標位置(X,y)時的具體運算 方法係可採用在第1實施形態中已說明的各種運算方法。 此外,亦可使位置取得部5取得在第1實施形態中敘述的 示意位置來作爲表示.指示音發生源的指示位置資訊。 此外,設在保護蓋60的周緣部60a的背面的麥克風數 量亦可爲3個。 另一方面,在本實施形態所示之LCM51中,藉由保護 -23- 201140394 蓋6 0來保護液晶面板5 2免於受到因觸控筆3 0 指尖所造成的撞擊。因此,在構成液晶面板5 2 係可使用厚度爲〇.7mm〜0.5mm左右之薄型者。 護蓋60可確保0.20mm左右的厚度,則可保護 此,當例如偏光板14、15的厚度爲0.17mm、 膜53爲0.06mm時,保護蓋60與LCM51之全 成爲2.Omm〜1.60mm左右。 〔第3實施形態〕 在上述第1實施形態及第2實施形態中, 顯示畫面上在2次元平面的指示位置作爲指示 加以說明,但是在以下第3實施形態中,係針 示畫面重疊的空間,亦即針對顯示畫面上在3 指示位置來作爲指示位置的情形加以說明。 第9圖係顯示具備有作爲指示位置檢測裝 或作爲顯示裝置的構成之攜帶式資訊終端100 攜帶式資訊終端1 00係具備有:排程管理功能 料參照功能、筆輸入功能等各種功能者,其具窄 如第9圖所示,攜帶式資訊終端1 00的本 長狀,在本體102的表面設有:顯示文字資訊 等各種資訊的橫長顯示部103、電源按鍵104、 操作攜帶式資訊終端100時所使用的複數個操 l〇5e。 此外,在顯示部103的外周部設有第1〜 等指示具或 的玻璃基板 此外,若保 LCM51。因 亮度提升薄 體厚度可形 係針對檢測 位置的情形 對檢測在顯 次元空間的 置的構成、 的構成圖。 、辭典等資 「以下構成。 體102爲橫 或影像資訊 及使用者在 作鍵1 0 5 a〜 第4麥克風 -24- 201140394 6 A 〜6 D。 第10圖係顯示顯示部103之示意構造的 部103係藉由可進行彩色顯示的LCM31所構 由:表側與背側的2片透明玻璃基板3 2、3 3 璃基板3 2、3 3間的液晶3 4、分別被貼附在天 3 3之外面的偏光板3 5、3 6、設在背側的偏光 的導光板37、及光反射薄片38所構成。其 37之未圖示的外周部係配置有LED ( light ei 等光源。 在背側的玻璃基板33的內面係形成有 極39的圖案,在像素電極39中與像素對應 形成有TFT40。在表側的玻璃基板32的內面 配列的濾色片4 1與透明的共用電極4.2係依 圖案。 LCM31之表側的偏光板35的周圍係藉由 表面的框架蓋43所覆蓋。在框架蓋43係形 的偏光板35的顯示窗43a的開口,在顯示窗 配置有第1〜第4麥克風6A〜6D。另外,在 端100中,在LCM31的顯示面(表側的偏光 可由顯示窗43a辨識的矩形區域爲顯示畫面.. 第1〜第4麥克風6A〜6D係如第9圖所 面31a的中心QQ呈正交,並且在與顯示畫面 平面’亦即在與顯示畫面31a相對向的同一 剖面圖。顯示 成。LCM3 1係 、被封入兩玻 皮璃基板32、 :板36的背面 中,在導光板 nitting diode ) 透明的像素電 的部分係分別 ,具有預定色 序層積而形成 構成本體2的 成有露出表側 4 3 a的內側係 攜帶式資訊終 板35的表面) •3 1 a. ° •示,在顯示畫 3 1 a呈平行的 平面存在的2 -25· 201140394 條直線LL、MM上分別成對配置。亦即,第1及第3麥克 風6A、6C在與顯示畫面31a的長邊呈平行的一直線LL上 係成對配置,而且第2及第4麥克風6B、6D在與顯示畫面 31a的短邊呈平行的其他直線MM上係成對配置。其中,第 1 0圖係沿著上述直線LL的剖面圖》 第1〜第4麥克風6A〜6D係用以個別檢測由在攛帶式 資訊終端100附帶準備之第10圖所示之觸控筆70所發出 的指示音。 觸控筆70係在使用者使用攜帶式資訊終端100所具有 的筆輸入功能而輸入文字資訊等時使用,其具備有:筆型 本體71、及設在本體71周面的小型按鈕開關72。此外, 按鈕開關72係僅在被使用者按壓期間維持動作狀態的自 動恢復型。 在觸控筆70之未圖示之本體71的內部,內建有:小 型電源、及包含配置在本體71的前端部並且在按鈕開關72 被按壓時產生指示音的小型揚聲器或峰鳴器等放音部的指 示音生成電路。接著,觸控筆70係以在按鈕開關72被按 壓的期間,以一定的時間間隔(η次/秒)周期性發出特 定的頻率頻帶的指示音的方式進行動作。 第.1 1圖係顯示攜帶式資訊終端1 00之電性構成的示意-方塊圖。攜帶式資訊終端100係具備有:控制裝置全體的 控制部 151、ROM(Read Only Memory) 152、快閃記億體 153、按鍵輸入部154、驅動電路155、訊號處理部156。在 -26- 201140394 驅動電路155連接有LCM31,在訊號處理部156分別透過 放大器157連接有第1〜第4麥克風6A〜6D。 控制部 151 係由 CPU (Central Processing Unit)及其 周邊電路所構成。控制部1 5 1係依據記憶在R 0 Μ 1 5 2的各 種控制程式來控制攜帶式資訊終端1 0 0的動作,亦可發揮 作爲本發明之時差取得部1 5 1 a、及位置資訊取得部1 5 1 b的 功能。控制程式係在攜帶式資訊終端1 00的控制上不可或 缺的基本軟體(OS: Operating System)、及用以實現攜帶 式資訊終端1 00所具有的各功能之複數個應用軟體》其中, 在ROM 1 5 2中除了上述控制程式以外,另外記憶有辭典資 料等各種資料。 快閃記憶體1 5 3係記憶規定攜帶式資訊終端1 00之動 作的設定資料、或被使用者所輸入的文字資訊等的非揮發 性半導體記憶體。 按鍵輸入部154係第9圖所示之複數個操作鍵105a〜 105e,將因應使用者所操作的操作鍵而產生的操作訊號供 給至控制部1 5 1。 驅動電路1 5 5係依據控制部1 5 1的命令,生成用以驅 動LCM31的驅動訊號,藉由將所生成的驅動訊號供給至 LCM3卜使顯示畫面31a顯示預定的文字資訊或影像資訊。 訊號處理部156係將藉由放大器157被分別放大的第1 〜第4麥克風6A〜6D的輸出訊號、亦即類比的音響訊號轉 換成數位訊號,並且施行雜音去除等濾波處理,而將濾波 -27- 201140394 處理後的音響訊號供給至控制部1 5 1。 接著,在攜帶式資訊終端100中,在使用者使用筆輸 入功能時,藉由第1〜第4麥克風6A〜6D來檢測由觸控筆 70所發出的指示音,並且控制部1 5 1取得表示其指示位置 的指示位置資訊,來作爲由使用者所指示出之指示音的發 訊位置之對於顯示畫面3 1 a的指示位置。 控制部1 5 1所取得的指示位置資訊係表示3次元空間 內之任意指示位置者。亦即,指示位置資訊係如第1 2 A圖 所示爲正交座標的座標位置P(x,y,z),將顯示畫面31a ' 的左下角設爲原點(0,0,0),而且將顯示畫面31a的長 邊設爲X軸、將顯示畫面31a的短邊設爲y軸時的座標位 置。其中,第12B圖係顯示上述正交座標中之XY平面的 第.1〜第4麥克風6A〜6D的座標位置的圖。 接著,針對控制部1 5 1中之指示位置資訊的取得方法 加以說明。觸控筆70在任意位置發出指示音時,指示音係 以等速度(音速)朝各方向傳送。此時,在由指示音的發 訊位置至第1〜第4麥克風6A〜6D的各個麥克風的距離有 差異時,若將任2個麥克風設爲一組時,則在各組麥克風 間指示音的到達時間會產生差異。 第13A圖係方便顯,示指示音發生時的第1〜第4麥克 風6A〜6D的輸出訊號中之音壓位準的變化、及預先決定 的複數組麥克風的各個麥克風中之指示音的到達時間差的 圖。在第13A圖中,橫軸爲時間,縱軸爲音壓位準,各個 -28- 201140394 音壓位準達到峰値的時點(tA,tB,U,tD )爲第1〜第4 麥克風6A〜6D中之指示音的檢測時點,在本實施形態中 係指示音到達的時點。此外,音壓位準係觸控筆70所發出 之指示音的預定的頻率頻帶中的音壓位準。 此外,在第13A圖中,由第1及第3麥克風6A、6C 所成之一組麥克風間之指示音的到達時間差爲tAC,同樣地 由第2及第4麥克風6B、6D所成的一組麥克風間之指示音 的到達時間差爲Ud,由第1及第4麥克風6A、6D所成的 一組麥克風間之指示音的到達時間差爲U。。 接著,若將各組麥克風間之指示音的到達時間差(Uc, tBD,tAD )乘以音速,可得到與各組麥克風間之指示音的發 訊位置相距的距離差。 在此,在與第1及第3麥克風6A、6C相距一定距離差 的空間內的點係存在於以第1及第3麥克風6A、6C爲焦點 之雙曲面(雙葉雙曲面)。同樣地,在與第2及第4麥克風 6B、6D相距一定距離差的空間內的點係存在於以第2及第 4麥克風6B、6D作爲焦點之雙曲面。此外,在與第1及第 4麥克風6A、6D相距一定距離差的空間內的點係存在於以 第1及第4麥克風6A、6D作爲焦點之雙曲面。 因此,以各組麥克風作爲焦點.之各個雙曲面的交點係 成爲指示音的發訊位置,亦即相對於顯示畫面3 1 a的指示 位置。亦即,第1 3 B圖係顯示將以各組麥克風作爲焦點之 各個雙曲面在與顯示畫面31a呈平行的平面進行切割時的 -29- 201140394 切口,亦即雙曲線的圖。如第13B圖所示,以第1及第3 麥克風6A、6C爲焦點之第1雙曲面(雙曲線)l〇P、1〇Q ' 以第2及第4麥克風6B、6D爲焦點之第2雙曲面(雙曲線) 20p、20q、及以第1及第4麥克風6A、6D爲焦點之第3雙 曲面(雙曲線)30p、30q的交點即成爲指示位置P。此外, 第13B圖僅爲方便顯示各個雙曲面(雙曲線)者,形狀或 位置關係與實際上不同》 另一方面,以各組麥克風爲焦點之各個雙曲面可藉由 下式(6)來表示。但是’式(6)係焦點存在於z軸上時 的一般式。 X2 y2 z2 . _?w1 …⑻ 此外’由於第1及第3麥克風6A、6C間的距離(Lx) 爲已知,因此若將至指示位置p的距離差設爲2ai,則由上 述式(6)可得到下式(7)來作爲表示以第丨及第3麥克 風6A、6C爲焦點之第1雙曲面1〇p、1〇q的數式。 (x-L-x/2)2 (y-Ly/2]P 22 ax2 〜= 1VbxV-ax2V +U/2 ax2 + bv2 pxV-ax2ay2 + Ly/2 In addition, in the above formula (4), when a is positive and the difference tAC is positive, the 第 of the first term on the right side is smaller than (According to the calculation result, the position (x) on the first hyperbola l〇s close to 2A shown in Fig. 4B can be obtained. Conversely, the arrival time difference t AC is negative .. The first item on the right /2), therefore, the position (X) on the hyperbola l〇t close to the third microphone 2C can be obtained as a result of the calculation. Similarly, in the above formula (5), when a, the following equations (4), ... (4) (5) of the positive 値P on the}c axis, that is, L»/ 2 when arriving, the first microphone ® a X is negative 値, 値 will be greater than (L, S 4 B is shown in the figure - that is, when the arrival time -14.201140394 difference Ud is positive, the first item on the right side will be less than (Ly / 2) Therefore, in the calculation result, the position (y) on the second hyperbola 20s close to the second microphone 2B shown in Fig. 4B can be obtained. Conversely, when &, is negative, that is, the time difference of arrival When tBD is negative, the 第 of the first term on the right side is larger than (L, /2), so the page ' can be obtained as close to the position on the hyperbola 20t of the fourth microphone 2D shown in FIG. 4B ( In the position acquisition unit 5, the time difference acquisition unit 5a acquires the arrival time difference (tAC, tBD) of the indication sound between the plurality of microphones, and then uses the position information acquisition unit 5b to calculate the expression (4). Equation (5), thereby obtaining the first hyperbola 10s with the first and third microphones 2A, 2C as the focus and the second and fourth microphones 2B, 2D as shown in FIG. 4B The coordinate position (X, y) of the intersection of the second hyperbola 20s which is the focus. That is, the coordinate position (X, y) of the arbitrary indication position P is obtained. Then, the position acquisition unit 5 takes the obtained coordinate position ( X, y) is supplied to the other device as the pointing position information. That is, the pointing position detecting device according to the first embodiment includes a display module having a display screen, and a plurality of microphones are arranged separately from each other. The outer peripheral portion of the display screen is for detecting a contact sound to the display screen; the time difference acquisition unit is configured to obtain a difference in arrival time of the contact sound between two microphones; The part 'derives a hyperbola 'focusing on the microphone corresponding to the arrival time difference to obtain the intersection of the two derived hyperbolas as the pre-production -15- according to each of the aforementioned arrival time differences obtained by the time difference acquisition unit. 201140394 The position information of the contact sound is described. Next, in the instruction position detecting device according to the first embodiment, the display screen 1 of the LCM 1 is instructed by the stylus pen 30 or the like. In the arbitrary position of a, the first to fourth microphones 2A to 2D detect the pointing sound generated at the pointed position p, and the pointing position P is specified based on the arrival time difference of the pointing sound between the microphones that are paired with each other. Since it is not necessary to cover the display screen 1a with other members, the indication position in the display screen 1a can be detected without lowering the display characteristics of the LCM 1. Further, in the practice of the present invention, the description will be described in the embodiment. The configuration of the pointing position detecting device and the like are changed as follows. For example, two straight lines L and Μ which are orthogonal to each other in the first to fourth microphones 2A to 2D are arranged, and may not necessarily exist in the same plane. The two straight lines L and Μ may also exist in different planes parallel to each other. In addition, the two straight lines L and Μ may exist in different planes that are not parallel to each other. Further, as described in the present embodiment, it is convenient to calculate the coordinate position (X, y) at the position Ρ when the two straight lines L and Μ are orthogonal, but the display screen is at least projected on the display screen 1a. It is sufficient to form a cross in la. Further, as shown in Fig. 5, the first to fourth microphones 2A to 2D may be disposed at respective corners of the display screen 1a. In other words, the first to fourth microphones 2A to 2D may be arranged in pairs on a straight line L1 including one diagonal line of the display screen 1a and on a straight line M1 including another diagonal line. Further, the setting units -16 - 201140394 of the first to fourth microphones 2A to 2D in the LCM 1 are. The indicator sound generated in the vicinity of the display screen 1a or the display screen 1a can be sensed when the pointer instructs any position on the display screen 1a, and can be appropriately changed. In other words, the first to fourth microphones 2A to 2D can be disposed at any position on the outer peripheral portion of the display screen 1a as long as they are separated from each other. Further, in the present embodiment, the hyperbola (the first hyperbola l〇s) having the first and third microphones 2A and 2C as the focus and the pair of the second and fourth microphones 2B and 2D as the focus are detected. The intersection of the two different hyperbolas of the curve (the second hyperbola 20 s) is used as the indicated position in the display screen la. However, the two hyperbola which are different in the calculation target of the coordinate position (X, y) of the intersection point (indicating the position P) may be the first and fourth microphones 2A and 2D as shown in FIG. The hyperbola of the focus 30s, 30t, and the hyperbola 40s, 40t with the second and third microphones 2B, 2C as the focus. In other words, the combination of a set of microphones to be hyperbolically calculated can be appropriately changed, for example, 'the arrival time difference of the indication sounds in the first and fourth microphones 2A and 2D, and the second and third microphones 2B, The arrival time difference of the indicator sound in 2C is to specify the indication position P. In addition, one of the hyperbola 30s, 30t and the other hyperbola 40s, 40t shown in Fig. 6 is the same as that shown in Fig. 4B. For convenience, the shape or positional relationship of the hyperbola is It's actually different. In addition, the combination of a set of microphones which are hyperbolic calculation targets is not shown in FIG. 5, and the first to fourth microphones 2A to 2D are arranged in the respective corners of the display -17-201140394 screen la. The same can be used in any combination. Further, the position obtaining unit 5 can obtain the coordinate position of the arbitrary pointing position P by the following processing different from the present embodiment when the pointing sound is detected by adding the function as the control unit and the correcting unit in the present invention. (X, y ) ° For example, the position obtaining unit 5 performs the coordinate position (X, y) of the intersection (indicating position P) of the two hyperbola shown in FIG. 4B in the order described in the embodiment. The calculation result is obtained as the processing of the first indication position information. Then, the position obtaining unit 5 changes the combination of the microphones which are one of the hyperbolic calculation targets to another combination shown in FIG. 6, and calculates the two different pairs according to the same principle as the present embodiment. The coordinate position (X, y) of the intersection of the curve (indicating position P). In other words, the position acquisition unit 5 calculates the difference between the arrival time difference between the first and fourth microphones 2A and 2D and the arrival time difference between the second and third microphones 2B and 2C. The coordinate position (X, y) of the intersection of the hyperbola (indicating the position P), and the calculation result is obtained as the processing of the second indication position information. Then, the position obtaining unit 5 calculates the X coordinate of the point located in the middle of the X coordinate and the second indicated position information in the first indicated position information, and obtains the calculated knot. The frozen coordinate is the corrected X coordinate. At the same time, the position obtaining unit 5 calculates the y coordinate of the point in the middle of the Y coordinate in the first indicated position information and the y coordinate in the second indicated position information, and obtains the calculation result as the corrected y coordinate. In other words, the position acquisition unit 5 performs -18 - 201140394 to correct the first indication position information by the second indication position information, and obtains the corrected X coordinate and the corrected y coordinate as the third indication position information. Then, the position acquisition unit 5 supplies the coordinate position (X, y) obtained as the corrected third position information to the other device as the final instruction position information. As described above, the first indication position information and the second indication position information are obtained by converting the combination of the group microphones which are the hyperbolic calculation targets, and the acquired first indication position information is corrected by the second indication position information. By obtaining the final indication position information (the third indication position information), the detection accuracy of the indication position in the display screen 1 a can be improved. Further, in the present embodiment, a configuration in which the detection position is detected using four microphones will be described. However, the number of microphones provided on the outer peripheral portion of the display screen 1a may be three. When three microphones are used to detect the position of the indication, for example, the first group composed of the first microphone and the second microphone and the second group composed of the first microphone and the third microphone may be used. Two sets of microphone pairs are constructed as hyperbolic calculation objects. Further, in the present embodiment, the coordinate position (X, y) of the Χ γ coordinate system is used as the indication position information indicating an arbitrary indication position on the display screen 1a. However, when the present invention is implemented, only one set of microphones separated from each other may be disposed on the outer peripheral portion of the display screen 1a, and the representation may be determined based on the information of the hyperbola with a set of microphones as the focus. The information indicating the position of any indicated position in the screen 1 a is displayed as -19-201140394 as the indicated position information indicating the arbitrary indicated position. As the information indicating the position which can be judged based on the information of the hyperbola with a set of microphones as the focus, it is, for example, information indicating that any of the indicated positions is located in any of the upper and lower half regions of the display screen 1a. Or, the information indicating that any of the indicated positions is located in any of the left half area and the right half area of the display screen la. Further, as information indicating a schematic position that can be determined based on information of a hyperbola having a set of microphones as a focus, for example, when the display screen 1a is divided into a plurality of squares in the vertical and horizontal directions, it indicates that there is any indicated position. Information about the specific squares (multiple squares) of the possibility. In addition, the position obtaining unit 5 described in the present embodiment can be realized by, for example, a configuration including any device including the LCM 1, and can be realized by a microcomputer or the like included in any device (including a personal computer). Further, the indicator sounds detected by the first to fourth microphones 2A to 2D may have characteristics in a frequency band of an audible range, or may have characteristics in a frequency band of a non-audible range. Further, in the present embodiment, the pointing position detecting device for detecting an arbitrary pointing position on the display screen of the LCM 1 is described. However, the present invention may be used in addition to the LCM 1 in a display screen of another display device such as a CRT. Detection of any indicated position. [Second Embodiment] Fig. 7 is a schematic configuration diagram showing a second embodiment of the pointing position detecting device of the present invention. The embodiment of the present embodiment is an example of the case where the pointing position detecting device of the present invention is applied to the LCM 51 that protects the display screen by the cover -20-201140394 cover 60. As shown in Fig. 7, the LCM 51 is a transmissive type in which the liquid crystal panel 52 is attached to the polarizing plates 14 and 15 on the front and back sides of the liquid crystal panel 52, and the brightness of the polarizing plate 15 is attached to the back side. The lift film 53 is configured such that the surface of the polarizing plate 14 on the front side is covered by the protective cover 60. Although not shown in FIG. 7, the liquid crystal panel 52 is composed of two transparent glass substrates 1 1 and 1 described in the first embodiment, and liquid crystals 13 and pixels provided between the two glass substrates 1 and 12. The electrode 16, the TFT 17, the color filter 18, and the common electrode 19 are formed. The brightness enhancement film 53 is, for example, a PET (Poly Ethylene Terephtalate) film in which an acrylic resin is laminated, and the light emitted from the surface light source formed by a light guide plate or a backlight (not shown) is collected to increase the brightness of the liquid crystal panel 52. Upgrade. The polarizing plate 14 attached to the surface side of the liquid crystal panel 52 has a configuration as shown in Fig. 8A, Fig. 8B or Fig. 8C. For example, as shown in Fig. 8A, the polarizing plate 14 has a three-layer structure in which TACCTri Acetyl Cellulose films 14b and 14b are attached to the PVA (poly Vinyl Alcohol) film 14a to which polarizing performance is applied, and is reinforced. Next, the agent J4e is connected to the liquid crystal panel 52 and the protective cover 60. Further, for example, as shown in FIG. 8B, the polarizing plate 14 has a two-layer structure in which the back surface of the PVA film 141 to which the polarizing performance is applied is adhered to the TAC film 14b to be reinforced, and the liquid crystal is cured by the transparent adhesive I4e. Panels 52 and -21 - 201140394 protect the cover 60 in a subsequent configuration. Further, for example, as shown in FIG. 8C, the polarizing plate 14 has a three-layer structure in which a PVA film 14a and a reinforcing TAC film 14b which impart polarizing performance are sequentially attached to the phase difference plate 14c, and a liquid crystal is bonded by a transparent adhesive 14e. The panel 52 and the protective cover 60 are constructed next. The protective cover 60 is, for example, a transparent plate made of glass or plastic, and is attached with a polarizing plate 14 on the surface side. Further, the protective cover 60 is fixed to the body or the casing of any device provided with the LCM 51, and has an area larger than the surface of the polarizing plate 14. Then, in the present embodiment, the first and third microphones 2A shown in FIG. 7 are adhered to the back surface of the peripheral edge portion 60a of the protective cover 60 on the outer side of the peripheral edge of the polarizing plate 14 on the surface side. 2C, and 4 microphones composed of the 2nd and 4th microphones not shown in Fig. 7. The position of the four microphones on the plane is the same as that of the first embodiment, and is located at the center of each side of the display screen of the LCM 51 (the surface of the polarizing plate 14 on the front side) (see FIG. 2A). However, the four microphones are arranged in pairs on two straight lines which are on the same plane facing the back side of the display screen (the surface of the polarizing plate 14 on the front side) of the LCM 51. Further, in the present embodiment, the instructions are also configured by four microphones including the first and third microphones 2A and 2C, an amplifier 3 to which four microphones are connected, an A/D converter 4, and a position acquisition unit 5. Position detection device. The amplifier 3, the A/D converter 4, and the position acquisition unit 5 have the same configuration and function as those of the first embodiment. -22-201140394 In the present embodiment, the arbitrary position of the display screen of the LCM 51 is set by the peripheral portion 60a of the protective cover 60 when the position of the display screen of the LCM 51 is indicated by the pointing finger or the fingertip. Four microphones on the back to detect the indicator tone. Next, the position acquisition unit 5 calculates a coordinate position (X' y) belonging to the instruction position information indicating the source of the indication sound by the same method as in the first embodiment. Therefore, it is not necessary to cover the display screen of the LCM 5 1 with a film provided with an electrode grid, and the indication position on the display screen can be detected without deteriorating the display characteristics of the LCM 51. According to the present embodiment, even when four microphones are provided on the back surface of the peripheral edge portion 60a of the protective cover 60, the four microphones can be placed on the outer peripheral portion of the display screen of the LCM 51 as in the first embodiment. Anywhere. For example, four microphones can also be placed at each corner of the display screen (see Fig. 5). In addition, the four microphones may not necessarily be arranged in the same plane. Further, as shown in the present embodiment, even when four microphones are provided on the back surface of the peripheral edge portion 60a of the protective cover 60, the position obtaining unit 5 calculates the coordinate position (X, y) indicating the source of the sound generation. The specific calculation method can employ various calculation methods described in the first embodiment. Further, the position obtaining unit 5 may obtain the indicated position described in the first embodiment as the indicated position information indicating the source of the indication sound. Further, the number of microphones provided on the back surface of the peripheral edge portion 60a of the protective cover 60 may be three. On the other hand, in the LCM 51 shown in the present embodiment, the liquid crystal panel 52 is protected from the impact caused by the fingertip of the stylus 30 by protecting the cover 630-201140394 cover 60. Therefore, in the case of constituting the liquid crystal panel 52, a thin type having a thickness of about 0.7 mm to 0.5 mm can be used. The cover 60 can ensure a thickness of about 0.20 mm, and can be protected. When, for example, the thickness of the polarizing plates 14 and 15 is 0.17 mm and the film 53 is 0.06 mm, the entire protective cover 60 and the LCM 51 become 2.0 mm to 1.60 mm. about. [Third Embodiment] In the first embodiment and the second embodiment, the position indicated by the second-order plane on the display screen is used as an instruction. However, in the following third embodiment, the space where the screen overlaps is indicated. That is, the case where the position indicated by 3 is indicated as the indicated position on the display screen will be described. FIG. 9 shows a portable information terminal 100 having a configuration as a pointing position detecting device or a display device. The portable information terminal 100 includes various functions such as a schedule management function reference function and a pen input function. As shown in FIG. 9, the length of the portable information terminal 100 is provided on the surface of the main body 102: a horizontally long display unit 103 for displaying various information such as text information, a power button 104, and an operation portable information. The plurality of operations l〇5e used by the terminal 100. Further, a glass substrate of the first or the like or the like is provided on the outer peripheral portion of the display unit 103. Further, the LCM 51 is secured. The brightness can be increased by the thickness of the thin body, and the configuration of the position in the display element space can be determined for the case where the position is detected. , dictionary, etc. "The following structure. Body 102 is horizontal or video information and the user is working as a key 1 0 5 a~ 4th microphone-24- 201140394 6 A to 6 D. Fig. 10 shows the schematic structure of the display unit 103 The portion 103 is constructed by the LCM 31 capable of color display: two transparent glass substrates 3 and 3 3 on the front side and the back side, and liquid crystals 34 between the glass substrates 3 2 and 3 3 are respectively attached to the sky. The polarizing plate 3 5 and 36 on the outer surface of the third surface, the light-guiding plate 37 provided on the back side, and the light-reflecting sheet 38 are provided. The outer peripheral portion of the 37 (not shown) is provided with an LED (light source such as light ei) A pattern of the poles 39 is formed on the inner surface of the glass substrate 33 on the back side, and the TFTs 40 are formed corresponding to the pixels in the pixel electrodes 39. The color filters 4 1 arranged on the inner surface of the glass substrate 32 on the front side are transparent. The common electrode 4.2 is patterned. The periphery of the polarizing plate 35 on the front side of the LCM 31 is covered by the frame cover 43 on the surface. The opening of the display window 43a of the polarizing plate 35 of the frame cover 43 is arranged in the display window. 1 to 4th microphones 6A to 6D. In addition, at the end 100, on the display surface of the LCM 31 (on the side of the table) The rectangular area recognized by the display window 43a is a display screen. The first to fourth microphones 6A to 6D are orthogonal to the center QQ of the face 31a of the ninth figure, and are displayed and displayed on the display screen plane. The same cross-sectional view of the screen 31a is shown. The LCM3 1 system is sealed in the back surface of the two glass substrates 32 and the plate 36, and the transparent pixel portion of the light guide plate has a predetermined color. The surface layer is formed to form the surface of the body 2 having the inner side portable information end plate 35 exposing the front side 4 3 a) • 3 1 a. ° • shown, in the plane where the display 3 1 a is parallel -25· 201140394 The straight lines LL and MM are arranged in pairs, that is, the first and third microphones 6A and 6C are arranged in pairs on the straight line LL parallel to the long side of the display screen 31a, and the second and second microphones are arranged in pairs. The fourth microphones 6B and 6D are arranged in pairs on the other straight line MM parallel to the short side of the display screen 31a. The first zero figure is a cross-sectional view along the straight line LL. The first to fourth microphones 6A to 〜 6D is used for individual detection by the piggybacking information terminal 100 The instruction sound emitted by the stylus pen 70 shown in Fig. 10. The stylus pen 70 is used when the user inputs text information or the like using the pen input function of the portable information terminal 100, and is provided with: The pen type main body 71 and the small push button switch 72 provided on the circumferential surface of the main body 71. The push button switch 72 is an automatic recovery type that maintains the operating state only during the pressing by the user. Inside the main body 71 (not shown) of the stylus pen 70, a small power supply and a small speaker or a buzzer including a front end portion of the main body 71 and generating an instruction sound when the push button switch 72 is pressed are built therein. The indicator sound generation circuit of the sound emitting unit. Next, the stylus pen 70 is operated to periodically emit an instruction sound of a specific frequency band at a constant time interval (n times/second) while the push button switch 72 is being pressed. Fig. 1 is a schematic block diagram showing the electrical configuration of the portable information terminal 100. The portable information terminal 100 includes a control unit 151, a ROM (Read Only Memory) 152, a flash memory unit 153, a key input unit 154, a drive circuit 155, and a signal processing unit 156. The LCM 31 is connected to the drive circuit 155 at -26-201140394, and the first to fourth microphones 6A to 6D are connected to the signal processing unit 156 via the amplifier 157. The control unit 151 is composed of a CPU (Central Processing Unit) and its peripheral circuits. The control unit 151 controls the operation of the portable information terminal 100 according to various control programs stored in R 0 Μ 1 5 2, and can also function as the time difference acquisition unit 1 5 1 a and the position information acquisition of the present invention. Part 1 5 1 b function. The control program is an essential software (OS: Operating System) that is indispensable for the control of the portable information terminal 100, and a plurality of application software for realizing the functions of the portable information terminal 100. In addition to the above control program, ROM 1 5 2 also stores various materials such as dictionary materials. The flash memory 1 5 3 system is a non-volatile semiconductor memory that stores setting data of the mobile information terminal 1 or the text information input by the user. The key input unit 154 is a plurality of operation keys 105a to 105e shown in Fig. 9, and supplies an operation signal generated in response to an operation key operated by the user to the control unit 151. The driving circuit 15 5 generates a driving signal for driving the LCM 31 according to the command of the control unit 151, and supplies the generated driving signal to the LCM 3 to cause the display screen 31a to display predetermined text information or image information. The signal processing unit 156 converts the output signals of the first to fourth microphones 6A to 6D amplified by the amplifier 157, that is, the analog audio signals into digital signals, and performs filtering processing such as noise removal, and filters- 27- 201140394 The processed audio signal is supplied to the control unit 1 51. Next, in the portable information terminal 100, when the user uses the pen input function, the first to fourth microphones 6A to 6D detect the pointing sound emitted by the stylus pen 70, and the control unit 151 obtains The indicated position information indicating the position is indicated as the indicated position of the display position 3 1 a of the transmission position of the indication sound indicated by the user. The instruction position information acquired by the control unit 151 indicates an arbitrary position in the three-dimensional space. That is, the indication position information is the coordinate position P(x, y, z) of the orthogonal coordinates as shown in Fig. 1 2 A, and the lower left corner of the display screen 31a' is set to the origin (0, 0, 0). Further, the long side of the display screen 31a is set to the X axis, and the coordinate position when the short side of the display screen 31a is set to the y axis. Here, Fig. 12B is a view showing coordinate positions of the first to fourth microphones 6A to 6D in the XY plane in the orthogonal coordinates. Next, a method of obtaining the indicated position information in the control unit 151 will be described. When the stylus 70 emits an instruction sound at an arbitrary position, the pointing sound is transmitted in various directions at a constant speed (sonic speed). In this case, when there is a difference in the distance from the transmission position of the instruction sound to the respective microphones of the first to fourth microphones 6A to 6D, if any two microphones are set as one set, the indicator sound is set between the respective groups of microphones. The arrival time will vary. Fig. 13A is a convenient display showing the change of the sound pressure level in the output signals of the first to fourth microphones 6A to 6D at the time of occurrence of the indication sound, and the arrival of the indication sound in each microphone of the predetermined complex array microphone. A diagram of the time difference. In Fig. 13A, the horizontal axis is time and the vertical axis is the sound pressure level, and the time point (tA, tB, U, tD) at which each of the -28-201140394 sound pressure levels reaches the peak is the first to fourth microphones 6A. The detection timing of the indication sound in ~6D is the timing at which the indication sound arrives in the present embodiment. Further, the sound pressure level is a sound pressure level in a predetermined frequency band of the indication sound emitted by the stylus pen 70. Further, in Fig. 13A, the arrival time difference between the indication sounds of the microphones formed by the first and third microphones 6A and 6C is tAC, and the second and fourth microphones 6B and 6D are similarly formed. The arrival time difference of the indicator sound between the group microphones is Ud, and the arrival time difference between the indicator sounds of the group of microphones formed by the first and fourth microphones 6A, 6D is U. . Next, by multiplying the arrival time difference (Uc, tBD, tAD) of the indication sound between the respective sets of microphones by the speed of sound, a distance difference from the transmission position of the indication sound between the respective sets of microphones can be obtained. Here, the point in the space which is spaced apart from the first and third microphones 6A and 6C by a certain distance is present in a hyperboloid (double-leaf hyperboloid) focusing on the first and third microphones 6A and 6C. Similarly, a point in a space having a predetermined distance from the second and fourth microphones 6B and 6D exists in a hyperboloid having the second and fourth microphones 6B and 6D as focal points. Further, a point in a space which is spaced apart from the first and fourth microphones 6A, 6D by a distance is present in a hyperboloid having the first and fourth microphones 6A, 6D as a focal point. Therefore, the intersection of the respective hyperboloids with each group of microphones as the focus is the position of the transmission of the indication sound, that is, the indication position with respect to the display screen 3 1 a . That is, the 1 3 B-picture shows a -29-201140394 slit, that is, a hyperbola, when each hyperboloid having each group of microphones as a focus is cut in a plane parallel to the display screen 31a. As shown in Fig. 13B, the first hyperboloid (hyperbolic) l〇P, 1〇Q' with the first and third microphones 6A and 6C as the focus is the second and fourth microphones 6B and 6D. The intersection of the two hyperboloids (hyperbolic) 20p, 20q, and the third hyperboloid (hyperbolic) 30p, 30q with the first and fourth microphones 6A, 6D as the focus becomes the pointing position P. In addition, the 13B chart is only for the convenience of displaying each hyperboloid (hyperbolic), and the shape or positional relationship is different from the actual one. On the other hand, each hyperboloid with the focus of each group of microphones can be obtained by the following formula (6). Said. However, the equation (6) is a general expression when the focus is present on the z-axis. X2 y2 z2 . _?w1 (8) Further, since the distance (Lx) between the first and third microphones 6A and 6C is known, if the distance difference to the pointed position p is 2ai, the above equation ( 6) The following equation (7) can be obtained as a numerical expression indicating the first hyperboloids 1〇p and 1〇q focusing on the third and third microphones 6A and 6C. (x-L-x/2)2 (y-Ly/2]P 22 ax2 ~= 1

ax = (l/2)C0tAC ^k=Lx/2 ."⑺ ________ 丄.… -30- 201140394 同樣地’由於第2及第4麥克風6B、6D間的距離(L,) 爲已知’因此若將至指示位置p的距離差設爲2a,,則由上 述式(6)可得到下式(8)來作爲表示以第2及第4麥克 風6B、6D作爲焦點之第2雙曲面2〇p、20q的數式。 (X-LJ2)2 (y-Ly/2)2 22 Γ~2 Τ~2 ΓΤ = -1 ay by by ay =(l/2)C〇tBD …⑻ cy =Ly/2 by 一 ay2 另一方面,假定第1及第4麥克風6 A、6D位於X軸上, 而且第1麥克風6A位於原點(〇,〇,〇),若將第1及第4 麥克風6A、6D間的距離設爲距離(x),將至指示位置p 的距離差設爲2a〃,則由上述式(6)可得到下式(9)作 爲表示以第1及第4麥克風6A、6D作爲焦點之假想上的雙 曲面的數式。 X2 Y2 z2 -2--9--0=1 axy bxy bxyAx = (l/2)C0tAC ^k=Lx/2 ."(7) ________ 丄.... -30- 201140394 Similarly, 'the distance between the 2nd and 4th microphones 6B and 6D (L,) is known' Therefore, when the distance difference to the pointing position p is 2a, the following equation (8) can be obtained as the second hyperboloid 2 indicating that the second and fourth microphones 6B and 6D are the focal points. The formula of 〇p, 20q. (X-LJ2)2 (y-Ly/2)2 22 Γ~2 Τ~2 ΓΤ = -1 ay by by ay =(l/2)C〇tBD ...(8) cy =Ly/2 by one ay2 another On the other hand, it is assumed that the first and fourth microphones 6 A and 6D are located on the X-axis, and the first microphone 6A is located at the origin (〇, 〇, 〇), and the distance between the first and fourth microphones 6A and 6D is set to When the distance difference from the pointing position p is 2a, the distance (x) is obtained by the above formula (6), and the following equation (9) is obtained as a imaginary representation with the first and fourth microphones 6A and 6D as the focus. The number of hyperboloids. X2 Y2 z2 -2--9--0=1 axy bxy bxy

axy = (1/2)C0tAD __ …⑼ cxy = (V4^Lx2+Ly2 "..... bxy =^xy2-axy2 此外’存在於上述假想上的雙曲面的各點的座標位置 (X,y’ z)若使用下式(10)來作轉換,則可轉換成以第 -31- 201140394 1及第4麥克風6 A、6D作爲焦點之實際的第3雙曲面3 0p、 30q中之座標位置(X,y,ζ)β X COS0 -sin0 0、 ,Χ、 'Lx/4、 y = sin0 COS0 0 Y + 3Ly/4 0 ,Ζ; ,〇 , 0 = tan_1(Ly/Lx) -(10) 因此’由式(9)及式(10)可得到下式(11)作爲表 示以第1及第4麥克風6A、作爲焦點之第3雙曲面30p、 30q的數式。 cos2 θ sin2 0 y2 [2 2 ) a 2 b 2 V axy Dxy J X + kaxy Dxy ) cos0.sin0.xy cos20 sin2〆 xyAxy = (1/2)C0tAD __ ...(9) cxy = (V4^Lx2+Ly2 "..... bxy =^xy2-axy2 In addition, the coordinate position of each point of the hyperboloid existing on the above imaginary (X , y' z) If the following formula (10) is used for conversion, it can be converted into the actual third hyperboloids 30p, 30q with the focus of the -31-201140394 1 and the fourth microphones 6 A, 6D as the focus. Coordinate position (X, y, ζ) β X COS0 - sin0 0, , Χ, 'Lx/4, y = sin0 COS0 0 Y + 3Ly/4 0 , Ζ; , 〇, 0 = tan_1(Ly/Lx) - (10) Therefore, the following equation (11) can be obtained from the equations (9) and (10) as a mathematical expression indicating the first and fourth microphones 6A and the third hyperboloids 30p and 30q as the focal points. cos2 θ sin2 0 y2 [2 2 ) a 2 b 2 V axy Dxy JX + kaxy Dxy ) cos0.sin0.xy cos20 sin2〆xy

a〆 16aJ b、A〆 16aJ b,

Lxcosg^ 3Ly sin0 2a 2b, y 16b xy b xy 因此’滿足全部式(7)、式(8)、式(11)的座標位 置(X,y,Z)係以各組麥克風作爲焦點之各個雙曲面的交 點’成爲指示音的發訊位置,亦即相對於顯示畫面3la之 任意指示位置P的座標位置(X,y , z ) ^ 但是’例如若在各組麥克風的到達時間差(tAC , tBD , )存在誤差時’由於在與各組麥克風間之指示音的發訊 位置相距的距離差(2ax ’ 2 a, ’ 2a,y )亦會產生誤差,因此 -32- 201140394 無法獲得滿足全部式(7)、式(8)、式(11)的座標位置 (X,y,z ) ° 因此,在控制部151中,係藉由使用下式(12),取得 任意之指示位置P的座標位置(X,y,z ),亦即指示位置 資訊》 n = {F(x, y, z)f + {G(x, y, z)}2 + {H(x, y, z)}2 其中, F(x,y,z)=式(6)的(左邊)-(右邊) G(x,y,z)=式(6)的(左邊)-(右邊) H(x,y,z)=式(6)的(左邊)-(右邊)…(12) 上述式(1 2 )係在由各組麥克風的到達時間差(Uc, tBD,tAD )所得之與各組麥克風間之指示音的發訊位置相距 的距離差(2a»> 2ay,2aiy)沒有誤差時,運算結果(η)成 爲0 (特定値)的判別式。 控制部1 5 1取得指示位置資訊時的具體順序係如以下 所示。亦即在控制部1 5 1中,在上述式(1 2 )的座標値(X, y,ζ),依序代入(〇,〇,〇)至(Lx,L, ’ L:)的座標値而 分別求出運算結果(η )。在此,座標値(匕,Ly ’ L:)中之 z座標(Lz )係被預定作爲指示位置之z軸中之檢測範圍的 最大座標位置。亦即控制部1 5係在式(1 2 )的座標値(X, y’ z),依序代入表示顯示畫面31a之上方的一定範圍內的 3次元空間的各點的座標値而分別求出運算結果(η )。接 -33- 201140394 著,控制部1 5 1係取得運算結果(n )爲最小時之座標値(χ, y,z)作爲指示位置資訊。 但是,在攜帶式資訊終端100係預先準備軟鍵模式與 毛筆模式與線圖模式等3種動作模式作爲用以使用筆輸入 功能的動作模式,使用筆輸入功能時,使用者可視需要來 設定任意動作模式。軟鍵模式係爲了輸入文字或記號而準 備的動作模式,毛筆模式與線圖模式係爲了輸入線圖而準 備的動作模式。 接著,.在攜帶式資訊終端100中,在設定3種動作模 式之任一者時,亦由控制部151發揮作爲本發明之時差取 得部1 5 1 a及位置資訊取得部1 5 1 b之功能,並且亦發揮作 爲顯示控制部151c及輸入處理部151d之功能。 以下,針對包含在攜帶式資訊終端1 00中由使用者使 用筆輸入功能時藉由控制部1 5 1所進行之指示位置資訊的 具體取得順序的動作內容加以說明。 (軟鍵模式) 首先,針對藉由使用者設定軟鍵模式時的攜帶式資訊 終端100的動作加以說明。第14圖及第1 5圖係顯示控制 部151的處理內容的流程圖,第16圖係顯示軟鍵模式設定 中之觸控筆70的操作、及因應觸控潷.70之操作的LCM31 的顯示晝面31 a’中的顯示內容的變化之一例的說明圖。 如第14圖所示,控制部1 5 1係在軟鍵模式的設定之同 時開始動作,首先開始進行由觸控筆70所發出的指示音的 -34- 201140394 檢測動作,並且使LCM 31的顯示畫面31a顯示第 之軟鍵501 (步驟SA1 )。 在此,指示音的檢測動作係逐次確認第1〜: 風6A〜6D中之輸出訊號的音壓位準的變化的動 部1 5 1係在指示音的檢測動作開始的時點,開始 的複數組麥克風的各個麥克風中之指示音的到達 計算所使用的經過時間的計數。 此外,軟鍵501係由複數個操作按鍵所構成 在軟鍵501的各操作按鍵係預先分配有英文字母 句點等複數個記號。在步驟SA1中所顯示的初期 鍵5 01係按每個操作按鍵顯示有分配在各個操作 文字母或記號之一。亦即,如第16圖所示,顯示「 「Kj、「P」、「U」、「Z」。 此外,在第16圖中雖省略圖示,但如第17A 構成軟鍵501的各個操作按鍵501a,除了上述英 外,表示被分配在各個操作按鍵501a的其他英文 號的導引文字(「A〜E」、「Ζ·,」等)係以小 文字母的方式顯示。 另一方面,在構成軟鍵501的各個操作按鍵 按壓方向(z軸方向之相反方向)假想地設有複 的操作位置,在各階段的操作位置被分配有被分 操作按鍵501a的特定英文字母或記號之一。例如 作按鍵50 1 a係假想設有5階段的操作位置,如第 1 6圖所不 第4麥克 作,控.制 之前說明 時間差的 的影像, 、或點或 狀態的軟 按鍵的英 A」、「F」、 圖所示般 文字母以 字母或記 於上述英 501a ,朝 數個階段 配在相同 在各個操 1 7 B圖所 -35- 201140394 示,在被分配有「A〜E」的操作按鍵501a的第1層操作位 置分配「A」,而且在第2層〜第5層的各操作位置係分配 「B」〜「E」。亦即,控制部1 5 1係使初期狀態之軟鍵50 1 的各個操作按鍵501a,顯示被分配在各個操作按鍵501a的 第1層操作位置的英文字母或記號。 在以下說明中,將被分配至各操作按鍵501a之各層位 置的英文字母及記號稱爲文字等。 在進行步驟S A 1的處理後,控制部1 5 1逐次確認觸控 筆70的指示音是否已檢測出(步驟SA2 )。亦即,控制部 151係逐次確認在第1〜第4麥克風6A〜6D的輸出訊號的 音壓位準是否以些微時間差來呈現峰値。 接著,當控制部151可確認在第1〜第4麥克風6A〜 6D的輸出訊號的音壓位準以些微時間差呈現峰値(步驟 S A2 :是)時,則判斷可在該時點檢測出指示音,藉由之前 說明的方法,取得表示屬於指示音發生源之指示位置的指 示位置資訊,亦即第12A圖所示之正交座標中之座標位置 (X,y,z )(步驟 SA3 )。 第1 5圖係顯示控制部1 5 1中之指示位置資訊的取得順 序的流程圖。在取得指示位置資訊時,控制部1 5 1係將在 第1〜第4麥克風6A〜6D的輸出訊號的音壓位準呈現峰値 的時點設爲在各麥克風中指示音到達的時點。 接著,控制部1 5 1係藉由由在第3麥克風6C到達指示 音的時點的經過時間(tc ),減算在第1麥克風6A到達指 -36- 201140394 示音的時點的經過時間(tA),來取得第1及第3麥克風6a、 6C中之指示音的到達時間差Uc (步驟SA1〇1 )。 此外,控制部15 1係藉由以在第4麥克風6D指示音到 達的時點的經過時間(tD ) ’減去在第2麥克風6B指示音 到達的時點的經過時間(tB),來取得第2及第4麥克風6B、 6D中之指示音的到達時間差tBD (步驟SM〇2)。 此外’控制部15 1係藉由以在第4麥克風6D指示音到 達的時點的經過時間(tD)’減去在第1麥克風6A指示音 到達的時點的經過時間(t a ),來取得第1及第4麥克風6 A、 6D中之指示音的到達時間差tAD (步驟SA103 )。 接著,控制部1 5 1係進行依序設定(〇,〇,〇 )至(Lx, Ly,L:)的座標位置來作爲第12A圖所示之正交座標中之 任意點的座標位置(X,y,z)的處理(步驟SA104),在 之前說明的判別式的數式(1 2 ),代入所設定的座標位置 (X,y,z)、及在步驟SA101〜步驟SA103中所取得的各 組麥克風的到達時間差(tAC> tBD> tAD)>而求出運算結果 (η)(步驟SA105),使所求出的運算結果(n)與所設定 的座標位置(X,y,ζ )對應並記億在內部記憶體(步驟 SA106)。之後,控制部151係反覆進行步驟SA104〜步驟 SA106的處理直到座標位置(X,y,ζ)成爲(L«,L,,Lz) 爲止(步驟SA107 :否)。 接著,控制部15 1係於記憶在座標位置(X,y,z )代 入(L,,L,,Lz)時的運算結果(η)後(步驟SA107:是), -37- 201140394 確認所記憶的全部運算結果(η )中獲得最小値之運算結果 (η)時的座標位置(x,y,z)’取得所確認的座標位置(;(, y,z)作爲表示指示位置的座標位置,亦即指示位置資訊 (步驟 SA108 )。 其中,用以獲得式(12 )的運算結果(n )成爲最小値 的座標位置(X,y,ζ)的具體處理順序爲任意。 另一方面,控制部1 5 1係在取得作爲指示位置資訊的 座標位置(X,y,ζ)之後即返回第14圖所示之處理,確 認與所取得的座標位置(X,y,ζ )對應的顯示畫面3 1 a內 的指示位置(x,y)是否在按鍵區域內(步驟SA4)。亦即, 控制部1 5 1確認藉由所取得的座標位置(X,y,ζ )所表示 的XY平面的座標位置(X,y)是否被包含在構成軟鍵501 的任何操作按鍵5 0 1 a的顯示區域內。 接著,若顯示畫面31a內的指示位置(X,y)不在按 鍵區域內(步驟SA4 :否),則控制部15 1什麼也不做即返 回步驟SA2的處理。此外,控制部51係當顯示畫面3U內 的指示位置(X,y)在按鍵區域內時(步驟SA4:是),另 外確認與指示位置(X,y)對應的操作按鍵是否爲已在選 擇中的操作按鍵(步驟SA5 )。 在處理開始的最初,即使顯示畫面3 1 a內的指示位置 (X,y)在按鍵區域內,與指示位置(X,y)對應的操作 按鍵亦非爲選擇中的操作按鍵(步驟SA5:否)。因此,控 制部151首先使顯示中的文字等(第1層操作位置的文字 -38- 201140394 或記號)反轉顯示在與指示位置(x,y)對應的位置的操 作按鍵,並且將該操作按鍵作爲選擇中的操作按鍵,而將 表示該操作按鍵的預定的按鍵識別資訊記億在內部記憶體 (步驟SA6 )。此外,控制部151係將在步驟SA3中取得的 座標位置(X,y,z)的z座標作爲z軸方向(高度方向) 的基準位置而記憶在內部記憶體後(步驟SA7),立即返回 步驟SA2的處理。 因此,使用者在按壓例如按鈕開關7 2的狀態下使觸控 筆70的前端部朝「A〜E」的操作按鍵的上方移動時,「A 〜E」的操作按鍵被記憶爲選擇中的操作按鍵,並且如第 16圖的狀態I所示,第1層的「A」的文字被反轉顯示。同 時,觸控筆70的前端部的上下方向的位置被記億。 接著,控制部151係在每次檢測指示音時(步驟SA2 : 是),取得新的座標位置(X,y,z)(步驟SA3)。接著, 控制部151爲,在步驟SA3中取得新的座標位置(X,y,z) 之際,當顯示畫面31a內的指示位置(X,y)在按鍵區域 內(步驟SA4 :是),但是與指示位置(x,y)對應的操作 按鍵非爲選擇中的操作按鍵時,亦即與指示位置(X,y) 對應的操作按鍵改變成其他操作按鍵時(步驟SA5:否), 會再次執行步驟SA6、SA7的處理。 亦即’控制部151係使顯示中的文字反轉顯示於與新 的指示位置(X’ y)對應的位置的操作按鍵等,並且將該 操作按鍵作爲選擇中的操作按鍵,將表示該操作按鍵的預 -39- 201140394 定的按鍵識別資訊記憶在內部記憶體(步驟SA6 )。 此外,控制部151係將新取得的座標位置(X,y,z) 的Z座標作爲Z軸方向的基準位置而記憶在內部記憶體(步 驟 SA7)。 因此,使用者一面按壓按鈕開關72,一面使例如觸控 筆70的前端部由分配有「A〜E」的操作按鍵移動至分配有 「K〜0」的操作按鍵的上方時,分配有「K〜◦」的操作按 鍵被記憶作爲選擇中的操作按鍵,並且如第1 6圖之狀態II 所示,第1層的「K」的文字被反轉顯示。同時,觸控筆 70的前端部的上下方向的位置被記憶。 此外,控制部151爲,在步驟SA3中取得新的座標位 置(X,y,z)之際,當顯示畫面31a內的指示位置(X,y) 在按鍵區域內(步驟SA4:是),而且與指示位置(X,y) 對應的操作按鍵爲選擇中的操作按鍵(步驟SA5:是)時, 即確認在z座標是否有變化(步驟SA8 )。 若在z座標沒有變化(步驟S A8 :否),控制部1 5 1立 即返回步驟SA2的處理。此外,控制部151爲,若在z座 標有變化(步驟SA8 :是),則由被記憶作爲基準位置的z 座標的値減去新的z座標的値,藉此計算由指示位置(指 示音的發訊位置)中在步驟SA7中所記憶的基準位置朝下 方的移動量(步驟SA9 )。其中,在步驟SA9的處理中,控 制部151係當移動量爲負的値時,將移動量設爲〇。 接著,控制部51係確認反轉顯示中的文字等是否爲因 -40- 201140394 應在步驟SA9中所計算的移動量而預先決定的操作位置 (層位置)的文字等(步驟SA10)。此外,移動量與層位 置呈現每當移動量增加一定量,操作位置即增加1層的關 係。 接著’若反轉顯示中的文字等爲與所計算的移動量對 應的層位置的文字等(步驟SA10 :是),則控制部151什 麼也不做而返回步驟SA2的處理。相反地,若反轉顯示中 .的文字非爲與所計算的移動量對應的操作位置的文字等 (步驟SA10:否),則控制部151將反轉中的文字等變更 成與移動量對應的操作位置的文字等後(步驟SA11),暫 時返回步驟SA2的處理。 因此,使用者一面按壓按鈕開關72,一面使例如觸控 筆70的前端部朝分配有「K〜0」的操作按鍵的上方移動 後,若使觸控筆70的前端部朝顯示畫面3 1 a側(下方側) 移動預定量,則如第16圖之狀態III所示,反轉中的文字 由「K」變更爲例如「N」。 另一方面,控制部1 5 1係在反覆進行步驟SA2以後的 處理的期間,沒有指示音(步驟SA2 :否),而且指示音無 法檢測的狀態持續預定時間以上,亦即持續比觸控筆70中 之指示音的發訊間隔爲更長的預定時間以上時(步驟 SA12 :是),執行以下處理。 首先,控制部1 5 1係確認之前的顯示畫面3 1 a內的指 示位置(X,y)是否在按鍵區域內(步驟SA13)。接著, -41 - 201140394 當之前的指示位置(X,y)在按鍵區域內時(步驟SA13: 是)’控制部151將在選擇中的操作按鍵顯示中的文字等顯 示在顯示畫面31a之的預定的文字輸入區域(步驟SA14)。 亦即,進行文字資訊的輸入處理。 因此’使用者若在例如第1 6圖之狀態III所示之狀態 下,停止按壓按鈕開關72的操作而使指示音的發生停止, 則如第16圖之狀態IV所示,在顯示畫面31a內的預定的 文字輸入區域輸入「N」的文字。 此外,控制部151係在處理步驟SA13之際,於之前的 指示位置(X,y)不在按鍵區域內時(步驟SA13:否), 將軟鍵501初始化之後,亦即將軟鍵501恢復成與在步驟 SA1中顯示時相同的初始狀態之後(步驟SA),返回步驟 SA2的處理。 之後,控制部151係在藉由使用者解除軟鍵模式爲止 的期間,反覆執行步驟SA2以後的處理。 如以上所示,在使用筆輸入功能之際於攜帶式資訊終 端100設定軟鍵模式時,使用者係使用觸控筆70來輸入所 期望的文字等。 (毛筆模式) 接著,針對被使用者設定毛筆模式時之攜帶式資訊終 端1 00的動作加以說明。第1 8圖係顯示控制部1 5 1的處理 內容的流程圖,第19圖係顯示毛筆模式設定中之觸控筆70 的操作、及因應觸控筆70的操作之LCM31的顯示畫面31a -42- 201140394 中之顯示內容之變化之一例的說明圖。 如第1 8圖所示,控制部1 5 1係在毛筆模式的設定之同 時開始動作,首先開始觸控筆70所發出之指示音的檢測動 作,並且將應描繪線條的粗細(線寬)設定爲預先決定的 基準粗細(步驟S B 1 )。此外,指示音的檢測動作係與軟鍵 模式的情形同樣,控制部1 5 1係在指示音之檢測動作開始 進行的時點,開始計數之前說明的複數組麥克風的各個麥 克風中之指示音的到達時間差的計算時所使用的經過時 間。 在進行步驟SB1的處理後,控制部151係逐次確認觸 控筆70的指示音是否已檢測(步驟SB2 )。亦即,控制部 151逐次確認在第1〜第4麥克風6A〜6D之輸出訊號的音 壓位準是否以些微時間差呈現峰値》 接著,控制部151若可確認在第1〜第4麥克風6A〜 6D的輸出訊號的音壓位準以些微時間差呈現峰値,則判斷 在該時點可檢測指示音(步驟SB2 :是),藉由第15圖所 示之已說明的處理來取得表示屬於指示音發生源的指示位 置的指示位置資訊,亦即第12A圖所示之正交座標中之座 標位置(X,y,z)(步驟SB3)。 接著,控制部15 1確認取得的座標位置(X,y,z )所 顯示之XY平面的座標位置(X,y)是否在顯示畫面31a 內的位置(步驟SB4)。 若指示位置(X,y)不在顯示畫面31a內(步驟SB4: -43- 201140394 否)’則控制部1 5 1什麼也不做即返回步驟SB2的處理。此 外’當指示位置(X,y)在顯示畫面31a內時(步驟SB4: 是),控制部151進一步確認是否在描繪中(步驟SB5 )。 此外’步驟S B 5的確認係藉由確認是否內部記憶體記憶有 後述之描繪旗標來進行。 在處理開始的最初,即使指示位置(X,y)在顯示畫 面31a內,亦非爲描繪中的狀態(步驟SB5:否)。因此, 控制部151係先將步驟SB3中所取得的座標位置(X,y,z) 的z座標作爲z軸方向(高度方向)的基準位置而記億在內 部記憶體(步驟S B 6 )。 此外,控制部1 5 1係將顯示畫面3 1 a內的指示位置(X, y )作爲描繪位置而記憶在內部記憶體,又設定表示描繪中 的描繪旗標(步驟SB7)。另外,描繪旗標的設定係將描繪 旗標記憶在內部記憶體的處理。然後,控制部1 5 1係在顯 示畫面31a內的指示位置(X,y)顯示起點(步驟SB8), 且暫時返回至步驟SB2的處理。 亦即,當使用者在使觸控筆70的前端部位於顯示畫面 3 1 a之所期望位置之上方的狀態下按壓按鈕開關72時,如 第1 9圖之狀態I所示,在顯示畫面3 1 a之所期望的位置顯 示起點S。同時,記憶顯示畫面3 1 a內的指示位置(X,y )、 及觸控筆70之前端部之上下方向的位置。 接著,控制部151係在每次檢測指示音時(步驟SB2 : 是)’取得新的座標位置(X,y,z)(步驟SB3)。接著, -44 - 201140394 控制部15 1係在步驟SB3中取得新的座標位置(χ,y,z) 時’若XY平面的座標位置(x’y)爲顯示畫面3ia內的位 置(步驟SB4:是)’而且在描繪中(步驟SB5:是),則將 新的XY平面的座標位置(X,y)作爲這次描繪位置而記 憶在內部記憶體(步驟SB9 )。 然後’控制部1 5 1執行以下處理。首先,控制部1 5 ! 係確認z座標是否改變(步驟s B10 )。接著,若在z座標 沒有改變(步驟S B 1 0 :否)’則控制部1 5 1立即在顯示畫 面31a內之前次描繪位置(X,y)與這次描繪位置(X,y) 之間’描繪將這次描繪位置(X,y)的粗細設爲設定中之 粗細的線條(步驟S B 1 3 )。 另一方面’控制部151爲,當在z座標有變化(步驟 SB10:是)’由被記憶作爲基準位置之z座標的値減去新的 z座標的値,藉此計算指示位置(指示音的發訊位置)中 之在步驟SB6中所記億的基準位置朝上下方向的移動量 (步驟S B 1 1 )»亦即,控制部1 5 1係取得正或負的値作爲 移動量。 接著,控制部1 5 1係因應所計算的移動量來增減應描 繪的線條的粗細(步驟SB12)。在步驟SB12的處理中,控 制部1 5 1係當所計算的移動量爲正的値,且指示位置由基 準位置朝下方移動時,進行將應描繪的線條粗細以因應移 動量的程度進行比基準粗細還要粗的設定。此外,在步驟 SB12的處理中,控制部151係當所計算的移動量爲負的 -45- 201140394 値,且指示位置由基準位置朝上方移動時,進行將應描繪 的線條粗細以按照移動量的程度比基準粗細還要細的設 定。 然後,控制部151係在顯示畫面31a內之前次描繪位 置(X,y)與這次描繪位置(X,y)之間,描繪將這次描 繪位置(X,y)中的粗細設爲設定中的粗細的線條(步驟 SB13)。之後,控制部151係暫時返回步驟SB2的處理,在 可檢測指示音的期間,在每次檢測指示音時反覆執行步驟 SB9〜步驟SB13的處理》 因此,如第19圖之狀態I所示,在顯示畫面31a顯示 起點S之後,例如當使用者一面按壓按鈕開關72,一面使 觸控筆70(的前端部)朝斜右下方向移動時,如第19圖之 狀態II所示,在顯示畫面3 1 a描繪由起點S朝向右方慢慢 變粗的線條K。此外,當使用者使觸控筆70朝斜右上方向 移動時’如第1 9圖之狀態III所示,描繪中的線條κ的粗 細係一面慢慢變細,一面朝右方延伸。亦即,進行線圖資 訊的輸入處理。 另一方面,控制部1 5 1爲,在反覆進行步驟S B 2以後 的處理之期間’無法檢測指示音(步驟S B 2 :否),而且無 法檢測指示音的狀態持續預定時間以上,亦即比觸控筆7 〇 中之指示音的發訊間隔爲更長的預定時間以上時(步驟 SB14:是),即執行以下處理。 亦即控制部1 5 1係將應描繪的線條的粗細恢復成基準 -46- 201140394 的粗細(步驟SB 15 ),又將描繪旗標設爲OFF狀態(步驟 SB16)。將描繪旗標設爲OFF狀態的處理係將描繪旗標由 內部記憶體消去的處理。之後,控制部1 5 1係返回步驟SB2 的處理,在被使用者解除毛筆模式之期間,反覆執行步驟 S B 2以後的處理。 因此,使用者係在描繪所期望的線後,暫時停止按壓 按鈕開關72的操作而使指示音的發生停止後,再次按壓按 鈕開關72,藉此可開始進行新的線條的描繪。 根據以上,在使用筆輸入功能之際當在攜帶式資訊終 端100設定毛筆模式時,使用者可藉由使觸控筆70相對於 顯示畫面31a朝縱橫方向移動,來描繪所期望的線條。同 時,使用者可在線條的描繪中使觸控筆70上下移動來改變 線條的粗細。亦即,使用者係可以與用毛筆書寫線條或文 字時相同的感覺,一面自在地調整線條粗細,一面將所期 望形狀的線條或文字等描繪在顯示畫面3 1 a。 (線圖模式) 接著,針對藉由使用者設定線圖模式時之攜帶式資訊 終端1 00的動作加以說明。第20圖係顯示控制部1 5 1的處 理內容的流程圖,第2 1圖係顯示線圖模式之設定中之觸控 筆70的操作、及因應觸控筆70之操作的LCM31的顯示畫 面31a中之顯示內容的變化之一例的說明圖。 如第20圖所示,控制部1 5 1係在線圖模式的設定之同 時開始動作,首先開始進行觸控筆70所發出之指示音的檢 -47- 201140394 測動作’並且將應描繪的線條粗細設定爲預先決定的基準 粗細(步驟S C 1 )。此外,指示音的檢測動作係與軟鍵模式 及毛筆模式的情形相同,控制部1 5 1係在指示音的檢測動 作開始的時點,開始之前說明的複數組麥克風的各個麥克 風中之指示音的到達時間差計算時所使用的經過時間的計 數。 在進行步驟SC 1的處理後,控制部1 5 1係逐次確認是 否可檢測觸控筆70的指示音(步驟SC2 )。亦即,控制部 151係逐次確認在第1〜第4麥克風6A〜6D的輸出訊號的 音壓位準是否以些微時間差呈現峰値。 接著,當控制部151可確認在第1〜第4麥克風6A〜 6D的輸出訊號的音壓位準以些微時間差呈現峰値時,則判 斷可在該時點檢測指示音(步驟SC2:是),藉由第15圖 所示之已說明的處理來取得表示屬於指示音發訊位置之指 示位置的指示位置資訊,亦即第12A圖所示之正交座標中 之座標位置(X,y,z)(步驟SC3)。 接著,控制部1 5 1係在將所取得的座標位置(x,y,z ) 中的z座標轉換成y座標之後(步驟SC4),確認轉換後的 座標位置(x’y)是否爲顯示畫面31a內的位置(步驟SC5)。 若轉換後的座標位置(x,y)不在顯示畫面31a內(步 驟SC5 :否)’則控制部151什麼也不做即返回步驟SC2的 處理。此外’ 1當轉換後的座標位置(X,y)在顯示畫面 31a內時(步驟SC5:是),控制部15進一步確認是否在描 -48- 201140394 繪中(步驟SC6 ) »另外,步驟SC6的確認係藉由確認是否 在內部記憶體記億有後述描繪旗標來進行。 在處理開始的最初,即使轉換後的座標位置(X,y) 在顯示畫面31a內,亦非爲描繪中的狀態(步驟SC6:否)。 因此,控制部151先將轉換後的座標位置(X,y)作爲描 繪位置而記億在內部記憶體,另外設定表示在描繪中的描 繪旗標(步驟SC7)。此外,描繪旗標的設定係將描繪旗標 記憶在內部記憶體的處理。然後,控制部1 5 1係在顯示畫 面31a內的描繪位置(X,y)顯示起點(步驟SC8),暫時 返回至步驟SC2的處理。 亦即,當使用者在使觸控筆70的前端部位於顯示畫面 3 1 a所期望位置的上方側的狀態下按壓按鈕開關72時,如 第21圖之狀態I所示,在顯示畫面31a顯示起點S。同時, 記憶顯示畫面31a內的描繪位置(X,y)。但是,不同於之 前說明的毛筆模式的情形,由於顯示畫面31a的縱方向(y 軸方向)成爲3次元空間的上下方向(z軸方向),因此例 如在觸控筆70的前端部抵接於顯示畫面31a時,起點S的 顯示位置係成爲與顯示畫面31a的下邊相接的位置。 接著,控制部151係在每次檢測指示音(步驟SC2 : 是)時,取得新的座標位置(X,y,z)(步驟SC3 ),將所 取得的座標位置(X,y,z)中的z座標轉換爲y座標(步 驟 SC4)。 接著,若轉換後的座標位置(X,y)爲顯示畫面31a -49- 201140394 內的位置(步驟SC5:是),且爲描繪中(步驟SC6:是), 則控制部1 5 1將新取得的轉換後的座標位置(X,y )作爲 這次描繪位置而記憶在內部記憶體(步驟SC9 )。然後,控 制部151係在顯示畫面31a描繪將前次描繪位置(X,y) 與這次描繪位置(X,y)之間連結的線條(步驟SC10)。 之後,控制部151暫時返回步驟SC2的處理,在可檢 測指示音的期間,在每次檢測指示音時,反覆執行步驟SC4 〜步驟SC6、步驟SC9、步驟SC10的各處理。 因此,如第21圖之狀態I所示,在顯示畫面31a顯示 起點S之後,例如當使用者一面按壓按鈕開關72 —面使觸 控筆70 (的前端部)以朝向遠離顯示畫面31a的方向(上 方)描繪螺旋的方式移動時,在顯示畫面31a可依第21圖 的狀態II、第2 1圖的狀態III所示順序描繪線條K »亦即, 進行線圖資訊的輸入處理。 亦即,在顯示畫面31a描繪表示觸控筆70的前端部的 軌跡之線條K,該線條K係在使視線與顯示畫面3 1 a呈平 行、且與顯示畫面31a的縱方向(y軸方向)一致而進行觀 察的狀態下,亦即由特定方向觀察的狀態下之線條Κ» 另一方面,控制部1 5 1係在反覆進行步驟SC2以後的 處理的期間無法發出指示音(步驟SC2 :否),而且無法檢 測指示音的狀態持續預定時間以上,亦即持續比觸控筆70 中之指示音的發訊間隔爲更長的預定時間以上時(步驟 SC11:是),將描繪旗標設爲OFF狀態(步驟SB16)。將 -50- 201140394 描繪旗標設爲OFF狀態的處理,係將描繪旗標由內部記憶 體消去的處理。之後,控制部151係返回步驟SC2的處理, 迄至藉由使用者解除線圖模式爲止的期間,反覆執行步驟 SC2以後的處理。 因此,使用者係在描繪所期望的線條之後,暫時停止 按壓按鈕開關72的操作而使指示音的發訊停止,然後,再 次按壓按鈕開關72,藉此可開始新的線條的描繪。 由以上得知,於使用筆輸入功能之際在攜帶式資訊終 端100設定有線圖模式時,使用者藉由使觸控筆70在顯示 畫面31a的上方側移動,可與觸控筆70的前端部在3次元 空間的移動軌跡對應,並且可描繪表示由特定方向觀察移 動軌跡時的形狀的線圖。 亦即,第3實施形態的指示位置檢測裝置具備有:具 有顯示畫面的顯示模組;複數個麥克風,係彼此分離配置 在前述顯示畫面的外周部,用以檢測由前述顯示畫面上的 3次元空間所發出的指示音;時差取得部,係對3種前述 麥克風的組合,取得2個前述麥克風間之前述指示音的到 達時間差;以及位置資訊取得部,係依藉由前述時差取得 部所取得的每個前述到達時間差,導出以與該到達時間差 對應的前述麥克風作爲焦點的雙曲面,取得以該所導出的 3個雙曲面的交點作爲發出前述指示音的位置資訊。 接著’在第3實施形態中具備有指示位置檢測裝置的 攜帶式資訊終端1〇〇中,係在藉由使用者來使用筆輸入功 -51 - 201140394 能時,藉由第1〜第4麥克風6A〜6D來檢測觸控筆70所 發出的指示音,根據彼此成組的麥克風間之指示音的到達 時間差,取得表示屬於指示音發訊位置的觸控筆70的前端 部的位置的座標位置(x,y,z)來作爲表示對顯示畫面31a 之指示位置的指示位置資訊。 因此,如使用電阻膜方式的觸控面板來檢測對顯示畫 面3 1 a的指示位置的情形所示,並不需要以其他構件來覆 蓋顯示畫面31a。因此,可在不會使LCM1的顯示特性降低 的情況下檢測顯示畫面3 1 a中之指示位置。 而且,在攜帶式資訊終端1〇〇中,爲了取得3次元的 位置資訊(X,y,z)作爲指示位置資訊,在前述之軟鍵模 式下顯示於顯示畫面31a的軟鍵501,係可在複數個操作按 鍵的一個一個上分配複數文字等。亦即,與可使用一般的 軟體鍵盤,藉由畫面上的按鍵選擇來輸入文字等的情形相 比,可刪減顯示在顯示畫面31a內的操作按鍵數。因此, 藉由使軟鍵501的顯示面槙變小,在可藉由筆輸入功能來 輸入文字等時,可有效地使用顯示畫面31a。 此外,在前述之毛筆模式下,如前所述,使在顯示畫 面31a描繪中的線條粗細因應觸控筆70的上下動作而逐次 變化,藉此可讓使用者以與用毛筆書寫線條或文字時相同 的感覺自在地調整線條粗細。 此外,在前述之線圖模式中,如前所述,可與觸控筆 70的前端部在3次元空間的移動軌跡對應,並且可描繪表 -52- 201140394 示由特定方向觀察移動軌跡時之形狀的線圖。而且,使用 者係在線圖的描繪作業中,逐次確認因與實際視點不同的 視點所造成的線圖(移動軌跡),藉此即使爲表示稍微複雜 的3次元形狀的線圖,亦可較容易描繪。 其中,在實施本發明時,亦可將本實施形態中說明之 攜帶式資訊終端100的構成等變更爲如下所示。 例如在第1〜第4麥克風6A〜6D中分別相互配置有二 組麥克風之彼此呈正交的2條直線LL、MM,亦可未必存 在於同一平面,2條直線LL、MM亦可存在於彼此平行的 不同平面。此外,2條直線LL、MM亦可存在於彼此不平 行的不同平面者。 此外,如本實施形態所示,2條直線LL、MM形成正 交時,在表示對顯示畫面31a的任意指示位置P之座標位 置(x,y,z)的計算上較爲方便,但是2條直線LL、MM 亦可爲至少於投影在顯示畫面31a時在顯示畫面31a內僅 形成交叉。 此外,第1〜第4麥克風6A〜6D係如第22圖所示, 亦可配置在顯示畫面31a的各個角部。亦即,第1〜第4 麥克風6A〜6D亦可分別成對配置在包含顯示畫面31a的一 對角線的直線L1上及包含另—對角線的直線Ml上。 此外,LCM1中之第1〜第4麥克風6A〜6D的設置部 位爲,只要使用者對顯示畫面31a指示出任意位置時可在 顯示畫面31a的上方檢測出觸控筆70所發出的指示音即 -53- 201140394 可,可作適當變更。亦即第1〜第4麥克風6A〜6D只要彼 此分離即可,可配置在顯示畫面31a的外周部分的任意位 置。 此外,在本實施形態中,係在顯示畫面31a的外周部 設置第1〜第4麥克風6A〜6D,將三組麥克風中的一組麥 克風設爲其他二組麥克風之各組中之一側的麥克風。亦即 將第1及第4麥克風6A、6D作爲一組麥克風來處理。 但是,例如亦可在顯示畫面31a的外周部,除了第1 〜第4麥克風6A〜6D以外,另外設置第5麥克風與第6 麥克風,藉此由未構成其他組的麥克風的2個麥克風來構 成三組麥克風之各組的麥克風。 此外,例如亦可在顯示畫面31a的外周部,除了第1 〜第4麥克風6A〜6D以外,另外僅設置第5麥克風,藉此 僅將5個麥克風的任一者構成彼此不同的二組麥克風者來 處理。 此外,亦可爲在顯示畫面31a的外周部僅設置第1〜第 3麥克風6A〜6C,將3個麥克風的各個麥克風構成不同的 一組麥克風的其中一組與另一組來處理。亦即,亦可將第 1及第2麥克風6A、6B視爲第1組,將第2及第3麥克風 6B、6C設爲第2組,將第3及第1麥克風..6..C..、6A視爲第 3組,來分別作處理。 此外,如本實施形態所示,在顯示畫面31a的外周部 設置第1〜第4麥克風6A〜6D的4個麥克風的情形自不待 -54- 201140394 言’即使如前述般在顯示畫面31a的外周部設置5個麥克 風或6個麥克風的情形’亦可針對各組麥克風的組合來採 用任意組合。 此外,即使在顯示畫面31a的外周部設置3個麥克風、 5個麥克風、或6個麥克風的情形,關於外周部中之各麥 克風的具體配置形態亦可採用任意的配置形態。 此外,在控制部1 5 1,亦可藉由附加作爲本發明之位置 取得控制部、及補正部的功能,在檢測出指示音時利用與 本實施形態不同的以下處理,來取得表示對顯示畫面31a 之任意指示位置P的座標位置(X,y,z)。 例如使控制部1 5 1進行根據本實施形態中說明之順 序,運算第13B圖所示之不同的3個雙曲面之交點P的座 標位置(X,y,z ),取得運算結果作爲第1指示位置資訊 的處理。接著,使控制部151將3個雙曲面中以第1及第4 麥克風6A、6D作爲焦點之第3雙曲面(雙曲線)30p、30q, 如第23圖所示般變更成以將第2及第3麥克風6B、6C作 爲焦點之雙曲面40p、40q之後,再按照與本實施形態相同 的原理,運算不同的3個雙曲面之交點P的座標位置(X, y,z ) ° 亦即,使控制部1 5 1進行分別取得由與本實施形態中 之組合(第1組合)不同之其他組合(第2組合)所成的 三組麥克風之各組中之指示音的到達時間差,根據所取得 的各組到達時間差,運算3個雙曲面之交點P的座標位置 -55- 201140394 (x’y,z),取得運算結果作爲第2指示位置資訊的處理。 此外’第23圖係與第13B圖相同,僅爲方便顯示各個雙曲 面(雙曲線)者,形狀或位置關係與實際上不同。 之後’使控制部151,計算位於第1指示位置資訊中之 X座標、與第2指示位置資訊中之x座標的中間的點的X 座標’取得計算結果作爲補正後的X座標。同樣地,使控 制部151計算第1指示位置資訊中之y座標、與第2指示 位置資訊中之y座標的中間的點的y座標,取得計算結果 作爲補正後的y座標。此外,使控制部51計算位於第丨指 示位置資訊中之Z座標、與第2指示位置資訊中之Z座標 的中間的點的z座標,取得計算結果作爲補正後的z座標。 換言之,使控制部1 5 1藉由第2指示位置資訊來補正 第1指示位置資訊,取得由補正後之X,y,Z的各座標所 成的座標位置(X,y,Z)作爲第3指示位置資訊,取得第 3指示位置資訊作爲最終指示位置資訊。 如上所述,若改變三組麥克風中一組麥克風的組合, 而取得第1指示位置資訊與第2指示位置資訊,利用第2 指示位置資訊來補正所取得的第i指示位置資訊,藉此取 得最終指示位置資訊(第3指示位置資訊),則可提升顯示 畫面3 1 a."中之指示位置的檢測精度。另外,不同於上述例, 亦可在取得第1指示位置資訊與第2指示位置資訊時,改 變三組麥克風的所有組合麥克風的組合。 此外,在本實施形態中,係針對在控制部151取得指 -56- 201140394 示位置資訊時,在式(12)的座標値(x,y,z)依序代入 表示顯示畫面31a上方之一定範圍內的3次元空間的各點 的座標値而分別求出運算結果(η),取得運算結果(η)爲 最小時的座標値(X,y,ζ )作爲指示位置資訊的構成加以 說明。但是,在求出指示位置資訊,亦即3個雙曲面的交 點(或者可判斷爲交點的點)之座標位置(X,y,ζ )時的 具體方法係可適用任意的方法。 另一方面,第1〜第4麥克風6A〜6D所檢測的指示音 亦可在可聽範圍的頻率頻帶具有特性者,亦可爲在非可聽 範圍的頻率頻帶具有特性者。在將指示音作成在可聽範圍 的頻率頻帶具有特性者時,可在觸控筆70操作中對使用者 提供確實的操作感。此外,在將指示音作成在非可聽範圍 的頻率頻帶具有特性者時,可對可聽得到指示音而感到心 煩的使用者提供良好的操作環境,同時可使周圍者覺得指 示音爲雜訊的不良情形消失。 此外’在攜帶式資訊終端100,以指示音的檢測模式而 言,係有:應檢測的指示音在可聽範圍的頻率頻帶具有特 性者的第1檢測模式、及應檢測的指示音在非可聽範圍的 頻率頻帶具有特性者的第2檢測模式等2種檢測模式,亦 可確保使用者可視需要..來切換指示音的檢測模式的構成。 若在攜帶式資訊終端100確保上述構成,則使用者可依喜 好或使用環境而選擇性分開使用發出在可聽範圍的頻率頻 帶具有特性的指示音者、及發出在非可聽範圍的頻率頻帶 -57- 201140394 具有特性的指示音之構成來作爲觸控筆。 此外,在本實施形態中,係針對當設定軟鍵模式作爲 使用筆輸入功能時的動作模式時,控制部151使LCM31的 顯示畫面31a顯示由複數個操作按鍵所構成的軟鍵501者 加以說明。但是,在軟鍵模式中,若爲假想地設有複數個 階段的操作位置,則亦可形成爲控制部1 5 1使單一操作按 鍵顯不於顯不畫面31a的構成。 此外,在本實施形態中,是顯示在複數個操作按鍵分 配有英文字母或記號者,作爲軟鍵501的一例。但是,軟 鍵501亦可形成爲例如在各個操作按鍵將數字分成複數個 群組來作分配者。 此外’只要是與各階段的操作位置對應而預先作分配 的資訊’則控制部151亦可使LCM31的顯示畫面31a所顯 示的軟鍵501或單一操作按鍵上,顯示文字資訊以外之其 他資訊。 此外’在本實施形態中,當設定線圖模式作爲可使用 筆輸入功能時的動作模式時,控制部1 5 1係作成使顯示於 LCM31之顯示畫面31a的線圖爲表示使視線與顯示畫面31a 平行,且使其與顯示畫面31a的縱方向(y軸方向)一致而 觀察的狀態下之觸控筆70之前端部.的軌跡的線K。但是, 在線圖模式中,控制部51亦可作成使顯示於LCM31的顯 示畫面31a的線圖爲,例如由斜上方觀察觸控筆70的前端 部的軌跡之前端部的移動範圍的狀態者。 -58- 201140394 jfct外,控制部151亦可使顯不在LCM31的顯不畫面31a 的線圖非爲單—。亦即,例如亦可在LCM31的顯不畫面 31a,同時顯示由x軸力@胃胃到軌 跡之狀態下的線圖 '由y軸方向觀察到觸控筆70的前端部 的軌跡之狀態下的線圖、及由z軸方向觀察到觸控筆70的 前端部的軌跡之狀態下的線圖等3種線圖° 此外,在本實施形態中’係針對預先準備有軟鍵模式、 毛筆模式及線圖模式等3種動作模式來作爲用以在攜帶式 資訊終端1 〇〇使用筆輸人功能的動作模式的情形加1以說 明。但是,在攜帶式資訊終端100,除了 3種動作模式以外’ 亦可設置其他動作模式。 以其他動作模式而言’例如控制部1 5 1將與於顯示畫 面31a顯示中的軟鍵501不同的其他影像等因應對顯示畫 面3 1 a的指示位置(指示位置資訊)來進行控制之動作模 式、或控制部151在顯不畫面31a因應對顯不畫面31a的 指示位置(指示位置資訊),而使有別於線圖的其他任意資 訊(影像資訊或文字資訊)重新顯示的動作模式。 此外,在上述其他的動作模式中,可使控制部151,在 以因應觸控筆70中之指示音的發訊周期的一定時間間隔 連續取得指示位置資訊的期間內,進行控制在顯示畫面3 12 顯示中的影像等、或使顯示畫面31a新顯示任意資訊的處 理,亦可在取得指示位置資訊的任意時點進行。 此外,在本實施形態中,係針對具備有作爲本發明之 -59- 201140394 指示位置檢測裝置的構成、及作爲本發明之顯示裝置的構 成,並且具有可使用觸控筆70進行文字或線圖的輸入之筆 輸入功能的攜帶式資訊終端100加以說明》但是,本發明 之指示位置檢測裝置及顯示裝置亦可組裝在其他裝置,而 不限於攜帶式資訊終端100。 此外,當然,表示本發明中所檢測的指示位置、亦即 3次元空間內之指示音之發訊位置的座標位置(X,y,z) 並非限定於對本實施形態中所說明之LCM3 1所具有之顯示 畫面的指示位置,亦可爲LCM1以外之CRT等其他顯示機 器所具有之顯示畫面中之任意指示位置。 同業者將可輕易連想到其他優點及修改,因此,本發明之 範圍不限定於此處所示與所述之特定細節及代表的實施 例。因此,在未超出隨附之申請專利範圍與其等效者所界 定之一般發明構思的精神或範圍內可作各種修改。 【圖式簡單說明】 第1圖係顯示第1實施形態之指示位置檢測裝置的構 成圖。 第2A圖係第1實施形態中之各麥克風的配置圖。 第2B圖係第1實施形態中之各麥克風的配置圖。 第3 .圖係顯示第1實施形態中之各麥克風之座標位置 圖。 第4A圖係顯示第1實施形態中之指示位置之取得方法 的說明圖。 -60- 201140394 第4B圖係顯示第丨實施形態中之指示位置之取得方法 的說明圖。 第5圖係顯示第1實施形態中之各麥克風之其他配置 例的配置圖。 第6圖係顯示成爲雙曲線之計算對象之一對麥克風之 其他組合的說明圖。 第7圖係顯示第2實施形態之指示位置檢測裝置的構 成圖。 第8A圖係顯示偏光板之具體構造之例的說明圖。 第8B圖係顯示偏光板之具體構造之例的說明圖。 第8C圖係顯示偏光板之具體構造之例的說明圖。 第9圖係顯示第3實施形態之攜帶式資訊終端的構成 圖。 第1 0圖係顯示第3實施形態中之顯示部的示意構造剖 面圖。 第11圖係顯示第3實施形態中之攜帶式資訊終端之電 氣構成的示意方塊圖。 第1 2 A圖係顯示3次元空間中之任意指示位置的位置 圖。 第1 2B,.圖係顯示第3實施形態中之各麥克風之XY座 標系之座標位置圖。 第13A圖係顯示第3實施形態中之指示位置資訊之取 得方法的說明擱。 -61 - 201140394 第1 3 B圖係顯示第3實施形態中之指示位置資訊之取 得方法的說明圖。 第14圖係顯示軟鍵模式下的處理內容的流程圖。 第1 5圖係顯示指示位置資訊取得處理的流程圖。 第16圖係例示軟鍵模式下之攜帶式資訊終端之動作 的說明圖。 第17A圖係顯示軟鍵之詳細內容的說明圖。 第17B圖係顯示軟鍵之詳細內容的說明圖。 第1 8圖係顯示毛筆模式下之處理內容的流程圖。 第1 9圖係例示毛筆模式下之攜帶式資訊終端之動作 的說明圖。 第20圖係顯示線圖模式下之處理內容的流程圖。 第21圖係例示線圖模式下之攜帶式資訊終端之動作 的說明圖。 第22圖係顯示第3實施形態中之麥克風之其他配置例 的配置圖。 第23圖係顯示三組麥克風之其他組合的說明圖。 【主要元件符號說明】Lxcosg^ 3Ly sin0 2a 2b, y 16b xy b xy Therefore 'satisfy the coordinate positions (X, y, Z) of all equations (7), (8), and (11) with each set of microphones as the focus of each pair The intersection point of the curved surface becomes the transmission position of the indication sound, that is, the coordinate position (X, y, z) with respect to any indication position P of the display screen 3la ^ but 'for example, if the arrival time difference of each group of microphones (tAC, tBD) , ) When there is an error, 'the distance difference (2ax ' 2 a, ' 2a, y ) between the positions of the indication sounds between the microphones of each group also produces an error, so -32- 201140394 cannot be satisfied. (7) The coordinate position (X, y, z) of the equations (8) and (11). Therefore, in the control unit 151, the coordinates of the arbitrary indication position P are obtained by using the following formula (12). Position (X, y, z), which indicates position information" n = {F(x, y, z)f + {G(x, y, z)}2 + {H(x, y, z)} 2 where F(x, y, z) = (left) - (right) of equation (6) G(x, y, z) = (left) - (right) of equation (6) H (x, y , z) = (left) - (right) of equation (6) (12) above (1 2 ) When there is no error in the distance difference (2a»> 2ay, 2aiy) obtained from the arrival time difference (Uc, tBD, tAD ) of each group of microphones and the position of the indication sound between each group of microphones, the calculation result ( η) becomes a discriminant of 0 (specific 値). The specific sequence when the control unit 151 obtains the position information is as follows. That is, in the control unit 151, coordinates ((, 〇, 〇) to (Lx, L, 'L:) are sequentially substituted in the coordinates 値 (X, y, ζ) of the above formula (1 2 ). The calculation result (η ) is obtained separately. Here, the z coordinate (Lz) in the coordinate 値 (匕, Ly ′ L:) is predetermined as the maximum coordinate position of the detection range in the z-axis indicating the position. In other words, the control unit 15 is in the coordinate 値(X, y' z) of the equation (1 2 ), and sequentially substitutes the coordinates 各 of each point in the three-dimensional space in a certain range above the display screen 31a. The operation result (η ) is output. In the case of -33-201140394, the control unit 151 obtains the coordinate 値(χ, y, z) when the calculation result (n) is the minimum as the indication position information. However, in the portable information terminal 100, three types of operation modes, such as a soft key mode, a brush mode, and a line drawing mode, are prepared in advance as an operation mode for using the pen input function, and when the pen input function is used, the user can set any desired as needed. Action mode. The soft key mode is an operation mode prepared for inputting characters or symbols, and the brush mode and the line drawing mode are operation modes prepared for inputting a line drawing. then,. In the portable information terminal 100, when the three types of operation modes are set, the control unit 151 also functions as the time difference acquisition unit 15 1 a and the position information acquisition unit 15 1 b of the present invention, and It also functions as the display control unit 151c and the input processing unit 151d. Hereinafter, the operation content of the specific acquisition order of the indicated position information by the control unit 151 when the pen input function is used by the user in the portable information terminal 100 will be described. (Soft Key Mode) First, the operation of the portable information terminal 100 when the user sets the soft key mode will be described. Fig. 14 and Fig. 15 are flowcharts showing the processing contents of the control unit 151, and Fig. 16 shows the operation of the stylus pen 70 in the soft key mode setting, and the touch 潷. An explanatory diagram of an example of a change in display content in the display face 31 a' of the LCM 31 operated by 70. As shown in Fig. 14, the control unit 151 starts the operation while setting the soft key mode, and first starts the detection operation of the -34-201140394 indicating sound by the stylus pen 70, and makes the LCM 31 The display screen 31a displays the first soft key 501 (step SA1). Here, the detection operation of the indicator sound sequentially confirms the movement of the sound pressure level of the output signal in the first to the first of the winds 6A to 6D, and the moving portion 151 is the plural point at the start of the detection operation of the instruction sound. The arrival of the indicator sound in each microphone of the group microphone counts the count of elapsed time used. Further, the soft key 501 is composed of a plurality of operation buttons. Each of the operation keys of the soft key 501 is pre-assigned with a plurality of symbols such as an English period. The initial key 015 displayed in step SA1 is displayed with one of the respective operation letters or symbols for each operation button. That is, as shown in Fig. 16, "Kj, "P", "U", "Z" are displayed. In addition, although the illustration is omitted in Fig. 16, each of the operation buttons 501a constituting the soft key 501 in Fig. 17A indicates the guide characters of the other English numbers assigned to the respective operation buttons 501a ("A". ~E", "Ζ·,", etc.) are displayed in small letters. On the other hand, in the respective operation button pressing directions (the opposite directions of the z-axis direction) constituting the soft keys 501, a plurality of operation positions are imaginarily provided, and the specific English letters of the divided operation buttons 501a are assigned at the operation positions of the respective stages. Or one of the tokens. For example, the button 50 1 a is supposed to have a 5-stage operation position, such as the 4th chip in Figure 16. Before the system, the image of the time difference, or the point or state of the soft button of the English A", "F", the letter shown in the figure is written in letters or in the above English 501a, in the same stage in the same operation 1 7 B-35-201140394 shows that "A" is assigned to the first layer operation position of the operation button 501a to which "A to E" is assigned, and is assigned to each of the operation positions of the second layer to the fifth layer. "B" ~ "E". In other words, the control unit 151 displays the alphabets or symbols assigned to the first layer operation positions of the respective operation buttons 501a by the respective operation buttons 501a of the soft keys 50 1 in the initial state. In the following description, the English letters and symbols assigned to the respective layer positions of the operation buttons 501a are referred to as characters or the like. After the processing of step S A 1 is performed, the control unit 151 confirms whether or not the indication sound of the stylus pen 70 has been detected (step SA2). In other words, the control unit 151 sequentially confirms whether or not the sound pressure level of the output signals of the first to fourth microphones 6A to 6D is peaked with a slight time difference. Next, when the control unit 151 can confirm that the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak time with a slight time difference (step S A2 : YES), it is judged that the indication can be detected at that time point. The sound, by the method described above, obtains the indicated position information indicating the indicated position of the source of the indication sound, that is, the coordinate position (X, y, z) in the orthogonal coordinates shown in FIG. 12A (step SA3) . Fig. 15 is a flow chart showing the order of obtaining the position information in the control unit 151. When the instruction position information is acquired, the control unit 151 sets the time point at which the sound pressure level of the output signals of the first to fourth microphones 6A to 6D is peaked as the point at which the indication sound arrives in each microphone. Next, the control unit 151 subtracts the elapsed time (tA) when the first microphone 6A reaches the finger-36-201140394 when the first microphone 6A reaches the time indicated by the elapsed time (tc) at the time when the third microphone 6C reaches the instruction sound. The arrival time difference Uc of the indication sounds in the first and third microphones 6a and 6C is obtained (step SA1〇1). Further, the control unit 15 1 obtains the second time by subtracting the elapsed time (tB) at the time when the second microphone 6B indicates the arrival of the sound by the elapsed time (tD ) of the time when the fourth microphone 6D indicates the arrival of the sound. And the arrival time difference tBD of the indicator sounds in the fourth microphones 6B and 6D (step SM〇2). In addition, the control unit 15 1 obtains the first time by subtracting the elapsed time (ta ) at the time when the first microphone 6A indicates the arrival of the sound by the elapsed time (tD) of the time when the fourth microphone 6D indicates the arrival of the sound. And the arrival time difference tAD of the indication sound in the fourth microphones 6 A, 6D (step SA103). Next, the control unit 151 sets the coordinate positions of (Lx, Ly, L:) in order to be the coordinate position of any point in the orthogonal coordinates shown in FIG. 12A ( The processing of X, y, z) (step SA104), the equation (1 2 ) of the discriminant described above, substituting the set coordinate position (X, y, z), and in steps SA101 to SA103 The obtained arrival time difference (tAC >tBD>tAD)> of each group of microphones is obtained, and the calculation result (η) is obtained (step SA105), and the obtained calculation result (n) and the set coordinate position (X, y) are obtained. , ζ ) corresponds to the billion in the internal memory (step SA106). Thereafter, the control unit 151 repeats the processing of steps SA104 to SA106 until the coordinate position (X, y, ζ) becomes (L«, L, Lz) (step SA107: NO). Next, the control unit 15 1 stores the calculation result (η) when the coordinate position (X, y, z) is substituted (L, L, Lz) (step SA107: Yes), -37-201140394 The coordinate position (x, y, z) at the time of obtaining the minimum 値 operation result (η) in the total operation result (η) of the memory obtains the confirmed coordinate position (; (, y, z) as a coordinate indicating the indicated position The position, that is, the position information is indicated (step SA108), wherein the specific processing order of the coordinate position (X, y, ζ) obtained by obtaining the operation result (n) of the equation (12) becomes the minimum 为 is arbitrary. The control unit 151 returns to the processing shown in FIG. 14 after acquiring the coordinate position (X, y, ζ) as the pointing position information, and confirms that it corresponds to the acquired coordinate position (X, y, ζ). Whether the pointed position (x, y) in the display screen 3 1 a is within the button area (step SA4). That is, the control unit 151 confirms the position indicated by the obtained coordinate position (X, y, ζ). Whether the coordinate position (X, y) of the XY plane is included in any of the operation keys 5 0 1 a constituting the soft key 501 When the indication position (X, y) in the display screen 31a is not in the button area (step SA4: NO), the control unit 15 1 returns to the processing of step SA2 without doing anything. When the indication position (X, y) in the display screen 3U is within the button area (step SA4: YES), it is also confirmed whether the operation button corresponding to the indication position (X, y) is the operation button that is already selected. (Step SA5) At the beginning of the process, even if the pointed position (X, y) in the display screen 3 1 a is in the button area, the operation button corresponding to the pointed position (X, y) is not the selected operation. The control unit 151 first reversely displays the character or the like (the character-38-201140394 or the symbol of the first layer operation position) in the position corresponding to the pointed position (x, y). The operation button is used as the selected operation button, and the predetermined button identification information indicating the operation button is recorded in the internal memory (step SA6). Further, the control unit 151 is to be in step SA3. Acquired seat The z coordinate of the position (X, y, z) is stored as the reference position in the z-axis direction (height direction) after being stored in the internal memory (step SA7), and immediately returns to the processing of step SA2. Therefore, the user is pressing, for example, a push button switch. When the front end portion of the stylus pen 70 is moved toward the upper side of the "A to E" operation buttons in the state of 7.2, the operation buttons of "A to E" are memorized as the selected operation buttons, and as shown in FIG. In the state I, the character of the "A" of the first layer is displayed in reverse. At the same time, the position of the front end portion of the stylus pen 70 in the vertical direction is recorded. Next, the control unit 151 acquires a new coordinate position (X, y, z) every time the instruction sound is detected (step SA2: YES) (step SA3). Next, when the new coordinate position (X, y, z) is acquired in step SA3, the control unit 151 sets the instruction position (X, y) in the display screen 31a in the button area (step SA4: YES). However, when the operation button corresponding to the indicated position (x, y) is not the selected operation button, that is, when the operation button corresponding to the indicated position (X, y) is changed to another operation button (step SA5: No), The processing of steps SA6 and SA7 is performed again. In other words, the control unit 151 is an operation button or the like that reversely displays the character being displayed on the position corresponding to the new instruction position (X' y), and uses the operation button as the selected operation button to indicate the operation. The key recognition information of the button pre-39-201140394 is memorized in the internal memory (step SA6). Further, the control unit 151 stores the Z coordinate of the newly acquired coordinate position (X, y, z) as the reference position in the Z-axis direction in the internal memory (step SA7). Therefore, when the user presses the push button switch 72, for example, when the front end portion of the stylus pen 70 is moved from the operation button to which "A to E" is assigned to the operation button to which "K to 0" is assigned, " The operation button of K to ◦ is memorized as the operation button being selected, and as shown in the state II of Fig. 16, the character of the "K" of the first layer is reversely displayed. At the same time, the position of the front end portion of the stylus pen 70 in the vertical direction is memorized. Further, when the new coordinate position (X, y, z) is acquired in step SA3, the control unit 151 sets the instruction position (X, y) in the display screen 31a in the button area (step SA4: YES). Further, when the operation button corresponding to the indicated position (X, y) is the selected operation button (step SA5: YES), it is confirmed whether or not there is a change in the z coordinate (step SA8). If there is no change in the z coordinate (step S A8: NO), the control unit 151 immediately returns to the processing of step SA2. Further, when the control unit 151 changes the z coordinate (step SA8: YES), the control unit 151 subtracts the new z coordinate 値 from the z coordinate stored as the reference position, thereby calculating the indicated position (indicative sound). The amount of movement of the reference position stored in step SA7 downward is the amount of movement in the lower position (step SA9). In the process of step SA9, the control unit 151 sets the amount of movement to 〇 when the amount of movement is negative. Then, the control unit 51 confirms whether or not the character or the like in the reverse display is a character or the like of the operation position (layer position) determined in advance by the amount of movement calculated in step SA9 by -40 - 201140394 (step SA10). In addition, the amount of movement and the position of the layer are increased by a certain amount each time the movement amount is increased, and the operation position is increased by one layer. Then, if the character or the like in the reverse display is a character or the like of the layer position corresponding to the calculated movement amount (step SA10: YES), the control unit 151 returns to the processing of step SA2 without doing anything. Conversely, if the display is reversed. When the character is not the character of the operation position corresponding to the calculated movement amount (step SA10: NO), the control unit 151 changes the character or the like in the reverse rotation to the character of the operation position corresponding to the movement amount, etc. (step SA11), temporarily returns to the process of step SA2. Therefore, when the user presses the push button switch 72 to move the front end portion of the stylus pen 70 upward toward the operation button to which "K 0 0" is assigned, the front end portion of the stylus pen 70 is directed toward the display screen 3 1 When the a side (lower side) is moved by a predetermined amount, as shown in the state III of Fig. 16, the character in the reverse rotation is changed from "K" to "N", for example. On the other hand, the control unit 151 does not have an instruction sound during the process of repeating the processing of step SA2 and subsequent steps (step SA2: NO), and the state in which the indication sound cannot be detected continues for a predetermined time or longer, that is, the stylus is continued. When the transmission interval of the indicator sound in 70 is longer than the predetermined time (step SA12: YES), the following processing is performed. First, the control unit 151 checks whether or not the indicated position (X, y) in the previous display screen 3 1 a is within the button area (step SA13). Next, -41 - 201140394 When the previous instruction position (X, y) is in the button area (step SA13: YES), the control unit 151 displays the character or the like in the selected operation button display on the display screen 31a. A predetermined character input area (step SA14). That is, input processing of text information is performed. Therefore, if the user stops the operation of pressing the push button switch 72 to stop the occurrence of the indicator sound in the state shown in the state III of the sixth embodiment, the user displays the screen 31a as shown in the state IV of Fig. 16. Enter the text of "N" in the predetermined text input area. Further, when the control unit 151 is in the processing step SA13, when the previous instruction position (X, y) is not in the button area (step SA13: NO), after the soft key 501 is initialized, the soft key 501 is restored to After the same initial state as that displayed in step SA1 (step SA), the process returns to step SA2. Thereafter, the control unit 151 repeatedly executes the processing in and after step SA2 while the user releases the soft key mode. As described above, when the soft key mode is set in the portable information terminal 100 when the pen input function is used, the user uses the stylus pen 70 to input a desired character or the like. (brush mode) Next, the operation of the portable information terminal 100 when the user sets the brush mode will be described. Fig. 18 is a flowchart showing the processing contents of the control unit 151, and Fig. 19 is a view showing the operation of the stylus pen 70 in the brush mode setting and the display screen 31a of the LCM 31 in response to the operation of the stylus pen 70. An illustration of an example of a change in the display content in 42-201140394. As shown in Fig. 18, the control unit 151 starts to operate at the same time as the setting of the brush mode, and first starts the detection operation of the indication sound emitted by the stylus pen 70, and the thickness (line width) of the line to be drawn is drawn. The predetermined reference thickness is set (step SB 1 ). Further, the detection operation of the indicator sound is the same as in the case of the soft key mode, and the control unit 151 starts counting the arrival of the indicator sound in each microphone of the complex array microphone described above when the detection operation of the instruction sound starts. The elapsed time used in the calculation of the time difference. After the processing of step SB1 is performed, the control unit 151 sequentially confirms whether or not the instruction sound of the touch pen 70 has been detected (step SB2). In other words, the control unit 151 sequentially confirms whether or not the sound pressure level of the output signals of the first to fourth microphones 6A to 6D is peaked with a slight time difference. Next, the control unit 151 can confirm the first to fourth microphones 6A. When the sound pressure level of the output signal of the ~6D is peaked by a slight time difference, it is determined that the indicator sound can be detected at the time point (step SB2: YES), and the indication belonging to the indication is obtained by the processing shown in FIG. The position information indicating the position of the sound generation source, that is, the coordinate position (X, y, z) in the orthogonal coordinates shown in Fig. 12A (step SB3). Next, the control unit 15 1 confirms whether or not the coordinate position (X, y) of the XY plane displayed by the acquired coordinate position (X, y, z) is in the position on the display screen 31a (step SB4). If the pointed position (X, y) is not in the display screen 31a (step SB4: -43 - 201140394 No), the control unit 151 returns to the processing of step SB2 without doing anything. When the instruction position (X, y) is within the display screen 31a (step SB4: YES), the control unit 151 further confirms whether or not the drawing is in progress (step SB5). Further, the confirmation of the step S B 5 is performed by confirming whether or not the internal memory has a drawing flag to be described later. At the beginning of the process start, even if the pointed position (X, y) is within the display screen 31a, it is not in the state of drawing (step SB5: NO). Therefore, the control unit 151 first counts the z coordinate of the coordinate position (X, y, z) acquired in step SB3 as the reference position in the z-axis direction (height direction) in the internal memory (step S B 6 ). Further, the control unit 151 stores the indicated position (X, y) in the display screen 3 1 a as the drawing position in the internal memory, and sets the drawing flag indicating the drawing (step SB7). In addition, the setting of the flag is to depict the processing of the flag in the internal memory. Then, the control unit 151 displays the start point at the instruction position (X, y) in the display screen 31a (step SB8), and temporarily returns to the process of step SB2. That is, when the user presses the push button switch 72 while the front end portion of the stylus pen 70 is positioned above the desired position of the display screen 31a, as shown in the state I of FIG. The starting point S is displayed at the desired position of 3 1 a. At the same time, the indication position (X, y) in the display screen 3 1 a and the position in the upper and lower directions of the front end portion of the stylus pen 70 are memorized. Next, the control unit 151 acquires a new coordinate position (X, y, z) every time the instruction sound is detected (step SB2: YES) (step SB3). Next, -44 - 201140394 When the control unit 15 1 acquires a new coordinate position (χ, y, z) in step SB3, the coordinate position (x'y) of the XY plane is the position in the display screen 3ia (step SB4). : YES) 'When drawing (step SB5: YES), the coordinate position (X, y) of the new XY plane is stored in the internal memory as the current drawing position (step SB9). Then, the control unit 151 performs the following processing. First, the control unit 1 5 checks whether or not the z coordinate is changed (step s B10 ). Then, if the z coordinate is not changed (step SB 1 0: NO), the control unit 151 immediately draws the position (X, y) between the previous drawing position (X, y) and the current drawing position (X, y) in the display screen 31a. The line in which the thickness of the drawing position (X, y) is set to the thickness of the setting is drawn (step SB 1 3 ). On the other hand, the control unit 151 calculates the indication position (instruction sound) by subtracting the new z coordinate from the z coordinate of the z coordinate stored as the reference position when the z coordinate is changed (step SB10: YES). The amount of movement of the reference position of 100 million in the vertical direction in step SB6 (step SB 1 1 ) » that is, the control unit 151 obtains a positive or negative 値 as the amount of movement. Next, the control unit 151 increases or decreases the thickness of the line to be drawn in accordance with the calculated amount of movement (step SB12). In the processing of step SB12, when the calculated movement amount is positive 値 and the indicated position is moved downward from the reference position, the control unit 151 performs a ratio of the line thickness to be drawn to the extent of the movement amount. The reference thickness is also set coarsely. Further, in the processing of step SB12, the control unit 151 performs the line thickness to be drawn in accordance with the amount of movement when the calculated movement amount is negative -45 - 201140394 値 and the indicated position is moved upward from the reference position. The degree is set to be finer than the reference thickness. Then, the control unit 151 draws between the previous drawing position (X, y) and the current drawing position (X, y) in the display screen 31a, and draws the thickness of the current drawing position (X, y) as the setting. Thick lines (step SB13). After that, the control unit 151 temporarily returns to the processing of step SB2, and repeats the processing of steps SB9 to SB13 every time the instruction sound is detected while the indicator sound can be detected. Therefore, as shown in the state I of FIG. 19, After the start point S is displayed on the display screen 31a, for example, when the user presses the push button switch 72 while moving the front end portion of the stylus pen 70 in the obliquely lower right direction, as shown in the state II of Fig. 19, the display is performed. The screen 3 1 a depicts a line K that gradually becomes thicker from the starting point S toward the right. Further, when the user moves the stylus pen 70 in the obliquely upper right direction, as shown in the state III of Fig. 19, the thickness of the line κ in the drawing gradually becomes thinner and extends to the right. That is, the input processing of the line graph information is performed. On the other hand, the control unit 151 does not detect the indication sound during the process of repeating the processing after step SB2 (step SB 2: NO), and the state in which the indication sound cannot be detected continues for a predetermined time or longer, that is, the ratio When the transmission interval of the indication sound in the stylus 7 is longer than the predetermined time (step SB14: YES), the following processing is performed. In other words, the control unit 151 restores the thickness of the line to be drawn to the thickness of the reference -46 to 201140394 (step SB15), and sets the drawing flag to the OFF state (step SB16). The process of setting the flag to the OFF state will depict the process by which the flag is erased by the internal memory. Thereafter, the control unit 151 returns to the process of step SB2, and the process of step S B 2 and subsequent steps is repeatedly executed while the user cancels the brush mode. Therefore, after the user draws the desired line and temporarily stops the operation of pressing the push button switch 72 to stop the occurrence of the instruction sound, the button switch 72 is pressed again, whereby the drawing of the new line can be started. As described above, when the pen input mode is set in the portable information terminal 100 when the pen input function is used, the user can draw a desired line by moving the stylus pen 70 in the vertical and horizontal directions with respect to the display screen 31a. At the same time, the user can move the stylus 70 up and down in the depiction of the line to change the thickness of the line. In other words, the user can draw the line or character of the desired shape on the display screen 3 1 a while adjusting the line thickness freely while using the same feeling as when writing a line or a character with a brush. (Line Graph Mode) Next, the operation of the portable information terminal 100 when the user sets the line graph mode will be described. Fig. 20 is a flowchart showing the processing contents of the control unit 151, and Fig. 2 shows the operation of the stylus pen 70 in the setting of the line graph mode, and the display screen of the LCM 31 in response to the operation of the stylus pen 70. An explanatory diagram of an example of a change in display content in 31a. As shown in Fig. 20, the control unit 151 starts the operation while setting the line graph mode, and first starts the detection of the indication sound by the stylus 70 - 47 - 201140394, and the line to be drawn The thickness is set to a predetermined reference thickness (step SC 1 ). Further, the detection operation of the indicator sound is the same as in the case of the soft key mode and the brush mode, and the control unit 151 starts the instruction sound in each microphone of the complex array microphone described above when the detection operation of the instruction sound starts. The count of elapsed time used in the calculation of the arrival time difference. After the processing of step SC1 is performed, the control unit 151 checks sequentially whether or not the indication sound of the stylus pen 70 can be detected (step SC2). In other words, the control unit 151 sequentially confirms whether or not the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak time with a slight time difference. Next, when the control unit 151 can confirm that the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak time with a slight time difference, it is determined that the indicator sound can be detected at that time point (step SC2: YES). The indicated position information indicating the indicated position belonging to the indication sound transmission position, that is, the coordinate position in the orthogonal coordinates shown in FIG. 12A (X, y, z) is obtained by the processing described in FIG. ) (step SC3). Next, the control unit 151 converts the z coordinate in the obtained coordinate position (x, y, z) into a y coordinate (step SC4), and confirms whether or not the converted coordinate position (x'y) is displayed. The position in the screen 31a (step SC5). If the converted coordinate position (x, y) is not in the display screen 31a (step SC5: NO), the control unit 151 returns to the processing of step SC2 without doing anything. Further, when the coordinate position (X, y) after the conversion is within the display screen 31a (step SC5: YES), the control unit 15 further confirms whether or not it is drawn in the drawing - 48-201140394 (step SC6) » In addition, step SC6 The confirmation is performed by confirming whether or not the internal memory is marked with a flag to be described later. At the beginning of the process start, even if the converted coordinate position (X, y) is within the display screen 31a, it is not in the state of drawing (step SC6: NO). Therefore, the control unit 151 first records the converted coordinate position (X, y) as the drawing position in the internal memory, and additionally sets the drawing flag indicating the drawing (step SC7). In addition, the setting of the depiction flag will depict the processing of the flag in the internal memory. Then, the control unit 151 displays the start point at the drawing position (X, y) in the display screen 31a (step SC8), and temporarily returns to the process of step SC2. In other words, when the user presses the push button switch 72 while the front end portion of the stylus pen 70 is positioned above the desired position of the display screen 31a, as shown in the state I of FIG. 21, on the display screen 31a. The starting point S is displayed. At the same time, the drawing position (X, y) in the display screen 31a is memorized. However, unlike the case of the brush mode described above, since the vertical direction (y-axis direction) of the display screen 31a is the vertical direction (z-axis direction) of the three-dimensional space, for example, the front end portion of the stylus pen 70 abuts When the screen 31a is displayed, the display position of the start point S is a position that is in contact with the lower side of the display screen 31a. Next, the control unit 151 acquires a new coordinate position (X, y, z) every time the instruction sound is detected (step SC2: YES) (step SC3), and obtains the obtained coordinate position (X, y, z). The z coordinate in the middle is converted to the y coordinate (step SC4). Next, if the converted coordinate position (X, y) is the position within the display screen 31a - 49 - 201140394 (step SC5: Yes), and is in the drawing (step SC6: YES), the control unit 151 will new The obtained coordinate position (X, y) after the conversion is stored in the internal memory as the current drawing position (step SC9). Then, the control unit 151 draws a line connecting the previous drawing position (X, y) and the current drawing position (X, y) on the display screen 31a (step SC10). Thereafter, the control unit 151 temporarily returns to the processing of step SC2, and repeats the processing of steps SC4 to SC6, step SC9, and step SC10 every time the instruction sound is detected while the indicator sound is detectable. Therefore, as shown in the state I of Fig. 21, after the display screen 31a displays the start point S, for example, when the user presses the button switch 72 to face the stylus 70 (the front end portion) in a direction away from the display screen 31a When the upper side is moved in a manner of drawing a spiral, the line K can be drawn on the display screen 31a in the order of the state II of the 21st drawing and the state III of the 2nd figure, that is, the input processing of the line drawing information is performed. That is, a line K indicating the trajectory of the front end portion of the stylus pen 70 is drawn on the display screen 31a, and the line K is made to be parallel to the display screen 31a and to the longitudinal direction of the display screen 31a (y-axis direction). In the state in which the observation is performed in unison, that is, in the state of being observed in a specific direction, the control unit 151 is unable to emit an instruction sound during the process of repeating the processing of step SC2 and subsequent steps (step SC2: No), and the state in which the indication sound cannot be detected continues for a predetermined time or longer, that is, when the transmission interval of the indication sound in the stylus pen 70 is continued for a predetermined time or longer (step SC11: YES), the flag will be drawn. Set to the OFF state (step SB16). The process of setting the -50-201140394 flag to the OFF state is a process of erasing the flag from the internal memory. Thereafter, the control unit 151 returns to the processing of step SC2, and repeats the processing of step SC2 and subsequent steps until the user releases the line graph mode. Therefore, after drawing the desired line, the user temporarily stops the operation of pressing the push button switch 72 to stop the transmission of the command sound, and then presses the push button switch 72 again, whereby the drawing of the new line can be started. As described above, when the portable information terminal 100 is set to the cable map mode when the pen input function is used, the user can move the stylus pen 70 on the upper side of the display screen 31a to the front end of the stylus pen 70. The portion corresponds to the movement trajectory of the 3-dimensional space, and a line graph indicating the shape when the movement trajectory is observed from a specific direction can be drawn. In other words, the pointing position detecting device according to the third embodiment includes a display module having a display screen, and a plurality of microphones are disposed apart from each other on an outer peripheral portion of the display screen for detecting a three-dimensional element on the display screen. An indication sound generated by the space; the time difference acquisition unit acquires a time difference of arrival of the instruction sound between the two microphones in combination with the three types of microphones; and the position information acquisition unit is obtained by the time difference acquisition unit For each of the aforementioned arrival time differences, a hyperboloid with the aforementioned microphone corresponding to the arrival time difference is derived as a focal point, and the intersection of the three hyperboloids derived as the position is obtained as the position information for emitting the indication sound. Then, in the portable information terminal 1 including the pointing position detecting device in the third embodiment, when the user inputs the work using the pen-51 - 201140394, the first to fourth microphones are used. 6A to 6D detect the pointing sound emitted by the stylus pen 70, and obtain a coordinate position indicating the position of the front end portion of the stylus pen 70 belonging to the pointing sound transmitting position based on the arrival time difference of the pointing sound between the microphones of the groups. (x, y, z) is used as the indicated position information indicating the pointed position on the display screen 31a. Therefore, as shown in the case where the touch panel of the resistive film type is used to detect the pointed position of the display screen 31a, it is not necessary to cover the display screen 31a with other members. Therefore, the indicated position in the display screen 3 1 a can be detected without degrading the display characteristics of the LCM 1. Further, in the portable information terminal 1A, in order to obtain the position information (X, y, z) of the third dimension as the pointing position information, the soft key 501 displayed on the display screen 31a in the soft key mode described above is available. A plurality of characters and the like are assigned to one of a plurality of operation buttons. In other words, the number of operation buttons displayed on the display screen 31a can be reduced as compared with the case where a normal keyboard is used to input a character or the like by button selection on the screen. Therefore, by making the display surface of the soft key 501 small, the display screen 31a can be effectively used when characters or the like can be input by the pen input function. Further, in the above-described brush mode, as described above, the line thickness in the drawing of the display screen 31a is sequentially changed in response to the up and down movement of the stylus pen 70, thereby allowing the user to write lines or characters with a brush. The same feeling feels free to adjust the line thickness. Further, in the aforementioned line graph mode, as described above, it is possible to correspond to the movement trajectory of the front end portion of the stylus pen 70 in the 3-dimensional space, and it is possible to draw a table-52-201140394 when the movement trajectory is observed from a specific direction. Line drawing of the shape. Further, in the drawing operation of the online image, the user sequentially confirms the line graph (moving trajectory) caused by the viewpoint different from the actual viewpoint, thereby making it easier to display a slightly complicated three-dimensional shape line graph. Depiction. In the implementation of the present invention, the configuration and the like of the portable information terminal 100 described in the present embodiment may be changed as follows. For example, in the first to fourth microphones 6A to 6D, two straight lines LL and MM in which two sets of microphones are orthogonal to each other are disposed, and the two straight lines LL and MM may not exist in the same plane. Different planes parallel to each other. Further, the two straight lines LL, MM may also exist in different planes that are not parallel to each other. Further, as shown in the present embodiment, when the two straight lines LL and MM are orthogonal to each other, it is convenient to calculate the coordinate position (x, y, z) of the arbitrary indication position P on the display screen 31a, but 2 The straight lines LL, MM may also form only intersections in the display screen 31a at least when projected on the display screen 31a. Further, the first to fourth microphones 6A to 6D may be arranged at respective corners of the display screen 31a as shown in FIG. In other words, the first to fourth microphones 6A to 6D may be arranged in pairs on a straight line L1 including a diagonal line of the display screen 31a and a line M1 including another diagonal line. Further, the first to fourth microphones 6A to 6D in the LCM 1 are provided so that the pointing sound emitted from the stylus pen 70 can be detected on the display screen 31a when the user instructs the display screen 31a to an arbitrary position. -53- 201140394 Yes, subject to change. In other words, the first to fourth microphones 6A to 6D can be disposed at any position on the outer peripheral portion of the display screen 31a as long as they are separated from each other. Further, in the present embodiment, the first to fourth microphones 6A to 6D are provided on the outer peripheral portion of the display screen 31a, and one of the three sets of microphones is set to one side of each of the other two sets of microphones. microphone. That is, the first and fourth microphones 6A, 6D are handled as a set of microphones. However, for example, in addition to the first to fourth microphones 6A to 6D, the fifth microphone and the sixth microphone may be separately provided on the outer peripheral portion of the display screen 31a, thereby forming two microphones that do not constitute the microphones of the other groups. A microphone of each of the three sets of microphones. Further, for example, in addition to the first to fourth microphones 6A to 6D, the fifth microphone may be provided on the outer peripheral portion of the display screen 31a, whereby only one of the five microphones may be configured as two sets of microphones different from each other. To handle. Further, only the first to third microphones 6A to 6C may be provided on the outer peripheral portion of the display screen 31a, and each of the three microphones may be configured to form one of the different sets of microphones and the other group. In other words, the first and second microphones 6A and 6B can be regarded as the first group, and the second and third microphones 6B and 6C can be set as the second group, and the third and first microphones can be used. . 6. . C. . 6A is regarded as the third group and is treated separately. Further, as shown in the present embodiment, the case where the four microphones of the first to fourth microphones 6A to 6D are provided on the outer peripheral portion of the display screen 31a is not required to be -54-201140394, even if it is on the outer periphery of the display screen 31a as described above. The case where five microphones or six microphones are provided in the section 'may be used in any combination for each combination of microphones. Further, even when three microphones, five microphones, or six microphones are provided on the outer peripheral portion of the display screen 31a, the specific arrangement of the respective microphones in the outer peripheral portion may be in any arrangement. In addition, the control unit 155 can add the function of the position acquisition control unit and the correction unit of the present invention, and when the instruction sound is detected, the following processing different from the present embodiment can be used to obtain the display of the display pair. The coordinate position (X, y, z) of any position P of the screen 31a is indicated. For example, the control unit 151 performs the coordinate position (X, y, z) of the intersection point P of the three different hyperboloids shown in FIG. 13B in the order described in the embodiment, and obtains the calculation result as the first. Indicates the processing of location information. Next, the control unit 151 changes the third hyperboloids (hyperbolic) 30p and 30q having the first and fourth microphones 6A and 6D as the focus among the three hyperboloids, as shown in FIG. After the third microphones 6B and 6C are used as the hyperboloids 40p and 40q of the focus, the coordinates (X, y, z) ° of the intersection point P of the three different hyperboloids are calculated according to the same principle as the present embodiment. The control unit 151 performs the arrival time difference of the indicator sounds in each of the three sets of microphones formed by the other combination (the second combination) different from the combination (the first combination) in the present embodiment, according to The obtained arrival time difference of each group is calculated, and the coordinate position -55 - 201140394 (x'y, z) of the intersection point P of the three hyperboloids is calculated, and the calculation result is obtained as the processing of the second indication position information. Further, Fig. 23 is the same as Fig. 13B, and the shape or positional relationship is practically different only for the convenience of displaying each hyperbolic surface (hyperbolic). Then, the control unit 151 calculates the X coordinate of the point located between the X coordinate in the first indicated position information and the x coordinate in the second indicated position information as the corrected X coordinate. Similarly, the control unit 151 calculates the y coordinate of the point between the y coordinate in the first indicated position information and the y coordinate in the second indicated position information, and obtains the calculation result as the corrected y coordinate. Further, the control unit 51 calculates the z coordinate of the point located between the Z coordinate in the second indication position information and the Z coordinate in the second indication position information, and obtains the calculation result as the corrected z coordinate. In other words, the control unit 151 corrects the first indication position information by the second indication position information, and obtains the coordinate position (X, y, Z) formed by the coordinates of the corrected X, y, and Z. 3 indicates the location information, and obtains the third indication location information as the final indication location information. As described above, when the combination of the microphones of the three sets of microphones is changed, the first indication position information and the second indication position information are obtained, and the obtained i-th indication position information is corrected by the second indication position information, thereby obtaining Finally, the position information (3rd position information) is indicated, and the display screen 3 1 a. " The detection accuracy of the indicated position. Further, unlike the above example, the combination of all the combined microphones of the three sets of microphones may be changed when the first indication position information and the second indication position information are acquired. Further, in the present embodiment, when the position information of the finger-56-201140394 is obtained by the control unit 151, the coordinate 値(x, y, z) of the equation (12) is sequentially substituted to indicate a certain above the display screen 31a. The coordinate 値 of each point in the three-dimensional space in the range is obtained, and the calculation result (η) is obtained, and the coordinate 値(X, y, ζ) obtained when the calculation result (η) is the smallest is described as the configuration of the position information. However, a specific method can be applied to the specific method of obtaining the position information (X, y, ζ) indicating the position information, that is, the intersection of the three hyperboloids (or the point at which the intersection can be determined). On the other hand, the command sounds detected by the first to fourth microphones 6A to 6D may have characteristics in the frequency band of the audible range, or may have characteristics in the frequency band of the non-audible range. When the indicator sound is made to have a characteristic in the frequency band of the audible range, the user can be provided with a reliable operational feeling in the operation of the stylus pen 70. In addition, when the indicator sound is made to have a characteristic in the frequency band of the non-audible range, the user who is annoyed by the audible indication sound can provide a good operating environment, and the surrounding person can feel that the indication sound is noise. The bad situation disappeared. Further, in the portable information terminal 100, in the detection mode of the indicator sound, the first detection mode in which the indicator sound to be detected has a characteristic in the frequency band of the audible range, and the indication sound to be detected are in the non-detection mode. The frequency band of the audible range has two detection modes, such as the second detection mode of the characteristic, and can also ensure that the user can view it as needed. . The configuration of the detection mode of the indication sound is switched. When the portable information terminal 100 secures the above configuration, the user can selectively use the indicator sound having the characteristic in the frequency band of the audible range and the frequency band emitted in the non-audible range according to the preference or the use environment. -57- 201140394 A characteristic indicator sound is used as a stylus. In the present embodiment, when the soft key mode is set as the operation mode when the pen input function is used, the control unit 151 causes the display screen 31a of the LCM 31 to display the soft key 501 composed of a plurality of operation buttons. . However, in the soft key mode, if a plurality of stages of operation positions are imaginarily provided, the control unit 151 may be configured such that a single operation button is not displayed on the display screen 31a. Further, in the present embodiment, an image in which a plurality of operation buttons are assigned with an English letter or a symbol is displayed as an example of the soft key 501. However, the soft key 501 can also be formed, for example, by dividing the number into a plurality of groups as assigners at the respective operation buttons. Further, the control unit 151 may display other information than the text information on the soft key 501 or the single operation button displayed on the display screen 31a of the LCM 31 as long as the information is allocated in advance in accordance with the operation position of each stage. Further, in the present embodiment, when the line graph mode is set as the operation mode when the pen input function can be used, the control unit 151 sets the line graph displayed on the display screen 31a of the LCM 31 to indicate the line of sight and the display screen. 31a is parallel and is in front of the stylus 70 in a state where it is observed in the longitudinal direction (y-axis direction) of the display screen 31a. The line K of the trajectory. However, in the line graph mode, the control unit 51 may be configured such that the line graph displayed on the display screen 31a of the LCM 31 is, for example, a state in which the movement range of the end portion before the trajectory of the tip end portion of the stylus pen 70 is observed obliquely upward. -58- 201140394 In addition to jfct, the control unit 151 may also make the line graph of the display screen 31a not displayed in the LCM 31 non-single-. In other words, for example, in the display screen 31a of the LCM 31, the line graph in the state of the x-axis force@gastric stomach to the trajectory is displayed at the same time as the trajectory of the front end portion of the stylus pen 70 is observed from the y-axis direction. Three kinds of line graphs, such as a line graph and a line graph in a state in which the trajectory of the tip end portion of the stylus pen 70 is observed in the z-axis direction. In addition, in the present embodiment, the soft key mode and the brush are prepared in advance. The three types of operation modes, such as the mode and the line graph mode, are described as one for the case where the portable information terminal 1 uses the operation mode of the pen input function. However, in the portable information terminal 100, other operation modes may be set in addition to the three types of operation modes. In the other operation mode, for example, the control unit 151 controls the other image or the like different from the soft key 501 displayed on the display screen 31a in response to the instruction position (instruction position information) of the display screen 31a. The mode or the control unit 151 causes an operation mode in which the display unit 31a re-displays any other information (image information or text information) different from the line drawing in response to the instruction position (instruction position information) of the display screen 31a. Further, in the other operation modes described above, the control unit 151 may be controlled to be displayed on the display screen 3 while the position information is continuously acquired at a predetermined time interval in response to the transmission cycle of the instruction sound in the stylus pen 70. The process of displaying an image or the like in the display or displaying the arbitrary information on the display screen 31a may be performed at any time when the position information is instructed. Further, in the present embodiment, the configuration of the position detecting device of the present invention as the -59-201140394 and the configuration of the display device of the present invention are provided, and the stylus 70 can be used for text or line drawing. The portable information terminal 100 of the input pen input function will be described. However, the pointing position detecting device and the display device of the present invention may be incorporated in other devices, and are not limited to the portable information terminal 100. Further, of course, the coordinate position (X, y, z) indicating the position of the indication detected in the present invention, that is, the position of the indication sound in the three-dimensional space is not limited to the LCM3 1 described in the present embodiment. The pointed position of the display screen may be any indicated position on the display screen of another display device such as a CRT other than the LCM1. Other advantages and modifications will be apparent to those skilled in the art, and the scope of the present invention is not limited to the specific details and representative embodiments shown herein. Therefore, various modifications may be made without departing from the spirit and scope of the general inventive concept as defined by the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a view showing the configuration of an instruction position detecting device according to a first embodiment. Fig. 2A is a layout view of each microphone in the first embodiment. Fig. 2B is a layout view of each microphone in the first embodiment. Third. The figure shows the coordinate position map of each microphone in the first embodiment. Fig. 4A is an explanatory view showing a method of acquiring the indicated position in the first embodiment. -60- 201140394 Fig. 4B is an explanatory view showing a method of obtaining the indicated position in the third embodiment. Fig. 5 is a layout view showing another example of arrangement of the microphones in the first embodiment. Fig. 6 is an explanatory view showing another combination of microphones which is one of the calculation targets of the hyperbola. Fig. 7 is a view showing the configuration of the pointing position detecting device of the second embodiment. Fig. 8A is an explanatory view showing an example of a specific structure of a polarizing plate. Fig. 8B is an explanatory view showing an example of a specific structure of a polarizing plate. Fig. 8C is an explanatory view showing an example of a specific structure of a polarizing plate. Fig. 9 is a view showing the configuration of a portable information terminal of the third embodiment. Fig. 10 is a cross-sectional view showing the schematic structure of the display unit in the third embodiment. Fig. 11 is a schematic block diagram showing the electrical configuration of the portable information terminal in the third embodiment. The 1 2 A map shows the position map of any indicated position in the 3 dimensional space. 1 2B,. The figure shows the coordinate position map of the XY coordinate system of each microphone in the third embodiment. Fig. 13A is a view showing a method of obtaining the position information in the third embodiment. -61 - 201140394 Fig. 1 3B shows an explanatory diagram of a method of obtaining the position information in the third embodiment. Fig. 14 is a flow chart showing the processing contents in the soft key mode. Fig. 15 is a flow chart showing the process of instructing the position information acquisition. Fig. 16 is an explanatory diagram illustrating the operation of the portable information terminal in the soft key mode. Fig. 17A is an explanatory diagram showing the details of the soft keys. Fig. 17B is an explanatory diagram showing the details of the soft keys. Fig. 18 is a flow chart showing the processing contents in the brush mode. Fig. 19 is an explanatory diagram showing the operation of the portable information terminal in the brush mode. Figure 20 is a flow chart showing the processing contents in the line graph mode. Fig. 21 is an explanatory diagram showing the operation of the portable information terminal in the line graph mode. Fig. 22 is a view showing the arrangement of another arrangement example of the microphone in the third embodiment. Figure 23 is an explanatory diagram showing other combinations of three sets of microphones. [Main component symbol description]

1 LCM la 顯示畫面 2A、2B、2C、2D 麥克風 3 放大器 4 A/ D轉換器 -62- 201140394 5 位置取得部 5 a 時差取得部 5b 位置資訊取得部 6 A 〜6 D 麥克風 10s、 10t、 20s、 20t 雙曲線 10p、10q、20p、20q、30p、30q 雙曲面(雙曲線) 11' 12 玻 璃 基 板 13 液 晶 14、 15 偏 光 板 14a PVA 薄 膜 14b TAC 薄 膜 14c 相 位 差 板 1 4 e 透 明 接 著劑 16 像 素 電 極 1 7 TFT 18 濾 色 片 19 共 用 電 極 20 框 架 蓋 20a 顯 示 窗 30 觸 控 筆 3 1 LCM 3 1a 顯 示 畫 面 32、 33 玻 璃 基 板 -63- 201140394 34 液晶 35、36 偏光板 37 導光板 38 光反射薄片 39 像素電極 40 TFT 41 濾色片 4 2 共用電極 43 框架蓋 43a 顯示窗 5 1 LCM 52 液晶面板 53 亮度提升薄膜 60 保護蓋 60a 周緣部 70 觸控筆 7 1 本體 72 按鈕開關 100 攜帶式資訊終端 102 本體 103 顯示部 104 電源按鍵 1 0 5 a 〜1 0 5 e 操作鍵 -64- 201140394 151 控制部 151a 時差取得部 151b 位置資訊取得部 151c 顯示控制部 1 5 1 d 0 輸入處理部 152 ROM 153 . 快閃記憶體 154 按鍵輸入部 155 驅動電路 156 訊號處理部 157 放大器 5 01a 操作按鍵 P 指示位置 -65-1 LCM la Display screen 2A, 2B, 2C, 2D Microphone 3 Amplifier 4 A/D converter-62- 201140394 5 Position acquisition unit 5 a Time difference acquisition unit 5b Position information acquisition unit 6 A to 6 D Microphones 10s, 10t, 20s 20t hyperbola 10p, 10q, 20p, 20q, 30p, 30q hyperboloid (hyperbolic) 11' 12 glass substrate 13 liquid crystal 14, 15 polarizing plate 14a PVA film 14b TAC film 14c phase difference plate 1 4 e transparent adhesive 16 Pixel electrode 1 7 TFT 18 color filter 19 common electrode 20 frame cover 20a display window 30 stylus 3 1 LCM 3 1a display screen 32, 33 glass substrate -63- 201140394 34 liquid crystal 35, 36 polarizing plate 37 light guide plate 38 light Reflective sheet 39 pixel electrode 40 TFT 41 color filter 4 2 common electrode 43 frame cover 43a display window 5 1 LCM 52 liquid crystal panel 53 brightness enhancement film 60 protective cover 60a peripheral portion 70 stylus 7 1 body 72 push button switch 100 portable Information terminal 102 body 103 display unit 104 power button 1 0 5 a ~ 1 0 5 e operation button -64- 201140394 151 Control unit 151a Time difference acquisition unit 151b Position information acquisition unit 151c Display control unit 1 5 1 d 0 Input processing unit 152 ROM 153. Flash memory 154 Key input unit 155 Drive circuit 156 Signal processing unit 157 Amplifier 5 01a Operation button P indicates the position -65-

Claims (1)

201140394 七、申請專利範圍: 1. 一種指示位置檢測裝置,其具備: 顯示模組,其具有顯示畫面; 複數個麥克風,其彼此分離配置在前述顯示畫面的外 周部,檢測對前述顯示畫面的接觸音; .時差取得部,其取得前述複數個麥克風之2種組合中 各組合的2個麥克風間之前述接觸音的到達時間差;及 位置資訊取得部,其導出與藉由前述時差取得部取得 的前述到達時間差對應的2個雙曲線,且該各個雙曲線 係在前述複數個麥克風之前述2種組合中各組合的前述2 個麥克風具有焦點的雙曲線,取得該所導出的2個雙曲 線的交點作爲產生前述接觸音的位置資訊。 2. 如申請專利範圍第1項之指示位置檢測裝置,其中前述 時差取得部係取得第1麥克風與第3麥克風之間之前述 接觸音的到達時間差作爲第1到達時間差,並且取得第2 麥克風與第4麥克風之間之前述接觸音的到達時間差作 爲第2到達時間差, 前述位置資訊取得部係根據前述第1到達時間差導出 以前述第1麥克風及前述第3麥克風作爲焦點的第1雙 曲線,並且根據前述第2到達時間差導出以前述第2麥 克風及前述第4麥克風作爲焦點的第2雙曲線,取得前 述第1雙曲線與前述第2雙曲線的交點作爲產生前述接 觸音的位置資訊。 -66 - 201140394 3 ·如申請專利範圍第2項之指示位置檢測裝置,其 顯示畫面係形成爲矩形形狀, 以前述顯示畫面位於前述第1麥克風與前述第 風之間的方式配置前述第1麥克風與前述第3麥] 以前述顯示畫面位於前述第2麥克風與前述第 風之間的方式配置前述第2麥克風與前述第4麥ΐ 4.如申請專利範圍第3項之指示位置檢測裝置,其 第1麥克風、前述第2麥克風、前述第3麥克風 第4麥克風係以與前述顯示畫面之彼此不同的邊 方式配置。 5 ·如申請專利範圍第3項之指示位置檢測裝置,其 第1麥克風、前述第2麥克風、前述第3麥克風 第4麥克風係以與前述顯示畫面之彼此不同的角 的方式配置。 6.如申請專利範圍第1項之指示位置檢測裝置,其 時差取得部係取得第1麥克風與第2麥克風之間 接觸音的到達時間差作爲第1到達時間差,並且 述第1麥克風與第3麥克風之間之前述接觸音的 間差作爲第2到達時間差, 前述位置資訊取得部係..根據前述第1到達時間 以前述第1麥克風及前述第2麥克風作爲焦點的 曲線,並且根據前述第2到達時間差導出以前述 克風及前述第3麥克風作爲焦點的第2雙曲線, 中前述 3麥克 艺風, 4麥克 艺風。 中前述 及前述 對應的 中前述 及前述 落對應 中前述 之前述 取得前 到達時 差導出 第1雙 第1麥 取得前 -67- 201140394 述第1雙曲線與前述第2雙曲線的交點作爲產生前述接 觸音的位置資訊。 7 .—種指示位置檢測裝置,其具備: 顯示模組,其具有顯示畫面; 複數個麥克風,其彼此分離配置在前述顯示畫面的外 周部,檢測從前述顯示畫面上的3次元空間所發出的指 示音; 時差取得部,其取得前述複數個麥克.風之3種組合中 各組合的2個麥克風間之前述指示音的到達時間差;及 位置資訊取得部,其導出與藉由前述時差取得部所取 得的前述到達時間差對應的3個雙曲面,且該各個雙曲 面係在前述複數個麥克風之前述3種組合中各組合的前 述2個麥克風具有焦點的雙曲面,取得該所導出的3個 雙曲線的交點作爲發出前述指示音的位置資訊。 8.如申請專利範圍第7項之指示位置檢測裝置,其中前述 時差取得部係取得第1麥克風與第3麥克風之間之前述 指示音的到達時間差作爲第1到達時間差,取得第2麥 克風與第4麥克風之間之前述指示音的到達時間差作爲 第2到達時間差’且取得前述第1麥克風與前述第4麥 克風之間之目丨』述指不音的到達時間差作爲第3到達時間 差, BU述位置資訊取得部係根據前述第1到達時間差導出 以前述第1麥克風及前述第3麥克風作爲焦點的第丨雙 -68- 201140394 曲面,根據前述第2到達時間差導出以前述第2麥克風 及前述第4麥克風作爲焦點的第2雙曲面,根據前述第3 到達時間差導出以前述第1麥克風及前述第4麥克風作 爲焦點的第3雙曲面,取得前述第1雙曲面與前述第2 雙曲面與前述第3雙曲面的交點作爲發出前述指示音的 位置資訊。 9.如申請專利範圍第8項之指不位置檢測裝置,其中前述 顯示畫面係形成爲矩形形狀, 以前述顯示畫面位於前述第1麥克風與前述第3麥克 風之間的方式配置前述第1麥克風與前述第3麥克風, 以前述顯示畫面位於前述第2麥克風與前述第4麥克 風之間的方式配置前述第2麥克風與前述第4麥克風。 1 〇 ·如申請專利範圔第9項之指示位置檢測裝置,其中前述 第1麥克風、前述第2麥克風、前述第3麥克風及前述 第4麥克風係以與前述顯示畫面之彼此不同的邊對應的 方式配置。 11.如申請專利範圍第9項之指示位置檢測裝置,其中前述 第1麥克風、前述第2麥克風、前述第3麥克風及前述 第4麥克風係以與前述顯示畫面之彼此不同的角落對應 的方式配置。 1 2.—種指示位置檢測方法,其包含: 時差取得步驟,其取得彼此分離配置在前述顯示畫 面的外周部的複數個麥克風之2種麥克風之組合中各組 -69- 201140394 合的2個麥克風間之前述接觸音的到達時間差,俾以檢 測對於顯示模組中之顯示畫面的接觸音;及 位置資訊取得步驟,其導出與在前述時差取得步驟 中所取得的前述到達時間差對應的2個雙曲線,且該各 個雙曲線係在前述複數個麥克風之前述2種組合中各組 合的前述2個麥克風具有焦點的雙曲線,取得該所導出 的2個雙曲線的交點作爲產生前述接觸音的位置資訊。 1 3 .如申請專利範圍第1 2項之指示位置檢測方法,其中前 述時差取得步驟係取得第1麥克風與第3麥克風之間之 前述接觸音的到達時間差作爲第1到達時間差,並且取 得第2麥克風與第4麥克風之間之前述接觸音的到達時 間差作爲第2到達時間差, 目U述位置資訊取得步驟係根據前述第1到達時間差 導出以前述第1麥克風及前述第3麥克風作爲焦點的第 1雙曲線’並且根據前述第2到達時間差導出以前述第 2麥克風及前述第4麥克風作爲焦點的第2雙曲線,取 得前述第1雙曲線與前述第2雙曲線的交點作爲產生前 述接觸音的位置資訊。 1 4 · 一種指示位置檢測方法,其包含: … 時差取得步驟’其取得彼此分離配置在前述顯示畫 面的外周部的4個麥克風之4種麥克風之組合中各組合 的2個麥克風間之則述接觸音的到達時間差,俾以檢測 對於顯示模組中之顯示畫面的接觸音;及 -70- 201140394 位置資訊取得步驟’其導出與在前述時差取得步驟 中所取得的前述到達時間差對應的雙曲線,且該各個雙 曲線係在前述複數個麥克風之前述4種組合中各組合的 前述2個麥克風具有焦點的雙曲線,根據該所導出的雙 曲線取得產生前述接觸音的位置資訊。 15.如申請專利範圍第14項之指示位置檢測方法,其中前 述時差取得步驟係包含: 第1時間差取得步驟,其取得第1麥克風與第3麥 克風之間之前述接觸音的到達時間差作爲第1到達時間 差; 第2時間差取得步驟,其取得第2麥克風與第4麥 克風之間之前述接觸音的到達時間差作爲第2到達時間 差; 第3時間差取得步驟,其取得前述第1麥克風與前 述第4麥克風之間之前述接觸音的到達時間I差作爲第3 到達時間差;及 第4時間差取得步驟,其取得前述第2麥克風與前 述第3麥克風之間之前述接觸音的到達時間差作爲第4 到達時間差。 1 6.如申請專利範圍第1 5項之指示位置檢測方法,其中, 前述位置資訊取得步驟係包含: 第1位置資訊取得步驟,其根據前述第1到達時間 差導出以前述第1麥克風及前述第3麥克風作爲焦點的 -71 - 201140394 第1雙曲線,並且根據前述第2到 第2麥克風及前述第4麥克風作爲 導出前述第1雙曲線與前述第2雙 位置; 第2位置資訊取得步驟,其根 差導出以前述第1麥克風及前述第 第3雙曲線,並且根據前述第4到 第2麥克風及前述第3麥克風作爲 導出前述第3雙曲線與前述第4雙 位置;及 補正步驟,其取得前述第1位 中間位置作爲產生前述接觸音的位 1 7 ·—種指示位置檢測方法,其包含: 時差取得步驟,其取得彼此分 面的外周部的複數個麥克風之3種 合的2個麥克風間之前述指示音的 測從顯示模組中之顯示畫面上的3 .不音;及 位置資訊取得步驟,其導出與 中所取得的前述到達時間差對應的 個雙曲面係在前述複數個麥克風之 合的前述2個麥克風具有焦點的雙 的3個雙曲面的交點作爲發出前述 達時間差導出以前述 焦點的第2雙曲線, 曲線的交點作爲第1 據前述第3到達時間 4麥克風作爲焦點的 達時間差導出以前述 焦點的第4雙曲線, 曲線的交點作爲第2 置與前述第2位置的 置資訊。 離配置在前述顯示畫 麥克風之組合中各組 到達時間差,俾以檢 次元空間所發出的指 在前述時差取得步驟 3個雙曲面,且該各 前述3種組合中各組 曲面,取得該所導出 指示音的位置資訊。 -72- 201140394 18. 如申請專利範圍第17項之指示位置檢測方法,其中前 述時差取得步騾係取得第1麥克風與第3麥克風之間之 前述指示音的到達時間差作爲第丨到達時:= 2麥克風與第4㈣風之間之前述指示音的到達時間差 作爲第2¾達時間差,取得前述第工麥克風與前述第4 麥克風之間之前述指示音的到達時間差作爲第3到達時 間差; BIJ述位置資訊取得步驟係根據前述第1到達時間差 導出以前述第1麥克風及前述第3麥克風作爲焦點的第 1雙曲面,根據前述第2到達時間差導出以前述第2麥 克風及前述第4麥克風作爲焦點的第2雙曲面,根據前 述第3到達時間差導出以前述第丨麥克風及前述第4麥 克風作爲焦點的第3雙曲面,取得前述第1雙曲面與前 述第2雙曲面與前述第3雙曲面的交點作爲發出前述指 示音的位置資訊。. 19. 一種指示位置檢測方法,其包含: 時差取得步驟’其取得彼此分離配置在前述顯示畫 面的外周部的4個麥克風之4種麥克風之組合中各組合 的2個麥克風間之前述指示音的到達時間差,俾以檢測 從顯示模組中之顯示畫面上的3次..元空間所發出的指示 3ίζ: · Ί3, 曰,及 位置資訊取得步驟,其導出與在前述時差取得步驟 中所取得的前述到達時間差對應的雙曲面,且該各個雙 -73- 201140394 曲面係在前述複數個麥克風之前述4種組合中各組合的 前述2個麥克風具有焦點的雙曲面,根據該所導出的雙 曲面取得發出前述指示音的位置資訊。 20. 如申請專利範圍第1 9項之指示位置檢測方法,其中前 述時差取得步驟係包含: 第1時間差取得步驟,取得第1麥克風與第3麥克 風之間之前述指示音的到達時間差作爲第1到達時間 差; 第2時間差取得步驟,取得第2麥克風與第4麥克 風之間之前述指示音的到達時間差作爲第2到達時間 差; 第3時間差取得步驟,取得前述第1麥克風與前述 .第4麥克風之間之前述指示音的到達時間差作爲第3到 達時間差;及 第4時間差取得步驟,取得前述第2麥克風與前述 第3麥克風之間之前述指示音的到達時間差作爲第4到 達時間差。 21. 如申請專利範圍第21項之指示位置檢測方法,其中前 述位置資訊取得步驟係包含: 第1雙曲面導出步驟,根據前述第1到達時間差導 出以前述第1麥克風及前述第3麥克風作爲焦點的第1 雙曲面; 第2雙曲面導出步驟,根據前述第2到達時間差導 -74- 201140394 出以即述第2麥克風及前述第4麥克風作爲焦點的第2 雙曲面; 第3雙曲面導出步驟’根據前述第3到達時間差導 出以即述第1麥克風及前述第4麥克風作爲焦點的第3 雙曲面;. 第4雙曲面導出步驟,根據前述第4到達時間差, 導出以前述第2麥克風及前述第3麥克風作爲焦點的第 4雙曲面; 第1位置資訊取得步驟,導出前述第丨雙曲面與前 述第2雙曲面與前述第3雙曲面的交點作爲第1位置; 第2位置資訊取得步驟,導出前述第1雙曲面與前 述第2雙曲面與前述第4雙曲面的交點作爲第2位置; 及 補正步驟,取得前述第1位置與前述第2位置的中 間位置作爲發出前述指示音的位置資訊。 -75-201140394 VII. Patent application scope: 1. An indication position detecting device, comprising: a display module having a display screen; a plurality of microphones disposed apart from each other at an outer peripheral portion of the display screen to detect contact with the display screen a time difference obtaining unit that obtains an arrival time difference of the contact sound between two microphones of each of the two combinations of the plurality of microphones, and a position information acquisition unit that derives and acquires the time difference obtained by the time difference acquisition unit The two hyperbolic curves corresponding to the arrival time difference, and the respective hyperbola are hyperbola of the focus of the two microphones in each of the foregoing two combinations of the plurality of microphones, and the two hyperbolic curves derived are obtained. The intersection point serves as positional information for generating the aforementioned contact sound. 2. The instruction position detecting device according to the first aspect of the invention, wherein the time difference acquisition unit acquires a difference in arrival time of the contact sound between the first microphone and the third microphone as a first arrival time difference, and acquires the second microphone and The difference in arrival time of the contact sound between the fourth microphones is a second arrival time difference, and the position information acquisition unit derives a first hyperbola having the first microphone and the third microphone as a focus based on the first arrival time difference, and A second hyperbola in which the second microphone and the fourth microphone are the focus is derived from the second arrival time difference, and an intersection of the first hyperbola and the second hyperbola is obtained as position information for generating the contact sound. -66 - 201140394 3 - The indication position detecting device according to the second aspect of the patent application, wherein the display screen is formed in a rectangular shape, and the first microphone is disposed such that the display screen is located between the first microphone and the first wind The second microphone and the fourth microphone are arranged such that the display screen is located between the second microphone and the first wind, and the indication position detecting device of the third aspect of the patent application is provided. The first microphone, the second microphone, and the third microphone and the fourth microphone are arranged side by side different from the display screen. 5. The pointing position detecting device according to claim 3, wherein the first microphone, the second microphone, the third microphone, and the fourth microphone are disposed at different angles from each other on the display screen. 6. The pointing position detecting device according to the first aspect of the invention, wherein the time difference obtaining unit acquires a difference in arrival time of a contact sound between the first microphone and the second microphone as a first time difference of arrival, and the first microphone and the third microphone are described. The difference between the contact sounds is the second arrival time difference, and the position information acquisition unit is based on the first arrival time and the first microphone and the second microphone as the focus, and the second arrival is based on the second arrival time. The time difference is derived from the second hyperbola in which the aforementioned wind and the third microphone are the focal points, and the aforementioned 3 MacArt style, 4 MacArt style. In the above-mentioned and the aforementioned correspondence, the aforementioned pre-acquisition time difference is derived from the first double first wheat acquisition-67-201140394 before the intersection of the first hyperbola and the second hyperbola as the occurrence of the contact The location information of the sound. 7. An indication position detecting device comprising: a display module having a display screen; a plurality of microphones disposed apart from each other on an outer peripheral portion of the display screen, and detecting a three-dimensional space from the display screen a time difference acquisition unit that acquires an arrival time difference of the indicator sound between two microphones of each of the three combinations of the plurality of microphones and the wind; and a position information acquisition unit that derives and obtains the time difference acquisition unit And obtaining the hyperboloids corresponding to the difference in the arrival time difference, and the two hyperbolas each of the three combinations of the plurality of microphones have a hyperboloid of a focus, and the three exported are obtained. The intersection of the hyperbola serves as the positional information for emitting the aforementioned indication sound. 8. The instruction position detecting device according to claim 7, wherein the time difference acquisition unit acquires a difference in arrival time of the instruction sound between the first microphone and the third microphone as a first arrival time difference, and acquires the second microphone and the 4, the arrival time difference of the indication sound between the microphones is the second arrival time difference 'and the target between the first microphone and the fourth microphone is acquired", and the difference in arrival time of the voice is referred to as the third arrival time difference, and the position of the BU is described. The information acquisition unit derives a second --68-201140394 curved surface having the first microphone and the third microphone as a focus based on the first arrival time difference, and derives the second microphone and the fourth microphone based on the second arrival time difference. The second hyperboloid as a focus is obtained by deriving a third hyperboloid having the first microphone and the fourth microphone as a focus based on the third arrival time difference, and acquiring the first hyperboloid, the second hyperboloid, and the third double The intersection of the curved surfaces serves as the positional information for the aforementioned indication sound. 9. The pointing position detecting device according to claim 8, wherein the display screen is formed in a rectangular shape, and the first microphone and the first microphone are disposed such that the display screen is located between the first microphone and the third microphone. In the third microphone, the second microphone and the fourth microphone are disposed such that the display screen is positioned between the second microphone and the fourth microphone. 1. The instruction position detecting device according to claim 9, wherein the first microphone, the second microphone, the third microphone, and the fourth microphone are associated with sides different from each other on the display screen. Mode configuration. 11. The instruction position detecting device according to claim 9, wherein the first microphone, the second microphone, the third microphone, and the fourth microphone are arranged to correspond to different corners of the display screen. . 1 2. An indication position detecting method, comprising: a time difference obtaining step of acquiring two combinations of two types of microphones of a plurality of microphones that are disposed apart from each other on an outer peripheral portion of the display screen - 69- 201140394 a difference in arrival time of the contact sound between the microphones to detect a contact sound with respect to the display screen in the display module; and a position information obtaining step of deriving two of the aforementioned arrival time differences obtained in the time difference obtaining step a hyperbola, wherein each of the two microphones in each of the foregoing two combinations of the plurality of microphones has a hyperbola of focus, and the intersection of the two hyperbola derived is obtained as the contact sound. Location information. The method of detecting an indication position according to claim 12, wherein the time difference acquisition step acquires a difference in arrival time of the contact sound between the first microphone and the third microphone as a first arrival time difference, and obtains a second time difference The difference in arrival time of the contact sound between the microphone and the fourth microphone is the second arrival time difference, and the position information acquisition step is based on the first arrival time difference to derive the first focus of the first microphone and the third microphone. The hyperbola' derives a second hyperbola having the second microphone and the fourth microphone as a focus based on the second arrival time difference, and obtains an intersection of the first hyperbola and the second hyperbola as a position at which the contact sound is generated. News. 1 4 . An indication position detecting method, comprising: a time difference obtaining step of acquiring between two microphones of each of a combination of four types of microphones of four microphones disposed on an outer peripheral portion of the display screen a difference in arrival time of the contact sound to detect a contact sound for the display screen in the display module; and -70-201140394 position information obtaining step 'which derives a hyperbola corresponding to the aforementioned arrival time difference obtained in the aforementioned time difference obtaining step And each of the two hyperbolas in the above four combinations of the plurality of microphones has a hyperbola of a focus, and position information for generating the contact sound is obtained based on the derived hyperbola. 15. The method according to claim 14, wherein the time difference obtaining step includes: a first time difference obtaining step of obtaining a difference in arrival time of the contact sound between the first microphone and the third microphone as the first a second time difference obtaining step of obtaining a difference in arrival time of the contact sound between the second microphone and the fourth microphone as a second arrival time difference, and a third time difference obtaining step of acquiring the first microphone and the fourth microphone The difference in arrival time I between the contact sounds is the third arrival time difference, and the fourth time difference obtaining step is to obtain the difference in arrival time of the contact sound between the second microphone and the third microphone as the fourth arrival time difference. 1. The method according to claim 15, wherein the position information obtaining step includes: a first position information obtaining step of deriving the first microphone and the first according to the first time difference of arrival 3 - the first double curve, and the first to second microphones and the fourth microphone are used as the focus to derive the first hyperbola and the second double position; the second position information acquisition step, Deriving the first microphone and the third hyperbola based on the root difference, and deriving the third hyperbola and the fourth double position based on the fourth to second microphones and the third microphone; and correcting the step The first intermediate position is a bit 17-type indicating position detecting method for generating the contact sound, and includes: a time difference obtaining step of acquiring two microphones of three types of a plurality of microphones on the outer peripheral portion of the face-to-face The above-mentioned instruction sound is measured from the display screen in the display module, and the location information acquisition step is derived and exported. The hyperbola corresponding to the aforementioned arrival time difference is the intersection of the two hyperboloids of the two microphones having the focus of the plurality of microphones, and the second hyperbola of the focus is derived as the aforementioned time difference, and the curve is obtained. The intersection point is derived from the fourth hyperbola of the focus based on the time difference of the microphone as the focus of the third arrival time 4, and the intersection of the curve is used as the information of the second position and the second position. Arranging the time difference of each group in the combination of the display microphones, and obtaining the three hyperboloids in the time difference by the finger emitted by the inspection dimension space, and obtaining the curved surface of each of the three combinations The position information of the indicator sound. The method of detecting an indicated position according to claim 17, wherein the time difference obtaining step obtains a difference in arrival time of the indication sound between the first microphone and the third microphone as the first arrival time: The difference in arrival time of the indication sound between the microphone and the fourth (fourth) wind is the second time difference, and the difference in arrival time of the indication sound between the microphone and the fourth microphone is obtained as the third arrival time difference; BIJ describes the position information. In the acquisition step, the first hyperboloid having the first microphone and the third microphone as a focus is derived based on the first arrival time difference, and the second microphone and the fourth microphone are used as the second focus based on the second arrival time difference. The hyperboloid derives a third hyperboloid having the second microphone and the fourth microphone as a focus based on the third arrival time difference, and obtains an intersection of the first hyperboloid and the second hyperboloid and the third hyperboloid as an emission The position information of the aforementioned indicator sound. 19. An indication position detecting method, comprising: a time difference obtaining step of: obtaining the indication sound between two microphones of each combination of four types of microphones of four microphones disposed apart from each other on an outer peripheral portion of the display screen The arrival time difference, in order to detect the indication from the three-dimensional space on the display screen in the display module. 3ίζ: · Ί3, 曰, and location information acquisition steps, which are derived and in the aforementioned time difference acquisition step Obtaining a hyperboloid corresponding to the foregoing arrival time difference, and the respective two-73-201140394 curved surface is a hyperboloid of the focus of the two microphones in each of the foregoing four combinations of the plurality of microphones, according to the derived double The surface acquires position information that gives the aforementioned indication sound. 20. The method according to claim 19, wherein the time difference obtaining step includes: a first time difference obtaining step of obtaining a difference in arrival time of the indicator sound between the first microphone and the third microphone as the first The second time difference acquisition step acquires the arrival time difference of the instruction sound between the second microphone and the fourth microphone as the second arrival time difference, and the third time difference acquisition step acquires the first microphone and the fourth microphone. The arrival time difference between the instruction sounds is the third arrival time difference; and the fourth time difference acquisition step acquires the arrival time difference of the instruction sound between the second microphone and the third microphone as the fourth arrival time difference. 21. The method according to claim 21, wherein the position information obtaining step includes: a first hyperboloid deriving step of deriving the first microphone and the third microphone as a focus based on the first arrival time difference a first hyperboloid; a second hyperboloid derivation step, according to the second arrival time difference guide -74-201140394, the second hyperboloid with the second microphone and the fourth microphone as the focus; the third hyperboloid exporting step 'Deriving a third hyperboloid with the first microphone and the fourth microphone as a focus based on the third arrival time difference; the fourth hyperboloid deriving step deriving the second microphone and the aforementioned based on the fourth arrival time difference a fourth hyperboloid having a third microphone as a focus; a first position information obtaining step of deriving the intersection of the second hyperboloid and the second hyperboloid and the third hyperboloid as a first position; and a second position information obtaining step Deriving the intersection of the first hyperboloid and the second hyperboloid and the fourth hyperboloid as a second position; and correcting the step Between the first position and the second position as a position indicating the emitted sound location. -75-
TW099135043A 2009-10-16 2010-10-14 Indicated position detecting apparatus and indicated position detecting method TWI448931B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2009238796 2009-10-16
JP2009254511A JP5024355B2 (en) 2009-11-06 2009-11-06 Pointed position detecting device, pointed position detecting method, display device and display control method thereof, portable information terminal, and program
JP2010052456A JP4968353B2 (en) 2009-10-16 2010-03-10 Pointed position detecting device, pointed position detecting method and program

Publications (2)

Publication Number Publication Date
TW201140394A true TW201140394A (en) 2011-11-16
TWI448931B TWI448931B (en) 2014-08-11

Family

ID=46760296

Family Applications (1)

Application Number Title Priority Date Filing Date
TW099135043A TWI448931B (en) 2009-10-16 2010-10-14 Indicated position detecting apparatus and indicated position detecting method

Country Status (1)

Country Link
TW (1) TWI448931B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI796108B (en) * 2022-01-21 2023-03-11 廣達電腦股份有限公司 Method and system for obtaining font trajectory

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3111087B2 (en) * 1990-09-06 2000-11-20 シャープ株式会社 Signal input device
JP2001125736A (en) * 1999-10-29 2001-05-11 Seiko Epson Corp Image display device, presentation system and information storage medium
JP3988476B2 (en) * 2001-03-23 2007-10-10 セイコーエプソン株式会社 Coordinate input device and display device
TWM352729U (en) * 2008-08-13 2009-03-11 Wistek Co Ltd Sonar type touch panel and its system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI796108B (en) * 2022-01-21 2023-03-11 廣達電腦股份有限公司 Method and system for obtaining font trajectory

Also Published As

Publication number Publication date
TWI448931B (en) 2014-08-11

Similar Documents

Publication Publication Date Title
KR101214346B1 (en) Indicated position detecting apparatus and indicated position detecting method
JP4042065B1 (en) Input processing system for information processing device
JP4019114B1 (en) Information output device
JP4135116B2 (en) Remote controller
JP5652711B2 (en) Touch panel device
US9035914B2 (en) Touch system including optical touch panel and touch pen, and method of controlling interference optical signal in touch system
US20120044143A1 (en) Optical imaging secondary input means
JP4544482B1 (en) Information processing system and program thereof
JP3151886U (en) Information processing system
JP5440926B2 (en) Information processing system and program thereof
TW201140394A (en) Indicated position detecting apparatus and indicated position detecting method
JP2014134571A (en) Computer device, reproduction system, and program
JP5024355B2 (en) Pointed position detecting device, pointed position detecting method, display device and display control method thereof, portable information terminal, and program
JP2012108647A (en) Touch panel system
JP5157973B2 (en) Projection input / output system and program thereof
JP5413315B2 (en) Information processing system and display processing program
JP4042066B1 (en) Input processing system for information processing device
KR101153977B1 (en) Input system for a handheld electronic device
JP2012022430A (en) Information processing system and program thereof
JP2016197322A (en) Display system, display method for display system, and program
JP4136584B2 (en) Coordinate input device, coordinate value output method and program
JP4968353B2 (en) Pointed position detecting device, pointed position detecting method and program
JPWO2014156287A1 (en) Touch panel system
JP2010211589A (en) Projection type input/output system and its program
JP2022147297A (en) Display device, method for display, and program

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees