WO2014132389A1 - Touch sensor apparatus, display system, and position coordinate correction method - Google Patents

Touch sensor apparatus, display system, and position coordinate correction method Download PDF

Info

Publication number
WO2014132389A1
WO2014132389A1 PCT/JP2013/055390 JP2013055390W WO2014132389A1 WO 2014132389 A1 WO2014132389 A1 WO 2014132389A1 JP 2013055390 W JP2013055390 W JP 2013055390W WO 2014132389 A1 WO2014132389 A1 WO 2014132389A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
display area
effective area
display
pressed
Prior art date
Application number
PCT/JP2013/055390
Other languages
French (fr)
Japanese (ja)
Inventor
考晃 野田
Original Assignee
Necディスプレイソリューションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Necディスプレイソリューションズ株式会社 filed Critical Necディスプレイソリューションズ株式会社
Priority to PCT/JP2013/055390 priority Critical patent/WO2014132389A1/en
Publication of WO2014132389A1 publication Critical patent/WO2014132389A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • G06F3/04186Touch location disambiguation

Definitions

  • the present invention relates to a touch sensor device, a display system, and a position coordinate correction method.
  • a display device including a touch panel calibration is performed to calibrate the correspondence between coordinates on the touch panel and coordinates on an image displayed on the display device according to a user's manual work (for example, Patent Document 1). reference).
  • Some display devices can display images with various resolutions such as 1024 ⁇ 768, 1280 ⁇ 1024, 1920 ⁇ 1080, and the like.
  • the resolution of the display panel of the display device is 1920 ⁇ 1080
  • a signal having a resolution of 1920 ⁇ 1080 is input
  • an image is displayed over the entire display area of the display panel.
  • a signal with a resolution of 1024 ⁇ 768 is input
  • an image is displayed in the approximate center of the display panel, and margins are generated vertically and horizontally.
  • the resolution and aspect ratio of the display image may differ between the display device and the input signal.
  • the resolution may be different, so the display position and pixel pitch of the displayed image may change.
  • the coordinates of the touch panel are determined by the dot arrangement and physical size on the touch panel.
  • the present invention has been made in consideration of the above circumstances, and eliminates the need for calibration work for calibrating the correspondence between the coordinates on the touch panel and the coordinates on the image displayed on the display device, A display system and a position coordinate correction method are provided.
  • a touch sensor device includes a touch panel that acquires a pressed coordinate value indicating a coordinate of a position pressed in a sense area, and an effective area in the sense area.
  • An effective area information acquisition unit that captures effective area information from an external display device, and the pressed coordinate value acquired by the touch panel based on the effective area information captured by the information acquisition unit, in the effective area
  • a correction processing unit that converts the correction position into a correction coordinate value indicating the pressed position.
  • a display system includes a display unit that receives an input signal from the outside and displays an image based on the input signal, and is stacked on the display unit. Detected by the touch panel for acquiring the pressed coordinate value indicating the coordinates of the position pressed in the sense area, the effective area detecting unit for detecting the effective area information indicating the effective area of the image, and the effective area detecting unit. A correction processing unit that converts the pressed coordinate value acquired by the touch panel into a corrected coordinate value indicating the pressed position in the effective area based on the effective area information.
  • a position coordinate correction method includes a coordinate value acquisition step of acquiring a pressed coordinate value indicating a coordinate of a position pressed in a sense area from a touch panel; An effective area information acquisition step for acquiring effective area information indicating an effective area from an external display device, and the pressing coordinate value acquired by the touch panel based on the effective area information acquired by the effective area information acquisition step, And a correction step of converting into a correction coordinate value indicating the pressed position in the effective area.
  • the calibration work for calibrating the correspondence between the coordinates on the touch panel and the coordinates on the image displayed on the display device can be eliminated.
  • FIG. 1 is a block diagram showing the basic configuration of the first embodiment of the present invention.
  • the touch sensor 501 according to the first embodiment includes a touch panel 511, an information acquisition unit 512, and a correction processing unit 513.
  • the touch panel 511 acquires a pressed coordinate value indicating the coordinates of the position pressed in the sense area.
  • the information acquisition unit 512 takes in effective area information indicating the effective area in the sense area from the external display device 514.
  • the correction processing unit 513 converts the pressed coordinate value acquired by the touch panel 511 into a corrected coordinate value indicating the coordinate in the effective area based on the effective area information acquired by the effective area information acquisition unit 512.
  • FIG. 2 is a block diagram showing a configuration of a display system in which the touch sensor according to the second embodiment of the present invention is used.
  • the display system using the touch sensor according to the second embodiment of the present invention includes a PC (Personal Computer) main body 11, a display device 12, a touch sensor 13, and the like.
  • PC Personal Computer
  • the PC body 11 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, an HDD (Hard Disk Drive) 103, a RAM (Random Access Memory) 104, an image processing unit 105, and a LAN (Local It includes an Area (Network) interface (LAN I / F) 106 and a USB (Universal Serial Bus) interface (USB I / F) 107.
  • CPU Central Processing Unit
  • ROM Read Only Memory
  • HDD Hard Disk Drive
  • RAM Random Access Memory
  • image processing unit 105 includes an Area (Network) interface (LAN I / F) 106 and a USB (Universal Serial Bus) interface (USB I / F) 107.
  • LAN I / F Area (Network) interface
  • USB I / F Universal Serial Bus
  • the CPU 101 executes various processes by executing a program.
  • the ROM 102 is a read-only memory and stores a boot program such as BIOS (Basic Input / Output System).
  • BIOS Basic Input / Output System
  • the HDD 103 stores basic programs such as an OS (Operating System), various application programs, and the like. Note that an SSD (Solid State Disk) may be used instead of the HDD 103.
  • the RAM 104 is a memory used for the main memory (main storage device) of the CPU 101, and is used for a work area of the program.
  • the image processing unit 105 generates various image data to be displayed on the screen.
  • the display device 12 is connected to the image processing unit 105.
  • the image processing unit 105 can set a plurality of display image resolutions. That is, there are various display image resolutions such as 1024 ⁇ 768, 1280 ⁇ 1024, 1920 ⁇ 1080, and the like.
  • the image processing unit 105 can select and output a desired resolution from among these various resolutions by a user selection operation.
  • the LAN interface 106 is an interface for performing data communication with an external device.
  • the USB interface 107 is an interface for connecting various devices.
  • the touch sensor 13 is connected to the USB interface 107.
  • the display device 12 displays the input signal supplied from the image processing unit 105 of the PC main body 11 on the display panel 151.
  • the display device 12 includes a display panel 151, a scaler processing unit 152, a display area detection unit 153, a resolution measurement unit 154, and an information output unit 155.
  • the display panel 151 is realized by an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence), and displays an input signal from the PC main body 11.
  • the resolution of the display panel 151 is, for example, 1920 ⁇ 1080.
  • the scaler processing unit 152 performs scale processing of the input signal to be displayed according to the resolution of the input signal to be displayed.
  • the display area detection unit 153 detects the position of the display area of the image displayed on the display panel 151. Then, the display area detection unit 153 outputs the offset between the image display area and the display area of the display panel 151 as position information of the image display area.
  • the image display area is controlled by the scaler processing unit 152 so as to be positioned at the center of the display area of the display panel 151.
  • the image display area is an area in which the input signal is displayed in a partial area or the entire area of the display area of the display panel according to the resolution and display position according to the type of the input signal.
  • the resolution measuring unit 154 measures the resolution of the input signal displayed on the display panel 151 and outputs resolution information.
  • the resolution information is represented by the number of horizontal pixels and the number of vertical pixels of the image display area.
  • the information output unit 155 sends the position information of the image display area detected by the display area detection unit 153 and the resolution information measured by the resolution measurement unit 154 to the touch sensor 13.
  • the display area detection unit 153, the resolution measurement unit 154, and the information output unit 155 can be realized by an MPU (Micro Processing Unit) for controlling the operation of the display device 12.
  • MPU Micro Processing Unit
  • the touch sensor 13 is disposed, for example, on the display surface of the display device 12 and is used by the user to directly touch the display screen to perform various inputs.
  • the touch sensor 13 includes a touch panel 161, an information acquisition unit 162, a correction processing unit 163, and a coordinate output unit 164.
  • the touch panel 161 acquires pressing coordinates representing a position pressed with a finger by the user within the sense area on the panel.
  • the touch panel 161 has various configurations such as a resistive film method, an infrared ray method, an electromagnetic induction method, and a capacitance method. In this embodiment, any system may be used.
  • the information acquisition unit 162 is connected to the information output unit 155 of the display device 12. Then, the information acquisition unit 162 acquires the position information and resolution information of the image display area sent from the information output unit 155 of the display device 12.
  • the correction processing unit 163 converts the pressing coordinates into correction coordinates using the position information and resolution information of the image display area acquired by the information acquisition unit 162, and the correction coordinates. Is output to the USB interface 107 of the PC main body 11. The conversion of the correction coordinates will be described later.
  • the coordinate output unit 164 is connected to the USB interface 107 of the PC main body 11.
  • the coordinate output unit 164 transmits the correction coordinates obtained by the correction processing unit 163 to the PC main body 11. That is, the touch sensor 13 operates as an input interface of the PC main body 11, specifically as a pointing device. Note that the sense area of the touch panel 161 coincides with the display area of the display panel 151.
  • the information acquisition unit 162, the correction processing unit 163, and the coordinate output unit 164 can be realized by an MPU for controlling the operation of the touch sensor 13.
  • the display device 12 is provided with the display area detection unit 153 and the resolution measurement unit 154. Then, the information output unit 155 of the display device 12 outputs position information and resolution information of the image display area.
  • the correction processing unit 163 of the touch sensor 13 obtains a correction coordinate value by using the position information and resolution information of the image display area acquired by the information acquisition unit 162 for the press coordinates on the panel acquired from the touch panel 161, The corrected coordinate value is supplied to the PC main body 11. For this reason, even if the resolution of the input signal is changed, calibration for calibrating the correspondence between the coordinates of the touch sensor and the display coordinates becomes unnecessary. This will be described below.
  • the coordinate system of the sense area of the touch panel 161 is physically determined, and generally has a higher resolution than that of the display panel 151.
  • the horizontal resolution of the touch panel 161 is m times the horizontal resolution of the display panel 151 and the vertical resolution of the touch panel 161 is n times the vertical resolution of the display panel 151.
  • m and n are both real numbers of 1 or more. Therefore, by dividing the pressed coordinates detected by the touch panel 161 by m and n, the pressed coordinates can be easily converted to the coordinates of the display panel.
  • the press coordinates acquired by the touch panel 161 are absolute coordinates that are physically determined as described above.
  • the coordinate system of the image display area is a relative coordinate in order to relatively indicate where the point pressed by the user is in the image display area.
  • the resolution and display position of the image display area may vary depending on the type of input signal. Therefore, in the present invention, based on the absolute coordinates indicating the pressing point, the resolution of the display image, and the position information of the image display area, the pressing coordinates indicating the pressing point are converted into relative coordinates in the image display area and output.
  • the image display area displayed on the display panel 151 may change when the input signal changes.
  • the pressing coordinates of the pressing points are set so that the correspondence between the coordinate system of the sense area and the coordinate system indicating the display area of the display panel and the coordinate system indicating the image display area does not change.
  • the positional relationship of the pressing points in the image display area is obtained from the information of the resolution of the image display area and the display position of the image, and converted into correction coordinates corresponding to the positional relationship.
  • FIG. 3 shows the coordinate system of the display area of the display panel 151.
  • the coordinate system of the display area of the display panel 151 is determined by the physical dot arrangement of the display panel 151. If the maximum horizontal coordinate of the display area of the display panel 151 is A and the maximum vertical coordinate is B, the size of the display area of the display panel 151 is (A ⁇ B) as shown in FIG. Become. When the coordinates of the upper left corner of the display panel 151 are the origin, the coordinates of the four corners of the display area of the display panel 151 are (0, 0), (A-1, 0), ( 0, B-1) (A-1, B-1).
  • FIG. 4 shows the coordinate system of the image display area displayed on the display panel 151.
  • the image display area displayed on the display panel 151 differs depending on the resolution and aspect ratio of the input signal.
  • the size of the image display area is (C ⁇ D) as shown in FIG. .
  • the size of the image display area varies depending on the resolution. For example, when the resolution is 1024 ⁇ 768, the size of the image display area indicated by the same coordinate system as the sense area is (1024 ⁇ 768). When the resolution is 1280 ⁇ 1024, the size of the image display area indicated by the same coordinate system as the sense area is (1280 ⁇ 1024).
  • the resolution is 1920 ⁇ 1080
  • the size of the image display area shown in the same coordinate system as the sense area is (1920 ⁇ 1080).
  • the image display area is the entire displayable area of the display panel 151 (display area of the display panel). If the coordinates of the upper left corner of the screen are the origin, the coordinates of the four corners of the image display area are (0, 0), (C-1, 0), (0, D-1) as shown in FIG. ) (C-1, D-1).
  • the coordinates on the display area of the display panel 151 can be expressed as follows.
  • A Maximum horizontal coordinate of the display area of the display panel (horizontal resolution)
  • B Maximum vertical coordinate of the display area of the display panel (vertical resolution)
  • C Resolution in the horizontal direction of the image display area (number of pixels)
  • D Resolution in the vertical direction of the image display area (number of pixels)
  • the pressing coordinates of the pressing points required by the PC main body 11 coincide with the resolution of the input signal, not the coordinates based on the resolution of the touch panel 161.
  • the purpose of using the touch panel 161 by the user is to inform the PC main body 11 where the user's pressing point is located in the display image. That is, the touch panel 161 functions as a pointing device for the PC main body 11.
  • the input signal is changed to a signal having a resolution of 1024 ⁇ 768 and an aspect ratio of 4: 3.
  • FIG. 5 it is assumed that the image display area and the display area of the display panel 151 are displayed so as to overlap each other on the coordinate system of the display area of the display panel.
  • the horizontal offset between the coordinates of the sense area and the coordinates of the image display area is SH
  • the vertical offset is SV.
  • the offset value output by the display area detection unit 153 of the display device 12 is a numerical value in the coordinate system of the display area of the display panel.
  • the physical pressing coordinates of the point pressed by the user are (P10, Q10).
  • the pressed coordinates are converted into coordinates (P10 / m, Q10 / n) of the display area of the display panel 151.
  • the horizontal and vertical offsets are subtracted to obtain P12 and Q12.
  • the relative coordinates (P11, Q11) that maintain the positional relationship between the pressed point and the image display area are obtained and output.
  • the relative coordinates (P11, Q11) are obtained as follows.
  • Q11 (B / D) ⁇
  • Q12 (B / D) ⁇ ((Q10 / n) ⁇ SV)
  • SH Horizontal offset of the image display area in the display area coordinate system of the display panel
  • SV Vertical offset of the image display area in the display area coordinate system of the display panel
  • the PC main body 11 uses the converted coordinate values (P11 , Q11) from the coordinate output unit 164, the point pressed by the user can be accurately recognized.
  • the formula is as follows.
  • the correction processing unit 163 converts the press coordinates (x, y) detected by the touch panel 161 based on the expressions (1) and (2) according to the positional relationship between the image display area and the press points. It is converted into correction coordinates (X, Y) of the display area of the display panel.
  • the horizontal resolution C of the image display area and the vertical resolution D of the image display area are measured by the resolution measuring unit 154 of the display device 12.
  • the horizontal offset SH of the image display area and the vertical offset SV of the image display area are detected by the display area detector 153 of the display device 12.
  • the resolutions C and D of the image display area and the offsets SH and SV of the image display area are output from the information output unit 155 of the display device 12 and input from the information acquisition unit 162 of the touch sensor 13.
  • the coordinate value of the touched position is corrected so as to cancel out the shift amount between the sense region and the image display region based on the offset information.
  • FIG. 6 is a flowchart showing processing of the touch sensor 13 according to the first embodiment of the present invention.
  • the information acquisition unit 162 of the touch sensor 13 acquires resolution information from the information output unit 155 of the display device 12 (step S1). Further, the information acquisition unit 162 acquires the position information of the image display area from the information output unit 155 of the display device 12 (step S2).
  • the correction processing unit 163 acquires the press coordinates (x, y) on the touch panel (step S4). Then, the correction processing unit 163 calculates the touch coordinates (x, y) of the touch panel based on the resolution information acquired from the display device 12 and the position information of the image display area, using the expressions (1) and (2). Conversion is made to correction coordinates (X, Y) on the display area of the display panel according to the positional relationship between the display area and the pressed point (step S5). Then, the coordinate output unit 164 outputs the corrected coordinates (X, Y) thus obtained to the PC main body 11 (step S6).
  • the position information of the image display area is acquired from the display device 12, and the position of the pressing point in the image display area is corrected. Therefore, even when the resolution is changed and the position of the image display area is changed, the position of the pressing point of the user can be corrected.
  • the touch sensor 13 acquires the resolution information and the position information of the image display area from the display device 12, and sets the press coordinates (x, y) according to the positional relationship between the image display area and the press point. It is converted into correction coordinates (X, Y) on the display area of the display panel. This eliminates the need for calibration for calibrating the correspondence between the coordinate system indicating the sense area and the coordinate system indicating the image display area when the resolution is changed.
  • calibration of the correspondence between the coordinate system indicating the sense area and the coordinate system indicating the image display area is not necessary, and therefore, by operating the touch panel without depending on the PC environment such as the type of application.
  • Various input operations can be performed.
  • a position coordinate correction program for realizing the control function is recorded on a computer-readable recording medium
  • the position coordinate correction program recorded on the recording medium is read into the computer system
  • the computer system executes the program. It may be realized by doing.
  • This computer system includes an operating system (OS) and hardware of peripheral devices.
  • the computer-readable recording medium is a portable recording medium such as a flexible disk, a magneto-optical disk, an optical disk, or a memory card, and a storage device such as a magnetic hard disk or a solid state drive provided in the computer system.
  • a computer-readable recording medium holds a program dynamically for a short time, such as a computer network such as the Internet, and a communication line when transmitting a program via a telephone line or a cellular phone network.
  • a server that holds a program for a certain period of time, such as a volatile memory inside a computer system serving as a server device or a client in that case, may be included.
  • the position coordinate correction program may be for realizing a part of the above-described functions, and further for realizing the above-described functions by a combination with a program already recorded in the computer system. There may be.

Abstract

A touch sensor (501) is provided with a touch panel (511), an information acquiring unit (512), and a correcting unit (513). The touch panel (511) acquires pressed coordinate values that indicate the coordinates of a position pressed in a sense region. The information acquiring unit (512) fetches effective region information from an external display apparatus, said effective region information indicating an effective region in a display region of the display apparatus. On the basis of the effective region information fetched by means of the effective region information acquiring unit (512), the correction unit (513) converts the pressed coordinate values acquired by means of the touch panel (511) into corrected coordinate values that indicate a pressed point position in the effective region.

Description

タッチセンサ装置、表示システム、および位置座標補正方法Touch sensor device, display system, and position coordinate correction method
 本発明は、タッチセンサ装置、表示システム、および位置座標補正方法に関する。 The present invention relates to a touch sensor device, a display system, and a position coordinate correction method.
 タッチパネルを備えた表示装置では、ユーザの手作業にしたがって、タッチパネル上の座標と表示装置に表示される画像上の座標との対応関係を校正するキャリブレーションが行われている(例えば、特許文献1参照)。 In a display device including a touch panel, calibration is performed to calibrate the correspondence between coordinates on the touch panel and coordinates on an image displayed on the display device according to a user's manual work (for example, Patent Document 1). reference).
特開2011-197860号公報JP2011-197860A
 表示装置には、1024×768、1280×1024、1920×1080等、様々な解像度の画像を表示することができるものがある。表示装置の表示パネルの解像度が1920×1080の場合、解像度が1920×1080の信号を入力すると、表示パネルの表示領域全域に画像が表示される。一方、解像度が1024×768の信号を入力すると、表示パネルの略中央に画像が表示され、上下および左右に余白が生じる。このように入力信号によっては、表示画像の解像度や縦横のアスペクト比が、表示装置と入力信号との間で異なることがある。入力信号が変更されると、解像度が異なることがあるため、表示される画像の表示位置や画素ピッチが変わってくる場合がある。これに対して、タッチパネルの座標は、タッチパネル上のドット配列や物理的な大きさにより決まっている。 Some display devices can display images with various resolutions such as 1024 × 768, 1280 × 1024, 1920 × 1080, and the like. When the resolution of the display panel of the display device is 1920 × 1080, when a signal having a resolution of 1920 × 1080 is input, an image is displayed over the entire display area of the display panel. On the other hand, when a signal with a resolution of 1024 × 768 is input, an image is displayed in the approximate center of the display panel, and margins are generated vertically and horizontally. Thus, depending on the input signal, the resolution and aspect ratio of the display image may differ between the display device and the input signal. When the input signal is changed, the resolution may be different, so the display position and pixel pitch of the displayed image may change. On the other hand, the coordinates of the touch panel are determined by the dot arrangement and physical size on the touch panel.
 このため、特許文献1に示されるものでは、解像度の異なる入力信号を表示するたびに、タッチパネル上の座標と表示装置に表示される画像上の座標との対応関係を校正するためのキャリブレーションを行う必要がある。 For this reason, in what is shown in Patent Document 1, every time an input signal with a different resolution is displayed, calibration for calibrating the correspondence between the coordinates on the touch panel and the coordinates on the image displayed on the display device is performed. There is a need to do.
 本発明は、上記事情を考慮してなされたものであり、タッチパネル上の座標と表示装置に表示される画像上の座標との対応関係を校正するキャリブレーション作業を不要とする、タッチセンサ装置、表示システム、および位置座標補正方法を提供する。 The present invention has been made in consideration of the above circumstances, and eliminates the need for calibration work for calibrating the correspondence between the coordinates on the touch panel and the coordinates on the image displayed on the display device, A display system and a position coordinate correction method are provided.
 [1]上記の課題を解決するため、本発明の一態様であるタッチセンサ装置は、センス領域内で押圧された位置の座標を示す押圧座標値を取得するタッチパネルと、前記センス領域における実効領域を示す実効領域情報を外部の表示装置から取り込む実効領域情報取得部と、前記情報取得部が取り込んだ前記実効領域情報に基づいて、前記タッチパネルが取得した前記押圧座標値を、前記実効領域における前記押圧された位置を示す補正座標値に変換する補正処理部と、を備える。 [1] In order to solve the above-described problem, a touch sensor device according to an aspect of the present invention includes a touch panel that acquires a pressed coordinate value indicating a coordinate of a position pressed in a sense area, and an effective area in the sense area. An effective area information acquisition unit that captures effective area information from an external display device, and the pressed coordinate value acquired by the touch panel based on the effective area information captured by the information acquisition unit, in the effective area A correction processing unit that converts the correction position into a correction coordinate value indicating the pressed position.
 [2]上記の課題を解決するため、本発明の一態様である表示システムは、外部から入力信号を取り込み、前記入力信号による画像を表示する表示部と、前記表示部に積層して配設され、センス領域内で押圧された位置の座標を示す押圧座標値を取得するタッチパネルと、前記画像の実効領域を示す実効領域情報を検出する実効領域検出部と、前記実効領域検出部により検出された前記実効領域情報に基づいて、前記タッチパネルが取得した前記押圧座標値を、前記実効領域における前記押圧された位置を示す補正座標値に変換する補正処理部と、を備える。 [2] In order to solve the above-described problems, a display system according to one embodiment of the present invention includes a display unit that receives an input signal from the outside and displays an image based on the input signal, and is stacked on the display unit. Detected by the touch panel for acquiring the pressed coordinate value indicating the coordinates of the position pressed in the sense area, the effective area detecting unit for detecting the effective area information indicating the effective area of the image, and the effective area detecting unit. A correction processing unit that converts the pressed coordinate value acquired by the touch panel into a corrected coordinate value indicating the pressed position in the effective area based on the effective area information.
 [3]上記の課題を解決するため、本発明の一態様である位置座標補正方法は、センス領域内で押圧された位置の座標を示す押圧座標値をタッチパネルから取得する座標値取得ステップと、実効領域を示す実効領域情報を外部の表示装置から取り込む実効領域情報取得ステップと、前記実効領域情報取得ステップによって取り込んだ前記実効領域情報に基づいて、前記タッチパネルが取得した前記押圧座標値を、前記実効領域における前記押圧された位置を示す補正座標値に変換する補正ステップと、を有する。 [3] In order to solve the above-described problem, a position coordinate correction method according to an aspect of the present invention includes a coordinate value acquisition step of acquiring a pressed coordinate value indicating a coordinate of a position pressed in a sense area from a touch panel; An effective area information acquisition step for acquiring effective area information indicating an effective area from an external display device, and the pressing coordinate value acquired by the touch panel based on the effective area information acquired by the effective area information acquisition step, And a correction step of converting into a correction coordinate value indicating the pressed position in the effective area.
 本発明によれば、入力信号の解像度を変更しても、タッチパネル上の座標と表示装置に表示される画像上の座標との対応関係を校正するキャリブレーション作業を不要とすることができる。 According to the present invention, even if the resolution of the input signal is changed, the calibration work for calibrating the correspondence between the coordinates on the touch panel and the coordinates on the image displayed on the display device can be eliminated.
本発明の第1実施形態の基本構成を示すブロック図である。It is a block diagram which shows the basic composition of 1st Embodiment of this invention. 本発明の第2実施形態に係るタッチセンサが用いられる表示システムの構成を示すブロック図である。It is a block diagram which shows the structure of the display system with which the touch sensor which concerns on 2nd Embodiment of this invention is used. タッチパネルのセンス領域の説明図である。It is explanatory drawing of the sense area | region of a touchscreen. 画像表示領域の説明図である。It is explanatory drawing of an image display area. 画像表示領域とセンス領域とを重ねて表示したときの説明図である。It is explanatory drawing when an image display area and a sense area are displayed in an overlapping manner. 本発明の第1の実施形態に係るタッチセンサの処理を示すフローチャートである。It is a flowchart which shows the process of the touch sensor which concerns on the 1st Embodiment of this invention.
 以下、本発明の実施の形態について図面を参照しながら説明する。図1は、本発明の第1実施形態の基本構成を示すブロック図である。図1に示すように、第1実施形態に係るタッチセンサ501は、タッチパネル511と、情報取得部512と、補正処理部513とを備える。 Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the basic configuration of the first embodiment of the present invention. As illustrated in FIG. 1, the touch sensor 501 according to the first embodiment includes a touch panel 511, an information acquisition unit 512, and a correction processing unit 513.
 タッチパネル511は、センス領域内で押圧された位置の座標を示す押圧座標値を取得する。情報取得部512は、センス領域における実効領域を示す実効領域情報を外部の表示装置514から取り込む。補正処理部513は、実効領域情報取得部512が取り込んだ実効領域情報に基づいて、タッチパネル511が取得した押圧座標値を実効領域における座標を示す補正座標値に変換する。 The touch panel 511 acquires a pressed coordinate value indicating the coordinates of the position pressed in the sense area. The information acquisition unit 512 takes in effective area information indicating the effective area in the sense area from the external display device 514. The correction processing unit 513 converts the pressed coordinate value acquired by the touch panel 511 into a corrected coordinate value indicating the coordinate in the effective area based on the effective area information acquired by the effective area information acquisition unit 512.
 次に、本発明の実施形態について詳細に説明する。図2は、本発明の第2実施形態に係るタッチセンサが用いられる表示システムの構成を示すブロック図である。 Next, an embodiment of the present invention will be described in detail. FIG. 2 is a block diagram showing a configuration of a display system in which the touch sensor according to the second embodiment of the present invention is used.
 図2に示すように、本発明の第2実施形態に係るタッチセンサが用いられる表示システムは、PC(Personal Computer)本体11と、表示装置12と、タッチセンサ13と等から構成される。 As shown in FIG. 2, the display system using the touch sensor according to the second embodiment of the present invention includes a PC (Personal Computer) main body 11, a display device 12, a touch sensor 13, and the like.
 PC本体11は、CPU(Central Processing Unit)101と、ROM(Read Only Memory)102と、HDD(Hard Disk Drive)103と、RAM(Random Access Memory)104と、画像処理部105と、LAN(Local Area Network)インターフェース(LAN I/F)106と、USB(Universal Serial Bus)インターフェース(USB I/F)107を備える。 The PC body 11 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, an HDD (Hard Disk Drive) 103, a RAM (Random Access Memory) 104, an image processing unit 105, and a LAN (Local It includes an Area (Network) interface (LAN I / F) 106 and a USB (Universal Serial Bus) interface (USB I / F) 107.
 CPU101は、プログラムを実行することによって、各種処理を実行する。ROM102は、読み出し専用のメモリであり、BIOS(Basic Input/Output System)等のブートプログラムを記憶する。HDD103は、OS(Operating System)等の基本プログラムや、各種アプリケーションプログラム等を格納する。なお、HDD103の代わりに、SSD(Solid State Disk)を用いてもよい。RAM104は、CPU101のメインメモリ(主記憶装置)に用いられるメモリであり、プログラムの作業領域等に用いられる。 The CPU 101 executes various processes by executing a program. The ROM 102 is a read-only memory and stores a boot program such as BIOS (Basic Input / Output System). The HDD 103 stores basic programs such as an OS (Operating System), various application programs, and the like. Note that an SSD (Solid State Disk) may be used instead of the HDD 103. The RAM 104 is a memory used for the main memory (main storage device) of the CPU 101, and is used for a work area of the program.
 画像処理部105は、画面上に表示する各種の画像データを生成する。画像処理部105には、表示装置12が接続される。画像処理部105は、表示画像の解像度を複数に設定できる。すなわち、表示画像の解像度としては、1024×768、1280×1024、1920×1080等、種々のものがある。画像処理部105は、ユーザの選択操作により、これら各種の解像度の中から、所望の解像度を選択して出力することができる。 The image processing unit 105 generates various image data to be displayed on the screen. The display device 12 is connected to the image processing unit 105. The image processing unit 105 can set a plurality of display image resolutions. That is, there are various display image resolutions such as 1024 × 768, 1280 × 1024, 1920 × 1080, and the like. The image processing unit 105 can select and output a desired resolution from among these various resolutions by a user selection operation.
 LANインターフェース106は、外部の機器とデータ通信を行うためのインターフェースである。USBインターフェース107は、各種の機器を接続するためのインターフェースである。また、USBインターフェース107には、タッチセンサ13が接続される。 The LAN interface 106 is an interface for performing data communication with an external device. The USB interface 107 is an interface for connecting various devices. The touch sensor 13 is connected to the USB interface 107.
 表示装置12は、PC本体11の画像処理部105から供給された入力信号を表示パネル151に表示する。表示装置12は、表示パネル151と、スケーラ処理部152と、表示領域検出部153と、解像度計測部154と、情報出力部155とを備える。 The display device 12 displays the input signal supplied from the image processing unit 105 of the PC main body 11 on the display panel 151. The display device 12 includes a display panel 151, a scaler processing unit 152, a display area detection unit 153, a resolution measurement unit 154, and an information output unit 155.
 表示パネル151は、LCD(Liquid Crystal Display)や有機EL(Electro Luminescence)により実現され、PC本体11からの入力信号を表示する。表示パネル151の解像度は、例えば1920×1080とする。スケーラ処理部152は、表示する入力信号の解像度に応じて、表示する入力信号のスケールの処理を行う。 The display panel 151 is realized by an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence), and displays an input signal from the PC main body 11. The resolution of the display panel 151 is, for example, 1920 × 1080. The scaler processing unit 152 performs scale processing of the input signal to be displayed according to the resolution of the input signal to be displayed.
 表示領域検出部153は、表示パネル151に表示する画像の表示領域の位置を検出する。そして、表示領域検出部153は、画像表示領域と、表示パネル151の表示領域とのオフセットを画像表示領域の位置情報として出力する。通常、画像表示領域は、スケーラ処理部152によって表示パネル151の表示領域の中央に位置するように制御される。画像表示領域は、表示パネルの表示領域内の一部の領域または全域に、入力信号の種類に応じた解像度や表示位置に従って当該入力信号が表示される領域である。 The display area detection unit 153 detects the position of the display area of the image displayed on the display panel 151. Then, the display area detection unit 153 outputs the offset between the image display area and the display area of the display panel 151 as position information of the image display area. Usually, the image display area is controlled by the scaler processing unit 152 so as to be positioned at the center of the display area of the display panel 151. The image display area is an area in which the input signal is displayed in a partial area or the entire area of the display area of the display panel according to the resolution and display position according to the type of the input signal.
 解像度計測部154は、表示パネル151に表示する入力信号の解像度を計測し、解像度情報を出力する。ここで、解像度情報は、画像表示領域の水平方向画素数および垂直方向画素数で表される。 The resolution measuring unit 154 measures the resolution of the input signal displayed on the display panel 151 and outputs resolution information. Here, the resolution information is represented by the number of horizontal pixels and the number of vertical pixels of the image display area.
 情報出力部155は、表示領域検出部153で検出された画像表示領域の位置情報と、解像度計測部154で計測された解像度情報を、タッチセンサ13に送出する。 The information output unit 155 sends the position information of the image display area detected by the display area detection unit 153 and the resolution information measured by the resolution measurement unit 154 to the touch sensor 13.
 なお、表示領域検出部153、解像度計測部154、および情報出力部155は、表示装置12の動作を制御するためのMPU(Micro Processing Unit)により実現することができる。 The display area detection unit 153, the resolution measurement unit 154, and the information output unit 155 can be realized by an MPU (Micro Processing Unit) for controlling the operation of the display device 12.
 タッチセンサ13は、例えば、表示装置12の表示面に積層して配設され、ユーザが表示画面を直接タッチして、各種の入力を行うのに用いられる。タッチセンサ13は、タッチパネル161と、情報取得部162と、補正処理部163と、座標出力部164とを備える。 The touch sensor 13 is disposed, for example, on the display surface of the display device 12 and is used by the user to directly touch the display screen to perform various inputs. The touch sensor 13 includes a touch panel 161, an information acquisition unit 162, a correction processing unit 163, and a coordinate output unit 164.
 タッチパネル161は、パネル上のセンス領域内でユーザにより指で押圧された位置を表す押圧座標を取得する。タッチパネル161としては、抵抗膜方式、赤外線方式 、電磁誘導方式、静電容量方式等、種々の構成のものがある。本実施形態では、どのような方式のものを用いてもよい。 The touch panel 161 acquires pressing coordinates representing a position pressed with a finger by the user within the sense area on the panel. The touch panel 161 has various configurations such as a resistive film method, an infrared ray method, an electromagnetic induction method, and a capacitance method. In this embodiment, any system may be used.
 情報取得部162は、表示装置12の情報出力部155と接続されている。そして、情報取得部162は、表示装置12の情報出力部155から送られてくる画像表示領域の位置情報と解像度情報とを取得する。 The information acquisition unit 162 is connected to the information output unit 155 of the display device 12. Then, the information acquisition unit 162 acquires the position information and resolution information of the image display area sent from the information output unit 155 of the display device 12.
 補正処理部163は、タッチパネル161から押圧座標が取得されると、情報取得部162で取得された画像表示領域の位置情報および解像度情報を用いて、この押圧座標を補正座標に変換し、補正座標をPC本体11のUSBインターフェース107に出力する。補正座標の変換については、後に説明する。 When the pressing coordinates are acquired from the touch panel 161, the correction processing unit 163 converts the pressing coordinates into correction coordinates using the position information and resolution information of the image display area acquired by the information acquisition unit 162, and the correction coordinates. Is output to the USB interface 107 of the PC main body 11. The conversion of the correction coordinates will be described later.
 座標出力部164は、PC本体11のUSBインターフェース107に接続される。座標出力部164は、補正処理部163により求められた補正座標をPC本体11に送信する。すなわち、タッチセンサ13は、PC本体11の入力インターフェース、具体的にはポインティングデバイスとして動作する。なお、タッチパネル161のセンス領域は、表示パネル151の表示領域と一致している。 The coordinate output unit 164 is connected to the USB interface 107 of the PC main body 11. The coordinate output unit 164 transmits the correction coordinates obtained by the correction processing unit 163 to the PC main body 11. That is, the touch sensor 13 operates as an input interface of the PC main body 11, specifically as a pointing device. Note that the sense area of the touch panel 161 coincides with the display area of the display panel 151.
 なお、情報取得部162、補正処理部163、および座標出力部164は、タッチセンサ13の動作を制御するためのMPUにより実現することができる。 The information acquisition unit 162, the correction processing unit 163, and the coordinate output unit 164 can be realized by an MPU for controlling the operation of the touch sensor 13.
 上述のように、本実施形態では、表示装置12に、表示領域検出部153と解像度計測部154とが設けられる。そして、表示装置12の情報出力部155からは、画像表示領域の位置情報と解像度情報とが出力される。タッチセンサ13の補正処理部163は、タッチパネル161から取得されたパネル上の押圧座標を、情報取得部162で取得された画像表示領域の位置情報および解像度情報を用いて、補正座標値を求め、この補正座標値を、PC本体11に供給している。このため、入力信号の解像度を変更しても、タッチセンサの座標と表示座標との対応関係を校正するためのキャリブレーションは不要になる。このことについて、以下に説明する。 As described above, in the present embodiment, the display device 12 is provided with the display area detection unit 153 and the resolution measurement unit 154. Then, the information output unit 155 of the display device 12 outputs position information and resolution information of the image display area. The correction processing unit 163 of the touch sensor 13 obtains a correction coordinate value by using the position information and resolution information of the image display area acquired by the information acquisition unit 162 for the press coordinates on the panel acquired from the touch panel 161, The corrected coordinate value is supplied to the PC main body 11. For this reason, even if the resolution of the input signal is changed, calibration for calibrating the correspondence between the coordinates of the touch sensor and the display coordinates becomes unnecessary. This will be described below.
 まず、タッチパネル161のセンス領域を示す座標系と、表示パネル151の表示領域を示す座標系および画像表示領域を示す座標系とについて説明する。タッチパネル161のセンス領域の座標系は物理的に決まっており、一般に表示パネル151の解像度よりも高解像度である。ここでは、タッチパネル161の水平解像度は、表示パネル151の水平解像度のm倍であり、タッチパネル161の垂直解像度は、表示パネル151の垂直解像度のn倍であるとする。ここで、m、nはともに1以上の実数である。従ってタッチパネル161の検出した押圧座標をm、nで除することによって、容易に押圧座標を表示パネルの座標に変換することができる。 First, a coordinate system indicating the sense area of the touch panel 161, a coordinate system indicating the display area of the display panel 151, and a coordinate system indicating the image display area will be described. The coordinate system of the sense area of the touch panel 161 is physically determined, and generally has a higher resolution than that of the display panel 151. Here, it is assumed that the horizontal resolution of the touch panel 161 is m times the horizontal resolution of the display panel 151 and the vertical resolution of the touch panel 161 is n times the vertical resolution of the display panel 151. Here, m and n are both real numbers of 1 or more. Therefore, by dividing the pressed coordinates detected by the touch panel 161 by m and n, the pressed coordinates can be easily converted to the coordinates of the display panel.
 タッチパネル161が取得する押圧座標は、前述したように物理的に決まっている絶対座標である。一方、画像表示領域の座標系は、ユーザの押圧した点が画像表示領域の中のどの位置にあるかを相対的に示すため、相対座標である。また画像表示領域は、入力信号の種類によって解像度や表示位置が異なることがある。このため本願発明では、押圧点を示す絶対座標および表示画像の解像度や画像表示領域の位置の情報を元に、押圧点を示す押圧座標を画像表示領域における相対座標に変換して出力する。表示パネル151に表示される画像表示領域は、入力信号が変化すると変化することがある。そこで、入力信号が変化しても、センス領域の座標系および表示パネルの表示領域を示す座標系と画像表示領域を示す座標系との対応関係が変化しないように、押圧点の押圧座標を、画像表示領域の解像度と画像の表示位置の情報から画像表示領域における押圧点の位置関係を求めて、当該位置関係に相当する補正座標に変換する。 The press coordinates acquired by the touch panel 161 are absolute coordinates that are physically determined as described above. On the other hand, the coordinate system of the image display area is a relative coordinate in order to relatively indicate where the point pressed by the user is in the image display area. In addition, the resolution and display position of the image display area may vary depending on the type of input signal. Therefore, in the present invention, based on the absolute coordinates indicating the pressing point, the resolution of the display image, and the position information of the image display area, the pressing coordinates indicating the pressing point are converted into relative coordinates in the image display area and output. The image display area displayed on the display panel 151 may change when the input signal changes. Therefore, even if the input signal changes, the pressing coordinates of the pressing points are set so that the correspondence between the coordinate system of the sense area and the coordinate system indicating the display area of the display panel and the coordinate system indicating the image display area does not change. The positional relationship of the pressing points in the image display area is obtained from the information of the resolution of the image display area and the display position of the image, and converted into correction coordinates corresponding to the positional relationship.
 図3は、表示パネル151の表示領域の座標系を示したものである。表示パネル151の表示領域の座標系は、表示パネル151の物理的なドット配列により決まっている。この表示パネル151の表示領域の水平方向の最大座標をA、垂直方向の最大座標をBとすると、図3に示すように、表示パネル151の表示領域の大きさは、(A×B)となる。そして、表示パネル151の左上隅の座標を原点とすると、表示パネル151の表示領域の4隅の座標は、図3に示すように、(0,0)、(A-1,0)、(0,B-1)(A-1,B-1)となる。 FIG. 3 shows the coordinate system of the display area of the display panel 151. The coordinate system of the display area of the display panel 151 is determined by the physical dot arrangement of the display panel 151. If the maximum horizontal coordinate of the display area of the display panel 151 is A and the maximum vertical coordinate is B, the size of the display area of the display panel 151 is (A × B) as shown in FIG. Become. When the coordinates of the upper left corner of the display panel 151 are the origin, the coordinates of the four corners of the display area of the display panel 151 are (0, 0), (A-1, 0), ( 0, B-1) (A-1, B-1).
 図4は、表示パネル151に表示する画像表示領域の座標系を示したものである。表示パネル151に表示する画像表示領域は、前述したように、入力信号の解像度およびアスペクト比により異なる。画像表示領域の水平方向の解像度(画素数)をC、垂直方向の解像度(画素数)をDとすると、図4に示すように、画像表示領域の大きさは、(C×D)となる。この画像表示領域の大きさは、解像度に応じて、異なってくる。例えば、1024×768の解像度のときには、センス領域と同様の座標系で示した画像表示領域の大きさは、(1024×768)となる。1280×1024の解像度のときには、センス領域と同様の座標系で示した画像表示領域の大きさは、(1280×1024)となる。1920×1080の解像度のときには、センス領域と同様の座標系で示した画像表示領域の大きさは、(1920×1080)となる。このとき、表示パネル151の解像度が1920×1080であるため、画像表示領域は、表示パネル151の表示可能な領域(表示パネルの表示領域)の全域となる。
 そして、画面の左上隅の座標を原点とすると、画像表示領域の4隅の座標は、図4に示すように、(0,0)、(C-1,0)、(0,D-1)(C-1,D-1)となる。
FIG. 4 shows the coordinate system of the image display area displayed on the display panel 151. As described above, the image display area displayed on the display panel 151 differs depending on the resolution and aspect ratio of the input signal. When the horizontal resolution (number of pixels) of the image display area is C and the vertical resolution (number of pixels) is D, the size of the image display area is (C × D) as shown in FIG. . The size of the image display area varies depending on the resolution. For example, when the resolution is 1024 × 768, the size of the image display area indicated by the same coordinate system as the sense area is (1024 × 768). When the resolution is 1280 × 1024, the size of the image display area indicated by the same coordinate system as the sense area is (1280 × 1024). When the resolution is 1920 × 1080, the size of the image display area shown in the same coordinate system as the sense area is (1920 × 1080). At this time, since the resolution of the display panel 151 is 1920 × 1080, the image display area is the entire displayable area of the display panel 151 (display area of the display panel).
If the coordinates of the upper left corner of the screen are the origin, the coordinates of the four corners of the image display area are (0, 0), (C-1, 0), (0, D-1) as shown in FIG. ) (C-1, D-1).
 ここで、図4に示した画像表示領域の点(P2,Q2)の座標を表示パネル151の表示領域上における座標(P1,Q1)に変換するとする。画像表示領域の水平解像度はCであり、表示パネル151の水平解像度はAであるので、P2/C=P1/Aが成立する。すなわち、P1およびP2は、それぞれ表示パネル151の水平方向の位置と画像表示領域の水平方向の位置を示しており、それらの比率が同一となるように変換する。従ってP2が求まればP1を得ることができる。同様にQ2/D=Q1/BからQ2が求まればQ1を得ることができる。なお、画像表示領域が表示パネル151の表示領域の全域の場合(A=CかつB=Dのとき)は、タッチパネル161の押圧座標から直接、表示パネル151の表示領域上における座標(P1,Q1)を求めることができる。すなわち、タッチパネル161の押圧座標を(P0,Q0)とすると、表示パネル151の表示領域上における座標を、P1=P0/m、Q1=Q0/nとして求めることができる。 Here, it is assumed that the coordinates of the points (P2, Q2) in the image display area shown in FIG. 4 are converted to the coordinates (P1, Q1) on the display area of the display panel 151. Since the horizontal resolution of the image display area is C and the horizontal resolution of the display panel 151 is A, P2 / C = P1 / A is established. That is, P1 and P2 indicate the horizontal position of the display panel 151 and the horizontal position of the image display area, respectively, and are converted so that their ratios are the same. Therefore, if P2 is obtained, P1 can be obtained. Similarly, if Q2 is obtained from Q2 / D = Q1 / B, Q1 can be obtained. When the image display area is the entire display area of the display panel 151 (when A = C and B = D), the coordinates (P1, Q1) on the display area of the display panel 151 directly from the pressed coordinates of the touch panel 161. ). That is, if the pressed coordinates of the touch panel 161 are (P0, Q0), the coordinates on the display area of the display panel 151 can be obtained as P1 = P0 / m and Q1 = Q0 / n.
 これにより、表示パネル151の表示領域上における座標は、下記のように表すことができる。
P1=(A/C)×P2
Q1=(B/D)×Q2
A:表示パネルの表示領域の水平方向の最大座標(水平解像度)
B:表示パネルの表示領域の垂直方向の最大座標(垂直解像度)
C:画像表示領域の水平方向の解像度(画素数)
D:画像表示領域の垂直方向の解像度(画素数)
Thereby, the coordinates on the display area of the display panel 151 can be expressed as follows.
P1 = (A / C) × P2
Q1 = (B / D) × Q2
A: Maximum horizontal coordinate of the display area of the display panel (horizontal resolution)
B: Maximum vertical coordinate of the display area of the display panel (vertical resolution)
C: Resolution in the horizontal direction of the image display area (number of pixels)
D: Resolution in the vertical direction of the image display area (number of pixels)
 PC本体11が必要とする押圧点の押圧座標は、タッチパネル161の解像度に基づく座標ではなく、入力信号の解像度と一致している方が望ましい。ユーザがタッチパネル161を使用する目的は、ユーザの押圧点が表示画像のどの位置にあるかをPC本体11に知らせることにあるからである。すなわち、タッチパネル161は、PC本体11のポインティングデバイスとして機能する。
 次に、画像表示領域と表示パネル151の表示領域が一致しない場合について説明する。入力信号を解像度が1024×768で、アスペクト比が4:3の信号に変更したとする。そして図5に示すように、画像表示領域と表示パネル151の表示領域とを、表示パネルの表示領域の座標系上に重ねて表示したとする。
It is desirable that the pressing coordinates of the pressing points required by the PC main body 11 coincide with the resolution of the input signal, not the coordinates based on the resolution of the touch panel 161. This is because the purpose of using the touch panel 161 by the user is to inform the PC main body 11 where the user's pressing point is located in the display image. That is, the touch panel 161 functions as a pointing device for the PC main body 11.
Next, a case where the image display area and the display area of the display panel 151 do not match will be described. Assume that the input signal is changed to a signal having a resolution of 1024 × 768 and an aspect ratio of 4: 3. Then, as shown in FIG. 5, it is assumed that the image display area and the display area of the display panel 151 are displayed so as to overlap each other on the coordinate system of the display area of the display panel.
 入力信号の解像度とアスペクト比が変化すると、この入力信号の解像度とアスペクト比の変化に伴い、画像表示領域の解像度および位置が変動する。そこで、センス領域の座標と画像表示領域の座標との水平方向のオフセットをSH、垂直方向のオフセットをSVとする。ここで表示装置12の表示領域検出部153が出力するオフセット値は、表示パネルの表示領域の座標系における数値である。
 ユーザが押圧した点の物理的な押圧座標を(P10,Q10)とする。まず、押圧座標を表示パネル151の表示領域の座標(P10/m、Q10/n)に変換する。次に水平方向、垂直方向のオフセットをそれぞれ減算してP12およびQ12を得る。最後に押圧点と画像表示領域における位置関係を維持した相対座標(P11,Q11)を求めて出力する。
When the resolution and aspect ratio of the input signal change, the resolution and position of the image display area change with the change of the resolution and aspect ratio of the input signal. Therefore, the horizontal offset between the coordinates of the sense area and the coordinates of the image display area is SH, and the vertical offset is SV. Here, the offset value output by the display area detection unit 153 of the display device 12 is a numerical value in the coordinate system of the display area of the display panel.
The physical pressing coordinates of the point pressed by the user are (P10, Q10). First, the pressed coordinates are converted into coordinates (P10 / m, Q10 / n) of the display area of the display panel 151. Next, the horizontal and vertical offsets are subtracted to obtain P12 and Q12. Finally, the relative coordinates (P11, Q11) that maintain the positional relationship between the pressed point and the image display area are obtained and output.
 なお、上記押圧座標を表示パネルの表示領域座標に変換した(P10/m、Q10/n)をそのまま出力すると、PC本体11は、ユーザが押圧した点と異なる点が押圧されたものと誤認識してしまう。
 例えば、図5では、1919×1079(16:9)の解像度である表示パネルの表示領域(符号a)内の略中央に、1024×768(4:3)の解像度である画像の表示領域(符号b)が表示される場合において、押圧点(符号c)の画像表示領域(符号b)における座標(P12,Q12)が(256、192)であるとする。これは画像表示領域(符号b)の左から1/4、上から1/4の点を示す。このときSH=(1920-1024)/2=448であり、SV=(1080-768)/2=156であるため、押圧点の表示パネルの水平方向の座標は、256+448=704であり、垂直方向の座標は、192+156=348となる。すなわち、704/1920>0.25となり、また348/1080>0.25となって画像表示領域(符号b)の左から1/4、上から1/4の点とならない。従ってユーザの希望する押圧点を得ることはできない。図5の例では、ユーザの押圧点よりも右下方向にずれてしまう。
Note that if (P10 / m, Q10 / n), in which the pressed coordinates are converted into the display area coordinates of the display panel, is output as it is, the PC body 11 erroneously recognizes that a point different from the point pressed by the user is pressed. Resulting in.
For example, in FIG. 5, an image display area (1024 × 768 (4: 3) resolution) (approximately 1024 × 768 (4: 3) resolution) is displayed at the approximate center in the display area (reference a) having a resolution of 1919 × 1079 (16: 9). When the symbol b) is displayed, it is assumed that the coordinates (P12, Q12) in the image display area (the symbol b) of the pressing point (the symbol c) are (256, 192). This indicates a point that is 1/4 from the left and 1/4 from the top of the image display area (symbol b). At this time, since SH = (1920-1024) / 2 = 448 and SV = (1080-768) / 2 = 156, the horizontal coordinate of the display panel at the pressing point is 256 + 448 = 704, and the vertical The direction coordinates are 192 + 156 = 348. That is, 704/1920> 0.25, and 348/1080> 0.25, and the image display area (reference numeral b) does not become a point 1/4 from the left and 1/4 from the top. Therefore, the pressing point desired by the user cannot be obtained. In the example of FIG. 5, it will shift | deviate to the lower right direction rather than a user's press point.
 相対座標(P11,Q11)は、以下のようにして求まる。
P11=(A/C)×P12
   =(A/C)×((P10/m)-SH)
Q11=(B/D)×Q12
   =(B/D)×((Q10/n)-SV)
SH:表示パネルの表示領域座標系での画像表示領域の水平方向のオフセット
SV:表示パネルの表示領域座標系での画像表示領域の垂直方向のオフセット
 PC本体11は、変換された座標値(P11,Q11)を座標出力部164から受信すると、ユーザが押圧した点を正確に認識することができる。
The relative coordinates (P11, Q11) are obtained as follows.
P11 = (A / C) × P12
= (A / C) × ((P10 / m) −SH)
Q11 = (B / D) × Q12
= (B / D) × ((Q10 / n) −SV)
SH: Horizontal offset of the image display area in the display area coordinate system of the display panel SV: Vertical offset of the image display area in the display area coordinate system of the display panel The PC main body 11 uses the converted coordinate values (P11 , Q11) from the coordinate output unit 164, the point pressed by the user can be accurately recognized.
 以上の説明より、タッチパネル161で検出された押圧座標(x,y)を、画像表示領域と押圧点との位置関係に応じた表示パネルの表示領域の補正座標(X,Y)に変換する補正式は、以下のようになる。 As described above, the correction for converting the press coordinates (x, y) detected by the touch panel 161 into the correction coordinates (X, Y) of the display area of the display panel according to the positional relationship between the image display area and the press points. The formula is as follows.
X=M×((x/m)-SH)    …(1)
Y=N×((y/n)-SV)    …(2)
M=A/C
N=D/B
M:表示解像度の水平解像度の補正係数
N:表示解像度の垂直解像度の補正係数
X = M × ((x / m) −SH) (1)
Y = N × ((y / n) −SV) (2)
M = A / C
N = D / B
M: Correction coefficient for horizontal resolution of display resolution N: Correction coefficient for vertical resolution of display resolution
 なお、画像表示領域の中心と、表示パネルの表示領域の中心とが一致しているときには、水平方向および垂直方向のオフセットSH、SVは、以下のようになる。 Note that when the center of the image display area coincides with the center of the display area of the display panel, the horizontal and vertical offsets SH and SV are as follows.
SH=(A-C)/2
SV=(B-D)/2
SH = (AC) / 2
SV = (BD) / 2
 図2において、補正処理部163は、式(1)および式(2)に基づいて、タッチパネル161で検出された押圧座標(x,y)を、画像表示領域と押圧点との位置関係に応じた表示パネルの表示領域の補正座標(X,Y)に変換する。 In FIG. 2, the correction processing unit 163 converts the press coordinates (x, y) detected by the touch panel 161 based on the expressions (1) and (2) according to the positional relationship between the image display area and the press points. It is converted into correction coordinates (X, Y) of the display area of the display panel.
 ここで、画像表示領域の水平方向の解像度Cおよび画像表示領域の垂直方向の解像度Dは、表示装置12の解像度計測部154で計測される。画像表示領域の水平方向のオフセットSHおよび画像表示領域の垂直方向のオフセットSVは、表示装置12の表示領域検出部153で検出される。これら画像表示領域の解像度CおよびD、並びに、画像表示領域のオフセットSHおよびSVは、表示装置12の情報出力部155から出力され、タッチセンサ13の情報取得部162から入力される。 Here, the horizontal resolution C of the image display area and the vertical resolution D of the image display area are measured by the resolution measuring unit 154 of the display device 12. The horizontal offset SH of the image display area and the vertical offset SV of the image display area are detected by the display area detector 153 of the display device 12. The resolutions C and D of the image display area and the offsets SH and SV of the image display area are output from the information output unit 155 of the display device 12 and input from the information acquisition unit 162 of the touch sensor 13.
 式(1)および式(2)に示した補正式では、オフセット情報を基に、センス領域と画像表示領域とのずれ量を相殺するよう、タッチされた位置の座標値を補正している。これにより、解像度を変更しても、タッチセンサのセンス領域を示す座標系と、表示領域を示す座標系との対応関係を校正するためのキャリブレーションが不要になる。 In the correction equations shown in Equation (1) and Equation (2), the coordinate value of the touched position is corrected so as to cancel out the shift amount between the sense region and the image display region based on the offset information. Thereby, even if the resolution is changed, calibration for calibrating the correspondence between the coordinate system indicating the sense area of the touch sensor and the coordinate system indicating the display area becomes unnecessary.
 図6は、本発明の第1の実施形態に係るタッチセンサ13の処理を示すフローチャートである。図6において、タッチセンサ13の情報取得部162は、表示装置12の情報出力部155から解像度情報を取得する(ステップS1)。また、情報取得部162は、表示装置12の情報出力部155から、画像表示領域の位置情報を取得する(ステップS2)。 FIG. 6 is a flowchart showing processing of the touch sensor 13 according to the first embodiment of the present invention. 6, the information acquisition unit 162 of the touch sensor 13 acquires resolution information from the information output unit 155 of the display device 12 (step S1). Further, the information acquisition unit 162 acquires the position information of the image display area from the information output unit 155 of the display device 12 (step S2).
 タッチパネル161の押圧が検出されると(ステップS3 Yes)、補正処理部163は、タッチパネル上の押圧座標(x,y)を取得する(ステップS4)。そして、補正処理部163は、表示装置12から取得した解像度情報および画像表示領域の位置情報に基づいて、式(1)および式(2)により、タッチパネルの押圧座標(x,y)を、画像表示領域と押圧点との位置関係に応じた表示パネルの表示領域上の補正座標(X,Y)に変換する(ステップS5)。そして、座標出力部164は、このようにして求めた補正座標(X,Y)を、PC本体11に出力する(ステップS6)。 When pressing of the touch panel 161 is detected (step S3, Yes), the correction processing unit 163 acquires the press coordinates (x, y) on the touch panel (step S4). Then, the correction processing unit 163 calculates the touch coordinates (x, y) of the touch panel based on the resolution information acquired from the display device 12 and the position information of the image display area, using the expressions (1) and (2). Conversion is made to correction coordinates (X, Y) on the display area of the display panel according to the positional relationship between the display area and the pressed point (step S5). Then, the coordinate output unit 164 outputs the corrected coordinates (X, Y) thus obtained to the PC main body 11 (step S6).
 以上説明したように、本実施形態では、表示装置12から画像表示領域の位置情報を取得して、画像表示領域における押圧点の位置を補正している。これにより、解像度を変更して、画像表示領域の位置が変わった場合でも、ユーザの押圧点の位置を補正できる。 As described above, in the present embodiment, the position information of the image display area is acquired from the display device 12, and the position of the pressing point in the image display area is corrected. Thereby, even when the resolution is changed and the position of the image display area is changed, the position of the pressing point of the user can be corrected.
 また、本実施形態では、タッチセンサ13は、表示装置12から解像度情報および画像表示領域の位置情報を取得し、押圧座標(x,y)を、画像表示領域と押圧点との位置関係に応じた表示パネルの表示領域上の補正座標(X,Y)に変換している。これにより、解像度を変更したときに、センス領域を示す座標系と、画像表示領域を示す座標系との対応関係を校正するためのキャリブレーションが不要となる。 In the present embodiment, the touch sensor 13 acquires the resolution information and the position information of the image display area from the display device 12, and sets the press coordinates (x, y) according to the positional relationship between the image display area and the press point. It is converted into correction coordinates (X, Y) on the display area of the display panel. This eliminates the need for calibration for calibrating the correspondence between the coordinate system indicating the sense area and the coordinate system indicating the image display area when the resolution is changed.
 また、本実施形態では、センス領域を示す座標系と、画像表示領域を示す座標系との対応関係の校正が不要となるため、アプリケーションの種類等PC環境に依存せずに、タッチパネルの操作により各種の入力作業を行うことができる。 Further, in this embodiment, calibration of the correspondence between the coordinate system indicating the sense area and the coordinate system indicating the image display area is not necessary, and therefore, by operating the touch panel without depending on the PC environment such as the type of application. Various input operations can be performed.
 なお、上述した実施形態である表示装置の一部、例えば、制御部の機能をコンピュータで実現するようにしてもよい。この場合、その制御機能を実現するための位置座標補正プログラムをコンピュータ読み取り可能な記録媒体に記録し、この記録媒体に記録された位置座標補正プログラムをコンピュータシステムに読み込ませて、このコンピュータシステムが実行することによって実現してもよい。なお、このコンピュータシステムとは、オペレーティング・システム(Operating System;OS)や周辺装置のハードウェアを含むものである。また、コンピュータ読み取り可能な記録媒体とは、フレキシブルディスク、光磁気ディスク、光ディスク、メモリカード等の可搬型記録媒体、コンピュータシステムに備えられる磁気ハードディスクやソリッドステートドライブ等の記憶装置のことをいう。さらに、コンピュータ読み取り可能な記録媒体とは、インターネット等のコンピュータネットワーク、および電話回線や携帯電話網を介してプログラムを送信する場合の通信回線のように、短時間の間、動的にプログラムを保持するもの、さらには、その場合のサーバ装置やクライアントとなるコンピュータシステム内部の揮発性メモリのように、一定時間プログラムを保持するものを含んでもよい。また上記の位置座標補正プログラムは、前述した機能の一部を実現するためのものであってもよく、さらに、前述した機能をコンピュータシステムにすでに記録されているプログラムとの組み合わせにより実現するものであってもよい。 In addition, you may make it implement | achieve a part of display apparatus which is embodiment mentioned above, for example, the function of a control part with a computer. In this case, a position coordinate correction program for realizing the control function is recorded on a computer-readable recording medium, the position coordinate correction program recorded on the recording medium is read into the computer system, and the computer system executes the program. It may be realized by doing. This computer system includes an operating system (OS) and hardware of peripheral devices. The computer-readable recording medium is a portable recording medium such as a flexible disk, a magneto-optical disk, an optical disk, or a memory card, and a storage device such as a magnetic hard disk or a solid state drive provided in the computer system. Furthermore, a computer-readable recording medium holds a program dynamically for a short time, such as a computer network such as the Internet, and a communication line when transmitting a program via a telephone line or a cellular phone network. In addition, a server that holds a program for a certain period of time, such as a volatile memory inside a computer system serving as a server device or a client in that case, may be included. The position coordinate correction program may be for realizing a part of the above-described functions, and further for realizing the above-described functions by a combination with a program already recorded in the computer system. There may be.
 以上、本発明の実施の形態について図面を参照して詳述したが、具体的な構成はその実施形態に限られるものではなく、本発明の要旨を逸脱しない範囲の設計等も含まれる。 The embodiment of the present invention has been described in detail above with reference to the drawings. However, the specific configuration is not limited to the embodiment, and includes design and the like within the scope not departing from the gist of the present invention.
 11 PC本体
 12 表示装置
 13 タッチセンサ
 151 表示パネル
 152 スケーラ処理部
 153 表示領域検出部
 154 解像度計測部
 155 情報出力部
 161 タッチパネル
 162 情報取得部
 163 補正処理部
 164 座標出力部
 511 タッチパネル
 512 実効領域情報取得部
 512 情報取得部
 513 補正処理部
 514 表示装置
DESCRIPTION OF SYMBOLS 11 PC main body 12 Display apparatus 13 Touch sensor 151 Display panel 152 Scaler process part 153 Display area detection part 154 Resolution measurement part 155 Information output part 161 Touch panel 162 Information acquisition part 163 Correction process part 164 Coordinate output part 511 Touch panel 512 Acquisition of effective area information Unit 512 information acquisition unit 513 correction processing unit 514 display device

Claims (6)

  1.  センス領域内で押圧された位置の座標を示す押圧座標値を取得するタッチパネルと、
     前記センス領域における実効領域を示す実効領域情報を外部の表示装置から取り込む実効領域情報取得部と、
     前記情報取得部が取り込んだ前記実効領域情報に基づいて、前記タッチパネルが取得した前記押圧座標値を、前記実効領域における前記押圧された位置を示す補正座標値に変換する補正処理部と、
     を備えるタッチセンサ装置。
    A touch panel that acquires a pressed coordinate value indicating a coordinate of a position pressed in the sense area;
    An effective area information acquisition unit that captures effective area information indicating an effective area in the sense area from an external display device;
    Based on the effective area information captured by the information acquisition unit, a correction processing unit that converts the pressed coordinate value acquired by the touch panel into a corrected coordinate value indicating the pressed position in the effective area;
    A touch sensor device comprising:
  2.  前記実効領域は、前記表示装置が表示する画像表示領域に対応する領域であり、
     前記実効領域情報は、前記表示装置の表示領域に対する前記画像表示領域の位置のオフセットを示す情報であり、
     前記補正処理部は、前記表示装置の表示領域に対する前記画像表示領域の位置のオフセットに基づいて、前記表示装置の表示領域に対する前記画像表示領域の位置を補正する演算処理を行う、
     請求項1記載のタッチセンサ装置。
    The effective area is an area corresponding to an image display area displayed by the display device,
    The effective area information is information indicating an offset of the position of the image display area with respect to the display area of the display device,
    The correction processing unit performs arithmetic processing for correcting the position of the image display area with respect to the display area of the display device based on an offset of the position of the image display area with respect to the display area of the display device.
    The touch sensor device according to claim 1.
  3.  前記実効領域は、前記表示装置が表示する画像表示領域に対応する領域であり、
     前記実効領域情報は、前記画像表示領域の画像の解像度を示す情報であり、
     前記補正処理部は、前記解像度を示す情報に基づいて、前記画像表示領域を示す座標系を、前記表示装置の表示領域の座標系に変換する演算処理を行う、
     請求項1記載のタッチセンサ装置。
    The effective area is an area corresponding to an image display area displayed by the display device,
    The effective area information is information indicating the resolution of the image in the image display area,
    The correction processing unit performs arithmetic processing for converting a coordinate system indicating the image display area into a coordinate system of the display area of the display device based on the information indicating the resolution.
    The touch sensor device according to claim 1.
  4.  前記実効領域は、前記表示装置が表示する画像表示領域に対応する領域であり、
     前記実効領域情報は、前記表示装置の表示領域に対する前記画像表示領域の位置のオフセットを示す情報および前記画像表示領域の画像の解像度を示す情報であり、
     前記補正処理部は、前記表示装置の表示領域に対する前記画像表示領域の位置のオフセットを示す情報および前記解像度を示す情報に基づいて、前記実効領域を示す座標系を、前記表示装置の表示領域の座標系に変換するとともに、前記表示装置の表示領域に対する前記画像表示領域の位置を補正する演算処理を行う、
     請求項1記載のタッチセンサ装置。
    The effective area is an area corresponding to an image display area displayed by the display device,
    The effective area information is information indicating the offset of the position of the image display area with respect to the display area of the display device and information indicating the resolution of the image of the image display area,
    The correction processing unit uses a coordinate system indicating the effective area based on the information indicating the offset of the position of the image display area with respect to the display area of the display device and the information indicating the resolution as a display area of the display device. Converting to a coordinate system and performing a calculation process for correcting the position of the image display area with respect to the display area of the display device,
    The touch sensor device according to claim 1.
  5.  外部から入力信号を取り込み、前記入力信号による画像を表示する表示部と、
     前記表示部に積層して配設され、センス領域内で押圧された位置の座標を示す押圧座標値を取得するタッチパネルと、
     前記画像の実効領域を示す実効領域情報を検出する実効領域検出部と、
     前記実効領域検出部により検出された前記実効領域情報に基づいて、前記タッチパネルが取得した前記押圧座標値を、前記実効領域における前記押圧された位置を示す補正座標値に変換する補正処理部と、
     を備える表示システム。
    A display unit for capturing an input signal from the outside and displaying an image based on the input signal;
    A touch panel that is disposed in a stacked manner on the display unit, and acquires a press coordinate value indicating a coordinate of a position pressed in the sense area;
    An effective area detector that detects effective area information indicating an effective area of the image;
    Based on the effective area information detected by the effective area detection unit, a correction processing unit that converts the pressed coordinate value acquired by the touch panel into a corrected coordinate value indicating the pressed position in the effective area;
    A display system comprising:
  6.  センス領域内で押圧された位置の座標を示す押圧座標値をタッチパネルから取得する座標値取得ステップと、
     実効領域を示す実効領域情報を外部の表示装置から取り込む実効領域情報取得ステップと、
     前記実効領域情報取得ステップによって取り込んだ前記実効領域情報に基づいて、前記タッチパネルが取得した前記押圧座標値を、前記実効領域における前記押圧された位置を示す補正座標値に変換する補正ステップと、
     を有する位置座標補正方法。
    A coordinate value acquisition step of acquiring a pressed coordinate value indicating a coordinate of a position pressed in the sense area from the touch panel;
    An effective area information acquisition step for fetching effective area information indicating the effective area from an external display device;
    Based on the effective area information captured by the effective area information acquisition step, the correction step of converting the pressed coordinate value acquired by the touch panel into a corrected coordinate value indicating the pressed position in the effective area;
    A position coordinate correction method comprising:
PCT/JP2013/055390 2013-02-28 2013-02-28 Touch sensor apparatus, display system, and position coordinate correction method WO2014132389A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2013/055390 WO2014132389A1 (en) 2013-02-28 2013-02-28 Touch sensor apparatus, display system, and position coordinate correction method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2013/055390 WO2014132389A1 (en) 2013-02-28 2013-02-28 Touch sensor apparatus, display system, and position coordinate correction method

Publications (1)

Publication Number Publication Date
WO2014132389A1 true WO2014132389A1 (en) 2014-09-04

Family

ID=51427690

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/055390 WO2014132389A1 (en) 2013-02-28 2013-02-28 Touch sensor apparatus, display system, and position coordinate correction method

Country Status (1)

Country Link
WO (1) WO2014132389A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09330172A (en) * 1996-06-11 1997-12-22 Toyo Commun Equip Co Ltd Input/output device
JP2001142645A (en) * 1999-11-11 2001-05-25 Fujitsu General Ltd Image display device having touch panel
JP2005321972A (en) * 2004-05-07 2005-11-17 Sony Corp Information processor, processing method for information processor, and processing program for information processor

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09330172A (en) * 1996-06-11 1997-12-22 Toyo Commun Equip Co Ltd Input/output device
JP2001142645A (en) * 1999-11-11 2001-05-25 Fujitsu General Ltd Image display device having touch panel
JP2005321972A (en) * 2004-05-07 2005-11-17 Sony Corp Information processor, processing method for information processor, and processing program for information processor

Similar Documents

Publication Publication Date Title
US10942546B2 (en) Electronic device and method for processing gesture thereof
TWI471776B (en) Method and computing device for determining angular contact geometry
US9632626B2 (en) Apparatuses and methods for providing a 3D man-machine interface (MMI)
TWI497390B (en) Touch display device and method for sensing capacitance thereof
WO2010127167A3 (en) Operating a touch screen control system according to a plurality of rule sets
US8947397B2 (en) Electronic apparatus and drawing method
US8908098B2 (en) Method and apparatus for interacting with television screen
US20160196034A1 (en) Touchscreen Control Method and Terminal Device
JP2011113128A (en) Pen tablet input device and input method using the same
US20140118312A1 (en) Electronic apparatus and drawing method
US9891729B2 (en) Operation processing device and method for user interface
US20140160043A1 (en) Method of compensating for edge coordinates of touch sensing system
US11182040B2 (en) Information processing device, information processing method, and program for controlling behavior of an application based on association information
JP2007188482A (en) Display device and driving method thereof
JP6287382B2 (en) Gesture recognition device and method for controlling gesture recognition device
CN101006420B (en) Method of rotating image, computer, and recording media
JP2006126997A (en) Three-dimensional touch panel
US20160018917A1 (en) Touch system, touch apparatus, and mobile device
TWI525480B (en) Position detection device and detection method
US20080094376A1 (en) Stylus calibration system and method
WO2014132389A1 (en) Touch sensor apparatus, display system, and position coordinate correction method
JP6437299B2 (en) Information processing apparatus, information processing program, and information processing method
KR20100112379A (en) Display apparatus and method for inputting pointing information thereof
CN103869941A (en) Electronic device with virtual touch service and virtual touch immediate correction method
CN113110732A (en) Eye tracking control method and system for multi-picture display screen

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13876656

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13876656

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP