JP2011159091A - Display apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display apparatus that enables easy execution of various operations via a touch pen used for touch operation on a touch panel. <P>SOLUTION: The display apparatus includes an axial rotation detection part 38 for detecting a rotation of the touch pen 14 about an axis C, an inclination detection part 42 for detecting an inclination of the touch pen 14 to a plane part 12p, an input mode determination part 30 for determining whether an input mode is in effect in which the touch pen 14 is used for input to the touch panel 24, and an operation control part 32 for, when the input mode determination part 30 provides an affirmative determination, controlling the display of an image on a display 22 or changing the input condition of touch operation on the touch panel 24 according to at least either the result of detection by the axial rotation detection part 38 or the result of detection by the inclination detection part 42. This facilitates image display control of the display 22 or changes of the input condition of touch operation on the touch panel 24. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display device including a touch panel that receives an input in response to a contact operation on a flat surface, and more particularly to an improvement that enables various operations to be easily performed via a touch pen used for the touch operation on the touch panel.

  There is known a display device including a touch panel that receives an input in accordance with a contact operation on a flat surface, an axial touch pen used for the touch operation on the touch panel, and a display that displays an image. For example, a digital photo frame or a tablet PC provided with a touch panel display. In such a display device, a technique has been proposed in which various operations can be easily performed via the touch pen. For example, this is the electronic device described in Patent Document 1. According to this technology, even when the touch pen (input pen) is stored in the storage unit of the device main body, the touch pen can be rotated to function as an input device.

JP-A-2005-63200

  However, the conventional technology as described above has a problem that the function cannot be used unless the touch pen is housed in the device body. The touch pen is often handled by a user when using the display device, but various operations can be easily performed through the touch pen in a state where the touch pen is detached from the device main body. The technology is not yet developed.

  The present invention has been made in the background of the above circumstances, and an object thereof is to provide a display device that can easily perform various operations via a touch pen used for a touch operation on a touch panel. It is in.

  In order to achieve such an object, the gist of the present invention is to display a touch panel that receives an input in response to a contact operation on a flat surface, an axial touch pen used for the contact operation on the touch panel, and an image. A rotation detection unit that detects rotation about an axis of the touch pen, an inclination detection unit that detects an inclination of the touch pen with respect to the plane unit, and an input to the touch panel An input mode determination unit that determines whether or not the input mode uses the touch pen, and a detection result by the rotation detection unit and a detection result by the tilt detection unit when the determination of the input mode determination unit is affirmed Based on at least one of the above, the display control of the image on the display or the touch operation on the touch panel And an operation control unit for executing a change in the input conditions according to, is characterized in that it comprises.

  If it does in this way, the rotation detection part which detects the rotation around the axial center which concerns on the said touch pen, the inclination detection part which detects the inclination of the said touch pen with respect to the said plane part, and the input which uses the said touch pen for the said touch panel Based on at least one of the detection result by the rotation detection unit and the detection result by the tilt detection unit when the determination of the input mode determination unit and the input mode determination unit is affirmed. And an operation control unit that executes an image display control on the display or an input condition change related to a touch operation on the touch panel, so that the user is circulated when using the display device. Via a touch pen, input control related to image display control on the display or touch operation on the touch panel. It is possible to easily perform the change of conditions. That is, it is possible to provide a display device that can easily execute various operations via a touch pen used for a touch operation on the touch panel.

  Here, preferably, the operation control unit executes deformation or switching of the image as display control of the image on the display based on a detection result by the rotation detection unit, or a touch operation on the touch panel. As such an input condition, the form of a line or a character input according to the contact operation is changed. In this way, it is easy to practically change the input conditions related to the display control of the image on the display or the touch operation on the touch panel via the touch pen that is circulated by the user when using the display device. Can be executed.

  Preferably, the operation control unit determines the change of the line or character form as the change of the input condition based on the detection result by the rotation detection unit based on the detection result by the inclination detection unit. It is. In this way, according to the inclination of the touch pen with respect to the plane part of the touch panel, it is possible to selectively change the thickness, line type, line color, etc. of the line drawn by the touch pen.

  Preferably, the operation control unit selectively selects one of display control of an image on the display and change of an input condition related to a touch operation on the touch panel based on a determination result of the input mode determination unit. To be executed. If it does in this way, the operation via the touch pen can be made different between the case of the input mode using the touch pen for input to the touch panel and the case other than that.

  Preferably, the operation control unit executes display control of an image on the display based on a detection result by the rotation detection unit when the determination of the input mode determination unit is negative. is there. If it does in this way, when it is not the input mode which uses the touch pen for the input to the touch panel, display control of an image on the display can be simply performed via the touch pen.

It is a figure which shows roughly the external appearance of the display apparatus which is one Example of this invention. It is a block diagram explaining the structure of the display apparatus which is one Example of this invention. It is a block diagram explaining the structure of the touch pen with which the display apparatus of FIG. 2 was equipped. It is a figure explaining the rotation of the shaft center detected by the shaft rotation detection part with which the touch pen of FIG. 3 was equipped. It is a figure explaining the rotation around the fulcrum detected by the fulcrum rotation detection part with which the touch pen of FIG. 3 was equipped. It is a figure explaining the inclination of the axial center of a touch pen with respect to the touchscreen display detected by the inclination detection part with which the touch pen of FIG. 3 was equipped. FIG. 7 is a diagram for explaining an example of a configuration provided in the touch pen of FIG. 3 in order to enable detection of the rotation about the axis shown in FIG. 4, the rotation about the fulcrum shown in FIG. 5, and the inclination shown in FIG. 6. Yes, this corresponds to a cross section of the touch pen viewed in the axial direction. FIG. 8 is a diagram illustrating an example of a relationship used for rotation around the axis shown in FIG. 4, rotation around a fulcrum shown in FIG. 5, and inclination detection shown in FIG. 6 corresponding to the configuration shown in FIG. 7. It is a figure explaining a mode that the form of the line input according to the contact operation with respect to a touchscreen is changed based on the detection result by the axial rotation detection part of a touch pen shown in FIG. 3, and the detection result by an inclination detection part. Based on the detection result by the axis rotation detection unit of the touch pen shown in FIG. 3 and the detection result by the inclination detection unit, the thickness of the line input in response to the touch operation on the touch panel is set to be thicker than the line shown in FIG. It is a figure explaining a done state. Based on the detection result by the axis rotation detection unit of the touch pen shown in FIG. 3 and the detection result by the inclination detection unit, the thickness of the line input in response to the touch operation on the touch panel is set to be thinner than the line shown in FIG. It is a figure explaining a done state. Based on the detection result by the axis rotation detection unit of the touch pen and the detection result by the inclination detection unit shown in FIG. FIG. Explained that the type of line input according to the touch operation on the touch panel is set to be a one-dot chain line based on the detection result by the axis rotation detection unit and the detection result by the inclination detection unit of the touch pen shown in FIG. It is a figure to do. FIG. 3 is a diagram conceptually illustrating a state in which a plurality of images are slide-displayed on a display in a slide mode as an example of image display control on the display of the display device illustrated in FIG. 2. Corresponding to the slide switching display of the plurality of images shown in FIG. 14, it is displayed on the display of the display device of FIG. 2 based on the rightward rotation detected by the shaft rotation detection unit provided in the touch pen of FIG. 3. FIG. 6 is a diagram conceptually illustrating a state in which a plurality of images are slide-displayed. Corresponding to the slide switching display of the plurality of images shown in FIG. 14, it is displayed on the display of the display device of FIG. 2 based on the leftward rotation detected by the shaft rotation detection unit provided in the touch pen of FIG. 3. FIG. 6 is a diagram conceptually illustrating a state in which a plurality of images are slide-displayed. As another example of the image display control on the display of the display device shown in FIG. 2, the concept is that a plurality of images are slide-displayed on the display in the slide mode, and the images are switched and displayed in a virtual front-rear direction. FIG. Corresponding to the virtual front / rear direction switching display of the plurality of images shown in FIG. 17, based on the detection results by the shaft rotation detection unit provided in the touch pen of FIG. 3, the images on the display of the display device of FIG. It is a figure which shows notionally a mode that the switching display of the virtual front-back direction of the image is performed as display control. 3 is a flowchart illustrating a main part of main control executed by a control unit of the display device shown in FIG. 2. It is a flowchart explaining the principal part of the input mode process in the main control shown in FIG. It is a flowchart explaining the principal part of the slide mode axis | shaft rotation process in the main control shown in FIG. It is a flowchart explaining the principal part of the slide mode fulcrum rotation process in the main control shown in FIG. It is a flowchart explaining the principal part of rotation detection / transmission control by the control part of the touch pen shown in FIG.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram schematically showing the appearance of a display device 10 according to an embodiment of the present invention. As shown in FIG. 1, the display device 10 of the present embodiment includes a touch panel display 12 for displaying a predetermined image (video) and inputting according to a user's contact operation. In addition, an axial touch pen 14 used for a touch operation on the touch panel display 12 is provided separately. The touch pen 14 is used by being held on a user's finger in the same manner as a writing instrument such as a pencil or a pen when using the display device 10 of the present embodiment. As shown in FIG. In addition to the basic operations of drawing (free drawing) by a touch operation on the touch panel 12 and performing a predetermined selection operation by touching an icon displayed on the touch panel display 12, the touch pen 14 is used as described later. Various controls are executed in the display device 10 in accordance with the rotation, inclination, and the like.

  FIG. 2 is a block diagram illustrating the configuration of the display device 10. As shown in FIG. 2, the display device 10 of this embodiment includes a control unit 16 that executes various controls including image display control by the display device 10, and a plurality of image information (image files). And a storage unit 18 such as a flash memory for storing various information to be received, and a wireless reception unit 20 for receiving a wireless signal transmitted from the touch pen 14 or the like.

  As shown in FIG. 2, the touch panel display 12 is input by touching the touch panel display 12 with a display 22 that displays a predetermined image on the touch panel display 12, a user's finger, the touch pen 14 provided, or the like. And a touch panel 24 to be configured. In addition, the display device 10 includes a display control unit 26 that performs display control of an image (video) on the display 22 and an input control unit 28 that processes input information input through the touch panel 24. The display control unit 26 and the input control unit 28 perform image display control or information input control by the touch panel display 12 via the display 22 and the touch panel 24. Here, the touch panel 24 preferably outputs a signal corresponding to the detection result by detecting the pressure on the surface, but other methods of position detection include electronic and electromagnetic induction types. Electrostatic type, optical type, ultrasonic type, etc. are adopted.

  The control unit 16 includes, for example, a CPU that is a central processing unit, a ROM that is a read-only memory, and a RAM that is a write / read memory as needed, while using a temporary storage function of the RAM. Image display control that is a so-called microcomputer that executes various information processing by the CPU based on information stored in the ROM, and displays a predetermined image on the touch panel display 12 (display 22) via the display control unit 26. , Input processing control for processing an input signal input via the input control unit 28 in accordance with the touch operation on the touch panel display 12 (touch panel 24), and processing of the radio signal received by the radio receiving unit 20 Various controls related to the display device 10 of the present embodiment are executed. As shown in FIG. 2, the control unit 16 is functionally provided with an input mode determination unit 30 and an operation control unit 32. These control functions will be described later with reference to FIGS.

  For example, JPEG (Joint Photographic Experts Group) or PNG (Portable Network Graphics) is stored in the storage unit 18 as image information for displaying a predetermined image on the touch panel display 12 (display 22) via the display control unit 26. ), Image data (image file) in a file format such as GIF (Graphics Interchange Format) is stored with each identification information as an index. The display 22 may display not only a still image but also a moving image, and image information stored in the storage unit 18 corresponds to a moving image if it corresponds to a still image. It doesn't matter if there is. Further, as shown in FIG. 2, a pen status table 34 is formed in the storage unit 18 when the control unit 16 controls the present embodiment. The pen status table 34 will be described later together with the description of the input mode determination unit 30 and the operation control unit 32.

  FIG. 3 is a block diagram illustrating a configuration provided (incorporated) in the touch pen 14. As shown in FIG. 3, the touch pen 14 detects a rotation around the axis of the touch pen 14 and a control unit 36 that executes various controls including rotation detection and tilt detection control of the touch pen 14. A shaft rotation detection unit 38, a fulcrum rotation detection unit 40 that detects rotation (rotation) around the fulcrum related to the touch pen 14, and an inclination detection unit 42 that detects the tilt of the axis of the touch pen 14 with respect to the touch panel display 12. A wireless transmission unit 44 that transmits the detection results of the shaft rotation detection unit 38, the fulcrum rotation detection unit 40, and the tilt detection unit 42 to the display device 10 as wireless signals; the control unit 36; A power supply unit 46 for supplying electrical energy for operating the unit 38, the fulcrum rotation detection unit 40, the inclination detection unit 42, the wireless transmission unit 44, etc. Ete is configured. Note that the power supply unit 46 is not necessarily provided when a wired power supply is secured by an electric cable or the like.

  FIG. 4 is a diagram for explaining the rotation around the axis of the touch pen 14 detected by the shaft rotation detector 38. As indicated by arrows in FIG. 4, the shaft rotation detector 38 detects the direction of rotation (rotation) or the amount of rotation about the axis C of the touch pen 14 as the rotation axis. As the detection of the rotation amount, preferably, it is detected whether or not a rotation of a predetermined angle (for example, 45 °) or more around the axis C of the touch pen 14 is performed, and the detection is repeated to thereby detect the rotation amount. A cumulative rotation amount is calculated.

  FIG. 5 is a diagram for explaining the rotation around the fulcrum related to the touch pen 14 detected by the fulcrum rotation detection unit 40. As indicated by the arrows in FIG. 5, the fulcrum rotation detection unit 40 uses the center of the touch pen 14 in the longitudinal direction (not necessarily strictly the center) as the fulcrum F, and the axis C of the touch pen 14. The direction of rotation or the amount of rotation in the plane that contains it is detected. In other words, the rotation direction or the rotation amount of the touch pen 14 in the direction in which the direction of the pen tip of the touch pen 14 changes is detected. As the detection of the rotation amount, preferably, it is detected whether or not a rotation of a predetermined angle (for example, 45 °) or more is performed around the fulcrum F related to the touch pen 14, and the detection is repeated. A cumulative rotation amount is calculated.

  FIG. 6 is a diagram for explaining the inclination of the axis of the touch pen 14 with respect to the touch panel display 12 detected by the inclination detector 42. As shown in FIG. 6, the tilt detection unit 42 detects the tilt angle θ of the axis C of the touch pen 14 with respect to the normal of the flat surface 12 p of the touch panel display 12 (the surface common to the display 22 and the touch panel 24). To do. Preferably, the tilt angle θ of the touch pen 14 with respect to the normal of the plane portion 12p is set such that the inclination angle θ is 10 ° or less, within a range of 10 ° to 45 °, or 45 ° or more. The inclination angle θ of the axis C is detected stepwise.

  FIG. 7 is a diagram illustrating an example of a configuration provided in the touch pen 14 to enable detection by the shaft rotation detection unit 38, the fulcrum rotation detection unit 40, and the tilt detection unit 42. 14 corresponds to a cross section when viewed in the axial direction (longitudinal direction). As shown in FIG. 7, the touch pen 14 includes three acceleration sensors 48a, 48b, and 48c that detect acceleration in one axial direction in a plane perpendicular to the axis C (hereinafter, unless otherwise specified). Has a built-in acceleration sensor 48). Each of these acceleration sensors 48 detects an acceleration in a uniaxial direction represented by the A-B direction shown in FIG. 7, that is, the blacked-out direction A and the opposite direction B, at least. It is configured so that it can be detected whether the acceleration is in the direction of A or B. Then, as shown in FIG. 7, each of the acceleration sensors 48 a, 48 b, and 48 c is configured such that the AB directions form 120 ° with each other, so that the planes perpendicular to the axis C of the touch pen 14 are formed. Three-axis accelerations (at least the acceleration directions) forming 120 ° with each other are detected. Moreover, it is preferable that the site | part in which these acceleration sensors 48 are provided avoids the center part of the longitudinal direction of the said touch pen 14, and is a pen point side rather than the center part, or the other side. In the following embodiments, an aspect in which the acceleration sensor 48 is provided at a predetermined portion on the opposite side of the pen tip from the center of the touch pen 14 will be described.

  The shaft rotation detection unit 38, the fulcrum rotation detection unit 40, and the inclination detection unit 42 perform the detection based on a detection result by the acceleration sensor 48 from a predetermined relationship. FIG. 8 is a diagram illustrating an example of a relationship used for this detection. In the configuration in which each acceleration sensor 48 is disposed as shown in FIG. 7, the touch pen 14 rotates clockwise about the axis C, left-rotates, and rotates right around the fulcrum F in a plane including the axis C. The pattern (combination) of detection results detected by the respective acceleration sensors 48a (sensor 1), 48b (sensor 2), and 48c (sensor 3) is different in the left rotation. In the present embodiment, the clockwise rotation in the same direction as the pen tip of the touch pen 14 is defined as the clockwise rotation around the axis. That is, as shown in FIG. 8, the acceleration sensor 48a detects no acceleration corresponding to the gravity when the axis C of the touch pen 14 is in the horizontal direction, and the acceleration 48b accelerates in the A direction. And acceleration in the B direction is detected by the acceleration sensor 48c. Further, the acceleration in the B direction is detected by any of the acceleration sensors 48a, 48b, and 48c in response to the right rotation around the axis C of the touch pen 14. Further, the acceleration in the A direction is detected by any of the acceleration sensors 48a, 48b, and 48c in response to the left rotation around the axis C of the touch pen 14. Corresponding to the right rotation around the fulcrum F in the plane including the axis C of the touch pen 14, the acceleration 48a detects the acceleration in the A direction, and the acceleration 48b detects the acceleration in the B direction. The acceleration sensor 48c detects the acceleration in the B direction. Corresponding to the left rotation around the fulcrum F in the plane including the axis C of the touch pen 14, the acceleration 48a detects the acceleration in the B direction, and the acceleration 48b detects the acceleration in the A direction. The acceleration sensor 48c detects the acceleration in the A direction. Such a relationship, that is, a correspondence pattern between the rotation mode of the touch pen 14 as shown in FIG. 8 and the acceleration direction detected by each acceleration sensor 48 is stored in the RAM of the control unit 36 or a storage unit (not shown). ing.

  The shaft rotation detection unit 38, the fulcrum rotation detection unit 40, and the inclination detection unit 42 perform the detection by collating the direction of acceleration detected by each acceleration sensor 48 with the relationship in FIG. Note that the change in the inclination of the touch pen 14 with respect to the flat surface portion 12p of the touch panel display 12 corresponds to the rotation in the plane including the axis C, and therefore, based on the relationship corresponding to the fulcrum rotation shown in FIG. Can be judged. Further, a mode in which the inclination of the touch pen 14 with respect to the flat surface portion 12p is detected based on the direction of gravitational acceleration detected by each acceleration sensor 48 is also conceivable. The detection results detected by the shaft rotation detection unit 38, the fulcrum rotation detection unit 40, and the inclination detection unit 42 as described above are transmitted from the wireless transmission unit 44 to the display device 10, and the display device 10 and is supplied to the control unit 16 and the like. Note that infrared communication is preferably used for transmission of information from the wireless transmission unit 44 to the wireless reception unit 20, but may be realized by short-range wireless communication such as Bluetooth (registered trademark) communication. Good.

  The input mode determination unit 30 illustrated in FIG. 2 determines whether or not the input mode uses the touch pen 14 for input to the touch panel 24. For example, when a touch operation (input operation) is performed on the touch panel 24 and when the predetermined time elapses after the last touch operation is performed, the input mode is determined. When the predetermined time has elapsed since the touch operation on the touch panel 24 was performed, it is determined that the mode is the non-input mode. As an example of this non-input mode, there is a slide mode in which an image displayed on the display 22 is slid as described later. Hereinafter, in this embodiment, a case where the slide mode is determined as the non-input mode will be described. Here, the touch operation with respect to the touch panel 24 can be performed not only with the touch pen 14 but also with other shaft-shaped members or a user's finger or the like. In this embodiment, the touch operation with respect to the touch panel 24 is exclusively performed with the touch pen 14. This determination is made according to whether or not there is a touch operation on the touch panel 24. Further, a mode is also conceivable in which a switch is provided in the display device 10 and it is determined whether or not the input mode is in accordance with switching of the switch.

  The operation control unit 32 illustrated in FIG. 2 displays an image on the display 22 based on at least one of detection results of the shaft rotation detection unit 38, the fulcrum rotation detection unit 40, and the tilt rotation detection unit 42 of the touch pen 14. Control or change of input conditions related to the touch operation on the touch panel 24 is executed. Hereinafter, specific control by the operation control unit 32 will be described in detail with reference to FIGS. 9 to 18.

  The operation control unit 32 is preferably detected by the shaft rotation detection unit 38 when the determination of the input mode determination unit 30 is affirmative, that is, in the input mode in which the touch pen 14 is used for input to the touch panel 24. Based on the result and the detection result by the inclination detector 42, the input condition related to the touch operation on the touch panel 24 is changed. Preferably, as such an input condition, the form (property) of a line input in accordance with a touch operation on the touch panel 24 is changed. Here, the line input in response to the touch operation on the touch panel 24 refers to the display 22 according to the touch operation on the touch panel 24 under the control of a paint application or the like functionally provided in the display device 10. It is a straight line or a curve to be drawn, and is represented, for example, by connecting a plurality of paths.

  9 to 13 show a state in which the form of the input line is changed according to the touch operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38 and the detection result by the inclination detection unit 42. It is a figure explaining. In the drawing on the touch panel display 12 using the touch pen 14, as shown in FIG. 9, a line 50a corresponding to the touch operation according to the touch operation on the touch panel 24 (hereinafter, not particularly distinguished from other lines). Is simply referred to as a line 50) is reflected (displayed) on the display 22 almost immediately. That is, by moving the contact portion of the touch pen 14 with respect to the touch panel 24, the line 50a corresponding to the movement locus follows and is displayed (drawn) on the display 22.

  Here, the operation control unit 32 preferably changes the thickness (line width) of the line 50 input in accordance with the contact operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38. To do. As the thickness of the line 50 input in response to this contact operation, a plurality of line widths such as “0.1 point”, “0.5 point”, “1.0 point”,... Are predetermined. The operation control unit 32 preferably determines the thickness of the line 50 input in accordance with the contact operation on the touch panel 24 in the above-described steps based on the detection result by the shaft rotation detection unit 38. Set to one of the line widths. For example, when a right rotation around the axis of the touch pen 14 is detected by the shaft rotation detection unit 38, the thickness of a line drawn corresponding to the movement locus of the contact portion of the touch pen 14 with respect to the touch panel 24 Change the input condition to thicken. For example, when the input operation similar to that shown in FIG. 9 is performed in accordance with the change of the input condition from the state where the line width is “0.5 point”, the touch panel display 12 (display 22) is shown in FIG. As shown in FIG. 10, a line 50b of, for example, “1.0 point”, which is thicker than the line 50a, is drawn. In addition, when the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38, the thickness of a line drawn corresponding to the movement locus of the contact portion of the touch pen 14 with respect to the touch panel 24 Change the input condition to make For example, when the input operation similar to that shown in FIG. 9 is performed in accordance with the change of the input condition from the state where the line width is “0.5 point”, the touch panel display 12 (display 22) is shown in FIG. As shown in FIG. 11, a line 50c of, for example, “0.1 point”, which is thinner than the line 50a, is drawn. Further, the thickness of the line 50 is continuously (linearly) based on a rotation amount (rotation angle) in a predetermined direction (for example, clockwise) around the axis of the touch pen 14 detected by the shaft rotation detection unit 38. Control to change to is also conceivable.

  In addition, the operation control unit 32 preferably changes the type (line type) of the line 50 input according to the contact operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38. As types of the line 50 input in response to the contact operation, a plurality of types of lines such as “two-dot chain line”, “one-dot chain line”, “solid line”, “dashed line”,... The operation control unit 32 preferably determines the type of the line 50 input according to the contact operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38 as the plurality of types of line types. Set to one of the following. For example, when a right rotation around the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 in a state where the line type is “solid line”, the movement locus of the contact portion of the touch pen 14 with respect to the touch panel 24 is detected. The input condition is changed to “dashed line” which is a predetermined first line type as the type of line drawn corresponding to When the input operation similar to that shown in FIG. 9 is performed in accordance with the change of the input conditions, for example, the touch panel display 12 (display 22) is drawn with a broken line 50d as shown in FIG. . In addition, when the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 in a state where the line type is “solid line”, the movement locus of the contact portion of the touch pen 14 with respect to the touch panel 24 is detected. The input condition is changed to “one-dot chain line”, which is a line type previously determined in advance, as the type of the line drawn corresponding to. When the input operation similar to that shown in FIG. 9 is performed in accordance with such change of the input condition, for example, a line 50e which is a one-dot chain line is drawn on the touch panel display 12 (display 22) as shown in FIG. It is. Further, based on the rotation amount (rotation angle) in a predetermined direction (for example, clockwise direction) around the axis of the touch pen 14 detected by the shaft rotation detection unit 38, the line type of the line 50 is “one-dot chain line”, Control of changing the line type continuously (linear), such as “two-dot chain line”, “three-dot chain line”,.

  In addition, the operation control unit 32 preferably changes the color (line color) of the line 50 input according to the contact operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38. As the color of the line 50 input in response to the contact operation, a plurality of types of colors such as “red”, “black”, “blue”,... Are predetermined, and the operation control unit 32 preferably sets the color of the line 50 input according to the contact operation on the touch panel 24 to any one of the plurality of colors based on the detection result by the shaft rotation detection unit 38. For example, when a right rotation around the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 in a state where the line color is “black”, the movement locus of the contact portion of the touch pen 14 with respect to the touch panel 24 is detected. The input condition is changed so that the color of the line drawn corresponding to “blue”, which is a predetermined first line color, is “blue”. With the change of the input condition, for example, when an input operation similar to that shown in FIG. 9 is performed, a blue line 50 is drawn on the touch panel display 12 (display 22). In addition, when the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 in a state where the line color is “black”, the movement locus of the contact portion of the touch pen 14 with respect to the touch panel 24 is detected. The input condition is changed so that the color of the line drawn corresponding to “red” is “red” which is a predetermined previous color. With such a change in the input conditions, for example, when an input operation similar to that shown in FIG. 9 is performed, a red line 50 is drawn on the touch panel display 12 (display 22). Further, a color pallet window arranged in a circle in advance in such control is displayed, and a rotation amount (for example, clockwise) around the axis of the touch pen 14 detected by the shaft rotation detection unit 38 ( Based on the rotation angle), a control may be conceived in which the line color of the line 50 is set to any one on the window of the color palette.

  The operation control unit 32 preferably uses a change in line form (property) as a change in the input condition based on a detection result from the shaft rotation detection unit 38 as a detection result by the tilt detection unit 42. Determine based on. For example, regarding the change in the form of the line 50 input in response to the touch operation on the touch panel 24, as described above, the three different forms are changed, that is, the thickness (line width) of the line 50 is changed, and the type of the line 50 is changed. In the case where it is possible to change the (line type) and the color (line color) of the line 50, any one of the changes is selectively executed based on the detection result by the inclination detection unit 42. For example, when the inclination θ (see FIG. 6) of the touch pen 14 with respect to the flat surface part 12p detected by the inclination detection unit 42 is within a first angle range (for example, within a range of 0 ° to 10 °). Changes the thickness (line width) of the line 50 input in response to the touch operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38. Further, when the inclination θ of the touch pen 14 with respect to the flat surface part 12p detected by the inclination detection unit 42 is within a second angle range (for example, within a range of 10 ° to 45 °), the shaft rotation detection is performed. Based on the detection result by the unit 38, the type (line type) of the line 50 input according to the contact operation on the touch panel 24 is changed. Further, when the inclination θ of the touch pen 14 with respect to the flat surface portion 12p detected by the inclination detection unit 42 is within a third angle range (for example, within a range of 45 ° to 90 °), the shaft rotation detection is performed. Based on the detection result by the unit 38, the color (line color) of the line 50 input in response to the touch operation on the touch panel 24 is changed. Further, the above control is executed according to a relative angle change from an angle when the pen tip of the touch pen 14 stops on the touch panel 24, not an absolute angle detected by the tilt detection unit 42. There may be.

  The operation control unit 32 is preferably operated by the shaft rotation detection unit 38 in the input mode in which the touch pen 14 is used for input to the touch panel 24 when the determination of the input mode determination unit 30 is positive. As a change in the input condition related to the touch operation on the touch panel 24 based on the detection result and the detection result by the tilt detection unit 42, the form of a character or character string input or selected according to the touch operation on the touch panel 24 ( Change the property. Preferably, editing such as deletion of a character or character string input or selected in accordance with a touch operation on the touch panel 24 is performed based on a detection result by the shaft rotation detection unit 38. For example, when a right rotation around the axis of the touch pen 14 is detected by the shaft rotation detector 38, editing is performed to delete the selected character or character string. If the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detector 38, the deleted character or character string is restored (executed by undoing the process). Note that such control is selectively executed with the change of the input condition relating to the line 50 described above, and preferably any one of the processes is executed by a predetermined operation. Any of them may be applied.

  Further, the operation control unit 32 preferably changes the font of the character or character string input or selected according to the touch operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38. To do. As the types of fonts input in response to this contact operation, a plurality of types of fonts are predetermined, such as “Gothic”, “Line type”, “Mincho”,. Preferably, the operation control unit 32 selects one of the plurality of types of fonts as input or selected according to the contact operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38. Set. For example, when the right rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 from the state where the font of the character or the character string is “line font”, for example, the touch operation on the touch panel 24 is performed. The input condition is changed or edited so that the font of the character or the character string input or selected in response is changed to “Mincho”, which is a predetermined primary font. For example, when the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 from the state where the font of the character or the character string is “line font”, the touch operation on the touch panel 24 is performed. The input condition is changed or edited so that the font of the character or the character string input or selected in response is changed to “Gothic” which is a predetermined previous font. Further, a predetermined font list is displayed in such control, and based on a rotation amount (rotation angle) in a predetermined direction (for example, clockwise) around the axis of the touch pen 14 detected by the shaft rotation detection unit 38. Thus, a control in which the font of a character or character string is determined to any one of the font list is also conceivable.

  In addition, the operation control unit 32 preferably has a character or character string size (font) input or selected according to a touch operation on the touch panel 24 based on a detection result by the shaft rotation detection unit 38. Size). As the size of the character or the character string input in response to the contact operation, a plurality of sizes such as “1 point”, “5 point”, “10 point”,... The control unit 32 preferably determines the size of the character or character string input or selected according to the touch operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38 in the above-mentioned stepwise manner. Set to one of the specified sizes. For example, when a right rotation around the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 from a state where the size of a character or a character string is “0.5 point”, the touch operation on the touch panel 24 is performed. The input condition is changed or edited so that the size of the character or character string that is input or selected in response is “10 points”, which is a predetermined one larger size. For example, when the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 from the state where the size of the character or the character string is “0.5 point”, the touch operation on the touch panel 24 is performed. The input condition is changed or edited so that the size of the character or character string input or selected in response is set to “1point”, which is a predetermined smaller size. Further, for example, when a scalable font is applied, a character or a character is generated based on a rotation amount (rotation angle) in a predetermined direction (for example, clockwise) around the axis of the touch pen 14 detected by the shaft rotation detection unit 38. Control that changes the size of the character string, for example, one point at a time (linear) can be considered.

  The operation control unit 32 is preferably configured to input a character or a character string color (character) that is input or selected in accordance with a touch operation on the touch panel 24 based on a detection result by the shaft rotation detection unit 38. Color). As the color of the character or the character string input in response to the contact operation, a plurality of types of colors such as “red”, “black”, “blue”,... The control unit 32 preferably selects the color of the character or character string input or selected according to the touch operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38 from the plurality of colors. Set to one of the following. For example, when a right rotation around the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 in a state where the color of a character or a character string is “black”, for example, according to the touch operation on the touch panel 24. The input condition is changed or edited so that the color of the character or character string input or selected is “blue” which is a predetermined first line color. For example, when the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38 in a state where the color of the character or the character string is “black”, the touch operation on the touch panel 24 is performed. The input condition is changed or edited so that the color of the character or character string input or selected is “red”, which is a predetermined previous line color. Further, a color pallet window arranged in a circle in advance in such control is displayed, and a rotation amount (for example, clockwise) around the axis of the touch pen 14 detected by the shaft rotation detection unit 38 ( A control in which the color of a character or character string is determined to any one on the window of the color palette based on the rotation angle) is also conceivable.

  The operation control unit 32 preferably determines a change in the form (property) of the character or the character string based on the detection result by the shaft rotation detection unit 38 based on the detection result by the inclination detection unit 42. To do. For example, regarding the change of the form of a character or character string input or selected according to the touch operation on the touch panel 24, as described above, the change of three different forms, that is, the change of the font of the character or character string, the character In the case where it is possible to change the size of the character string (font size) and the color of the character or character string, any change is selectively performed based on the detection result by the inclination detection unit 42. To run. For example, when the inclination θ (see FIG. 6) of the touch pen 14 with respect to the flat surface part 12p detected by the inclination detection unit 42 is within a first angle range (for example, within a range of 0 ° to 10 °). Changes the font of the character or character string input or selected in accordance with the touch operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38. Further, when the inclination θ of the touch pen 14 with respect to the flat surface part 12p detected by the inclination detection unit 42 is within a second angle range (for example, within a range of 10 ° to 45 °), the shaft rotation detection is performed. Based on the detection result by the unit 38, the size (font size) of the character or character string input or selected according to the touch operation on the touch panel 24 is changed. Further, when the inclination θ of the touch pen 14 with respect to the flat surface portion 12p detected by the inclination detection unit 42 is within a third angle range (for example, within a range of 45 ° to 90 °), the shaft rotation detection is performed. Based on the detection result by the unit 38, the color of the character or character string input or selected according to the touch operation on the touch panel 24 is changed.

  In addition, the operation control unit 32 preferably copies (duplicates) and pastes a character or a character string selected according to the touch operation on the touch panel 24 based on the detection result by the shaft rotation detection unit 38. Selectively execute editing such as (Paste). For example, when a right rotation around the axis of the touch pen 14 is detected by the shaft rotation detection unit 38, a copy of a character or a character string selected according to the touch operation on the touch panel 24 is executed. Further, when a left rotation around the axis of the touch pen 14 is detected by the shaft rotation detection unit 38, for example, a character or a character string copied by the above operation is placed at a position corresponding to the touch operation on the touch panel 24. Perform the edit that you want to paste.

  Further, the operation control unit 32 preferably enlarges, reduces, rotates, etc. an editing screen (work area related to drawing) displayed on the display 22 based on the detection result by the shaft rotation detection unit 38. Selective changes are performed. For example, when the right rotation around the axis of the touch pen 14 is detected by the shaft rotation detector 38, the editing screen displayed on the display 22 is enlarged. When the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38, the editing screen displayed on the display 22 is reduced.

  The operation control unit 32 is preferably configured so that the shaft rotation detection unit 38, in the input mode in which the touch pen 14 is used for input to the touch panel 24, when the determination of the input mode determination unit 30 is affirmed. Even when at least one of the fulcrum rotation detection unit 40 and the inclination detection unit 42 detects a rotation or a change in inclination of the touch pen 14, the coordinates of the contact portion of the touch pen 14 with respect to the touch panel 24 are predetermined. When it is determined that the speed is changed at a speed or higher, control such as change of the input condition based on a change in rotation or inclination of the touch pen 14 is not executed (not executed). When it is determined that the coordinates of the contact portion of the touch pen 14 with respect to the touch panel 24 are changing at a predetermined speed or more, the user may be performing drawing on the touch panel 24 with the touch pen 14. Conceivable. In such a case, the touch pen 14 is rotated or the inclination is changed as a movement related to drawing, not to change the input condition related to the display control of the image on the display 22 or the touch operation on the touch panel 24. Since the above control is not executed, the display control of the image on the display 22 or the change of the input condition related to the touch operation on the touch panel 24 that is not intended by the user is executed. Can be suitably suppressed.

  The operation control unit 32 is preferably a non-input mode (slide mode) that is not an input mode in which the touch pen 14 is used for input to the touch panel 24 when the determination of the input mode determination unit 30 is negative. , Based on at least one of the detection results by the shaft rotation detection unit 38 and the fulcrum rotation detection unit 40, deformation or switching of the image is executed as image display control on the display 22.

  FIG. 14 is a diagram conceptually illustrating a state in which a plurality of images are slide-displayed on the display 22 in the slide mode, as an example of image display control on the display 22. In a slide mode, which is an example of an image display mode in the display device 10, a plurality of images are displayed on the display 22 while being slid in the horizontal direction (left and right toward the display 22) in accordance with a predetermined operation. It is done. For example, in the example illustrated in FIG. 14, the first image “Pic.A”, the second image “Pic.B”, the third image “Pic.C”, and the fourth image. “Pic.D” is basically switched and displayed in accordance with a touch operation on the touch panel 24 (for example, a slide operation in the horizontal direction while maintaining the touch state on the touch panel 24). That is, in the state shown in FIG. 14, the second image “Pic.B” is displayed on the display 22, and a sliding operation to the right is performed while maintaining the contact state with the touch panel 24. The image displayed on the display 22 is slid from “Pic.B” to “Pic.A” while the slide operation is performed in the left direction while maintaining the contact state with the touch panel 24. As a result, the image displayed on the display 22 is slid from “Pic.B” to “Pic.C” and further to “Pic.D”.

  15 and 16 correspond to the slide switching display of the plurality of images described above with reference to FIG. 14, and the image is displayed as image display control on the display 22 based on the detection result by the shaft rotation detection unit 38. It is a figure which shows notionally that a slide switching display of this is performed. As shown in these drawings, the operation control unit 32 preferably displays a plurality of images on the display 22 in the horizontal direction (left and right direction toward the display 22) based on the detection result by the shaft rotation detection unit 38. ) To perform display control for switching display. For example, when a right rotation around the axis of the touch pen 14 is detected by the shaft rotation detector 38, as shown in FIG. 15, the display area of the display 22 (area corresponding to the displayed image) Display control is executed to sequentially switch and display the plurality of images in the right direction (rightward toward the display 22). When the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detector 38, the display area of the display 22 is set to the left with respect to the plurality of images as shown in FIG. Display control is performed to sequentially switch and display while sliding in the left direction (toward the display 22). In addition, the operation control unit 32 preferably has a slide amount or slide related to the slide switching display based on a rotation amount or rotation speed around the axis of the touch pen 14 detected by the shaft rotation detection unit 38. Control the speed. That is, the slide switching display control is executed so that the slide amount or slide speed related to the slide switching display increases as the rotation amount or rotation speed detected by the shaft rotation detector 38 increases.

  FIG. 17 shows another example of the image display control on the display 22. In the slide mode, a plurality of images are slide-displayed on the display 22, and the images are switched and displayed in a virtual front-rear direction (depth direction). It is a figure which shows notably a mode that it is performed. In FIGS. 17, 18, and 19, only the touch panel display 12 is shown by omitting the display device 10 body for the sake of simplicity. In the slide mode shown in FIG. 17, a plurality of images are displayed on the display 22 while being switched in a horizontal direction (left and right toward the display 22) while being slid in accordance with a predetermined operation. Are switched and displayed in a typical front-rear direction (depth direction). Here, the horizontal slide switching display is as described above with reference to FIGS. Further, regarding the switching display in the front-rear direction, for example, in the example shown in FIG. 17, the first image “Pic.A”, the second image “Pic.B”, and the third image “Pic. .C ”and the fourth image“ Pic.D ”are displayed on the forefront side, the fifth image“ Pic.E ”, and the sixth image“ Pic.D ”. The second display column including “F”, the seventh image “Pic.G”, and the eighth image “Pic.H” is in the center, and the ninth image “Pic.I”, Third display columns including “Pic.J” as the tenth image, “Pic.K” as the eleventh image, and “Pic.L” as the twelfth image are arranged on the back side, respectively. Virtually arranged. These display columns are basically switched according to a touch operation on the touch panel 24 (for example, a touch operation on a front / rear switching button (not shown) displayed on the touch panel 24). That is, in the state shown in FIG. 17, “Pic.F” as the sixth image is displayed on the display 22, and when the forward / backward switching button displayed on the touch panel 24 is pressed, the display 22 is displayed. The displayed image is switched from “Pic.F” to “Pic.B” on the front side (near side) or “Pic.J” on the back side (back side).

  18 corresponds to the virtual front-rear direction switching display of the plurality of images described above with reference to FIG. 17, and the image display control on the display 22 is based on the detection result by the shaft rotation detection unit 38. It is a figure which shows notionally a mode that the switching display of the virtual front-back direction of the image is performed. As shown in these drawings, the operation control unit 32 preferably displays a plurality of images on the display 22 in a virtual front-rear direction (depth direction) based on the detection result by the shaft rotation detection unit 38. Executes display control for switching display. For example, when the left rotation about the axis of the touch pen 14 is detected by the shaft rotation detection unit 38, an image displayed on the display 22 is displayed as "Pic" as shown by a touch panel display 12 'in FIG. Execute display control to switch from “.F” to “Pic.B” on the front side (front side). When the shaft rotation detection unit 38 detects a right rotation around the axis of the touch pen 14, an image displayed on the display 22 is displayed as “Pic” as indicated by a touch panel display 12 ″ in FIG. 18. Display control to switch from “.F” to “Pic.J” on the back side (back side).

  In addition, the operation control unit 32 is preferably arranged in the virtual front-rear direction based on the detection result by the shaft rotation detection unit 38 and the direction (longitudinal direction) in which the pen tip of the touch pen 14 is directed. The switching display control of the plurality of images is executed. That is, as shown in FIG. 18, the axial center of the touch pen 14 in the left-right direction toward the touch panel display 12 (the direction parallel to the flat portion 12p of the touch panel display 12 and the lateral direction of the flat portion 12p). When C is oriented (it does not have to be exactly the same), switching display control of a plurality of images in the virtual front-rear direction is executed based on the detection result by the shaft rotation detection unit 38. In addition, as shown in FIG. 18, when the pen tip of the touch pen 14 (the end on the side to be brought into contact with the touch panel 24) is directed leftward toward the touch panel display 12, the shaft rotation detection unit 38. When the left rotation about the axis of the touch pen 14 is detected by the above, display control is performed to switch the image displayed on the display 22 to the front side (front side) image, while the shaft rotation detection unit 38 When a right rotation around the axis of the touch pen 14 is detected, display control is performed to switch the image displayed on the display 22 to a back side (back side) image. On the other hand, when the pen tip of the touch pen 14 is directed in the right direction toward the opposite side of FIG. 18, that is, toward the touch panel display 12, the shaft rotation detection unit 38 performs the right rotation around the axis of the touch pen 14. When it is detected, display control is performed to switch the image displayed on the display 22 to the front side (front side) image, while the shaft rotation detection unit 38 detects left rotation about the axis of the touch pen 14. Display control is performed to switch the image displayed on the display 22 to the image on the back side (back side) when it is performed.

  In addition, the operation control unit 32 is preferably in the vertical direction toward the touch panel display 12 in the example shown in FIG. 18 (a direction parallel to the flat part 12p of the touch panel display 12 and the flat part 12p). In the case where the axis C of the touch pen 14 is oriented in the vertical direction (not necessarily strictly coincident), based on the detection result by the shaft rotation detector 38, FIG. 15 and FIG. The left and right slide switching display control of the plurality of images described above is executed using. That is, in each of the first display row, the second display row, and the third display row shown in FIG. 18, a plurality of images included in each display row are left and right based on the detection result by the shaft rotation detection unit 38. Display control for switching display while sliding in the direction is executed.

  Here, the determination of the direction of the tip of the touch pen 14, that is, the direction of the axis C of the touch pen 14 with respect to the flat surface portion 12 p of the touch panel display 12 is performed based on the detection result by the fulcrum rotation detection unit 40. In addition, the pen status table 34 shown in FIG. 2 stores the pen status corresponding to the direction of the touch pen 14 at each time point for such determination. That is, in the pen status table 34, the pen status “0” corresponding to the state in which the pen tip of the touch pen 14 is brought into perpendicular contact with the plane portion 12p is displayed with respect to the plane portion 12p. The pen status “1” corresponds to a state in which the axis C of the touch pen 14 is parallel and the tip of the pen is facing rightward with respect to the plane portion 12p. Corresponding to the state in which the pen tip is vertical and the pen tip is directed in the opposite direction of the plane portion 12p, the pen status “2” has the axis C of the touch pen 14 parallel to the plane portion 12p. Further, the pen status “3” is stored corresponding to the state in which the pen tip is directed leftward with respect to the plane portion 12p. Further, the pen status stored in the pen status table 34 is set to the pen status “0” in the initial setting (at the start of control), and is updated every time detection by the fulcrum rotation detection unit 40 is performed thereafter. For example, whenever the fulcrum rotation detection unit 40 determines that a rotation of a predetermined angle (for example, 45 °) or more around the fulcrum F related to the touch pen 14 is performed, the pen status table 34 corresponds to the rotation direction. The pen status stored in is updated. By such control, the direction in which the pen tip of the touch pen 14 is directed at each time point is determined, and display control by the operation control unit 32 is executed based on the direction. Note that the touch pen 14 preferably includes a signal transmission button (not shown), and when the signal transmission button is pressed, a pen direction reset signal is transmitted from the wireless transmission unit 44 to the display device 10. The When the display device 10 receives such a pen direction reset signal, the pen status stored in the pen status table 34 in the display device 10 is reset to the initial value “0”.

  FIG. 19 is a flowchart for explaining a main part of the main control executed by the control unit 16 of the display device 10, and is repeatedly executed at a predetermined cycle.

  First, in step (hereinafter, step is omitted) S1, an application related to the control of this embodiment is started in accordance with a predetermined contact operation on the touch panel 24 or the like. Next, in S <b> 2, the pen status “0”, which is an initial value, is set in the pen status table 34. Next, in S <b> 3, it is determined whether or not an end of the application related to the control of the present embodiment has been requested in accordance with a predetermined contact operation on the touch panel 24. If the determination at S3 is affirmative, the routine is terminated after the application relating to the control of the present embodiment is terminated at S4, but when the determination at S3 is negative, S5 is performed. Then, it is determined whether or not detection information related to the rotation of the touch pen 14 detected by the shaft rotation detection unit 38 or the fulcrum rotation detection unit 40 has been received by the wireless reception unit 20. When the determination at S5 is negative, the processing after S3 is executed again, but when the determination at S5 is affirmative, the processing after S6 is executed.

  In S <b> 6, it is determined whether or not the input mode uses the touch pen 14 for input to the touch panel 24. If the determination in S6 is negative, the processing from S10 is executed, but if the determination in S6 is affirmative, in S7, the rotation information received by the wireless reception unit 20 is the axis. It is determined whether or not the information relates to rotation about the axis of the touch pen 14 detected by the rotation detection unit 38. If the determination in S7 is negative, the processes in and after S3 are executed again. If the determination in S7 is positive, in S8, the line 50 currently being drawn on the touch panel display 12 at that time. It is determined whether or not there exists. If the determination in S8 is negative, the processing from S3 onward is executed again. If the determination in S8 is positive, in S9, the touched part, that is, the contact portion of the touch pen 14 with respect to the touch panel 24 is determined. It is determined whether or not these coordinates are moving (moving) at a speed or an amount of change greater than or equal to a predetermined threshold. If the determination in S9 is negative, the processing from S3 onward is executed again. However, if the determination in S9 is positive, after the input mode processing SA shown in FIG. The process is executed again. In S <b> 10, it is determined whether or not the rotation information received by the wireless reception unit 20 is information related to rotation around the axis of the touch pen 14 detected by the shaft rotation detection unit 38. If the determination at S10 is affirmative, the slide mode shaft rotation processing SB shown in FIG. 21 is executed, and then the processing at S3 and subsequent steps is executed again. However, when the determination at S10 is negative, After the slide mode fulcrum rotation process SC shown in FIG. 22 is executed, the processes after S3 are executed again.

  FIG. 20 is a flowchart for explaining a main part of the input mode process (input mode subroutine) in the main control shown in FIG.

  First, in SA1, it is determined whether or not the tilt of the touch pen 14 with respect to the flat surface portion 12p of the touch panel display 12 detected by the tilt detection unit 42 is 10 ° or less. When the determination at SA1 is negative, the processing after SA5 is executed. When the determination at SA1 is affirmative, the rotation information received by the wireless reception unit 20 at SA2 is the touch pen. It is determined whether or not the information relates to the right rotation around the 14 axis. If the determination at SA2 is affirmative, after the input condition for increasing the thickness (line width) of the line 50 input in response to the touch operation on the touch panel 24 is changed at SA3, 19, when the determination in SA2 is negative, in SA4, an input condition for reducing the thickness (line width) of the line 50 input in response to the touch operation on the touch panel 24. After the change is made, the control is returned to the control shown in FIG.

  In SA5, it is determined whether or not the tilt of the touch pen 14 with respect to the flat surface portion 12p of the touch panel display 12 detected by the tilt detection unit 42 is 45 ° or less. If the determination at SA5 is negative, the processing after SA9 is executed, but if the determination at SA5 is affirmative, the rotation information received by the wireless reception unit 20 at SA6 is the touch pen. It is determined whether or not the information relates to the right rotation around the 14 axis. If the determination in SA6 is affirmative, in SA7, the type (line type) of the line 50 input in response to the touch operation on the touch panel 24 is changed to the next type in the predetermined list. After the input condition is changed, the control is returned to the control shown in FIG. 19, but if the determination in SA6 is negative, the line 50 input in response to the touch operation on the touch panel 24 in SA8. After the input condition is changed to change the type (line type) to the previous type in the predetermined list, the control is returned to the control shown in FIG.

  In SA9, it is determined whether or not the rotation information received by the wireless reception unit 20 is information related to the right rotation around the axis of the touch pen 14. If the determination in SA9 is affirmative, in SA10, the color (line color) of the line 50 input in response to the touch operation on the touch panel 24 is changed to the next color in a predetermined list. After the input condition is changed, the control is returned to the control shown in FIG. 19, but when the determination of SA9 is negative, the line 50 input in response to the touch operation on the touch panel 24 is determined in SA11. After the input condition for changing the color (line color) to the previous color in the predetermined list is changed, the control is returned to the control shown in FIG.

  FIG. 21 is a flowchart for explaining a main part of the slide mode axis rotation process (slide mode axis rotation subroutine) in the main control shown in FIG.

  First, in SB1, it is determined whether or not the rotation information received by the wireless reception unit 20 is information related to the right rotation around the axis of the touch pen 14. If the determination of SB1 is affirmed, the processing from SB9 is executed. If the determination of SB1 is negative, the pen status set in the pen status table 34 is “0” in SB2. Is determined. If the determination at SB2 is affirmative, after the display control for sliding the display area of the display 22 to the left by one image is executed at SB3, the control returns to the control shown in FIG. If the determination at SB2 is negative, it is determined at SB4 whether or not the pen status set in the pen status table 34 is “1”. If the determination in SB4 is affirmative, in SB5, after the display control for moving the display area of the display 22 to the back (back side) by one image is executed, the control is returned to the control shown in FIG. However, if the determination at SB4 is negative, the processing from SB6 onward is executed.

  In SB6, it is determined whether or not the pen status set in the pen status table 34 is “2”. If the determination in SB6 is affirmative, in SB7, after the display control for sliding the display area of the display 22 to the right by one image is executed, the control returns to the control shown in FIG. If the determination at SB6 is negative, display control for moving the display area of the display 22 forward by one image (front side) is executed at SB8, and then the control is returned to the control shown in FIG. . In SB9, it is determined whether or not the pen status set in the pen status table 34 is “0”. If the determination at SB9 is affirmative, display control for sliding the display area of the display 22 to the right by one image is executed at SB10, and then the control returns to the control shown in FIG. If the determination at SB9 is negative, the processes after SB11 are executed.

  In SB11, it is determined whether or not the pen status set in the pen status table 34 is "1". If the determination at SB11 is affirmative, display control for moving the display area of the display 22 forward by one image (front side) is executed at SB12, and then the control is returned to the control shown in FIG. However, if the determination in SB11 is negative, it is determined in SB13 whether or not the pen status set in the pen status table 34 is “2”. If the determination at SB13 is affirmative, at SB14, after the display control for sliding the display area of the display 22 to the left by one image is executed, the control returns to the control shown in FIG. If the determination at SB13 is negative, display control for moving the display area of the display 22 to the back (back side) by one image is executed at SB15, and then the control is returned to the control shown in FIG. .

  FIG. 22 is a flowchart for explaining a main part of the slide mode fulcrum rotation process (slide mode fulcrum rotation subroutine) in the main control shown in FIG.

  First, in SC1, it is determined whether or not the rotation information received by the wireless reception unit 20 is information related to the right rotation around the fulcrum of the touch pen 14. If the determination of SC1 is negative, the processing from SC5 is executed. If the determination of SC1 is positive, the pen status set in the pen status table 34 is “3” in SC2. Is determined. If the determination at SC2 is affirmative, after the pen status in the pen status table 34 is set to "0" at SC3, the control returns to the control shown in FIG. 19, but the determination at SC2 is denied. In SC4, the pen status in the pen status table 34 is incremented, that is, incremented by 1, and then the control is returned to the control shown in FIG. In SC5, it is determined whether or not the pen status set in the pen status table 34 is “0”. If the determination at SC5 is affirmative, after the pen status in the pen status table 34 is set to "3" at SC6, the control returns to the control shown in FIG. 19, but the determination at SC5 is denied. In SC7, after the pen status in the pen status table 34 is decremented, that is, 1 is subtracted, the control is returned to the control shown in FIG.

  FIG. 23 is a flowchart for explaining a main part of rotation detection / transmission control by the control unit 36 of the touch pen 14, and is repeatedly executed at a predetermined cycle.

  First, in SS1, it is determined whether the rotation of the touch pen 14 is detected by the shaft rotation detection unit 38 or the fulcrum rotation detection unit 40. If the determination of SS1 is negative, the processing of SS5 and subsequent steps is executed. If the determination of SS1 is positive, in SS2, the shaft rotation detection unit 38 causes the axis of the touch pen 14 to move around. It is determined whether or not rotation is detected. When the determination of SS2 is affirmed, in SS3, the rotation direction or the like as information related to the rotation of the touch pen 14 around the axis by the shaft rotation detection unit 38 is transmitted from the wireless transmission unit 44 to the display device 10. After the transmission, the processing after SS1 is executed again. However, when the determination of SS2 is negative, in SS4, the rotation of the touch pen 14 related to the rotation around the fulcrum is performed by the fulcrum rotation detection unit 40. After the information such as the rotation direction is transmitted from the wireless transmission unit 44 to the display device 10 as information, the processes after SS1 are executed again. In SS5, it is determined whether or not a change in the tilt of the touch pen 14 with respect to the flat surface portion 12p is detected by the tilt detection unit 42. If the determination at SS5 is negative, the processing after SS1 is executed again. If the determination at SS5 is affirmative, the flat surface portion 12p detected by the inclination detection unit 42 at SS6. After the change in the tilt of the touch pen 14 with respect to the is transmitted from the wireless transmission unit 44 to the display device 10, the processes after SS1 are executed again.

  In the above control, S6 is the operation of the input mode determination unit 30, SA, SB, and SC are the operation of the operation control unit 32, SS3 is the operation of the shaft rotation detection unit 38, and SS4 is the fulcrum rotation. SS5 corresponds to the operation of the detector 40, and SS5 corresponds to the operation of the inclination detector 42, respectively.

  As described above, according to the present embodiment, the shaft rotation detection unit 38 (SS3) that detects the rotation around the axis C of the touch pen 14 and the tilt detection that detects the tilt of the touch pen 14 with respect to the plane portion 12p. The determination of the unit 42 (SS5), the input mode determination unit 30 (S6) that determines whether the input mode uses the touch pen 14 for input to the touch panel 24, and the determination of the input mode determination unit 30 is affirmed. The input condition related to the display control of the image on the display 22 or the touch operation on the touch panel 24 based on at least one of the detection result by the shaft rotation detection unit 38 and the detection result by the tilt detection unit 42. Since the operation control unit 32 (SA, SB, and SC) for executing the In through the stylus 14 Torimawasa the user, a change in the input conditions of the contact operation in the display control or the touch panel 24 of the image in the display 22 can be easily performed. That is, it is possible to provide the display device 10 that can easily perform various operations via the touch pen 14 used for the touch operation on the touch panel 24.

  In addition, the operation control unit 32 performs deformation or switching of the image as display control of the image on the display 22 based on the detection result by the shaft rotation detection unit 38, or performs a touch operation on the touch panel 24. As the input condition is to change the form of lines or characters that are input according to the touch operation, the display device 10 uses the touch pen 14 circulated by the user when using the display device 10. It is possible to easily execute image display control or change of input conditions related to the touch operation on the touch panel 24 in a practical manner.

  Further, the operation control unit 32 determines the change of the line or character form as the change of the input condition based on the detection result by the shaft rotation detection unit 38 based on the detection result by the inclination detection unit 42. Therefore, according to the inclination of the touch pen 14 with respect to the plane part 12p of the touch panel 24, the change of the thickness, line type, line color, etc. of the line 50 drawn by the touch pen 14 is selectively executed. Can do.

  The operation control unit 32 selectively selects either display control of an image on the display 22 or change of an input condition related to a touch operation on the touch panel 24 based on a determination result of the input mode determination unit 30. Therefore, the operation through the touch pen 14 can be different between the input mode using the touch pen 14 for input to the touch panel 24 and the other cases. .

  Further, when the determination of the input mode determination unit 30 is negative, the operation control unit 32 detects the detection result by the shaft rotation detection unit 38, the detection result by the fulcrum rotation detection unit 40, and the tilt detection unit. Since the display control of the image on the display 22 is executed based on at least one of the detection results of 42, when the touch pen 14 is not in the input mode using the touch pen 14 for the input to the touch panel 24, the touch pen 14 Thus, the display control of the image on the display 22 can be easily executed.

  The preferred embodiments of the present invention have been described in detail with reference to the drawings. However, the present invention is not limited to these embodiments, and may be implemented in other modes.

  For example, in the above-described embodiment, the shaft rotation detection unit 38, the fulcrum rotation detection unit 40, and the inclination detection unit 42 are all provided in the touch pen 14, but the present invention is not limited thereto. The display device 10 is provided with a control unit having functions equivalent to some or all of the shaft rotation detection unit 38, the fulcrum rotation detection unit 40, and the inclination detection unit 42. May be. For example, such a configuration is made possible by embedding a plurality of markers in the touch pen 14 and scanning the markers on the display device 10 side. In such a configuration, the wireless receiver 20 and the wireless transmitter 44 are not necessarily provided.

  In the above-described embodiment, the shaft rotation detection unit 38 detects rotation around the axis of the touch pen 14 itself, but the grip portion of the touch pen 14 is coaxial with the main body shaft portion. In the configuration in which the relative rotation is possible, the rotation of the grip portion may be detected. In this aspect, the operation control unit 32 executes the control based on the rotation of the grip portion of the touch pen 14 as the rotation around the axis C of the touch pen 14.

  In the above-described embodiment, the display device includes the touch panel display 12 in which the display 22 and the touch panel 24 are integrally configured. However, the display and the touch panel are configured separately. Also in the apparatus, the present invention has a temporary effect. The present invention is also suitably applied to a configuration including a pen tablet or the like in which the touch pen and the touch panel complementarily function as an input device.

  In the above-described embodiment, the touch pen 14 is configured separately from the display device 10, and transmits and receives the detection result by wireless communication via the wireless transmission unit 44 and the wireless reception unit 20. However, the present invention is also preferably applied to a configuration in which the touch pen 14 and the display device 10 are connected by wire.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

10: display device 12p: plane part 14: touch pen 22: display 24: touch panel 30: input mode determination part 32: operation control part 38: shaft rotation detection part 42: tilt detection part 50: line C: axis F: fulcrum Pic . A to Pic. L: Image

Claims (5)

A display device comprising: a touch panel that receives an input according to a contact operation on a flat surface; an axial touch pen used for the contact operation on the touch panel; and a display that displays an image.
A rotation detector for detecting rotation around the axis of the touch pen;
An inclination detection unit for detecting an inclination of the touch pen with respect to the plane part;
An input mode determination unit that determines whether or not the input mode uses the touch pen for input to the touch panel;
When the determination of the input mode determination unit is affirmed, the display control of the image on the display or the touch operation on the touch panel is performed based on at least one of the detection result by the rotation detection unit and the detection result by the tilt detection unit. A display device comprising: an operation control unit configured to change the input condition.   The operation control unit executes deformation or switching of the image as display control of the image on the display based on a detection result by the rotation detection unit, or the contact operation as an input condition related to the touch operation on the touch panel. The display device according to claim 1, wherein the input line or character is changed in response to the input.   The operation control unit determines a change in a line or character form as a change in the input condition based on a detection result by the rotation detection unit based on a detection result by the inclination detection unit. The display device described.   The operation control unit selectively executes any one of display control of an image on the display and change of an input condition related to a touch operation on the touch panel based on a determination result of the input mode determination unit. The display device according to claim 1.   The said operation control part performs display control of the image in the said display based on the detection result by the said rotation detection part, when the determination of the said input mode determination part is denied. Display device.

Images