CN114546151A

CN114546151A - Information processing apparatus and information processing method

Info

Publication number: CN114546151A
Application number: CN202111322010.3A
Authority: CN
Inventors: 野村良太; 铃木义从
Original assignee: Lenovo Singapore Pte Ltd
Current assignee: Lenovo Singapore Pte Ltd
Priority date: 2020-11-11
Filing date: 2021-11-09
Publication date: 2022-05-27
Also published as: US11449176B2; JP2022077127A; JP7118120B2; US20220147221A1

Abstract

The invention provides an information processing apparatus and an information processing method, which can prevent the drawing formed by the undesirable pen-touch operation of a user with high precision. The information processing device includes: a drawing information acquisition unit that acquires drawing information including at least touch position information indicating a touch position at which a touch operation is performed on the touch panel and pressure information indicating a pressure applied to the touch position; a calculation unit that calculates an amount of change relating to movement of the touch position based on the acquired first drawing information and second drawing information acquired later than the first drawing information; a determination unit that determines whether or not the touch operation is an operation for which drawing should be executed, based on the calculated amount of change; and a mode control unit that sets a first mode in which drawing related to the touch operation is executed if the touch operation is determined to be an operation in which drawing is to be executed, and sets a second mode in which drawing related to the touch operation is not executed if the touch operation is determined not to be an operation in which drawing is to be executed.

Description

Information processing apparatus and information processing method

Technical Field

The invention relates to an information processing apparatus and an information processing method.

Background

Conventionally, various techniques have been proposed, which are: when a touch operation (hereinafter, also referred to as a "pen-touch operation") is performed on the touch screen by a user using a stylus pen as an operation medium, the processing performed is controlled based on a pressure applied to a touch position (hereinafter, also referred to as a "pen-touch position") of the stylus pen.

For example, the following patent document 1 discloses the following technique: the display processing of the stroke position is controlled based on the pressure applied to the stroke position by the stroke operation of the user. In this technique, for example, display or non-display of the stroke position is controlled depending on whether or not the pressure applied to the stroke position is equal to or less than a predetermined threshold value.

However, when a user uses a stylus to input characters or the like by handwriting on a touch panel, drawing may be performed by a pen-touch operation that is not intended by the user. For example, when an operation medium in contact with the touch panel slides and moves in a direction not intended by the user, drawing not intended by the user is performed. Further, if the operation medium slides, the pressure applied to the pen-touch position decreases. Therefore, as in the technique of patent document 1, by utilizing the magnitude of the pressure applied to the stroke position, for example, by controlling not to perform drawing when the pressure applied to the stroke position is equal to or less than a predetermined threshold value, it is possible to prevent drawing which is not intended by the user.

Patent document 1: japanese patent laid-open publication No. 2019-086965.

However, when it is determined only by whether or not the pressure applied to the pen-touch position is equal to or less than a predetermined threshold, not only the drawing which is not intended by the user but also the drawing which is intended by the user may be prevented. For example, in the case of a user with weak pen pressure, even if the user desires drawing, the pressure applied to the pen-touch position is equal to or less than a predetermined threshold value, and there is a possibility that drawing is not performed.

Disclosure of Invention

In view of the above-described problems, an object of the present invention is to provide an information processing apparatus and an information processing method capable of preventing, with high accuracy, drawing by a pen-touch operation which is not intended by a user.

In order to solve the above problem, an information processing apparatus according to an aspect of the present invention includes: a drawing information acquisition unit that acquires drawing information including at least touch position information indicating a touch position at which a touch operation is performed on a touch panel and pressure information indicating pressure applied to the touch position; a calculation unit that calculates an amount of change relating to movement of the touch position based on first drawing information acquired by the drawing information acquisition unit and second drawing information acquired later than the first drawing information; a determination unit configured to determine whether or not the touch operation is an operation for which drawing should be executed, based on the amount of change calculated by the calculation unit; and a mode control unit that sets a first mode in which drawing related to the touch operation is executed when the determination unit determines that the touch operation is an operation for which drawing should be executed, and sets a second mode in which drawing related to the touch operation is not executed when the determination unit determines that the touch operation is not an operation for which drawing should be executed.

An information processing method according to an aspect of the present invention includes the steps of: a drawing information acquisition unit that acquires drawing information including at least touch position information indicating a touch position at which a touch operation is performed on a touch panel and pressure information indicating a pressure applied to the touch position; a calculation unit that calculates an amount of change relating to movement of the touch position based on first drawing information acquired by the drawing information acquisition unit and second drawing information acquired later than the first drawing information; a determination unit that determines whether or not the touch operation is an operation for which drawing should be executed, based on the amount of change calculated by the calculation unit; and a mode control unit that sets a first mode in which drawing related to the touch operation is executed when the determination unit determines that the touch operation is an operation in which drawing is to be executed, and sets a second mode in which drawing related to the touch operation is not executed when the determination unit determines that the touch operation is not an operation in which drawing is to be executed.

According to the present invention, it is possible to prevent, with high accuracy, a drawing formed by a pen-touch operation which is not intended by a user.

Drawings

Fig. 1 is a diagram showing an example of a system configuration according to each embodiment.

Fig. 2 is a diagram showing an example of a drawing in a general touch panel.

Fig. 3 is a diagram showing an example of an outline of mode transition according to each embodiment.

Fig. 4 is a diagram showing an example of drawing on a touch panel according to each embodiment.

Fig. 5 is a diagram showing an example of a hardware configuration of the tablet terminal according to each embodiment.

Fig. 6 is a diagram showing an example of the hardware configuration of the stylus according to each embodiment.

Fig. 7 is a diagram schematically illustrating the first embodiment.

Fig. 8 is a diagram showing an example of a functional configuration of the tablet terminal according to the first embodiment.

Fig. 9 is a diagram showing an example of the functional configuration of the stylus pen according to the first embodiment.

Fig. 10 is a sequence diagram showing an example of the flow of the processing according to the first embodiment.

Fig. 11 is a flowchart showing an example of the flow of the stroke operation determination processing according to each embodiment.

Fig. 12 is a diagram schematically illustrating the second embodiment.

Fig. 13 is a diagram showing an example of a functional configuration of a tablet terminal according to the second embodiment.

Fig. 14 is a diagram showing an example of the functional configuration of the stylus pen according to the second embodiment.

Fig. 15 is a sequence diagram showing an example of the flow of the processing according to the second embodiment.

Fig. 16 is a flowchart showing an example of the flow of the stroke operation determination processing according to the modification.

Description of the reference numerals

1(1-1, 1-2) … tablet terminal; 2 … a frame body; 3(3-1, 3-2) … stylus; 11 … CPU; 12 … main memory; 13 … GPU; 14 … touch screen; 15 … display a picture; 16 … touch panel; 17 … chipset; 18 … BIOS memory; 19 … HDD; 20 … audio system; 21 … a communication device; 22 … EC; 23 … input devices; 24 … power supply circuit; a 25 … battery; 26 … OS; 27 … use; 31 … IC; a 32 … pressure sensor; 33 … storage means; 34 … a communication device; a 35 … battery; 110(110-1, 110-2) …; 120(120-1, 120-2) … a stroke position detecting section; 130(130-1, 130-2) …; 140(140-1, 140-2) …; 141 … depicts an information acquisition unit; 142 … calculation part; 143 … determination unit; 144 … mode control; 145 … depicts an information update unit; 146 … depicts a control; 147 … depicts a control section; 150(150-1, 150-2) … storage section; 160(160-1, 160-2) … display portion; 310(310-1, 310-2) … control; 320(320-1, 320-2) … pressure detecting part; 330(330-1, 330-2) … storage; 340(340-1, 340-2) … communication section; 311 … drawing information acquisition unit; 312 … calculation section; a 313 … determination unit; 314 … mode control part; 315 … depicts an information update unit; 1000(1000-1, 1000-2) … information handling system.

Detailed Description

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, an X axis, a Y axis, and a Z axis orthogonal to each other are shown as necessary. In each axis, a direction in which an arrow extends is referred to as a "positive direction", and a direction opposite to the positive direction is referred to as a "negative direction".

System structure (1)

First, a system configuration according to each embodiment will be described with reference to fig. 1. Fig. 1 is a diagram showing an example of a system configuration according to each embodiment. The information processing system 1000 is constituted by the tablet terminal 1 and the stylus pen 3 shown in fig. 1.

The tablet terminal 1 is an example of an electronic device capable of inputting information by a pen-touch operation. The electronic device is not limited to the tablet terminal 1 as long as it is a terminal having at least a touch panel mounted thereon. For example, the electronic Device may be implemented by a notebook pc (personal computer) equipped with a touch panel, a smart phone, a Foldable terminal (Foldable Device) capable of folding the touch panel, or the like. The terminal implementing the electronic device is not limited to the above example.

The number of touch panels provided in the electronic device is not particularly limited. For example, the electronic device has 2 displays (Dual Display), and one of the 2 displays may be a touch screen, or each of the 2 displays may be a touch screen.

As shown in fig. 1, the tablet terminal 1 includes a housing 2 and a touch panel 14. In the following description, the longitudinal direction of the touch panel 14 is referred to as the X-axis direction, the short-side direction of the touch panel 14 is referred to as the Y-axis direction, and the direction perpendicular to the surface of the touch panel 14 is referred to as the Z-axis direction.

The housing 2 is a housing provided with a touch panel 14. As shown in fig. 1, the touch panel 14 is an input/output device including a display screen 15 on which various information can be displayed and a touch panel 16 on which pen-touch operation can be detected. In the present embodiment, the pen-touch operation is performed by bringing the stylus pen 3 into contact with the surface of the touch panel 14.

The stylus 3 is an example of an operation medium used for pen-touch operation of the touch screen 14. The user inputs characters, numerals, symbols, or figures by handwriting through a pen-touch operation using the stylus 3. Information of the handwritten input is depicted on the touch screen 14. Characters such as "Hello" are drawn on the touch panel 14 shown in fig. 1. This represents an example of a drawing in the case where the user has handwritten-inputted the character "Hello" on the touch screen 14 using the stylus 3.

However, in a general touch panel, when a user performs handwriting input using an operation medium, drawing which is not intended by the user may be performed.

For example, when a user performs a pen-touch operation in which a position where a pen tip is in contact with a touch panel (hereinafter, also referred to as a "pen-touch position") is moved while the pen tip is in contact with the touch panel, the pen tip may slide, and the position of the pen tip may move in a direction that is not intended by the user. At this time, if the position of the pen tip is moved in a direction unintended by the user while the pen tip is in contact with the touch panel, drawing unintended by the user is performed. In the drawing which is not intended by the user due to the pen tip sliding, a sudden change in the moving direction of the stroke position (hereinafter, also referred to as "drawing direction") and a sudden decrease in the pressure applied to the stroke position (hereinafter, also referred to as "drawing pressure") occur simultaneously. On the other hand, when the movement of the stroke position is the movement desired by the user, the abrupt change in the drawing direction and the abrupt decrease in the drawing pressure do not occur simultaneously. Therefore, it is possible to distinguish between drawing intended by the user and drawing unintended by determining whether or not a sharp decrease in drawing pressure and a sudden change in drawing direction occur simultaneously.

Here, an example of drawing in a general touch panel will be described with reference to fig. 2. Fig. 2 is a diagram showing an example of a drawing in a general touch panel. In fig. 2, a depiction that is not intended by the user due to the sliding of the pen tip is shown. Specifically, the drawing in the section from the position P1 to the position P2, the drawing in the section from the position P3 to the position P4, and the drawing in the section from the position P5 to the position P6 are respectively drawings which are not intended by the user.

For example, in the interval from the position P1 to the position P2, the drawing direction changes greatly (abruptly) from the direction D1 to the direction D2 at the point of time when the pen tip slides at the position P1. At this time, the drawing pressure applied to the position P2 (stroke position) is greatly reduced (sharply reduced) as compared with the drawing pressure applied to the position P1.

In the section from the position P3 to the position P4, the drawing direction largely changes (abruptly changes) from the direction D3 to the direction D4 at the time when the pen tip slides at the position P3. At this time, the drawing pressure applied to the position P4 (stroke position) is greatly reduced (sharply reduced) as compared with the drawing pressure applied to the position P3.

In the section from the position P5 to the position P6, the drawing direction largely changes (abruptly changes) from the direction D5 to the direction D6 at the time when the pen tip slides at the position P5. At this time, the drawing pressure applied to the position P6 (stroke position) is greatly reduced (sharply reduced) as compared with the drawing pressure applied to the position P5.

Further, in a depiction similar to the depiction shown in FIG. 2 that the user does not wish to depict, there is a "left-right" and a "hook" that the user wishes to depict. When the user desires to "left-right", the user decreases the pen pressure in the left-right direction and moves the pen tip. Therefore, in the drawing of the desired "left-falling stroke", the drawing pressure is sharply decreased, but the drawing direction does not abruptly change at the same timing. When the user desires to "hook", the user increases the pressure and then moves the pen tip in the direction of the hook. Therefore, in the drawing of the desired "hook", the drawing direction is abruptly changed, but the drawing pressure is not sharply decreased at the same timing. In this way, in the case of drawing desired by the user such as "left-right stroke" and "hook", a sharp decrease in the drawing pressure and a sudden change in the drawing direction occur at different timings.

Therefore, it is possible to distinguish between drawing intended by the user and drawing not intended by determining whether or not at least a sharp decrease in drawing pressure and a sudden change in drawing direction occur simultaneously.

In view of the above, in the information processing system 1000 according to each embodiment of the present invention, it is determined whether or not the stroke operation is an operation (operation desired by the user) for which drawing should be performed, based on whether or not the sharp decrease in the drawing pressure and the abrupt change in the drawing direction occur simultaneously. When the stroke operation is an operation to perform drawing (an operation desired by the user), the information processing system 1000 sets a drawing mode (first mode) in which drawing of data corresponding to the stroke operation is performed. On the other hand, when the stroke operation is an operation (an operation not intended by the user) in which drawing should not be performed, the information processing system 1000 sets a non-drawing mode (second mode) in which drawing of data corresponding to the stroke operation is not performed. Thus, the information processing system 1000 can prevent, with high accuracy, drawing by a pen-touch operation which is not intended by the user.

Further, the drawing which is not intended by the user may be performed when the user carelessly brings the operation medium into contact with the touch panel. In the depiction of the contact formation which is not intended by the user, the depiction pressure may become extremely low. On the other hand, when the touch panel is in contact with the operation medium as intended by the user, the drawing pressure is detected to some extent or more at the pen-touch position. Therefore, the information processing system 1000 may control the drawing mode and the non-drawing mode by distinguishing between the operation of executing drawing and the operation of not executing drawing according to whether the drawing pressure is extremely low.

Here, an outline of mode transition according to each embodiment will be described with reference to fig. 3. Fig. 3 is a diagram showing an example of an outline of mode transition according to each embodiment. Mode transitions between the depicting mode and the non-depicting mode are shown in fig. 3. Further, the initial state is a drawing mode.

As shown in fig. 3, in the drawing mode, when a sudden change in the drawing direction and a sudden decrease in the drawing pressure occur simultaneously, the drawing mode is changed to the non-drawing mode. In the drawing mode, when the drawing pressure is extremely low, the mode is switched from the drawing mode to the non-drawing mode.

In the non-drawing mode, the drawing pressure (pen pressure) is in a low state because the user does not perform a desired pen-touch operation. When a desired stroke operation is performed from a state in which the desired stroke operation is not performed, the user intensifies the pen pressure. Therefore, the drawing pressure rises. Thus, it is possible to determine that the drawing operation (desired stroke operation) should be performed, based on the increase in the drawing pressure. Therefore, in the non-drawing mode, when the drawing pressure increases, the non-drawing mode is shifted to the drawing mode.

Here, an example of the drawing on the touch panel 14 according to each embodiment will be described with reference to fig. 4. Fig. 4 is a diagram showing an example of drawing on the touch panel 14 according to each embodiment. Fig. 4 shows an example of drawing when a pen-touch operation is performed on the touch panel 14, which is similar to the example shown in fig. 2. Further, the drawing mode is set at the position P1, the position P3, and the position P5.

In the interval from the position P1 to the position P2, a sudden change in the drawing direction and a sudden decrease in the drawing pressure occur at the position P1 due to the sliding of the pen tip. Therefore, the stroke operation in the section from the position P1 to the position P2 is determined as an operation that should not be drawn (a stroke operation that is not intended by the user), and the non-drawing mode is set while the stroke position is moving from the position P1 to the position P2. Thus, no drawing is performed in the interval from the position P1 to the position P2.

Similarly, the non-drawing mode is set in the section from the position P3 to the position P4 and in the section from the position P5 to the position P6, and therefore drawing is not performed.

< 2. hardware architecture >

The system configuration according to each embodiment has been described above. Next, the hardware configuration according to each embodiment will be described with reference to fig. 5 and 6.

< 2-1. hardware architecture of tablet terminal

The hardware configuration of the tablet terminal 1 according to each embodiment will be described with reference to fig. 5. Fig. 5 is a diagram showing an example of the hardware configuration of the tablet terminal 1 according to each embodiment. As shown in fig. 5, the tablet terminal 1 includes a CPU11(Central Processing Unit), a main memory 12, a GPU13(Graphic Processing Unit), a touch panel 14, a display screen 15, a touch panel 16, a chipset 17, a BIOS memory 18(Basic Input Output System), an HDD19(Hard Disk Drive), an audio System 20, a communication device 21, an EC22(Embedded Controller), an Input device 23, a power supply circuit 24, and a battery 25.

The CPU11 executes various arithmetic processes by program control, and controls the tablet terminal 1 as a whole.

The main memory 12 is a writable memory used as a read area for the execution program of the CPU11 or a work area for writing the processing data of the execution program. The main Memory 12 is composed of, for example, a plurality of DRAM (Dynamic Random Access Memory) chips. The execution program includes: an OS (Operating System), various drivers for hardware operation of peripheral devices, various services/utilities, and applications.

The GPU13 performs image processing and generates display data based on the control of the CPU 11. The GPU13 is connected to the display screen 15, and outputs the generated display data to the display screen 15.

The touch panel 14 includes a display screen 15 and a touch panel 16. The touch panel 14 displays various information corresponding to the display data converted into the video signal on the display screen 15, and detects a touch by an operation medium such as a finger or a stylus of a user or an approach of the operation medium by the touch panel 16, thereby accepting an operation input by the operation medium.

The display screen 15 is a display device such as an OLED display (organic EL display), for example. The display screen 15 may be configured to be foldable (foldable).

The touch panel 16 is disposed so as to overlap the display surface of the display screen 15. The touch panel 16 may be configured integrally with the display screen 15, and may be configured to be foldable (foldable) in the same manner as the display screen 15.

The touch panel 16 detects an operation position. The operation position is specifically a pen-touch position where pen-touch operation is performed on the touch panel 14. The stroke position is shown by coordinates, for example. The range of coordinates of the stroke position is determined according to the size of the touch screen 14. Information indicating the position of the pen stroke on the touch panel 16 as the coordinates is hereinafter also referred to as "pen stroke position information".

The chipset 17 includes controllers such as a USB (Universal Serial Bus), a Serial ATA (AT Attachment), an SPI (Serial Peripheral Interface) Bus, a PCI (Peripheral Component Interconnect) Bus, a PCI-Express Bus, and an LPC (Low Pin Count) Bus, and connects a plurality of devices. In fig. 5, as an example of the plurality of devices, the CPU11, the BIOS memory 18, the HDD19, the audio system 20, the communication device 21, and the EC22 are connected to the chipset 17.

The BIOS Memory 18 is constituted of an Electrically rewritable nonvolatile Memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash ROM (Read Only Memory). The BIOS memory 18 stores system firmware and the like for controlling the BIOS and the EC22 and the like. The system firmware is firmware executed by CPU11, unlike EC firmware executed by EC 22.

The HDD19 (one example of a nonvolatile storage device) stores an OS, various drives, various services/utilities, application programs, and various data.

The audio system 20 records, plays, and outputs sound data. The audio system 20 is connected with, for example, a microphone, a speaker, and the like.

The communication device 21 is communicably connected to other devices via a wireless or wired communication network, and performs transmission and reception of various data. For example, the communication device 21 includes a wired LAN interface such as ethernet (registered trademark), a wireless LAN interface such as Wi-Fi (registered trademark), and the like. The communication device 21 may include a USB interface or a Bluetooth (registered trademark) interface.

The EC22(embedded controller) is a single-Chip Microcomputer (One-Chip Microcomputer) that monitors and controls various devices (peripheral devices, sensors, and the like) regardless of the system state of the tablet terminal 1. The EC22 includes a CPU, ROM, and RAM (Random Access memory), not shown.

The EC22 operates independently of the CPU11, and mainly functions as a control unit that manages the operating environment inside the tablet terminal 1. EC22 reads a control program (EC firmware) stored in ROM in advance, and executes processing instructed by various commands described in the read control program to realize various functions.

The EC22 includes a plurality of channels of a/D input terminals, D/a output terminals, a timer, and digital input/output terminals. For example, the input device 23 and the power supply circuit 24 are connected to the EC22 via these input/output terminals, and the EC22 controls these operations.

The input device 23 is an input device that performs input, for example, to a power switch and a function switch.

The power supply circuit 24 includes, for example, a DC/DC converter, a charging/discharging unit, a battery unit, an AC/DC adapter, and the like, and converts a direct-current voltage supplied from an external power supply or the battery unit into a plurality of voltages necessary for operating the tablet terminal 1. Further, the power supply circuit 24 supplies power to each unit of the tablet terminal 1 based on control from the EC 22.

The battery 25 is, for example, a lithium battery. When power is supplied from an external power supply to the tablet terminal 1, the battery 25 is charged via the power supply circuit 24. When no electric power is supplied from the external power supply to the tablet terminal 1, the battery 25 outputs the electric power charged via the power supply circuit 24 as the operation electric power of the tablet terminal 1.

< 2-2. hardware architecture of stylus

The hardware configuration of the stylus 3 according to each embodiment will be described with reference to fig. 6. Fig. 6 is a diagram showing an example of the hardware configuration of the stylus 3 according to each embodiment. As shown in fig. 6, the stylus 3 includes an IC31(Integrated Circuit), a pressure sensor 32, a storage device 33, a communication device 34, and a battery 35.

The IC31 executes various arithmetic processes under program control, and controls the entire stylus 3.

The pressure sensor 32 is a sensor device that detects pressure. The information indicating the pressure detected by the pressure sensor 32 is hereinafter also referred to as "pressure information".

The storage device 33 stores various information. The storage device 33 is constituted by ROM, RAM, EEPROM, or the like, for example.

The communication device 34 is communicably connected to other devices via a wireless communication network, and performs transmission and reception of various data. For example, the communication device 34 communicates with the tablet terminal 1 by communication using a protocol unique to the stylus pen 3. The protocol is for example Wacom AES (Active Electro Static). The stylus pen 3 may communicate with the tablet terminal 1 by short-range wireless communication such as Bluetooth (registered trademark).

The battery 35 is, for example, a lithium ion battery or an alkali ion battery. Power is supplied from the battery 35 to the IC31, and the IC31 adjusts the voltage level and supplies the voltage to the pressure sensor 32, the storage device 33, and the communication device 34.

< 3 > first embodiment

The hardware configuration according to each embodiment is explained above. Next, a first embodiment will be described with reference to fig. 7 to 11. In the first embodiment, an example in which the information processing apparatus is the tablet terminal 1 will be described as an example.

< 3-1. overview of the first embodiment

An outline of the first embodiment will be described with reference to fig. 7. Fig. 7 is a diagram schematically illustrating the first embodiment. As shown in fig. 7, the information processing system 1000-1 according to the first embodiment is configured by a tablet terminal 1-1 and a stylus pen 3-1.

In the first embodiment, processing for controlling a drawing formed so as not to perform a pen-touch operation not intended by the user is installed in the tablet terminal 1-1. Hereinafter, a drawing formed by a pen-touch operation which is not intended by the user is also referred to as "disturbed drawing". The process for controlling not to execute the drawing of the interference is hereinafter also referred to as "interference removal process".

For example, the interference elimination process is installed in the application 27 executed on the OS26 of the tablet terminal 1-1. The application 27 executes the interference elimination processing based on the drawing information input from the OS. The application 27 controls setting of the drawing mode or the non-drawing mode according to the result of the interference elimination processing. The application 27 outputs a signal indicating that drawing is performed (hereinafter, also referred to as "drawing signal") to the display screen 15 when the drawing mode is set, and outputs a signal indicating that drawing is not performed (hereinafter, also referred to as "non-drawing signal") to the display screen 15 when the non-drawing mode is set.

The drawing information is information related to drawing, including at least pressure information and stroke position information. In the first embodiment, the pressure information is acquired on the stylus 3-1 side and transmitted to the tablet terminal 1-1. The position information of the pen touch is acquired at the side of the tablet terminal 1-1.

The interference elimination process is installed in the application 27, and the intensity of the interference elimination can be set according to the type of the application, the type of the pen used in the application 27 (for example, a pencil, a pen, a ball point pen, or the like), and the like. In addition, the intensity of interference removal can be changed in the interaction.

< 3-2. functional Structure of Flat Panel terminal

A functional configuration of the tablet terminal 1-1 according to the first embodiment will be described with reference to fig. 8. Fig. 8 is a diagram showing an example of the functional configuration of the tablet terminal 1-1 according to the first embodiment. As shown in fig. 8, the tablet terminal 1-1 includes an input unit 110-1, a stroke position detection unit 120-1, a communication unit 130-1, a control unit 140-1, a storage unit 150-1, and a display unit 160-1.

(1) Input unit 110-1

The input unit 110-1 has a function of accepting input of various information. This function is realized by, for example, the touch panel 14 and the input device 23 described with reference to fig. 5. The input unit 110-1 accepts input of information input by the user to the touch panel 14.

(2) Pen contact position detecting section 120-1

The stroke position detecting section 120-1 has a function of detecting the position of a stroke in the touch screen 14. This function is realized by the touch panel 16 described with reference to fig. 5, for example. The stroke position detecting unit 120-1 detects, for example, a stroke position when the user performs a stroke operation on the touch panel 14 using the operation medium. The stroke position detecting unit 120-1 outputs the detected stroke position as stroke position information. The stroke position detection unit 120-1 also acquires a time stamp indicating the date and time at which the stroke position was detected. The stroke position detection unit 120-1 outputs the acquired time stamp as time stamp information.

(3) Communication unit 130-1

The communication unit 130-1 has a function of transmitting and receiving various information. This function is realized by the communication device 21 described with reference to fig. 5, for example. The communication unit 130-1 receives, for example, the pressure information transmitted from the stylus 3-1.

(4) Control section 140-1

The control unit 140-1 has a function of controlling the overall operation of the tablet terminal 1-1. This function is realized by, for example, the CPU11 and the chipset 17 described with reference to fig. 5. As shown in fig. 8, the control unit 140-1 includes a drawing information acquisition unit 141, a calculation unit 142, a determination unit 143, a mode control unit 144, a drawing information update unit 145, and a drawing control unit 146.

(4-1) drawing information acquiring unit 141

The drawing information acquiring unit 141 has a function of acquiring drawing information. For example, when a pen-touch operation on the touch panel 14 is detected, the drawing information acquiring unit 141 acquires pressure information, pen-touch position information, and time stamp information corresponding to the pen-touch operation as drawing information. The information included in the drawing information is not particularly limited as long as it includes at least pressure information and pen stroke position information.

Specifically, the drawing information acquisition unit 141 acquires the pressure information received by the communication unit 130-1 from the stylus 3-1. The drawing information acquiring unit 141 acquires the stroke position information and the time stamp information output from the stroke position detecting unit 120-1. The time stamp indicates the date and time when the stroke operation corresponding to the pressure information and the stroke position information acquired by the drawing information acquiring unit 141 is detected.

The drawing information acquiring unit 141 outputs drawing information including various information acquired from the communication unit 130-1 and the stroke position detecting unit 120-1 when the stroke operation is detected, to the calculating unit 142.

When the pen-touch operation on the touch panel 14 is detected, the drawing information acquiring unit 141 acquires the drawing information stored in the storage unit 150-1. The drawing information output from the drawing information acquiring unit 141 to the calculating unit 142 is acquired after comparing the drawing information stored in the storage unit 150-1. That is, the drawing information output from the drawing information acquiring unit 141 to the calculating unit 142 is first drawing information, and the drawing information stored in the storage unit 150-1 is second drawing information. Specifically, the second drawing information is the drawing information acquired before one of the first drawing information and stored in the storage unit 150-1. Therefore, in the following description, the drawing information output from the drawing information acquisition unit 141 to the calculation unit 142 is referred to as "current drawing information", and the drawing information acquired from the storage unit 150 by the drawing information acquisition unit 141 is referred to as "previous drawing information". That is, when the pen-touch operation on the touch panel 14 is detected, the drawing information acquiring unit 141 also acquires the previous drawing information from the storage unit 150-1, and outputs the previous drawing information to the calculating unit 142 together with the current drawing information.

When drawing information is acquired for the first time, the storage unit 150-1 does not store the previous drawing information. Therefore, the drawing information acquiring unit 141 outputs only the current drawing information when the drawing information is acquired for the first time.

(4-2) calculation section 142

The calculation unit 142 has a function of calculating the amount of change in the movement of the stroke position. For example, the calculation unit 142 calculates the amount of change in the movement of the stroke position based on the previous drawing information acquired by the drawing information acquisition unit 141 and the current drawing information.

As an example, the calculation unit 142 calculates the amount of change in the drawing pressure and the amount of change in the drawing direction as the amount of change associated with the movement of the pen position.

Specifically, the calculation unit 142 calculates the difference between the drawing pressure indicated by the pressure information included in the current drawing information and the drawing pressure indicated by the pressure information included in the previous drawing information as the amount of change in the drawing pressure. The calculation unit 142 calculates an angle between the coordinates of the stroke position indicated by the stroke position information included in the current drawing information and the coordinates of the stroke position information indicated by the stroke position information included in the previous drawing information as the amount of change in the drawing direction.

After the calculation, the calculation unit 142 outputs the calculated amount of change in the drawing pressure and the amount of change in the drawing direction to the determination unit 143.

(4-3) determination unit 143

The determination unit 143 has a function of performing a determination process (hereinafter, also referred to as a "stroke operation determination process") of whether or not a stroke operation is an operation to be performed for drawing. For example, the determination unit 143 determines whether or not the stroke operation is an operation to perform drawing, based on the amount of change calculated by the calculation unit 142. The variation input from the calculation unit 142 includes at least the variation of the drawing pressure and the variation of the drawing direction.

Specifically, it is assumed that the amount of change in the drawing pressure (the amount of decrease in the drawing pressure) is equal to or greater than a predetermined threshold (a first threshold, for example, 80%) and the drawing pressure decreases sharply, and the amount of change in the drawing direction is equal to or greater than a predetermined threshold (a second threshold, for example, 20 degrees) and the drawing direction changes abruptly. In this case, it is known that a sharp decrease in the drawing pressure and a sudden change in the drawing direction occur simultaneously. Therefore, the determination unit 143 can determine that the stroke operation, which is not intended by the user, is not an operation to perform drawing.

It is assumed that the drawing pressure indicated by the pressure information included in the current drawing information acquired by the drawing information acquiring unit 141 is a predetermined threshold (a fourth threshold, for example, 100 gf/cm)²) The following, and the drawing pressure is extremely low. In this case, since the drawing pressure is extremely low, it is clear that the user is not applying the pen pressure. Therefore, the determination unit 143 can determine that the stroke operation, which is not intended by the user, is not an operation to perform drawing.

Further, when determining whether or not the stroke operation is an operation to perform drawing (first determination), the determination unit 143 determines that the stroke operation is not an operation to perform drawing when determining earlier than the determination (second determination). In the following, the first determination time will be referred to as "this determination time", and the second determination time will be referred to as "previous determination time". It is assumed that the drawing pressure at this determination is not increased than that at the previous determination. In this case, since the drawing pressure does not rise, it is clear that the user is not applying the pen pressure. Therefore, the determination unit 143 can determine that the user has not performed the intended stroke operation and can continue the unintended stroke operation, and therefore the stroke operation is not an operation to perform drawing.

It is assumed that the drawing pressure at this determination is higher than that at the previous determination. In this case, since the drawing pressure increases, it is known that the user applied the pen pressure. Therefore, the determination unit 143 can determine that the stroke operation desired by the user is an operation to perform drawing because the stroke operation is performed.

After the determination, the determination unit 143 outputs the result of the determination to the mode control unit 144.

(4-4) mode control section 144

The mode control unit 144 has a function of controlling a mode related to drawing. For example, the mode control unit 144 sets the drawing mode or the non-drawing mode based on the result of the determination performed by the determination unit 143. Specifically, the mode control unit 144 sets the drawing mode when the determination unit 143 determines that the stroke operation is an operation to perform drawing, and sets the non-drawing mode when the determination unit determines that the stroke operation is not an operation to perform drawing.

The mode control unit 144 outputs information indicating the set mode as mode information. The mode information is shown by a flag, for example. For example, when the pen-touch operation is an operation to perform drawing, the mode control unit 144 sets information (for example, 1) indicating that the flag is on as the mode information. On the other hand, when the stroke operation is not an operation to perform drawing, the mode control unit 144 sets information (for example, 0) indicating that the flag is off as the mode information. In the mode information, information indicating that the flag is off when the pen-touch operation is an operation to perform drawing and information indicating that the flag is on when the pen-touch operation is not an operation to perform drawing may be set.

The mode control unit 144 may set the drawing mode or the non-drawing mode based on the mode set last time and the result of the determination by the determination unit 143. The mode set last time can be confirmed by referring to the mode information associated with the last drawing information stored in the storage unit 150-1.

For example, when the mode set last time is the drawing mode and the stroke operation is not an operation to perform drawing, the mode control unit 144 sets the non-drawing mode. When the previously set mode is the drawing mode and the stroke operation is an operation to perform drawing, the mode control unit 144 sets the drawing mode as it is.

Further, when the mode set last time is the non-drawing mode and the stroke operation is an operation to perform drawing, the mode control unit 144 sets the drawing mode. When the mode set last time is the non-drawing mode and the stroke operation is not an operation to perform drawing, the mode control unit 144 sets the non-drawing mode as it is.

The stroke operation determination process by the determination unit 143 and the mode control by the mode control unit 144 are performed based on only the previous drawing information and the current drawing information. Therefore, the held data in the storage unit 150-1 can be minimized, and the response of the processing is also fast.

(4-5) drawing information update unit 145

The drawing information updating unit 145 has a function of updating drawing information. For example, the drawing information updating unit 145 updates the previous drawing information stored in the storage unit 150-1 with the current drawing information. At the time of updating, the drawing information updating unit 145 stores information associating the amount of change in the drawing pressure, the amount of change in the drawing direction, and the pattern information with the drawing information of this time in the storage unit 150-1. The amount of change in the drawing pressure and the amount of change in the drawing direction associated with the current drawing information are calculated by the calculation unit 142 based on the current drawing information. The pattern information associated with the current drawing information is output from the pattern control unit 144 based on the current drawing information.

(4-6) drawing control section 146

The drawing control unit 146 has a function of controlling the drawing on the display unit 160-1. For example, the drawing control unit 146 controls the drawing on the display unit 160-1 in accordance with the mode set by the mode control unit 144. When the drawing mode is set by the mode control unit 144, the drawing control unit 146 outputs a drawing signal to the display unit 160-1. On the other hand, when the mode control unit 144 sets the non-drawing mode, the drawing control unit 146 outputs a non-drawing signal to the display unit 160-1.

(5) Storage unit 150-1

The storage unit 150-1 has a function of storing various information. The storage unit 150-1 is realized by, for example, the main memory 12, the BIOS memory 18, the HDD19, or the ROM or the RAM included in the EC22, which is described with reference to fig. 5. For example, the storage unit 150-1 stores the drawing information updated by the drawing information updating unit 145. The storage unit 150-1 stores various kinds of firmware such as OS, software such as various applications, system firmware, and EC firmware.

(6) Display part 160-1

The display unit 160-1 has a function of displaying various information. The function of the display unit 160-1 is realized by a display provided as hardware in the information processing apparatus, for example. The display is, for example, the touch panel 14 described with reference to fig. 5.

The display unit 160-1 performs drawing based on a signal input from the drawing control unit 146. For example, when a drawing signal is input from the drawing control unit 146, the display unit 160-1 performs drawing related to a pen-touch operation. On the other hand, when the non-drawing signal is input from the drawing control unit 146, the display unit 160-1 does not perform drawing related to the pen-touch operation.

< 3-3. functional Structure of stylus

The functional configuration of the stylus 3-1 according to the first embodiment will be described with reference to fig. 9. Fig. 9 is a diagram showing an example of the functional configuration of the stylus 3-1 according to the first embodiment. As shown in FIG. 9, the stylus 3-1 includes a control unit 310-1, a pressure detection unit 320-1, a storage unit 330-1, and a communication unit 340-1.

(1) Control section 310-1

The control unit 310-1 has a function of controlling the entire operation of the stylus 3-1. This function is realized by, for example, the IC31 described with reference to fig. 6.

(2) Pressure detection unit 320-1

The pressure detection unit 320-1 has a function of detecting a drawing pressure by a pen-touch operation. This function is realized by the pressure sensor 32 described with reference to fig. 6, for example.

For example, when the stylus 3-1 is pressed against the touch panel 14 by a pen-touch operation, the pressure detection section 320-1 detects a pressure (pen pressure) applied to the pen tip as a drawing pressure. The pressure detection unit 320-1 outputs pressure information indicating the detected drawing pressure.

(3) Storage section 330-1

The storage section 330-1 has a function of storing various kinds of information. This function is realized by the storage device 33 described with reference to fig. 6, for example.

(4) Communication section 340-1

The communication unit 340-1 has a function of transmitting and receiving various information. This function is realized by the communication device 34 described with reference to fig. 6, for example.

For example, the communication part 340-1 transmits a signal containing information related to the stylus pen 3-1 to the tablet terminal 1-1. Specifically, the communication unit 340-1 transmits a signal including the pressure information output by the pressure detection unit 320-1 to the tablet terminal 1-1.

< 3-4. flow of processing

The flow of processing according to the first embodiment will be described with reference to fig. 10 and 11. Fig. 10 is a sequence diagram showing an example of the flow of the processing according to the first embodiment.

As shown in fig. 10, first, the stylus pen 3-1 is brought into contact with the touch screen 14 of the tablet terminal 1-1 by the operation of the user (step S100).

When the stylus 3-1 is brought into contact with the touch panel 14, the pressure detection unit 320-1 of the stylus 3-1 detects the drawing pressure (step S101). The pressure detection unit 320-1 outputs pressure information indicating the detected drawing pressure. The communication unit 340-1 of the stylus 3-1 transmits the pressure information output from the pressure detection unit 320-1 to the tablet terminal 1-1 (step S102).

When the stylus 3-1 comes into contact with the touch panel 14, the stroke position detection unit 120-1 of the tablet terminal 1-1 detects the stroke position and acquires the time stamp (step S103). The stroke position detecting unit 120-1 outputs stroke position information indicating the detected stroke position and time stamp information indicating the acquired time stamp.

The drawing information acquisition unit 141 of the tablet terminal 1-1 acquires the current drawing information and the previous drawing information (step S104). For example, the drawing information acquisition unit 141 acquires, as the current drawing information, the pressure information transmitted from the stylus 3-1 in step S102, and the stroke position information and the time stamp information output by the stroke position detection unit 120-1 in step S103. Further, the drawing information acquisition unit 141 acquires the drawing information stored in the storage unit 150-1 of the tablet terminal 1-1 as the previous drawing information.

The calculation unit 142 of the tablet terminal 1-1 calculates the amount of change based on the drawing information of this time and the drawing information of the last time acquired by the drawing information acquisition unit 141 in step S104 (step S105). Specifically, the calculation unit 142 calculates the difference between the pressure information included in the current drawing information and the pressure information included in the previous drawing information as the amount of change in the drawing pressure. The calculation unit 142 calculates an angle between the coordinates of the stroke position indicated by the stroke position information included in the current drawing information and the coordinates of the stroke position indicated by the stroke position information included in the previous drawing information as the amount of change in the drawing direction.

The determination unit 143 of the tablet terminal 1-1 performs the stroke operation determination process based on the amount of change calculated by the calculation unit 142 (step S106). The flow of the stroke operation determination process will be described later.

The mode control unit 144 of the tablet terminal 1-1 controls the mode related to drawing based on the determination result of the determination unit 143 (step S107). Specifically, when the determination unit 143 determines in step S106 that the stroke operation is an operation for executing drawing, the mode control unit 144 sets the drawing mode. On the other hand, when the determination unit 143 determines in step S106 that the stroke operation is not an operation to perform drawing, the mode control unit 144 sets the non-drawing mode. After the mode is set, the mode control unit 144 outputs mode information indicating the set mode.

The drawing information updating unit 145 of the tablet terminal 1-1 updates the drawing information stored in the storage unit 150-1 (step S108). Specifically, the drawing information updating unit 145 updates the drawing information stored in the storage unit 150-1 with information that associates the amount of change in the drawing pressure and the amount of change in the drawing direction calculated by the calculation unit 142 in step S105 and the pattern information output by the pattern control unit 144 in step S107 with the drawing information of this time.

The drawing control unit 146 of the tablet terminal 1-1 controls drawing on the display unit 160-1 of the tablet terminal 1-1 in accordance with the mode set by the mode control unit 144 (step S109). Specifically, when the drawing mode is set by the mode control unit 144 in step S107, the drawing control unit 146 outputs a drawing signal to the display unit 160-1. On the other hand, when the non-drawing mode is set by the mode control unit 144 in step S107, the drawing control unit 146 outputs a non-drawing signal to the display unit 160-1.

Here, the flow of the stroke operation determination process will be described with reference to fig. 11. Fig. 11 is a flowchart showing an example of the flow of the stroke operation determination processing according to each embodiment.

As shown in fig. 11, the determination unit 143 first determines whether or not the drawing pressure detected this time is equal to or higher than a predetermined threshold (fourth threshold) based on the pressure information included in the drawing information this time (step S200). When the detected drawing pressure is equal to or higher than the predetermined threshold value (step S200/yes), the determination unit 143 advances the process to step S202. On the other hand, when the drawing pressure detected this time is not equal to or higher than the predetermined threshold (no in step S200), the determination unit 143 determines that the stroke operation is not an operation to perform drawing (step S201), and ends the stroke operation determination process.

The determination unit 143 determines whether or not the drawing pressure detected this time is higher than the drawing pressure detected last time (step S202). When the drawing pressure increases (yes in step S202), the determination unit 143 determines that the stroke operation is an operation to perform drawing (step S203), and ends the stroke operation determination process. On the other hand, when the drawing pressure does not increase (step S202/no), the determination unit 143 advances the process to step S204.

The determination unit 143 determines whether or not the amount of decrease in the drawing pressure is equal to or greater than a predetermined threshold (first threshold) (step S204). When the amount of decrease in the drawing pressure is equal to or greater than the predetermined threshold value (step S204/yes), the determination unit 143 advances the process to step S205. On the other hand, when the decrease amount of the drawing pressure is not equal to or greater than the predetermined threshold (step S204/no), the determination unit 143 advances the process to step S206.

The determination unit 143 determines whether or not the amount of change in the drawing direction is equal to or greater than a predetermined threshold (second threshold) (step S205). When the amount of change in the drawing direction is equal to or greater than the predetermined threshold value (yes at step S205), the determination unit 143 determines that the stroke operation is not an operation to be performed (step S201), and ends the stroke operation determination process. On the other hand, when the amount of change in the drawing direction is not equal to or greater than the predetermined threshold (step S205/no), the determination unit 143 advances the process to step S206.

The determination unit 143 determines whether or not drawing corresponding to the stroke operation detected last time is performed (step S206). When the drawing has been executed last time (yes at step S206), the determination unit 143 determines that the stroke operation is an operation to execute drawing (step S203), and ends the stroke operation determination process. On the other hand, when drawing has not been executed last time (step S206/no), the determination unit 143 determines that the stroke operation is not an operation to execute drawing (step S201), and ends the stroke operation determination process.

As described above, the tablet terminal 1-1 according to the first embodiment includes the drawing information acquisition unit 141, the calculation unit 142, the determination unit 143, and the mode control unit 144.

The drawing information acquiring unit 141 acquires drawing information including at least pen stroke position information indicating a pen stroke position at which a pen stroke operation is performed on the touch panel 14 and pressure information indicating a drawing pressure applied to the pen stroke position.

The calculation unit 142 calculates the amount of change in the movement of the stroke position based on the previous drawing information acquired by the drawing information acquisition unit 141 and the current drawing information.

The determination unit 143 determines whether or not the stroke operation is an operation to perform drawing, based on the amount of change calculated by the calculation unit 142.

The mode control unit 144 sets a drawing mode in which drawing is performed in association with the pen-touch operation when the pen-touch operation is an operation to perform drawing, and sets a non-drawing mode in which drawing is not performed in association with the pen-touch operation when the pen-touch operation is not an operation to perform drawing.

According to the above configuration, in the tablet terminal 1-1 according to the first embodiment, it is possible to determine whether or not the stroke operation is an operation to perform drawing based on the amount of change calculated from the stroke position information and the pressure information, and set either the drawing mode or the non-drawing mode.

Thus, the tablet terminal 1-1 can determine with higher accuracy whether or not the pen-touch operation is an operation for which drawing should be performed, as compared with the case where only drawing pressure is used. Further, the tablet terminal 1-1 can also control switching between the drawing mode and the non-drawing mode with high accuracy by using a more accurate determination result.

Therefore, the tablet terminal 1-1 according to the first embodiment can prevent, with high accuracy, a drawing (a drawing of disturbance) formed by a pen-touch operation that is not intended by the user.

In the tablet terminal 1-1 according to the first embodiment, by preventing the drawing of the disturbance, the disturbance is removed with high accuracy from the drawing by the handwriting input using the stylus pen 3-1. In particular, the accuracy of removing the disturbance caused by the drawing on the screen which is likely to slide is improved. Therefore, the drawing result is more preferable. In addition, improvement of recognition accuracy in handwriting recognition can also be expected.

In the first embodiment, the example in which the operation medium is the stylus pen 3-1 has been described, but the operation medium is not limited to the example. For example, the operation medium may be a human finger. In this case, the tablet terminal 1-1 also has a configuration for detecting the drawing pressure applied to the pen-touch position on the touch screen 14, in the configuration described with reference to fig. 5 and 8.

In the first embodiment, the description has been given of an example in which the drawing control unit 146 outputs the drawing signal to the display unit 160-1 when the drawing mode is set, and outputs the non-drawing signal to the display unit 160-1 when the non-drawing mode is set, but the present invention is not limited to the above example. For example, the drawing control unit 146 may output a drawing signal to the display unit 160-1 when the drawing mode is set, and may not output a signal to the display unit 160-1 when the non-drawing mode is set.

< 4 > second embodiment

The first embodiment has been described above. Next, a second embodiment will be described with reference to fig. 12 to 15. In the second embodiment, an example in which the information processing device is the stylus pen 3 will be described as an example. The description overlapping with the first embodiment is omitted.

< 4-1. overview of second embodiment

An outline of the second embodiment will be described with reference to fig. 12. Fig. 12 is a diagram schematically illustrating the second embodiment. As shown in fig. 12, the information processing system 1000-2 according to the second embodiment is composed of a tablet terminal 1-2 and a stylus pen 3-2.

In the second embodiment, the interference elimination process is mounted on the stylus 3-2.

For example, the interference cancellation process is mounted on the IC31 of stylus 3-2. The IC31 executes the interference removal processing based on the drawing information. The IC31 controls setting of the drawing mode or the non-drawing mode based on the result of the interference cancellation processing. The IC31 transmits a drawing signal to the tablet terminal 1-2 when the drawing mode is set, and transmits a non-drawing signal to the tablet terminal 1-2 when the non-drawing mode is set.

In the case where the tablet terminal 1-2 receives the drawing signal from the stylus pen 3-2, the application 27 executed on the OS26 outputs the drawing signal to the display screen 15. On the other hand, in the case where the tablet terminal 1-2 receives the non-drawing signal from the stylus pen 3-2, the application 27 outputs the non-drawing signal to the display screen 15.

Further, in the second embodiment, the pressure information is acquired on the stylus 3-2 side. The stroke position information is acquired at the tablet terminal 1-2 side and transmitted to the stylus 3-2.

The interference elimination process is mounted on the IC31, and therefore, the drawing of interference can be prevented regardless of the type of application on the tablet terminal 1-2 side.

< 4-2. functional Structure of Flat Panel terminal

A functional configuration of the tablet terminal 1-2 according to the second embodiment will be described with reference to fig. 13. Fig. 13 is a diagram showing an example of a functional configuration of the tablet terminal 1-2 according to the second embodiment. As shown in fig. 13, the tablet terminal 1-2 includes an input unit 110-2, a stroke position detection unit 120-2, a communication unit 130-2, a control unit 140-2, a storage unit 150-2, and a display unit 160-2.

(1) Input unit 110-2

The function of the input unit 110-2 is the same as that of the input unit 110-1 described with reference to fig. 8 in the first embodiment, and therefore, redundant description is omitted.

(2) Pen contact position detecting section 120-2

The function of the stroke position detecting unit 120-2 is the same as that of the stroke position detecting unit 120-1 described with reference to fig. 8 in the first embodiment, and therefore, redundant description is omitted.

(3) Communication unit 130-2

The communication unit 130-2 has a function of transmitting and receiving various information. This function is realized by the communication device 21 described with reference to fig. 5, for example. The communication unit 130-2 transmits the stroke position information output from the stroke position detection unit 120-2 to the stylus 3-2, for example. Further, the communication unit 130-2 receives a signal (for example, a drawing signal or a non-drawing signal) transmitted from the stylus 3-2.

(4) Control section 140-2

The control unit 140-2 has a function of controlling the overall operation of the tablet terminal 1-2. This function is realized by, for example, the CPU11 and the chipset 17 described with reference to fig. 5. As shown in fig. 13, the control unit 140-2 includes a drawing control unit 147.

(4-1) drawing control section 147

The drawing control unit 147 has a function of controlling the drawing on the display unit 160-2. For example, the drawing control unit 147 controls the drawing on the display unit 160-2 in accordance with a signal received from the stylus 3-2 by the communication unit 130-2. When the communication unit 130-2 receives the drawing signal, the drawing control unit 147 outputs the drawing signal to the display unit 160-2. On the other hand, when the communication unit 130-2 receives the non-drawing signal, the drawing control unit 147 outputs the non-drawing signal to the display unit 160-2.

(5) Storage unit 150-2

The function of the storage unit 150-2 is the same as that of the storage unit 150-1 described with reference to fig. 8 in the first embodiment, and therefore, redundant description is omitted. In the second embodiment, the storage unit 150-2 does not store drawing information.

(6) Display part 160-2

The function of the display unit 160-2 is the same as that of the display unit 160-1 described with reference to fig. 8 in the first embodiment, and therefore, redundant description is omitted.

< 4-3. functional Structure of stylus

The functional configuration of the stylus 3-2 according to the second embodiment will be described with reference to fig. 14. Fig. 14 is a diagram showing an example of the functional configuration of the stylus 3-2 according to the second embodiment. As shown in FIG. 14, the stylus 3-2 includes a control unit 310-2, a pressure detection unit 320-2, a storage unit 330-2, and a communication unit 340-2.

(1) Control unit 310-2

The control unit 310-2 has a function of controlling the entire operation of the stylus 3-2. This function is realized by, for example, the IC31 described with reference to fig. 6. As shown in fig. 14, the control unit 310-2 includes a drawing information acquisition unit 311, a calculation unit 312, a determination unit 313, a mode control unit 314, and a drawing information update unit 315.

(1-1) drawing information acquisition unit 311

The function of the drawing information acquiring unit 311 is the same as that of the drawing information acquiring unit 141 described with reference to fig. 8 in the first embodiment described above, and therefore, redundant description is omitted. Further, the drawing information acquisition section 311 acquires the pressure information output by the pressure detection section 320-2, the stroke position information and the time stamp information received by the communication section 340-2 from the tablet terminal 1-2 as the drawing information of this time. The drawing information acquiring unit 311 acquires the drawing information stored in the storage unit 330-2 as the previous drawing information.

(1-2) calculation section 312

The function of the calculation unit 312 is the same as that of the calculation unit 142 described with reference to fig. 8 in the first embodiment described above, and therefore redundant description is omitted.

(1-3) determination unit 313

The function of the determination unit 313 is the same as that of the determination unit 143 described with reference to fig. 8 in the first embodiment described above, and therefore, redundant description is omitted.

(1-4) mode control part 314

The function of the mode control unit 314 is the same as that of the mode control unit 144 described with reference to fig. 8 in the first embodiment, and therefore, redundant description is omitted. Further, the mode control unit 314 transmits a signal corresponding to the set mode from the communication unit 340-2 to the tablet terminal 1-2. For example, when the drawing mode is set, the mode control unit 314 transmits a drawing signal from the communication unit 340-2 to the tablet terminal 1-2. On the other hand, when the non-drawing mode is set, the mode control unit 314 transmits a non-drawing signal from the communication unit 340-2 to the tablet terminal 1-2.

(1-5) drawing information update section 315

The function of the drawing information updating unit 315 is the same as that of the drawing information updating unit 145 described with reference to fig. 8 in the first embodiment described above, and therefore, redundant description is omitted. Further, the drawing information updating unit 315 updates the drawing information stored in the storage unit 330-2.

(2) Pressure detection unit 320-2

The function of the pressure detection unit 320-2 is the same as that of the pressure detection unit 320-1 described with reference to fig. 9 in the first embodiment, and therefore, redundant description is omitted.

(3) Storage section 330-2

The function of the storage section 330-2 is the same as that of the storage section 330-1 described with reference to fig. 9 in the first embodiment described above, and therefore, redundant description is omitted. The storage unit 330-2 stores the drawing information updated by the drawing information updating unit 315.

(4) Communication section 340-2

The function of the communication unit 340-2 is the same as that of the communication unit 340-1 described with reference to fig. 9 in the first embodiment, and therefore, redundant description thereof is omitted. Further, the communication section 340-2 does not transmit a signal containing the pressure information output by the pressure detection section 320-2 to the tablet terminal 1-2. The communication unit 340-2 transmits the drawing signal or the non-drawing signal to the tablet terminal 1-2 according to the mode set by the mode control unit 314. In addition, the communication section 340-2 receives the stroke position information and the time stamp information transmitted from the tablet terminal 1-2.

< 4-4. flow of processing >)

The flow of the processing according to the second embodiment will be described with reference to fig. 15. Fig. 15 is a sequence diagram showing an example of the flow of the processing according to the second embodiment.

As shown in fig. 15, first, the stylus pen 3-2 is brought into contact with the touch screen 14 of the tablet terminal 1-2 by the user' S operation (step S300).

When the stylus 3-2 is in contact with the touch panel 14, the pressure detection unit 320-2 of the stylus 3-2 detects the drawing pressure (step S301). The pressure detection unit 320-2 outputs pressure information indicating the detected drawing pressure.

When the stylus 3-2 is in contact with the touch panel 14, the stroke position detection unit 120-2 of the tablet terminal 1-2 detects the stroke position and acquires the time stamp (step S302). The stroke position detecting unit 120-2 outputs stroke position information indicating the detected stroke position and time stamp information indicating the acquired time stamp. The communication part 130-2 of the tablet terminal 1-2 transmits the stroke position information and the time stamp information output from the stroke position detection part 120-2 to the stylus 3-2 (step S303).

The drawing information acquiring unit 311 of the stylus 3-2 acquires the current drawing information and the previous drawing information (step S304). For example, the drawing information acquisition section 311 acquires, as this drawing information, the pressure information output by the pressure detection section 320-2 in step S301, the stroke position information and the time stamp information transmitted from the tablet terminal 1-2 in step S303. Further, the drawing information acquisition unit 311 acquires the drawing information stored in the storage unit 330-2 of the stylus 3-2 as the previous drawing information.

The calculation unit 312 of the stylus pen 3-2 calculates the amount of change based on the drawing information of this time and the drawing information of the previous time acquired by the drawing information acquisition unit 311 in step S304 (step S305). Specifically, the calculation unit 312 calculates the difference between the pressure information included in the current drawing information and the pressure information included in the previous drawing information as the amount of change in the drawing pressure. The calculation unit 312 calculates an angle between the coordinates of the stroke position indicated by the stroke position information included in the current drawing information and the coordinates of the stroke position indicated by the stroke position information included in the previous drawing information as the amount of change in the drawing direction.

The determination unit 313 of the stylus 3-2 performs a stroke operation determination process based on the amount of change calculated by the calculation unit 312 (step S306). Note that the details of the stroke operation determination processing in step S306 are the same as the flow of the processing described with reference to fig. 11 in the first embodiment, and therefore redundant description is omitted.

The mode control unit 314 of the stylus 3-2 controls the mode related to drawing based on the determination result of the determination unit 313 (step S307). Specifically, when the determination unit 313 determines in step S306 that the pen-touch operation is an operation to perform drawing, the mode control unit 314 sets the drawing mode. On the other hand, when the determination unit 313 determines in step S306 that the stroke operation is not an operation to perform drawing, the mode control unit 314 sets the non-drawing mode. After the mode is set, the mode control unit 314 outputs mode information indicating the set mode.

The drawing information updating unit 315 of the stylus 3-2 updates the drawing information stored in the storage unit 330-2 (step S308). Specifically, the drawing information updating unit 315 updates the drawing information stored in the storage unit 330-2 with information that associates the amount of change in the drawing pressure and the amount of change in the drawing direction calculated by the calculation unit 312 in step S305 and the pattern information output by the pattern control unit 314 in step S307 with the drawing information of this time.

The communication unit 340-2 of the stylus 3-2 transmits a signal corresponding to the mode set by the mode control unit 314 to the tablet terminal 1-2 (step S309). Specifically, when the drawing mode is set by the mode control unit 314 in step S307, the communication unit 340-2 transmits a drawing signal to the tablet terminal 1-2. On the other hand, when the non-drawing mode is set by the mode control unit 314 in step S307, the communication unit 340-2 transmits a non-drawing signal to the tablet terminal 1-2.

The drawing control section 147 of the tablet terminal 1-2 controls the drawing in the display section 160-2 of the tablet terminal 1-2 according to the signal received by the communication section 130-2 of the tablet terminal 1-2 from the stylus pen 3-2 (step S310). Specifically, when the communication unit 130-2 receives the drawing signal from the stylus 3-2, the drawing control unit 147 outputs the drawing signal to the display unit 160-2. On the other hand, when the communication unit 130-2 receives the non-drawing signal from the stylus pen 3-2, the drawing control unit 147 outputs the non-drawing signal to the display unit 160-2.

As described above, the stylus 3-2 according to the second embodiment includes the drawing information acquisition unit 311, the calculation unit 312, the determination unit 313, and the mode control unit 314.

The drawing information acquiring unit 311 acquires drawing information including at least pen stroke position information indicating a pen stroke position at which a pen stroke operation is performed on the touch panel 14 and pressure information indicating a drawing pressure applied to the pen stroke position.

The calculation unit 312 calculates the amount of change in the movement of the stroke position based on the previous drawing information acquired by the drawing information acquisition unit 311 and the current drawing information.

The determination unit 313 determines whether or not the stroke operation is an operation to perform drawing, based on the amount of change calculated by the calculation unit 312.

The mode control unit 314 sets a drawing mode in which drawing related to the pen-touch operation is performed when the pen-touch operation is an operation to perform drawing, and sets a non-drawing mode in which drawing related to the pen-touch operation is not performed when the pen-touch operation is not an operation to perform drawing.

According to the above configuration, in the stylus 3-2 according to the second embodiment, it is possible to determine whether or not the stroke operation is an operation to perform drawing based on the amount of change calculated from the stroke position information and the pressure information, and set any one of the drawing mode and the non-drawing mode.

Thus, the stylus 3-2 can determine with higher accuracy whether or not the pen-touch operation is an operation to perform drawing, as compared with the case of using only drawing pressure. Further, the stylus pen 3-2 can also control the switching between the drawing mode and the non-drawing mode with high accuracy by using a determination result with higher accuracy.

Therefore, the stylus pen 3-2 according to the second embodiment can prevent, with high accuracy, drawing (drawing of disturbance) by a pen-touch operation which is not intended by the user.

In the tablet terminal 1-2 according to the second embodiment, the drawing with interference is prevented, and thus the interference is removed with high accuracy from the drawing by handwriting input using the stylus pen 3-2. In particular, the accuracy of removing the disturbance caused by the drawing on the screen which is likely to slide is improved. Therefore, the drawing result is more preferable. In addition, improvement of recognition accuracy in handwriting recognition can also be expected.

In the second embodiment, the description has been given of the example in which the drawing information updated by the drawing information updating unit 315 of the stylus 3-2 is stored in the storage unit 330-2 of the stylus 3-2, but the present invention is not limited to the above example. For example, the drawing information updated by the drawing information updating unit 315 may be stored in the storage unit 150-2 of the tablet terminal 1-2. In this case, when the drawing information acquisition unit 311 of the stylus pen 3-2 acquires the previous drawing information, the drawing information stored in the storage unit 150-2 of the tablet terminal 1-2 is acquired as the previous drawing information. Further, the drawing information updating unit 315 of the stylus 3-2 updates the drawing information stored in the storage unit 150-2 of the tablet terminal 1-2 when the drawing information is updated.

In the second embodiment, the example in which the stylus pen 3-2 transmits the drawing signal to the tablet terminal 1-2 when the drawing mode is set and transmits the non-drawing signal to the tablet terminal 1-2 when the non-drawing mode is set has been described, but the present invention is not limited to the above example. For example, the stylus pen 3-2 may transmit the drawing signal to the tablet terminal 1-2 when the drawing mode is set, and may not transmit the signal to the tablet terminal 1-2 when the non-drawing mode is set.

< 5. variant >

The second embodiment has been described above. Next, a modification of each embodiment will be described with reference to fig. 16.

In the above-described embodiments, the description has been given of the example in which the amount of change in the drawing pressure and the amount of change in the drawing direction are included in the amounts of change calculated by the calculation unit 142 and the calculation unit 312, but the present invention is not limited to the above-described example. For example, the amount of change calculated by the calculation units 142 and 312 may include the amount of change in the stroke position. The amount of change in the stroke position is, for example, the distance from the last detected stroke position to the current detected stroke position, that is, the moving distance of the stroke position. The calculation unit 142 and the calculation unit 312 calculate, for example, a distance between the coordinates of the stroke position indicated by the stroke position information included in the current drawing information and the coordinates of the stroke position indicated by the stroke position information included in the previous drawing information as the movement distance.

When the amount of change calculated by the calculation unit 142 and the calculation unit 312 also includes the movement distance, the determination unit 143 and the determination unit 313 determine that the pen-touch operation is not the operation to perform drawing when the amount of decrease in the drawing pressure is equal to or greater than a predetermined threshold (first threshold), the amount of change in the drawing direction is equal to or greater than a predetermined threshold (second threshold), and the movement distance is equal to or greater than a predetermined threshold (third threshold, for example, 0.5 mm). In this way, the determination unit 143 can improve the accuracy of the pen-touch operation determination by using the movement distance also in the determination of the pen-touch operation.

Here, a flow of the stroke operation determination process in the case where the amount of change also includes the movement distance will be described with reference to fig. 16. Fig. 16 is a flowchart showing an example of the flow of the stroke operation determination processing according to the modification. The flowchart shown in fig. 16 is obtained by adding step S207 to the flowchart shown in fig. 11. Steps S200, S201, S202, S203, S204, and S206 shown in fig. 16 are the same as steps S200, S201, S202, S203, S204, and S206 shown in fig. 11, and therefore, redundant description is omitted.

In the flowchart shown in fig. 16, when the amount of change in the drawing direction is equal to or greater than the predetermined threshold value in step S205 (step S205/yes), the determination unit 143 and the determination unit 313 advance the process to step S207.

The determination unit 143 and the determination unit 313 determine whether or not the movement distance is equal to or greater than a predetermined threshold (third threshold) (step S207). When the moving distance is equal to or greater than the predetermined threshold (yes in step S207), the determination unit 143 and the determination unit 313 determine that the stroke operation is not the operation to be drawn (step S201), and the stroke operation determination process is ended. On the other hand, when the moving distance is not equal to or greater than the predetermined threshold (step S207/no), the determination unit 143 advances the process to step S206.

The embodiments of the present invention have been described above.

Each of the configurations of the tablet terminal 1 and the stylus pen 3 described above includes a computer system therein. Further, the processes in the respective configurations of the tablet terminal 1 and the stylus pen 3 may be performed by recording a program for realizing the functions of the respective configurations of the tablet terminal 1 and the stylus pen 3 in a computer-readable recording medium, and causing a computer system to read and execute the program recorded in the recording medium. Here, "causing a computer system to read a program recorded in a recording medium and execute" includes installing the program in the computer system. The "computer system" herein includes hardware such as an OS and peripheral devices.

The "computer system" may include a plurality of computer devices connected via a network including a communication line such as the internet, a WAN, a LAN, or a dedicated line. The term "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a recording device such as a hard disk incorporated in a computer system. The recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

The recording medium also includes an internally or externally provided recording medium that can be accessed from a distribution server to distribute the program. Further, the configuration in which the program is divided into a plurality of pieces and downloaded at different timings and then combined with the respective configurations of the tablet terminal 1 and the stylus pen 3, and the distribution server for distributing the divided programs may be different.

The "computer-readable recording medium" also includes a configuration in which a program is held for a certain period of time, such as a volatile memory (RAM) in a server or a computer system serving as a client when the program is transmitted via a network. The program may be configured to realize a part of the above-described functions. Further, the present invention may be a so-called differential file (differential program) that can be realized by combining the above-described functions with a program already recorded in a computer system.

In addition, a part or all of the above functions may be implemented as an integrated circuit such as an LSI (Large Scale Integration). Each of the above functions may be independently processed, or may be partially or entirely integrated to be processed. The method of integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when a technique for realizing an integrated circuit instead of an LSI has been developed with the advance of semiconductor technology, an integrated circuit based on the technique may be used.

While the embodiments of the present invention have been described in detail with reference to the drawings, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the spirit of the present invention.

Claims

1. An information processing apparatus includes:

a drawing information acquisition unit that acquires drawing information including at least touch position information indicating a touch position at which a touch operation is performed on a touch panel and pressure information indicating pressure applied to the touch position;

a calculation unit that calculates an amount of change relating to movement of the touch position based on first drawing information acquired by the drawing information acquisition unit and second drawing information acquired later than the first drawing information;

a determination unit that determines whether or not the touch operation is an operation for which drawing should be executed, based on the amount of change calculated by the calculation unit; and

and a mode control unit that sets a first mode in which drawing related to the touch operation is performed when the determination unit determines that the touch operation is an operation in which drawing should be performed, and sets a second mode in which drawing related to the touch operation is not performed when the determination unit determines that the touch operation is not an operation in which drawing should be performed.

2. The information processing apparatus according to claim 1,

the amount of change calculated by the calculation section includes at least an amount of change in pressure applied to the touch position and an amount of change in a moving direction of the touch position,

the determination unit determines that the touch operation is not an operation to perform drawing when the change amount of the pressure is equal to or greater than a first threshold value and the pressure is sharply decreased and the change amount of the movement direction is equal to or greater than a second threshold value and the movement direction is abruptly changed.

3. The information processing apparatus according to claim 2,

the amount of change calculated by the calculation section further includes a movement distance of the touch position,

the determination unit determines that the touch operation is not an operation to be performed when the decrease amount of the pressure is equal to or larger than the first threshold, the change amount of the movement direction is equal to or larger than the second threshold, and the movement distance is equal to or larger than a third threshold.

4. The information processing apparatus according to any one of claims 1 to 3,

the determination unit determines that the touch operation is not an operation to perform drawing when the pressure indicated by the pressure information included in the second drawing information is equal to or less than a fourth threshold and the pressure is extremely low.

5. The information processing apparatus according to any one of claims 1 to 4,

when it is determined that the touch operation is not an operation to be performed drawing at the time of a first determination and the pressure at the time of a second determination later than the time of the first determination is not increased as compared to the time of the first determination, the determination unit determines that the operation to be performed drawing is continued.

6. The information processing apparatus according to any one of claims 1 to 5,

when the pressure increases at a first determination time as compared to a second determination time earlier than the first determination time, the determination unit determines that the touch operation is an operation for which drawing should be performed.

7. An information processing method comprising the processes of:

a drawing information acquisition unit that acquires drawing information including at least touch position information indicating a touch position at which a touch operation is performed on a touch panel and pressure information indicating a pressure applied to the touch position;

the mode control unit sets a first mode in which the drawing related to the touch operation is executed when the determination unit determines that the touch operation is an operation in which the drawing should be executed, and sets a second mode in which the drawing related to the touch operation is not executed when the determination unit determines that the touch operation is not an operation in which the drawing should be executed.