JP2017215631A - Input device, input system, input processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an input device capable of preventing an operation plane from getting damaged, and an input system, an input processing method, and a program.SOLUTION: The input device includes: an operation plane that receives an input operation made by a touch of a predetermined operation body; a detection part that detects that an object different from the predetermined operation body positions closer to the operation plane; and a warning part that emits an alarm to a user on the basis of the fact that the detection part has detected the approximation of the object different from the predetermined operation body.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an input device, an input system, an input processing method, and a program.

  In recent years, a technique for recognizing characters, numbers, symbols and the like input by handwriting using a pointing device such as an electronic pen or a user's fingertip has begun to spread. For example, in an input device such as a tablet PC (Personal Computer) or a smartphone equipped with an operation surface such as a touch panel, when movement of an operation body such as an electronic pen or a finger is detected on the operation surface, Characters, numbers, symbols, and the like are recognized based on the movement trajectory of the operating body. Then, recognition results such as recognized characters, numbers, symbols, and the like are input as data to the input device. An input device using such a technique can achieve cost reduction and the like by making paperless, and furthermore, the user can input with the feeling described on a paper-like medium, and thus the input operation is easy. For this reason, the technology has been widely used. For example, the technology is disclosed in Patent Documents 1 and 2 below as an example of the technology.

JP 2003-225209 A JP 2001-222376 A

  However, in the conventional input device, instead of using an electronic pen or a finger, a user may accidentally perform an input operation on the operation surface using a writing tool such as a ballpoint pen. There was a problem of damaging the operation surface.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a novel and improved input device and input capable of preventing the operation surface from being damaged. A system, an input processing method, and a program are provided.

  In order to solve the above-described problem, according to an aspect of the present invention, an operation surface that receives an input operation by contact of a predetermined operation body and an object that is different from the predetermined operation body are detected to approach the operation surface. An input device is provided that includes a detection unit that performs a warning to a user based on the detection unit detecting an approach of an object different from the predetermined operation body.

  The input device may further include a display unit that displays to the user, and the warning unit may perform the warning by causing the display unit to display a warning.

  The input device may further include a voice output unit that outputs a voice to the user, and the warning unit may perform the warning by causing the voice output unit to output a warning voice.

  The input device may further include a vibration generating unit that vibrates the input device, and the warning unit may perform the warning by controlling the vibration generating unit to vibrate the input device.

  The predetermined operation body may be an electronic pen or a finger of the user.

  The object different from the predetermined operation body may be a writing instrument that performs actual writing on a paper-like medium.

  The detection unit may be a magnetic field detection device that detects a magnetic field change generated on the operation surface.

  The object different from the predetermined operation body may include a magnetic force generation unit that generates a constant magnetic field on the operation surface.

  The detection unit may be a photographing device that photographs the object different from the predetermined operation body positioned on the operation surface.

  The object different from the predetermined operation body is a writing instrument to which an identification member having a shape capable of detecting a difference from the predetermined operation body is connected, and the detection unit is configured to perform the identification on a captured image. It may be detected by recognizing a member that the object different from the predetermined operation body has approached the operation surface.

  The detection unit may be a signal detection device that detects a predetermined signal transmitted from an object different from the predetermined operation body.

  The predetermined signal may be a signal indicating that an optical sensor provided on the object different from the predetermined operation body has detected a light amount not less than a predetermined amount.

  In order to solve the above problem, according to another aspect of the present invention, an operation surface that receives an input operation by contact of a predetermined operation body, and an object that is different from the predetermined operation body approaches the operation surface. An input system is provided that includes a detection unit that detects this, and a warning unit that issues a warning to a user based on the detection unit detecting an approach of an object different from the predetermined operation body. The

  Furthermore, in order to solve the above-described problem, according to still another aspect of the present invention, an object different from the predetermined operation body is provided in the operation unit in the operation unit that receives an input operation by contact of the predetermined operation body. There is provided an input processing method including detecting approaching and warning a user based on detection of approach of an object different from the predetermined operating body.

  In order to solve the above-described problem, according to still another aspect of the present invention, a computer includes an operation unit that receives an input operation by contact with a predetermined operation body, and an object that is different from the predetermined operation body. Functions as a detection unit that detects an approach to the operation unit, and a warning unit that warns the user based on the detection unit detecting an approach of an object different from the predetermined operation body A program is provided to make it happen.

  As described above, according to the present invention, it is possible to prevent the operation surface from being damaged.

It is explanatory drawing which shows the structural example of the input system 1 which concerns on the 1st Embodiment of this invention. It is a block diagram of input device 10 concerning a 1st embodiment. It is explanatory drawing which shows roughly the internal structure of the electronic pen 30 which concerns on 1st Embodiment. It is explanatory drawing for demonstrating the writing instrument 50 which concerns on 1st Embodiment. It is a flowchart figure of the input processing method which concerns on 1st Embodiment. It is explanatory drawing for demonstrating an example of the warning screen 800 which concerns on 1st Embodiment. It is explanatory drawing for demonstrating the writing instrument 52 which concerns on 2nd Embodiment. It is a flowchart figure of the input processing method which concerns on 2nd Embodiment. It is explanatory drawing for demonstrating the writing instrument 54 which concerns on 3rd Embodiment. It is a flowchart figure of the processing method which concerns on 3rd Embodiment. It is the block diagram which showed the hardware constitutions of the input device 10 which concerns on embodiment of this invention.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.

<< First Embodiment >>
<Input system 1>
First, a configuration example of the input system 1 according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 is an explanatory diagram illustrating a configuration example of the input system 1 according to the present embodiment. As shown in FIG. 1, the input system 1 according to the present embodiment includes, for example, an input device 10, an electronic pen (predetermined operation body) 30, and a writing instrument (an object different from the predetermined operation body) 50. Consists of. Hereinafter, the input device 10, the electronic pen 30, and the writing tool 50 included in the input system 1 will be described.

  The input device 10 is, for example, a terminal having an operation surface that accepts an input operation by contact with an electronic pen 30 described later, and specifically, a tablet PC (Personal Computer), a smartphone, or the like. The detailed configuration of the input device 10 will be described later.

  The electronic pen 30 is an example of a pointing device used when performing an input operation on the input device 10. Specifically, the user brings the pen tip 304 (see FIG. 3) of the electronic pen 30 into contact with the operation display unit (operation surface) 106 of the input device 10. The input device 10 then receives information (hereinafter referred to as “electronic information”) generated when the electronic pen 30 touches the operation display unit 106 of the input device 10 such as the coordinates of the position where the pen tip 304 of the electronic pen 30 contacts. The input operation from the user is accepted. The detailed configuration of the electronic pen 30 will be described later. In the present embodiment, the operating body that performs an input operation on the input device 10 is not limited to the electronic pen 30 described above, and may be a user's finger.

  The writing instrument 50 is a writing instrument that performs actual writing on a paper-like medium such as an input form. Specifically, the writing instrument 50 is a writing instrument in which an attachment 506 (see FIG. 4) is attached to a general writing instrument such as a ballpoint pen, a sign pen, a mechanical pen, or a pencil. In the following description, actual writing means writing on a paper-like medium such as a writing instrument such as a ballpoint pen, a sign pen, a mechanical pen, and a pencil. The detailed configuration of the writing instrument 50 will be described later.

<Detailed Configuration of Input Device 10>
Next, a basic configuration of the input device 10 according to the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 2 is a block diagram of the input device 10 according to the present embodiment. As described above, the input device 10 is a terminal having an operation surface that receives an input operation by contact of the electronic pen 30. As shown in FIGS. 1 and 2, the input device 10 includes a control unit 100, a communication unit 102, a storage unit 104, an operation display unit (operation surface) 106, an imaging unit 108, an audio output unit 110, and a vibration generation unit 112. It has mainly. Hereinafter, each of these components will be described. Details of the hardware configuration of the input device 10 will be described later.

(Control unit 100)
The control unit 100 generally controls the operation of the input device 10 as shown in FIG. 2 using hardware such as a CPU (Central Processing Unit) and a RAM (Random Access Memory) built in the input device 10. It has the function to do. For example, when the electronic information by the electronic pen 30 is acquired by the operation display unit 106 to be described later, the control unit 100 controls each block such as the communication unit 102 based on the acquired electronic information. Further, the control unit 100 can control the operation display unit 106, the audio output unit 110, the vibration generation unit 112, and the like as a warning unit that issues a warning to the user.

(Communication unit 102)
The communication unit 102 is provided inside the input device 10 and can transmit and receive data (may include a call) to and from other external devices (not shown), for example, via a wireless communication network or the like. it can. The communication unit 102 may be configured to transmit and receive data to and from the electronic pen 30. In this case, the communication unit 102 serves as a signal detection device that detects a signal transmitted from the electronic pen 30. It can also function.

(Storage unit 104)
The storage unit 104 is a storage medium that is provided inside the input device 10 and stores various software such as applications executed by the input device 10 and various data such as a warning screen 800 (see FIG. 6) described later. . As a storage medium used for the storage unit 104, for example, a magnetic recording medium such as a hard disk (Hard Disk), an EEPROM (Electronically Erasable), or the like.
and Programmable Read Only Memory), Flash Memory, MRAM (Magnetic Responsive Random Access Memory), FeRAM (Ferroelectric Random Access Memory), PRAM (Phase Memory Memory), and PRAM (Phase Memory Memory).

(Operation display unit 106)
As shown in FIG. 1, the operation display unit 106 is provided on the surface of the input device 10 and serves as an interface between the user and the input device 10. The operation display unit 106 has a function as a display unit for displaying to the user, and is realized by, for example, a liquid crystal display (LCD) device, an organic light emitting diode (OLED) device, or the like. The operation display unit 106 displays a screen such as a warning screen 800 (see FIG. 6), for example, under the control of the control unit 100. The operation display unit 106 has a function as an operation unit that accepts various input operations to the input device 10 by the user. For example, an input by touching the electronic pen 30 or the like by a panel stacked on the operation display unit 106. Accept the operation.

  Specifically, the operation display unit 106 acquires electronic information when the electronic pen 30 comes into contact. The electronic information includes information indicating how the electronic pen 30 has touched the operation display unit 106, such as position coordinates. The operation display unit 106 is operated by the pen tip 304 (see FIG. 3) of the electronic pen 30. When the display unit 106 is touched, electronic information such as the coordinates of the touched position can be acquired. Then, the operation display unit 106 outputs electronic information obtained by contacting the pen tip 304 of the electronic pen 30 to the operation display unit 106 to the control unit 100. Note that the operation display unit 106 may acquire electronic information such as coordinates of a position touched by the user's finger when the user's fingertip touches.

  The operation display unit 106 can acquire electronic information using, for example, an electromagnetic induction method. Specifically, the operation display unit 106 includes an antenna coil group including a plurality of antenna coils (not shown) provided in a matrix along the X-axis direction and the Y-axis direction on the surface of the operation display unit 106. Is provided. Each antenna coil of the antenna coil group includes a high-frequency source (not shown) and a receiving circuit (not shown) provided inside the operation display unit 106, a coil changeover switch (not shown), and a transmission / reception changeover switch (not shown). (Not shown). The coil changeover switch and the transmission / reception changeover switch are controlled by a controller (not shown), whereby each antenna coil can be connected to a high frequency source or a reception circuit. The details of the method of acquiring electronic information by touching the electronic pen 30 in the operation display unit 106 will be described later together with the detailed configuration of the electronic pen 30.

  The operation unit of the operation display unit 106 also has a function as a detection unit that detects that an object other than the electronic pen 30 has approached the operation display unit 106, and this function has a detailed configuration of the electronic pen 30. A description will be given later. Furthermore, in the present embodiment, the operation unit and the display unit of the operation display unit 106 are limited to be configured as an operation display unit that includes both the operation function and the display function. It is not a thing. In the present embodiment, for example, a display device as a display unit and a touch panel as an operation unit may be configured separately.

(Shooting unit 108)
As illustrated in FIG. 1, the photographing unit 108 is a photographing device such as a camera provided on the surface of the input device 10, and photographs a situation around the input device 10. Specifically, the photographing unit 108 can photograph an object (for example, the electronic pen 30 or the writing instrument 50) located on or above the operation display unit 106 of the input device 10.

(Audio output unit 110)
As shown in FIG. 1, the sound output unit 110 is a sound output device such as a speaker provided on the surface of the input device 10, and outputs a sound such as a warning sound to a user who uses the input device 10. can do.

(Vibration generator 112)
The vibration generating unit 112 includes a vibrator or the like provided in the input device 10 and can vibrate the input device 10. For example, by being controlled by the control unit 100 described above, the vibration generating unit 112 can generate vibration and vibrate the input device 10.

  Each functional unit of the input device 10 described above is not limited to being configured as being included in the single input device 10, but is configured as a separate device that constitutes a single input system. It may be. In other words, in this case, these separate devices constitute one input system. The input system may further include other devices.

<Detailed Configuration of Electronic Pen 30>
As described above, the electronic pen 30 according to the present embodiment is an example of the pointing device of the input device 10, and when the electronic pen 30 contacts the operation display unit 106 of the input device 10, the input device 10. Can acquire electronic information using an electromagnetic induction method. A detailed configuration of the electronic pen 30 will be described with reference to FIG. FIG. 3 is an explanatory diagram schematically showing the internal configuration of the electronic pen 30.

  As shown in FIG. 3, the electronic pen 30 mainly includes a housing 300, a pen core 302, a transmission / reception coil 306, a ferrite core 308, and a circuit unit 310. The pen core 302 is provided so as to pass through the center of the cylindrical casing 300 of the electronic pen 30, and one end of the pen core 302 serves as a pen tip 304 that contacts the operation display unit 106 of the input device 10. Protrusively. The pen core 302 is configured such that the pen tip 304 can protrude to the outside of the housing 300 when a switch (not shown) provided on the outer peripheral surface of the housing 300 is pressed by the user. It may be. A ferrite core 308 is provided on the pen tip 304 side of the pen core 302 so as to surround the pen core 302. A transmission / reception coil 306 is wound around the ferrite core 308. Furthermore, a circuit unit 310 is provided inside the housing 300, and the circuit unit 310 includes a capacitor (not shown). The capacitor and the transmission / reception coil 306 constitute a resonance circuit of the electronic pen 30. Further, the electronic pen 30 may be provided with a switch (not shown), and the resonance circuit including the capacitor and the transmission / reception coil 306 may be activated when the switch is pressed by the user. .

  When the pen point 304 of the electronic pen 30 is brought into contact with the operation display unit 106 of the input device 10, the operation display unit 106 can acquire electronic information as follows. First, the transmission / reception changeover switch (not shown) provided on the operation display unit 106 is connected to the high frequency power supply (not shown) side by the control of the controller (not shown) provided on the operation display unit 106 described above. The antenna coil (not shown) provided in the operation display unit 106 enters the transmission state. In this case, an alternating current flows through the antenna coil, and a magnetic field change occurs in the surface layer portion of the operation display unit 106. When the electromagnetic wave corresponding to the resonance frequency of the resonance circuit of the electronic pen 30 is emitted (transmitted) from the antenna coil due to the change in the magnetic field, electric energy (electromagnetic induction current) is generated in the resonance circuit of the electronic pen 30 by the resonance phenomenon. ) Is accumulated. Specifically, the current generated in the transmission / reception coil 306 by induction of electromagnetic waves corresponding to the resonance frequency is accumulated as electric energy in a capacitor (not shown) of the circuit unit 310. Note that the amount of electrical energy that can be stored by the capacitor is determined by the capacity of the capacitor.

  Next, under the control of the controller of the operation display unit 106, the transmission / reception changeover switch is connected to the reception circuit (not shown) side, and the antenna coil is switched to the reception state. When the antenna coil is switched to the reception state, the operation display unit 106 can detect the electromagnetic wave emitted from the electronic pen 30. At this time, the electronic pen 30 transmits an electromagnetic wave by causing a resonance current to flow through the transmission / reception coil 306 using the electrical energy accumulated in the capacitor. The electromagnetic wave emitted (transmitted) from the electronic pen 30 causes a magnetic field change in the surface layer portion of the operation display unit 106, and is detected (received) as an electromagnetic induction current by the receiving circuit via the antenna coil. Further, the receiving circuit outputs the detection result to the control unit 100 of the input device 10. The controller repeats switching the antenna coil between a transmission state and a reception state. As a result, the control unit 100 determines the position coordinates in the X and Y directions on the operation display unit 106 of the pen tip 304 of the electronic pen 30 based on the position of each receiving circuit that outputs the detection result and the detected electromagnetic wave intensity. Can be calculated. That is, the operation display unit 106 is a magnetic field detection device that detects a magnetic field change that occurs in the surface layer portion of the operation display unit 106 by the pen tip 304 of the electronic pen 30.

<Detailed configuration of writing instrument 50>
As described above, the writing instrument 50 is a writing instrument that performs actual writing on a paper-like medium such as an input form. The detailed configuration of the writing instrument 50 will be described with reference to FIG. FIG. 4 is an explanatory diagram for explaining the writing instrument 50 according to the present embodiment. The writing instrument 50 mainly includes a housing 500 and a pen core 502 containing ink or the like for actual writing. The pen core 502 is provided so as to penetrate the center of the cylindrical casing 500, and one end of the pen core 502 protrudes outside the casing 500 as a pen tip 504 for writing in contact with the paper-like medium. The pen core 502 can have the same configuration as the core of a writing instrument such as a ballpoint pen, a sign pen, a mechanical pen, or a pencil.

  Furthermore, the writing instrument 50 has an attachment 506 provided around the housing 500 as shown in FIG. The attachment 506 is preferably provided in the vicinity of the pen tip 504. The attachment 506 functions as a magnetic force generation unit that generates a constant magnetic field, and is configured by a permanent magnet or an electromagnet, for example. In addition, when the attachment 506 is configured by an electromagnet, a configuration for supplying a current such as a battery to the housing 500 is provided. When the attachment 506 has a predetermined distance (for example, about 1 to 3 cm) between the pen tip 504 of the writing instrument 50 and the operation display unit 106 of the input device 10, the attachment 506 is attached to the operation display unit 106. Create a constant magnetic field. Specifically, when the user performs an operation of bringing the writing instrument 50 closer to the operation display unit 106 to the predetermined distance or less, the magnetic field change caused by bringing the attachment 506 closer to the surface layer of the operation display unit 106 An electromagnetic induction current is generated. However, since the magnetic field generated by the attachment 506 is constant, thereafter, the magnetic field change does not continuously occur in the surface layer portion, and the electromagnetic induction current does not continuously occur. Therefore, since the electromagnetic induction current does not continuously occur, the operation display unit 106 cannot detect the magnetic field change by the electromagnetic induction current. As a result, the control unit 100 can determine that the object approaching the operation display unit 106 is not the electronic pen 30 but the writing instrument 50 based on the detection result of the operation display unit 106.

  In the present embodiment, the attachment 506 is configured such that the strength of the magnetic field generated by the attachment 506 is stronger than the strength of the magnetic field that can be generated by the electrical energy stored in the resonance circuit of the electronic pen 30. The magnetic force of the permanent magnet or electromagnet to be used may be selected. The strength of the magnetic field that can be generated by the electronic pen 30 depends on the electric energy that can be stored in the resonance circuit, and the electric energy is, as described above, the capacitance of the capacitor that constitutes the resonance circuit. Determined by. In this case, when the user performs an operation of bringing the writing instrument 50 close to the operation display unit 106, an electromagnetic induction current is generated due to a magnetic field change caused by bringing the attachment 506 close to the surface layer of the operation display unit 106. At this time, since the strength of the magnetic field generated by the attachment 506 of the writing instrument 50 is stronger than the magnetic field that can be generated by the electronic pen 30, the electromagnetic induction current is higher than when the electronic pen 30 is brought closer. It will flow. As a result, the control unit 100 can determine that the object approaching the operation display unit 106 is not the electronic pen 30 but the writing instrument 50 based on the detection result of the operation display unit 106.

  In the present embodiment, the pen tip 504 of the writing instrument 50 is not necessarily limited to projecting outside the housing 500 at all times. For example, the writing instrument 50 may have a structure in which the pen tip 504 can protrude to the outside of the housing 500 when the user presses a knock portion 508 provided in the housing 500.

<Input processing method>
The detailed configuration of the input device 10, the electronic pen 30, and the writing instrument 50 according to the present embodiment has been described above. Subsequently, an input processing method of the input system 1 according to the present embodiment will be described with reference to FIG. 5 or FIG. FIG. 5 is a flowchart of the input processing method according to the present embodiment. FIG. 6 is an explanatory diagram for explaining an example of the warning screen 800 according to the present embodiment. The input processing method described below includes steps S101 to S111 as shown in FIG.

  First, the user brings the electronic pen 30 or the writing instrument 50 close to the operation display unit 106 of the input device 10. Next, the process proceeds to step S101.

(Step S101)
The operation display unit 106 of the input device 10 detects a magnetic field change in the surface layer portion of the operation display unit 106 generated by the electronic pen 30 or the writing instrument 50, and outputs the detection result to the control unit 100 of the input device 10. Next, the process proceeds to step S103.

(Step S103)
Based on the detection result of the operation display unit 106, the control unit 100 determines whether the object approaching the operation display unit 106 is the electronic pen 30 or the writing instrument 50. For example, when a magnetic field change cannot be continuously detected or when a strong magnetic field is detected by an electromagnetic induction current greater than or equal to a predetermined value, the control unit 100 determines that an approach of the writing instrument 50 has been detected and proceeds to step S105. move on. On the other hand, when a magnetic field change is detected continuously or when a magnetic field due to an electromagnetic induction current less than a predetermined value is detected, the control unit 100 proceeds to step S111 assuming that the approach of the electronic pen 30 is detected. .

(Step S105)
The control unit 100 warns the user based on the approach of the writing instrument 50 being detected. Specifically, the control unit 100 causes the operation display unit 106 to display a warning screen (warning display) 800 for the user as shown in FIG. The warning screen 800 displays a message such as “Your pen cannot be used” to prevent the user from touching the pen tip 504 of the writing instrument 50 on the surface of the operation display unit 106. The writing tool 50 is used to guide the input device 10 to stop the input operation. Further, the warning screen 800 includes a statement that guides the user to carry the input operation to the input device 10 while holding the electronic pen 30. Further, as shown in FIG. 6, the warning screen 800 includes a confirmation button 802 for transmitting to the input device 10 that the user has recognized the warning content on the warning screen 800. Therefore, when the user touches the confirmation button 802 with his / her finger or changes the electronic pen 30 to bring the pen tip 304 of the electronic pen 30 into contact with the confirmation button 802, the user notifies the input device 10 of the warning content. You can tell that you have recognized. Note that the warning screen 800 is not limited to the screen shown in FIG. 6 and may be in another form.

  When displaying the warning screen 800, the control unit 100 may cause the voice output unit 110 to output a warning voice stating “Your pen cannot be used”. The control unit 100 may warn the user by controlling the vibration generating unit 112 to vibrate the input device 10. In this way, it is possible to make the user recognize the warning content more reliably. Next, the process proceeds to step S107.

(Step S107)
The control unit 100 determines whether the operation display unit 106 detects that the user has performed an operation on the confirmation button 802 on the warning screen 800. If it is detected that the user has operated the confirmation button 802 on the warning screen 800, the process proceeds to step S109. If it cannot be detected that the user has operated the confirmation button 802, the process returns to step S105.

(Step S109)
The control unit 100 stops the display of the warning screen 800. Next, the process returns to step S101. At this time, the control unit 100 outputs a warning sound from the sound output unit 110 and stops vibration from the vibration generation unit 112.

(Step S111)
Based on the detection of the approach of the electronic pen 30, the control unit 100 receives an input operation performed using the electronic pen 30 with respect to the operation display unit 106. Then, the input processing method according to the present embodiment ends.

  By the way, in the conventional input device, instead of the electronic pen and fingers, the user may accidentally input to the operation display unit of the input device using a writing instrument such as a ballpoint pen. There was a problem that the operation display unit was damaged by the pen tip of the writing instrument. In particular, in a sales office of a financial institution, when a customer (user) inputs necessary information to an input device, he / she can fill in a necessary item by actual writing on a paper-like medium such as a form in parallel. is there. For example, both an input device for electronic input and a writing stand on which a table for writing on a form is installed adjacent to the electronic pen for the input device and a writing tool for writing on the form Is placed, the customer must use an electronic pen for the input device and a writing instrument for the form. At this time, the customer forgets to change the electronic pen to be input to the input device and the writing tool to be entered in the form, accidentally touch the pen tip of the writing tool to the surface of the operation display section of the input device, and operate The display unit may be damaged.

  However, in this embodiment, when the writing instrument 50 is brought close to the operation display unit 106 of the input device 10, the operation display unit 106 detects the approach of the writing instrument 50, and the control unit 100 is based on the detection. Thus, a warning is given to guide the user to stop the input operation using the writing instrument 50. As a result, according to the present embodiment, the user can be prevented from contacting the operation display unit 106 with the pen tip 504 of the writing instrument 50 by being guided by the warning. It is possible to prevent the operation display unit 106 from being damaged by the pen tip 504.

<< Second Embodiment >>
In the first embodiment described above, the control unit 100 of the input device 10 determines that the object approaching the operation display unit 106 is the electronic pen 30 or writing based on the detection result by the operation display unit 106 that detects a magnetic field change. It was judged whether it was the tool 50. However, the detection and determination method is not limited to the above-described form, and may be another form. Therefore, as a second embodiment, a method for determining whether the electronic pen 30 or the writing instrument 52 is used by using the photographing unit 108 provided in the input device 10 will be described. In the present embodiment, for example, by providing the writing tool 52 with an attachment (identification member) 510 that can be recognized by the photographing unit 108, the writing tool 52 that approaches the operation display unit 106 using the photographing unit 108 is provided. Can be detected.

  In the present embodiment, the input system 1, the input device 10 included in the input system 1, and the electronic pen 30 are the same as those in the first embodiment, and the input system 1 in the first embodiment, Reference may be made to FIGS. 1 to 3, which are descriptions and explanatory diagrams of the input device 10 and the electronic pen 30. Therefore, description of the input system 1, the input device 10, and the electronic pen 30 is omitted here.

<Detailed Configuration of Writing Tool 52>
Next, the writing instrument 52 according to the present embodiment will be described with reference to FIG. FIG. 7 is an explanatory diagram for explaining the writing instrument 52 according to the present embodiment. As in the above-described embodiment, the writing instrument 52 is provided around the casing 500, as shown in FIG. 7, a cylindrical casing 500, a pen core 502 containing ink for writing, and the like. Main attachment 510. The attachment 510 has a shape capable of detecting a difference from the electronic pen 30 by an image. For example, the attachment 510 is provided on the side opposite to the pen tip 504, and prominent colors such as red and yellow are provided so that image recognition using the photographing unit 108 provided in the input device 10 can be easily performed. It is preferable to have a characteristic shape.

  More specifically, the photographing unit 108 can photograph an object (for example, the electronic pen 30 or the writing instrument 52) located on or above the operation display unit 106 of the input device 10. Further, the image information of the attachment 510 described above is recorded in advance in the storage unit 104 of the input device 10, and the control unit 100 of the input device 10 refers to the recorded image information of the attachment 510 to obtain a photographing unit. Whether the image of the attachment 510 is included in the image photographed by 108 can be determined. For example, when the control unit 100 can recognize the image of the attachment 510 on the photographed image, the control unit 100 recognizes that the writing instrument 52 to which the attachment 510 is attached has approached the operation display unit 106. On the other hand, when the image of the attachment 510 is not included in the captured image, the control unit 100 recognizes that the electronic pen 30 has approached the operation display unit 106.

<Input processing method>
Subsequently, an input processing method of the input system 1 according to the present embodiment will be described with reference to FIG. FIG. 8 is a flowchart of the input processing method according to this embodiment. The input processing method described below includes steps S201 to S211 as shown in FIG.

  First, as in the first embodiment, the user brings the electronic pen 30 or the writing instrument 52 close to the operation display unit 106 of the input device 10. Next, the process proceeds to step S201.

(Step S201)
The imaging unit 108 of the input device 10 captures an image of an object (the electronic pen 30 or the writing instrument 52) that approaches the operation display unit 106 of the input device 10. Next, the process proceeds to step S203.

(Step S203)
The control unit 100 of the input device 10 refers to the image information of the attachment 510 attached to the writing instrument 52 recorded in advance in the storage unit 104 of the input device 10, so that the attachment 510 is added to the image captured in step S <b> 201. It is judged whether the image of is included. If the image of the attachment 510 is included in the photographed image, it is recognized that the writing instrument 52 has approached the operation display unit 106, and the process proceeds to step S205. If the image of the attachment 510 is not included, it is recognized that the electronic pen 30 has approached the operation display unit 106, and the process proceeds to step S211.

(Step S205)
Based on the recognition of the approach of the writing instrument 50, the control unit 100 issues a warning to the user as in the first embodiment. Thereafter, the process proceeds to step S207 and step S209. Since the same processes as those in step S107 and step S109 of the first embodiment are performed, the description is omitted here.

(Step S211)
Based on the recognition of the approach of the electronic pen 30, the control unit 100 receives an input operation performed using the electronic pen 30 on the operation display unit 106. Then, the input processing method according to the present embodiment ends.

  Also in the present embodiment, when the writing tool 52 is brought close to the operation display unit 106 of the input device 10, the control unit 100 detects the approach of the writing tool 52 using the image photographed by the photographing unit 108. Based on the detection, the control unit 100 issues a warning for guiding the user to stop the input operation using the writing instrument 52. As a result, according to the present embodiment, the user can be prevented from bringing the pen tip 504 of the writing tool 52 into contact with the operation display unit 106 by being guided by the warning. It is possible to prevent the operation display unit 106 from being damaged by the pen tip 504.

<< Third Embodiment >>
As described above, in the present invention, the determination method for determining whether the object approaching the operation display unit 106 is the electronic pen 30 or the writing instrument 50 (52) is the first and second embodiments. The present invention is not limited to this, and other forms may be used. Therefore, as a third embodiment, a method for determining whether the electronic pen 30 or the writing tool 54 is used by using a specific signal emitted from the writing tool 54 will be described. In the present embodiment, for example, by providing the writing instrument 54 with a communication unit 516 that transmits a predetermined signal that can be detected by the communication unit 102 of the input device 10, the input device 10 is displayed on the operation display unit 106. The approaching writing instrument 54 can be detected by the predetermined signal.

  In the present embodiment, the input system 1, the input device 10 included in the input system 1, and the electronic pen 30 are the same as those in the first embodiment, and the input system 1 in the first embodiment, Reference may be made to FIGS. 1 to 3, which are descriptions and explanatory diagrams of the input device 10 and the electronic pen 30. Therefore, description of the input system 1, the input device 10, and the electronic pen 30 is omitted here.

<Detailed Configuration of Writing Tool 54>
Next, the writing instrument 54 according to the present embodiment will be described with reference to FIG. FIG. 9 is an explanatory diagram for explaining the writing instrument 54 according to the present embodiment. As shown in FIG. 9, the writing tool 54 includes a cylindrical casing 500, a pen core 502 containing ink for writing, and a pen tip 504 that is the tip of the pen core 502. Mainly includes a knock unit 508 operated by the camera, a photographing unit 512 located in the vicinity of the pen tip 504, and a control unit 514 and a communication unit 516 provided inside the housing 500. Note that the writing instrument 54 according to the present embodiment has a structure in which the pen tip 504 can protrude to the outside of the housing 500 when the knock portion 508 is pressed by the user. Here, in the writing instrument 54 according to the present embodiment, description of the casing 500, the pen core 502, and the knock unit 508 that are common to the first embodiment is omitted, and the photographing unit 512, the control unit 514, and The communication unit 516 will be described.

(Shooting unit 512)
The imaging unit 512 is an imaging device such as a CCD (Charge-Coupled Device) camera provided on the pen tip 504 side of the casing 500 of the writing instrument 54 as shown in FIG. The lens unit of the imaging unit 512 is exposed from the housing 500 in the vicinity of the pen tip 504, and an object facing the pen tip 504 can be taken. Note that the photographing unit 512 can be activated when the knock unit 508 is pushed by the user and the pen tip 504 of the pen core 502 protrudes outside the housing 500. In addition, the photographing unit 512 is not limited to a photographing device such as a CCD camera, and may be an optical sensor that detects the amount of light, for example.

(Control unit 514)
As shown in FIG. 9, the control unit 514 is provided inside the housing 500 and mainly configured with hardware such as a CPU, a ROM, and a RAM. The control unit 514 analyzes the image acquired by the imaging unit 512 and controls the communication unit 516 described later based on the analysis result. Specifically, when the operation display unit 106 of the input device 10 facing the pen tip 504 is imaged by the imaging unit 512, the imaging is performed due to a backlight (not shown) built in the operation display unit 106. The unit 512 can acquire a bright image. Accordingly, the control unit 514 analyzes the acquired image and determines that the object facing the pen tip 504 of the writing instrument 54 is the operation display unit 106 when the amount of light exceeding a predetermined level is detected. Based on the above, the communication unit 516 is controlled.

(Communication unit 516)
As shown in FIG. 9, the communication unit 516 is provided inside the housing 500, and can transmit a predetermined signal such as an infrared signal or a radio signal to the input device 10 based on control by the control unit 514. . For example, when the communication unit 102 of the input device 10 detects the predetermined signal, the operation display unit of the input device 10 of the pen tip 504 of the writing instrument 54 is detected based on the detection of the predetermined signal. An approach to 106 can be recognized.

<Input processing method>
Subsequently, an input processing method of the input system 1 according to the present embodiment will be described with reference to FIG. FIG. 10 is a flowchart of the input processing method according to this embodiment. The input processing method described below includes steps S301 to S309 as shown in FIG.

  First, the user brings the writing instrument 54 close to the operation display unit 106 of the input device 10. For example, when the user feeds the pen tip 504 of the writing instrument 54, the photographing unit 512 of the writing unit 54 is activated. In this state, when the pen tip 504 of the writing tool 54 approaches the operation display unit 106, the photographing unit 512 of the writing tool 54 acquires an image of the operation display unit 106. Then, the control unit 514 of the writing instrument 54 analyzes the acquired image. When the control unit 514 detects a light amount greater than or equal to a predetermined amount, it is assumed that a bright image can be obtained due to a backlight (not shown) built in the operation display unit 106. The object facing the pen tip 504 is determined to be the operation display unit 106. Further, the control unit 514 controls the communication unit 516 to transmit a predetermined signal to the input device 10 based on the determination result. On the other hand, when the user brings the electronic pen 30 close to the operation display unit 106, a predetermined signal is not transmitted from the electronic pen 30. Next, the process proceeds to step S301.

(Step S301)
The control unit 100 of the input device 10 determines whether or not the communication unit 102 has detected a predetermined signal. If the communication unit 102 detects a predetermined signal, the process proceeds to step S303. If the communication unit 102 has not detected the predetermined signal, the process proceeds to step S309.

(Step S303)
The control unit 100 recognizes the approach of the writing instrument 54 to the operation display unit 106 based on the fact that the communication unit 102 has detected a predetermined signal, and warns the user as in the first embodiment. Do. Thereafter, the process proceeds to step S305 and step S307. Since the same processes as those in step S107 and step S109 of the first embodiment are performed, description thereof is omitted here.

(Step S309)
Based on the fact that the communication unit 102 has not detected the predetermined signal, the control unit 100 recognizes the approach of the electronic pen 30 to the operation display unit 106 and uses the electronic pen 30 for the operation display unit 106. The input operation performed will be accepted. Then, the input processing method according to the present embodiment ends.

  Also in the present embodiment, when the writing tool 54 is brought close to the operation display unit 106 of the input device 10, the approach of the writing tool 54 is detected using a predetermined signal transmitted from the writing tool 54. Based on the detection, the control unit 100 issues a warning for guiding the user to stop the input operation using the writing instrument 54. As a result, according to the present embodiment, the user can be prevented from contacting the operation display unit 106 with the pen tip 504 of the writing tool 54 by being guided by the warning. It is possible to prevent the operation display unit 106 from being damaged by the pen tip 504.

  In the present embodiment, the operation display unit 106 of the input device 10 is detected by the photographing unit 512 provided in the writing tool 54. However, the present invention is not limited to this. By performing short-range communication between the communication unit 516 and the communication unit 102 of the input device 10, the proximity of the writing instrument 54 and the operation display unit 106 is detected by detecting the relative position (position coordinates, etc.) of each other. May be detected. At this time, the accurate position coordinates of the writing tool 54 with respect to the input device 10 may be calculated using the measurement by a plurality of sensors such as an acceleration sensor provided inside the writing tool 54. Furthermore, the communication unit 516 or the like is not provided inside the housing 500, but may be attached to the writing instrument 54 by being attached, for example.

  In the present embodiment, a vibration generator (not shown) that vibrates the writing tool 54 may be provided in the writing tool 54. In this case, when the operation display unit 106 of the input device 10 is detected by the imaging unit 512 provided in the writing tool 54, the writing tool 54 and the operation display unit are vibrated by vibrating the writing tool 54 by the vibration generation unit. It is possible to make the user recognize the approach to 106 with certainty.

  In the first to third embodiments described above, the operating body that performs an input operation on the input device 10 is not limited to the electronic pen 30 described above, and is a user's finger. Also good.

  In the present embodiment, the input device 10 is not limited to a tablet PC or the like. The input device 10 is installed in a store such as a convenience store such as an automatic transaction device installed in a financial institution's sales office, a banknote organizing device, an automatic change machine, or a ticket vending machine installed in a transportation station. It may be an input device provided on the front side of the information terminal or the like. Alternatively, the input device 10 may be provided as an input device attached to the above-described device.

<< Hardware configuration >>
The embodiment of the present invention has been described above. Next, the hardware configuration of the input device 10 according to the present embodiment will be described with reference to FIG. FIG. 11 is a block diagram illustrating a hardware configuration of the input device 10 according to the present embodiment.

  As shown in FIG. 11, the input device 10 includes a CPU 950, ROM 952, RAM 954, internal bus 956, input / output interface 958, input device 960, output device 962, HDD (Hard Disk Drive) 964, network interface 966, camera, respectively. 968, a drive 970 and a connection port 974.

(CPU950)
The CPU 950 is configured by a processor such as a microprocessor, and implements a function as the control unit 100 that controls the overall operation in the input device 10 according to various programs as an arithmetic processing unit and a control unit.

(ROM952)
The ROM 952 stores programs used by the CPU 950, calculation parameters, and the like.

(RAM954)
The RAM 954 temporarily stores programs used in the execution of the CPU 950, parameters that change as appropriate during the execution, and the like.

(Internal bus 956)
The internal bus 956 is constituted by a CPU bus or the like. The internal bus 956 connects the CPU 950, the ROM 952, and the RAM 954 to each other.

(I / O interface 958)
The input / output interface 958 connects the HDD 964 and the network interface 966 to the internal bus 956. For example, the HDD 964 exchanges data with the RAM 954 and the like via the input / output interface 958 and the internal bus 956.

(Input device 960)
The input device 960 is configured as an example of an operation unit of the operation display unit 106 of the input device 10. The input device 960 includes, for example, input means for a user to input information, an input control circuit that generates an input signal based on an input by the user, and outputs the input signal to the CPU 950.

(Output device 962)
The output device 962 is configured as an example of a display unit of the operation display unit 106. The output device 962 includes a display device such as a liquid crystal display device or an OLED device as a display unit. This display device displays an image or the like generated by the CPU 950. Further, the output device 962 can be configured as an example of the vibration generating unit 112. The output device 962 includes a vibration generating device such as a vibrator as the vibration generating unit 112.

(HDD964)
The HDD 964 is a data storage device that functions as the storage unit 104 of the input device 10. The HDD 964 can also store programs executed by the CPU 950 and various data.

(Network interface 966)
The network interface 966 is a communication interface configured by a communication device or the like for connecting to a communication network such as the Internet. This network interface 966 functions as the communication unit 102. Note that the network interface 966 may be a wireless LAN compatible communication device, an LTE (Long Term Evolution) compatible communication device, infrared communication, or the like. The network interface 966 can also wirelessly communicate with the writing instrument 54 and the like.

(Camera 968)
The camera 968 is configured as an example of the imaging unit 108. The camera 968 has a function of capturing a still image or a moving image by forming an image of the surroundings of the input device 10 on an imaging element such as a CCD or a CMOS through a lens.

(Drive 970)
The drive 970 is a reader / writer for a removable recording medium 972 such as a magnetic disk, an optical disk, or a semiconductor memory, and is built in or externally attached to the input device 10. The drive 970 can write information into the attached removable recording medium 972. Further, the drive 970 can read information recorded on the attached removable recording medium 972 and output the information to the RAM 954.

(Connection port 974)
The connection port 974 is a port for directly connecting an external device (not shown) to the input device 10. The connection port 974 is, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface) port, or the like. The connection port 974 can exchange various data between the input device 10 and the external device by connecting the external device to the connection port 974.

  Heretofore, an example of the hardware configuration of the input device 10 according to the present embodiment has been shown. Each component described above may be configured using a general-purpose member, or may be configured by hardware specialized for the function of each component. Such a configuration can be appropriately changed according to the technical level at the time of implementation.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  In addition, the steps in the input processing method of each embodiment described above do not necessarily have to be processed in the order described. For example, the steps may be processed by changing the order as appropriate. Each step may be processed in parallel or individually instead of being processed in time series. Furthermore, the processing method of each step does not necessarily have to be processed according to the described method, and may be processed by other functional units, for example.

  Furthermore, at least a part of the input processing method according to the above embodiment can be configured by software as an information processing program for causing a computer to function. When configured by software, at least one of these methods is possible. The program for realizing the unit may be stored in a recording medium such as a flexible disk or a CD-ROM, and may be read and executed by the input device 10 or other devices connected to the input device 10. The recording medium is not limited to a removable medium such as a magnetic disk or an optical disk, but may be a fixed recording medium such as a hard disk device or a memory. Furthermore, a program for realizing at least a part of these methods may be distributed via a communication line (including wireless communication) such as the Internet. Further, the program may be distributed in a state where the program is encrypted, modulated or compressed, and stored in a recording medium via a wired line such as the Internet or a wireless line.

DESCRIPTION OF SYMBOLS 1 Input system 10 Input device 30 Electronic pen 50, 52, 54 Writing instrument 100, 514 Control part 102, 516 Communication part 104 Storage part 106 Operation display part 108, 512 Image | photographing part 110 Audio | voice output part 112 Vibration generating part 300, 500 housing | casing Body 302, 502 Pen core 304, 504 Pen tip 306 Transmitting / receiving coil 308 Ferrite core 310 Circuit unit 506, 510 Attachment 508 Knock unit 800 Warning screen 802 Confirmation button 950 CPU
952 ROM
954 RAM
956 Internal bus 958 I / O interface 960 Input device 962 Output device 964 HDD
966 Network interface 968 Camera 970 Drive 972 Removable recording medium 974 Connection port

Claims (15)

An operation surface for receiving an input operation by contact with a predetermined operation body;
A detection unit for detecting that an object different from the predetermined operation body approaches the operation surface;
A warning unit that warns the user based on the detection of an approach of an object different from the predetermined operation body by the detection unit;
Comprising
Input device. A display unit for displaying to the user;
The input device according to claim 1, wherein the warning unit performs the warning by displaying a warning on the display unit. A voice output unit that outputs voice to the user;
The input device according to claim 1, wherein the warning unit performs the warning by causing the voice output unit to output a warning voice. A vibration generating unit that vibrates the input device;
The input device according to any one of claims 1 to 3, wherein the warning unit performs the warning by controlling the vibration generating unit to vibrate the input device.   The input device according to any one of claims 1 to 4, wherein the predetermined operation body is an electronic pen or a finger of the user.   The input device according to claim 1, wherein the object that is different from the predetermined operation body is a writing instrument that performs actual writing on a paper-like medium.   The input device according to claim 1, wherein the detection unit is a magnetic field detection device that detects a magnetic field change generated on the operation surface.   The input device according to claim 7, wherein the object different from the predetermined operation body includes a magnetic force generation unit that generates a constant magnetic field on the operation surface.   The input device according to claim 1, wherein the detection unit is a photographing device that photographs the object different from the predetermined operation body positioned on the operation surface.   The object different from the predetermined operation body is a writing instrument to which an identification member having a shape capable of detecting a difference from the predetermined operation body is connected, and the detection unit is configured to perform the identification on a captured image. The input device according to claim 9, wherein the input device detects that the object different from the predetermined operation body has approached the operation surface by recognizing a member.   The input device according to claim 1, wherein the detection unit is a signal detection device that detects a predetermined signal transmitted from the object different from the predetermined operation body.   The input device according to claim 11, wherein the predetermined signal is a signal indicating that an optical sensor provided on the object different from the predetermined operation body has detected a light amount greater than or equal to a predetermined amount. An operation surface for receiving an input operation by contact with a predetermined operation body;
A detection unit for detecting that an object different from the predetermined operation body approaches the operation surface;
A warning unit that warns the user based on the detection of an approach of an object different from the predetermined operation body by the detection unit;
Including the input system. Detecting that an object different from the predetermined operation body approaches the operation unit in an operation unit that receives an input operation by contact of the predetermined operation body;
Based on the detection of the approach of an object different from the predetermined operating body, a warning is given to the user.
An input processing method. Computer
An operation unit for receiving an input operation by contact with a predetermined operation body;
A detection unit that detects that an object different from the predetermined operation body approaches the operation unit;
A warning unit that warns the user based on the detection of an approach of an object different from the predetermined operation body by the detection unit;
Program to make it function.

Images