JP2006172222A - Electronic device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To cause an electronic device with a touch panel for a variety of input using an input device to implement a process that suits the psychological state of a user made clear by his or her behavior during input operation. <P>SOLUTION: The electronic device having an input device and a detection means for detecting the position of the input device or the direction that the input device points is caused to store movement locus data indicative of the movement locus of the input device, and process detailed data indicative of the details of a process corresponding to the movement locus. The movement locus of the input device is specified based on changes in the result of detection of the detection means over time, and a determination is made as to whether or not the result of the specification indicates the movement locus of input operation; if the result of the determination is negative, a determination is further made as to whether or not the movement locus data indicative of the movement locus corresponding to the result of the specification is stored. If the result of the determination is affirmative, a process indicated by the process detailed data stored in association with the movement locus data is implemented. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an electronic device including a touch panel that performs various inputs using an input element.

For example, a mouse or a keyboard is widely used as an input device for performing various inputs to an electronic device such as a PDA (Personal Digital Assistant) or a notebook personal computer. Further, the psychological state of the user is detected based on the operation speed of the operation elements such as buttons provided in these input devices, the gripping force of the user holding the entire input device, and the like according to the detection result. Various techniques for causing an electronic device to perform processing have also been proposed (for example, Patent Documents 1 and 2).
In addition, when a touch panel is used as an input device, a technique for recognizing the psychological state of the user who performed the input based on the writing pressure when performing input on the touch panel has been proposed (for example, Patent Document 3). The touch panel displays a GUI (Graphical User Interface) for prompting input of data, commands, etc. on a display unit such as an LCD (Liquid Crystal Display), and the data and commands displayed on the GUI are pen-type. The input is selected with an input element such as a stylus, and various inputs are made, and it is easy to use even for users who are not used to key input.
Japanese Patent Laid-Open No. 7-141096 JP 2001-34410 A JP-A-7-325658

  By the way, when various inputs are made to the touch panel as described above, the user's psychological state may be remarkably manifested in the operation that the user unconsciously performs between the input operations. For example, when the user is frustrated, the user may perform a specific operation such as turning the input element upside down and tapping the display unit in small increments, or when bored, turning the input element around with a fingertip. However, even if the techniques disclosed in Patent Documents 1, 2, and 3 are used, it is impossible for the electronic device to detect the user's state of mind appearing in the specific operation as described above.

  The present invention has been made in view of the above problems, and an electronic device equipped with a touch panel for performing various inputs using an input element is used based on an operation performed between input operations using the input element. An object of the present invention is to provide a technology that allows a psychological state to be detected and allows processing to be performed according to the state of the mental state.

In order to solve the above problems, the present invention provides an input element, movement locus data representing a movement locus of the input element, and processing content data representing a process content corresponding to the movement locus data for each movement locus. Storage means in which a plurality of sets are written, detection means for detecting the position of the input element or its pointing direction, and specifying means for analyzing the time change of the detection result by the detection means to identify the movement locus of the input element First determining means for determining whether or not the movement locus specified by the specifying means is a predetermined movement locus representing data or command input, and the movement locus specified by the specifying means is the A second determination for determining whether or not movement trajectory data representing the movement trajectory is stored in the storage means when the first determination means determines that the movement trajectory is not a predetermined movement trajectory; And when the second determination means determines that the movement trajectory data representing the movement trajectory specified by the specifying means is stored in the storage means, the memory is associated with the movement trajectory data and stored. There is provided an electronic apparatus having processing execution means for executing processing represented by processing content data stored in the means.
According to such an electronic device, movement trajectory data representing a movement trajectory drawn by the input element in an operation performed by the user according to the psychological state between input operations, and the psychological state such as relaxing the psychological state If the processing content data representing the processing content according to the above is written in the storage means in association with each other, the processing corresponding to the user's psychological state appearing in the operation performed between the input operations is executed.

  In a more preferred aspect, the movement trajectory data stored in the storage means is data representing a characteristic of a curve or a straight line corresponding to the movement trajectory represented by the movement trajectory data, and the specifying means is determined by the detection means. The time change of the detection result is analyzed to identify a characteristic of a curve or a straight line corresponding to the movement locus of the input element, and the first determination means determines the feature identified by the identification means and the predetermined movement locus. It is characterized by determining whether or not the characteristics of the corresponding curve or straight line are the same or similar. In such an aspect, the process to be executed by the process execution unit is determined based on the characteristic of the curve or straight line corresponding to the movement locus drawn by the input element.

  In a more preferred aspect, the apparatus includes a writing unit that writes the movement trajectory data and the processing content data into the storage unit in accordance with a user instruction. In such an aspect, the user writes movement trajectory data representing an action according to his / her own habit and process content data representing a process to be executed when the action is detected in the storage means. It is possible to leave.

  In a more preferred aspect, the input element includes a magnetic field generation unit that generates a magnetic field, and the detection unit includes at least three magnetic sensors arranged at different positions, and the magnetic field generated by the magnetic field generation unit. Is measured by each of the magnetic sensors, and the position of the input element or the direction indicated by the input element is specified.

  According to the present invention, an electronic device including a touch panel that performs various inputs with an input element is caused to detect a user's psychological state based on an operation performed between input operations, and to perform a process according to the psychological state. The effect that it becomes possible.

Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.
(A. Configuration)
FIG. 1 is a perspective view of an electronic device 10 according to an embodiment of the present invention.
The electronic device 10 is, for example, a PDA. As shown in FIG. 1, as shown in FIG. 1, for example, a display unit 110 formed by forming an LCD or the like in a rectangular panel shape is displayed on the display unit 110. And an input 200 for selecting data and commands to be executed. In the present embodiment, the case where the electronic device 10 is a PDA will be described. However, the electronic device 10 may be a mobile phone, a notebook personal computer, or a desktop personal computer. In short, any electronic device including a touch panel for inputting data and commands using an input element may be used.

As shown in FIG. 1, the input element 200 is a stylus formed in a pen shape, for example, and includes a magnetic field generation unit 210. In the present embodiment, as the magnetic field generator 210, for example, a permanent magnet formed in a rod shape is embedded in the input element 200 so as to be along the axial direction of the input element 200. On the other hand, in the main body 100, magnetic sensors 120a, 120b, 120c, and 120d are embedded one by one at positions corresponding to the four corners of the display unit 110, respectively. Hereinafter, when it is not necessary to distinguish each of the magnetic sensors 120a, 120b, 120c, and 120d, they are referred to as “magnetic sensor 120”. The magnetic sensor 120 functions as a detection unit that measures the strength and direction of the magnetic field generated by the magnetic field generation unit 210 and detects the three-dimensional position of the input element 200 relative to the display unit 110 and the direction indicated by the measurement result. Is.
In this embodiment, the case where the four magnetic sensors 120 embedded in the positions corresponding to the four corners of the display unit 110 detect the three-dimensional position of the input element 200 and the direction indicated by the four magnetic sensors 120 will be described. The number of sensors is not limited to four, and the embedded positions are not limited to the positions corresponding to the four corners of the display unit 110. In short, any mode in which three or more magnetic sensors are embedded in different positions of the main body 100 may be used. This is because if at least three magnetic sensors are embedded in different positions of the main body 100, the three-dimensional position of the input element 200 relative to the main body 100 and the direction indicated by the three-point surveying principle can be detected. It is. Further, in the present embodiment, a case where the magnetic field generation unit 210 embedded in the input element 200 is a permanent magnet will be described, but it is needless to say that an electromagnet may be used.

Next, the electrical configuration of the electronic device 10 will be described with reference to FIG.
FIG. 2 is a block diagram illustrating an example of an electrical configuration of the electronic device 10. As shown in FIG. 2, the electronic device 10 includes a control unit 130, an interface unit 140, a storage unit 150, and a bus 160 that mediates data exchange between these components.
The control unit 130 is, for example, a CPU (Central Processing Unit), and centrally controls each unit of the electronic device 10 according to software stored in the storage unit 150. The interface unit 140 is for connecting the display unit 110 and the magnetic sensor 120 and mediating data exchange between the display unit 110 and the magnetic sensor 120 and the control unit 130. More specifically, the interface unit 140 delivers the image data delivered from the control unit 130 to the display unit 110, and an image corresponding to the image data (for example, an image corresponding to a GUI screen for prompting various inputs). ) Is displayed from the magnetic sensor 120 and the data indicating the three-dimensional position of the input element 200 and the direction of the input element 200 are transferred to the control unit 130.
As shown in FIG. 2, the storage unit 150 includes a volatile storage unit 150a and a nonvolatile storage unit 150b. The volatile storage unit 150a is, for example, a RAM (Random Access Memory), and is used as a work area by the control unit 130 operating according to various software. On the other hand, the non-volatile storage unit 150b is, for example, a hard disk, and stores data and software for causing the control unit 130 to realize functions specific to the electronic apparatus according to the present invention. Hereinafter, data and software stored in the nonvolatile storage unit 150b will be described.

An example of the data stored in the nonvolatile storage unit 150b is a customization table shown in FIG. As shown in FIG. 3, in this customization table, two types of data of movement trajectory data and processing content data are written in association with each other. Here, the movement trajectory data is data representing a three-dimensional position of the input element 200 and a temporal change in the direction indicated by the input element 200 (hereinafter also referred to as “movement trajectory”). In the present embodiment, a characteristic of a curve or straight line drawn by the input element 200 in an operation performed according to the psychological state between input operations such as data and commands by the user of the electronic device 10 (for example, a curvature radius of the curve) And data representing the direction cosine of the straight line (hereinafter referred to as “feature data”) are stored in the customization table as the movement trajectory data. On the other hand, the processing content data is data representing processing according to the psychological state appearing on the movement locus represented by the movement locus data associated with the processing content data. Specifically, in the present embodiment, as the processing content data, data representing processing for causing the display unit 110 to display a message for relaxing the user's psychological state represented by the movement trajectory data associated with the processing content data. Is stored in the customization table.
For example, the movement trajectory data indicating that the user is frustrated (the movement trajectory data indicating the movement trajectory drawn by the input element 200 when the user taps the main body 100 with the input element 200 turned upside down) is included. , Process content data representing “a process of displaying a message to prompt the user to take a break on the display unit 110” is associated. Also, the movement trajectory data indicating that the user is bored (the movement trajectory data indicating the movement trajectory drawn by the input element 200 when the user turns the input element 200 with his / her fingertip) is “ Process content data representing “a process for displaying a message to prompt the user to concentrate on the display unit 110” is associated. Although details will be described later, the contents stored in the customization table are processed according to the user's psychological state appearing in the operation performed between data and command input operations (in this embodiment, the user's psychological state). This process is used when the control unit 130 executes a process of displaying a message having a content that alleviates the problem. In addition to the customization table, the nonvolatile storage unit 150b includes feature amount data (hereinafter, “predetermined trajectory data”) representing features of a predetermined trajectory drawn by the input element 200 by an input operation such as data and commands. Is stored in advance. The predetermined trajectory data is used when the control unit 130 determines whether or not the movement trajectory drawn by the input element 200 is due to an input operation.

On the other hand, examples of software stored in the nonvolatile storage unit 150b include OS software for causing the control unit 130 to implement an operating system (hereinafter referred to as “OS”) and a user using the electronic device 10. Processing execution software for causing the control unit 130 to execute processing according to the psychological state may be mentioned. Hereinafter, functions given to the control unit 130 operating according to these software will be described.
When the power supply (not shown) of the electronic device 10 is turned on, the control unit 130 first reads the OS software from the nonvolatile storage unit 150b and executes it. The control unit 130 operating in accordance with the OS software includes a function for controlling each unit of the electronic device 10, a time measurement function for measuring the passage of time, and other software in accordance with a user instruction, etc. A function to read out and execute from is added. In the present embodiment, the control unit 130 reads out the process execution software from the nonvolatile storage unit 150b and executes it as soon as the execution of the OS software is completed and the OS is realized. The control unit 130 operating according to the processing execution software is given the following four functions.
The first function is to specify the movement locus of the input element 200 by analyzing the three-dimensional position of the input element 200 detected by the magnetic sensor 120 and the time change of the direction indicated by the input element 200.
Second, the movement trajectory specified by the specific function is a predetermined movement trajectory drawn by the input element 200 by an input operation such as selection of “Yes” or “No” displayed in the dialog or clicking of an icon, for example. This is a first determination function for determining whether or not there is.
Third, when the first determination function determines that the movement locus specified by the specifying function is not the predetermined movement locus, movement locus data representing the movement locus is stored in the customization table. It is the 2nd determination function which determines whether it is.
Fourth, when it is determined by the second determination function that the movement locus data representing the movement locus specified by the specifying function is stored in the customization table, the movement locus data is associated with the movement locus data. It is a process execution function for executing a process represented by process content data stored in the customization table.

Due to such a configuration, according to the electronic device 10 according to the present embodiment, when the user inputs data or commands using the input element 200, the operation performed between the input operations is performed. A message corresponding to the appearing psychological state is displayed on the display unit 110. Thereby, for example, when the user is frustrated or bored, a message for relieving the psychological state is displayed on the display unit 110, and it becomes possible to relieve the frustration and boredom.
In the present embodiment, the electronic device 10 has the same configuration as that of a general computer device, and the four functions that are characteristic of the electronic device according to the present invention are implemented by software modules. Of course, the electronic device according to the present invention may be configured by combining the hardware modules having these functions. Specifically, the input element 200 for allowing the user to perform various input operations, and detection means (in this embodiment, the magnetic sensor 120) for detecting the three-dimensional position of the input element 200 and the pointing direction thereof. In addition to the above, the specifying means responsible for the specific function, the first determination means responsible for the first determination function, the second determination means responsible for the second determination function, and the process execution function Of course, the electronic apparatus according to the present invention may be configured by combining the processing execution means.

(B: Operation)
Next, among the operations performed by the electronic apparatus 10 according to the present embodiment, operations that significantly show the features will be described with reference to the drawings.
FIG. 4 is a flowchart illustrating a flow of a process execution operation performed by the control unit 130 of the electronic device 10 according to the process execution software. As shown in FIG. 4, the control unit 130 first specifies the movement locus of the input element 200 based on the three-dimensional position of the input element 200 detected by the magnetic sensor 120 and the direction indicated by the input element 200 (step SA1). Specifically, the control unit 1300 receives data representing the three-dimensional position of the input element 200 delivered from the magnetic sensor 120 via the interface unit 140 and data indicating the direction indicated by the input element 200 at predetermined time intervals. Write to the volatile storage unit 150a, and record the time change of the three-dimensional position of the input element 200 and the time change of the direction indicated by it. Then, the control unit 130 analyzes the data written in the volatile storage unit 150a by, for example, the least square method, etc., identifies a curve or a straight line representing the movement locus drawn by the input element 200, and determines the characteristics of the curve or the straight line. The feature amount data to be expressed is generated.

Next, the control unit 130 determines whether or not the movement locus specified in step SA1 is a predetermined movement locus representing an input operation of data and commands (step SA2). Specifically, the control unit 130 compares the feature amount data generated in step SA1 with each of the predetermined trajectory data stored in the nonvolatile storage unit 150b, and when both match or are similar to each other. In addition, the movement trajectory represented by the feature amount data is determined to be the predetermined movement trajectory. The fact that the feature amount data generated in step SA1 and the predetermined trajectory data are similar means that the difference between the two is a value within a predetermined range.
When the determination result in step SA2 is “Yes”, the control unit 130 performs input processing (that is, input of data and commands) corresponding to the movement locus specified in step SA1 (step SA3). On the contrary, when the determination result in step SA2 is “No”, the control unit 130 draws the movement locus specified in step SA1 by the input element 200 in the operation performed between the input operations. It is determined whether or not movement locus data representing the movement locus is stored in the customization table (see FIG. 3) (step SA4). Specifically, the control unit 130 compares the feature amount data generated in step SA1 with each movement trajectory data stored in the customization table, and if both match or are similar, the control unit 130 proceeds to step SA1. It is determined that the movement trajectory data representing the movement trajectory specified in this way is stored in the customization table.
Then, when the determination result in step SA4 is “Yes”, the control unit 130 associates the corresponding movement locus data (that is, movement locus data representing the movement locus specified in step SA1) with the customization table. The process indicated by the process content data stored in the is executed (step SA5).

As described above, in the present embodiment, the movement trace data representing the movement trace drawn by the input element 200 when the input element 200 is turned upside down and the display surface of the display unit 110 is tapped in small increments takes a break from the user. Processing content data representing processing for displaying a message prompting the display on the display unit 110 is associated, and the movement trajectory data representing the movement trajectory drawn by the input element 200 in the operation of turning the input element 200 is displayed to the user. Processing content data representing processing for displaying on the display unit 110 a message prompting to concentrate is associated.
For this reason, for example, when the user is frustrated and the input element 200 is turned upside down and the display surface of the display unit 110 is tapped, a message prompting the user to take a break is displayed on the display unit 110, and the user can work. When the user is bored and turns the input element 200 with his / her fingertip, a message prompting the user to concentrate on the work is displayed on the display unit 110. Thereby, when the user is frustrated or bored, the psychological state can be relaxed.

  As described above, according to the electronic device 10 according to the present embodiment, the user's psychology appearing in the operation performed between the input operations in a situation where various inputs are performed on the touch panel including the pen-type input element. Processing according to the state can be performed.

(C: deformation)
Although one embodiment of the present invention has been described above, it goes without saying that the following modifications may be made.
(C-1: Modification 1)
In the above-described embodiment, the psychological state of the user who is performing an input operation using the input element 200 is detected based on the movement trajectory of the input element 200 (a three-dimensional position or a time change in the pointing direction), and the The case where the process according to a psychological state is performed was demonstrated. However, in addition to the movement trajectory, the user's psychological state may be detected in consideration of the movement speed. This is because the psychological state of the user also appears at the moving speed, for example, the moving speed of the input element becomes faster as the degree of irritation gets worse. This is because, for example, data representing different movement speeds (movement speed data) is associated with each of a plurality of movement locus data representing the same movement locus, and the movement locus data and movement speed data are associated with each other. It is only necessary to associate unique processing content data with each pair. If it does in this way, even if it is the same psychological state, it will become possible to make the electronic device 10 perform various processes according to the degree.
In addition to the moving speed described above, the user's psychological state and the degree thereof may be detected by taking into account the degree of sweating of the user and the writing pressure at the time of input. Specifically, the input element 200 may be provided with a humidity sensor that measures the ambient humidity, and the degree of sweating of the user may be measured according to the detection result of the humidity sensor. A transparent pressure sensor formed in a sheet shape is placed on the sheet, and the user's writing pressure may be detected by the pressure sensor. The data representing the degree of sweating and writing pressure of the user estimated to be in a certain psychological state is associated with the movement trajectory data corresponding to the psychological state and the processing content data representing the processing corresponding to the psychological state, and customized. Store it in a table.

(C-2: Modification 2)
In the above-described embodiment, a case has been described in which movement trajectory data representing the operation of the input element 200 corresponding to the user's psychological state and processing content data representing processing corresponding to the psychological state are stored in the customization table in advance. . However, before the use of the electronic device 10 is started, it should be executed when movement trajectory data representing the movement trajectory drawn by the input element 200 in an operation corresponding to the user's own habit, and when that habit appears. Processing content data representing processing may be stored in the customization table. Such a thing is implement | achieved by providing the writing means which writes the said movement locus | trajectory data and the said process content data to the said memory | storage means according to a user's instruction | indication in the electronic device which concerns on embodiment mentioned above. . If it does in this way, there exists an effect that it becomes possible to make electronic device 10 perform processing according to each user's habit.

(C-3: Modification 3)
In the above-described embodiment, based on the characteristics of the movement locus drawn by the input element 200, whether the movement locus is a predetermined movement locus representing the input operation or the movement locus of the action according to the psychological state of the user. A case has been described in which the control unit 130 determines whether there is any. The reason for using the feature of the movement locus in this way is to cause the control unit 130 to execute the above determination regardless of the relative position of the movement locus with respect to the display unit 110. However, based on the movement locus itself, the movement locus is used. Of course, the control unit 130 may execute processing corresponding to the psychological state of the user represented by This is detected by the magnetic sensor 120 using data representing the three-dimensional position of the input element 200 and the time change in the direction indicated by the movement locus data stored in the customization table in association with the processing content data. The processing to be executed may be determined by comparing the three-dimensional position of the input element 200 or the time change in the direction indicated by the input locus 200 and the movement trajectory data.

(C-4: Modification 4)
In the above-described embodiment, the case where the electronic device 10 is caused to execute the process of displaying a message for relaxing the user's psychological state appearing on the movement locus of the input element 200 has been described. However, the content of the processing to be executed by the electronic device 10 is not limited to that intended to alleviate the user's psychological state, and may be content that promotes the user's willingness to work. The point is that the content of the message is not limited as long as the message is displayed according to the user's psychological state.
Moreover, although embodiment mentioned above demonstrated the case where the electronic device 10 performed the process which displays the message according to a user's mental state, the electronic device 10 is made to perform the process which outputs such a message with an audio | voice. Alternatively, the electronic device 10 may be caused to execute a process of playing BGM (Back Ground Music) according to the user's psychological state. In short, any process may be used as long as it is a process according to the psychological state of the user.

(C-5: Modification 5)
In the embodiment described above, a magnetic sensor type touch panel that detects the strength and direction of the magnetic field generated by the magnetic field generation unit 210 embedded in the input element 200 with the magnetic sensor 120 and identifies the movement locus of the input element 200 will be described. However, as long as the touch panel can specify the movement locus of the input element 200, it is needless to say that other types of touch panels may be used.

(C-6: Modification 6)
In the above-described embodiment, a case has been described in which software for causing the control unit 130 to realize a function specific to the electronic device according to the present invention is stored in advance in the nonvolatile storage unit 150b. However, for example, the software is recorded on a computer-readable recording medium such as a CD-ROM (Compact Disk-Read Only Memory) or a DVD (Digital Versatile Disk), and the magnetic sensor type is recorded using this recording medium. Of course, the above-described software may be installed in a computer device having a touch panel to provide the same function as the electronic apparatus according to the present invention.

1 is a perspective view of an electronic device 10 according to a first embodiment of the present invention. 2 is a diagram illustrating an example of a hardware configuration of the electronic device 10. FIG. 4 is a diagram showing an example of a customization table stored in a nonvolatile storage unit 150b of the electronic device 10. FIG. 4 is a flowchart showing a flow of processing execution operation performed by a control unit 130 of the electronic device 10.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Electronic device, 100 ... Main body, 110 ... Display part, 120, 120a, 120b, 120c, 120d ... Magnetic sensor, 130 ... Control part, 140 ... Interface part, 150 ... Memory | storage part, 150a ... Volatile memory part, 150b: nonvolatile storage unit, 160: bus, 200: input element, 210: magnetic field generation unit.

Claims (4)

An input and
Storage means in which a plurality of sets of movement trajectory data representing the movement trajectory of the input element and processing content data representing processing content corresponding to the movement trajectory data are written;
Detecting means for detecting a position of the input element or a direction indicated by the input element;
A specifying means for analyzing a time change of a detection result by the detecting means and specifying a movement locus of the input;
First determination means for determining whether or not the movement trajectory specified by the specifying means is a predetermined movement trajectory representing data or command input;
Whether or not movement trajectory data representing the movement trajectory is stored in the storage means when the first determination means determines that the movement trajectory specified by the specifying means is not the predetermined movement trajectory Second determination means for determining
When it is determined by the second determining means that the movement locus data representing the movement locus specified by the specifying means is stored in the storage means, the movement locus data is stored in the storage means in association with the movement locus data. And a processing execution means for executing processing represented by the processed content data. The movement trajectory data stored in the storage means is data representing characteristics of a curve or a straight line corresponding to the movement trajectory represented by the movement trajectory data,
The specifying means is:
Analyzing the time variation of the detection result by the detection means to identify the characteristic of the curve or straight line corresponding to the movement locus of the input element,
The first determination means includes
The electronic device according to claim 1, wherein it is determined whether or not a feature specified by the specifying unit and a characteristic of a curve or a straight line corresponding to the predetermined movement locus are identical or similar. The electronic apparatus according to claim 1, further comprising a writing unit that writes the movement trajectory data and the processing content data to the storage unit in response to a user instruction. The input is
It has a magnetic field generator that generates a magnetic field,
The detection means includes
Comprising at least three magnetic sensors arranged at different positions, measuring the strength or direction of the magnetic field generated by the magnetic field generation unit by each of the magnetic sensors, and specifying the position of the input element or the direction indicated by the input element. The electronic device according to claim 1.

Images