JP2019211587A - Writing act evaluation system - Google Patents

Abstract

To accurately visualize the writing ability of a user using a writing act.SOLUTION: A writing act evaluation system includes: a detection unit 101 for detecting a writing amount in a writing act using a writing instrument, and a writing speed in the writing act; and an information output unit 202 for outputting information corresponding to the writing amount in the writing act detected through the detection unit 101 so as to visually or audibly appeal to a user, and also outputting information corresponding to the writing speed in the writing act so as to visually or audibly appeal to the user.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a system for evaluating the writing ability of users, particularly children who are educated and study hard.

  A system for measuring a handwriting that is a locus of movement of a writing tip of a writing instrument during a writing action is known (see Patent Documents 1 to 3 below). This type of system is mainly used in offices and the like to convert written characters, drawn figures, and the like into digital data and import them into information processing terminals such as smartphones and personal computers.

  There is also a timing device (stopwatch) that can be attached to a writing instrument and measures the time during which a child or the like is writing or studying using the writing instrument (see Patent Document 4 below).

  By the way, recently, in education for children and the like, the focus is on developing writing skills. In particular, emphasis is placed on the ability to execute without being conscious of writing, which is located between transcription or calligraphy and composition, and the power that is the basis of thought that is equivalent to multiplication of arithmetic. This is called “writing power”. If the ability to write is high, it is possible to write while thinking and think while writing. In addition, the improvement of writing ability is expected to lead to the improvement of reading ability. Therefore, through daily study and training, children's brains can be written as letters even from what they care about writing letters (the cognitive burden of writing work is heavy). It is required to evolve to a state where you can concentrate (the cognitive load of writing work is light).

Japanese Patent Laid-Open No. 2006-024504 JP 2004-274518 A JP 2004-029915 A Japanese Patent No. 5176046

  An object of the present invention is to accurately visualize the writing ability of a user who uses a writing instrument in a writing act.

  In the present invention, a detection unit that detects a writing amount in a writing act using a writing instrument and a writing speed in the writing act, and information according to the writing amount in the writing act detected through the detection unit A writing action evaluation system comprising an information output unit that outputs in a manner that appeals to the sense of sight or hearing, and that outputs information corresponding to the speed of writing in the manner of appealing to the user's vision or hearing did.

  Increasing the amount of writing means getting used to writing and increasing the achievement of learning and training. On the other hand, writing faster and faster writing suggests that writing ability has improved and that you can concentrate on studying and other tasks that involve writing. The present invention pays attention to this point, and outputs to the user information corresponding to the speed of writing as well as the amount of writing, and tells the user how much power is currently written. At the same time, it is possible to make the user aware of the speed of writing.

  The information output unit, depending on the speed of writing detected through the detection unit during the writing operation, on the condition that the writing amount in the writing operation detected through the detection unit has reached a predetermined threshold value Output different information.

  The writing act evaluation system according to the present invention is typically an information processing terminal that is attached to a writing instrument and includes a writing instrument side device that includes the detection unit and the information output unit that can exchange data between the writing instrument side device. And the element. In addition, the writing instrument side device stores the writing amount in the writing act and the writing speed in the writing act acquired by the detection unit, and the stored writing amount and the writing speed are stored in the information processing. The information processing terminal that transmits the information to the information processing terminal in a state where it can communicate with the terminal and receives the information outputs the information based on the writing amount and the writing speed in the information output unit.

  If the detection unit has an acceleration sensor that measures the acceleration of the movement of the writing tip of the writing instrument, the acceleration sensor is used to simplify both the writing amount in the writing action and the writing speed in the writing action. Can be calculated and acquired.

  The writing instrument side device used for constituting the writing act evaluation system according to the present invention detects the writing amount in the writing act using the writing instrument and the writing speed of the writing instrument in the writing act, and the detected writing act And a detection unit that stores the writing speed, and a transmission that transmits the writing amount and the writing speed detected and stored by the detection unit to the information processing terminal in a state where the information processing terminal can communicate with the information processing terminal. A part.

  The writing instrument side device is preferably detachable with respect to the writing instrument used for the writing act.

  The program used to configure the writing act evaluation system according to the present invention is transmitted from the writing instrument side device attached to the writing instrument to the information processing terminal, the writing amount in the writing act using the writing instrument, and the writing act A receiving unit that receives the speed of writing, and outputs information according to the writing amount received by the receiving unit in a manner that appeals to the user's sight or hearing, and according to the writing speed received by the receiving unit It functions as an information output unit that outputs information that appeals to the user's visual or auditory sense.

  According to the present invention, it is possible to accurately visualize a user's writing ability in a writing act.

The perspective view which shows the writing instrument side apparatus and information processing terminal which are the elements of the writing action evaluation system of one Embodiment of this invention. The figure which shows the hardware resources with which the writing instrument side apparatus of the embodiment is provided. The functional block diagram of the writing act evaluation system of the embodiment. The figure which shows the hardware resources with which the information processing terminal of the embodiment is provided. The flowchart which shows the example of the procedure of the process which the writing instrument side apparatus of the embodiment performs in order to acquire the data regarding a writing action. The figure which shows operation which a user performs as execution start conditions of transmission / reception of the data regarding the writing action from the writing instrument side apparatus of the embodiment to an information processing terminal. The flowchart which shows the example of the procedure of the process performed in order that the writing instrument side apparatus and information processing terminal of the embodiment may transmit / receive the data regarding a writing action. The figure which shows the example which the information processing terminal of the embodiment outputs different information according to the amount of writing and the speed of writing. The figure which shows the example which the information processing terminal of the embodiment outputs different information according to the speed of writing.

  An embodiment of the present invention will be described with reference to the drawings. As shown in FIG. 1, the writing activity evaluation system in the present embodiment includes a writing instrument side device 1 attached to the writing instrument 0 used for the writing act and an information processing terminal 2 capable of communicating with the writing instrument side device 1. The main component. The writing instrument side apparatus 1 plays a role of obtaining quantified data related to a writing action using the writing tool 0, for example, a writing amount and a writing speed in the writing action. The information processing terminal 2 receives data related to the writing action acquired by the writing instrument side device 1 from the writing instrument side device 1 and outputs information corresponding to the data in a manner appealing to the user's vision or hearing.

  The writing instrument side device 1 can be retrofitted to a ready-made writing instrument 0 such as a pencil, a mechanical pencil, or a ballpoint pen. For this purpose, a holding unit 11 that holds the writing instrument 0 is provided in the casing of the writing instrument side apparatus 1. The holding part 11 is, for example, an insertion hole through which the writing instrument 0 can be inserted and held, and is a clip or a clamp that holds and holds the writing instrument 0 or fits on the outer periphery of the writing instrument 0. It doesn't matter. The housing of the writing instrument side apparatus 1 may have a grip portion 12 that is gripped by the finger of a user who performs a writing act using the writing instrument 0. In the present embodiment, the writing instrument side device 1 can be attached to and detached from the writing instrument 0, and the writing instrument side device 1 can be commonly used for several writing instruments 0. However, the writing instrument side device 1 is not integrated with the writing instrument 0 and cannot be detached from the writing instrument 0, or does not hinder the aspect of being built in the writing instrument 0.

  As shown in FIG. 2, the writing instrument side apparatus 1 is a microcomputer system including hardware resources such as a processor 1a, a main memory 1b, an auxiliary storage device 1c, an acceleration sensor 1d, a communication interface 1e, and a battery 1f. The auxiliary storage device 1c is a flash memory, for example. The acceleration sensor 1d is, for example, a function of a triaxial acceleration sensor that measures acceleration along three directions of the X axis, the Y axis, and the Z axis that are orthogonal to each other, the θ direction around the X axis, and the Y axis. It is a so-called six-axis acceleration sensor or nine-axis acceleration sensor that also has the function of a three-axis rotation angular velocity sensor (gyro sensor) that measures angular velocities along the rotation directions of the φ direction and the Ψ direction around the Z axis. . The acceleration sensor 1d can detect the acceleration of the movement of the writing instrument 0 (the tip of the writing instrument), can calculate the speed of the movement of the writing instrument 0 through the time integration of acceleration or the time series of the acceleration measured repeatedly, and the time integration of the speed Alternatively, the displacement amount of the movement of the writing instrument 0 can be calculated through integration of the time series of the repetitively calculated speed. Incidentally, the nine-axis acceleration sensor also has a function of a three-axis geomagnetic sensor (electronic compass) for knowing the direction of east, west, south, and north, but the function of this geomagnetic sensor is not always necessary.

  The communication interface 1e is a device for performing data communication between the writing instrument side device 1 and the external information processing terminal 2, and is, for example, Bluetooth (registered trademark), a wireless LAN (Local Area Network), or a mobile phone network. , A wireless transceiver for performing wireless communication via a WiMAX (Worldwide Interoperability for Microwave Access) network or the like, or an RFID (Radio Frequency IDentification) card or chip. The battery 1f supplies power necessary for the hardware resources. In addition, instead of the battery 1f or together with the battery 1f, a power generation device that generates power using the motion (vibration) applied to the writing instrument side device 1 or the temperature of the user gripping the grip portion 12 and supplies or charges the power, It is also conceivable to mount on the writing instrument side device 1.

  In the writing instrument side apparatus 1, a program to be executed by the processor 1a is stored in the auxiliary storage device 1c. When the program is executed, the program is read from the auxiliary storage device 1c into the main memory 1b and decoded by the processor 1a. Is done. The writing instrument side apparatus 1 operates the hardware resources according to a program, and exhibits the functions as the detection unit 101 and the transmission unit 102 shown in FIG.

  The information processing terminal 2 is, for example, a general-purpose mobile phone terminal, particularly a smartphone, a personal computer, a video game machine, or the like. As shown in FIG. 4, the information processing terminal 2 includes a processor 2a, a main memory 2b, an auxiliary storage device 2c, a video codec 2d, an audio codec 2e, a communication interface 2f, an input device 2g, a display 2h, an audio output device 2i, and a battery. Hardware resources such as 2j are provided, and these are controlled by a controller (system controller, I / O controller, etc.) 2k to operate in cooperation. The auxiliary storage device 2c is a flash memory, a hard disk drive, an optical disk drive, or the like. The video codec 2d generates a screen to be displayed based on the drawing instruction received from the processor 2a, and transmits the screen signal to the display 2h. The video codec 2d temporarily stores the screen and image data. A video memory or the like to be stored is used as an element. The audio codec 2e decodes the encoded audio data and outputs the audio from the audio output device 2i. Each of the video codec 2d and the audio codec 2e can be implemented as software instead of hardware.

  The communication interface 2f is a device for the information processing terminal 2 to perform data communication with an external device or computer including the writing instrument side device 1, and is, for example, Bluetooth (registered trademark), wireless LAN, mobile phone network , A wireless transceiver for implementing wireless communication via a WiMAX network or the like, or an RFID card reader. The input device 2g is a touch panel (which may be superimposed on the display 2h), a push button, a mouse, a keyboard, or the like that is operated by a user's fingers, or a voice input device that allows a user to input a command with a real voice. . The battery 2j supplies power necessary for the hardware resource.

  In the information processing terminal 2, the program to be executed by the processor 2a is stored in the auxiliary storage device 2c, and is read from the auxiliary storage device 2c into the main memory 2b and decoded by the processor 2a when the program is executed. Is done. The information processing terminal 2 operates the hardware resources according to the program, and exhibits the functions as the receiving unit 201 and the information output unit 202 shown in FIG.

  Hereinafter, the function of each part of this system will be described in detail. The detection unit 101 of the writing instrument side apparatus 1 uses the acceleration sensor 1d to acquire quantified data related to the writing action using the writing instrument 0 by the user. Then, the data is stored and held in a required storage area of the main memory 1b or the auxiliary storage device 1c.

  In the present embodiment, the data related to the writing action includes the writing amount in the user writing action and the writing speed in the writing action. The amount of writing indicates the amount of writing performed by the user. More specifically, they are the integrated value of the time when the writing action was performed, the integrated value of the displacement, which is the distance that the writing tip of the writing instrument 0 moved in the writing action, the number of strokes written, or the number of characters written. It can be said that as the amount of writing increases, the user gets used to writing or the achievement level of learning and training increases. The speed of writing indicates the speed of carrying in writing, and the number of strokes and characters written by the user within a certain period of time. More specifically, the angular velocity or speed of the movement of the writing tip of the writing instrument 0 during the writing action. The faster the writing, that is, the faster it can be written, the higher the user's ability to write, and it can be said that they can concentrate on studying and other tasks involving writing.

  The information processing terminal 2 is not involved in the collection of data related to the writing act by the writing instrument side apparatus 1, and the presence of the information processing terminal 2 and the communication between the writing instrument side apparatus 1 and the information processing terminal 2 are not necessary.

  In FIG. 5, the procedure of the process for acquisition of the data regarding the writing action in the detection part 101 of the writing instrument side apparatus 1 is shown. The detection unit 101 of the writing instrument side apparatus 1 detects triaxial accelerations [X, Y, and X] via the acceleration sensor 1d every predetermined time, for example, every frame (one frame is 1/30 second or 1/60 second). Z] and the angular velocity [θ, φ, Ψ] of rotation about three axes are obtained (step S1). The writing instrument side device 1 is fixed to the writing instrument 0 used by the user, and the acceleration and the angular velocity measured by the acceleration sensor 1d indicate the acceleration and angular velocity of the movement of the writing instrument 0 (the writing tip). At this time, a predetermined axis of the acceleration sensor 1d, for example, the Z axis is set in advance so as to be parallel or substantially parallel to the axial direction of the writing instrument 0, in other words, the direction in which the writing instrument 0 extends.

  The acceleration and angular velocity acquired in step S1 may be raw values output from the acceleration sensor 1d, or calculated values obtained by calculation based on the output value of the acceleration sensor 1d, that is, the output of the acceleration sensor 1d. It may be a value calculated by substituting a raw value to be substituted into a predetermined function expression. For example, when the Z axis of the acceleration sensor 1d is aligned with the direction in which the axis of the writing instrument 0 extends, the writing surface (the surface of paper to be written) on which writing is performed in the writing action using the writing instrument 0 is performed. It is assumed that the Z-axis is substantially orthogonal and the writing tip of the writing instrument 0 is displaced in the X-axis direction and the Y-axis direction during writing. However, it is not guaranteed that the Z axis and the writing surface are always orthogonal, and it is natural that the Z axis is inclined with respect to the writing surface. Therefore, in order to accurately know the acceleration, speed, or displacement amount of the movement of the writing tip on the writing surface, after detecting the inclination of the Z axis with respect to the writing surface, that is, the horizontal plane based on the gravity acting on the acceleration sensor 1d, It is necessary to convert the raw output values [X, Y, Z] of the acceleration sensor 1d into acceleration values [X ′, Y ′, Z ′] after inclination correction. If the angle with respect to the writing surface of the Z axis, which is the axis of the writing instrument 0, is constant during writing, the acceleration value [X ′, Y ′] after the inclination correction is the acceleration of the movement of the writing tip on the writing surface, that is, Is the acceleration along the biaxial directions parallel to the writing surface and orthogonal to each other. In addition, the acceleration value along the Z′-axis direction is 0 unless the writing tip approaches or separates from the writing surface (the Z′-axis direction is a direction perpendicular to the writing surface. Of course, unless one stroke is written, Naturally, the brush tip is displaced in the Z ′ direction).

  However, since the angle of the axis of the writing instrument 0 can change during the writing action, the angle change, that is, the rotation is detected using the function of the acceleration sensor 1d as the angular velocity sensor, and the acceleration value [X By applying a rotation matrix that cancels the rotation of the writing tool 0 to [', Y', Z '], it is possible to calculate the acceleration of the movement of the writing tip on the writing surface with higher accuracy.

  Nonetheless, the demands on the accuracy of data related to writing are not necessarily very high. In addition, the actual writing surface is not always horizontal, the top plate is slightly inclined like a desk in a university lecture room, or the writing surface is vertical as when writing on a whiteboard. It is also possible. Therefore, it is not essential to perform the above correction on the output value of the acceleration sensor 1d.

  The acceleration and angular velocity acquired in step S1 may be obtained by applying some filtering process to the raw value output from the acceleration sensor 1d. When the output value of the acceleration sensor 1d frequently fluctuates or pulsates, the moving average of the output value of the acceleration sensor 1d is calculated, or the output value of the acceleration sensor 1d is subjected to low-pass filter processing, thereby changing or pulsating. Suppressed proper acceleration and angular velocity can be obtained.

Next, the detecting unit 101 sets a predetermined number of consecutive frames, for example, ten frames as one period, and for each period, the absolute value of acceleration of each frame included in the period (for example, √ (X ² + Y ² )) Or, the sum of √ (X ′ ² + Y ′ ² )) (sum of absolute values of ten accelerations) is calculated. Then, on the condition that the total value exceeds the determination threshold (step S2), the period is counted as “writing time” during which the user performs a writing act (step S4). Otherwise, the period is counted as “time not written” when the user does not write (step S5).

  However, even if the sum of the absolute values of the acceleration of each frame in a certain period exceeds the determination threshold value, it cannot be immediately determined that the period is the “writing time”. This is because the acceleration of the movement of the writing instrument 0 detected by the acceleration sensor 1d may increase due to factors other than the writing action. When the user is a child or the like, it is not difficult to imagine playing with the writing instrument 0 being shaken, rotated, or rolled. Therefore, even if the determination result of step S2 is true, the detection unit 101 detects the absolute value of the acceleration or angular velocity of the movement of the writing instrument 0 detected via the acceleration sensor 1d in the period or the frame included in the period. Is greater than or equal to the predetermined upper limit value (step S3), it is determined that the large exercise is not due to a writing act, and the period is counted as “time not written” when the user does not perform the writing act. (Step S5).

  The acceleration or angular velocity value referred to in step S3 (compared with the upper limit value) may be a raw output value of the acceleration sensor 1d, or a calculated value obtained by calculation based on the output value of the acceleration sensor 1d. In particular, it may be a value subjected to the above-described correction, filter processing, or the like. It is also arbitrary whether to refer to the acceleration in any direction of the X axis, the Y axis, or the Z axis, or to refer to the angular velocity in any rotation direction of the θ direction, the φ direction, or the Ψ direction. When the Z axis of the acceleration sensor 1d is aligned with the direction in which the axis of the writing instrument 0 extends, the absolute value of the acceleration in the Z axis direction becomes excessive when the user swings the writing instrument 0 up and down, and when the writing instrument 0 is shaken left and right It is expected that the absolute value of acceleration in the X-axis or Y-axis direction will be excessive. In addition, it is expected that the absolute value of the angular velocity in the θ direction or φ direction will be excessive when the user turns the writing instrument 0, and that the absolute value of the angular velocity in the Ψ direction will be excessive when the writing instrument 0 is rolled around the axis. The detection unit 101 is an upper limit value corresponding to the absolute values of the X-axis direction acceleration, the Y-axis direction acceleration, the Z-axis direction acceleration, the θ-direction angular velocity, the φ-direction angular velocity, and the ψ-direction angular velocity measured for each frame in the target period. If any of them exceeds or exceeds the upper limit value, the period is counted as “time not written”. Alternatively, the sum of absolute values of the X-axis direction acceleration of each frame included in the period (sum of 10 absolute values), the sum of absolute values of the Y-axis direction acceleration, and the sum of absolute values of the Z-axis direction acceleration Value, the sum of absolute values of θ-direction angular velocity, the sum of absolute values of φ-direction angular velocity, and the sum of absolute values of ψ-direction angular velocity are compared with the corresponding upper limit values. If it exceeds, it is good also as counting the said period in "time not written". The upper limit value may be set individually for each axial direction or rotational direction, may be the same value in the triaxial direction, or may be the same value in all rotational directions.

  Alternatively, in step S3, the average value, median value, maximum value, or the like of the speed (absolute value) or displacement (absolute value) of the writing instrument 0 in the target period is compared with a predetermined upper limit value, When the former is greater than or greater than the latter, the period may be counted as “non-writing time” when the user is not writing. The speed or amount of displacement of the writing instrument 0 during the period can be calculated based on the acceleration and / or angular velocity detected via the acceleration sensor 1d during the period.

  The number of periods of “writing time” counted through steps S1 to S5 corresponds to the writing amount of the writing act performed by the user using the writing instrument 0. And the total value of the counted number of “Writing time” and the number of “Writing time” period is the total time that the user was holding the writing instrument 0, including the time other than writing. Corresponds to the length of The detection unit 101 of the writing instrument side apparatus 1 stores at least the number of periods of “writing time” corresponding to the writing amount in the main memory 1b or the auxiliary storage device 1c. In addition, the sum of the number of periods of “time not written” and / or the number of periods of “time written” and the number of periods “time not written” is stored in the main memory 1b or the auxiliary storage device 1c. Remember.

In addition, for each period determined to be “writing time”, the detection unit 101 calculates the absolute value of the acceleration of each frame included in the period (for example, √ (x ² + y ² ) or √ (X ′ ² + Y ' ² )) is summed up (the sum of the absolute values of the ten accelerations) is evaluated in stages, for example, in five stages (step S6). That is, it is determined in which range of the five rank categories the sum of the absolute values of acceleration exceeding the determination threshold value in step S3 is located. This means that the brush stroke speed in the period is evaluated in five levels. Then, the frequency of occurrence of the five-level evaluation is counted (step S7). For example, if the sum of the absolute values of acceleration of a certain period is within the range of the C rank, the value of the occurrence frequency of the C rank is increased by one.

  The occurrence frequency of each rank counted through steps S6 and S7 suggests the speed of writing in the writing action performed by the user using the writing instrument 0. The detection unit 101 of the writing instrument side apparatus 1 uses the main memory 1b or the auxiliary value as the histogram of the occurrence frequency of each rank, that is, the occurrence frequency of the A rank, the occurrence frequency of the B rank,. Store in the storage device 1c. If the number of periods counted in “writing time” is 500, the total value of the occurrence frequency of rank A, the occurrence frequency of rank B,. When evaluating the speed of writing by the user, the rank with the highest occurrence frequency, or the occurrence frequency and rank score value of each rank (for example, 5 for A rank, 4 for B rank, ..., E rank) Then, the average value or median value of the sum of the product with 1) for all ranks can be used as an index for the evaluation.

  The detection unit 101 repetitively executes the above steps S1 to S7, thereby acquiring data related to the writing action using the writing instrument 0 of the user, that is, the writing amount and the writing speed in the writing action, and the main memory 1b or It is stored and held in the auxiliary storage device 1c. The output value of the acceleration sensor 1d obtained during the period determined as “non-writing time” in step S2 or S3, and the writing amount and writing speed calculated based on the output value are obtained as data relating to writing act. (I.e., it is not counted as "writing time", nor is it subject to a five-step evaluation of writing speed. The counting of "not writing time" corresponds to data related to writing act, not writing amount. Do not remember).

  Note that the detection unit 101 may calculate and store an accumulated value of the displacement amount of the writing tip of the writing instrument 0 in the period determined as “writing time” as the writing amount in the writing act. In addition, as the writing speed in the writing action, the detection unit 101 determines the average value or median value of the movement speed of the writing tip of the writing instrument 0 in the period determined as “writing time”, “writing time”. The value obtained by dividing the integrated value of the displacement of the writing tip of the writing instrument 0 in the period determined as “the writing time” by the number of periods (after all, the displacement of the writing tip per unit time), or one of them The occurrence frequency of each rank when evaluated may be calculated and stored.

  The transmission unit 102 of the writing instrument side apparatus 1 uses the communication interface 1e, and the data relating to the writing action using the writing instrument 0 by the user, which is detected by the detection unit 101 and stored in the main memory 1b or the auxiliary storage device 1c. Is transmitted to the information processing terminal 2. The receiving unit 201 of the information processing terminal 2 receives the data related to the writing action transmitted from the writing instrument side device 1 using the communication interface 2f, and stores the received data in the main memory 2b or the auxiliary storage device 2c. Store and hold in the area.

  In the present embodiment, as shown in FIG. 6, the user attaches the end portion of the writing instrument 0 attached to the writing instrument side apparatus 1 (the front end portion having the writing tip or the rear end portion on the side opposite to the writing tip may be used). , An operation of tilting downward from the top toward the information processing terminal 2 (an operation of changing the posture of the writing instrument 0 from the position in which the writing instrument 0 is laid down (closer to horizontal) to the posture in which the writing instrument 0 is raised (closer to vertical)) Data between the writing instrument side device 1 and the information processing terminal 2 triggered by an operation as if water stored in the writing instrument 0 was poured into the information processing terminal 2 from the end of the writing instrument 0 Begin giving and receiving. In this operation, the writing amount of the writing action performed by the user using the writing tool 0 is regarded as a certain kind of energy or power, and the energy or power accumulated by the user in the writing tool 0 through the writing action is poured into the information processing terminal 2. Simulates behavior.

  In FIG. 7, the procedure of the process for transmission / reception of the data regarding a writing action by the transmission part 102 of the writing instrument side apparatus 1 and the receiving part 201 of the information processing terminal 2 is shown. The transmitting unit 102 of the writing instrument side device 1 is ready for the previous stage of data transmission / reception (step S8), and then rotates around the three axes of the writing instrument 0 via the acceleration sensor 1d every predetermined time, that is, every frame. The angular velocity [θ, φ, Ψ] of rotation is obtained (step S9).

  The branch determination in step S8 becomes true when, for example, the user operates a predetermined button or switch mounted on the writing instrument side apparatus 1 itself. Alternatively, the user performs a specific operation via the input device 2 g of the information processing terminal 2, and a signal or information indicating that is transmitted from the information processing terminal 2 to the writing instrument side apparatus 1. True when received. Of course, the operation of turning the end of the writing instrument 0 downward is also performed during writing. Therefore, step S8 is intended to prevent transmission of data from the writing instrument side apparatus 1 to the information processing terminal 2 from being started during writing, even though the user does not intend.

  The angular velocity acquired in step S9 may be a raw value output from the acceleration sensor 1d, or may be a raw value output from the acceleration sensor 1d subjected to some filter processing.

  Thus, the transmitting unit 102 of the writing instrument side apparatus 1 uses the Euler angle or the quaternion (quaternary) as the time series of the angular velocity [θ, φ, Ψ] of the rotation of the writing instrument 0 detected via the acceleration sensor 1d every predetermined time. The number is transmitted to the information processing terminal 2 in any numerical format (step S10).

  The receiving unit 201 of the information processing terminal 2 receives the time series of the angular velocity of the rotation of the writing instrument 0 every predetermined time, which is provided from the writing instrument side apparatus 1 (step S11). And based on this, it is determined whether the user performed operation which inclines the edge part of the writing instrument 0 toward the information processing terminal 2 (step S12). When it is determined that the user has performed an operation of tilting the end of the writing instrument 0 toward the information processing terminal 2, a signal or information indicating that is transmitted to the writing instrument side apparatus 1 (step S13).

  The transmitter 102 of the writing instrument side apparatus 1 receives the above signal or information from the information processing terminal 2 (Step S14), and stores the data stored in the main memory 1b or the auxiliary storage device 1c. Transmission for the information processing terminal 2 is started (step S15).

  In steps S10 to S14 described above, the information processing terminal 2 determines and confirms that an operation of tilting the end of the writing instrument 0 toward the information processing terminal 2 is performed by the user's hand. However, in the writing instrument side apparatus 1, it is determined whether or not such an operation has been performed based on the time series of the angular velocity of the rotation of the writing instrument 0 every predetermined time. The transmission to the information processing terminal 2 may be executed (step S15). If it is determined in the writing instrument side apparatus 1 whether or not the operation is performed, steps S10 to S14 can be omitted.

  The data transmitted from the writing instrument side apparatus 1 to the information processing terminal 2 in step S15 is the data related to the user's writing action, and indicates the number of periods of “writing time” indicating the writing amount and the writing speed. Occurrence frequency of each rank of the five-level evaluation shown, and the number of periods of "unwritten time" and / or the total number of periods of "written time" and period of "unwritten time" including.

  The receiving unit 201 of the information processing terminal 2 receives the data provided from the writing instrument side apparatus 1 (step S16) and stores it in the main memory 2b or the auxiliary storage device 2c. At this time, in the information processing terminal 2, the newly received “writing time” is added to the number of “writing time” periods received in the past and stored in the main memory 2b or the auxiliary storage device 2c. The number of periods may be added. In addition, the newly received histogram of the frequency of occurrence of each rank may be added to the histogram of the frequency of occurrence of each rank in the five-stage evaluation of writing speed received and stored in the past. In addition, the number of periods of “unwritten time” received and stored in the past, or the sum of the number of periods of “writing time” and the number of periods of “unwritten time” has been newly added. May be added to the number of periods of “time not written” or the sum of the number of periods of “time written” and the number of periods of “time not written”.

  The data transmission / reception in steps S15 and S16 may be completed as quickly as possible. However, the larger the data value stored or held in the writing instrument side apparatus 1 or the larger the amount of data, the more data transmission / reception is possible. It is also possible to produce an effect that takes a long time to complete. More specifically, the length of time that the transmission unit 102 of the writing instrument side device 1 and the receiving unit 201 of the information processing terminal 2 maintain the state where the user tilts the end of the writing instrument 0 toward the information processing terminal 2. The transmission / reception of data is completed on the condition that the threshold value exceeds the threshold value, and the threshold value is set to be larger (longer) as the number of periods of “writing time” stored in the writing instrument side device 1 is larger, Alternatively, the larger the frequency of occurrence of each rank of the five-step evaluation of the writing speed stored in the writing instrument side device 1, the larger the setting. In other words, the more energy or power that the user has accumulated in the writing instrument 0 through the writing action, the longer it takes for the energy or power to flow into the information processing terminal 2.

  Until the data transmission / reception is completed, that is, while the user keeps the end of the writing instrument 0 tilted toward the information processing terminal 2 (the length of time for which the state is maintained has reached the threshold value). As a function of the receiving unit 201 of the information processing terminal 2, information for making the user aware that the transmission / reception process is in progress, in other words, for allowing the user to recognize that the state should still be maintained is provided. It is also preferable to output in a manner that appeals to the visual or auditory sense of the user. For example, during transmission / reception, a moving image in which water is poured may be displayed on the screen of the display 2h, or a sound effect such as a sound in which water is poured is output from the audio output device 2i. Also good.

  Further, in the case where the transmission / reception of data is not immediately completed as described above, the data value stored in the main memory 1b or the auxiliary storage device 1c of the writing instrument side apparatus 1 during the transmission / reception, particularly “writing” Data stored in the main memory 2b or the auxiliary storage device 2c of the information processing terminal 2 while gradually changing (gradually decreasing) the value of the occurrence frequency of each rank in the five-stage evaluation of the number of periods of time and the speed of writing It is also possible to perform processing so as to gradually change (gradually increase) the value, in particular, the number of periods of “writing time” and the value of the occurrence frequency of each rank in the five-stage evaluation of writing speed.

  When the user stops maintaining the state in which the end of the writing instrument 0 is tilted toward the information processing terminal 2 before the time exceeds the threshold, the transmission / reception of data itself May be canceled, that is, the data stored in each of the writing instrument side device 1 and the information processing terminal 2 may be the data before the start of transmission / reception (or recovered to the data before transmission / reception). Alternatively, if a process of gradually changing the data value stored in each of the writing instrument side device 1 and the information processing terminal 2 during transmission / reception is performed, the user stops maintaining the above state The data value may be stored and held in the writing instrument side device 1 and the information processing terminal 2. Whether or not the user keeps the end of the writing instrument 0 tilted toward the information processing terminal 2 during the transmission / reception is determined by determining whether the user holds the end of the writing instrument 0 as the transmission / reception start condition. In accordance with a procedure similar to that for determining whether or not an operation of tilting toward is performed, the determination result is transmitted (transmitted) from the information processing terminal 2 to the writing instrument side device 1 after being executed on the information processing terminal 2 side. Alternatively, the writing instrument side device 1 itself may make the determination.

  After the data transmission / reception (steps S15 and S16) between the writing instrument side apparatus 1 and the information processing terminal 2 is completed, the writing instrument side apparatus 1 has been stored in the main memory 1b or the auxiliary storage device 1c until then. Erasing the transmitted data from the main memory 1b or the auxiliary storage device 1c, in other words, the number of periods of “writing time”, the number of periods of “not writing time”, and the speed of writing The frequency of occurrence of each rank of evaluation is reset to 0 (step S17).

  The transmitting unit 102 of the writing instrument side device 1 and the receiving unit 201 of the information processing terminal 2 block communication between the two in a period other than the time when the data transmission / reception in steps S8 to S17 described above is performed, that is, wirelessly directed toward each other. Signal transmission is stopped, thereby reducing power consumption.

  The information output unit 202 of the information processing terminal 2 receives information from the writing instrument side device 1 and stored in the main memory 2b or the auxiliary storage device 2c according to the data related to the writing action performed by the user using the writing instrument 0. , Output in a manner appealing to the user's visual or auditory sense.

  For example, as shown in FIG. 8, based on the writing amount (accumulated value) of the writing action that the user has performed so far, as the information indicating the writing amount visually, the tree 21 that greatly increases as the writing amount increases. Such an image is generated or selected and displayed on the screen of the display 2h. At this time, different audio information such as timbre, melody, and loudness may be generated or selected according to the amount of writing performed by the user so far and output from the audio output device 2i.

  The amount of writing can be said to be the result of the user's previous study or training, etc., and by presenting this to the user in a timely manner, the writing act using the writing instrument 0 has game characteristics, especially for children etc. Inspire users' willingness to study.

  In addition, as shown in FIGS. 8 and 9, the information output unit 202 of the information processing terminal 2 is a histogram of the frequency of occurrence of each rank in the five-stage evaluation of the writing speed of the writing action that the user has performed so far. ) To generate or select an image in which different types of fruits 22 will appear on the tree 21 according to the speed of writing as information visually indicating the speed of writing, and display it on the screen of the display 2h. Let For example, when the writing speed is lower than a low rank or lower than a certain low value, as shown in FIG. 9A, the cherry 22 is born, and the high rank or certain high value with a writing speed is high. If it is higher than that, the banana 22 will be fruited as shown in FIG. 9 (c), and if the speed of writing is between them, the apple 22 will be fruited as shown in FIG. 9 (b). , And so on. At this time, different audio information such as timbre, melody, and loudness may be generated or selected according to the writing speed of the writing action performed by the user so far, and output from the audio output device 2i. As described above, the speed of writing in the past writing action of the user depends on the rank with the highest occurrence frequency among the occurrence frequencies of each rank of the five-level evaluation, the occurrence frequency of each rank, and the score value of the rank. Can be evaluated from the average or median of the sums of all ranks. If the frequency of occurrence of D rank was the highest, it can be evaluated that the user's writing speed is slightly slower than the medium, and there is room for growth or improvement, and if the frequency of occurrence of A rank is the highest, It can be evaluated that the user's writing has become considerably faster and the ability to write out has increased. If the average value or median value of the product of the rank occurrence frequency and the rank score value is referred to, it can be evaluated that the higher the value, the faster the user's writing.

  The ability of the information processing terminal 2 to present not only the amount of writing by the user so far but also the speed of writing in the writing act leads to making the user such as children especially aware of the speed of writing, and the ability to write out It is expected to contribute to the cultivation of If you are in the lower grades of elementary school, you can write 15 to 20 characters per minute, if you are in the middle grade you can write 20 to 25 characters per minute, and if you are in the upper grades you can write 25 to 30 characters per minute. Speed will be a measure of your goal. If you have the ability to write thirty characters per minute constantly with decent characters, that is the writing power of an adult who has no shortage of writing, and when you try to write notes, memos, diaries, postcards, letters, etc. The brush will move immediately.

  In this embodiment, according to the writing amount in the writing action using the writing instrument 0, the detection unit 101 for detecting the writing speed in the writing action, and the writing amount in the writing action detected through the detection unit 101 A writing act comprising: an information output unit 202 that outputs information in a manner that appeals to the user's vision or hearing, and that outputs information that varies according to the speed of writing in the writing act in a manner that appeals to the user's vision or hearing An evaluation system was configured. According to the present embodiment, both the writing amount and the writing speed in the user's writing action can be output and presented to the user. As a result, it becomes possible to accurately visualize the degree of improvement of the user's writing ability as well as the degree of achievement of the user's learning through the writing action and use it for evaluation.

  The information output unit 202 detects the speed of writing detected through the detecting unit 101 during the writing operation on condition that the writing amount of the writing act detected through the detecting unit 101 has reached a predetermined threshold. Different information is output depending on. If it describes in accordance with the example shown in FIG. 8, if the fruit 22 which displays the speed of writing will not grow to the magnitude | size with the tree 21 extended according to the amount of writing, that is, the tree 21 will grow to the magnitude | size. If the amount of writing stored in the information processing terminal 2 does not increase up to the amount necessary for that, that is, the threshold value, it is not fruitful. The same applies to the output of voice information corresponding to the speed of writing.

  The writing action evaluation system of the present embodiment is an information processing terminal that can exchange data between the writing instrument side device 1 that is attached to the writing instrument 0 and includes the detection unit 101, and the information output unit 202. 2 and the writing instrument side device 1 stores the writing amount of the writing action acquired by the detection unit 101 and the writing speed in the writing action, and the stored writing amount and the writing speed. Is transmitted to the information processing terminal 2 in a situation where it can communicate with the information processing terminal 2, and the information processing terminal 2 that receives the information transmits the information based on the writing amount and the writing speed in the information output unit 202. The information is output. In the present embodiment, a value that suggests the speed of writing, that is, a histogram of the occurrence frequency of the five-stage evaluation is calculated and stored in the writing instrument side apparatus 1 in advance, and the writing instrument side apparatus 1 and the information processing terminal 2 Send and receive when communication is possible. Accordingly, during the writing action, the acceleration, speed, displacement, position coordinates, etc. of the writing tip of the writing instrument 0 are continuously transmitted from the writing instrument side apparatus 1 to the information processing terminal 2 constantly and over a long period of time. There is no need. That is, power saving can be realized by appropriately limiting opportunities for communication between the writing instrument side device 1 and the information processing terminal 2. Furthermore, the collection of data related to writing acts can be performed without the need of the information processing terminal 2 (even if the information processing terminal 2 is absent), and the presence of the information processing terminal 2 does not interfere with the writing act. .

  The detection unit 101 includes an acceleration sensor 1d that measures the acceleration of the movement of the writing tip of the writing instrument 0. The writing amount of the writing action and the writing speed in the writing action can be easily performed using the acceleration sensor 1d. Can be calculated and acquired.

  Moreover, in this embodiment, the writing instrument side apparatus 1 attached to the writing instrument 0 used for the writing act and the information processing terminal 2 that can exchange data between the writing instrument side apparatus 1 are used as elements. 1 is a condition that a detection unit 101 that acquires and stores data quantified with respect to a writing action using the writing instrument 0 and an operation of tilting the end of the writing instrument 0 toward the information processing terminal 2 are performed. And a transmission unit 102 that transmits the data acquired and stored by the detection unit 101 to the information processing terminal 2, and the information processing terminal 2 receives data transmitted from the writing instrument side device 1. The transmission / reception system including the receiving unit 201 is configured. According to the present embodiment, when data is exchanged between the writing instrument side apparatus 1 and the information processing terminal 2, it is possible to provide a linked experience between the writing instrument 0 and the application program on the information processing terminal 2, Game nature is improved.

  The information processing terminal 2 includes an information output unit 202 that outputs information in a manner that appeals to the user's vision or hearing according to the data received by the receiving unit 201.

  The transmission unit 102 and the reception unit 201 complete transmission / reception on condition that the length of time during which the end of the writing instrument 0 is tilted toward the information processing terminal 2 exceeds a threshold value. The threshold value fluctuates in accordance with the magnitude of the data value acquired or stored by the detection unit 101 or the amount of data. Thereby, according to the data of the writing amount stored in the writing instrument 0, the time during which the user performs the operation of tilting the writing instrument 0 toward the information processing terminal 2 changes, and the more energy or power accumulated in the writing instrument 0, It is possible to provide the user with a virtual experience that it takes time to flow all of the energy or power into the information processing terminal 2.

  The transmission unit 102 and the reception unit 201 reduce power consumption by interrupting communication between them in a period other than when the data is transmitted and received.

  Further, in the present embodiment, the data related to the writing action is the output value of the sensor 1d that is attached to the writing instrument 0 and measures the acceleration, speed, or displacement of the movement of the writing instrument 0, or the calculated value that is calculated based on the output value. The detection unit 101 acquires the output value of the sensor 1d or the calculated value obtained based on the output value above or beyond a predetermined upper limit value. The writing instrument side apparatus 1 that does not acquire the output value or the calculated value that exceeds or exceeds the upper limit value as data related to the writing action is configured. According to the present embodiment, the movement of the writing instrument 0 caused by the writing action and the movement of the writing instrument 0 caused by the action other than the writing action are separated without separately mounting sensors and switches other than the sensor 1d. Can be identified. And it can suppress effectively that an error mixes in the data about the writing act acquired via sensor 1d.

  The sensor 1d measures the acceleration, speed, or displacement of the movement of the writing instrument 0 along the direction of at least one of three axes that are set immovable with respect to the writing instrument 0 and are orthogonal to each other. When the output value of the sensor 1d or a calculated value obtained by calculation based on the output value exceeds or exceeds a predetermined upper limit value, the unit 101 outputs an output value that exceeds or exceeds the upper limit value or The calculated value is not acquired as data related to the writing act.

  The sensor 1d measures the acceleration, speed, or displacement of the rotational movement of the writing instrument 0 about at least one of three axes that are set immovable with respect to the writing instrument 0 and are orthogonal to each other. When the output value of the sensor 1d or a calculated value obtained by calculation based on the output value exceeds or exceeds a predetermined upper limit value, the unit 101 outputs an output value that exceeds or exceeds the upper limit value or The calculated value is not acquired as data related to the writing act.

  The sensor 1d has functions of a triaxial acceleration sensor and a triaxial gyro sensor.

  The detection unit 101 acquires both the writing amount of the writing action and the writing speed in the writing action as data relating to the writing action.

  The present invention is not limited to the embodiment described in detail above. Various modifications can be made to the specific configuration of each part, processing procedure, and the like without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 0 ... Writing implement 1 ... Writing implement side apparatus 1d ... Acceleration sensor 101 ... Detection part 102 ... Transmission part 2 ... Information processing terminal 201 ... Reception part 202 ... Information output part 21 ... Information (tree) which changes according to the amount of writing in writing act
22 ... Information (fruit) that varies depending on the speed of writing in writing

Claims (8)

A detection unit for detecting a writing amount in a writing act using a writing instrument, and a writing speed in the writing act;
Information according to the amount of writing in the writing act detected via the detection unit is output in a manner appealing to the user's vision or hearing, and information according to the speed of writing in the writing act is output to the user's vision or hearing A writing act evaluation system comprising an information output unit that outputs in a manner appealing to The information output unit responds to the speed of writing detected through the detection unit during the writing operation on condition that the writing amount in the writing operation detected through the detection unit has reached a predetermined threshold. The writing act evaluation system according to claim 1 which outputs information. A writing instrument side device attached to a writing instrument and including the detection unit, and an information processing terminal including the information output unit that can exchange data between the writing instrument side device, and
The writing instrument side device stores the writing amount in the writing act acquired by the detection unit and the writing speed in the writing act, and can communicate the stored writing amount and the writing speed with the information processing terminal. The information processing terminal which transmitted toward the said information processing terminal in a favorable condition and received this outputs the said information based on the said writing amount and the speed of writing in the said information output part. Written action evaluation system. The said detection part has an acceleration sensor which measures the acceleration of the movement of the writing-tip of a writing instrument, and acquires the writing speed in the writing action and the writing speed in the writing action using the said acceleration sensor. Or the writing act evaluation system of 3 description. It is used for configuring the writing act evaluation system according to claim 1, 2, 3 or 4,
A detection unit that detects the writing amount in the writing act using the writing instrument, and the writing speed of the writing instrument in the writing act, and stores the detected writing action and the writing speed;
A writing instrument side device comprising: a transmission unit that transmits the amount of writing and the speed of writing detected and stored by the detection unit toward the information processing terminal in a situation in which the information processing terminal can communicate with the information processing terminal. 6. The writing instrument side device according to claim 5, which is detachable from a writing instrument used for a writing act. It is used for configuring the writing act evaluation system according to claim 1, 2, 3 or 4,
Information processing terminal
A receiving unit that receives a writing amount in a writing action using the writing tool, and a writing speed in the writing action, transmitted from a writing tool side device attached to the writing tool; and
A mode in which information according to the amount of writing received by the receiving unit is output in a mode that appeals to the user's vision or hearing, and a mode in which information according to the speed of writing received by the receiving unit is appealed to the user's vision or hearing Program that functions as an information output unit that outputs in A set of the writing instrument side device according to claim 5 and the program according to claim 7.

Images