CN112074419B

CN112074419B - Transceiver system

Info

Publication number: CN112074419B
Application number: CN201980029996.XA
Authority: CN
Inventors: 中井信彦; 山形润
Original assignee: Kokuyo Co Ltd
Current assignee: Kokuyo Co Ltd
Priority date: 2018-06-04
Filing date: 2019-03-05
Publication date: 2022-04-19
Anticipated expiration: 2039-03-05
Also published as: JP7243046B2; CN112074419A; JP2019209566A; WO2019235008A1

Abstract

A transmission/reception system is configured in which a writing instrument-side device (1) attached to a writing instrument (0) used for writing and an information processing terminal (2) capable of transmitting and receiving data to and from the writing instrument-side device (1) are used as elements in order to provide a sense of game play to an operation for transmitting and receiving data from and to the information processing terminal from the writing instrument-attached device, the writing instrument-side device (1) having: a detection unit that acquires and stores data obtained by quantifying a writing behavior using a writing tool (0); and a transmitting unit that transmits the data acquired and stored by the detecting unit to an information processing terminal (2) on the condition that an operation of tilting an end portion of a writing instrument (0) is performed, wherein the information processing terminal (2) includes a receiving unit that receives the data transmitted from the writing instrument-side device (1).

Description

Transceiver system

Technical Field

The present invention relates to a transmission/reception system for transmitting/receiving data between a writing instrument-side device attached to a writing instrument and an information processing terminal.

Background

Systems for measuring handwriting, which is a movement trajectory of a pen tip of a writing instrument during a writing operation, are known (see patent documents 1 to 3 below). Such a system is used for the following purposes: written characters, drawn figures, and the like are digitized mainly in offices and the like, and put into information processing terminals such as smartphones and personal computers.

There is also a timer device (stopwatch) that can be attached to a writing instrument and measures the time for writing and learning with a writing instrument such as a child (see patent document 4 below).

However, when some data measured or acquired and stored by the device attached to the writing instrument is transmitted to the information processing terminal, wireless communication or wired communication is performed between the two. Operations performed by the user at that time include operations of a specific button or switch attached to the apparatus, operations of a touch panel or a keyboard on the information processing terminal, and connection of a communication cable. However, such operations are not interesting and not necessarily intuitive.

Documents of the prior art

Patent document 1: japanese patent laid-open publication No. 2016-024504

Patent document 2: japanese patent laid-open publication No. 2004-274518

Patent document 3: japanese laid-open patent publication No. 2004-029915

Patent document 4: japanese patent No. 5176046

Disclosure of Invention

Technical problem to be solved by the invention

It is a desirable object of the present invention to provide a game feeling to an operation for transmitting and receiving data from and to an information processing terminal from a device attached to a writing instrument, and to make the use of the writing instrument more pleasant.

Means for solving the problems

In the present invention, there is provided a transmission/reception system including a writing instrument-side device attached to a writing instrument used for writing, and an information processing terminal capable of transmitting and receiving data to and from the writing instrument-side device, as elements, the writing instrument-side device including: a detection unit that acquires and stores data obtained by quantifying a writing behavior using a writing instrument; and a transmitting unit that transmits the data acquired and stored by the detecting unit to an information processing terminal on the condition that an operation of tilting an end portion of a writing instrument is performed, wherein the information processing terminal includes a receiving unit that receives the data transmitted from the writing instrument-side device.

It can be said that, in the present invention, an operation of injecting or flowing data from the writing instrument into the information processing terminal as if it were water is possible.

The information processing terminal may include an information output unit that outputs information so as to appeal to the user's sight or hearing based on the data received by the receiving unit.

If the transmission unit and the reception unit complete transmission and reception on the condition that the length of time during which the state in which the end of the writing instrument is tilted toward the information processing terminal is maintained exceeds a threshold value that varies depending on the size of the value of the data or the amount of data acquired and stored by the detection unit, the same operation as in the case where the injection takes longer as the amount of water increases can be realized.

The transmission unit and the reception unit can reduce power consumption if communication between the two is interrupted in a period other than when the data is transmitted and received.

The writing instrument side device for constituting a transmission/reception system according to the present invention includes: a detection unit that acquires and stores data obtained by quantifying a writing behavior using a writing tool; and a transmission unit that transmits the data acquired and stored by the detection unit to an information processing terminal on the condition that an operation of tilting an end portion of a writing instrument is performed.

The writing instrument-side device is preferably attachable to and detachable from a writing instrument used for writing.

The program constituting the writing behavior evaluation system according to the present invention causes an information processing terminal to function as a receiving unit that receives data obtained by quantifying a writing behavior using a writing instrument, the data being transmitted from a writing instrument-side device attached to the writing instrument on the condition that an operation of tilting an end portion of the writing instrument is performed.

The program may cause the information processing terminal to function as an information output unit that outputs information so as to appeal to the user's sight or hearing based on the data received by the receiving unit.

ADVANTAGEOUS EFFECTS OF INVENTION

According to the present invention, it is possible to provide a game feeling to an operation for transmitting and receiving data from and to an information processing terminal from a device attached to a writing instrument, and to make the use of the writing instrument more pleasant.

Drawings

Fig. 1 is a perspective view showing a writing instrument-side device and an information processing terminal which are elements of a transmission/reception system according to an embodiment of the present invention.

Fig. 2 is a diagram showing hardware resources provided in the writing instrument-side device according to the embodiment.

Fig. 3 is a functional block diagram of the transmission/reception system according to this embodiment.

Fig. 4 is a diagram showing hardware resources provided in the information processing terminal according to this embodiment.

Fig. 5 is a flowchart showing an example of the procedure of processing executed by the writing instrument-side apparatus according to this embodiment to acquire data relating to writing behavior.

Fig. 6 is a diagram showing an operation performed by the user as an execution start condition for transmission and reception of data relating to writing behavior from the writing instrument-side device to the information processing terminal according to the embodiment.

Fig. 7 is a flowchart showing an example of the procedure of the processing executed by the writing instrument-side device and the information processing terminal according to the embodiment to transmit and receive data relating to writing behavior.

Fig. 8 is a diagram showing an example in which the information processing terminal of the embodiment outputs information that differs according to the writing amount and the writing speed.

Fig. 9 is a diagram showing an example in which the information processing terminal according to this embodiment outputs information that differs depending on the writing speed.

Description of the reference symbols

0 writing instrument

1 writing implement side device

1d acceleration sensor

101 detection part

102 sending part

2 information processing terminal

201 receiving part

202 information output unit

21 information (tree) different according to the writing amount in the writing behavior

22 information (fruit) different depending on writing speed in writing behavior

Detailed Description

An embodiment of the present invention will be described with reference to the drawings. As shown in fig. 1, the transmission/reception system according to the present embodiment includes a writing instrument-side device 1 attached to a writing instrument 0 used for writing, and an information processing terminal 2 capable of communicating with the writing instrument-side device 1 as main components. The writing instrument-side device 1 is responsible for acquiring quantified data on writing behavior using the writing instrument 0, for example, the writing amount and the writing speed in writing behavior. The information processing terminal 2 receives data on writing behavior acquired by the writing instrument-side device 1 from the writing instrument-side device 1, and outputs information corresponding to the data so as to appeal to the user's sight or hearing.

The writing instrument-side device 1 can be post-loaded with a writing instrument 0 that is an off-the-shelf product such as a pencil, a mechanical pencil, a ball-point pen, or the like. Therefore, the case of the writing instrument-side device 1 is provided with a holding portion 11 for holding the writing instrument 0. The holding portion 11 is, for example, an insertion hole through which the writing instrument 0 can be inserted and held, but may be a member such as a clip or a pressing plate that is inserted and holds the writing instrument 0 or fits to the outer periphery of the writing instrument 0. The casing of the writing instrument-side device 1 may have a grip portion 12 to be gripped by a finger of a user who performs writing using the writing instrument 0. In the present embodiment, the writing instrument-side device 1 is detachably attached to the writing instrument 0, and the writing instrument-side device 1 can be commonly used for several writing instruments 0. However, the writing instrument-side device 1 is not prevented from being integrated with the writing instrument 0 and being detached from the writing instrument 0, or from being incorporated in the writing instrument 0.

As shown in fig. 2, the writing instrument-side device 1 is a microcomputer system including hardware resources such as a processor 1a, a main memory 1b, an auxiliary storage device 1c, an acceleration sensor 1d, a communication interface 1e, and a battery 1 f. The secondary storage device 1c is, for example, a flash memory. The acceleration sensor 1d is, for example, a so-called six-axis acceleration sensor or a nine-axis acceleration sensor having both a function of a three-axis acceleration sensor for measuring acceleration in directions along three axes, i.e., an X axis, a Y axis, and a Z axis, which are orthogonal to each other, and a function of a three-axis rotational angular velocity sensor (gyro sensor) for measuring acceleration in directions along θ about the X axis and about the Y axis

The angular velocity in each direction of rotation of the direction and the Ψ -direction around the Z-axis is measured. The acceleration sensor 1d can detect the acceleration of the movement of (the pen tip of) the writing instrument 0, and can calculate the velocity of the movement of the writing instrument 0 by the time integral of the acceleration or the time-series accumulation of the repeatedly measured accelerations, and can calculate the displacement amount of the movement of the writing instrument 0 by the time integral of the velocity or the time-series accumulation of the repeatedly calculated velocities. Further, the nine-axis acceleration sensor also has a function of a three-axis geomagnetic sensor (electronic compass) for learning the east-west, south-north orientation, but the function of the geomagnetic sensor is not necessarily essential.

The communication interface 1e is a device for performing data communication between the writing instrument-side apparatus 1 and an external information processing terminal 2, and includes, for example, a Radio transceiver or an RFID (Radio Frequency Identification) card or a chip for performing wireless communication via a Bluetooth (registered trademark), a wireless LAN (Local Area Network), a mobile phone Network, a WiMAX (Worldwide Interoperability for Microwave Access) Network, or the like. The battery 1f supplies the electric power required by the above-described hardware resources. In addition, it is also conceivable to attach, instead of the battery 1f or together with the battery 1f, a power generation device to the writing instrument-side device 1, the power generation device generating power by using motion (vibration) applied to the writing instrument-side device 1, body temperature of the user gripping the grip portion 12, or the like, and supplying or charging the power.

In the writing instrument-side device 1, a program to be executed by the processor 1a is stored in the auxiliary storage device 1c, and when the program is executed, the program is read from the auxiliary storage device 1c to the main memory 1b and interpreted by the processor 1 a. The writing instrument-side device 1 operates the hardware resources in accordance with a program, and functions as the detection unit 101 and the transmission unit 102 shown in fig. 3.

The information processing terminal 2 is, for example, a general-purpose mobile phone terminal, particularly a smartphone, a personal computer, an electronic game machine, or the like. As shown in fig. 4, the information processing terminal 2 includes hardware resources such as a processor 2a, a main memory 2b, a secondary storage device 2c, a video encoder 2d, an audio encoder 2e, a communication interface 2f, an input device 2g, a display 2h, a voice output device 2I, and a battery 2j, and these hardware resources are controlled by a controller (a system controller, an I/O controller, or the like) 2k to operate in cooperation. The secondary storage device 2c is a flash memory, a hard disk drive, an optical disk drive, or the like. The video encoder 2d has, as elements, a GPU (Graphics Processing Unit) that generates a screen to be displayed in accordance with the drawing instruction received by the processor 2a and transmits the screen signal to the display 2h, a video memory that temporarily stores data of the screen and the image, and the like. The audio encoder 2e decodes the encoded voice data, so that voice is output from the voice output device 2 i. The video encoder 2d and the audio encoder 2e may be installed not as hardware but as software, respectively.

The communication interface 2f is a device for performing data communication between the information processing terminal 2 and an external device or computer including the writing instrument-side device 1, and includes, for example, a radio transceiver or an RFID card reader for performing wireless communication via Bluetooth (registered trademark), a wireless LAN, a cellular phone network, a WiMAX network, or the like. The input device 2g is a touch panel (which may be a member overlapping the display 2 h) operated by a user with a finger, a push button, a mouse, a keyboard, or the like, or a voice input device for a user to input an instruction by voice. The battery 2j supplies the power required by the above-described hardware resources.

In the information processing terminal 2, a program to be executed by the processor 2a is stored in the secondary storage device 2c, and when the program is executed, the program is read from the secondary storage device 2c to the main memory 2b and interpreted by the processor 2 a. The information processing terminal 2 operates the above-described hardware resources in accordance with a program, and functions as a reception unit 201 and an information output unit 202 shown in fig. 3.

The functions of each part of the present system will be described in detail later. The detection unit 101 of the writing instrument-side device 1 acquires, by using the acceleration sensor 1d, quantified data relating to the writing behavior of the user using the writing instrument 0. The data is stored and held in a required storage area of the primary storage device 1b or the secondary storage device 1 c.

In the present embodiment, the data on the writing behavior includes the writing amount in the writing behavior of the user and the writing speed in the writing behavior. The writing amount represents the amount of writing performed by the user. More specifically, the cumulative value of the time when the writing action is performed, the cumulative value of the displacement amount which is the distance the pen tip of the writing instrument 0 has moved during the writing action, the number of strokes written, or the number of characters written. It can be said that the more the writing amount is increased, the more proficient the user writes, or the higher the completion degree of learning training. The writing speed represents the speed of moving a pen in the writing behavior, the number of strokes and the number of characters written by a user in a certain time. More specifically, the angular velocity or speed of movement of the pen tip of the writing instrument 0 in the writing behavior. The faster the writing, that is, the faster the writing is possible, the higher the stroke ability of the user, and the more the user can concentrate on the work accompanying the writing, such as learning.

The information processing terminal 2 does not participate in the collection of data relating to writing behavior by the writing instrument-side device 1 itself, and the presence of the information processing terminal 2 and the communication of the writing instrument-side device 1 with the information processing terminal 2 are not required.

Fig. 5 shows a procedure of data acquisition processing for the detection unit 101 of the writing instrument-side device 1, the data acquisition processing being related to writing behavior. The detector 101 of the writing instrument-side device 1 detects the three-axis acceleration [ X, Y, Z ] via the acceleration sensor 1d every predetermined time, for example, every frame (one frame is 1/30 seconds or 1/60 seconds)]And the angular velocity of rotation about three axes theta,

Ψ](step S1). The writing instrument-side device 1 is fixed to a writing instrument 0 used by a user, and the acceleration and angular velocity measured by the acceleration sensor 1d suggest the acceleration and angular velocity of the movement of (the pen tip of) the writing instrument 0. At this time, a predetermined axis of the acceleration sensor 1d, for example, the Z axis is set in advance to be parallel or substantially parallel to the axial direction of the writing instrument 0, in other words, the direction in which the writing instrument 0 extends.

The acceleration and the angular velocity acquired in step S1 may be direct values output by the acceleration sensor 1d, or may be calculated based on the output value of the acceleration sensor 1d, that is, by substituting a predetermined functional expression or the like with the direct values output by the acceleration sensor 1 d. For example, consider the following: when the Z-axis of the acceleration sensor 1d is aligned with the direction in which the axis of the writing instrument 0 extends, the Z-axis is substantially orthogonal to a writing surface (surface of a paper or the like to be written) on which writing is performed in a writing operation using the writing instrument 0, and the pen tip of the writing instrument 0 is displaced in the X-axis direction and the Y-axis direction during writing. However, there is no guarantee that the Z axis is always orthogonal to the jotting surface, and the Z axis may of course be tilted with respect to the jotting surface. Therefore, in order to accurately know the acceleration, speed, or displacement of the movement of the pen tip on the writing surface, it is necessary to detect the inclination of the Z axis with respect to the writing surface, that is, the horizontal plane, based on the gravity acting on the acceleration sensor 1d, and then convert the direct output value [ X, Y, Z ] of the acceleration sensor 1d into the corrected acceleration value [ X ', Y ', Z ' ]. When the angle of the Z-axis, which is the axis of the writing tool 0, with respect to the writing surface is constant during writing, the acceleration values [ X ', Y' ] after the inclination correction become the acceleration of the movement of the pen tip on the writing surface, that is, the acceleration in the directions along the two axes parallel to the writing surface and orthogonal to each other. Further, the acceleration value along the Z 'axis direction is 0 (the Z' axis direction is a direction orthogonal to the writing surface) as long as the pen tip approaches the writing surface or does not leave the writing surface.

Of course, since the angle of the axis of the writing instrument 0 may change during the writing operation, the acceleration matrix for eliminating the rotation of the writing instrument 0 is further applied to the acceleration values [ X ', Y ', Z ' ] after the inclination correction by detecting the rotation, which is the change in the angle, using the function of the acceleration sensor 1d as the angular velocity sensor, and the acceleration of the movement of the pen tip on the writing surface can be calculated with high accuracy.

However, the accuracy of the data relating to the writing behavior is not necessarily required to be very high. Further, the actual writing surface is not always horizontal, but may be a slightly inclined surface such as a desk in a lecture room of university, or a plumb surface such as a writing surface on a whiteboard. Thus, the output value of the acceleration sensor 1d does not have to be corrected as described above.

The acceleration and angular velocity acquired in step S1 may be obtained by applying a certain filtering process to the direct values output by the acceleration sensor 1 d. When the output value of the acceleration sensor 1d frequently fluctuates or pulsates, an appropriate acceleration and angular velocity can be obtained with fluctuations or pulsates suppressed by calculating a moving average of the output value of the acceleration sensor 1d or by performing low-pass filtering on the output value of the acceleration sensor 1 d.

Next, the detection unit 101 sets a predetermined number of consecutive frames, for example, ten frames asOne period (period), and the absolute value (for example √ (X)) of the acceleration of each frame included in the period is calculated for each period (period)²+Y²) Or √ (X'²+Y’²) Total of ten absolute values of acceleration). On condition that the total value exceeds the determination threshold (step S2), the time is counted up to "writing time" at which the user performs writing (step S4). Otherwise, the period is counted up to "non-writing time" at which the user does not perform the writing action (step S5).

However, even if the sum of the absolute values of the accelerations of the respective frames in a certain period exceeds the determination threshold, it cannot be immediately determined that the period is "writing time". This is because: the acceleration of the movement of the writing instrument 0 detected by the acceleration sensor 1d may become large for reasons other than the writing behavior. In the case where the user is a child or the like, it is not difficult to imagine shaking the writing tool 0, rotating the writing tool 0, and rolling the writing tool 0 to play the writing tool 0. Therefore, even if the determination result in step S2 is true, if the absolute value of the acceleration or angular velocity of the motion of the writing instrument 0 detected by the acceleration sensor 1d at the time or in the frame included in the time is equal to or greater than the predetermined upper limit value (step S3), the detector 101 assumes that the large motion is not an action due to the writing action, and counts the time until the user does not perform the "unwritten time" of the writing action (step S5).

The value of the acceleration or the angular velocity referred to (compared with the upper limit value) in step S3 may be a direct output value of the acceleration sensor 1d, or a calculated value calculated based on the output value of the acceleration sensor 1d, particularly a value obtained by applying the above-described correction, filtering processing, or the like. Further, with respect to which direction of acceleration among the X-axis, Y-axis and Z-axis is referred to, the theta direction is referred to,

The angular velocity of which of the Ψ -direction and the Ψ -direction is rotated is arbitrary. It is envisioned that: the Z axis of the acceleration sensor 1d and the axial extension of the writing tool 0 are setWhen the long direction is the same, the absolute value of the acceleration in the Z-axis direction is excessively large when the user shakes the writing instrument 0 up and down, and the absolute value of the acceleration in the X-axis or Y-axis direction is excessively large when the user shakes the writing instrument 0 left and right. And is envisioned to be: when the user rotates the writing instrument 0, the theta direction is either

The absolute value of the angular velocity of the direction becomes excessively large, and when the writing instrument 0 is rolled around the axis, the absolute value of the angular velocity of the Ψ -direction becomes excessively large. The detection unit 101 measures the acceleration in the X-axis direction, the acceleration in the Y-axis direction, the acceleration in the Z-axis direction, the angular velocity in the theta direction, and the acceleration in the X-axis direction, the acceleration in the Y-axis direction, the acceleration in the Z-axis direction, and the angular velocity in the theta direction, which are measured in each frame of the target period,

The absolute values of the directional angular velocity and the Ψ -directional angular velocity are compared with the corresponding upper limit values, and if either one is equal to or greater than the upper limit value or exceeds the upper limit value, the time is counted as "time not to write". Alternatively, the following may be provided: the sum of the absolute values of the accelerations in the X-axis direction (the sum of the ten absolute values), the sum of the absolute values of the accelerations in the Y-axis direction, the sum of the absolute values of the accelerations in the Z-axis direction, the sum of the absolute values of the angular velocities in the theta direction, and the like of each frame included in the time period are calculated,

The sum of the absolute values of the directional angular velocities and the sum of the absolute values of the Ψ directional angular velocities are compared with the corresponding upper limit values, and if either one of the values is equal to or greater than the upper limit value or exceeds the upper limit value, the time is counted as "time not to write". The upper limit value may be set individually in the axial direction and the rotational direction, may be the same value in the three-axial direction, or may be the same value in all the rotational directions.

Alternatively, the following may be provided: in step S3, the average, median, or maximum value of the (absolute value of the) velocity or the (absolute value of the) displacement of the movement of the writing tool 0 in the period of the target is compared with a predetermined upper limit value, and when the former is equal to or greater than the latter, the period is counted as "unwritten time" at which the user does not perform writing. The velocity or displacement amount of the movement of the writing tool 0 in a period can be calculated based on the acceleration and/or angular velocity detected via the acceleration sensor 1d in the period.

The number of "writing time" counted in steps S1 to S5 corresponds to the writing amount of the writing action performed by the user using the writing instrument 0. The total of the counted time periods of "writing time" and "non-writing time" corresponds to the total length of time for which the user has placed the writing instrument 0 on his hand, including the time other than the writing action. The detection unit 101 of the writing instrument-side device 1 stores, in the main memory 1b or the auxiliary storage device 1c, at least the number of time periods corresponding to "writing time" corresponding to the amount of writing. Then, the total value of the number of times of "writing-free time" and/or the total value of the number of times of "writing-free time" and the number of times of "writing-free time" is stored in the main memory 1b or the auxiliary storage device 1 c.

Then, the detection unit 101 determines, for each time period for "writing time", the absolute value (for example √ (x) of the acceleration of each frame included in the time period²+y²) Or √ (X'²+Y’²) In step S6), the magnitude of the total (sum of absolute values of ten accelerations) is evaluated in stages, for example, in five stages. That is, it is determined in step S3 in which range of the rank (rank) division of the five stages the total of the absolute values of the accelerations exceeding the determination threshold value is located. This means that a five-stage evaluation of pen-motion speed is performed during this period. Further, the occurrence frequency of the five-stage evaluation is counted (step S7). For example, if the total of the absolute values of the acceleration at a certain time is within the range of the C level, the value of the frequency of occurrence of the C level is increased by 1.

The generation frequency of each level counted in steps S6 and S7 suggests the writing speed in the writing action performed by the user using the writing instrument 0. The detection unit 101 of the writing instrument-side device 1 stores the histogram of the occurrence frequency of each rank, that is, the values of the occurrence frequency of the a rank, the occurrence frequency of the B rank, … …, and the occurrence frequency of the E rank in the main memory 1B or the auxiliary storage device 1 c. When the number of time periods counted up to "writing time" is 500, the total value of the generation frequency of the a-level, the generation frequency of the B-level, and the generation frequencies of the … … and E-level becomes 500. In evaluating the writing speed of the user, the rank having the highest occurrence frequency, or the average or median of the total of the occurrences of all ranks for each rank and the score values of the ranks (for example, a rank of 5, B rank of 4, … …, and E rank of 1) can be used as an index for the evaluation.

The detection unit 101 repeatedly executes the above-described steps S1 to S7, thereby acquiring data on the writing behavior of the user using the writing instrument 0, that is, the writing amount and the writing speed in the writing behavior, and storing and holding the data in the main memory 1b or the auxiliary storage device 1 c. The output value of the acceleration sensor 1d obtained at the time when it is determined at step S2 or S3 that "time not written" is present, and the writing amount and the writing speed calculated based on the output value are not obtained as data relating to the writing behavior (that is, the count up to "time written", and also as an object of five-stage evaluation of the writing speed, the count of "time not written" is not a writing amount, and does not belong to data relating to the writing behavior), and are not stored and held.

The detection unit 101 may calculate and store an integrated value of the displacement amount of the pen tip of the writing instrument 0 in a time period for which the retention determination is "time to write" as the writing amount in the writing behavior. As the writing speed in the writing behavior, the detection unit 101 may calculate and store an average value or a central value of the speed of the movement of the pen tip of the writing instrument 0 in a period determined as the "writing time", a value obtained by dividing an integrated value of the displacement amount of the pen tip of the writing instrument 0 in a period determined as the "writing time" by the number of times of the "writing time" (the result is the displacement amount of the pen tip per unit time), or the generation frequency of each level when any one of them is evaluated in stages.

The transmission unit 102 of the writing instrument-side device 1 transmits data relating to the writing behavior of the user using the writing instrument 0, which is detected by the detection unit 101 and stored in the main memory 1b or the auxiliary storage device 1c, to the information processing terminal 2 by using the communication interface 1 e. The receiving unit 201 of the information processing terminal 2 receives data relating to writing behavior transmitted from the writing instrument-side device 1 via the communication interface 2f, and stores and holds the data in a necessary storage area of the main memory 2b or the auxiliary storage device 2 c.

In the present embodiment, as shown in fig. 6, the user initiates the transfer of data between the writing instrument-side device 1 and the information processing terminal 2 by performing an operation of tilting the end portion (including the tip portion of the pen tip or the rear end portion located on the opposite side of the pen tip) of the writing instrument 0 with the writing instrument-side device 1 toward the information processing terminal 2 placed thereon from the top to the bottom (an operation of changing the posture in which the writing instrument 0 is laid down (more nearly horizontal) to the posture in which the writing instrument 0 is raised (more nearly plumb), or an operation of pouring water accumulated in the writing instrument 0 from the end portion of the writing instrument 0 into the information processing terminal 2. This operation mimics the following actions: the amount of writing performed by the user using the writing instrument 0 is regarded as a certain energy or capability (power), and the energy or capability that the user has accumulated in the writing instrument 0 by the writing action is made to flow into the information processing terminal 2.

Fig. 7 shows a procedure of transmission/reception processing for data relating to writing behavior performed by the transmission unit 102 of the writing instrument-side device 1 and the reception unit 201 of the information processing terminal 2. After the preparation of the preceding stage of data transmission and reception is completed (step S8), the transmitter 102 of the writing instrument-side device 1 obtains the angular velocity [ θ ] of the rotation of the writing instrument 0 about the three axes via the acceleration sensor 1d for each predetermined time, that is, for each frame,

Ψ](step S9).

The branch determination at step S8 is true when, for example, the user operates a predetermined button or switch attached to the writing instrument-side device 1 itself. Alternatively, the user performs a specific operation via the input device 2g of the information processing terminal 2, a signal or information indicating that the operation has been performed is transmitted from the information processing terminal 2 to the writing instrument-side device 1, and the writing instrument-side device 1 becomes true when the signal or information is received. Of course, the end of the writing instrument 0 is also directed downward during writing. Therefore, the purpose of step S8 is to prevent the transmission of data from the writing instrument-side device 1 to the information processing terminal 2 from being started in writing, although not intended by the user.

The angular velocity obtained in step S9 may be a direct value output by the acceleration sensor 1d, or may be a value obtained by applying some sort of filtering process to a direct value output by the acceleration sensor 1 d.

Then, the transmission unit 102 of the writing instrument-side device 1 transmits the angular velocity [ θ ] of the rotation of the writing instrument 0 detected via the acceleration sensor 1d to the information processing terminal 2 in the form of an arbitrary numerical value such as an euler angle or a quaternion (quaternion) every predetermined time period,

Ψ]time series of (step S10).

The receiving unit 201 of the information processing terminal 2 receives the time series of the angular velocity of the rotation of the writing instrument 0 every predetermined time period obtained from the writing instrument-side device 1 (step S11). Based on this, it is determined whether the user has performed an operation of tilting the end of the writing instrument 0 toward the information processing terminal 2 (step S12). When it is determined that the user has performed the operation of tilting the end of the writing instrument 0 toward the information processing terminal 2, a signal or information indicating the operation is transmitted to the writing instrument-side device 1 (step S13).

On condition that the transmission unit 102 of the writing instrument-side device 1 receives the signal or the information obtained from the information processing terminal 2 (step S14), it starts transmission of the data stored in the main memory 1b or the auxiliary storage device 1c to the information processing terminal 2 (step S15).

The above-described steps S10 to S14 are steps of determining and confirming that the user has performed the operation of tilting the tip of the writing instrument 0 toward the information processing terminal 2 by the hand of the user on the information processing terminal 2 side. However, the writing instrument-side device 1 may determine whether or not such an operation has been performed based on a time series of the angular velocity of the rotation of the writing instrument 0 every predetermined time, and may perform the data transmission to the information processing terminal 2 on the condition that the operation has been performed (step S15). If the presence or absence of this operation is determined in the writing instrument-side device 1, the steps S10 to S14 can be omitted.

The data transmitted from the writing instrument-side device 1 to the information processing terminal 2 in step S15 includes, as data relating to the writing behavior of the user, the number of times of "writing time" indicating the writing amount, the frequency of occurrence of each level indicating five-stage evaluation of the writing speed, the number of times of "non-writing time", and/or the sum of the number of times of "writing time" and the number of times of "non-writing time".

The receiving unit 201 of the information processing terminal 2 receives the data obtained from the writing instrument-side device 1 (step S16), and stores the data in the main memory 2b or the auxiliary storage 2 c. At this time, the information processing terminal 2 may add the number of times of "writing time" newly received this time to the number of times of "writing time" received in the past and stored in the main memory 2b or the auxiliary storage device 2 c. In addition, a histogram of the occurrence frequency of each level newly received this time may be added to a histogram of the occurrence frequency of each level evaluated in five stages of the writing speed received and stored in the past. In addition, a sum of a time period number of "writing-free time" newly received this time or a time period number of "writing-free time" and a time period number of "writing-free time" may be added to a time period number of "writing-free time" or a sum of a time period number of "writing-free time" and a time period number of "writing-free time" previously received and stored.

The data transmission and reception in steps S15 and S16 may be completed as quickly as possible, but it is also possible to implement an arrangement in which the larger the value of the data stored and held in the writing instrument-side device 1 is, or the larger the amount of data is, the longer the time required until the data transmission and reception is completed is. More specifically, the transmission unit 102 of the writing instrument side device 1 and the reception unit 201 of the information processing terminal 2 complete data transmission and reception on the condition that the length of time during which the user holds the state in which the end of the writing instrument 0 is tilted toward the information processing terminal 2 exceeds a threshold value, and the threshold value is set to be larger (longer) as the number of time periods of "writing time" held in the writing instrument side device 1 increases, or to be larger as the frequency of occurrence of each level of the five-stage evaluation of the writing speed held in the writing instrument side device 1 increases. That is, the more energy or ability the user accumulates in the writing instrument 0 by the writing action, the longer it takes to flow the entire energy or ability into the information processing terminal 2.

It is also preferable that, during a period until the transmission/reception of data is completed, that is, during a period in which the user holds a state in which the end of the writing instrument 0 is tilted toward the information processing terminal 2 (a time point at which the length of the time during which the state is held does not reach the threshold), information for making the user recognize that the state is in the middle of the transmission/reception process, in other words, for making the user recognize that the state should be maintained, be output as a function of the receiving unit 201 of the information processing terminal 2 so as to appeal to the visual sense or auditory sense of the user. For example, during the period of transmission and reception, a moving image such as water filling may be displayed on the screen of the display 2h, or an effect sound such as water filling sound may be output from the voice output device 2 i.

In addition, when data transmission and reception are not completed immediately, the processing may be performed during the period of time in which the data transmission and reception are being performed such that: the data values stored in the main memory 1b or the auxiliary memory device 1c of the writing instrument-side apparatus 1, in particular, the values of the occurrence frequencies of the respective levels of the five-stage evaluation of the "writing time" and the writing speed are gradually changed (gradually decreased), and the data values stored in the main memory 2b or the auxiliary memory device 2c of the information processing terminal 2, in particular, the values of the occurrence frequencies of the respective levels of the five-stage evaluation of the "writing time" and the writing speed are gradually changed (gradually increased).

It is also possible to provide: when the user stops maintaining the state in which the user keeps the end of the writing instrument 0 inclined toward the information processing terminal 2 until the length of time exceeds the threshold value, the transmission and reception of data itself, that is, the data stored in each of the writing instrument-side device 1 and the information processing terminal 2 is canceled and set as the data before the transmission and reception are started (or restored to the data before the transmission and reception). Alternatively, the following may be provided: if the data values stored in the writing instrument-side device 1 and the information processing terminal 2 are gradually changed during the transmission and reception, the data values at the time when the user stops maintaining the above state are stored and held in the writing instrument-side device 1 and the information processing terminal 2. The determination as to whether or not the user keeps the state in which the end of the writing instrument 0 is tilted toward the information processing terminal 2 during transmission and reception may be performed by the same procedure as the determination as to whether or not the user has performed the operation of tilting the end of the writing instrument 0 toward the information processing terminal 2 as the start condition of transmission and reception, and after the execution on the information processing terminal 2 side, the determination result may be notified (transmitted) from the information processing terminal 2 to the writing instrument side apparatus 1, or may be performed by the writing instrument side apparatus 1 itself.

After the data transmission/reception between the writing instrument-side device 1 and the information processing terminal 2 is completed (steps S15 and S16), the writing instrument-side device 1 deletes the transmitted data stored in the main memory 1b or the auxiliary memory device 1c so far, in other words, resets the occurrence frequency of each level of the five-stage evaluation of the number of times of "writing time", the number of times of "non-writing time", and the writing speed to 0 from the main memory 1b or the auxiliary memory device 1c (step S17).

The transmitter 102 of the writing instrument-side device 1 and the receiver 201 of the information processing terminal 2 interrupt communication therebetween, that is, stop transmission of wireless signals mutually performed, and further suppress power consumption, in a period other than the time of transmitting and receiving data in steps S8 to S17.

The information output unit 202 of the information processing terminal 2 outputs information corresponding to data relating to writing behavior performed by the user using the writing instrument 0, which is received from the writing instrument-side device 1 and stored in the main memory 2b or the auxiliary storage 2c, so as to appeal to the user's sight or hearing.

For example, as shown in fig. 8, based on (an accumulated value of) the writing amount in the writing operation performed by the user so far, as information visually indicating the writing amount, an image such as a tree 21 that extends more as the writing amount increases is generated or selected, and displayed on the screen of the display 2 h. In this case, information of voices having different timbres, melodies, or sound sizes may be generated or selected according to the amount of writing performed by the user so far, and may be output from the voice output device 2 i.

The writing amount is a result of learning or training so far by the user, and by presenting the user with the writing tool 0 in a timely manner, the user can enjoy the writing behavior, and in particular, the user's intention of spontaneous learning such as a child can be aroused.

As shown in fig. 8 and 9, the information output unit 202 of the information processing terminal 2 generates or selects, as information visually representing the writing speed, an image such as a fruit 22 whose kind differs depending on the writing speed, which is produced by the tree 21, based on the writing speed (histogram of occurrence frequency of each level evaluated in five stages) in the writing behavior performed by the user so far, and displays the image on the screen of the display 2 h. For example, the following method is used: when the writing speed is lower than a certain low level or a certain low level, the cherry 22 is formed as shown in fig. 9 (a), when the writing speed is higher than a certain high level or a certain high level, the banana 22 is formed as shown in fig. 9 (c), and when the writing speed is in the middle of these, the apple 22 is formed as shown in fig. 9 (b). In this case, information of voices having different timbres, melodies, or sound sizes may be generated or selected in accordance with the writing speed of the writing action performed by the user so far, and may be output from the voice output device 2 i. As described above, the writing speed in the past writing behavior of the user can be evaluated based on the rank having the highest occurrence frequency among the occurrence frequencies of the ranks evaluated in the five stages, the average value or the median value of the values obtained by summing up the products of the occurrence frequencies of the ranks and the score values of the ranks for all the ranks, and the like. If the generation frequency of level D is the highest, it can be evaluated that the writing speed of the user is slightly slower than the medium level and has room for growth or improvement, and if the generation frequency of level a is the highest, it can be evaluated that the writing of the user is considerably fast and the stroke ability is high. If the average value or the median value of the product of the occurrence frequency of the rank and the score value of the rank is referred to, it can be evaluated that the writing of the user is faster as the value is higher.

The information processing terminal 2 presents not only the writing amount of the user up to now but also the writing speed in the writing behavior, and is expected to contribute to the training of the stroke ability particularly in relation to the recognition of the writing speed by the user such as a child. The speed at which fifteen to twenty words can be written during one minute becomes a standard for targets in low school years of primary schools, the speed at which twenty to twenty-five words can be written during one minute becomes a standard for targets in middle school years, and the speed at which twenty-five to thirty words can be written during one minute becomes a standard for targets in high school years. If the writing instrument has the capability of always writing thirty characters in each minute by using the characters with the regular moment, the writing instrument is the writing force of an ordinary adult which is indispensable for writing, and can immediately write when writing notes, records, diaries, postcards, letters and the like.

In the present embodiment, a writing behavior evaluation system is configured to include a detection unit 101 and an information output unit 202, the detection unit 101 detects the writing amount in the writing behavior using the writing instrument 0 and the writing speed in the writing behavior, the information output unit 202 outputs information corresponding to the writing amount in the writing behavior detected via the detection unit 101 so as to appeal to the visual sense or the auditory sense of the user, and outputs information different depending on the writing speed in the writing behavior so as to appeal to the visual sense or the auditory sense of the user. According to the present embodiment, it is possible to present to the user both the writing amount and the writing speed in the writing behavior of the user. Further, the degree of improvement in the user's stroke ability can be visualized appropriately together with the achievement degree of learning by the user of the writing behavior, and the degree can be provided for evaluation.

The information output unit 202 outputs information that differs according to the writing speed detected by the detection unit 101 in the writing behavior on the condition that the writing amount of the writing behavior detected by the detection unit 101 reaches a predetermined threshold value. As described with reference to the example shown in fig. 8, for the fruit 22 indicating the writing speed, when the tree 21 elongated according to the writing amount does not grow to a certain size, that is, when the writing amount stored in the information processing terminal 2 does not increase to the amount required for the tree 21 to grow to the certain size, that is, the threshold value, the fruit 22 does not bear. The same applies to the output of voice information according to the writing speed.

The writing behavior evaluation system of the present embodiment has, as elements, a writing instrument-side device 1 including the detection unit 101 attached to the writing instrument 0 and an information processing terminal 2 capable of transmitting and receiving data to and from the writing instrument-side device 1 and having the information output unit 202, wherein the writing instrument-side device 1 stores the writing amount of the writing behavior and the writing speed in the writing behavior acquired by the detection unit 101, transmits the stored writing amount and writing speed to the information processing terminal 2 in a state in which communication with the information processing terminal 2 is possible, and the information processing terminal 2 having received the writing amount and writing speed outputs the information based on the writing amount and writing speed in the information output unit 202. In the present embodiment, the histogram of the occurrence frequency of the five-stage evaluation, which is the value of the inspired writing rate, is calculated and stored in advance in the writing instrument side device 1, and the writing instrument side device 1 and the information processing terminal 2 transmit and receive data when they can communicate with each other. Therefore, during the period in which the writing action is being performed, it is not necessary to continuously transmit the acceleration, speed, displacement amount, position coordinates, and the like of the pen tip of the writing instrument 0 from the writing instrument-side device 1 to the information processing terminal 2 constantly and for a long time. That is, the opportunity of communication between the writing instrument-side device 1 and the information processing terminal 2 can be appropriately limited to achieve power saving. Further, it is not necessary to cause the information processing terminal 2 to collect data relating to writing behavior (even if the information processing terminal 2 is not present), data collection can be performed, and the presence of the information processing terminal 2 does not become an obstacle to writing behavior.

The detection unit 101 includes an acceleration sensor 1d for measuring acceleration of movement of the pen tip of the writing instrument 0, and can easily estimate and acquire the writing amount of a writing operation and the writing speed in the writing operation by using the acceleration sensor 1 d.

In addition, the present embodiment constitutes a transmission/reception system as follows: the writing instrument-side device 1 is provided with a detection unit 101 and a transmission unit 102, the detection unit 101 acquires and stores data obtained by quantifying a writing action using the writing instrument 0, the transmission unit 102 transmits the data acquired and stored by the detection unit 101 to the information processing terminal 2 on the condition that an operation of tilting an end of the writing instrument 0 toward the information processing terminal 2 is performed, and the information processing terminal 2 is provided with a reception unit 201 that receives the data transmitted from the writing instrument-side device 1. According to the present embodiment, when data is transmitted and received between the writing instrument-side device 1 and the information processing terminal 2, it is possible to provide an experience of linkage between the object, i.e., the writing instrument 0, and the application on the information processing terminal 2, thereby enhancing the interest and the game.

The information processing terminal 2 includes an information output unit 202, and the information output unit 202 outputs information so as to appeal to the user's sight or hearing based on the data received by the reception unit 201.

The transmission unit 102 and the reception unit 201 complete transmission and reception on the condition that the length of time for which the state in which the end of the writing instrument 0 is tilted toward the information processing terminal 2 is maintained exceeds a threshold value which varies depending on the magnitude of the data value or the amount of data acquired and stored by the detection unit 101. Thereby, the following virtual reality experience can be provided to the user: the time for the user to perform the operation of tilting the writing tool 0 toward the information processing terminal 2 varies according to the data of the writing amount stored in the writing tool 0, and the more the energy or the capability accumulated in the writing tool 0, the more time is required for the energy or the capability to flow into the information processing terminal 2 entirely.

The transmission unit 102 and the reception unit 201 interrupt communication therebetween in a period other than the time of transmitting and receiving the data, thereby reducing power consumption.

Further, in the present embodiment, the writing instrument-side device 1 attached to the writing instrument 0 is configured, the writing instrument-side device 1 includes the detection unit 101, the detection unit 101 acquires, as data related to the writing behavior, an output value of the sensor 1d that measures acceleration, speed, or displacement of the movement of the writing instrument 0 or a calculated value calculated based on the output value, and the detection unit 101 does not acquire, as the data related to the writing behavior, an output value that is equal to or greater than a predetermined upper limit value or a calculated value that is calculated based on the output value, when the output value of the sensor 1d or the calculated value that is calculated based on the output value is equal to or greater than the upper limit value or exceeds the upper limit value. According to the present embodiment, even if sensors and switches other than the sensor 1d are not separately attached, it is possible to distinguish and specify the movement of the writing instrument 0 due to the writing action and the movement of the writing instrument 0 due to the action other than the writing action. Further, it is possible to effectively suppress an error from being mixed into the data relating to the writing behavior acquired via the sensor 1 d.

The sensor 1d measures acceleration, speed, or displacement of the movement of the writing instrument 0 in a direction along at least one of three axes which are set immovably with respect to the writing instrument 0 and are orthogonal to each other, and the detection unit 101 does not acquire, as data relating to the writing behavior, an output value or a calculated value at the time when the output value of the sensor 1d or a calculated value calculated based on the output value is equal to or greater than a predetermined upper limit value or exceeds the upper limit value.

The sensor 1d measures acceleration, speed, or displacement of the rotational motion of the writing instrument 0 around at least one of three axes which are set immovably with respect to the writing instrument 0 and are orthogonal to each other, and the detection unit 101 does not acquire, as data relating to the writing behavior, an output value or a calculated value which is equal to or exceeds a predetermined upper limit value when the output value of the sensor 1d or a calculated value calculated based on the output value is equal to or greater than the upper limit value or exceeds the upper limit value.

The sensor 1d has functions of a three-axis acceleration sensor and a three-axis gyro sensor.

The detection unit 101 acquires both the writing amount of a writing behavior and the writing speed of the writing behavior as data relating to the writing behavior.

Furthermore, the present invention is not limited to the embodiments described in detail above. The specific configuration of each part, the steps of the processing, and the like can be variously modified within a range not departing from the gist of the present invention.

Claims

1. A transmission/reception system is provided with a writing instrument-side device attached to a writing instrument used for writing, and an information processing terminal capable of transmitting and receiving data to and from the writing instrument-side device as elements,

the writing instrument-side device includes:

a detection unit that acquires and stores data obtained by quantifying a writing behavior using a writing instrument; and

a transmitting unit that transmits the data acquired and stored by the detecting unit to an information processing terminal on the condition that an operation of tilting an end portion of a writing instrument is performed,

the information processing terminal includes a receiving unit that receives data transmitted from the writing instrument-side device,

the transmitting unit and the receiving unit complete transmission and reception on the condition that the length of time during which the tip of the writing instrument is kept tilted toward the information processing terminal exceeds a threshold value,

the threshold value varies depending on the size of the data value or the amount of data acquired and stored by the detection unit.

2. A transmission/reception system is provided with a writing instrument-side device attached to a writing instrument used for writing, and an information processing terminal capable of transmitting and receiving data to and from the writing instrument-side device as elements,

the writing instrument-side device includes:

when the writing instrument is not being used for writing, the data is transmitted from the transmitting unit of the writing instrument-side device to the receiving unit of the information processing terminal.

3. A transmission/reception system is provided with a writing instrument-side device attached to a writing instrument used for writing, and an information processing terminal capable of transmitting and receiving data to and from the writing instrument-side device as elements,

the writing instrument-side device includes:

the data is transmitted from the transmitting unit of the writing instrument-side device to the receiving unit of the information processing terminal on the condition that the user operates a predetermined button or switch attached to the writing instrument-side device itself, or on the condition that the user performs a specific operation via the input device of the information processing terminal and a signal or information indicating that the operation is performed is transmitted from the information processing terminal to the writing instrument-side device.

4. Transceiving system according to claim 1, 2 or 3,

the information processing terminal includes an information output unit that outputs information so as to appeal to the user's sight or hearing based on the data received by the receiving unit.

5. Transceiving system according to claim 1, 2 or 3,

the transmitting unit and the receiving unit interrupt communication therebetween in a period other than a time of transmitting and receiving the data.

6. A writing instrument-side device constituting the transmission/reception system according to claim 1, comprising:

7. A writing instrument-side device constituting the transmitter/receiver system according to claim 2, comprising:

and transmitting the data from the transmitting unit to the information processing terminal when the writing tool is not being used for writing.

8. A writing instrument-side device constituting the transmitter/receiver system according to claim 3, comprising:

the data is transmitted from the transmission unit to the information processing terminal on the condition that the user operates a predetermined button or switch attached to the writing instrument-side device itself, or on the condition that the user performs a specific operation via an input device of the information processing terminal and a signal or information indicating that the operation is performed is transmitted from the information processing terminal to the writing instrument-side device.

9. The writing instrument-side device according to claim 6, 7 or 8,

can be attached to and detached from a writing instrument used for writing.

10. A computer-readable recording medium in which a program for constituting the transmission/reception system according to claim 1, 2 or 3 is recorded,

the information processing terminal is made to function as a receiving section,

the receiving unit receives data obtained by quantifying a writing behavior using a writing instrument, the data being transmitted from a writing instrument-side device attached to the writing instrument on the condition that an operation of tilting an end portion of the writing instrument is performed.