WO2019235008A1 - Système de transmission et de réception - Google Patents

Système de transmission et de réception Download PDF

Info

Publication number
WO2019235008A1
WO2019235008A1 PCT/JP2019/008609 JP2019008609W WO2019235008A1 WO 2019235008 A1 WO2019235008 A1 WO 2019235008A1 JP 2019008609 W JP2019008609 W JP 2019008609W WO 2019235008 A1 WO2019235008 A1 WO 2019235008A1
Authority
WO
WIPO (PCT)
Prior art keywords
writing
writing instrument
information processing
processing terminal
data
Prior art date
Application number
PCT/JP2019/008609
Other languages
English (en)
Japanese (ja)
Inventor
信彦 中井
潤 山形
Original Assignee
コクヨ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コクヨ株式会社 filed Critical コクヨ株式会社
Priority to CN201980029996.XA priority Critical patent/CN112074419B/zh
Publication of WO2019235008A1 publication Critical patent/WO2019235008A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B43—WRITING OR DRAWING IMPLEMENTS; BUREAU ACCESSORIES
    • B43K—IMPLEMENTS FOR WRITING OR DRAWING
    • B43K23/00—Holders or connectors for writing implements; Means for protecting the writing-points
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B43—WRITING OR DRAWING IMPLEMENTS; BUREAU ACCESSORIES
    • B43K—IMPLEMENTS FOR WRITING OR DRAWING
    • B43K29/00—Combinations of writing implements with other articles
    • B43K29/08—Combinations of writing implements with other articles with measuring, computing or indicating devices
    • B43K29/093—Combinations of writing implements with other articles with measuring, computing or indicating devices with calculators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Definitions

  • the present invention relates to a transmission / reception system for exchanging data between a writing instrument side device attached to a writing instrument and an information processing terminal.
  • Patent Documents 1 to 3 A system for measuring a handwriting that is a locus of movement of a writing tool during writing is known (see Patent Documents 1 to 3 below). This type of system is mainly used in offices and the like to convert written characters, drawn figures, and the like into digital data and import them into information processing terminals such as smartphones and personal computers.
  • timing device stopwatch
  • stopwatch that can be attached to a writing instrument and measures the time that a child or the like is writing or studying using the writing instrument (see Patent Document 4 below).
  • the present invention is intended to make the use of a writing instrument more enjoyable by incorporating a sense of play in the operation for transmitting and receiving data from a device attached to the writing instrument to an information processing terminal.
  • the writing instrument side device attached to the writing instrument used for the writing act and an information processing terminal capable of transferring data between the writing instrument side device are used as elements, and the writing instrument side device uses the writing instrument.
  • the detection unit that acquires and stores the data quantified regarding the action and the operation of tilting the end of the writing instrument is performed, the data acquired and stored in the detection unit is directed to the information processing terminal
  • the transmission / reception system includes a transmission unit, and the information processing terminal includes a reception unit that receives data transmitted from the writing instrument side device.
  • the information processing terminal may include an information output unit that outputs information in a manner that appeals to the user's sight or hearing according to data received by the receiving unit.
  • the transmission unit and the reception unit complete transmission / reception on condition that the length of time in which the end of the writing instrument is tilted toward the information processing terminal exceeds a threshold, If the threshold value fluctuates according to the size of the data value acquired and stored by the detection unit or the amount of data, the same operation as that requiring more time to pour as the amount of water increases Can be implemented.
  • the transmission / reception system according to claim 1, 2 or 3.
  • the writing instrument side device used to configure the transmission / reception system includes a detection unit that acquires and stores data that is quantified regarding a writing action using the writing instrument, and an operation that tilts the end of the writing instrument. And a transmitter that transmits the data acquired and stored by the detector to the information processing terminal.
  • the writing instrument side device is preferably detachable from the writing instrument used for the writing act.
  • the program used to configure the writing activity evaluation system according to the present invention is transmitted from the writing instrument side device attached to the writing instrument on the condition that the information processing terminal is operated to tilt the end of the writing instrument.
  • This program may cause the information processing terminal to function as an information output unit that outputs information in a manner that appeals to the user's vision or hearing according to data received by the receiving unit.
  • the present invention it is possible to incorporate a sense of play into the operation for transmitting and receiving data from the device attached to the writing instrument to the information processing terminal, thereby making the use of the writing instrument more enjoyable.
  • the perspective view which shows the writing instrument side apparatus and information processing terminal which are the elements of the transmission / reception system of one Embodiment of this invention.
  • the figure which shows the hardware resources with which the writing instrument side apparatus of the embodiment is provided.
  • the figure which shows the hardware resources with which the information processing terminal of the embodiment is provided.
  • the flowchart which shows the example of the procedure of the process which the writing instrument side apparatus of the embodiment performs in order to acquire the data regarding a writing action.
  • the flowchart which shows the example of the procedure of the process performed in order that the writing instrument side apparatus and information processing terminal of the embodiment may transmit / receive the data regarding a writing action.
  • the figure which shows the example which the information processing terminal of the embodiment outputs different information according to the amount of writing and the speed of writing.
  • the figure which shows the example which the information processing terminal of the embodiment outputs different information according to the speed of writing.
  • the transmission / reception system mainly includes a writing instrument side device 1 attached to a writing instrument 0 used for a writing act and an information processing terminal 2 capable of communicating with the writing instrument side device 1.
  • the writing instrument side apparatus 1 plays a role of obtaining quantified data related to a writing action using the writing tool 0, for example, a writing amount and a writing speed in the writing action.
  • the information processing terminal 2 receives data related to the writing action acquired by the writing instrument side device 1 from the writing instrument side device 1 and outputs information corresponding to the data in a manner appealing to the user's vision or hearing.
  • the writing instrument side device 1 can be retrofitted to a ready-made writing instrument 0 such as a pencil, a mechanical pencil, or a ballpoint pen.
  • a holding unit 11 that holds the writing instrument 0 is provided in the casing of the writing instrument side apparatus 1.
  • the holding part 11 is, for example, an insertion hole through which the writing instrument 0 can be inserted and held, and is a clip or a clamp that holds and holds the writing instrument 0 or fits on the outer periphery of the writing instrument 0. It doesn't matter.
  • the housing of the writing instrument side apparatus 1 may have a grip portion 12 that is gripped by the finger of a user who performs a writing act using the writing instrument 0.
  • the writing instrument side device 1 can be attached to and detached from the writing instrument 0, and the writing instrument side device 1 can be commonly used for several writing instruments 0.
  • the writing instrument side device 1 is not integrated with the writing instrument 0 and cannot be detached from the writing instrument 0, or does not hinder the aspect of being built in the writing instrument 0.
  • the writing instrument side apparatus 1 is a microcomputer system including hardware resources such as a processor 1a, a main memory 1b, an auxiliary storage device 1c, an acceleration sensor 1d, a communication interface 1e, and a battery 1f.
  • the auxiliary storage device 1c is a flash memory, for example.
  • the acceleration sensor 1d is, for example, a function of a triaxial acceleration sensor that measures acceleration along three directions of the X axis, the Y axis, and the Z axis that are orthogonal to each other, the ⁇ direction around the X axis, and the Y axis.
  • the acceleration sensor 1d can detect the acceleration of the movement of the writing instrument 0 (the tip of the writing instrument), can calculate the speed of the movement of the writing instrument 0 through the time integration of acceleration or the time series of the acceleration measured repeatedly, and the time integration of the speed Alternatively, the displacement amount of the movement of the writing instrument 0 can be calculated through integration of the time series of the repetitively calculated speed.
  • the nine-axis acceleration sensor also has a function of a three-axis geomagnetic sensor (electronic compass) for knowing the direction of east, west, south, and north, but the function of this geomagnetic sensor is not always necessary.
  • the communication interface 1e is a device for performing data communication between the writing instrument side apparatus 1 and the external information processing terminal 2, and is, for example, Bluetooth (registered trademark), a wireless LAN (Local Area Network), or a mobile phone network. , A wireless transceiver for performing wireless communication via a WiMAX (Worldwide Interoperability for Microwave Access) network or the like, or an RFID (Radio Frequency IDentification) card or chip.
  • the battery 1f supplies power necessary for the hardware resources.
  • a power generation device that generates power using the motion (vibration) applied to the writing instrument side device 1 or the temperature of the user gripping the grip portion 12 and supplies or charges the power, It is also conceivable to mount on the writing instrument side device 1.
  • a program to be executed by the processor 1a is stored in the auxiliary storage device 1c.
  • the program is read from the auxiliary storage device 1c into the main memory 1b and decoded by the processor 1a. Is done.
  • the writing instrument side apparatus 1 operates the hardware resources according to a program, and exhibits the functions as the detection unit 101 and the transmission unit 102 shown in FIG.
  • the information processing terminal 2 is, for example, a general-purpose mobile phone terminal, particularly a smartphone, a personal computer, a video game machine, or the like. As shown in FIG. 4, the information processing terminal 2 includes a processor 2a, a main memory 2b, an auxiliary storage device 2c, a video codec 2d, an audio codec 2e, a communication interface 2f, an input device 2g, a display 2h, an audio output device 2i, and a battery. Hardware resources such as 2j are provided, and these are controlled by a controller (system controller, I / O controller, etc.) 2k to operate in cooperation.
  • the auxiliary storage device 2c is a flash memory, a hard disk drive, an optical disk drive, or the like.
  • the video codec 2d generates a screen to be displayed based on the drawing instruction received from the processor 2a, and transmits the screen signal to the display 2h.
  • the video codec 2d temporarily stores the screen and image data.
  • a video memory or the like to be stored is used as an element.
  • the audio codec 2e decodes the encoded audio data and outputs the audio from the audio output device 2i.
  • Each of the video codec 2d and the audio codec 2e can be implemented as software instead of hardware.
  • the communication interface 2f is a device for the information processing terminal 2 to perform data communication with an external device or computer including the writing instrument side device 1, and is, for example, Bluetooth (registered trademark), wireless LAN, mobile phone network , A wireless transceiver for implementing wireless communication via a WiMAX network or the like, or an RFID card reader.
  • the input device 2g is a touch panel (which may be superimposed on the display 2h), a push button, a mouse, a keyboard, or the like that is operated by a user's fingers, or a voice input device that allows a user to input a command with a real voice. .
  • the battery 2j supplies power necessary for the hardware resource.
  • the program to be executed by the processor 2a is stored in the auxiliary storage device 2c, and is read from the auxiliary storage device 2c into the main memory 2b and decoded by the processor 2a when the program is executed. Is done.
  • the information processing terminal 2 operates the hardware resources according to the program, and exhibits the functions as the receiving unit 201 and the information output unit 202 shown in FIG.
  • the detection unit 101 of the writing instrument side apparatus 1 uses the acceleration sensor 1d to acquire quantified data related to the writing action using the writing instrument 0 by the user. Then, the data is stored and held in a required storage area of the main memory 1b or the auxiliary storage device 1c.
  • the data related to the writing action includes the writing amount of the user writing action and the speed of writing in the writing action.
  • the amount of writing indicates the amount of writing performed by the user. More specifically, they are the integrated value of the time when the writing action was performed, the integrated value of the displacement, which is the distance that the writing tip of the writing instrument 0 moved in the writing action, the number of strokes written, or the number of characters written. It can be said that as the amount of writing increases, the user gets used to writing or the achievement level of learning and training increases.
  • the speed of writing indicates the speed of carrying in writing, and the number of strokes and characters written by the user within a certain period of time. More specifically, the angular velocity or speed of the movement of the writing tip of the writing instrument 0 during the writing action. The faster the writing, that is, the faster it can be written, the higher the user's ability to write, and it can be said that they can concentrate on studying and other tasks involving writing.
  • the collection of data relating to writing acts by the writing instrument side device 1 itself does not involve the information processing terminal 2, and the presence of the information processing terminal 2 and communication between the writing instrument side device 1 and the information processing terminal 2 are not necessary.
  • FIG. 5 shows a procedure of processing for acquiring data related to a writing action in the detection unit 101 of the writing instrument side apparatus 1.
  • the detection unit 101 of the writing instrument side apparatus 1 detects triaxial accelerations [X, Y, and X] via the acceleration sensor 1d every predetermined time, for example, every frame (one frame is 1/30 second or 1/60 second).
  • Z] and the angular velocity [ ⁇ , ⁇ , ⁇ ] of rotation about three axes are obtained (step S1).
  • the writing instrument side device 1 is fixed to the writing instrument 0 used by the user, and the acceleration and the angular velocity measured by the acceleration sensor 1d indicate the acceleration and angular velocity of the movement of the writing instrument 0 (the writing tip).
  • a predetermined axis of the acceleration sensor 1d for example, the Z axis is set in advance so as to be parallel or substantially parallel to the axial direction of the writing instrument 0, in other words, the direction in which the writing instrument 0 extends.
  • the acceleration and angular velocity acquired in step S1 may be raw values output from the acceleration sensor 1d, or calculated values obtained by calculation based on the output value of the acceleration sensor 1d, that is, the output of the acceleration sensor 1d. It may be a value calculated by substituting a raw value to be substituted into a predetermined function expression. For example, when the Z axis of the acceleration sensor 1d is aligned with the direction in which the axis of the writing instrument 0 extends, the writing surface (the surface of paper to be written) on which writing is performed in the writing action using the writing instrument 0 is performed.
  • the Z-axis is substantially orthogonal and the writing tip of the writing instrument 0 is displaced in the X-axis direction and the Y-axis direction during writing.
  • the Z axis and the writing surface are always orthogonal, and it is natural that the Z axis is inclined with respect to the writing surface.
  • the acceleration value [X ′, Y ′] after the inclination correction is the acceleration of the movement of the writing tip on the writing surface, that is, Is the acceleration along the biaxial directions parallel to the writing surface and orthogonal to each other.
  • the acceleration value along the Z′-axis direction is 0 unless the writing tip approaches or separates from the writing surface (the Z′-axis direction is a direction perpendicular to the writing surface. Of course, unless one stroke is written, Naturally, the brush tip is displaced in the Z ′ direction).
  • the angle change that is, the rotation is detected using the function of the acceleration sensor 1d as the angular velocity sensor, and the acceleration value [X
  • the acceleration value [X
  • the requirements for the accuracy of data related to writing are not necessarily very high.
  • the actual writing surface is not always horizontal, the top plate is slightly inclined like a desk in a university lecture room, or the writing surface is vertical as when writing on a whiteboard. It is also possible. Therefore, it is not essential to perform the above correction on the output value of the acceleration sensor 1d.
  • Acceleration and angular velocity acquired in step S1 may be obtained by subjecting raw values output from the acceleration sensor 1d to some filter processing.
  • the moving average of the output value of the acceleration sensor 1d is calculated, or the output value of the acceleration sensor 1d is subjected to low-pass filter processing, thereby changing or pulsating. Suppressed proper acceleration and angular velocity can be obtained.
  • the detection unit 101 sets a predetermined number of consecutive frames, for example, ten frames as one period, and for each period, the absolute value of acceleration of each frame included in the period (for example, ⁇ (X 2 + Y 2 )) Or the sum of ⁇ (X ′ 2 + Y ′ 2 )) (sum of absolute values of ten accelerations) is calculated. Then, on the condition that the total value exceeds the determination threshold (step S2), the period is counted as “writing time” during which the user performs a writing act (step S4). Otherwise, the period is counted as “time not written” when the user does not write (step S5).
  • step S2 the detection unit 101 detects the absolute value of the acceleration or angular velocity of the movement of the writing instrument 0 detected via the acceleration sensor 1d in the period or the frame included in the period. Is greater than or equal to a predetermined upper limit (step S3), the large movement is not due to a writing action, and the period is counted as “a time during which no writing is performed” by the user (step S5).
  • the acceleration or angular velocity value referred to in step S3 may be a raw output value of the acceleration sensor 1d, or a calculated value obtained by calculation based on the output value of the acceleration sensor 1d. In particular, it may be a value subjected to the above-described correction, filter processing, or the like. It is also arbitrary whether to refer to the acceleration in any direction of the X axis, the Y axis, or the Z axis, or to refer to the angular velocity in any rotation direction of the ⁇ direction, the ⁇ direction, or the ⁇ direction.
  • the absolute value of the acceleration in the Z axis direction becomes excessive when the user swings the writing instrument 0 up and down, and when the writing instrument 0 is shaken left and right It is expected that the absolute value of acceleration in the X-axis or Y-axis direction will be excessive. In addition, it is expected that the absolute value of the angular velocity in the ⁇ direction or ⁇ direction will be excessive when the user turns the writing instrument 0, and that the absolute value of the angular velocity in the ⁇ direction will be excessive when the writing instrument 0 is rolled around the axis.
  • the detection unit 101 is an upper limit value corresponding to the absolute values of the X-axis direction acceleration, the Y-axis direction acceleration, the Z-axis direction acceleration, the ⁇ -direction angular velocity, the ⁇ -direction angular velocity, and the ⁇ -direction angular velocity measured for each frame in the target period. If any of them exceeds or exceeds the upper limit value, the period is counted as “time not written”.
  • the sum of absolute values of the X-axis direction acceleration of each frame included in the period (sum of 10 absolute values), the sum of absolute values of the Y-axis direction acceleration, and the sum of absolute values of the Z-axis direction acceleration Value, the sum of absolute values of ⁇ -direction angular velocity, the sum of absolute values of ⁇ -direction angular velocity, and the sum of absolute values of ⁇ -direction angular velocity are compared with the corresponding upper limit values. If it exceeds, it is good also as counting the said period in "time not written".
  • the upper limit value may be set individually for each axial direction or rotational direction, may be the same value in the triaxial direction, or may be the same value in all rotational directions.
  • step S3 the average value, median value, maximum value, or the like of the speed (absolute value) or displacement (absolute value) of the writing instrument 0 in the target period is compared with a predetermined upper limit value, When the former is greater than or greater than the latter, the period may be counted as “non-writing time” when the user is not writing.
  • the speed or amount of displacement of the writing instrument 0 during the period can be calculated based on the acceleration and / or angular velocity detected via the acceleration sensor 1d during the period.
  • the number of periods of “writing time” counted through steps S1 to S5 corresponds to the writing amount of the writing act performed by the user using the writing instrument 0. And the total value of the counted number of “Writing time” and the number of “Writing time” period is the total time that the user was holding the writing instrument 0, including the time other than writing.
  • Corresponds to the length of The detection unit 101 of the writing instrument side apparatus 1 stores at least the number of periods of “writing time” corresponding to the writing amount in the main memory 1b or the auxiliary storage device 1c.
  • the sum of the number of periods of “time not written” and / or the number of periods of “time written” and the number of periods “time not written” is stored in the main memory 1b or the auxiliary storage device 1c.
  • the detection unit 101 determines, for each period determined as “writing time”, an absolute value of acceleration of each frame included in the period (for example, ⁇ (x 2 + y 2 ) or ⁇ (X ′ 2 + Y ' 2 )) is summed up (total of absolute values of ten accelerations) in a stepwise evaluation, for example, in five steps (step S6). That is, it is determined in which range of the five rank categories the sum of the absolute values of acceleration exceeding the determination threshold value in step S3 is located. This means that the brush stroke speed in the period is evaluated in five levels. Then, the frequency of occurrence of the five-level evaluation is counted (step S7). For example, if the sum of the absolute values of acceleration of a certain period is within the range of the C rank, the value of the occurrence frequency of the C rank is increased by one.
  • an absolute value of acceleration of each frame included in the period for example, ⁇ (x 2 + y 2 ) or ⁇ (X ′ 2 + Y ' 2
  • the occurrence frequency of each rank counted through steps S6 and S7 suggests the speed of writing in the writing action performed by the user using the writing instrument 0.
  • the detection unit 101 of the writing instrument side apparatus 1 uses the main memory 1b or the auxiliary value as the histogram of the occurrence frequency of each rank, that is, the occurrence frequency of the A rank, the occurrence frequency of the B rank,. Store in the storage device 1c. If the number of periods counted in “writing time” is 500, the total value of the occurrence frequency of rank A, the occurrence frequency of rank B,.
  • the rank with the highest occurrence frequency, or the occurrence frequency and rank score value of each rank (for example, 5 for A rank, 4 for B rank, ..., E rank) Then, the average value or median value of the sum of the product with 1) for all ranks can be used as an index for the evaluation.
  • the detection unit 101 repetitively executes the above steps S1 to S7, thereby acquiring data related to the writing action using the writing instrument 0 of the user, that is, the writing amount and the writing speed in the writing action, and the main memory 1b or It is stored and held in the auxiliary storage device 1c.
  • the output value of the acceleration sensor 1d obtained during the period determined as “non-writing time” in step S2 or S3, and the writing amount and writing speed calculated based on the output value are obtained as data relating to writing act. (I.e., it is not counted as "writing time", nor is it subject to a five-step evaluation of writing speed.
  • the counting of "not writing time” corresponds to data related to writing act, not writing amount. Do not remember).
  • the detection unit 101 may calculate and store the accumulated value of the displacement amount of the writing tip 0 of the writing instrument 0 in the period determined as “writing time” as the writing amount in the writing action. In addition, as the writing speed in the writing action, the detection unit 101 determines the average value or median value of the movement speed of the writing tip of the writing instrument 0 in the period determined as “writing time”, “writing time”. The value obtained by dividing the integrated value of the displacement of the writing tip of the writing instrument 0 in the period determined as “the writing time” by the number of periods (after all, the displacement of the writing tip per unit time), or one of them The occurrence frequency of each rank when evaluated may be calculated and stored.
  • the transmission unit 102 of the writing instrument side apparatus 1 uses the communication interface 1e, and the data relating to the writing action using the writing instrument 0 by the user, which is detected by the detection unit 101 and stored in the main memory 1b or the auxiliary storage device 1c. Is transmitted to the information processing terminal 2.
  • the receiving unit 201 of the information processing terminal 2 receives the data related to the writing action transmitted from the writing instrument side device 1 using the communication interface 2f, and stores the received data in the main memory 2b or the auxiliary storage device 2c. Store and hold in the area.
  • the user attaches the end portion of the writing instrument 0 attached to the writing instrument side apparatus 1 (the front end portion having the writing tip or the rear end portion on the side opposite to the writing tip may be used).
  • An operation of tilting downward from the top toward the information processing terminal 2 an operation of changing the posture of the writing instrument 0 from the position in which the writing instrument 0 is laid down (closer to horizontal) to the posture in which the writing instrument 0 is raised (closer to vertical)
  • Data between the writing instrument side device 1 and the information processing terminal 2 triggered by an operation as if water stored in the writing instrument 0 was poured into the information processing terminal 2 from the end of the writing instrument 0 Begin giving and receiving.
  • the writing amount of the writing action performed by the user using the writing tool 0 is regarded as a certain kind of energy or power, and the energy or power accumulated by the user in the writing tool 0 through the writing action is poured into the information processing terminal 2. Simulates behavior.
  • FIG. 7 shows a procedure of processing for transmission / reception of data related to writing by the transmitting unit 102 of the writing instrument side device 1 and the receiving unit 201 of the information processing terminal 2.
  • the transmitting unit 102 of the writing instrument side device 1 is ready for the previous stage of data transmission / reception (step S8), and then rotates around the three axes of the writing instrument 0 via the acceleration sensor 1d every predetermined time, that is, every frame.
  • the angular velocity [ ⁇ , ⁇ , ⁇ ] of rotation is obtained (step S9).
  • step S8 becomes true when, for example, the user operates a predetermined button or switch mounted on the writing instrument side apparatus 1 itself. Alternatively, the user performs a specific operation via the input device 2 g of the information processing terminal 2, and a signal or information indicating that is transmitted from the information processing terminal 2 to the writing instrument side apparatus 1. True when received. Of course, the operation of turning the end of the writing instrument 0 downward is also performed during writing. Therefore, step S8 is intended to prevent transmission of data from the writing instrument side apparatus 1 to the information processing terminal 2 from being started during writing, even though the user does not intend.
  • the angular velocity acquired in step S9 may be a raw value output from the acceleration sensor 1d, or a raw value output from the acceleration sensor 1d may be subjected to some filter processing.
  • the transmitting unit 102 of the writing instrument side apparatus 1 uses the Euler angle or the quaternion (quaternary) as the time series of the angular velocity [ ⁇ , ⁇ , ⁇ ] of the rotation of the writing instrument 0 detected via the acceleration sensor 1d every predetermined time.
  • the number is transmitted to the information processing terminal 2 in any numerical format (step S10).
  • the receiving unit 201 of the information processing terminal 2 receives the time series of the angular velocity of the rotation of the writing instrument 0 every predetermined time, which is provided from the writing instrument side apparatus 1 (step S11). And based on this, it is determined whether the user performed operation which inclines the edge part of the writing instrument 0 toward the information processing terminal 2 (step S12). When it is determined that the user has performed an operation of tilting the end of the writing instrument 0 toward the information processing terminal 2, a signal or information indicating that is transmitted to the writing instrument side apparatus 1 (step S13).
  • the transmitter 102 of the writing instrument side apparatus 1 receives the above signal or information from the information processing terminal 2 (Step S14), and stores the data stored in the main memory 1b or the auxiliary storage device 1c. Transmission for the information processing terminal 2 is started (step S15).
  • steps S10 to S14 are to determine and confirm on the information processing terminal 2 side that the operation of tilting the end of the writing instrument 0 toward the information processing terminal 2 is performed by the user's hand. However, in the writing instrument side apparatus 1, it is determined whether or not such an operation has been performed based on the time series of the angular velocity of the rotation of the writing instrument 0 every predetermined time. The transmission to the information processing terminal 2 may be executed (step S15). If it is determined in the writing instrument side apparatus 1 whether or not the operation is performed, steps S10 to S14 can be omitted.
  • the data transmitted from the writing instrument side apparatus 1 to the information processing terminal 2 in step S15 is the data related to the user's writing action, and indicates the number of periods of “writing time” indicating the writing amount and the writing speed. Occurrence frequency of each rank of the five-level evaluation shown, and the number of periods of "unwritten time” and / or the total number of periods of "written time” and period of "unwritten time” including.
  • the receiving unit 201 of the information processing terminal 2 receives the data provided from the writing instrument side apparatus 1 (step S16) and stores it in the main memory 2b or the auxiliary storage device 2c.
  • the newly received “writing time” is added to the number of “writing time” periods received in the past and stored in the main memory 2b or the auxiliary storage device 2c.
  • the number of periods may be added.
  • the newly received histogram of the frequency of occurrence of each rank may be added to the histogram of the frequency of occurrence of each rank in the five-stage evaluation of writing speed received and stored in the past.
  • the number of periods of “unwritten time” received and stored in the past, or the sum of the number of periods of “writing time” and the number of periods of “unwritten time” has been newly added. May be added to the number of periods of “time not written” or the sum of the number of periods of “time written” and the number of periods of “time not written”.
  • the data transmission / reception in steps S15 and S16 may be completed as quickly as possible.
  • the larger the data value stored or held in the writing instrument side apparatus 1 or the larger the amount of data the more data transmission / reception is possible. It is also possible to produce an effect that takes a long time to complete. More specifically, the length of time that the transmission unit 102 of the writing instrument side device 1 and the receiving unit 201 of the information processing terminal 2 maintain the state where the user tilts the end of the writing instrument 0 toward the information processing terminal 2.
  • the transmission / reception of data is completed on the condition that the threshold value exceeds the threshold value, and the threshold value is set to be larger (longer) as the number of periods of “writing time” stored in the writing instrument side device 1 is larger, Alternatively, the larger the frequency of occurrence of each rank of the five-step evaluation of the writing speed stored in the writing instrument side device 1, the larger the setting. In other words, the more energy or power that the user has accumulated in the writing instrument 0 through the writing action, the longer it takes for the energy or power to flow into the information processing terminal 2.
  • the receiving unit 201 of the information processing terminal 2 information for making the user aware that the transmission / reception process is in progress, in other words, for allowing the user to recognize that the state should still be maintained is provided. It is also preferable to output in a manner that appeals to the visual or auditory sense of the user. For example, during transmission / reception, a moving image in which water is poured may be displayed on the screen of the display 2h, or a sound effect such as a sound in which water is poured is output from the audio output device 2i. Also good.
  • the data value stored in the main memory 1b or the auxiliary storage device 1c of the writing instrument side apparatus 1 during the transmission / reception, particularly “writing” Data stored in the main memory 2b or the auxiliary storage device 2c of the information processing terminal 2 while gradually changing (gradually decreasing) the value of the occurrence frequency of each rank in the five-stage evaluation of the number of periods of time and the speed of writing It is also possible to perform processing so as to gradually change (gradually increase) the value, in particular, the number of periods of “writing time” and the value of the occurrence frequency of each rank in the five-stage evaluation of writing speed.
  • the transmission / reception of data itself May be canceled, that is, the data stored in each of the writing instrument side device 1 and the information processing terminal 2 may be data before the start of transmission / reception (or recovered to data before transmission / reception).
  • the user stops maintaining the above state The data value may be stored and held in the writing instrument side device 1 and the information processing terminal 2.
  • Whether or not the user keeps the end of the writing instrument 0 tilted toward the information processing terminal 2 during the transmission / reception is determined by determining whether the user holds the end of the writing instrument 0 as the transmission / reception start condition.
  • the determination result is transmitted (transmitted) from the information processing terminal 2 to the writing instrument side device 1 after being executed on the information processing terminal 2 side.
  • the writing instrument side device 1 itself may make the determination.
  • step S15 and S16 After the data transmission / reception (steps S15 and S16) between the writing instrument side apparatus 1 and the information processing terminal 2 is completed, the writing instrument side apparatus 1 has been stored in the main memory 1b or the auxiliary storage device 1c until then. Erasing the transmitted data from the main memory 1b or the auxiliary storage device 1c, in other words, the number of periods of “writing time”, the number of periods of “not writing time”, and the speed of writing The frequency of occurrence of each rank of evaluation is reset to 0 (step S17).
  • the transmitting unit 102 of the writing instrument side device 1 and the receiving unit 201 of the information processing terminal 2 block communication between the two in a period other than the time when the data transmission / reception in steps S8 to S17 described above is performed, that is, wirelessly directed toward each other. Signal transmission is stopped, thereby reducing power consumption.
  • the information output unit 202 of the information processing terminal 2 receives information from the writing instrument side device 1 and stored in the main memory 2b or the auxiliary storage device 2c according to the data related to the writing action performed by the user using the writing instrument 0. , Output in a manner appealing to the user's visual or auditory sense.
  • the tree 21 that greatly increases as the writing amount increases.
  • different audio information such as timbre, melody, and loudness may be generated or selected according to the amount of writing performed by the user so far and output from the audio output device 2i.
  • the amount of writing can be said to be the result of the user's previous study or training, etc., and by presenting this to the user in a timely manner, the writing act using the writing instrument 0 has game characteristics, especially for children etc. Inspire users' willingness to study.
  • the information output unit 202 of the information processing terminal 2 is a histogram of the frequency of occurrence of each rank in the five-stage evaluation of the writing speed of the writing action that the user has performed so far.
  • the speed of writing As shown in FIGS. 8 and 9, the information output unit 202 of the information processing terminal 2 is a histogram of the frequency of occurrence of each rank in the five-stage evaluation of the writing speed of the writing action that the user has performed so far.
  • the apple 22 will be fruited as shown in FIG. 9 (b). , And so on.
  • different audio information such as timbre, melody, and loudness may be generated or selected according to the writing speed of the writing action performed by the user so far, and output from the audio output device 2i.
  • the speed of writing in the past writing action of the user depends on the rank with the highest occurrence frequency among the occurrence frequencies of each rank of the five-level evaluation, the occurrence frequency of each rank, and the score value of the rank. Can be evaluated from the average or median of the sums of all ranks.
  • the frequency of occurrence of D rank was the highest, it can be evaluated that the user's writing speed is slightly slower than the medium, and there is room for growth or improvement, and if the frequency of occurrence of A rank is the highest, It can be evaluated that the user's writing has become considerably faster and the ability to write out has increased. If the average value or median value of the product of the rank occurrence frequency and the rank score value is referred to, it can be evaluated that the higher the value, the faster the user's writing.
  • the ability of the information processing terminal 2 to present not only the amount of writing by the user so far but also the speed of writing in the writing act leads to making the user such as children especially aware of the speed of writing, and the ability to write out It is expected to contribute to the cultivation of If you are in the lower grades of elementary school, you can write 15 to 20 characters per minute, if you are in the middle grade you can write 20 to 25 characters per minute, and if you are in the upper grades you can write 25 to 30 characters per minute. Speed will be a measure of your goal. If you have the ability to write thirty characters per minute constantly with decent characters, that is the writing power of an adult who has no shortage of writing, and when you try to write notes, memos, diaries, postcards, letters, etc. The brush will move immediately.
  • the detection unit 101 for detecting the writing speed in the writing action, and the writing amount in the writing action detected through the detection unit 101 A writing act comprising: an information output unit 202 that outputs information in a manner that appeals to the user's vision or hearing, and that outputs information that varies according to the speed of writing in the writing act in a manner that appeals to the user's vision or hearing
  • An evaluation system was configured. According to the present embodiment, both the writing amount and the writing speed in the user's writing action can be output and presented to the user. As a result, it becomes possible to accurately visualize the degree of improvement of the user's writing ability as well as the degree of achievement of the user's learning through the writing action and use it for evaluation.
  • the information output unit 202 detects the speed of writing detected through the detecting unit 101 during the writing operation on condition that the writing amount of the writing act detected through the detecting unit 101 has reached a predetermined threshold. Different information is output depending on. If it describes in accordance with the example shown in FIG. 8, if the fruit 22 which displays the speed of writing will not grow to the magnitude
  • the writing action evaluation system includes a writing instrument side device 1 that is attached to the writing instrument 0 and includes the detection unit 101, and an information processing terminal that can exchange data between the writing instrument side device 1 and includes the information output unit 202. 2, and the writing instrument side device 1 stores the writing amount of the writing action acquired by the detection unit 101 and the writing speed in the writing action, and the stored writing amount and the writing speed. Is transmitted to the information processing terminal 2 in a situation where it can communicate with the information processing terminal 2, and the information processing terminal 2 that has received the information transmits the information based on the writing amount and the writing speed in the information output unit 202. Output the information.
  • a value that suggests the speed of writing that is, a histogram of the occurrence frequency of five-stage evaluation is calculated and stored in the writing instrument side apparatus 1 in advance, and the writing instrument side apparatus 1 and the information processing terminal 2 Send and receive when communication is possible. Accordingly, during the writing action, the acceleration, speed, displacement, position coordinates, etc. of the writing tip of the writing instrument 0 are continuously transmitted from the writing instrument side apparatus 1 to the information processing terminal 2 constantly and continuously for a long time. There is no need. That is, power saving can be realized by appropriately limiting opportunities for communication between the writing instrument side device 1 and the information processing terminal 2. Furthermore, the collection of data related to writing acts can be performed without the need of the information processing terminal 2 (even if the information processing terminal 2 is absent), and the presence of the information processing terminal 2 does not interfere with the writing act. .
  • the detection unit 101 includes an acceleration sensor 1d that measures the acceleration of the movement of the writing tip of the writing instrument 0.
  • the writing amount of the writing action and the writing speed in the writing action can be easily performed using the acceleration sensor 1d. Can be calculated and acquired.
  • the writing instrument side apparatus 1 attached to the writing instrument 0 used for the writing act and the information processing terminal 2 that can exchange data between the writing instrument side apparatus 1 are used as elements.
  • 1 is a condition that a detection unit 101 that acquires and stores data quantified with respect to a writing action using the writing instrument 0 and an operation of tilting the end of the writing instrument 0 toward the information processing terminal 2 are performed.
  • a transmission unit 102 that transmits the data acquired and stored by the detection unit 101 to the information processing terminal 2, and the information processing terminal 2 receives data transmitted from the writing instrument side device 1.
  • the transmission / reception system including the receiving unit 201 is configured. According to the present embodiment, when data is exchanged between the writing instrument side apparatus 1 and the information processing terminal 2, it is possible to provide a linked experience between the writing instrument 0 and the application program on the information processing terminal 2, Game nature is improved.
  • the information processing terminal 2 includes an information output unit 202 that outputs information in a manner that appeals to the user's sight or hearing according to the data received by the receiving unit 201.
  • the transmission unit 102 and the reception unit 201 complete transmission / reception on condition that the length of time during which the end of the writing instrument 0 is tilted toward the information processing terminal 2 exceeds a threshold value.
  • the threshold value fluctuates in accordance with the magnitude of the data value acquired or stored by the detection unit 101 or the amount of data.
  • the transmission unit 102 and the reception unit 201 cut off communication between the two during a period other than when the data is transmitted and received to reduce power consumption.
  • the data related to the writing action is the output value of the sensor 1d that is attached to the writing instrument 0 and measures the acceleration, speed, or displacement of the movement of the writing instrument 0, or the calculated value that is calculated based on the output value.
  • the detection unit 101 acquires the output value of the sensor 1d or the calculated value obtained based on the output value above or beyond a predetermined upper limit value.
  • the writing instrument side apparatus 1 that does not acquire the output value or the calculated value that exceeds or exceeds the upper limit value as data related to the writing action is configured.
  • the movement of the writing instrument 0 caused by the writing action and the movement of the writing instrument 0 caused by the action other than the writing action are separated without separately mounting sensors and switches other than the sensor 1d. Can be identified. And it can suppress effectively that an error mixes in the data about the writing act acquired via sensor 1d.
  • the sensor 1d measures the acceleration, speed, or displacement of the movement of the writing instrument 0 along the direction of at least one of three axes that are set immovable with respect to the writing instrument 0 and are orthogonal to each other.
  • the unit 101 outputs an output value that exceeds or exceeds the upper limit value or The calculated value is not acquired as data related to the writing act.
  • the sensor 1d measures the acceleration, speed, or displacement of the rotational movement of the writing instrument 0 about at least one of three axes that are set immovable with respect to the writing instrument 0 and are orthogonal to each other.
  • the unit 101 outputs an output value that exceeds or exceeds the upper limit value or The calculated value is not acquired as data related to the writing act.
  • the sensor 1d has functions of a triaxial acceleration sensor and a triaxial gyro sensor.
  • the detection unit 101 acquires both the writing amount of the writing action and the writing speed in the writing action as data relating to the writing action.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Afin d'apporter un sens de jeu lors d'une opération d'émission et de réception de données à partir d'un dispositif fixé à un instrument d'écriture vers un terminal de traitement d'informations et de rendre l'utilisation de l'instrument d'écriture plus agréable, ce système d'émission et de réception comporte, en tant qu'éléments, un dispositif 1 côté instrument d'écriture qui se fixe à un instrument d'écriture 0 utilisé lors d'une action d'écriture, et un terminal de traitement d'informations 2 qui peut envoyer et recevoir des données vers et depuis ledit dispositif 1 côté instrument d'écriture, le dispositif 1 côté instrument d'écriture étant pourvu d'une unité de détection qui acquiert et stocke des données quantifiées relatives à une action d'écriture dans laquelle l'instrument d'écriture 0 a été utilisé, et une unité de transmission qui, à la condition de réaliser une opération d'inclinaison de l'extrémité de l'instrument d'écriture 0, transmet des données acquises et stockées par l'unité de détection au terminal de traitement d'informations 2, et le terminal de traitement d'informations 2 est pourvu d'une unité de réception qui reçoit les données transmises depuis le dispositif 1 côté instrument d'écriture.
PCT/JP2019/008609 2018-06-04 2019-03-05 Système de transmission et de réception WO2019235008A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201980029996.XA CN112074419B (zh) 2018-06-04 2019-03-05 收发系统

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-106809 2018-06-04
JP2018106809A JP7243046B2 (ja) 2018-06-04 2018-06-04 送受信システム

Publications (1)

Publication Number Publication Date
WO2019235008A1 true WO2019235008A1 (fr) 2019-12-12

Family

ID=68769334

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/008609 WO2019235008A1 (fr) 2018-06-04 2019-03-05 Système de transmission et de réception

Country Status (3)

Country Link
JP (1) JP7243046B2 (fr)
CN (1) CN112074419B (fr)
WO (1) WO2019235008A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005135338A (ja) * 2003-10-31 2005-05-26 Pentel Corp 電子ペンの接点構造
JP5176046B2 (ja) * 2008-12-05 2013-04-03 仁科 慈成 計時装置付筆記用具

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102890571A (zh) * 2011-07-21 2013-01-23 梁露露 一种多功能无线手写笔
CN103744541B (zh) * 2014-01-26 2017-07-04 上海鼎为电子科技（集团）有限公司 书写笔、电子终端及书写系统
CN103927025B (zh) * 2014-04-29 2017-02-08 南京数模微电子有限公司 一种笔迹数字化实现装置及其方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005135338A (ja) * 2003-10-31 2005-05-26 Pentel Corp 電子ペンの接点構造
JP5176046B2 (ja) * 2008-12-05 2013-04-03 仁科 慈成 計時装置付筆記用具

Also Published As

Publication number Publication date
CN112074419B (zh) 2022-04-19
JP7243046B2 (ja) 2023-03-22
CN112074419A (zh) 2020-12-11
JP2019209566A (ja) 2019-12-12

Similar Documents

Publication Publication Date Title
TWI582643B (zh) 手持電腦系統及關於人類活動之字元和命令識別之技術
CN108027643B (zh) 用于可穿戴计算设备的基于微运动的输入姿势控制的方法、设备和装置
CN104076920A (zh) 信息处理设备、信息处理方法及存储介质
CN102109913B (zh) 基于复合mems传感器的控制器指针定位方法及控制器
US20100077857A1 (en) Inertia sensing module
JP2012157644A (ja) スイング解析装置、プログラム及びスイング解析方法
CN104871120A (zh) 使用磁场传感器来确定用户输入的电气设备
JP2014062962A (ja) 情報処理装置、筆記具、情報処理方法およびプログラム
JPWO2009069531A1 (ja) 入力装置、制御装置、制御システム、制御方法及びハンドヘルド装置
JP2012230135A (ja) 音楽演奏用プログラム、音楽演奏装置、音楽演奏システムおよび音楽演奏方法
CN111742540A (zh) 检测模式和行为以避免移动终端掉落事件
Arsenault et al. Gesture recognition using Markov Systems and wearable wireless inertial sensors
JP5621464B2 (ja) 動作検出装置、記録システム及びプログラム
WO2019235008A1 (fr) Système de transmission et de réception
WO2019235009A1 (fr) Dispositif côté instrument d'écriture
WO2019021566A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme
WO2019235007A1 (fr) Système d'évaluation d'action d'écriture
EP2151734A2 (fr) Module de détection d'inertie
JP4675718B2 (ja) 動作判別装置、動作判別プログラムおよびコンピュータ読取り可能な記録媒体
JP6270557B2 (ja) 情報入出力装置及び情報入出力方法
JP5652647B2 (ja) 小型電子機器、処理方法及びプログラム
US10678337B2 (en) Context aware movement recognition system
JP2022179538A (ja) 行為嘉賞システム
TW201830198A (zh) 手語辨識方法及系統
Mäntyjärvi et al. Gesture interaction for small handheld devices to support multimedia applications

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19815801

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19815801

Country of ref document: EP

Kind code of ref document: A1