WO2023140089A1 - コンピュータ、プログラム、及びストロークデータ表示制御方法 - Google Patents

コンピュータ、プログラム、及びストロークデータ表示制御方法 Download PDF

Info

Publication number
WO2023140089A1
WO2023140089A1 PCT/JP2022/048545 JP2022048545W WO2023140089A1 WO 2023140089 A1 WO2023140089 A1 WO 2023140089A1 JP 2022048545 W JP2022048545 W JP 2022048545W WO 2023140089 A1 WO2023140089 A1 WO 2023140089A1
Authority
WO
WIPO (PCT)
Prior art keywords
stroke data
data
input
stroke
ink
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/048545
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
司 能美
秀樹 藤巻
昭一 末
裕 古田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wacom Co Ltd
Original Assignee
Wacom Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wacom Co Ltd filed Critical Wacom Co Ltd
Priority to JP2023575175A priority Critical patent/JPWO2023140089A1/ja
Priority to DE112022006466.8T priority patent/DE112022006466T5/de
Priority to CN202280086404.XA priority patent/CN118401982A/zh
Publication of WO2023140089A1 publication Critical patent/WO2023140089A1/ja
Priority to US18/778,423 priority patent/US12535897B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G06T11/10—Texturing; Colouring; Generation of textures or colours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G06T11/20—Drawing from basic elements
    • G06T11/23—Drawing from basic elements using straight lines or curves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G06V30/333—Preprocessing; Feature extraction
    • G06V30/347—Sampling; Contour coding; Stroke extraction
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Definitions

  • the present invention relates to a computer, a program, and a stroke data display control method, and more particularly to a computer and program using stroke data, and a stroke data display control method for controlling the display of stroke data.
  • Patent Document 1 discloses a technique for reproducing such an input process.
  • one of the objects of the present invention is to provide a computer, a program, and a stroke data display control method that allow the user to easily grasp whether or not the answer was given in the expected state.
  • a computer is a computer including a processor, wherein the processor acquires a plurality of stroke data, determines whether or not the plurality of stroke data has been input in a predetermined state, and controls the display state when displaying the plurality of stroke data based on the result of the determination.
  • a program according to the present invention is a program for causing a computer to execute a step of obtaining a plurality of stroke data, a step of determining whether or not the plurality of stroke data has been input in a predetermined state, and a step of controlling a display state when displaying the plurality of stroke data based on the result of the determination.
  • a stroke data display control method is a stroke data display control method including the step of obtaining a plurality of pieces of stroke data by a computer, the step of determining whether or not the plurality of pieces of stroke data have been input in a predetermined state, and the step of controlling the display state when the plurality of pieces of stroke data are displayed based on the result of the determination.
  • a computer may be a computer including a processor, wherein the processor acquires ink data including a plurality of stroke data, determines whether or not the plurality of stroke data has been input in a predetermined state, and controls the display state when displaying the ink data based on the result of the determination.
  • the program according to the present invention may be a program for causing a computer to execute the steps of acquiring ink data including a plurality of stroke data, determining whether or not the plurality of stroke data has been input in a predetermined state, and controlling the display state when displaying the ink data based on the result of the determination.
  • An ink data display control method is an ink data display control method including the steps of: a computer acquiring ink data including a plurality of stroke data; the computer determining whether or not the plurality of stroke data has been input in a predetermined state; and the computer controlling a display state when the ink data is displayed based on the result of the determination.
  • the present invention it is possible to easily grasp from the appearance of the ink data whether or not the user was able to answer in the expected state.
  • FIG. 1 is a diagram showing the system configuration of an ink data processing system 1 according to an embodiment of the invention
  • FIG. 3 is a diagram showing an example of the hardware configuration of each of the student terminal 2, the teacher terminal 3, and the ink server 4
  • FIG. 4 is a diagram showing the configuration of answer ink data
  • 4 is a diagram showing an example of an answer window displayed on the display of the teacher's terminal 3
  • FIG. 7 is a processing flow diagram showing processing performed by the student terminal 2 to acquire answer ink data
  • 8 is a diagram showing processing executed by an ink server 4 that stores answer ink data in an ink database 6
  • FIG. FIG. 7 is a processing flow diagram showing a specific example of processing executed by the ink server 4 in step S22 shown in FIG. 6
  • 4 is a diagram showing processing executed by an ink server 4 in response to an answer window transmission request from a teacher terminal 3.
  • FIG. 3 is a diagram showing an example of the hardware configuration of each of the student terminal 2, the teacher terminal 3, and the ink server 4
  • FIG. 1 is a diagram showing the system configuration of an ink data processing system 1 according to an embodiment of the invention.
  • the ink data processing system 1 has a configuration in which a student terminal 2 , a teacher terminal 3 and an ink server 4 are interconnected via a network 5 .
  • An ink database 6 is also connected to the ink server 4 .
  • FIG. 2 is a diagram showing an example of the hardware configuration of each of the student terminal 2, teacher terminal 3, and ink server 4.
  • the student terminal 2, teacher terminal 3, and ink server 4 can each be configured by a computer 100 having the illustrated configuration. Note that the ink server 4 may be configured by connecting a plurality of computers 100 .
  • the computer 100 has a configuration in which a CPU (Central Processing Unit) 101, a storage device 102, an input device 103, an output device 104, and a communication device 105 are interconnected via a bus 106.
  • a CPU Central Processing Unit
  • the CPU 101 is a device (processor) that controls each part of the computer 100 and reads and executes various programs stored in the storage device 102 .
  • Each process described later with reference to FIGS. 3 to 8 is realized by executing a program stored in the storage device 102 by the CPU 101 of the student terminal 2, teacher terminal 3, and ink server 4.
  • FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present disclosure.
  • the storage device 102 includes a main storage device such as a DRAM (Dynamic Random Access Memory) and an auxiliary storage device such as a hard disk, and serves to store the operating system of the computer 100, various programs for executing various applications, and data used by these programs.
  • main storage device such as a DRAM (Dynamic Random Access Memory)
  • auxiliary storage device such as a hard disk
  • the input device 103 is a device that receives a user's input operation and supplies it to the CPU 101, and includes, for example, a keyboard, a mouse, and a touch detection device.
  • the touch detection device is a device including a touch sensor and a touch controller, and is used to detect pen input or touch input.
  • a pen P shown in FIG. 1 is an electronic pen used to perform pen input to the touch detection device of the student terminal 2 .
  • Pen input by the pen P is realized by, for example, an active electrostatic method or an electromagnetic induction method.
  • Touch input is input by a passive pointer such as a finger, and is realized by, for example, a capacitive method.
  • the output device 104 is a device that outputs the processing results of the CPU 101 to the user, and includes, for example, a display and a speaker.
  • a communication device 105 is a device for communicating with an external device, and transmits and receives data according to instructions from the CPU 101 .
  • the student terminal 2, teacher terminal 3, and ink server 4 each use this communication device 105 to communicate with other devices, systems, networks, and the like.
  • the ink database 6 is a storage device for storing various data necessary for correspondence education.
  • the various types of data include educational material data provided to students, ink data indicating student answers to questions contained in the educational material data (hereinafter referred to as "answer ink data"), and the like.
  • the substance of the ink database 6 may be implemented in a computer separate from the ink server 4 or may be implemented in the storage device 102 of the ink server 4 .
  • the ink server 4 is a server computer used by a correspondence education service provider company, and plays the role of providing teaching material data in the ink database 6 to the student terminals 2, acquiring answer ink data from the student terminals 2 and storing it in the ink database 6, as well as generating a screen containing the student's answers (hereinafter referred to as "answer window") and providing it to the teacher terminal 3.
  • the ink server 4 also analyzes the answer ink data stored in the ink database 6 to determine whether or not each stroke data constituting the answer ink data has been input in a predetermined state, and based on the determination result, performs processing for controlling the display state (appearance) when the answer ink data is displayed in the answer window.
  • the student terminal 2 is a computer whose user is a correspondence course student, and is configured to be able to execute student applications.
  • the student terminals 2 are tablet terminals, but other types of computers such as notebook computers, desktop computers, and smartphones may be used as long as they are equipped with a built-in or external input device and are compatible with pen input or touch input using the pen P.
  • the student application is a program for causing the student terminal 2 to receive the teaching material data from the ink server 4, display it on the display, and receive the input of the answer to the question included in the displayed teaching material data.
  • a student uses a student application after logging in using a student ID assigned in advance.
  • the student terminal 2 which operates according to the student application, identifies teaching material data to be acquired from the ink server 4 according to the student's operation, and requests the ink server 4 to transmit the identified teaching material data. Then, the educational material data transmitted by the ink server 4 as a result of the request is received and displayed on the display.
  • the teaching material data is data that has a display screen that includes a plurality of questions, an answer input area for each question, and a submit button that indicates the end of answer input.
  • the question and answer input areas may be divided and displayed on a plurality of display screens (pages), and each page in that case is provided with a forward button for advancing to the next page and a return button for returning to the previous page, and the submit button is provided on the last page or on the global navigation commonly displayed on each page.
  • Each question is assigned a question ID for identifying the question, and the answer input area is also identified by this question ID.
  • a student terminal 2 operating according to a student application acquires answer ink data according to an input operation performed by a student for each answer input area, and is configured to transmit each answer ink data acquired so far to an ink server 4 together with a student ID and each question ID when the student presses a submit button.
  • Input operations for the answer input area are performed by pen input or touch input.
  • the touch detection device of the student terminal 2 periodically detects the position of the pen P within the touch surface, and based on the detection result, acquires stroke data indicating a series of strokes.
  • the stroke data acquired in this way is data containing a series of coordinates indicating the trajectory of the position of the pen tip from pen-down (when the pen comes into contact with the touch surface) to pen-up (when the pen leaves the touch surface).
  • the answer ink data consists of a series of stroke data entered by the student in the corresponding answer entry area.
  • FIG. 3 is a diagram showing the structure of answer ink data.
  • each stroke data constituting the answer ink data includes information indicating the input order of each stroke data in the answer ink data (hereinafter referred to as "stroke ID"), a time stamp including the stroke start time (pen-down time) that is the time when the student starts inputting the stroke, and the stroke end time (pen-up time) that is the time when the student finishes inputting the stroke, a series of coordinate data, and a status flag.
  • the state flag is data added by the ink server 4 to each stroke data in the answer ink data already stored in the ink database 6, and is not included in the stroke data at the stage output from the student terminal 2. Details of the status flag will be described later.
  • Each piece of coordinate data can include coordinates indicating the position of the pen P on the touch surface, pen pressure values indicating the pressure applied to the tip of the pen P, tilt data indicating the inclination of the pen P, and on/off information of the switch provided on the pen P.
  • the pen pressure value and the on/off information are data acquired by the pen P and transmitted from the pen P to the touch detection device of the student terminal 2 .
  • tilt data is data acquired by the touch detection device when the pen P has two pen tip electrodes.
  • the pen P in this case is configured to transmit pen signals from each of the two pen tip electrodes.
  • the touch detection device calculates the distance between the two pen tip electrodes by performing position derivation based on each of the two pen signals, and acquires tilt data based on the calculated distance.
  • the teacher terminal 3 is a computer whose user is a correspondence education teacher (grader), and is configured to be able to execute a teacher application.
  • the teacher terminal 3 is a personal computer such as a notebook computer or a desktop computer, but it may be a tablet terminal similar to the student terminal 2 or a smart phone.
  • the teacher application is a program for causing the teacher terminal 3 to receive and display an answer window from the ink server 4.
  • the teacher uses the teacher application after logging in using the teacher ID assigned in advance.
  • the teacher terminal 3 which operates according to the teacher's application, identifies the student ID and question ID according to the teacher's operation, and requests the ink server 4 to transmit the answer window corresponding to the identified student ID and question ID. Then, it receives the answer window sent by the ink server 4 as a result of the request and displays it on the display. By looking at the answer window thus displayed, the teacher can grasp the student's answer, and according to this embodiment, it is possible to grasp whether or not the answer has been input in a predetermined state.
  • FIG. 4 is a diagram showing an example of an answer window displayed on the display of the teacher's terminal 3.
  • the answer window is configured to display the rendering result of the answer ink data on the right side and the analysis result of the answer ink data on the left side.
  • the analysis result of the answer ink data can include the result of character recognition as shown in FIG. 4, as well as the analysis result of the answer ink data (recording start time, writing start time, writing end time, time from writing start to submission, total writing time, total stroke length, average writing speed, acceleration, average writing pressure, graph showing the relationship between time and writing pressure, etc.).
  • the analysis result of the answer ink data may include a pseudo-ink usage amount obtained from the stroke length or the like.
  • FIG. 4 two of the stroke data included in the rendering result of the answer ink data are marked with dashed-line rounded squares.
  • This rounded square mark indicates that the corresponding stroke data is drawn in a color different from that of other stroke data, and such a rounded square mark is not actually attached.
  • the ink server 4 is configured to refer to the state flag shown in FIG. 3 when drawing stroke data in the answer window, and change the drawing color according to the value of the state flag. By looking at the changed drawing color, the teacher can know that the input for that portion is not performed in a predetermined state.
  • FIG. 5 is a processing flow diagram showing processing performed by the student terminal 2 to acquire answer ink data.
  • this process starts with the process (step S1) in which the student terminal 2 displays teaching material data according to the operation of the student.
  • the teaching material data includes a display screen that includes a plurality of questions, an answer input area for each question, and a submit button indicating completion of answer input.
  • the process starts with the process (step S1) in which the student terminal 2 displays teaching material data according to the operation of the student.
  • the teaching material data includes a display screen that includes a plurality of questions, an answer input area for each question, and a submit button indicating completion of answer input.
  • the student terminal 2 that displays the teaching material data first determines whether or not the submission button has been pressed (step S2). If it is determined that the button has not been pressed, the student terminal 2 detects the coordinate data (step S3) and determines whether or not pen down has occurred (step S4).
  • the coordinate data detected in step S3 is data that can include the coordinates indicating the position of the pen P on the touch surface, the writing pressure value indicating the pressure applied to the tip of the pen P, the tilt data indicating the inclination of the pen P, and the on/off information of the switch provided on the pen P.
  • the determination result in step S4 is affirmative if the pen pressure value in the coordinate data detected in step S3 indicates that the pen pressure value has changed from 0 to a value greater than 0, and otherwise negative.
  • the question ID specified here is the question ID corresponding to the answer input area including the writing start position.
  • the student terminal 2 determines the stroke ID of the stroke data to be generated by referring to the generated stroke data for the identified question ID (step S6).
  • the stroke ID is, as described above, information indicating the input order of each stroke data in the answer ink data. Therefore, the student terminal 2 may determine a number obtained by adding 1 to the largest one of the one or more stroke IDs already assigned to the generated stroke data for the specified question ID, as the stroke ID of the stroke data to be generated from now on. Subsequently, the student terminal 2 records the current time as the stroke start time (step S7), and then shifts the process to step S8.
  • step S8 the student terminal 2 determines whether or not a pen-up has occurred (step S8).
  • the determination result of step S8 is affirmative if the writing pressure value in the coordinate data detected in step S3 indicates that the writing pressure value has changed from a value greater than 0 to 0, and is negative otherwise.
  • the student terminal 2 that determines in step S8 that the pen-up has not occurred records the coordinate data detected in step S3 (step S9), and then returns to step S2.
  • the student terminal 2 which determines in step S8 that the pen-up has occurred records the current time as the stroke end time (step S10), generates stroke data based on each data recorded after the pen-down (stroke start time, series of coordinate data, stroke end time), and records it in association with the question ID specified in step S5 and the stroke ID determined in step S6 (step S11). After that, the student terminal 2 returns the process to step S2.
  • the student terminal 2 that determined that the submit button was pressed in step S2 generates answer ink data including all recorded stroke data for each question ID, and transmits it to the ink server 4 together with the student ID (step S12).
  • the ink server 4 that has received the transmitted answer ink data stores each received answer ink data in the ink database 6 in association with the received student ID.
  • FIG. 6 is a diagram showing the processing executed by the ink server 4 that stores the answer ink data in the ink database 6.
  • the ink server 4 may execute the process shown in the figure immediately after storing the answer ink data in the ink database 6, or may execute the process shown in the figure by batch processing.
  • the ink server 4 first acquires answer ink data from the ink database 6 (step S20). Then, the answer ink data is analyzed by, for example, executing an instance of the InkToMath class for mathematically analyzing the ink data, and the analysis result is stored in the ink database 6 in association with the answer ink data (step S21).
  • the analysis results saved in this way can be used later when the ink server 4 generates an answer window, and can also be used when the ink data 4 executes the next step S22.
  • the ink server 4 that has executed step S21 next executes an instance of the InkStatistics class for performing statistical processing of ink data, for example, to determine whether or not each stroke data constituting the answer ink data acquired in step S20 has been input in a predetermined state. Then, based on the determination result, the appearance of the answer ink data is controlled (step S22).
  • the specific content of the predetermined state to be determined is not particularly limited, but for example, it is preferable to use, as the predetermined state, a state in which each stroke data is input without stumbling during an answer (that is, without a gap of a predetermined time or longer), a state in which each stroke data is input in a predetermined order, a state in which each stroke data is input while the pen is held within a predetermined tilt range, and the like.
  • FIG. 7 is a process flow diagram showing a specific example of the process executed by the ink server 4 in step S22 of FIG.
  • the example shown in FIG. 7 is an example in which a state in which each stroke data is input without stumbling during an answer is used as the predetermined state to be determined. Further, FIG. 7 shows an example of a case where processing using the analysis result obtained in step S21 of FIG. 6 is performed as preprocessing for executing the processing of step S22.
  • the ink server 4 first executes the processes of steps S31 and S32 for each line of the answer ink data indicated by the analysis result obtained in step S21 of FIG. 6 (step S30). Specifically, the ink server 4 performs a process of calculating a gap time, which is the time from the end of the input of the previous stroke data to the start of the input of the target stroke data, for each of the second and subsequent stroke data in the target line (steps S31 and S32). The ink server 4 may perform the calculation in step S32 based on the time stamps (stroke end time and stroke start time) included in each stroke data.
  • the ink server 4 calculates the quartile of the data group composed of the calculated total gap time (step S33), and calculates the determination reference value based on the calculated quartile (step S34). For example, the ink server 4 may calculate the third quartile (the median of the data group composed of data larger than the median of all data) of the data group composed of the calculated total gap times as the determination reference value.
  • the ink server 4 then executes the processes of steps S36 and S37 for each gap time calculated in steps S30 to S32 (step S35). Specifically, the ink server 4 determines whether or not the attention gap time is longer than the determination reference value (step S36), and if it is determined to be longer, sets the status flag (see FIG. 3) of the corresponding subsequent stroke data to false (step S37).
  • the state flag is Boolean data indicating whether or not the corresponding stroke data has been input in a predetermined state, and if the state flag is false, it indicates that the corresponding stroke data has not been input in a predetermined state. The default value of the status flag is true, and the status flag of stroke data not set to false here becomes true.
  • step S36 can be said to be a process of determining whether or not the input of the corresponding stroke data has been performed in a predetermined state. Also, in the rendering of the answer ink data performed in step S42 (see FIG. 8), which will be described later, the drawing color of the stroke data is changed according to the value of the state flag set in step S37. Therefore, it can be said that the process of step S37 is a process of controlling the appearance when the answer ink data is displayed based on the determination result of step S36.
  • FIG. 8 is a diagram showing the process executed by the ink server 4 in response to the request for transmission of the answer window from the teacher terminal 3.
  • the ink server 4 receives the answer window transmission request from the teacher terminal 3 (step S40), it acquires the corresponding answer ink data and its analysis result from the ink database 6 (step S41).
  • the request to send the answer window includes the student ID and the question ID, and the ink server 4 searches the ink database 6 using the student ID and question ID as keys to acquire the answer ink data and its analysis results.
  • the ink server 4 generates the requested answer window (step S42).
  • the ink server 4 renders the answer ink data obtained in step S41, and arranges the rendering result in the answer window together with the analysis result obtained in step S41.
  • the ink server 4 performs rendering using different drawing colors for stroke data whose state flag is true and stroke data whose state flag is false.
  • the stroke data input in a predetermined state in the example of FIG. 7, input without stumbling
  • the stroke data not input in the predetermined state have different drawing colors.
  • the appearance of the answer ink data displayed on the teacher terminal 3 is controlled depending on whether or not the input of each stroke data constituting the answer ink data is performed in a predetermined state. Therefore, the teacher can easily grasp from the appearance of the answer ink data whether or not the student has answered in the expected state.
  • the criterion value of the answer ink data is calculated based on the quartile of the data group composed of the total gap time calculated for the answer ink data, so it is possible to realize appropriate appearance control corresponding to the individuality of the student (for example, writing speed).
  • the gap time is calculated for each line indicated by the analysis result of the answer ink data, it is possible to exclude the stroke data located at the beginning of the line, which tends to have a large gap time between it and the last stroke data of the previous line, from appearance control.
  • the gap time may be calculated without using the analysis result of the answer ink data. In this case, the stroke data positioned at the beginning of the line can be subjected to appearance control.
  • the predetermined state to be determined in step S21 of FIG. 6 a detailed description was given of an example in which the input of each stroke data is executed without stumbling during answering, but other states may of course be used.
  • the predetermined state a state in which each stroke data is input in a predetermined order may be used.
  • the ink server 4 may determine whether or not the plurality of stroke data constituting the answer ink data has been input in a predetermined state based on the stroke ID of each stroke data and the predetermined order. Such determination is particularly effective, for example, when the content of the question is dictation of Chinese characters.
  • a state in which each stroke data is input while the pen is held in a predetermined tilt range may be used as the predetermined state.
  • the ink server 4 may determine whether or not the plurality of stroke data constituting the answer ink data has been input in a predetermined state. Such a determination is particularly effective, for example, when instructing an infant how to hold the pen P, or the like.
  • step S21 of FIG. 6 only one type of predetermined state is subject to determination in step S21 of FIG. 6, but multiple types of predetermined states may be subject to determination. In this case, it is preferable to provide a plurality of state flags corresponding to each predetermined state within the stroke data.
  • data corresponding to the state flag may be held separately from the stroke data in the ink server 4 or the ink database 6, and based on this data, the appearance when the answer ink data is displayed may be controlled.
  • the appearance when the stroke data is displayed may be controlled by changing the drawing color in the metadata.
  • the appearance when answer ink data is displayed by changing the drawing color of stroke data may be controlled by other methods.
  • the appearance of the answer ink data displayed may be controlled by changing the line width and transparency of the stroke data, the presence or absence of dashed lines surrounding the stroke data, and the like.
  • the appearance of the answer ink data is controlled within the answer window displayed on the teacher terminal 3, but the ink data processing system 1 may be configured so that similarly controlled ink data is displayed when the student confirms his/her own answer on the student terminal 2. In this way, it becomes possible for the student himself or herself to know whether or not the answer was given in the expected state.
  • the appearance of the rendering result of the answer ink data displayed in the answer window is controlled, but the appearance of the character recognition result displayed in the answer window may also be controlled in the same way.
  • the easy-to-read print makes it possible for the student to grasp whether or not he or she has answered in the expected state.
  • step S42 shown in FIG. 8 when the answer window is generated in step S42 shown in FIG. 8, rendering is performed using different drawing colors for the stroke data for which the state flag is true and for the stroke data for which the state flag is false.
  • the teacher can grasp whether or not the student was able to answer in the expected state in units of abstract information rather than individual stroke data. For example, when a student stumbles in a quadratic equation, by setting the drawing color of all the stroke data that constitutes the quadratic equation to a color different from that of other stroke data, the teacher can grasp whether or not the student lowered during the answer by the unit of the quadratic equation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
PCT/JP2022/048545 2022-01-20 2022-12-28 コンピュータ、プログラム、及びストロークデータ表示制御方法 Ceased WO2023140089A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2023575175A JPWO2023140089A1 (https=) 2022-01-20 2022-12-28
DE112022006466.8T DE112022006466T5 (de) 2022-01-20 2022-12-28 Computer, programm und verfahren zur steuerung der anzeige von schriftzugsdaten
CN202280086404.XA CN118401982A (zh) 2022-01-20 2022-12-28 计算机、程序及笔划数据显示控制方法
US18/778,423 US12535897B2 (en) 2022-01-20 2024-07-19 Computer, computer-readable medium, and stroke data display control method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-007373 2022-01-20
JP2022007373 2022-01-20

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/778,423 Continuation US12535897B2 (en) 2022-01-20 2024-07-19 Computer, computer-readable medium, and stroke data display control method

Publications (1)

Publication Number Publication Date
WO2023140089A1 true WO2023140089A1 (ja) 2023-07-27

Family

ID=87348638

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/048545 Ceased WO2023140089A1 (ja) 2022-01-20 2022-12-28 コンピュータ、プログラム、及びストロークデータ表示制御方法

Country Status (5)

Country Link
US (1) US12535897B2 (https=)
JP (1) JPWO2023140089A1 (https=)
CN (1) CN118401982A (https=)
DE (1) DE112022006466T5 (https=)
WO (1) WO2023140089A1 (https=)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102184652A (zh) * 2011-06-01 2011-09-14 张建强 一种演示文字书写过程的数字化方法及软件系统
JP2012100137A (ja) * 2010-11-04 2012-05-24 Fuji Xerox Co Ltd 画像処理装置、画像処理システム及び画像処理プログラム
JP2016004258A (ja) * 2014-06-19 2016-01-12 コニカミノルタ株式会社 記述過程自動分析装置と分析方法及び分析プログラム
JP2019113803A (ja) * 2017-12-26 2019-07-11 株式会社光文書院 漢字学習装置
JP2020016871A (ja) * 2018-07-17 2020-01-30 大日本印刷株式会社 情報処理装置及びプログラム
JP2021119374A (ja) * 2020-01-30 2021-08-12 Kddi株式会社 文書から認知・非認知能力を推定する能力推定プログラム、装置及び方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9013440B2 (en) * 2011-02-14 2015-04-21 Lenovo (Singapore) Pte. Ltd. Ink control on tablet devices
WO2015136618A1 (ja) * 2014-03-11 2015-09-17 株式会社 東芝 電子機器、方法およびプログラム
US10126873B2 (en) * 2016-06-24 2018-11-13 Wacom Co., Ltd. Stroke continuation for dropped touches on electronic handwriting devices
WO2018092555A1 (ja) 2016-11-18 2018-05-24 株式会社ワコム デジタル入力装置、デジタル添削装置及び通信教育システム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012100137A (ja) * 2010-11-04 2012-05-24 Fuji Xerox Co Ltd 画像処理装置、画像処理システム及び画像処理プログラム
CN102184652A (zh) * 2011-06-01 2011-09-14 张建强 一种演示文字书写过程的数字化方法及软件系统
JP2016004258A (ja) * 2014-06-19 2016-01-12 コニカミノルタ株式会社 記述過程自動分析装置と分析方法及び分析プログラム
JP2019113803A (ja) * 2017-12-26 2019-07-11 株式会社光文書院 漢字学習装置
JP2020016871A (ja) * 2018-07-17 2020-01-30 大日本印刷株式会社 情報処理装置及びプログラム
JP2021119374A (ja) * 2020-01-30 2021-08-12 Kddi株式会社 文書から認知・非認知能力を推定する能力推定プログラム、装置及び方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
IIYAMA MASAAKI, CHIHIRO NAKATSUKA, YOSHITAKA MORIMURA, ATSUSHI HASHIMOTO, MASAYUKI MURAKAMI, MICHIHIKO MINOH: "Detecting Answer Stuck Point Using Time Intervals of Pen Strokes", TRANSACTIONS OF JAPANESE SOCIETY FOR INFORMATION AND SYSTEMS IN EDUCATION, JAPANESE SOCIETY FOR INFORMATION AND SYSTEMS IN EDUCATION, vol. 34, no. 2, 1 April 2017 (2017-04-01), pages 166 - 171, XP093079820, ISSN: 1341-4135, DOI: 10.14926/jsise.34.166 *

Also Published As

Publication number Publication date
US12535897B2 (en) 2026-01-27
US20240371057A1 (en) 2024-11-07
DE112022006466T5 (de) 2024-11-07
JPWO2023140089A1 (https=) 2023-07-27
CN118401982A (zh) 2024-07-26

Similar Documents

Publication Publication Date Title
US9086798B2 (en) Associating information on a whiteboard with a user
CN104507389B (zh) 集中度测量装置和程序
JP6340830B2 (ja) 解析装置及びプログラム
CN110060531B (zh) 一种使用智能数码笔的计算机在线考试系统和方法
CN111027537B (zh) 一种搜题方法及电子设备
JP2016085614A (ja) 情報処理装置、情報処理システム及びプログラム
JP6068615B1 (ja) 学習支援システム、電子機器、サーバ装置、情報処理装置、及びプログラム
CN113485570B (zh) 多人书写方法、装置、计算机可读存储介质及终端设备
JP6980883B1 (ja) アシストシステム、アシスト方法、およびアシストプログラム
CN113065988A (zh) 一种作业批改方法、系统以及装置
CN112286411A (zh) 显示模式的控制方法、装置、存储介质以及电子设备
Tennison et al. Comparing haptic pattern matching on tablets and phones: Large screens are not necessarily better
KR20230035011A (ko) 필기 입력 기반의 코칭 서비스 제공방법 및 그를 위한 서버
WO2023140089A1 (ja) コンピュータ、プログラム、及びストロークデータ表示制御方法
US20260126865A1 (en) Computer, computer-readable medium, and stroke data display control method
JP2016091347A (ja) 手書き文字管理システム、手書き文字管理方法、および手書き文字管理プログラム
JP2016090747A (ja) 情報処理装置、情報処理システム及びプログラム
JP2016139293A (ja) 書き写し度算出システム、方法及びプログラム
JP2014224877A (ja) 学習支援システム、表示制御方法、プログラム及び情報記憶媒体
US12124670B2 (en) Information sharing system, method, and program
US12050746B2 (en) Ink amount calculation method, information processing device, and program
US12366930B2 (en) Input support apparatus, method, computer-readable medium, and input system
Räihä Some applications of string algorithms in human-computer interaction
KR20210086384A (ko) 형상화된 문자를 포함하는 캐릭터를 이용한 학습서비스를 제공하는 장치 및 방법
KR102130642B1 (ko) 아이템별 응시 시간 카운트 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22922239

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
ENP Entry into the national phase

Ref document number: 2023575175

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 202280086404.X

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 112022006466

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22922239

Country of ref document: EP

Kind code of ref document: A1