JP6190661B2 - Input terminal, program, and input reception method - Google Patents

Description

  The present invention relates to input control.

  2. Description of the Related Art Conventionally, there is a technique for preparing display output information that integrates information from a plurality of input devices by preparing layer information that forms input information for each input device as image information and multiplexing the layers. Patent Document 1 describes such a technique.

JP 2012-011245 A

  In the above technique, since layer information is provided for each input device, there is a case where the method of superimposing does not match depending on the input content and the order of input. For example, in the case where the input is performed a plurality of times alternately from a plurality of input devices, the input from the input device having the layer positioned at the top in the end may be the information of the input whose input order is old. It may be displayed on the top. That is, the time-series order of input may not be properly reflected in the display.

  An object of the present invention is to provide an input processing technique in which the order of input from one or a plurality of input devices is reflected.

The present application includes a plurality of means for solving at least a part of the above-described problems. Examples of such means are as follows. In order to solve the above problem, an input terminal according to the present invention includes an input reception unit that receives input information including position information that specifies a position of an input target at a predetermined point in an input reception period from the start to the end of input, The input information cooperation unit that receives the input information from another device in a predetermined period overlapping with part or all of the input reception period, the input information received by the input information cooperation unit, and the input reception unit For the input information in a period overlapping with the received input information, an input exclusive control unit that performs exclusive control to receive the input in priority order from the earliest start time and the input exclusive control unit receives the priority. For the input information, the figure specified by combining the input target position according to the elapsed time from the input start time is drawn. And the output unit determines the position of the input target for input information other than the input information prioritized by the input exclusive control unit after performing drawing using the input information received with priority. The graphic specified by combining according to the elapsed time from the time when the input was started is superimposed and drawn.

  In the input terminal, the input information cooperation unit may transmit the input information received by the input receiving unit to the other device.

  Further, in the input terminal, the input receiving unit configures a vector connecting the position of the input target at the predetermined time point and the position of the input start time point and the position of the input end time point. It may be specified by the position of a point.

  Further, in the above input terminal, the output unit is provided for each input information from the start to the end of each of the input information received by the input receiving unit or the input information received by the input information cooperation unit. A vector graphic composed of one or a plurality of vectors may be configured as the graphic and drawn.

  In the input terminal, when the direction of the position changes more than a predetermined amount with respect to input information from the start to the end of the input, the output unit configures different vectors before and after the change. It may be characterized by that.

  In the input terminal, when the input receiving unit detects the position where the contact is input on the screen, the input receiving unit receives it as the start of the input, and after the contact input position is continuously detected on the screen. If the end of the contact input on the screen is detected, the input may be accepted as the end of the input.

The program according to the present invention is a program for causing a computer to execute an input procedure, causing the computer to function as a control unit, and allowing the control unit to perform a predetermined input reception period from the start to the end of input. An input reception procedure for receiving input information including position information for specifying the position of the input target at the time of the input, and an input for receiving the input information from another device in a predetermined period overlapping with part or all of the input reception period Priority is given to the input information in the overlapping period between the information cooperation procedure, the input information received in the input information cooperation procedure, and the input information received in the input reception procedure in order from the earliest start of input. Priority is given to the input exclusive control procedure for performing exclusive control to be accepted and the above input exclusive control procedure. For the received input information, an output procedure for drawing a figure specified by combining the position of the input target according to the elapsed time from the time when the input was started is performed. After drawing using the input information received with priority, the position of the input target for the input information other than the input information prioritized by the input exclusive control procedure is combined according to the elapsed time from the input start time. By doing so, the graphic specified is drawn and superimposed.

The input reception method according to the present invention is a computer input reception method, wherein the computer includes position information that specifies a position of an input target at a predetermined point in an input reception period from the start to the end of input. An input reception step for receiving input information, an input information cooperation step for receiving the input information from another device in a predetermined period overlapping with part or all of the input reception period, and the input information received by the input information cooperation step An input exclusive control step for performing exclusive control to receive the input information in a period overlapping between the input information and the input information received in the input receiving step , with priority given to the input start time in order from the earliest, and the input For the input information received with priority by the exclusive control step, An output step of drawing a figure specified by combining the positions according to the elapsed time from the time when the input was started, and the output step used the input information received with priority Superimpose a figure specified by combining the position of the input target for the input information other than the input information prioritized by the input exclusive control step after drawing according to the elapsed time from the input start time. It is characterized by drawing.

  Problems, configurations, and effects other than those described above will become apparent from the following description of embodiments.

  According to the present invention, it is possible to provide an input processing technique that reflects the order of input from one or a plurality of input devices.

It is a figure which shows the Example of a handwriting input assistance system. It is a figure which shows the structural example of an input terminal. It is a figure which shows the data structure stored in a file share information storage part. It is a figure which shows the data structure stored in an update token memory | storage part. It is a figure which shows the data structure stored in an input history memory | storage part. It is a figure which shows the hardware constitutions of an input terminal. It is a figure which shows the flow of exclusive input control processing. It is a figure which shows the example of the screen display of the result of input control.

  Hereinafter, an embodiment using a handwriting input support system 1 to which a first embodiment according to the present invention is applied will be described with reference to the drawings.

  FIG. 1 is a diagram showing an example of a handwriting input support system 1 according to the first embodiment of the present invention. In the handwriting input support system 1 assumed in the present embodiment, input terminals 100A to 100F used for input by operators A10A to F10F that perform input are included, and are connected to be communicable with each other via a network 5. Is done.

  In the system, information to be handwritten can be shared by one or more of the operators A10A to F10F. Operators A10A to F10F start sharing information to be handwritten by inputting an operation for inputting information to the handwritten object created by any of the operators to the input terminal. Can do. The input handwritten information is synchronized at a predetermined timing between the input terminals sharing the information to be handwritten, shared between the input terminals, and displayed and output.

  For example, when the operator B 10B starts sharing using the input terminal 100B via the network 5 for information such as a file input by the operator A 10A using the input terminal 100A, the input terminal 100A and The input terminal 100B superimposes and displays information input via the input terminal 100A and information input via the input terminal 100B according to the order of input.

  Furthermore, when sharing is started from a plurality of operators such as the operator F10F from another operator C10C via the network 5, the input terminal 100A to the input terminal 100F also input information from those operators. The information input via 100A or input terminal 100F is superimposed and displayed according to the order of input.

  In particular, when input is performed by handwriting input such as a capacitance method, input information during a period from the start of contact for input to the end of contact, that is, input of one stroke is preferentially collected. Exclusive control. That is, during the input of one stroke, even if operated from another device, it can be appropriately reflected without being interrupted.

  FIG. 2 is a diagram illustrating a configuration example of the handwriting input support system 1. The handwriting input support system 1 includes input terminals 100 </ b> A to 100 </ b> F configured by tablet computers or the like that can be connected to each other via a network 5.

  The input terminals 100A to 100F are various information processing devices such as a tablet device, a personal computer, a smartphone, a workstation, and a PDA (Personal Data Assistant).

  The network 5 is a communication network such as a LAN (Local Area Network) and a WAN (Wide Area Network). It may be a VPN (Virtual Private Network) on a wireless communication network such as a mobile phone communication network.

  The input terminal 100 includes a control unit 110, a storage unit 120, and a communication unit 130. The control unit 110 includes an input receiving unit 111, an input information recording unit 112, an input exclusion control unit 113, and an input information cooperation unit 114. The storage unit 120 includes a file sharing information storage unit 121, an update token storage unit 122, an input history storage unit 123, and a file storage unit 124.

  FIG. 3 is a diagram illustrating an example of the data structure of the file sharing information storage unit 121. The file sharing information storage unit 121 includes, for each file name 121A for identifying a file, a file creator 121B that is information for identifying the creator of the file, a sharer 121C that can edit the file, a sharer's The priority order 121D for specifying the priority order is stored in association with each other.

  That is, the information stored in the file sharing information storage unit 121 is information that can specify the creator and the sharer for each file.

  FIG. 4 is a diagram illustrating an example of the data structure of the update token storage unit 122. The update token storage unit 122 stores a token holder 122B that identifies the current token holder in association with each file name 122A for identifying a file.

  In other words, the information stored in the update token storage unit 122 is information that identifies an operator with a high priority of updating for each file in order of priority.

  FIG. 5 is a diagram illustrating an example of the data structure of the input history storage unit 123. In the input history storage unit 123, input information that is input is associated with each file name 123A that identifies the file. Specifically, as input information, a vector ID 123B that specifies a vector graphic that forms part of the input stroke, a start time 123C that is information specifying the start time of vector input, and the end of input of the vector End time 123D, which is information for specifying time, start point 123E, which is information for specifying the start position of vector input, end point 123F, which is information for specifying the end position of vector input, and vector input The input person 123G, which is information specifying the performed operator, is stored in association with each other.

  That is, the information stored in the input history storage unit 123 can specify, for each file, the person who has input the file, the input information, and the relationship between the input information and time series. Information.

  Returning to the description of FIG. The input receiving unit 111 of the control unit 110 receives input information including position information that specifies the position of the input target at a predetermined point in the input receiving period from the start to the end of input. Specifically, the input receiving unit 111 changes the position of a series of input positions at a predetermined interval (for example, an interval of 10 milliseconds) from when the input information is input in units of strokes, that is, contact input until the contact input is released. (For example, the coordinate position on the screen) is accepted as one stroke.

  In addition, the input receiving unit 111 receives information specifying the operator for each stroke in association with each other.

  The input information recording unit 112 converts the input information received by the input receiving unit 111 into a combination of vector graphics divided into vectors, and records them in the input history storage unit 123. Specifically, the input information recording unit 112 regards a change in the input position as a line based on the position information included in the input information received by the input receiving unit 111, and the direction of the line is greater than or equal to a predetermined value (for example, 30 degrees or more). ) When changing, that is, when the direction of the vector changes more than a predetermined value, the position immediately before the change is specified as the end point of one vector and the start point of another new vector. Then, each from the start point to the end point is set as vector data. Then, the input information recording unit 112 stores the vector data in the input history storage unit 123.

  The input information recording unit 112 is specified by combining the position of the input target according to the elapsed time from the time when the input was started at a predetermined timing of exclusive control by the input exclusive control unit 113 described later. Configure vector graphics and generate output information. That is, it can be said that the input information recording unit 112 is also an output unit that generates output information.

  Note that the input information recording unit 112 also transmits input information from the other input terminals 100B to 100F sharing the same file with the input terminal 100A and received by the input information cooperation unit 114 described later. Similarly, it is converted into a combination of vector graphics and recorded in the input history storage unit 123.

  The input exclusive control unit 113 performs exclusive control on input information input to the input terminal 100A and the other input terminals 100B to 100F sharing the same file.

  Specifically, the input exclusion control unit 113 determines between the input information input via another device received by the input information cooperation unit 114 and the input information of the device received by the input reception unit 111. Thus, with respect to the input information in the overlapping period, exclusive control for receiving any input information with priority over the other input information is performed. In the exclusive control, the input exclusive control unit 113 receives the input information (that is, the stroke) with priority from the earliest start of input. In other words, an input with an early start time is accepted as a target to be output first, and information input in parallel during the same period is superimposed and displayed after the priority stroke is output.

  The input information linkage unit 114 transmits the input information received by the input receiving unit 111 to another device that shares the same file. Further, the input information cooperation unit 114 receives input information transmitted from other devices sharing the same file.

  The communication unit 130 communicates with other devices, for example, the input terminal B100B to the input terminal F100F, via the network 5.

  FIG. 6 is a diagram illustrating a hardware configuration example of the input terminal 100. The input terminal 100 includes at least an arithmetic device 102, an external storage device 103, a main storage device 104, an output device 105, a communication device 106, and a bus 107 that connects the devices. In addition, the input terminal 100 includes an input device 101 such as a touch panel.

  The arithmetic device 102 is an arithmetic device such as a CPU (Central Processing Unit).

  The external storage device 103 is a non-volatile storage device such as a so-called hard disk (Hard Disk Drive), SSD (Solid State Drive) or flash memory capable of storing digital information.

  The main storage device 104 is a memory device such as a RAM (Random Access Memory).

  The output device 105 is a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display.

  The communication device 106 is a device such as a network card that establishes a communication path with another input terminal 100 via the network 5 and transmits and receives information.

  The input device 101 includes various touch panels such as an electrostatic induction type or a pressure-sensitive type that detect a position touched by a stylus pen or a finger and detect that an input is performed on an object on the screen corresponding to the position. It is an input device.

  The input device 101, the arithmetic device 102, the external storage device 103, the main storage device 104, the output device 105, and the communication device 106 are connected to each other by a connecting conductor such as a bus 107.

  The input receiving unit 111, the input information recording unit 112, the input exclusion control unit 113, and the input information cooperation unit 114 of the input terminal 100 described above are realized by a program that causes the arithmetic device 102 to perform processing. The program is stored in the main storage device 104, the external storage device 103, or a ROM device (not shown), loaded onto the main storage device 104 for execution, and executed by the arithmetic device 102.

  The storage unit 120 of the input terminal 100 is realized by the main storage device 104 and the external storage device 103. In addition, the communication unit 130 of the input terminal 100 is realized by the communication device 106. The above is the hardware configuration example of the input terminal 100.

  Each of the above-described constituent elements is a classification of the configuration of the input terminal 100 according to main processing contents in order to facilitate understanding. Therefore, the present invention is not limited by the way of classifying the components and their names. The configuration of the input terminal 100 can be classified into more components depending on the processing content. Moreover, it can also classify | categorize so that one component may perform more processes.

  Each control unit may be constructed by hardware (ASIC, GPU, etc.). Further, the processing of each control unit may be executed by one hardware, or may be executed by a plurality of hardware.

  [Description of Operation] Next, the operation of the input terminal 100 in the present embodiment will be described. FIG. 7 is a flowchart of exclusive input control processing performed by the input terminal 100 according to this embodiment.

  The exclusive input control process is started when the input terminal 100 starts operating, a file is opened, file sharing is registered in the file sharing information storage unit 121, and input to the file is performed.

  First, the input receiving unit 111 receives information about an input start time and a start point (step S001). Specifically, the input reception unit 111 receives a time when a stroke input by a touch input is started and a touch position.

  Then, the input exclusion control unit 113 determines whether or not there is a series of inputs that have already been granted another update token (step S002). Specifically, the input exclusion control unit 113 determines whether there is input information related to the stroke to which the update token is given, which is the input information received from the input information cooperation unit 114.

  The update token is information given to an operator who is inputting a stroke for the sake of convenience in order to indicate that the stroke should be handled with priority. As shown in the update token storage unit 122, the update token is given by registering a holder in units of files. In this step, the input exclusion control unit 113 refers to the updated token storage unit 122 and determines whether or not the token holder corresponding to the file being edited is the operator of the own input terminal 100. It is determined whether there is a series of inputs for which another update token is being granted.

  If there is no series of inputs for which an update token is being granted (in the case of “No” in step S002), the input exclusion control unit 113 grants a token to the series of inputs that the input terminal has received and terminated. The input is transmitted to another sharer (step S003). Specifically, the input exclusion control unit 113 accepts an input of a stroke input at its own input terminal, and registers information for specifying the operator in the update token storage unit 122. Then, the input exclusion control unit 113 transmits stroke information to other input terminals sharing the file via the input information cooperation unit 114.

  Then, the input information recording unit 112 stores a series of inputs for which input has been completed and input information transmitted from other sharers, and adds the information being input to generate an output screen (step S004). Specifically, the input information recording unit 112 stores the input stroke information and the stroke information from another input terminal received by the input information cooperation unit 114 in the input history storage unit 123 at the start time. Store in order. When there is a stroke having the same start time, the priority order of the sharer who has input the stroke is specified by referring to the file sharing information storage unit 121 and stored according to the priority order. Then, the input information recording unit 112 identifies one or a plurality of vector graphics for each piece of stroke information, outputs a stroke graphic having an update token, and identifies vector graphics related to other strokes. Overlay display.

  When there is a series of inputs to which an update token is being granted (in the case of “Yes” in step S002), the input information recording unit 112 specifies the input until the direction changes more than a predetermined value as a vector, Information on the end point, start time, and end time is stored in the memory of the self-input terminal (step S005).

  Then, the input exclusion control unit 113 determines whether a series of inputs has been completed (step S006). Specifically, the input exclusion control unit 113 determines whether or not the stroke has been determined based on whether or not the touch input that has been continued has been interrupted.

  When the series of inputs is completed (in the case of “Yes” in step S006), the input exclusion control unit 113 returns the control to step S002. If the input has not ended (in the case of “No” in step S006), the input exclusion control unit 113 returns the control to step S005.

  The above is the process flow of the exclusive input control process. By executing the exclusive input control process, information input at different terminals at the same time can be divided into strokes, and the strokes can be displayed in a superimposed manner in the order in which strokes are input. In the exclusive input control process, the input terminals 100 sharing the file can update the information in real time by transmitting the stroke information input to each other, and therefore share the same input history information. It becomes. For this reason, there is no hesitation in the overlapping relationship of strokes between input terminals. In addition, for example, stroke information may be stored on behalf of a sharable file server device or the like, and may be referred to and updated between input terminals.

  FIG. 8 is a diagram illustrating transition examples 300A to 300H of screen display examples of the output screen generated in step S004 of the exclusive input control process.

  In the transition example 300A, two vectors 301 and 302 inputted by the operator A in one stroke are output. If the operator A further inputs a stroke and determines it, a vector 303 is output as in transition example 300B.

  An example in which two strokes are input from another operator B while the transition example 300B is displayed is a transition example 300C. In the transition example 300C, two strokes input from the operator B are superimposed and displayed as a vector 311 and a vector 312 respectively.

  When transition example C is displayed and there is an input of one stroke from the original operator A and another operator B almost simultaneously, as shown in transition example 300D and transition example 300E, the respective strokes are displayed. Among these, a vector 321 indicating a stroke with an early input start (assuming that the input from the operator A is earlier in this example) is output first, and a vector 331 indicating the stroke of the operator B after the vector 321 is output. Are superimposed and output.

  Similarly, as shown in transition example 300F, when a vector 322 indicating a stroke input by operator A and a vector 332 indicating a stroke input by operator B are input, they are superimposed and displayed. Is done.

  The transition example 300G and the transition example 300H are respectively in a state where the transition example 300F is displayed, and when one stroke is input from each of the original operator A and another operator B almost simultaneously, An example is shown in which a vector 323 and a vector 324 constituting a stroke input by the operator A are output first, and a stroke vector 333 input from another operator B is output after the vectors 323 and 324 are output.

  The above is a diagram illustrating transition examples 300A to 300H of the screen display example of the output screen generated in step S004 of the exclusive input control process.

  As described above, until the priority stroke is displayed, the display of other strokes is delayed, and other strokes are superimposed, so the superimposition relationship is organized according to the input order, causing unnecessary confusion. The order of input from one or a plurality of input devices is reflected without inviting.

  This can be said to reflect the order accurately when the input order is important, such as when a strikethrough is drawn on the stroke content once described.

  The handwriting input support system 1 to which the first embodiment according to the present invention is applied has been described above. According to this embodiment, it is possible to perform input processing that reflects the order of input from one or more input devices.

  The present invention is not limited to the first embodiment described above. The first embodiment described above can be variously modified within the scope of the technical idea of the present invention. For example, in the first embodiment described above, the superiority or inferiority of the input from each input terminal is based on the input start time, but is not limited thereto. For example, even if the input start time is somewhat delayed, the file creator's input may be given priority. According to this, since the input of another operator is reflected between the input of the file creator, it is possible to avoid obstructing the input of the file creator.

  Further, the technical elements of the above-described embodiments may be applied independently, or may be applied by being divided into a plurality of parts such as program parts and hardware parts.

  In the above, this invention was demonstrated centering on embodiment.

DESCRIPTION OF SYMBOLS 1 ... Handwriting input support system, 5 ... Network, 10A-10F ... Operator, 100A-100F ... Input terminal, 110 ... Control part, 111 ... Input reception part, 112 ... Input information recording unit, 113 ... Input exclusion control unit, 114 ... Input information cooperation unit, 120 ... Storage unit, 121 ... File sharing information storage unit, 122 ... Update token storage , 123 ... input history storage unit, 124 ... file storage unit, 130 ... communication unit

Claims (8)

An input reception unit that receives input information including position information that specifies a position of an input target at a predetermined point in an input reception period from the start to the end of input; and
An input information linkage unit that receives the input information from another device in a predetermined period that overlaps part or all of the input reception period;
Exclusive control that preferentially accepts the input information in a period overlapping between the input information received by the input information cooperation unit and the input information received by the input reception unit in order from the earliest start of input. An input exclusive control unit to perform,
For the input information received with priority by the input exclusive control unit, an output unit that draws a figure specified by combining the position of the input target according to the elapsed time from the time when the input was started;
With
The output unit performs the drawing using the input information received with priority, and then sets the position of the input target for the input information other than the input information prioritized by the input exclusive control unit from the time when the input is started. Draw the figure specified by combining according to the elapsed time of
An input terminal characterized by that. The input terminal according to claim 1,
The input information cooperation unit transmits the input information received by the input receiving unit to the other device;
An input terminal characterized by that. The input terminal according to claim 1 or 2,
The input receiving unit specifies the position of the input target at the predetermined time by the position of a point constituting a vector connecting the position at the time of starting the input and the position at the time of ending the input;
An input terminal characterized by that. The input terminal according to any one of claims 1 to 3 ,
The output unit is configured by one or a plurality of vectors for each input information from the input start to the end related to either the input information received by the input receiving unit or the input information received by the input information cooperation unit. Configure and draw vector graphics as the graphics,
An input terminal characterized by that. The input terminal according to claim 4 ,
The output unit is configured as vectors different from each other before and after the change when the direction of the position changes more than a predetermined amount for the input information from the input start to the end.
An input terminal characterized by that. The input terminal according to any one of claims 1 to 5 ,
When the input receiving unit detects the position where the contact is input on the screen, the input is received as the start of the input, and after the contact input position is continuously detected on the screen, the end of the contact input on the screen Is detected as the end of the input,
An input terminal characterized by that. A program that causes a computer to execute an input procedure,
Causing the computer to function as control means;
For the control means,
An input reception procedure for receiving input information including position information for specifying a position of an input target at a predetermined point in an input reception period from the start to the end of input;
An input information cooperation procedure for receiving the input information from another device in a predetermined period overlapping with part or all of the input reception period;
Exclusive control for preferentially receiving the input information in a period overlapping between the input information received in the input information cooperation procedure and the input information received in the input reception procedure in order from the earliest start of input. Input exclusion control procedure to be performed;
For the input information received with priority in the input exclusive control procedure, an output procedure for drawing a figure specified by combining the position of the input target according to the elapsed time from the time when the input was started;
To implement
In the output procedure, after drawing using the priority-accepted input information, the input target position of the input information other than the input information prioritized by the input exclusive control procedure is started. The figure specified by combining according to the elapsed time from
A program characterized by that. Computer input acceptance method,
The computer
An input reception step for receiving input information including position information for specifying a position of an input target at a predetermined point in an input reception period from the start to the end of input; and
An input information cooperation step for receiving the input information from another device in a predetermined period overlapping with part or all of the input reception period;
Exclusive control that preferentially accepts the input information in a period overlapping between the input information received in the input information cooperation step and the input information received in the input reception step in order from the earliest start of input. An input exclusive control step to be performed;
For the input information received with priority by the input exclusive control step, an output step for drawing a figure specified by combining the position of the input target according to the elapsed time from the time when the input was started;
Carried out
In the output step, the position of the input target for the input information other than the input information prioritized by the input exclusive control step after drawing using the input information received with priority is determined from the time when the input is started. Draw the figure specified by combining according to the elapsed time of
An input reception method characterized by the above.

Images