JP2015005095A - Information processor, information processing method, information processing program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processor capable of facilitating determination of how to organize opinions when organizing the opinions given on an electronic blackboard, and displaying a screen after the organization in an easy-to-read state.SOLUTION: A coordinate acquisition section 9 acquires a position coordinate of display information previously displayed on a movement destination of handwritten information on the basis of operation information indicating that the handwritten information displayed on a first display region 21 moves to a second display region 23. A movement processing section 10 moves the display information displayed on the second display region 23 so as not to interfere with the handwritten information by using the position coordinate of the display information acquired by the coordinate acquisition section 9 and the handwritten information.

Description

  The present invention relates to an information processing apparatus that organizes handwritten information written on an electronic blackboard and displays the information on a display screen.

Conventionally, there is an electronic blackboard that can categorize remarks and opinions as digital data instead of a whiteboard that records the contents of a meeting. There is already known a user interface technology capable of selecting and moving a writing stroke for the purpose of organizing opinion information written by a user on an electronic blackboard.
However, even when the selection / movement function of the conventional electronic blackboard is used, there is a problem that the opinion information cannot be accurately arranged unless it is understood how to arrange the opinion information in the first place.

In addition, when the conventional electronic blackboard selection / movement function is used, even if the user knows how to organize opinions, for example, if the related opinions are arranged in time order, Establish and move the opinion on it. However, there are cases where a plurality of opinions are concentrated on a specific part. In such a case, opinions overlap and it becomes very difficult to see, and there is a problem that visibility of the user is lowered.
As a conventional technique, Patent Document 1 discloses a configuration in which a symbol mark is added to a plurality of objects and information is organized according to the attribute of the added symbol mark for the purpose of organizing qualitative information.

Patent Document 1 discloses that information is organized according to the attributes of symbol marks. However, the configuration for recognizing the coordinate information of the information and changing the display of the organizing destination is not described, and the problem that the description items overlap when the information concentrates on a specific location has not been solved.
The present invention has been made in view of the above. The purpose of the present invention is to make it easy to determine how to organize opinions arranged on an electronic blackboard, and at the same time, An object of the present invention is to provide an information processing apparatus capable of displaying a screen in an easily viewable state.

  In order to solve this problem, the present invention provides an information processing apparatus including a display unit having a first display area for displaying handwritten information and a second display area to which the handwritten information is moved. The display information already displayed at the destination of the handwritten information based on the operation information indicating that the handwritten information displayed in the first display area is moved to the second display area. Using the coordinate acquisition means for acquiring the position coordinates, the position coordinates of the display information acquired by the coordinate acquisition means, and the handwritten information, the display information displayed in the second display area as the handwritten information. And movement processing means for moving so as not to interfere with.

  According to the present invention, the position of the display information already displayed at the destination of the handwritten information based on the operation information indicating that the handwritten information displayed in the first display area is moved to the second display area. The coordinates are acquired, and the display information displayed in the second display area is moved so as not to interfere with the handwritten information using the position coordinates of the display information and the handwritten information. As a result, the screen after sorting can be easily viewed.

It is a block diagram which shows the structure of the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating the presentation UI of the organization method. (A)-(c) is a figure for demonstrating the operation | movement which performs handwriting selection once about a biaxial arrangement | positioning template. (A)-(c) is a figure for demonstrating the operation | movement which performs handwriting selection continuously about a biaxial arrangement | positioning template. It is a flowchart explaining the flow of handwriting selection operation | movement about a biaxial arrangement | sequence template. (A) And (b) is a figure for demonstrating the operation | movement which performs a handwritten movement about a biaxial arrangement | positioning template. (A) And (b) is a figure for demonstrating the operation | movement which performs a handwritten movement about a biaxial arrangement | positioning template. (A) is a figure for demonstrating the operation | movement which performs handwritten movement about a biaxial arrangement | positioning template, (b) is a flowchart for demonstrating the flow of operation | movement. (A) And (b) is a figure for demonstrating the operation | movement which performs a handwritten movement about a biaxial arrangement | positioning template. It is a figure for demonstrating the operation | movement which performs handwritten movement about a time series arrangement | sequence template. (A) And (b) is a figure for demonstrating the operation | movement which performs handwritten movement about a time series arrangement | positioning template. (A) is a figure for demonstrating the processing method in the case of FIG. 11, (b) is a flowchart for demonstrating the flow of operation | movement. It is a figure for demonstrating a template. It is a figure for demonstrating a mode that a template is memorize | stored. It is a flowchart for demonstrating operation | movement of a movement process part.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the components, types, combinations, shapes, relative arrangements, and the like described in this embodiment are merely illustrative examples and not intended to limit the scope of the present invention only unless otherwise specified. .

FIG. 1 is a block diagram showing a configuration of an information processing apparatus according to an embodiment of the present invention. An information processing apparatus 100 according to the present invention includes a touch panel 1, an operation input unit 2, a display 3, a display unit 4, an arrangement template presentation unit 5, an arrangement template storage unit 6, a handwriting processing unit 7, a selection processing unit 8, and a movement processing unit 10. And the handwriting storage unit 11.
The touch panel 1 inputs input information in response to touching the screen.
The operation input unit 2 detects a template selection operation, handwritten information, handwriting information selection operation, handwriting information movement operation, and the like by a user operation on the touch panel 1, and outputs the operation information to the organizing template presenting unit 5.

The display 3 displays handwritten information and templates from the display unit 4.
The display unit 4 displays handwritten information and templates on the display 3.
The arrangement template presenting unit 5 presents an arrangement template candidate when there is a request for presentation of an arrangement template as operation information from the operation input unit 2. In addition, when the operation input unit 2 detects the selection of an arrangement template by the user from the candidates, the arrangement template presentation unit 5 requests the display unit 4 to display the arrangement template according to the operation information.

The arrangement template storage unit 6 stores a plurality of arrangement templates as image information, and the arrangement template presentation unit 5 presents them according to a user request.
When the operation input unit 2 detects a handwriting operation related to handwritten information by the user, the handwriting processing unit 7 stores the coordinate information of the handwritten stroke in the handwriting storage unit 11 according to the operation information.
The selection processing unit 8 specifies the selected handwritten information, and selects handwritten information including a stroke in a substantially circular shape or a substantially oval shape drawn by a drag operation in the selection mode. Alternatively, handwritten information including a stroke having a touched point as a constituent element is selected.

The coordinate acquisition unit 9 is based on the operation information indicating that the handwritten information displayed in the first display area is moved to the second display area, and the position of the display information already displayed at the destination of the handwritten information. Get the coordinates.
When the operation input unit 2 detects the movement operation of the handwritten information by the user, the movement processing unit 10 creates a new handwriting based on the information of the movement destination coordinates and the position information of the other handwritten information according to the operation information. Information is stored in the handwriting storage unit 11. The movement processing unit 10 uses the position coordinates of the display information acquired by the coordinate acquisition unit 9 and the handwritten information to move the display information displayed in the second display area so as not to interfere with the handwritten information.
The handwriting storage unit 11 stores stroke information that is a set of coordinates on the display as handwritten information.

  Note that the arrangement template presentation unit 5, the arrangement template storage unit 6, the handwriting processing unit 7, the selection processing unit 8, and the movement processing unit 10 may each be configured by a processing module. Each of these units may include a read only memory (ROM), a random access memory (RAM), a central processing unit (CPU), and a hard disk drive (HDD). Then, the operating system OS may be read from the HDD, expanded on the RAM, and the OS may be activated. Under the OS management, the program (processing module) may be read from the HDD and various processes may be executed.

FIG. 2 is a diagram for explaining the organizing method presentation UI.
In the presentation UI 20, the first display area 21 is displayed on the left side with the broken line as the center, and the second display area 23 is displayed on the right side. Then, handwritten information 22 is displayed in the first display area 21, and an arrangement template 26 is displayed in the second display area 23. Here, when the displayed organization button 26 is clicked, a plurality of organization methods are presented, and each template can be used by the user touching the template on the screen. At the same time, the mode shifts to the selection mode, and normal handwritten information cannot be operated. In this example, a biaxial arrangement template 24 and a time series arrangement template 25 are displayed.
The biaxial organization template 24 is a template displayed in the second display region for organizing the handwritten information displayed in the first display region, and is orthogonal to the horizontal direction in the second display region. This is image information representing two axes.
On the other hand, the time series organizing template 25 is a template displayed in the second display area for organizing the handwritten information displayed in the first display area, and is a vertical direction representing a time series along the time axis or Contains image information representing a horizontal line.

FIG. 3 is a diagram for explaining an operation of selecting an operation for handwritten information once for a biaxial arrangement template. Each operation procedure will be described as (a) to (c).
An operation when the biaxial arrangement template 24 is selected in the presentation UI 20 of FIG. When the biaxial arrangement template 24 is selected, the handwritten information 22 so far is reduced and displayed on the upper left (FIG. 3A), and the biaxial arrangement template 24 is displayed on the right side. The user selects a portion 22a to be expressed by the biaxial arrangement template 24 from the upper left handwritten information 22 (FIG. 3B) and moves to the area A on the two axes (FIG. 3C).
The selection operation is performed by an operation such as enclosing handwritten information in a substantially circular shape or an elliptical shape or touching the corresponding handwritten information. The movement operation is performed by dragging the selected handwritten information or by further touching the movement destination after selection.

  FIG. 4 is a diagram for explaining an operation of continuously selecting handwritten information for a biaxial arrangement template. Each operation procedure will be described in the order of (a) to (c). The same constituent elements will be described with the same reference numerals as in FIG. As shown in FIG. 4A, a plurality of handwritten information is selected by continuously performing the operation surrounding the handwritten information 22. That is, as shown in FIG. 4B, the handwritten information 22a to 22c is continuously surrounded, and the handwritten information 22a to 22c is moved to the area A of the biaxial organization template 24 as shown in FIG. As a result, the selected handwritten information is displayed together.

FIG. 5 is a flowchart for explaining the flow of the selection operation for handwritten information for the biaxial arrangement template.
First, handwritten information is selected by detecting a selection operation in the first display area 21 (S1). Next, when selection completion is detected, the mode shifts to the movement mode (S2).
Next, when an operation in the first display area 21 is further detected in the movement mode, the selection is canceled and the mode returns to the selection mode (S3).
Next, when a movement operation is detected in the movement mode, movement is performed (S4).
As shown in FIG. 5, the selection mode and the movement mode are largely divided, and the initial mode is the selection mode. When it is detected that the selection has been made in the selection mode, the mode shifts to the movement mode, the movement is performed, and the templates are arranged.

FIG. 6 is a diagram for explaining an operation of performing handwriting movement on the biaxial arrangement template. Each operation procedure will be described as (a) to (b). The same constituent elements will be described with the same reference numerals as in FIG.
As shown in FIG. 6A, when there is not enough space in the second display area 23 to which the handwritten information is moved (between 23a and 23b), another handwritten as shown in FIG. 6B. Information (23a and 23b) moves up and down, left and right (up and down in the figure) to create a space. Thereby, other handwritten information (22a) can move during that time.

FIG. 7 is a diagram for explaining an operation of moving handwritten information for a biaxial arrangement template. Each operation procedure will be described as (a) to (b). The same constituent elements will be described with the same reference numerals as in FIG.
As shown in FIG. 7A, when there is not enough space in the second display area 23 that is the movement destination (between 23a and 23b), other handwritten information is moved up and down as shown in FIG. 7B. Simultaneously move left and right (up and down in the figure) and reduce all handwritten information. Thereby, a space may be created and other handwritten information (22a) may be able to move during that time.

  Thus, the coordinate acquisition unit 9 is already displayed at the destination of the handwritten information based on the operation information indicating that the handwritten information displayed in the first display area 21 is moved to the second display area 23. Get the position coordinates of the displayed information. The movement processing unit 10 uses the position coordinates of the display information acquired by the coordinate acquisition unit 9 and the handwritten information to move the display information displayed in the second display area 23 so as not to interfere with the handwritten information. Thereby, since handwritten information is arrange | positioned without overlapping with the handwritten information already displayed by the movement destination, interference of handwritten information is lost and it becomes easy to perform visual confirmation.

FIG. 8A is a diagram for explaining an operation of moving handwritten information for a biaxial arrangement template, and FIG. 8B is a flowchart for explaining the flow of the operation.
FIG. 8A is a diagram for explaining the processing method in the case of FIGS. Originally, an example in which handwritten information G as shown by A to F is displayed and an attempt is made to move handwritten information G between handwritten information D and E shown in FIG. Here, the interval between the handwritten information B and D will be described as a, the interval between the handwritten information D and E as b, and the interval between the handwritten information E and F as c. The intervals a, b, c, and d may be handled as the number of pixels in the vertical direction.
In the following description, alphabets A to G indicate handwritten information. When the description is redundant, description of “handwritten information” is omitted.

  This will be described based on the flowchart of FIG. First, it is checked whether the interval is b <d (S11). If the interval is not b <d (NO in S11), G is displayed as it is between the handwritten information D and E (S15). If the interval is b <d in step S11 (YES in S11), it is checked whether the interval is (a + b / 2) <d / 2 (S12), and the interval is (a + b / 2) <d / 2. If there is (YES in S12), the process proceeds to step S13. If the interval is not (a + b / 2) <d / 2 in step S12 (NO in S12), the process proceeds to step 16. In step S13, it is checked whether the interval is (a + b + c) <d. If the interval is (a + b + c) <d (YES in S13), k (0 <k <0) without changing the start position of all strokes. 1) Reduction is doubled (S14). If the interval is not (a + b + c) <d (NO in S13), the handwritten information D is moved upward by a pixels, and the handwritten information E is moved downward by (d−b−a) pixels. Then, G is displayed between the handwritten information D and E (S20).

On the other hand, it is checked in step S16 whether the interval is (c + b / 2) <d / 2. If the interval is not (c + b / 2) <d / 2 (NO in S16), the handwritten information D is moved upward ( db) / 2 Moves by 2 pixels. Then, after the handwritten information E is moved downward by (db) / 2 pixels, G is displayed between the handwritten information D and E (S18). If the interval is (c + b / 2) <d / 2 (YES in S16), the process proceeds to step S17. In step S17, it is checked whether the interval is ((a + b + c) <d. If the interval is not (a + b + c) <d (NO in S17), the handwritten information D is upward (d−b−c) pixels. And the handwritten information E is moved down c, and G is displayed between the handwritten information D and E (S19).
In this way, the movement processing unit 10 changes the position coordinates of the display information displayed in the second display area, so that the display information is not interfered with the handwritten information moved from the first display area. Can be moved.

After dragging as an operation on the handwritten information and determining the destination, the process of the flowchart shown in FIG. 8B is executed. In the flowchart shown in FIG. 8, when the reduction is performed in step S <b> 14, the process returns to the top of the flowchart again to perform the process, and a space in which G enters between the handwritten information D and E is created.
In this way, the movement processing unit 10 may change the size of the display information displayed in the second display area, thereby creating a space and allowing handwritten information to move between them.

FIG. 9 is a diagram for explaining an operation of moving handwritten information for a biaxial arrangement template. Each operation procedure will be described as (a) to (b). The same constituent elements will be described with the same reference numerals as in FIG.
As shown in FIG. 9A, when there is not enough space in the second display area 23 that is the movement destination (left side of 23a), other handwritten information is displayed in the upper, lower, left, and right directions (as shown in FIG. 9B). By moving left and right in the figure, a space is created and other handwritten information (22a) can be moved between them. At that time, the lower right handwritten information (23b) may be shifted to the right as well.
In this way, by changing the position coordinates of other handwritten information (display information) displayed in the second display area, it can be moved so as not to interfere with the handwritten information.
In this way, the biaxial template is image information representing two axes orthogonal to the horizontal direction in the second display area, and each handwritten information is arranged without overlapping at the destination. Interference between handwritten information is eliminated, and visual confirmation is facilitated.
In this way, by displaying the template for organizing the handwritten information displayed in the first display area in the second display area, there is no interference between the handwritten information on the template, and visual confirmation is performed. It becomes easy to do.

FIG. 10 is a diagram for explaining an operation of moving handwritten information with respect to the time-series organization template. The same constituent elements will be described with the same reference numerals as in FIG.
Similar to the biaxial arrangement template, in the time series template, the axis 27 along the time axis is displayed, and handwritten information is moved and arranged thereon. In this example, as shown in FIG. 6, when there is not enough space in the second display area 23 to which the handwritten information is moved (between 23a and 23b), the other handwritten information (23a and 23b) is moved up and down. Move left and right (up and down in the figure) to make space. Thereby, other handwritten information (22a) can move during that time. As a result, each handwritten information is arranged without overlapping at the movement destination, so there is no interference between the handwritten information, and visual confirmation is facilitated.
In this way, by changing the position coordinates of other handwritten information (display information) displayed in the second display area, it can be moved so as not to interfere with the handwritten information.
In this way, the time series template includes image information representing a vertical or horizontal line representing a time series along the time axis, so that each handwritten information is arranged without overlapping at the destination. Interference between handwritten information is eliminated, and visual confirmation is facilitated.
In this way, by displaying the template for organizing the handwritten information displayed in the first display area in the second display area, there is no interference between the handwritten information on the template, and visual confirmation is performed. It becomes easy to do.

FIG. 11 is a diagram for explaining the operation of moving handwritten information with respect to the time-series organization template. The same constituent elements will be described with the same reference numerals as in FIG.
In this example, when there is not enough space in the time series direction of the second display area 23 to which the handwritten information is moved (between 23a and 23b), the other handwritten information (23a and 23b) moves to the left and right. Space is created, and other handwritten information (22a) can move between them.
FIG. 12A is a diagram for explaining the processing method in the case of FIG. Originally, the handwritten information as shown by the handwritten information A to E is displayed, and the handwritten information A is moved between the handwritten information D and E and the handwritten information B and C shown in FIG. An example of the case is shown. Here, it is assumed that the interval between the handwritten information A and C is a, the interval between the handwritten information B and D is b, the interval between the handwritten information E and the edge of the second display area is c, and the length of the handwritten information A is x. . The intervals a, b, c, and the length x may be treated as the number of pixels in the horizontal direction.

This will be described based on the flowchart of FIG. First, it is checked whether the interval is b <x (S31). If the interval is not b <x (NO in S31), the handwritten information A is displayed between the handwritten information B and D as it is (S35). If the interval is b <x in step S31 (YES in S31), it is checked whether the interval is (a + b / 2) <x / 2 (S32), and the interval is (a + b / 2) <x / 2. If there is (YES in S32), the process proceeds to step S33.
If the interval is not (a + b / 2) <x / 2 in step S32 (NO in S32), the process proceeds to step 36. In step S33, it is checked whether the interval is (a + b + c) <x. If the interval is (a + b + c) <x (YES in S33), all strokes are reduced to k times without changing the starting position ( S34). If the interval is not (a + b + c) <x (NO in S33), the handwritten information B and C are moved leftward by a pixels and the handwritten information D and E are (xba) pixels rightward. After the movement, the handwritten information A is displayed between the handwritten information B and C (S40).

On the other hand, whether or not the interval is (c + b / 2) <x / 2 is checked in step S36. If the interval is not (c + b / 2) <x / 2 (NO in S36), the handwritten information D and E are changed to After moving in the direction by (xb) / 2 pixels, the handwritten information A is displayed between the handwritten information B and D (S38). If the interval is (c + b / 2) <x / 2 (YES in S36), the process proceeds to step S37. In step S37, it is checked whether the interval is ((a + b + c) <x. If the interval is not (a + b + c) <x (NO in S37), the handwritten information B and C are moved to the left (x−b−c). It moves by the amount of pixels, and moves the handwritten information D and E to the right by the amount of c pixels, and then displays the handwritten information A between the handwritten information B and D (S39). Since they are arranged without overlapping at the destination, there is no interference between the handwritten information, and visual confirmation is facilitated.
In this way, the movement processing unit 10 changes the position coordinates of the display information displayed in the second display area, so that the display information is not interfered with the handwritten information moved from the first display area. Can be moved.

As in FIG. 8, if the left and right movements cannot create a sufficient movement space, the entire handwritten information is reduced. In this case, the reduction in step S34 is performed on the process flowchart, and the process is performed again from the beginning of the flowchart, and the process is repeated until A is displayed. The process of the flowchart shown in this figure is executed after dragging handwritten information and determining the destination.
In this way, the movement processing unit 10 may change the size of the display information displayed in the second display area, thereby creating a space and allowing handwritten information to move between them.

  FIG. 13 is a diagram for explaining a template. The handwriting storage unit 11 is stored as a set of coordinates of points constituting the stroke in units of strokes as shown in FIG. One handwritten information is composed of one or a plurality of strokes, and the ID in the first column is composed of the same strokes. For example, the coordinates of ID “1” are stored as (0.0, 0.0), (0.1, 0.0), (0.2, 0.5),.

FIG. 14 is a diagram for explaining how a template is stored.
As shown in FIG. 14, the template 30 is stored in the storage unit 31 as image information as described above. The image is composed of binary values of white and black, and the stroke of the handwritten information can be moved only on the white area. In the form associated with the template, direction information indicating whether to move in the “up / down / left / right” direction or the “left / right” direction is stored in the storage unit when there is not enough space. Here, if it is the “up / down / left / right” direction, a movement process as shown in FIGS. 5, 6 and 7 is performed, and if it is in the “left / right” direction, a movement process as shown in FIGS.

FIG. 15 is a flowchart for explaining the operation of the movement processing unit.
When the selection processing unit 8 detects the completion of selection, the processing of the movement processing unit 10 is started. First, the coordinates (x _s , y _s ) of the position touched first are acquired (S41). Next, the coordinates (x _e , y _e ) of the touch position when the end of movement is detected are obtained, the difference between the two coordinates is taken (S42), and the difference amount is added to all strokes to be moved. (S43). Note that the flowchart shown in FIG. 8 or FIG. 11 may be executed after the processing of this flowchart.

  As described above, the present invention provides a plurality of templates for organizing opinions on an electronic blackboard. A feature is that the user selects a template that seems to be optimum from among them, and selects and moves the opinions that have been written on the electronic blackboard on the template. This makes it easy for a person to organize how to sort out opinions on the electronic blackboard, and at the same time makes it easy to see the screen after sorting.

  DESCRIPTION OF SYMBOLS 1 Touch panel, 2 Operation input part, 3 Display, 4 Display part, 5 Organizing template presentation part, 6 Organizing template memory | storage part, 7 Handwriting processing part, 8 Selection processing part, 9 Coordinate acquisition part, 10 Movement processing part, 11 Handwriting memory Part, 20 presentation UI, 21 first display area, 22 handwritten information, 23 second display area, 24 biaxial arrangement template, 25 time series arrangement template, 26 arrangement button, 100 information processing apparatus

JP 05-108288 A

Claims (10)

An information processing apparatus comprising a display unit having a first display area for displaying handwritten information and a second display area to which the handwritten information is moved,
Based on the operation information indicating that the handwritten information displayed in the first display area is moved to the second display area, the position coordinates of the display information already displayed at the destination of the handwritten information are obtained. Coordinate acquisition means to acquire;
Movement processing means for moving the display information displayed in the second display area so as not to interfere with the handwritten information, using the position coordinates of the display information acquired by the coordinate acquisition means and the handwritten information; An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the movement processing unit changes a position coordinate of the display information displayed in the second display area.   The information processing apparatus according to claim 1, wherein the movement processing unit changes a size of display information displayed in the second display area.   The information processing apparatus according to claim 1, wherein a template for organizing handwritten information displayed in the first display area is displayed in the second display area.   The information processing apparatus according to claim 4, further comprising template storage means for storing the template.   The information processing apparatus according to claim 4, wherein the template is image information representing two axes orthogonal to a horizontal direction in the second display area.   The information processing apparatus according to claim 4, wherein the template includes image information representing a vertical line or a horizontal line representing a time series along a time axis. An information processing method in an information processing apparatus comprising a display unit having a first display area for displaying handwritten information and a second display area to which the handwritten information is moved,
Based on operation information indicating that the handwritten information displayed in the first display area is moved to the second display area, the position coordinates of the display information already displayed at the destination of the handwritten information are acquired. Coordinate acquisition step to perform,
A movement processing step of moving the display information displayed in the second display area so as not to interfere with the handwritten information, using the position coordinates of the display information acquired by the coordinate acquiring step and the handwritten information; An information processing method comprising:   An information processing program causing a processor to execute each step of the information processing method according to claim 8.   A recording medium in which the information processing program according to claim 9 is recorded so as to be readable by a computer.

Images