JP2020201668A - Information processor, document data display method and program - Google Patents

Abstract

To provide an information processor capable of recognizing a context of a drawing object that is extended off a page by a user when displaying a thickness of a document by overlapping a plurality of pages of document data.SOLUTION: An information processor 100 having a document edition application 201 includes: a processing execution unit 203 that acquires information of an annotation object placed by specifying a position with respect to any page of document data, determines, based on the acquired information of the annotation object, in which direction the annotation object extends off a page, and decides, according to the determined extension-off direction of the annotation object, the display direction representing a page thickness of the document data; and a UI unit 202 that displays, based on the display direction determined by the process execution unit 203, the document data.SELECTED DRAWING: Figure 9

Description

The present invention relates to an information processing device for displaying a document image, a method for displaying document data, and a program.

In a document editing application, document data can include various data such as image data such as bitmaps, text data such as character strings, and graphic data such as squares and lines as drawing objects. Some drawing objects can be arranged not only within the page that constitutes the document data but also outside the page. For example, annotations, sticky notes, index levels, etc. When the document data is composed of a plurality of pages, the plurality of pages are overlapped and displayed with a depth in order to show that the plurality of pages are overlapped. At this time, in accordance with the display of the page having depth, the context of the display of the drawing object protruding outside the page is displayed so that the user can visually grasp it. Based on this expression of depth, Patent Document 1 discloses a technique for displaying a drawing object hidden behind by shifting the display position when the drawing objects protruding from the plurality of pages overlap.

Japanese Unexamined Patent Publication No. 08-292861

However, since the depth display for displaying a plurality of pages is fixed in only one direction, in Patent Document 1, it is possible to visually grasp the context of the drawing object depending on the direction of the drawing object protruding from the page. Can not.

An object of the present invention is to provide an information processing device capable of recognizing the context of a drawing object protruding outside a page when displaying the thickness of a document by superimposing a plurality of pages of document data.

In order to solve the above problems, the information processing apparatus of the present invention has acquired by an acquisition means for acquiring information of an annotation object arranged by designating a position with respect to an arbitrary page of document data, and the acquisition means. A page of the document data according to a determination means for determining in which direction the annotation object protrudes from the page based on the information of the annotation object and a protrusion direction of the annotation object determined by the determination means. It is provided with a determination means for determining a display direction representing the thickness of the document, and a display means for displaying the document data based on the display direction determined by the determination means.

According to the present invention, it is possible to provide an information processing device capable of recognizing the context of a drawing object protruding outside the page when displaying the thickness of a document by superimposing a plurality of pages of document data.

It is a figure which shows the hardware configuration of the information processing apparatus which constitutes a document editing application. It is a figure which shows the software structure of the information processing apparatus which constitutes a document editing application. It is a figure explaining the data structure of the document data in a document editing application. It is a figure explaining the data structure of the annotation object in the annotation data in a document editing application. It is a figure which shows the user interface of a document editing application. It is a figure which shows the depth display pattern at the time of preview display of a document data. It is a flowchart which shows the display process of the document preview of a document editing application. It is a flowchart which shows the determination process of the protrusion direction of an annotation. It is a flowchart which shows the determination process of the depth display direction and the arrangement position of the annotation object in Example 1. FIG. It is a figure explaining information used in the display position calculation of annotation data. It is a flowchart which shows the process at the time of updating the display of a preview. It is a flowchart which shows the determination process of the depth display direction and the arrangement position of the annotation object in Example 2. It is a figure which shows the screen of the preview initial display setting screen. It is a flowchart which shows the determination process of the depth display direction and the arrangement position of the annotation object in Example 3.

Hereinafter, examples for carrying out the present invention will be described with reference to the drawings.
(Example 1)
[System configuration]
In this embodiment, all the functions of the document editing application are realized by a general information processing device. The information processing device is, for example, a personal computer, a tablet terminal, or the like. Further, the document editing application is realized by a server device or a virtual machine using resources provided by a data center including the server device, and may be used via a personal computer or a tablet terminal.

[Hardware configuration]
FIG. 1 is a diagram showing a hardware configuration of an information processing device 100 that constitutes a document editing application. A general hardware configuration of an information processing device can be applied to the information processing device 100 of this embodiment. The information processing device 100 includes a CPU 102, a RAM 103, a ROM 104, an HDD 105, a display 106, a keyboard / mouse 107, an interface 108, and a NIC 109, and these are connected via a system bus 101.

The CPU (Central Processing Unit) 102 controls the entire information processing device 100. The CPU 102 realizes various processes for controlling the information processing apparatus 100 by reading and executing an application program, an OS, or the like stored in the ROM 204 or the HDD 105. The RAM (Random Access Memory) 103 is used as a temporary storage area for the main memory, work area, etc. of the CPU 201, and the CPU 102 temporarily stores information, files, and the like necessary for executing the program. The ROM (Read Only Memory) 104 stores various programs and various data. The HDD (hard disk drive) 105 is a memory for storing application programs such as office applications and Web browsers, an OS, and related programs.

The display 106 displays commands input from the keyboard / mouse 107, screens for various processes, and the like. The display 106 may be a liquid crystal screen that has a touch panel function and can accept operations from the user. The keyboard / mouse 107 is an example of an input device that accepts operations from the user. The interface 108 is an interface for connecting to an external device such as a printer, a USB device, or a peripheral device. The keyboard / mouse 107 is an instruction input means. The NIC (network interface card) 109 exchanges data with an external device via the interface 109 and a network (not shown).

The configuration of the information processing device 100 is not limited to the configuration example of FIG. For example, the storage destination of data or programs can be changed in ROM 104, RAM 103, HDD 105, or the like according to the characteristics. Unless otherwise specified in this embodiment, various processes are realized by loading the program stored in the ROM 104 or the like into the RAM 103 or the like and executing the program in the CPU 102.

[Software configuration]
FIG. 2 is a diagram showing a software configuration of an information processing device 100 that constitutes a document editing application. The information processing device 100 has a document editing application 201. The function of the document editing application 201 is realized by a program executed by the information processing apparatus 100.

The document editing application 201 has a UI unit 202, a processing execution unit 203, a setting information management unit 204, and a file data management unit 205. The UI unit 202 is displayed on the display 106 of the information processing device 100, and provides a user interface that receives an operation from the user via an input device such as a keyboard / mouse 107. The process execution unit 203 detects the user's operation through the UI unit 202, and controls the document data editing process according to the operation instructed by the user. Further, the processing execution unit 203 generates a drawing object in order to reflect the processing result of the document data in the document data being displayed, and instructs the display 106 to display the contents through the UI unit 202. Further, the processing execution unit 203 instructs the processing of reading and saving the document data through the file data management unit 205 described later.

The setting information management unit 204 holds and manages various setting information of the document editing application 201. As the setting information held and managed by the setting information management unit 204, for example, there is display setting information of text data at the time of document preview. In this embodiment, as the display setting information of the text data, the setting information management unit 204 has a depth display direction 1 (value: right), a depth display direction 2 (value: top), a depth display amount 1 (value: 50), and It has a depth display amount of 2 (value: 50). The depth display direction 1 represents a setting of whether to set the depth display direction to the left or right at the time of document preview, and holds "left" or "right" as a value. The depth display direction 2 represents a setting of whether the depth display direction at the time of document preview is up or down, and "up" or "down" is held as a value. Further, the depth display amount 1 represents the thickness when performing the depth display specified in the depth display direction 1, and is held as a numerical value. The depth display amount 2 represents the thickness when performing the depth display specified in the depth display direction 2, and is held as a numerical value. The unit of the numerical values of the depth display amount 1 and the depth display amount 2 is PIXEL. In this embodiment, as the initial values of the display setting information for the depth display of the text data, the depth display direction 1 (value: right), the depth display direction 2 (value: top), the depth display amount 1 (value: 50), and the depth It is assumed that the display amount 2 (value: 50) is held. The file data management unit 205 accesses the HDD 105, the RAM 103, the ROM 104, a file server (not shown) connected by a network, and the like in accordance with a request from the processing execution unit 203, and performs reading and saving processing of document data.

[data structure]
The data structure of document data will be described. FIG. 3 is a diagram showing an example of a document data format. The document data 300 has a structure that imitates a paper-based book. First, the upper layer is called a "document", and attributes (document attributes) related to the entire document are defined. The lower layer is called a "page" and corresponds to each page defined in the document editing application 201. In addition, attributes (page attributes) for each page can be defined for each page as well. Further, one document may be one page, and may be composed of a plurality of pages. Note that "document" and "page" are terms used to indicate the structure of document data, and may be other terms as long as they have the same structure.

In FIG. 3, the document 301 and the page 302 in the document data 300 are indicated by the corresponding nodes, respectively. One document data 300 includes one document 301. Document 301 includes defined attribute values and links to lower layers as its entity. Page 302 has data for each page as an entity. Therefore, the page 302 includes the substance of the manuscript page (manuscript data 306, annotation data 307, etc.) in addition to the attribute value (page attribute 305).

In FIG. 3, document 301 has document attributes defined, and three pages 302A, 302B, and 302C are linked to indicate that these pages are included. Page attributes 305A, 305B, and 305C are defined in each page 302A, 302B, and 302C, respectively, and include manuscript data 306A, 306B, 306C and annotation data 307A, 307B, 307C which are the entities of each page. The page attribute 305 includes, for example, a page size 303 and a page number 304. For example, page 302A includes page size 303A and page number 304A as page attribute 305A. In this embodiment, as the page size 303A, for example, the vertical and horizontal sizes (Xp, Yp) constituting the page are held by PIXEL values.

FIG. 4 is a diagram showing an example of an annotation object list that manages annotation data 307 included in page 302. Annotation objects are objects such as sticky notes and indexes arranged at a designated position on an arbitrary page, and can be added outside the display area of the page. The annotation object list 400 is a list of a plurality of annotation object information 410. The annotation object information 410 has an annotation ID 401, an annotation type 402, coordinate information 403, creation / update date and time 404, user name 405, page number 406, and annotation unique information 407.

The annotation ID 401 is an ID for uniquely identifying each annotation. In this embodiment, a three-digit number is assigned as the annotation ID 401. Annotation type 402 indicates the type of annotation object. Types of annotation objects include, for example, sticky notes, indexes, rectangular annotations, circular annotations, and the like. The coordinate information 403 indicates the position of the annotation object. The coordinate information 403 of this embodiment includes relative position information (X1, Y1) to the upper left of the annotation object with the upper left of the corresponding page 302 as the base point (0,0) and size information (Xa, Y1) of the annotation itself. It is composed of Ya). The coordinate information 403 is also held as a PIXEL value like the page size 303A.

The creation / update date and time 404 indicates the date and time when the annotation object was created or updated. The user name 405 indicates the user name to which the annotation object is attached. Page number 406 indicates the page number to which the annotation object is attached. The annotation-specific information 407 is information such as the line color and font of the annotation object, and the information held differs depending on the annotation type 402. For example, when the annotation type 402 is a rectangular annotation, the annotation-specific information 407 includes a line type 411, a line color information 412 indicating line color and transparency information, and a fill color indicating fill color and transparency information. Includes information 413 and the like. When the annotation type 402 is a sticky note, the annotation-specific information 407 includes a line type 421, line color information 422, text information 423 to be displayed on the sticky note, and font information 424 used to display a character string. ..

[Document editing application screen]
FIG. 5 is a diagram showing an example of a screen of the document editing application 500. The user interface screen of the document editing application 500 is generated by the UI unit 202 and displayed on the display 106. The screen of the document editing application 500 includes a function menu 501, an annotation list display pane 502, a document preview pane 503, and an end button 505.

The function menu 501 displays a menu representing functions required for operation in the document editing application 500. In this embodiment, as an example, a file menu for operating a document, an annotation menu for operating an annotation, and a setting menu for setting an application are shown in the function menu 501.

The annotation list display pane 502 displays the annotation list information set in the document being displayed in the document preview pane 503. The annotation list display pane 502 of this embodiment includes the page number to which the annotation is added, the place where the annotation information extends beyond the page drawing area, and the character string information added to the annotation. In addition, the information held in the annotation object information 410 may be displayed in the annotation list display pane 502.

The annotated page number corresponds to page number 406. The location of the annotation list display pane 502 indicates the direction in which the annotation object does not fit in the page drawing area of each page on which the annotation information is set. In the annotation list display pane 502 shown in FIG. 5, there are annotations that are displayed on the right side of the third page, annotations that are projected on the upper side of the fifth page, and annotations that are in the page of the tenth page (not protruding). Represents. The item "location" in the list display pane 502 can be sorted (narrowed down) to a specific page (for example, "right") to which an annotation is added. Further, when the item "location" in the list display pane 502 is sorted, the display direction of the page thickness in the document preview 504 may also be displayed according to the sorted direction.

The document preview 504 to be displayed is displayed in the document preview pane 503. When the document holds a plurality of pages, the document preview 504 indicates that the document is composed of a plurality of pages by giving depth to the preview as shown in the figure. As the number of pages constituting the document data increases, the depth of the preview may increase.

The document preview 504 has a function of displaying the contents of the displayed page, displaying the protruding portion of the annotation set on the page, and expressing the situation where the sticky note is attached to the paper. The document editing application 500 displays a page in which the selected annotation is set by clicking and selecting the annotation displayed in the annotation list display pane 502 or the annotation displayed in the document preview pane 503 with a mouse or the like. It has a page switching function.

FIG. 6 is a diagram showing a depth display pattern at the time of preview display of document data. The direction of the depth display of the document preview 504 displayed in the document preview pane 503 is changed according to the place where the annotation is set. In this embodiment, the initial value of the depth display direction will be described as the upper right. Note that the annotations are shown by diagonal lines in FIG.

Annotations are set only on the right side of the document in FIG. 6 (A) and only on the upper side of the document in FIG. 6 (B). Since the annotation exists in the direction of the initial value of the depth display direction, the depth display direction does not change from the initial setting. In FIG. 6C, annotations are set only on the left side of the document. If the depth display direction remains at the upper right of the initial value, the annotation set on the left side becomes difficult to see. Therefore, in FIG. 6C, the depth display direction is changed from the upper right to the upper left for display. In FIG. 6D, annotations are set on the lower side of the document. If the depth display direction is left at the upper right of the initial value, it becomes difficult to see the annotation set on the lower side. Therefore, in FIG. 6D, the depth display direction is changed from the upper right to the lower right.

6 (A) to 6 (D) have described an example in which annotations are set on only one side of the document, but annotations may be set on a plurality of sides. 6 (E) to 6 (J) show a case where annotations are set on two sides of the document. In FIG. 6E, annotations are set on the right side and the upper side of the document. Since the annotation exists in the direction of the initial value of the depth display direction, the depth display direction does not change from the initial setting. In FIG. 6F, annotations are set on the left side and the lower side of the document. In FIG. 6F, the depth display direction is changed from the upper right to the lower left so that the annotations set on the left side and the lower side of the document can be seen. In FIG. 6 (G), annotations are set on the left side and the upper side of the document. In FIG. 6 (G), the depth display direction is changed from the upper right to the upper left so that the annotations set on the left and upper sides of the document can be seen. In FIG. 6H, annotations are set on the right side and the lower side of the document. In FIG. 6H, the depth display direction is changed from the upper right to the lower right so that the annotations set on the right side and the lower side of the document can be seen.

At the positions of the annotations in FIGS. 6 (A) to 6 (H), it was possible to match the direction in which the annotation was set with the display direction of the depth. However, when annotations are set on the left and right or up and down, or when annotations are set on three or more sides, it is not possible to give depth in all directions in which the annotations are set. Therefore, in this embodiment, when it is not possible to give depth in the direction in which all the annotations are set, the display is given in the direction in which the number of annotations is large.

In FIGS. 6 (I) and 6 (J), annotations are set on the left and right sides of the document. In FIG. 6 (I), one annotation is set on the left side and two annotations are set on the right side. Therefore, in FIG. 6 (I), the display direction of the depth is displayed as the upper right of the initial value so that the annotation set on the right side of the document can be seen. In FIG. 6J, three annotations are set on the left side and one annotation is set on the right side. Therefore, in FIG. 6J, the depth display direction is changed from the upper right to the upper left so that the annotation set on the left side of the document can be seen. In FIG. 6 (K), one annotation is set on the upper side of the document, two annotations are set on the right side, and two annotations are set on the lower side. Therefore, in FIG. 6 (K), the depth display direction is changed from the upper right to the lower left so that the annotations set on the right side and the lower side of the document can be seen.

[Document preview display processing flow]
A process for displaying the document preview 504 in the document preview pane 503 of the document editing application 201 according to the present embodiment will be described with reference to FIGS. 7 to 9. FIG. 7 is a flowchart showing a display process of the document preview 504 of the document editing application 201. Each operation (step) of the flowchart of FIG. 7 is realized in the processing execution unit 203 by the CPU 102 of the information processing apparatus 100 executing the control program stored in the HDD 105.

In this processing flow, the UI unit 202 detects that the user has selected a document in the file selection dialog (not shown) from the file menu of the function menu 501 with the keyboard / mouse 107, and displays the document preview on the processing execution unit 203. It is started by instructing.
In step S701, the processing execution unit 203 instructs the file data management unit 205 to read the document 301 specified by the user in the file selection dialog. The file data management unit 205 stores the document data 300 of the document 301 designated by the user in the RAM 103, and notifies the processing execution unit 203 of the storage location of the document data 300.

In step S702, the processing execution unit 203 acquires the number of pages of the document 301 from the document data 300 stored in the RAM 103. Then, the processing execution unit 203 stores the acquired page number information in the RAM 103.
In step S703, the processing execution unit 203 acquires the information of the annotation object list 400 that manages the annotation data 307 included in each page 302 of the document data 300 stored in the RAM 103. Then, the processing execution unit 203 acquires all the annotation object information 410 from the annotation object list 400.

In step S704, the processing execution unit 203 determines the extension direction of the annotation. The determination of the extension direction of the annotation is performed based on the coordinate information 403 of the annotation object information 410 acquired in step S703. The details of the process of determining the protrusion direction of the annotation will be described later with reference to FIG.
In step S705, the processing execution unit 203 acquires the initial value of the depth display when displaying the document preview 504. The processing execution unit 203 acquires the depth display direction 1 (value: right) and the depth display direction 2 (value: top) as the initial values of the depth display from the setting information management unit 204 and stores them in the RAM 103.

In step S706, the processing execution unit 203 determines the depth display direction according to the processing results in steps S704 and S705, and determines the arrangement position of the annotation object. Details of the process of determining the depth display direction and the arrangement position of the annotation object will be described later with reference to FIG.
In step S707, the processing execution unit 203 displays the drawing data of the document preview 504 in the document preview pane 503. At this time, the annotation object is also displayed in the document preview 504 according to the arrangement determined in step S706. Further, the annotation information is displayed in the annotation list display pane 502 based on the annotation object list 400 stored in the RAM 103. This step is displayed on the display 106 when the processing execution unit 203 instructs the UI unit 202 to draw the document preview and the annotation list.

[Depth display direction judgment processing flow]
FIG. 8 is a flowchart showing a determination process of the extension direction of the annotation in step S704. Similar to FIG. 7, each operation (step) of FIG. 8 is realized in the processing execution unit 203 by the CPU 102 of the information processing device 100 executing the control program stored in the HDD 105.

In step S801, the processing execution unit 203 creates a depth direction classification list in the RAM 103. The depth direction classification list is a list for classifying annotations for each protruding direction, and four lists are created for each direction. The depth direction classification list when annotations are added to the right side of the preview is called the "right list". Similarly, the depth direction classification list for the left side of the preview is referred to as the "left list", the depth direction classification list for the upper side is referred to as the "upper list", and the depth direction classification list for the lower side is referred to as the "lower list".

In the depth direction classification list, the page number 304, the annotation object information 410, and the annotation display coordinate information are managed in combination. The annotation display coordinate information is information indicating the drawing position of the annotation object on the screen when the document preview 504 is displayed. Similar to the coordinate information 403, the annotation display coordinate information includes information on relative position information (X2, Y2) from the upper left corner of the page to the upper left corner of the rectangle to be displayed and size information (Xd, Yd) to be displayed. Hold as.

In step S802, the processing execution unit 203 acquires the annotation object information 410. Specifically, the processing execution unit 203 acquires one annotation object information 410 that has not been read out of all the annotation object information 410 stored in the RAM 103 in step S703.

In step S803, the processing execution unit 203 determines whether or not the annotation object information 410 acquired in step S802 exists. If the annotation object information 410 exists, the process proceeds to step S804, and if it does not exist, the present processing flow ends.
In step S804, the processing execution unit 203 acquires the information of the page size 303 of the page 302 to which the annotation object information 410 selected in step S802 is linked from the RAM 103. The page size 303 is held as vertical and horizontal sizes (Xp, Yp).

In step S805, step S807, step S809, and step S811, it is determined whether or not the edge of the annotation object exceeds each side of the paper, and if so, it is added to the depth direction classification list in the corresponding direction. The right side is determined in step S805, the lower side is determined in step S807, the left side is determined in step S809, and the upper side is determined in step S811, but the order is not limited to this.

In step S805, the processing execution unit 203 determines whether or not the right end of the display position of the annotation object information 410 selected in step 802 is located outside the right side of the page. Whether or not the right edge of the display position of the annotation object information 410 is located outside the right edge of the page is determined by whether or not the right edge of the annotation object exceeds the paper width.

The value representing the position of the right end of the annotation object is calculated based on the coordinate information 403. The coordinate information 403 is composed of relative position information (X1, Y1) to the upper left of the annotation object with the upper left of the corresponding page 302 as the base point (0,0) and size information (Xa, Ya) of the annotation itself. It is composed. The total value of X1 + Xa, which is the sum of the position information of the annotation object and the size information of the annotation, is the value representing the position of the right end of the annotation object. The paper width is indicated by Xp, which indicates the horizontal size of the vertical and horizontal sizes (Xp, Yp) constituting the page. Therefore, in step S805, the processing execution unit 203 compares the value of Xp of the page size 303 acquired in step S804 with the total value of X1 + Xa of the coordinate information 403 of the annotation object information 410. If the Xp value is smaller, it is determined that the annotation object information 410 is outside the right side of the page, so the process proceeds to step S806. On the other hand, if the comparison values are the same or the Xp value is larger, it is determined that the annotation object information 410 is not outside the right side of the page, so the process proceeds to step S807.

In step S806, the processing execution unit 203 combines the annotation object information 410 and the page number 304 of the page 302 linked to the annotation object information 410 and registers them in the right list on the RAM 103. When the registration is completed, the process returns to step S802 in order to proceed to the next processing of the annotation object information 410.

In step S807, the processing execution unit 203 determines whether or not the lower side of the display position of the annotation object information 410 selected in step 801 is located outside the lower side of the page. Specifically, the value of Yp of the page size 303 acquired in step S804 and the total value of Y1 + Ya of the coordinate information 403 of the annotation object information 410 are compared. If the Yp value is smaller, it is determined that the annotation object information 410 is outside the bottom edge of the page, so the process proceeds to step S808. On the other hand, if the comparison values are the same or the Yp value is larger, it is determined that the annotation object information 410 is not outside the bottom edge of the page, so the process proceeds to step S809.

In step S808, the processing execution unit 203 registers the annotation object information 410 and the page number 304 of the page 302 linked to the annotation object information 410 in the lower list of the RAM 103. When the registration is completed, the process returns to step S802 in order to proceed to the next processing of the annotation object information 410.

In step S809, the processing execution unit 203 determines whether or not the left end of the display position of the annotation object information 410 selected in step 801 is a position outside the left side of the page. Specifically, it is determined whether or not the value of X1 of the coordinate information 403 of the annotation object information 410 acquired in step S804 is a negative value. If the value of X1 of the coordinate information 403 of the annotation object information 410 is a negative value, it is determined that the annotation object information 410 is located outside the left side of the page, so the process proceeds to step S808. On the other hand, when the value of X1 is zero or a positive value, it is determined that the annotation object information 410 does not go outside the left side of the page, so the process proceeds to step S811.

In step S810, the processing execution unit 203 registers the annotation object information 410 and the page number 304 of the page 302 linked to the annotation object information 410 in the left list of the RAM 103. When the registration is completed, the process returns to step S802 in order to proceed to the next processing of the annotation object information 410.

In step S811, the processing execution unit 203 determines whether or not the upper side of the display position of the annotation object information 410 selected in step 801 is located outside the upper side of the page. Specifically, it is determined whether or not the value of Y1 of the coordinate information 403 of the annotation object information 410 acquired in step S804 is a negative value. When the value of Y1 of the coordinate information 403 of the annotation object information 410 is a negative value, it is determined that the annotation object information 410 is located outside the upper side of the page, so the process proceeds to step S808. On the other hand, when the value of X1 is zero or a positive value, it is determined that the annotation object information 410 exists in the page area. Therefore, since the annotation object information 410 to be determined is not an annotation object that extends off the page, the process returns to step S802 without being registered in the list.

In step S812, the processing execution unit 203 registers the annotation object information 410 and the page number 304 of the page 302 linked to the annotation object information 410 in the lower list on the RAM 103. When the registration is completed, the process returns to step S802 in order to proceed to the next processing of the annotation object information 410.

[Annotation object display position determination process flow]
FIG. 9 is a flowchart showing a process of determining the depth display direction and the arrangement position of the annotation object in step S706. Similar to FIG. 7, each operation (step) of FIG. 9 is realized in the processing execution unit 203 by the CPU 102 of the information processing apparatus 100 executing the control program stored in the HDD 105.

In step S901, the processing execution unit 203 acquires the four types of depth direction classification lists generated in the RAM 103 in step S704. Further, the processing execution unit 203 acquires the number of annotations registered in each depth direction classification list.

In steps S902 to S904, the processing execution unit 203 determines the state of the annotation protruding from the document page. In step S902, the processing execution unit 203 determines whether the annotation protruding from the document page is "none", "only one direction", or "two or more directions". Specifically, the processing execution unit 203 moves up and down depending on the number of annotations registered in the depth direction classification list acquired in step S901, whether or not there is an annotation protruding from the document page, and when the annotation extends beyond the document page. Determine if only one of the left and right sides is present. Therefore, the processing execution unit 203 confirms the number of depth direction classification lists in which annotations are registered. When there is one depth direction classification list in which the annotations are registered, it is determined that the annotations protrude in only one direction, and the process proceeds to step S905. If there are two or more depth direction classification lists in which annotations are registered, it is determined that the annotations extend in two or more directions, and the process proceeds to step S903. If there is no depth direction classification list in which annotations are registered, the process proceeds to step S907.

In step S903, the processing execution unit 203 determines whether or not the annotation extends from the area of the document page in two directions, up, down, left, and right. Specifically, the processing execution unit 203 determines whether or not there are two depth direction classification lists in which the number of annotations is other than zero, based on the number of annotations registered in the depth direction classification list acquired in step S901. judge. If there are two depth direction classification lists in which annotations are registered, the process proceeds to step S905. On the other hand, if there are three or more depth direction classification lists in which annotations are registered, the process proceeds to step S906. It should be noted that the determination performed separately in step S902 and step S903 in this embodiment may be performed in a single determination. For example, at the stage of step S902, the extension directions of the annotation are "none", "1 direction", "2 directions", "3 directions or more" (or "none", "1 direction", "2 directions", 3 directions ", and" 4 directions ". ) May be determined in detail.

In step S904, the processing execution unit 203 determines whether or not the two directions in which the annotation extends from the area of the document page are adjacent to each other. Here, "adjacent" refers to two adjacent directions. Specifically, the locations where the annotations are present are the upward and right directions, the right and downward directions, the upward and left directions, and the left and downward directions of the page. Refers to a state that is any combination of. Specifically, in the processing execution unit 203, the combination of the depth direction classification list in which the annotation is registered in the determination in step S903 is the upper list and the right list, the upper list and the left list, the lower list and the right list, and the lower list. And one of the left list. If it is determined that these combinations are used, the process proceeds to step S905. On the other hand, in the case of other combinations, the process proceeds to step S906.

In step S905, the processing execution unit 203 updates the values (initial values) of the depth display direction 1 and the depth display direction 2 stored in the RAM 103 in step S705 in the direction of the depth direction classification list in which the annotation exists. If the depth direction classification list in which the annotation exists is the right list, the value of the depth display direction 1 is set to "right", and if the depth direction classification list is the left list, the value of the depth display direction 1 is set to "right". Set to "left". The same applies even when the depth direction classification list is the upper list or the lower list.

In step S906, the processing execution unit 203 sets the values (initial values) of the depth display direction 1 and the depth display direction 2 stored in the RAM 103 in step S705 to the page with the youngest page number among the pages to which the annotation is given. Update in the direction of the depth direction classification list of. Specifically, among the four types of depth direction classification lists acquired in step S901, the depth direction classification list having the smallest registered annotation page number is acquired. For example, when the list is a right list, the depth display direction 1 is updated to "right". The same applies to other lists. Therefore, when the protrusion directions are not adjacent to each other in two directions or three or more directions, the processing execution unit 203 sets the display direction of the page thickness of the preview image to the page number of the annotated pages. Is the direction of the annotation of the smallest page.

In step S907, the processing execution unit 203 determines the position and size of the annotation to be displayed at the position outside the page size of the document when creating the preview of the document. FIG. 10 is a diagram illustrating information used in the display position calculation of the annotation data in step S907. In this process, in order to create the display information of the annotation, the position information (X1, Y1) of the annotation registered in the depth direction classification list acquired in step S901, the size information (Xa, Ya), and the page number 304A Use (PN). Further, the page number (DPN) that the annotation displays as a preview, the number of pages of the document (PC), the above-mentioned page size (Xp, Yp), the depth display amount 1 (Xd), and the depth display amount 2 (Yd) are used. ..

In the preview in this embodiment, since the depth is provided in two directions, the display position of the annotation other than the page to be displayed increases as the number of pages displayed is shifted toward the back. Therefore, first, the vertical and horizontal deviation width for each page is calculated.
Horizontal deviation width Xs = Depth display amount 1 (Xd) ÷ Number of document pages (PC)
When the value in the depth display direction 1 is “left”, Xs = (-1) × Xs.
Vertical deviation width Ys = Depth display amount 2 (Yd) ÷ Number of document pages (PC)
When the value in the depth display direction 1 is “up”, Ys = (-1) × Ys.

Next, (X2, Y2) and (Xd, Yd) that constitute all the annotation display coordinate information registered in the four depth direction classification lists are obtained by the calculation formulas for each list.

<Annotation display coordinate information in the above list>
If the page number to link to the annotation object ≥ the page number to display (DPN)
X2 = X1 + Xs × (PN-DPN)
Xd = Xa
When the depth display direction 2 is "up",
Y2 = Y1 + Ys × (PN-DPN)
Yd = (-1) x Y1
When the depth display direction 2 is "down",
Y2 = Y1 + Ys × (PN-DPN)
Yd = (-1) x Y1-Ys x (PN-DPN)
If the page number to which the annotation object links <page number to display (DPN),
X2 = X1 + Xs × (PN + DPN)
Xd = Xa
When the depth display direction 2 is "up",
Y2 = Y1 + Ys × (PN + DPN)
Yd = (-1) x Y1
When the depth display direction 2 is "down",
Y2 = Y1 + Ys × (PN + DPN)
Yd = (-1) x Y1-Ys x (PN + DPN)

<Annotation display coordinate information in the list below>
If the page number to link to the annotation object ≥ the page number to display (DPN)
X2 = X1 + Xs × (PN-DPN)
Xd = Xa
When the depth display direction 2 is "up",
Y2 = Yp
Yd = Y1 + Ya-Yp-Ys × (PN-DPN)
When the depth display direction 2 is "down",
Y2 = Yp + Ys × (PN-DPN)
Yd = Y1 + Ya-Yp
If the page number to which the annotation object links <page number to display (DPN),
X2 = X1 + Xs × (PN + DPN)
Xd = Xa
When the depth display direction 2 is "up",
Y2 = Yp
Yd = Y1 + Ya-Yp-Ys × (PN + DPN)
When the depth display direction 2 is "down",
Y2 = Yp + Ys × (PN + DPN)
Yd = Y1 + Ya-Yp

<Annotation display coordinate information in the right list>
If the page number to link to the annotation object ≥ the page number to display (DPN)
Y2 = Y1 + Ys × (PN-DPN)
Yd = Ya
When the depth display direction 2 is "right",
X2 = Xp + Xs × (PN-DPN)
Xd = X1 + Xa-Xp
When the depth display direction 2 is "left",
X2 = Xp
Xd = X1 + Xa-Xp-Xs × (PN-DPN)
If the page number to which the annotation object links <page number to display (DPN),
Y2 = Y1 + Ys × (PN + DPN)
Yd = Ya
When the depth display direction 2 is "right",
X2 = Xp + Xs × (PN + DPN)
Xd = X1 + Xa-Xp
When the depth display direction 2 is "left",
X2 = Xp
Xd = X1 + Xa-Xp-Xs × (PN + DPN)

<Annotation display coordinate information in the left list>
If the page number to link to the annotation object ≥ the page number to display (DPN)
Y2 = Y1 + Ys × (PN-DPN)
Yd = Ya
When the depth display direction 2 is "right",
X2 = X1 + Xs × (PN-DPN)
Xd = (-1) x X1-Xs x (PN-DPN)
When the depth display direction 2 is "left",
X2 = X1
Xd = (-1) x X1 + Xs x (PN-DPN)
If the page number to which the annotation object links <page number to display (DPN),
Y2 = Y1 + Ys × (PN + DPN)
Yd = Ya
When the depth display direction 2 is "right",
X2 = X1 + Xs × (PN + DPN)
Xd = (-1) x X1-Xs x (PN + DPN)
When the depth display direction 2 is "left",
X2 = X1
Xd = (-1) x X1 + Xs x (PN + DPN)

The processing execution unit 203 sets the values of the above calculation results X2, Y2, Xd, and Yd as a set, and sets the annotation display coordinate information in association with the annotation information in each list.

In step S908, the processing execution unit 203 generates a preview image in which annotations are arranged. The processing execution unit 203 prepares a preview image based on the annotation display coordinate information calculated in step S907, the page number to be previewed, the page size, the depth display direction 1, the depth display direction 2, the depth display amount 1, and the depth display amount 2. To generate. Specifically, first, the processing execution unit 203 draws the image data of the page number to be displayed. Next, the processing execution unit 203 draws a portion representing the depth using the depth display amount 1 and the depth display amount 2. Finally, the processing execution unit 203 uses the annotation display coordinate information to draw annotations of the portion protruding from the image data in order from the one having the largest page number. When the drawing data of the preview image is completed, this processing flow ends.

[Preview display processing flow when dragging the preview image]
FIG. 11 is a flowchart showing a process for updating the preview display when the user drags and drops the document preview 504 with the mouse. This process is started when the UI unit 202 notifies the process execution unit 203 of the vertical and horizontal values of the mouse drag start position information when the user drags and drops the mouse and the position information at the time of dropping. .. Similar to FIG. 7, each operation (step) shown in the flowchart of FIG. 11 is realized in the processing execution unit 203 by the CPU 102 of the information processing apparatus 100 executing the control program stored in the HDD 105.

In step S1101, the processing execution unit 203 calculates the movement amount of the mouse from the movement start position information and the movement position information notified at the time of activation. The amount of movement is calculated by the following formula, and becomes a negative value when the mouse is moved in the direction of the upper part of the screen or the left part of the screen. In the following, the amount of movement in the horizontal direction is represented by Xm, and the amount of movement in the vertical direction is represented by Ym.
Lateral movement amount Xm = Moved position information (horizontal) -Movement start position information (horizontal)
Vertical movement amount Ym = Moved position information (vertical) -Movement start position information (vertical)

In step S1102, the processing execution unit 203 updates the values stored in the RAM 103 by reflecting the movement amount calculated in step S1101 on the values of the depth display amount 1 and the depth display amount 2 stored in the RAM 103 in step S704. To do. The updated values (Xd', Yd') are calculated by the following formula.
Xd'= Xd + Xm
Yd'= Yd + Ym

In step S1103, the processing execution unit 203 performs a process of changing the display position of the annotation object in accordance with the change of the depth display amount 1 and the depth display amount 2. The process performed in this step is the same as in step S706 described above.

In step S1104, the processing execution unit 203 displays the drawing data of the document preview including the annotation object information 410 whose arrangement has been changed in step S1103 as a new document preview 504 in the document preview pane 503. When the display of the updated document preview 504 is completed, the present processing flow is terminated. In this embodiment, the start of the process is drag and drop of the mouse, but the present invention is not limited to this, and the process may be started based on an operation in which the amount of movement specified by the user can be achieved.

(Example 2)
In this embodiment, the depth display direction of the document preview when the annotations are not adjacent to each other in two directions or three or more directions is determined based on a reference different from that in the first embodiment. In the first embodiment, in step S906, when the annotation has three or more protrusion directions, the depth display direction of the document preview is determined based on the direction of the annotation attached to the top page. In this embodiment, the depth display direction of the document preview is the direction in which the number of annotations is large in the direction in which the annotations extend. In the following, only the difference from the first embodiment will be described.

[Annotation object display position determination process flow]
FIG. 12 is a flowchart showing a process of determining the depth display direction and the arrangement position of the annotation object in step S706. The difference between FIG. 12 and FIG. 9 of the first embodiment is step S1201. The same steps as in the first embodiment are designated by the same reference numerals as those in FIG. 9, and the description thereof will be omitted. Each operation (step) showing the flowchart of FIG. 12 is realized in the processing execution unit 203 by executing the control program stored in the HDD 105 by the CPU 102 of the information processing apparatus 100 as in FIG.

In step S1201, the processing execution unit 203 holds the values of the depth display direction 1 and the depth display direction 2 stored in the RAM 103 in step S705 in the direction in which the number of annotations is the largest among the four corresponding depth direction classification lists. Update to. Specifically, the number of annotations in the right list and the left list of the four types of depth direction classification lists acquired in step S901 are compared, and the value in the depth display direction 1 is set to "right" and left when there are many right lists. If there are many lists, update to "left". If the number of annotations in the right list and the number of annotations in the left list are the same, the value in the depth display direction 1 is not updated. Similarly, the number of annotations in the upper list and the lower list of the depth direction classification list is compared, and the value of the depth display direction 2 is set to "up" when there are many upper lists and "lower" when there are many lower lists. Update. When the number of annotations in the upper list and the lower list is the same, the value in the depth display direction 2 is not updated.

By comparing the number of annotations in the opposite directions (for example, up and down) in this way, the annotations in the two adjacent directions (for example, up and left) where the most annotations are placed can be obtained. It can be shifted so that it can be viewed.

(Example 3)
In this embodiment, the user can set the depth display method of the document preview. As a result, the user can select the depth display of either the first embodiment or the second embodiment. In the following, only the differences from the first and second embodiments will be described. In explaining this embodiment, the only difference from the first embodiment is that the setting screen for the preview display is held and the process flow for determining the position of the annotation object in FIG. 9 is different. Since the flow and configuration are the same, the description will be omitted.

[Initial setting screen for preview display]
FIG. 13 is a diagram showing a screen of the preview initial display setting screen 1300 generated and displayed by the UI unit 202. The preview initial display setting screen 1300 is a screen generated / displayed when the UI unit 202 receives that "setting" of the function menu 501 of the document editing application 500 is selected. The preview initial display setting screen 1300 includes a depth display direction option 1301, a depth display amount 1302, an OK button 1303, and a cancel button 1304.

The depth display direction option 1301 is an option for indicating the direction of the depth display of the preview when there are annotations in non-adjacent directions. The user selects one of the "Direction of the first annotation" that selects the direction of the annotation on the front page and the "Direction of the number of annotations" that selects the direction with the largest number of annotations. can do. The “direction of the first annotation” is the same depth display method as in step S906 of the first embodiment, and the “direction with a large number of annotations” is the same depth display method as the step S1202 of the second embodiment.

When the option is selected in the depth display direction option 1301 and the OK button 1303 is pressed, the selection result is managed by the setting information management unit 204 as the “selection state of the depth display direction option”. The "selection state of the depth display direction option" is information generated when the preview initial display setting screen 1300 is set, and does not exist until the user sets the depth display direction option on this screen. In this embodiment, the initial selection value when the "selection state of the depth display direction option" does not exist is set to the "direction of the first annotation".

The depth display amount 1302 is an input area for setting the depth amount at the time of preview display, and is configured so that the user can input each of the vertical and horizontal depth amounts. The values displayed in the depth display amount 1302 are the depth display amount 1 and the depth display amount 2 managed by the setting information management unit 204 of the document editing application 201. The processing execution unit 203 acquires from the setting information management unit 204 during the display processing of the preview initial display setting screen 1300, and displays the depth display amount 1 as a horizontal value and the depth display amount 2 as a vertical value.

When the OK button 1303 is pressed, the values of the depth display direction option 1301 and the depth display amount 1302 are acquired, and the selection state of the depth display direction option of the setting information management unit 204, the depth display amount 1, and the depth display amount 2 are set. Stores the value set by the user. When the storage is completed, the preview initial display setting screen 1300 is closed. When the cancel button 1304 is pressed, all the values input by the user are discarded, and the preview initial display setting screen 1300 is closed.

[Annotation object display position determination process flow]
FIG. 14 is a flowchart showing a process of determining the depth display direction and the arrangement position of the annotation object in step S706. The difference between FIG. 14 and FIG. 9 of the first embodiment is step S1401. The same steps as those in the first or second embodiment are designated by the same reference numerals as those in FIG. 9 or 12, and the description thereof will be omitted. Each operation (step) showing the flowchart of FIG. 14 is realized in the processing execution unit 203 by executing the control program stored in the HDD 105 by the CPU 102 of the information processing device 100 as in FIGS. 9 and 12. ..

In step S1401, the processing execution unit 203 determines the display method from the information in the depth display direction set by the user when the extension directions of the annotations are not adjacent to each other in two directions or three or more directions. Specifically, the depth display direction of the document preview is determined based on the "selection state of depth display direction option" information stored in the setting information management unit 204. If the process execution unit 203 cannot acquire the "depth display direction option selection state" information from the setting information management unit 204, the process execution unit 203 determines "none" and proceeds to step S906. When the value of the "selection state of the depth display direction option" is the "direction of the first annotation", the process execution unit 203 determines that it is the "head" and proceeds to step S906. Further, when the value of the "selection state of the depth display direction option" is the "direction having a large number of annotations", the processing execution unit 203 determines that the "number of annotations" and proceeds to step S1201.

According to this embodiment, it is possible to realize the depth display of the document based on the conditions desired by the user.

(Other Examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and modifications can be made within the scope of the gist thereof.

Claims (9)

An acquisition method for acquiring information on an annotation object placed at a specified position on any page of document data,
Based on the information of the annotation object acquired by the acquisition means, a determination means for determining in which direction the annotation object protrudes outside the page, and
A determining means for determining a display direction representing the page thickness of the document data according to the protruding direction of the annotation object determined by the determining means, and
An information processing apparatus comprising: a display means for displaying the document data based on a display direction determined by the determination means. The determination means is characterized in that, when the annotation object has a protrusion direction of one direction or two adjacent directions, the protrusion direction is determined to be a direction for displaying the thickness of the document. The information processing device described in. When the extension directions of the annotation objects are not adjacent to each other in two directions or three or more directions, the determining means is an annotation object arranged on the page having the smallest page number among the pages to which the annotation is given. The information processing apparatus according to claim 1 or 2, wherein the protruding direction is determined in the direction in which the thickness of the document is displayed. The determination means determines the direction in which the thickness of the document is displayed according to the number of annotation objects protruding in each direction when the extension directions of the annotation objects are not adjacent to each other in two directions or three or more directions. The information processing apparatus according to claim 1 or 2, wherein the information processing device is characterized in that. Further provided with a designation means for designating a method for determining the thickness direction to be displayed when the protrusion directions of the annotation objects are not adjacent to each other in two directions or three or more directions.
The determining means determines the direction in which the thickness of the document is displayed according to the display method specified by the designated means when the protrusion directions of the annotation objects are not adjacent to each other in two directions or three or more directions. The information processing apparatus according to any one of claims 1 to 4, characterized in that. The display means according to any one of claims 1 to 5, characterized in that the display direction or display amount representing the page thickness of the document data is changed according to the user's operation on the displayed document data. The information processing device described. Further, a list display means for displaying a list of the information of the annotation object acquired by the acquisition means and the protruding direction of the annotation object is provided.
The display means is characterized in that, when the protrusion direction of the annotation object displayed by the list display means is narrowed down and displayed, the narrowed out display direction is determined to be the direction in which the thickness of the document is displayed. The information processing apparatus according to any one of 1 to 6. How to display document data
The acquisition process to acquire the information of the annotation object placed by specifying the position on any page of the document data, and
Based on the information of the annotation object acquired in the acquisition process, a determination step of determining in which direction the annotation object protrudes outside the page, and
A determination step of determining a display direction for representing the page thickness of the document data according to the protrusion direction of the annotation object determined in the determination step, and a determination step.
A method for displaying document data, which comprises a display step of displaying the document data based on a display direction determined in the determination step. A program for operating a computer as each means of the information processing apparatus according to any one of claims 1 to 7.

Images