JP2011076207A - Layout control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve the optimal layout of one or more objects in the page of an electronic document. <P>SOLUTION: A layout control method includes: an object input means for inputting one or more desired objects; a partial region information input means for inputting information about the partial region of a variable data document; a significant region setting means for setting a part or whole part of the objects as a significant region with significant content; an inhibition region setting means for setting a region, in which any significant region is not laid out inside the partial region, as an inhibition region; and a layout means for executing the layout of the object in the page by referring to the inhibition region and the significant region. The layout means executes dynamic layout so that the inhibition region and the significant region can be prevented from being overlapped with each other. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image processing apparatus for optimally laying out one or a plurality of objects in a page of an electronic document. The present invention relates to a technique for easily realizing an advanced layout in which an important part of an object desired to be printed does not overlap a specific area in a page or another object desired to be printed, and obtains an optimal positional relationship with each other.

  As a technique for laying out an object in an electronic document, for example, there is a technique as disclosed in Patent Document 1.

  According to the technique disclosed in Patent Document 1, a predetermined constraint is applied to containers holding text and image data, and the entire document is laid out in accordance with the constraint.

  In the case of a constraint, a constraint defined in the container itself (hereinafter referred to as an internal constraint), a constraint defined in a mutual positional relationship between containers (hereinafter referred to as an external constraint), or a constraint that defines an absolute positional relationship with respect to the paper of the document. There is also.

  For example, FIG. 20 shows a state in which two rectangular containers 2001 and 2002 exist, and a constraint 2003 that defines the distance therebetween is provided. Between the two containers is an object called a strut that schematically represents the constraints.

  The two containers are restricted in operation at the time of layout by this strut constraint, and the length of the strut, that is, the distance between the rectangular objects, for example, can be made variable or fixed by, for example, automatic or manual operation. Further, by setting the tension of the strut, a dynamic layout balanced with other tensions can be performed.

  Further, as a technique for performing printing while avoiding a specific area, for example, there is a technique disclosed in Patent Document 2.

  In the technique disclosed in Patent Document 2, the presence or absence of an image in the binding position area is detected and identified in a printed matter in which binding such as stapling occurs, and if an image exists, an appropriate recovery operation is performed. Recovery operation includes warning display, interrupting image forming operation for image information, continuing image forming operation and prohibiting only binding operation, moving image information from inside binding area to outside area Executing the image processing to be performed, changing the binding position to an area where no image information exists, and automatically canceling the binding mode for binding paper.

JP 2005-122728 A Japanese Patent Laid-Open No. 06-219629 JP 2005-13597 A

  In general, in order to improve the appearance and design, in the layout of electronic documents, such as arranging photos and graphics so that they spread across spread pages, text is arranged so as to overlap the photos There is a need for a technique for easily performing the above.

  However, with the techniques disclosed in Patent Literature 1 and Patent Literature 2, it is impossible to realize a high-level layout in which objects overlap each other or an object is arranged on a spread page.

  In the following, as shown in FIG. 5, inconsistency when using the technique disclosed in Patent Document 1 and Patent Document 2 in the case where a photographic object is spread across two spread pages. .

  In the following, the area near the binding portion at the center when the bound output is opened as shown at 2301 in FIG. 23 and the area of the original corresponding to the area are referred to as a throat area, and But this is true.

  First, consider a case where the layout is executed using the technique disclosed in Patent Document 2.

  In this case, if the throat area is set as the binding position area, it is possible to perform a layout in which a photographic object is contained in each page as shown in FIG. However, since the binding area and the photo object are in an exclusive relationship with each other, a recovery operation in which the photo object is rejected or the binding operation is not performed is performed, so the photo object is spread over two pages. It is impossible to distribute.

  Further, when the layout is executed using the technique disclosed in Patent Document 1, it is possible to fit a photographic object across two pages as shown in FIG. However, depending on the layout, an important part in the photograph, for example, an object such as a face part in a person photograph may fall on the throat region of the spread page.

  The present invention is intended to solve such problems. That is, the present invention relates to an image processing apparatus for optimally laying out one or a plurality of objects in a page of an electronic document. This is to provide advanced layout control in which an important part of a certain object to be printed does not overlap with a specific area in the page or another object to be printed without obtaining an optimum positional relationship with each other.

According to one aspect of the present invention, a method for easily performing advanced layout is disclosed, the method comprising:
A layout control method for generating a variable data document by arranging objects in a plurality of partial areas of a variable data document,
An object input means for inputting one or more desired objects;
Partial area information input means for inputting information about the partial area of the variable data document;
An important area setting means for setting a part or all of the object as an important area having important contents;
A prohibited area setting means for setting, as a prohibited area, an area where the important area is not laid out inside the partial area;
Layout means for performing layout of an object in a page with reference to the prohibited area and the important area,
The layout means executes dynamic layout so that the prohibited area and the important area do not overlap.

  Other aspects of the invention are also disclosed, including an apparatus for performing the above method and a computer readable storage device that causes the computer to execute.

  According to the image processing apparatus to which the present invention is applied, it is possible to easily implement an advanced image layout excellent in overall balance and design without placing important content in an inappropriate position.

Schematic diagram of a system that performs electronic document layout Module configuration diagram of object layout device in electronic document Operation flow of region setting unit in embodiment 1 Operation flow of layout unit in embodiment 1 Example of an electronic document and objects that lay out against it An example of critical and non-critical areas Added strut Example of prohibited area Characteristics of presence or absence of restrictions in the first embodiment Operation flow of region setting unit in embodiment 2 Operation flow of layout unit in embodiment 1 Example of first and second forbidden areas and variable direction struts in facing pages Characteristics of presence / absence of constraints in Example 2 An example of operation of a variable direction strut Operation flow of layout unit in embodiment 3 Struts added between important areas Characteristics of presence / absence of restriction in Example 3 Example of object layout to which the technique disclosed in Reference 2 is applied Example of object layout to which the technique disclosed in Reference 1 is applied Examples of multiple objects and struts added between them Schematic diagram of the breakdown of data stored in image files Operational flow of variable direction strut Illustration of the throat area Example of layout in embodiment 1 Example of layout in embodiment 1 Example of layout in Example 3

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 illustrates a system for performing electronic document layout.

  The computer module 101 connects input devices such as a keyboard 132 and a pointing device such as a mouse 133, and connects a display device 144 and an output device including a local printer 145 depending on the situation. The input / output interface 138 can connect the computer module 101 from the network connection 107 to connect to other computer devices in the system. A typical network connection 107 is a local area network (LAN) or a wide area network (WAN).

  The computer module 101 typically includes at least one processor unit (CPU) 135. The memory unit 136 includes, for example, a semiconductor random access memory (RAM) and a read only memory (ROM). Further, an INPUT / OUTPUT (I / O) interface including a video interface 137 is included, and an I / O interface 143 for the keyboard 132 and the mouse 133 is included. The storage device 139 typically includes a hard disk drive 140 and a floppy (registered trademark) disk drive 141. Although not shown in the figure, a magnetic tape drive or the like may also be used. The CD-ROM drive 142 is provided as a nonvolatile data source. The computer module 101 uses components 135 to 143 of the computer module 101 that performs communication via an operation system such as LINUX and Microsoft Windows (registered trademark) and the interconnection bus 134.

  The software that implements the procedure shown in the flowchart of the present invention is stored in a computer-readable medium including a storage device as described above, for example. The software is loaded into the computer from a computer readable medium and executed by the CPU 135 of the computer 101. By using a computer program product on the computer, it can operate as an advantageous device for document layout.

  FIG. 2 is a module configuration diagram of a layout apparatus for arranging objects in an electronic document to which the present invention is applied.

  FIG. 3 shows the operation flow of the region setting unit in this embodiment, and FIG. 4 shows the operation flow of the layout unit in this embodiment. FIG. 5 is an example of an electronic document and an object that performs layout for the electronic document.

  The overall outline of this embodiment will be described below with reference to these drawings.

  In the flow for changing the layout of the table, when an instruction from the operator is necessary, the instruction is input from the operator via the keyboard 132 and the mouse 133 and is appropriately processed by the CPU 135. In addition, the operator can check the pattern layout change on the video display 144 via the video interface 137.

  The image input unit 201 inputs an electronic document page (hereinafter referred to as a page) 501 and one or a plurality of objects 502 to be laid out.

  The area setting unit 202 sets a prohibited area, an important area, and an unimportant area, which will be described later, for the page 501 and the object 502 input by the image input unit 201. This will be described below with reference to FIG.

  The area setting unit 202 includes a prohibited area setting unit 220 and an important area setting unit 221.

  In S301, the prohibited area setting unit 220 sets a prohibited area in the page. The prohibited area is an area set with the intention of prohibiting the placement of an important area, which will be described later. That is, the forbidden area is typified by an end portion of a page, a throat area of a spread page when bookbinding is performed, a place where a crease, a punch hole, or a stapler is disposed when bookbinding is performed. The prohibited area is treated as a virtual object having a fixed relationship with the page unless otherwise specified.

  The prohibited region is not limited to a rectangle having an area, and may be a shape such as a point or a straight line.

  The prohibited area setting may be performed by the prohibited area setting unit 220 according to a command manually input from the operator who has confirmed the video display 144 via the keyboard 132 and the mouse 133. The prohibited area setting unit 220 may automatically set with reference to the page size and bookbinding settings. Moreover, the form of the combination of both may be sufficient.

  FIG. 8 shows the prohibited area 801 in the page 501. Here, it is set around the throat area and the page.

  In S302, the important area setting unit 221 sets an important area in the object and other non-important areas.

  The important area refers to an area having an important meaning in the expression of the electronic document, and is an area set with the intention of avoiding the prohibited area so as not to deteriorate the appearance when the layout is performed. That is, the important area means an area having an important meaning as content in the page object, represented by a face part of a human photograph, a subject of a photograph, a text part written in a graphic object, and the like. The non-important area refers to an area other than the important area in the object 502 input by the image input unit 201. The important area is treated as a virtual object having a fixed relationship with respect to the object including the important area unless otherwise specified.

  FIG. 6 shows an example of an important area and an unimportant area in the object 502. An area 601 is set as an important area in an area that can correspond to a face part of a portrait, and an area 602 is set as an unimportant area as the other part.

  Here, the important area is a part of the input object 502 in the image input unit, but the present invention is not limited to this, and the entire object may be the important area.

  Further, the setting of the important area may be performed by the important area setting unit 221 by a command manually input from the operator who has confirmed the video display 144 via the keyboard 132 and the mouse 133. The important area setting unit 221 may automatically recognize the contents according to the contents of the object. Moreover, the form of the combination of both may be sufficient. Further, metadata recorded in advance in the object, for example, the coordinates of the face part by the face recognition function stored at the time of photographing with the digital camera may be referred to.

  FIG. 21 is a schematic diagram showing a breakdown of data stored in an image file. In addition to the image content information 2102, header information 2101 is stored in the image file, which includes coordinates based on face recognition at the time of shooting.

  Further, the area recognition unit 202 may be provided with a function for identifying an important area.

  The layout unit 203 includes a strut addition processing unit 230 and a layout execution unit 231.

  The layout unit 203 adds a strut between the prohibited area and the important / unimportant area set by the area setting unit, and executes dynamic layout. This will be described below with reference to FIG.

  Note that the strut constraint conditions and the dynamic layout calculation method, which will be described later, are the techniques disclosed in Patent Document 1 and Patent Document 3, and are in accordance with this.

  FIG. 9 is a table showing the relationship of struts added between the prohibited area, the important area, and the non-important area. This indicates the presence or absence of struts added between the prohibited area, the important area, and the non-important area. That is, a strut can be added between the prohibited area and the important area, but a strut cannot be added between the prohibited area and the non-important area.

  In S401, strut addition processing is executed between the objects. This is performed in accordance with the operator's command in accordance with the strut addition processing disclosed in Patent Document 1 and Patent Document 3.

  Next, in S402, strut addition processing is executed between the important area and the prohibited area. The important area is not an object, but here, it is treated as a virtual object, and a constraint condition with a tension is imposed between the important area and the prohibited area.

  FIG. 7 shows the strut 701 added in S402.

  Note that in S401 and S402, the tension is not necessarily equal in the constraint condition by the added strut, and the tension coefficient may be set independently according to each characteristic.

  In S403, dynamic layout is executed in accordance with the constraint conditions by the added struts in S401 and S402.

  The above is the operation flow in this embodiment. This flow is repeated at any time by a command from the operator, such as when a new object is added, a strut is added, or an attribute of an existing object is changed.

  Hereinafter, an example in which the technology presented in the present embodiment works effectively will be described with reference to FIG. 2401 is a page, 2402 is a portrait photograph of a person to be arranged, 2403 is a face recognition portion of the person, and 2405 is a position of a punch hole to be opened at the time of output.

  Consider a case where an image object 2402 is laid out in a page 2401 and punched holes are output.

  In the image input unit 201, a page 2401 and an image object 2402 are input.

  The prohibited area setting unit 220 sets a peripheral area 2406 around the punch hole position 2405 as a prohibited area, and the important area setting unit 221 sets the face recognition portion 2403 as an important area.

  In the strut addition processing unit 230, a strut 2410 is added between the image object 2402 and the page edge, and a strut 2411 is added between the important area 2402 and the prohibited area 2406.

  The layout execution unit 232 executes dynamic layout according to the constraints of the struts 2410 and struts 2411.

  As a result, since the layout is performed while the prohibited area and the important area maintain tension between each other, the important area 2403 overlaps the prohibited area 2405, that is, a punch hole is formed in the face recognition portion. The inconvenience such as can be prevented.

  Further, consider a case where a text object 2406 is further inserted under the image object 2402 in the layout state as shown in FIG. Even in this case, as shown in FIG. 25, the inconvenience that the important area 2403 overlaps the prohibited area 2405 can be prevented, and the layout can be implemented while maintaining the balance of the entire page.

  As described above, according to the present embodiment, it is possible to easily implement an appropriate image layout excellent in overall balance and design without placing important content in an inappropriate position.

  In the first embodiment, as illustrated in FIG. 7, when an object is placed in a certain page, an important area in the object cannot be laid out on the opposite page due to the tension of the strut 701. However, in order to provide a degree of freedom in the layout, it is necessary to be able to lay out the page on the opposite side while maintaining the state so that the important area does not overlap the prohibited area. This embodiment solves this problem.

  In this embodiment, the area setting unit 202 and the layout unit 203 are different from the first embodiment. FIG. 10 shows an operation flow of the area setting unit 202 in this embodiment, and FIG. 11 shows an operation flow of the layout unit 203, which will be described below.

  The operation flow of the area setting unit 202 is different from that of the first embodiment in that the important area setting unit 221 sets two types of important areas and non-important areas.

  In S1002, a first prohibited area is set. The first prohibited area has the same properties as the prohibited area in the first embodiment, and the process in S1002 is equivalent to the process in S302. However, in order to distinguish clearly from the 2nd prohibition area | region mentioned later, it calls as above.

  In S1103, a second prohibited area different from the first prohibited area is set.

  The layout unit 203 differs from the first embodiment in that the strut addition process is divided into two steps. That is, the strut addition processing unit 230 adds a strut between the first prohibited area and the important area in S1102, and in S1103, changes the direction between the second prohibited area and the important area. It is a point to set a strut. S1102 is equivalent to the process in S402.

  The direction variable strut is a strut characterized in that the direction of tension to be set can be dynamically switched.

  FIG. 12 shows an example of the first and second prohibited areas and the variable direction struts in the spread page. FIG. 13 is a table showing characteristics regarding the presence or absence of restrictions added between each prohibited area and the important area.

  In FIG. 12, 1201 is an object, 1202 is an important area, 1203 is a first prohibited area, 1204 is a second prohibited area, 1205 is a strut, and 1206 is a variable direction strut. That is, here, the peripheral portion of the spread page is the first prohibited area, and the throat area is the second prohibited area.

  A strut 1205 is added between the important area 1202 and the first prohibited area 1203, and a variable direction strut 1206 or 1207 is added between the important area 1202 and the second prohibited area 1204.

  FIG. 14 shows an example of the operation of the variable direction strut.

  In normal struts, tension was applied in a specific direction as viewed from the prohibited area with respect to the important area, whereas in variable direction struts, it depends on the positional relationship between the important area and the second prohibited area. Thus, the position and direction where the strut is added are changed.

  FIG. 22 shows an operation flow of the direction variable strut, and FIG. 12 shows an environment in which the direction variable strut operates. In S2201, first, the tension generated for each selectable direction of the direction variable strut is calculated. In step S2202, all the tensions are compared, the direction of the case having the smallest tension is selected, and the direction variable strut is set in that direction. This flow is updated each time a layout is executed or an object is added.

  For example, in the case of FIG. 12, the tension 1206 when the important area 1202 is on the left side of the second prohibited area 1204 is compared with the tension 1207 when the important area 1202 is on the right side, and the case where the tension becomes smaller is selected. Since the tension f is defined by (Equation 1), in this case, the orientation of the strut 1206 is selected.

f = k ^* (x ^ 2) (Formula 1)
Here, the direction of the directional variable strut is selected from either the left direction or the right direction, but the direction is not limited to this, and an embodiment may be selected that includes a vertical direction or an oblique direction. In addition, although the tension of the struts 1206 and 1207 is used as a criterion for judgment, it is not limited to this. It may be a composite.

  As a result, even when an object including an important area is arranged on a spread page, it is possible to obtain a balanced optimal arrangement without limiting the layout of the object to one of the pages. In addition, even when an object is added after the layout is performed once, it is possible to dynamically obtain an optimal arrangement beyond the page.

  In the first embodiment, the case where there is one object including an important area arranged on a page has been described. However, when a plurality of objects are arranged in a page, there may be a case where a plurality of objects include an important area. In this case, particularly when an object is added later, an important area of a certain object may overlap with an important area of another object. Therefore, this embodiment solves this problem.

  In the present embodiment, the layout unit 203 is different from the first embodiment. FIG. 15 shows an operation flow of the layout unit in this embodiment.

  The layout unit 203 is different from the first embodiment in that a strut addition process is performed between important areas in S1503.

  That is, as shown in FIG. 16, a strut 1601 is added between the important areas so that the important areas do not overlap each other.

  Here, in particular, FIG. 17 shows the presence or absence of restrictions added between the prohibited area, the important area, and the non-important area. That is, struts can be added between prohibited areas and important areas, and between important areas and important areas, but struts cannot be added between combinations of other areas. .

  For example, consider a case where a text object 2406 whose entire object is an important area is added to a page in a layout state as shown in FIG. In this case, as shown in FIG. 26, since the restriction of the strut 2411 acts between the important area 2403 and the important area 2407, it is possible to prevent characters from being placed on the face recognition portion.

  As a result, even when a layout of a page in which a plurality of objects including important areas are mixed is implemented, it is possible to implement a layout that does not have inconsistencies and has a good appearance.

Claims (15)

A layout control method for generating a variable data document by arranging objects in a plurality of partial areas of a variable data document,
An object input means for inputting one or more objects;
Partial area information input means for inputting information about the partial area of the variable data document;
An important area setting means for setting a part or all of the object as an important area having important contents;
A prohibited area setting means for setting, as a prohibited area, an area where the important area is not laid out inside the partial area;
Layout means for performing layout of an object in a page with reference to the prohibited area and the important area,
The layout control method, wherein the layout means executes dynamic layout so that the prohibited area and the important area do not overlap. The layout control method according to claim 1,
The important area setting means automatically recognizes an important area from an object. The layout control method according to claim 1,
The layout control method according to claim 1, wherein the important area setting means refers to position information of an important area added as object metadata. The layout control method according to claim 1, wherein
In the prohibited area setting means, the area set as the prohibited area is one of an end portion of a page of the variable data document, a throat area of a spread page, a folding position, a staple binding position, and a punch punching position, or A layout control method characterized by a combination thereof. The layout control method according to claim 1, wherein:
A layout control method, wherein the layout means sets a constraint by a strut between a prohibited area and an important area and executes dynamic layout. The layout control method according to claim 1,
The prohibited area setting means is divided into a first prohibited area setting means for setting a first prohibited area and a second prohibited area setting means for setting a second prohibited area,
The first prohibited area setting means adds a strut between an important area and the first prohibited area,
The layout control method according to claim 2, wherein the second prohibited area setting means adds a direction variable and a rat between the important area and the second prohibited area. The layout control method according to claim 1,
The layout control method, wherein the layout means adds struts between a plurality of important areas. A layout control device for generating a variable data document by arranging objects in a plurality of partial areas of a variable data document,
An object input unit for inputting one or more objects;
A partial area information input unit for inputting information about a partial area of the variable data document;
An important area setting unit for setting a part or all of the object as an important area having important content;
A prohibited area setting unit for setting, as a prohibited area, an area where the important area is not laid out inside the partial area;
A layout unit that performs layout of an object in a page with reference to the prohibited area and the important area, and
The layout control apparatus, wherein the layout unit executes dynamic layout so that a prohibited area and an important area do not overlap. The layout control device according to claim 8, wherein
The important area setting unit automatically recognizes an important area from an object. The layout control device according to claim 8, wherein
The important area setting section refers to position information of an important area added as object metadata. The layout control device according to claim 8, wherein
In the prohibited area setting unit, the area set as the prohibited area is any one of an end portion of the page of the variable data document, a throat area of the spread page, a folding position, a staple binding position, and a punch punching position, or A layout control device characterized by a combination of the above. The layout control apparatus according to claim 8, wherein
The layout control apparatus according to claim 1, wherein the layout unit sets a constraint by a strut between the prohibited area and the important area, and executes dynamic layout. The layout control device according to claim 8, wherein:
The prohibited area setting section is divided into a first prohibited area setting section for setting a first prohibited area and a second prohibited area setting section for setting a second prohibited area,
The first prohibited area setting unit adds a strut between an important area and the first prohibited area,
The layout control apparatus according to claim 2, wherein the second prohibited area setting unit adds a direction variable and a rat between the important area and the second prohibited area. The layout control device according to claim 8, wherein
The layout control device, wherein the layout unit adds struts between a plurality of important regions. A computer-readable recording medium on which a program for causing a computer to execute layout control for generating a variable data document by arranging objects in a plurality of partial areas of the variable data document,
An object input means for inputting one or more objects;
Partial area information input means for inputting information about the partial area of the variable data document;
An important area setting means for setting a part or all of the object as an important area having important contents;
A prohibited area setting means for setting, as a prohibited area, an area where the important area is not laid out inside the partial area;
Layout means for executing a layout of an object in a page with reference to the prohibited area and the important area,
A computer-readable recording medium storing a program for causing a computer to execute layout control, wherein the layout means executes dynamic layout so that a prohibited area and an important area do not overlap.

Images