JP2012033031A - Document creation/edition support method and document creation/edition support device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To extract and present a part of a text which may cause unconformity when replacing images.SOLUTION: This document creation/edition support method includes: determining whether there is a difference in values set in attributes, which are comparable, in meta data of images before and after the replacement; when there is the difference, searching a position where the value of the image before the replacement appears in the text; and presenting the searched position as a correction candidate.

Description

  The present invention relates to a document creation / editing support method and a document creation / editing support apparatus, and more particularly to a technique for supporting correction of body text accompanying editing such as replacing an image in a document including an image such as a photograph.

  There is a technique for reflecting edited contents of a part of a document in the entire document so that inconsistency does not occur in the description contents when creating and editing the document. When editing a text-only document, a general process is to search a character string before editing from the entire document by pattern matching and batch-convert it into a character string after editing.

  On the other hand, in the case of a document such as a figure where text and text are mixed, if one of the edits is performed, the association is made in advance so that the other relevant location can be reached, and the characters included in both There is a way to maintain consistency so that the columns are identical. See, for example, US Pat.

JP-A-10-124509

However, in the conventional method, for example, when editing work is performed by replacing images, it is not necessary to directly modify the character string on the image, so it is possible to narrow down “where” the body text should be corrected. In some cases, it was difficult to avoid inconsistencies.
The present invention has been made in view of the above-described problems, and an object of the present invention is to enable extraction and presentation of a portion of body text that is likely to be inconsistent with image replacement.

  The document creation / editing support method of the present invention includes a document creation / editing process for creating / editing a document in which an image and text are mixed, and an instruction for designating images before and after replacement performed in the document creating / editing process. Receiving the image instruction receiving step, the metadata managing step for managing the metadata of the image so as to be acquired, and the metadata acquisition for acquiring the instructed metadata before and after the replacement from the metadata managing step, respectively. A process, a comparison attribute specifying process for specifying a comparable attribute from the metadata acquired in the metadata acquisition process, and a value set for the comparable attribute specified in the comparison attribute specifying process, When it is determined that there is a difference between the difference determination step for determining a difference and the difference determination step, the metadata attached to the image before replacement is related. A correction candidate position detecting step for detecting a description position in the body text to be edited from the document being edited, and an output step for outputting information for distinguishing the position of the correction candidate detected in the correction candidate position detecting step. It is characterized by providing.

  According to the present invention, when replacing an image such as a photograph in a document, it is possible to extract and present a portion of a body text that is likely to be inconsistent with the replacement of the image. For this reason, the user can suppress omissions without difficulty by confirming whether or not the body text is to be corrected around the presented location.

1 is a block diagram illustrating an example of a document creation / editing support apparatus according to an embodiment of the present invention. It is a block diagram which shows the basic composition of a document creation / edit assistance apparatus. It is a flowchart which shows the process of a document preparation / edit assistance apparatus. It is a block diagram which shows the structural example of the apparatus which enabled network connection. It is the figure which showed the example of the metadata provided to the image before and behind replacement. It is a figure which shows the example with no difference in the metadata provided to the image before and behind replacement. It is the figure which showed the example of a display of the document in edit. It is the figure which showed a mode that the image is replaced in the document in edit. It is the figure which showed the example by which the correction candidate in a text is highlighted. It is a block diagram which shows the basic composition of the apparatus which provided the word utilization intention estimation part.

  Preferred embodiments of the present invention will be described below with reference to the accompanying drawings. The embodiment described below shows an example when the present invention is specifically implemented, and is one of the specific embodiments having the configurations described in the claims.

(First embodiment)
A circuit configuration showing the document creation / editing support apparatus of this embodiment will be described with reference to the block diagram of FIG. In the present embodiment, this configuration may be realized by a single computer device, or may be realized by distributing each function to a plurality of computer devices as necessary. When configured by a plurality of computer devices, as shown in FIG. 4, a network interface 401 is added to the configuration shown in FIG. 1, and they are connected by a local area network (LAN) or the like so that they can communicate with each other. To do.

  In FIG. 1, a central processing unit (CPU) 101 controls the entire computer apparatus 100. A Read Only Memory (ROM) 102 stores programs and parameters that do not need to be changed. A random access memory (RAM) 103 temporarily stores programs and data supplied from the external storage device 104 or the like.

  The external storage device 104 includes a hard disk drive (HDD) and a flash memory drive (SSD) fixedly installed on the computer device 100, or a memory card and an optical disk that can be detached from the computer device 100. The input interface 105 is an interface with an input device 108 such as a pointing device or a keyboard that inputs data in response to a user operation. The output interface 106 is an interface with an output device 109 such as a monitor for outputting data held by the computer apparatus 100, supplied data, and an execution result of the program. A system bus 107 connects the units 101 to 106 so that they can communicate with each other.

Next, the basic configuration of the document creation / editing support apparatus of this embodiment will be described with reference to the block diagram of FIG.
The document creation / editing unit 200 can create and edit a document in which an image and text are mixed. Here, basic document creation and editing functions are provided. In the present embodiment, it is possible to perform editing input of body text, designation input of an image in a document, and the like.

  Furthermore, it is assumed that an image in a document can be replaced by an operation for instructing replacement of the designated image with another image. At this time, it is assumed that image identification information is held for each of the designated image and another image that has been instructed to be replaced. These pieces of identification information can be used when acquiring metadata of the image from the metadata management unit 202 described later. These operations are performed by input from the input device 108 via the input interface 105 and output to the output device 109 via the output interface 106.

  The image instruction receiving unit 201 receives image identification information before and after replacement. Here, it is assumed that identification information of an image from which metadata can be acquired is given at least in the metadata management unit 202 described later. In the present embodiment, identification information of each instructed image is acquired from the document creation / editing unit 200 in accordance with an instruction for the image before and after replacement via the input interface 105.

  The metadata management unit 202 manages the metadata of the image so as to be acquired from the identification information of the image. In the present embodiment, metadata is expressed by “attribute = value”. For example, assuming that “photographing location = Iriomote Island” is given as metadata of a certain photo, “photographing location” is an attribute, and “Iriomote Island” corresponds to a value. These metadata may be written in the file of the image main body by a prescribed method (for example, Exif format). The file may be managed separately from the image file in association with the image identification information. Alternatively, both methods may be managed together. In the case where the file is written in the image main body file, the acquisition of the metadata may be realized by specifying the image main body file from the image identification information and extracting the metadata from the file.

  The metadata acquisition unit 203 receives the identification information of the images before and after replacement, and acquires the metadata of each of these images from the metadata management unit 202. In the present embodiment, a list of metadata as shown in FIGS. 5A and 5B is acquired for the images before and after replacement, respectively. In FIG. 5, only a part of metadata necessary for explanation in the present embodiment is extracted and described.

  The comparison attribute specifying unit 204 specifies comparable attributes from the metadata before and after replacement. In the present embodiment, the attribute notations are compared, and if they are the same, the attributes are comparable. In the examples of FIGS. 5A and 5B, “subject” and “shooting location” are mutually comparable attributes.

  The difference determination unit 205 determines whether or not there is a difference in values set for the comparable attributes for the metadata before and after replacement. In this embodiment, it is determined that there is a difference when the value is text and the notation is different. In the example of FIG. 5, regarding the “subject” attribute, the value of the “subject” attribute is determined to be different because the “subject” attribute has changed from “comic eagle” to “Iriomote Wildcat” before and after the replacement.

  The correction candidate position detection unit 206 searches for the description position in the body text related to the metadata before replacement that has a difference, and detects the position as the position of the correction candidate. In this embodiment, a part where the character string pattern partially matches is searched from the entire body text, and the position is detected as a correction candidate position. In the example of FIG. 5, positions in the body text that partially match with “Kamuri-sword” that is a value before replacement are searched, and all of these positions are detected as correction candidate positions.

  The output unit 207 outputs a correction candidate position. In this embodiment, the document being edited by the document creation / editing unit 200 is displayed via the output device 109, and the correction candidate position is highlighted in the display of this document. The highlighting method is not particularly limited. For example, the display can be distinguished from other characters by changing the thickness or size of the characters, adding color, or enclosing them with a frame. Just do it. In the example of FIG. 5, the notation part of “Kamuri-sword” in the body text of the document being edited is highlighted.

  Next, the processing procedure for outputting the position of the body text as a correction candidate at the time of image replacement in the document creation / editing support apparatus of this embodiment will be described with reference to the flowchart of FIG.

In step S301, the image instruction receiving unit 201 receives identification information of an image to be replaced (an image before replacement) in a document being edited.
In step S <b> 302, the image instruction receiving unit 201 receives identification information of an image to be replaced (post-replacement image). At this time, the order of S301 and S302 may be either. Therefore, not only the operation of individually specifying, but also the method of specifying by an operation that confirms the images before and after replacement at the same time may be used.

  For example, it is assumed that the user is editing a document in the document creation / editing unit 200 under the display as shown in FIG. At this time, reference numeral 701 denotes an image to be replaced (pre-replacement image), reference numeral 702 denotes a document being edited, and a plurality of pages have already been created.

  In this state, when an operation for dragging and dropping the replacement image 801 onto the pre-replacement image 701 as shown in FIG. 8 is performed, it is only necessary to operate as if both were specified at the same time. In the present embodiment, since the document creation / editing unit 200 providing these operations can know the identification information of each image, when the image instruction receiving unit 201 receives the identification information, S301 and S302 are either Is also implemented.

In S303, the metadata acquisition unit 203 acquires the metadata of the image from the metadata management unit 202 from the identification information of the pre-replacement image specified in S301.
In S <b> 304, the metadata acquisition unit 203 acquires the metadata of the image from the metadata management unit 202 from the replacement image identification information specified in S <b> 302. At this time, the order of S303 and S304 may be first. In the present embodiment, in the examples of FIGS. 7 to 8, it is assumed that (a) in FIG. 5 can be acquired as metadata 701 and (b) in FIG. 5 can be acquired as metadata 801 by S303 and S304.

  In S305, the comparison attribute specifying unit 204 compares each attribute of the metadata acquired in S303 and S304 to determine whether there is a comparable attribute. If there is a comparable attribute, the process proceeds to S306, and if there is no comparable attribute, the flow ends. In this embodiment, (a) and (b) in FIG. 5 are acquired, and as described above, “subject” and “photographing place” are comparable attributes here.

  In step S306, the difference determination unit 205 determines whether there is a difference between the values of the attributes determined to be comparable in step S305. If there is a difference, the process proceeds to S307. In the present embodiment, it is determined from the metadata in FIGS. 5A and 5B that there is a difference between the “subject” attribute value “Kamuri eagle” and “Iriomote lynx”. On the other hand, if there is no difference in all values set in the comparable attribute, this flow ends.

  For this, for example, the metadata before and after replacement corresponds to the cases shown in FIGS. Here, since it is considered that the comparable attributes “subject” and “photo location” were replaced with the same image, it is not necessary to output correction candidates for the values set in the above-mentioned attributes It is. In this way, when the correction candidate output is unnecessary, the correction candidate is not presented. In this case, an effect of reducing the load on the user can be obtained.

  In S307, for each of the values determined to be different in S306, the correction candidate position detection unit 206 searches the corresponding description part from the body text of the document being edited, and detects the position. In the present embodiment, a process of detecting the position in the body text of “Kamuri eagle” from the entire document is performed.

  In S308, the output unit 207 outputs the body text position detected in S307 as a correction candidate accompanying the image replacement. In the present embodiment, the correction candidates are highlighted, and for example, the display is as shown in FIG. Here, the page that is hidden on the display is also made to appear on the page including “Kamuri eagle” and is highlighted by surrounding it with a square frame (901). Note that the value of “capturing location”, which is a comparable attribute, remains “Iriomote Island” before and after the replacement, and is not highlighted (902).

(Second Embodiment)
In the embodiment described above, the same notation is given as the comparable attribute, but the present invention is not limited to this. For example, there may be cases where the notation of attributes is different. This includes the case where one is a “photo location” and the other is a “photo location”. In such a case, the comparison attribute specifying unit 204 refers to the dictionary to determine whether or not the mutual attributes are equivalent (similar), and if it is determined that they are equivalent, the comparison attribute specifying unit 204 may use the comparable attribute. Absent.

  As for the dictionary, when the type of metadata attribute is known in advance, information associated with it explicitly may be provided. If metadata attributes may not be determined, use general-purpose dictionary data (ontologies and thesauruses that define general word meanings and hierarchical relationships of concepts) and dynamically associate them. You may do. Or you may make it define the information regarding the attribute which a user can compare. According to this embodiment, even in cases where the notation of attributes is different, metadata before and after replacement can be compared, and correction candidates can be presented.

(Third embodiment)
In the above-described embodiment, an example in which the difference determination of the metadata value is performed based on whether the notation is different is described. However, the present invention is not limited to this. For example, there may be cases where the expression of values is different, so the difference determination unit 205 may determine whether they are equivalent by referring to a dictionary. The dictionary may use a general-purpose dictionary (ontology or thesaurus in which the meaning of general words and the hierarchical relationship of concepts are defined) as general knowledge. Furthermore, the user may define it.

  For example, when a user assigns a subject name as metadata, a real name or a nickname may be given in a mixed manner. In such a case, the notation of the notation will occur, so the user may associate the real name with the nickname. Note that these dictionaries need not be limited to one, and may be mixed, for example, by giving priority to search. For example, dictionaries defined by the user may be mixed so that the dictionary is preferentially referenced over the general-purpose dictionary.

  In addition, for example, in the case where a conceptual hierarchical relationship is also defined as the above-mentioned dictionary, the metadata value that was different was replaced so that it changed to a lower conceptual value. Can know. In such a case, there is little or no mismatch between the content and the image. For example, consider a case where an image of “subject = cat” in “photographing place = Okinawa” is replaced with an image in “photographing place = Iriomote Island” and “subject = Iriomote cat”.

  In this case, inconsistency may not occur in the description contents regarding “Okinawa” or “cat” in the text even if the image is “Iriomote Island” or “Iriomote Wildcat”. Therefore, such a conceptual change to a lower value may be determined so that the difference is smaller than a change to another value. In this way, when highlighting, it is possible to change the way of emphasis depending on the magnitude of the difference, and it is possible to indicate the location where the user should preferentially correct.

  According to the present embodiment, even if there is a difference in notation, it is possible to prevent a metadata value that is expressed in the same way from being output as a correction candidate. In addition, the output method can be changed depending on the magnitude of the difference, and can be presented separately from the portion to be corrected.

(Fourth embodiment)
In the above-described embodiment, the partial match search of the character string is performed to detect the correction candidate position of the body text. However, the present invention is not limited to this. The positions to be detected may be narrowed down in consideration of a combination of “attribute = value” of metadata having a difference. For example, when “shooting location = Miyazaki” is replaced with an image of “shooting location = Kagoshima”, descriptions in the text such as “Ichiro Miyazaki” who is the name of the person should not be detected as correction candidates. .

  Therefore, first, after performing a partial match search in the body text, it is determined what purpose the word is used for. The method of this determination is not limited in the present embodiment. For example, it may be performed by a general-purpose specific expression extraction process as described below. That is, it is thought that proper expressions such as names of people, places, and organizations are statistically biased in the order of appearance and co-occurrence with other words in the sentence. For this reason, these tendencies may be learned in advance from a large amount of correct answer data, and it may be probabilistically estimated which specific expression has a similar tendency.

  When estimation is performed in this way, as shown in FIG. 10, as a basic configuration in this embodiment, a word usage intention estimation unit 1001 is provided here in the basic configuration in the above-described embodiment (FIG. 2).

  In S307, after detecting the position of the correction candidate word in the body text, the word usage intention estimation unit 1001 performs a process of estimating the usage intention of the correction candidate word from the description contents before and after the position.

  In the present embodiment, it is estimated that “Miyazaki” represented by “Mr. Ichiro Miyazaki” is the “person name” by the above-described extraction of the unique expressions. In this case, since it is different from the “place name” of the metadata of the image, the correction candidate position detection unit 206 does not detect the position as a correction candidate position. Alternatively, the priority may be set so that the candidate is lower in priority than other correction candidates estimated to be used as “place names”.

  The priority is determined from the likelihood obtained as the estimation processing result. Note that when the method of setting the priority is adopted, when the output unit 207 performs highlighting, the output unit 207 changes the method of emphasis according to the priority so that the higher priority is emphasized. To make it look like this. By using this embodiment, it is possible to suppress a word originally used with a different intention in the body text from being presented as a correction candidate.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

  200 Document creation / editing unit, 201 Image instruction receiving unit, 202 Metadata management unit, 203 Metadata acquisition unit, 204 Comparison attribute specifying unit, 205 Difference determination unit, 206 Correction candidate position detection unit, 207 Output unit

Claims (7)

A document creation / editing process for creating / editing a document with mixed images and body text;
An image instruction receiving step for receiving an instruction to specify images before and after replacement performed in the document creation / editing step;
A metadata management step for managing the metadata of the image so as to be obtainable;
A metadata acquisition step of acquiring metadata of the image before and after the instructed replacement from the metadata management step;
A comparison attribute identification step for identifying a comparable attribute from the metadata acquired in the metadata acquisition step;
A difference determination step of comparing values set in comparable attributes specified in the comparison attribute specification step and determining a difference, respectively.
A correction candidate position detection step of detecting a description position in the body text relating to the metadata attached to the image before the replacement from the document being edited when it is determined that there is a difference in the difference determination step;
An output step of outputting information for distinguishing the location of the correction candidate detected in the correction candidate position detection step;
A document creation / editing support method characterized by comprising:   2. The document creation / editing support method according to claim 1, wherein, in the comparison attribute specifying step, whether or not the attributes are similar is determined by looking up a dictionary, and a comparable attribute is specified.   3. The document creation / editing according to claim 1 or 2, wherein, in the difference determination step, it is determined whether or not there is a difference in values set in the comparable attributes by looking up a dictionary. Support method. A word use intention estimation step for estimating what intention the word of the body text is used for,
In the word usage intention estimation step, word usage intention estimation is performed on the portion detected in the correction candidate position detection step, and the estimated result is determined to be attributed to the metadata attribute determined to have a difference in the difference determination step. The document creation / editing support method according to any one of claims 1 to 3, wherein the detected portion is not regarded as a correction candidate when the relationship is different from the value relationship. In the word use intention estimation step, when estimating what kind of intention the word is used for, the likelihood of each intention is output,
In the correction candidate position detection step, priority as a correction candidate is determined by the likelihood,
5. The document creation / editing support method according to claim 4, wherein, in the output step, the output is performed by distinguishing according to the priority. Document creation / editing means for creating / editing a document with mixed images and body text,
Image instruction receiving means for receiving an instruction to specify images before and after replacement performed by the document creating / editing means;
Metadata management means for managing the metadata of the image so as to be obtainable;
Metadata acquisition means for acquiring metadata of the image before and after the instructed replacement from the metadata management means;
Comparison attribute specifying means for specifying a comparable attribute from the metadata acquired by the metadata acquisition means;
A difference determination unit that compares the values set in the comparable attributes specified by the comparison attribute specifying unit, and determines a difference;
Correction candidate position detecting means for detecting a description position in the body text relating to the metadata attached to the image before replacement when the difference determining means determines that there is a difference, from the document being edited;
An output means for outputting information for distinguishing the location of the correction candidate detected by the correction candidate position detection means;
A document creation / editing support apparatus characterized by comprising: A document creation / editing process for creating / editing a document with mixed images and body text;
An image instruction receiving step for receiving an instruction to specify images before and after replacement performed in the document creation / editing step;
A metadata management step for managing the metadata of the image so as to be obtainable;
A metadata acquisition step of acquiring metadata of the image before and after the instructed replacement from the metadata management step;
A comparison attribute identification step for identifying a comparable attribute from the metadata acquired in the metadata acquisition step;
A difference determination step of comparing values set in comparable attributes specified in the comparison attribute specification step and determining a difference, respectively.
A correction candidate position detection step of detecting a description position in the body text relating to the metadata attached to the image before the replacement from the document being edited when it is determined that there is a difference in the difference determination step;
A program for causing a computer to execute an output step of outputting information for distinguishing a location of a correction candidate detected in the correction candidate position detection step.

Images