JP6607030B2 - Information processing apparatus, information processing system, processing method thereof, and program - Google Patents

Description

  The present invention relates to an information processing apparatus, a server, an information processing system, and a processing method and program for recording instruction contents using an image.

  2. Description of the Related Art Conventionally, a technique (client / server type system) has been realized in which image data stored in a server is edited on the client side and the edited image is saved on the server.

Specifically, when the client side is a Windows (registered trademark) application, a protocol example that can exchange binary data between the server and the client for sending and receiving images: TCP socket communication), and image data that is binary data is sent to the client side. In general, drawing operations such as graphics and freehand are performed on the received image data using an image operation interface (eg, GDI) on the client side.
Utilizing these techniques, for example, as disclosed in Patent Document 1, in an electronic conference system, the content of manipulating images on a screen is shared by a plurality of people.

JP 2006-91033 A

  However, in a client / server type system, it is easy to construct a mechanism for managing the contents input on the client side by the server. However, in a Web environment using a browser, it is difficult to edit images and manage the edited contents. It was.

  In particular, even if an image displayed on a browser can be edited, it is not easy to appropriately manage the contents related to the editing (for example, editing order and comments related to the editing). In addition, in order to give an instruction using an image to another user, the instruction content cannot be transmitted by a technique that can simply edit the image, and there is a problem that is difficult to solve by the conventional technique.

  In addition, the editing method differs depending on the user, and the instruction content may not be appropriate. For this reason, there is a problem that the instruction contents are not transmitted well to a user (for example, an adjuster of an insurance company) who makes a determination using an image in which the instruction contents are input, and the efficiency is deteriorated. For this reason, there has been a demand for input with reference to the contents designated by other users.

  Accordingly, an object of the present invention is to provide a mechanism that supports input of contents using an image.

  In order to achieve the object of the present invention, an information processing apparatus capable of communicating with an edited image by adding annotations and a management apparatus that manages the attributes of the annotations used in the edited images, and acquires an image list of the edited images Used for the editing unit selected by the acquisition unit, the display unit for displaying the image list acquired by the acquisition unit, the edited image selection unit for selecting the edited image to be referred to from the image list, and the edited image selection unit And adding means for adding an annotation on the image to be edited using the attribute of the annotation.

  According to the present invention, it is possible to support input of content using an image.

1 is a system configuration diagram showing an example of a configuration of a Web system It is a block diagram which shows an example of the hardware constitutions of the information processing apparatus applicable to the client terminal 100 It is a figure which shows the functional block of each apparatus in this system. It is a flowchart which shows the process of image editing It is a flowchart which shows the process regarding image evaluation. It is a flowchart of annotation addition processing It is a flowchart of an image preservation | save process It is a flowchart of the display process of an image editing example. It is a flowchart of a display process of ranking It is an image figure which shows an example of an image edit screen. It is an image figure which shows an example of the image edit screen to which the attribute was set It is an image figure which shows an example of a feedback screen. It is an image figure which shows an example of a feedback result screen. It is an image figure which shows an example of a ranking screen. 4 is a data diagram illustrating an example of data stored in a DB server 300. FIG. It is an image figure which shows an example of an image list display screen It is a screen image figure before and after adding an annotation It is a data figure which shows an example of an annotation arrangement | sequence. It is a figure which shows the data transition of the preservation | save data of the edited image

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a configuration of a Web system (information processing system) including a client terminal 100 (information processing apparatus), a Web server 200 (image management server), a DB server 300, a file server 400, and a client terminal 401 according to the present invention. It is a system configuration diagram showing an example.

  The client terminal 100 is an information processing apparatus that is a base for registering and editing images and is installed in a repair shop or the like. The client terminal 401 is a base that checks a registered image. For example, the client terminal 401 is an information processing apparatus installed in a company that checks an image and determines whether to apply insurance. The Web server 200 (image management server), DB server 300, and file server 400 are servers installed on a network such as a cloud environment.

  In this embodiment, a Web system that manages images is used to explain using a more preferable example. However, any system other than a general Web system may be used as long as the system manages contents edited with images. May be.

  The client terminal 100 stores a browser and accesses the Web server 200 from the browser via the network 500. The user logs in to the Web server 200, receives a Web screen to be displayed on the browser from the Web server 200, receives an image managed by the Web server, and displays the image on the browser. The web screen is stored in the web server 200. Various scripts are described on the Web screen, and the display control on the Web screen can be realized.

In other words, the client terminal 100 is an information processing apparatus that can communicate with a management apparatus that manages an edited image by adding an annotation and attributes of the annotation used in the edited image (line type, thickness, color, etc.).
The DB server 300 is a server that manages data for managing images, and is a server that manages various data in a database.
In response to requests (search request, registration request, deletion request) from the Web server 200, the managed data can be accessed.

  When the transmission button 1504 in FIG. 15 is pressed, an image, an edited image, and a memo (item data) registered in a flowchart described later are transmitted from the Web server 200 to the file server 400. The file server 400 registers the transmitted matter data and notifies the client terminal 401 of it. The item data is displayed on the client terminal 401. At the time of this display, the edited image combined with the annotation is displayed on the browser.

The Web server manages images, and annotation information and memo information for the images are managed by the original image information table 1400 and the edited image information table 1410 in FIG. The original image information table 1400 holds an original image ID, an original image file path, and a memo value. The edited image information table 1410 holds values of an edited image ID, an original image ID, an edited image file path, and a serialized annotation.
In the present embodiment, the DB server 300 is described as a separate housing from the Web server 200, but the Web server and the DB server 300 may be the same housing.

  That is, a (database) configuration in which data is managed on the hard disk (storage device) of the Web server 200 may be used. The Web server 200 and the file server 400 may be the same housing.

  In the present embodiment, the network 500 is assumed to be an external network (a web environment such as a cloud system), but may be a closed network in the company.

In this system, a management device as a server manages an edited image by adding an annotation and an attribute of the annotation used in the edited image, acquires an image list of the edited image by an information processing device as a client terminal, An acquired image list (for example, 903) is displayed, an edited image to be referred to is selected from the image list, and an annotation is added to the image to be edited using the annotation attribute used for the selected edited image. (For example, 1006).
In the information processing apparatus, the annotation attributes used for editing are set to the annotation attributes used for editing (for example, 1001 and 1002).

Next, a hardware configuration of the information processing apparatus applicable to the client terminal 100 (information processing apparatus), the Web server 200, and the DB server 300 illustrated in FIG. 1 will be described with reference to FIG.
2 will be described as the client terminal 100. FIG.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 202 or the external memory 211 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 201, or a function executed by each server or each PC. Various programs to be described later are stored.

  In this embodiment, for example, a browser is managed. When FIG. 2 is a configuration diagram of the WEB server 200, Web applications and images are stored and managed. Note that the Web application manages a session in order to control login from the client terminal 100. The management of the number of simultaneous connections, that is, session management is possible because it is a well-known technique such as Apache, and the description thereof is omitted. Further, the configuration may be such that the number of login users is managed not only by a session but also by a Web application.

  A RAM 203 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for execution of processing from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

  An input controller 205 controls input from a keyboard (KB) 209 or a pointing device such as a mouse (not shown). A video controller 206 controls display on a display device such as a CRT display (CRT) 210. In FIG. 2, although described as CRT 210, the display device is not limited to the CRT, but may be another display device such as a liquid crystal display. These are used by the administrator as needed.

  A memory controller 207 is connected to the hard disk (HD), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, etc. via an adapter. The access to the external memory 211 such as a compact flash (registered trademark) memory is controlled.

  A communication I / F controller 208 is connected to and communicates with an external device via a network (for example, 500 shown in FIG. 1), and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the CRT 210 by executing outline font rasterization processing on a display information area in the RAM 203, for example. In addition, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the CRT 210.

  Various programs to be described later for realizing the present invention are recorded in the external memory 211 and executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, definition files and various information tables used when executing the program are also stored in the external memory 211, and a detailed description thereof will be described later.

Next, each functional block of each device in this system will be described with reference to the functional block diagram of FIG. Each function is executed by the CPU, and detailed processing executed by each function will be described with reference to the flowcharts of FIGS.
First, functional units of the client terminal 100 will be described.
The image acquisition unit 301 is a functional unit that acquires images from a storage device that manages images such as servers.
The image display control unit 302 is a functional unit that displays the image acquired by the image acquisition unit 301.

  An annotation display control (addition) unit 303 is a functional unit that displays (adds) an annotation with identification information obtained by operating an annotation at a position corresponding to a user operation on the image displayed by the image display control unit 302. .

The input information display control (addition) unit 304 is a functional unit that displays (adds) input information corresponding to the identification information when the annotation display control (addition) unit 303 displays (adds) an annotation.
Next, functional units of the Web server 200 will be described.
The image management unit 305 is a functional unit that manages images, annotation information provided by the client terminal 100, and input information.

  The image transmission unit 306 is a functional unit that transmits an image designated by the user to the client terminal 100. It is also a functional unit that transmits annotation information and input information corresponding to an image.

Hereinafter, the processing in the system of the present embodiment will be described in more detail with reference to the flowcharts of FIGS.
In addition, about each step, CPU of each apparatus performs a process.

  First, detailed processing in the embodiment of the present invention will be described with reference to FIGS. 4A and 4B. The flowchart in FIG. 4A is a flowchart showing image editing processing.

In step S401, after logging in to the Web server, the image list registered in the case information designated by the login user (the case information designated from the list of the accident case information 1440 in FIG. 14) is displayed on the detailed screen of the case (see FIG. 15). Assume that each image is associated with an original image ID. The edited image is displayed with a mark for identifying that it has been edited, such as 1502.
In step S402, an image designation is received in 1501.
In step S403, the pressing of the edit button 1503 for the designated image is accepted.

In step S404, the original image ID of the image specified in 1501 is transmitted to the Web server 200. It is assumed that the original image ID is included in the HTTP request and transmitted.
In step S405, the original image ID is received from the client terminal 100.

  In step S406, an acquisition request including the original image ID is transmitted to the DB server 300 in order to acquire the original image corresponding to the received original image ID. For example, it is assumed that an SQL sentence is issued.

In step S407, an original image file path (for example, 1401) is acquired from the original image information table (1400 in FIG. 14) according to the original image ID included in the acquisition request received from the Web server 200.
In step S408, the acquired original image file path is transmitted to the Web server 200.
In step S409, the original image file path transmitted by the DB server 300 is received.
In step S410, the original image stored in the external memory (HDD or the like) is acquired according to the original image file path. The external memory may be replaced with the file server 400.
In step S411, the acquired original image (including the original image ID) is transmitted to the client terminal 100.

  In step S412, the original image is received from the Web server 200. The received original image is stored in the RAM and acquired when displayed. That is, an example of an acquisition process for acquiring an image list of edited images is shown.

In step S413, the received image is displayed using a browser. For example, FIG. That is, an example of display processing for displaying the acquired image list is shown. The image list is an edited image obtained by combining the original image and the annotation.
In step S414, an image editing example is displayed on the image editing screen. Details will be described later with reference to FIG.
In step S415, an annotation is added. Details will be described later with reference to FIG.
In step S416, the image into which the annotation or memo is input is saved. Details will be described later with reference to FIG.

  In step S417, the original image ID, the part designated on the image editing screen (for example, 901), the added annotation, the comment, and the user ID of the factory user who performed the editing are transmitted to the Web server 200.

  In step S418, the original image ID transmitted from the client terminal 100, the part (part information), the added annotation (serialized annotation information), the comment (serialized text), and the user ID of the factory user who performed the editing are entered. Receive.

  In step S419, a storage request including part information, serialized annotation information, serialized text (memo information), factory user ID, and original image ID is transmitted to the DB server 300. Note that the annotation information and the memo information are converted into an appropriate format for saving in the table.

In step S420, the storage request is received, and the annotation information, the part information, and the factory user ID are stored in the edited image information table (1410 in FIG. 14) in association with the original image ID. The edited image ID is automatically numbered and registered. Also, the memo information is stored in the original image information table (1400 in FIG. 14) in association with the original image ID.
In step S421, the base64-encoded character string is decoded to obtain binary data, and is stored on the external memory as an edited image file.
In step S422, a save request including the file path of the saved edited image file and the original image ID is transmitted to the DB server 300.

  In step S423, the storage request is received, and the received file path is stored in the edited image file path of the edited image information table (1410 in FIG. 14) corresponding to the original image ID. This is the process of editing and saving.

Aside from this storage processing, processing that is displayed on the client terminal 401 on the non-life insurance company side when the transmission button 1504 is pressed on the screen of FIG. 15 from the client terminal 100 on the factory side will be described next.
In step S424, an image designation is received in 1501.
In step S425, the transmission button 1504 is pressed for the designated image.

  In step S <b> 426, the original image, annotation information, and memo information are transmitted to the Web server 200 to be transmitted to the client terminal 401. In this embodiment, the designated image is transmitted. However, a configuration in which all displayed images are transmitted may be used.

  In step S427, the original image, annotation information, and memo information received from the client terminal 100 are received and transmitted to the client terminal 401. In this embodiment, the client terminal 401 is configured to receive and display the original image, annotation information, and memo information by transmission from the client terminal 100. However, the client terminal 401 stores in the DB server at an arbitrary timing. The original image, the annotation information, and the memo information may be read and displayed.

  Next, processing following FIG. 4A will be described using the flowchart of FIG. 4B. The flowchart in FIG. 4B is a flowchart showing processing related to image evaluation.

  In step S428, the original image, annotation information, and memo information transmitted from the web server 200 in step S427 are received. The received original image is stored in the RAM, and the annotation information and the original image are combined and displayed on the browser. At this time, the memo information is also displayed in accordance with the comment field 1104. An example of the display is the feedback screen of FIG.

In step S429, an input of quality evaluation for the displayed image is received in the feedback field 1101 of the feedback screen (FIG. 11). An example of the accepted input will be described in the following steps.
In step S430, the annotation to be evaluated is selected from the pull-down 1105 in the feedback field 1101.

In step S431, the feedback column 1101 accepts an annotation evaluation input. In the feedback column 1101, in addition to the image evaluation (image quality evaluation information) of the image itself, as an evaluation of the annotation given to the image, an evaluation input (annotation evaluation information) of the type of line, the thickness of the line, and the color of the line ). It is also possible to evaluate comments. In the present embodiment, an evaluation input is received for each item of the annotation. However, as a comprehensive evaluation of the entire annotation, a rank such as A, B, C, D may be input.
In step S432, a feedback comment regarding feedback is input to the feedback column 1101.
In step S 433, the pressing of the evaluation transmission button 1102 on the screen of the client terminal 401 is accepted.
In step S434, image quality evaluation information, annotation evaluation information, and feedback comments are transmitted to the Web server 200.
In step S435, image quality evaluation information, annotation evaluation information, and a feedback comment are received from the client terminal 401.

In step S436, image quality evaluation information (evaluation score), annotation evaluation information (evaluation score), a total score of the evaluation scores, and a feedback comment storage request are transmitted to the DB server 300.
As the evaluation score, for example, “very good = 5 points” is set. The total score may be used instead of the total score.

  In step S437, the storage request is received, and the image quality evaluation information, the annotation evaluation information, the feedback comment, and the total score of the evaluation are stored in the feedback table (1420 in FIG. 14) in association with the original image ID.

  Next, processing for browsing feedback content on the client terminal 100 will be described. It is assumed that the feedback content stored in step S437 can be confirmed for an arbitrary image by the user's selection.

In step S438, designation of an image whose feedback content is to be confirmed in 1501 and 1502 is accepted. Although the feedback content can be viewed from the screen of FIG. 15 used for the description in step S401, the present invention is not limited to this.
In step S439, the pressing of the feedback content confirmation button 1505 for the designated image is accepted.

In step S440, a feedback content confirmation request (HTTP request) including the original image ID of the image specified in 1501 or 1502 is transmitted to the Web server 200.
In step S441, a feedback content confirmation request including the original image ID is received from the client terminal 100.

In step S442, in order to acquire the original image corresponding to the received original image ID, an acquisition request including the original image ID is transmitted to the DB server 300. For example, it is assumed that an SQL sentence is issued.

In step S443, an original image file path (for example, 1401) is acquired from the original image information table (1400 in FIG. 14) according to the original image ID included in the acquisition request received from the Web server 200.
In step S444, the acquired original image file path is transmitted to the Web server 200.

In step S445, a serialized annotation is acquired from the edited image information table (1410 in FIG. 14) according to the original image ID. The annotation information is a JSON type character string type. Further, a memo is acquired from the original image information table (1400 in FIG. 14) according to the original image ID.
In step S446, the acquired serialized annotation (hereinafter, annotation information) and memo (hereinafter, memo information) are transmitted to the Web server 200.

In step S447, image quality evaluation information, annotation evaluation information, and feedback comments are acquired from the feedback table (1420 in FIG. 14) according to the original image ID.
In step S448, the acquired image quality evaluation information, annotation evaluation information, and feedback comment are transmitted to the Web server 200.

In step S449, the original image file path, annotation information, memo information, image quality evaluation information, annotation evaluation information, and feedback comment are received from the DB server 300.
In step S450, the original image stored in the external memory (HDD or the like) is acquired according to the original image file path.

In step S451, the acquired original image, annotation information, memo information, image quality evaluation information, annotation evaluation information, and feedback comment are transmitted to the client terminal 100.

  In step S452, an original image, annotation information, memo information, image quality evaluation information, annotation evaluation information, and feedback comments are received from the Web server 200. Annotation information is stored on the RAM. Since the annotation function stores the drawing function and the drawing parameter, the annotation information is deserialized and the annotation is sequentially displayed on the original image using the drawing function and the drawing parameter.

  In step S453, the received original image, annotation information, memo information, image quality evaluation information, annotation evaluation information, and feedback comment are displayed using a browser. The original image is displayed on, for example, HTML5 Canvas. An annotation can be drawn on the upper layer of the image displayed on the canvas. An example of the feedback confirmation screen is shown in FIG. In FIG. 12, the mark is displayed with a mark such as ◎ ○ △ based on the evaluation score, but the present invention is not limited to this.

  Next, the annotation addition process in the embodiment of the present invention will be described with reference to FIG. FIG. 5 is a flowchart of the annotation addition process.

  In step S601, a mouse drag operation on the original image displayed on the browser is detected. At this time, the type (arrow, circle, freehand) indicating the shape of the annotation selected in 1608, the line thickness (thin, standard, thick), and the line color are set.

In step S602, the position by drag operation is acquired (position acquisition), and using this position, the set annotation type (arrow, circle, freehand), line thickness (thin, standard, thick) Draw annotations on the layer according to the line color. Note that the drawing is performed using, for example, a drawing function provided by a drawing library of JavaScript (registered trademark). For example, 1604 arrow. That is, an example of an addition process for adding an annotation to be added to an image to be edited using the annotation attribute used for the selected edited image.
In step S603, an empty element is added to the annotation array.

  In step S604, an annotation drawing command (drawing function, drawing function parameter) drawn on the added empty element is added. For example, annotation information is added as indicated by 1401 in FIG. In FIG. 14, the number of arrays is two for the sake of explanation, but when the annotation 1604 in FIG. 16 is added, the number of arrays is four.

  In step S605, the annotation number of the added annotation is acquired. The annotation number is determined based on the number of array elements (number in the order of creation).

  In step S606, an object in which the number of acquired elements (annotation number) is converted into a graphic (object 1609 with the number inserted) is displayed at the start point of the drawn annotation (drag operation start position with the mouse). This display is also displayed on the layer. The number of elements is associated with the annotation. That is, it is a step showing an example of annotation display control (addition) processing for additionally displaying an annotation (annotation and identification number) with identification information obtained by operating an annotation at a position corresponding to a user operation on the displayed image. . Further, it is a process of displaying the object with the number inserted in the displayed annotation. In this embodiment, the annotation start point is set so that the drag operation start position with the mouse is at the end opposite to the arrow direction, but the annotation operation start point with the mouse is at the tip in the arrow direction. When an object is drawn, an object in which the number of elements (annotation number) is rendered (an object 1609 with the number inserted) is drawn at the drag operation end position (end point) with the mouse. That is, an object with a number inserted at a predetermined position corresponding to the annotation is drawn.

In step S607, the acquired number of elements (annotation number) is added to the comment field 1603 (corresponding to input information addition processing). An added example is 1605 in FIG. That is, this is a step showing an example of input information display control (addition) processing for displaying input information (text) corresponding to identification information (number) when an annotation is displayed. Further, it is a process of automatically displaying identification information corresponding to an annotation in an area where text can be input in accordance with the addition of the annotation in order to input a comment on the annotation.
Further, the character string input by the keyboard is displayed in the added comment field in accordance with the user operation.

  In this embodiment, the annotation number is displayed in one comment field (text box). However, each time an annotation is added, a text box (input field) corresponding to the annotation is additionally displayed. Also good.

  In this embodiment, the annotation is displayed on the image, the annotation number object corresponding to the annotation is displayed on the image, and the annotation number text is displayed. However, after displaying the annotation, the annotation number is displayed on the text. After the display, a procedure for displaying the object of the annotation number on the image may be used. That is, as a result, if the annotation, the annotation number, and the text can be input, the processing procedure is not limited.

Next, image storage processing in the embodiment of the present invention will be described with reference to FIG. FIG. 6 is a flowchart of the image storage process. Note that the image storage process is executed when an annotation is added.
In step S1001, pressing of the save button is detected (button 1606).

In step S1002, all the elements of the annotation array (for example, FIG. 17) are converted (serialized) into JSON format annotation information. Specifically, for example, it is executed by using API “JSON.Stringify ()” of JavaScript. The annotation array holds the annotation line type (standard line thickness, type such as a circle).
In step S1003, the text (memo) in the text box that is a comment field is acquired and converted into the JSON format (serialized).

  In step S1004, the original image displayed on the canvas of the browser and the annotation drawn on the layer are combined to create a new image (edited image).

  Specifically, an edited image is created by executing the HTML5 canvas API “toDataURL ()”. By executing this function, a base64 encoded character string of the edited image can be acquired.

  FIG. 18 shows an example of the data transition stored by this storage. An example when an annotation is added is 1801. An example when a memo is added is 1802. An example of the case where the edited image is generated and saved is 1803, in which the edited image file path is registered.

  Note that, as indicated by reference numeral 1410 in FIG. 14, the annotation line type (standard line thickness, type such as a circle) is stored in the serialized annotation 1403 of the edited image information table 1410. As an item different from 1403, the annotation line type (standard line thickness, type such as a circle) may be stored.

  Next, display processing of an image editing example in the embodiment of the present invention will be described with reference to FIG. FIG. 7 is a flowchart of display processing of an image editing example.

In step S701, designation of a part is accepted in 901. The part name is a list of data of the part list 1430, and the part ID can be specified from the part name. On the screen, since the data read from the part list 1430 is held in the client terminal 100, the part ID can be specified.
In step S <b> 702, the part ID of the part specified in 901 is transmitted to the Web server 200.
In step S703, the part ID is received from the client terminal 100.

In step S704, an acquisition request including a part ID is acquired in order to obtain the top five edited images that are “an image with a high total evaluation score and an image that is equal to or higher than a certain point” among the edited images corresponding to the received part ID. Transmit to the DB server 300. For example, it is assumed that an SQL sentence is issued. The acquisition request condition is a partial ID, or a preset number or more (may be the top five). It is sufficient if images with high evaluation can be acquired, but if there are no five images above a certain evaluation, the number may be three or zero.

  In step S705, the original image ID (for example, 1402) is acquired from the edited image information table (1410 in FIG. 14) according to the part ID included in the acquisition request received from the Web server 200.

  In step S706, an original image file path (for example, 1401) is acquired from the original image information table (1400 in FIG. 14) according to the acquired original image ID.

  In step S707, the acquired original image file path is transmitted to the Web server 200. In this embodiment, an original image is used, and an edited image is generated from the original image and displayed on the client terminal 100. However, the edited image is acquired from the edited image information table (1410 in FIG. 14) and displayed. It may be.

  In step S708, annotation information is acquired from the edited image information table (1410 in FIG. 14) and memo information is acquired from the original image information table (1400 in FIG. 14) according to the edited image ID or original image ID.

In this embodiment, the annotation information and the memo information are managed in different tables. For example, the annotation information and the memo information are stored in the edited image information table (1410 in FIG. 14). It may be configured to be kept. In this case, annotation information and memo information are acquired from the edited image information table (1410 in FIG. 14).
In step S709, the acquired annotation information and memo information are transmitted to the Web server 200.
In step S710, the original image file path, annotation information, and memo information are received from the DB server 300.

In step S711, the original image (including the original image ID) stored in the external memory (HDD or the like) of the Web server 200 is acquired according to the original image file path.
In step S712, the acquired original image, annotation information, and memo information are transmitted to the client terminal 100.

Note that the annotation information and the memo information are JSON models. It should be noted that the conversion to the JavaScript (registered trademark) object format is executed by the client terminal 100. For example, JSON. This can be realized by using a parse function.
In step S 713, the original image, annotation information, and memo information are received from the Web server 200. Annotation information is stored on the RAM.
That is, an example of processing for acquiring an image list of edited images is shown.

  Since the annotation function stores the drawing function and the drawing parameter, the annotation information is deserialized and the annotation is sequentially displayed on the original image using the drawing function and the drawing parameter.

  In step S714, the received original image is displayed using a browser. The original image is displayed on, for example, HTML5 Canvas. An annotation can be drawn on the upper layer of the image displayed on the canvas.

  In the present embodiment, an image with annotation added is generated on the client terminal 100 and displayed on the browser. However, an image with annotation added on the Web server is generated and displayed on the client terminal 100. Also good. The image may be a thumbnail image. A list of thumbnail images is displayed in 903. That is, an example of display processing for displaying the image list acquired in step S13 is shown.

  In step S715, it is determined in step 902 whether a line type, thickness, or color has been selected. If the line type / thickness / color is selected, the process proceeds to step S716. If the line type / thickness / color is not selected, the process proceeds to step S727. Actually, the part ID and annotation information (line type and thickness) are transmitted to the Web server 200. That is, an example of attribute selection processing for selecting annotation attributes is shown.

  In step S716, among the edited images corresponding to the received part ID, an edited image that is “an image having the annotation information selected in step S715” and “an image having a high evaluation total score and an image having a certain score or more” is selected. In order to acquire the top five, an acquisition request including the part ID and annotation information is transmitted to the DB server 300. For example, it is assumed that an SQL sentence is issued. The conditions are, for example, the annotation information of the part ID, the thickness of the selected line, and the type.

  In step S717, the original image ID (for example, 1402) is acquired from the edited image information table (FIG. 14) according to the part ID and annotation information included in the acquisition request received from the Web server 200.

In step S718, an original image file path (for example, 1401) is acquired from the original image information table (FIG. 14) according to the acquired original image ID.
In step S719, the acquired original image file path is transmitted to the Web server 200.
In step S720, annotation information and memo information are acquired according to the original image ID.
In step S721, the acquired annotation information and memo information are transmitted to the Web server 200.
In step S722, the original image file path, annotation information, and memo information are received from the DB server 300.

In step S723, the original image (including the original image ID) stored in the external memory (HDD or the like) is acquired according to the original image file path.
In step S724, the acquired original image, annotation information, and memo information are transmitted to the client terminal 100.

  Note that the annotation information and the memo information are JSON models. It should be noted that the conversion to the JavaScript (registered trademark) object format is executed by the client terminal 100. For example, JSON. This can be realized by using a parse function.

  In step S725, the original image, annotation information, and memo information are received from the Web server 200. Annotation information is stored on the RAM. That is, an example of processing for acquiring an image list of edited images is shown. In addition, when an attribute is selected, an example of processing for obtaining a list of edited images having annotations of the selected attribute is shown.

  Since the annotation function stores the drawing function and the drawing parameter, the annotation information is deserialized and the annotation is sequentially displayed on the original image using the drawing function and the drawing parameter.

In step S726, the received original image is displayed using a browser. The original image is displayed on, for example, HTML5 Canvas. An annotation can be drawn on the upper layer of the image displayed on the canvas. This drawn image is an edited image, which may be a thumbnail image.
Note that steps S725 and S726 are the same processes as steps S713 to S714, and hold information on the line type and thickness for the image.

In step S727, it is determined whether an editing example is selected (edited image selection) in 903. If an editing example is selected, the process proceeds to step S728. If no editing example is selected, the process ends. That is, an example of an edited image selection process for selecting an edited image to be referred to from the image list is shown.
In step S728, the original image ID of the image specified in 903 is transmitted to the Web server 200.
In step S729, the original image ID is received from the client terminal 100.

  In step S730, an acquisition request including the original image ID is transmitted to the DB server 300 in order to acquire annotation information corresponding to the received original image ID.

In step S731, annotation information (eg, 1403) is acquired from the edited image information table (FIG. 14) in accordance with the original image ID included in the acquisition request received from the Web server 200. The annotation information includes the annotation line type (standard line thickness, circle type, etc.).
In step S732, the acquired annotation information is transmitted to the Web server 200.
In step S733, the annotation information transmitted by the DB server 300 is received.
In step S734, the acquired annotation information is transmitted to the client terminal 100.
In step S735, the annotation information transmitted by the Web server 200 is received.

  In step S736, based on the received annotation information, the corresponding selection item “line type / thickness / color selected (for example, 1001, 1002, 1003)” in FIG. 10 is set to a selected state (default setting). That is, the annotation attribute used for the edited image is set for each annotation attribute item used for editing. By selecting an editing example with a higher evaluation than this, the user can easily use the annotation with the higher evaluation, and the editing efficiency of the image is improved.

In step S737, it is determined in step 904 whether "Reflect comments to comment field" has been selected. If “reflect comments to comment column” 1005 is selected (checked), the process proceeds to step S738. If no editing example is selected, the process ends. As a result, highly rated comments can be used, and input is made more efficient. Furthermore, confirmation on the confirmation side such as a non-life insurance company becomes easy.
In step S738, the original image ID of the image specified in step S728 903 is transmitted to the Web server 200.
In step S739, the original image ID is received from the client terminal 100.
In step S740, an acquisition request including the original image ID is transmitted to the DB server 300 in order to acquire memo information corresponding to the received original image ID.

In step S741, memo information (for example, 1404) is acquired from the original image information table (1400 in FIG. 14) according to the original image ID included in the acquisition request received from the Web server 200.
In step S742, the acquired memo information is transmitted to the Web server 200.
In step S743, the memo information transmitted by the DB server 300 is received.
In step S744, the acquired memo information is transmitted to the client terminal 100.
In step S745, the memo information transmitted by the Web server 200 is received.
In step S746, the comment is displayed in the comment field based on the received memo information (for example, 1004).

Next, ranking display processing in the embodiment of the present invention will be described with reference to FIG. FIG. 7 is a flowchart of the ranking display process. The ranking display is performed by selecting the ranking display from the main menu. In addition, the structure which can display a ranking from the screen of FIG.9 and FIG.15 may be sufficient.
In step S801, a ranking menu list (national ranking, factory ranking, site-specific ranking) is displayed on the ranking menu screen.

  In step S802, it is determined which menu has been selected on the ranking menu screen. If the national ranking is selected, the process proceeds to step S803. If the factory ranking is selected, the process proceeds to step S804. If the site-specific ranking is selected, the process proceeds to step S805.

  In step S803, an acquisition request is transmitted to the DB server 300 in order to acquire the top three images having the highest total evaluation score among all the edited images. For example, it is assumed that an SQL sentence is issued.

In step S804, an acquisition request including the factory ID is transmitted to the DB server 300 in order to acquire the top three images having the highest total evaluation score among the edited images edited by the own factory user. For example, it is assumed that an SQL sentence is issued.
In step S805, a part designation is received on the ranking screen as indicated by reference numeral 901 in FIG.
In step S806, the part ID of the designated part is transmitted to the Web server 200.
In step S807, the part ID is received from the client terminal 100.

In step S808, an acquisition request including the part ID is transmitted to the DB server 300 in order to acquire the top three images having the highest evaluation total score among the edited images corresponding to the received part ID. For example, it is assumed that an SQL sentence is issued.

  In step S809, the original image ID (for example, 1402) is acquired from the edited image information table (1410 in FIG. 14) according to the acquisition request received from the Web server 200.

In step S810, an original image file path (for example, 1401) is acquired from the original image information table (1400 in FIG. 14) according to the acquired original image ID.
In step S811, the acquired original image file path is transmitted to the Web server 200.
In step S812, annotation information and memo information are acquired according to the original image ID.
In step S813, the acquired annotation information and memo information are transmitted to the Web server 200.
In step S814, the original image file path, annotation information, and memo information are received from the DB server 300.

  In step S815, the original image (including the original image ID) stored in the external memory (HDD or the like) is acquired according to the original image file path.

  In step S816, the acquired original image, annotation information, and memo information are transmitted to the client terminal 100. That is, this is a step showing an example of image transmission processing for transmitting an image.

  Note that the annotation information and the memo information are JSON models. It should be noted that the conversion to the JavaScript (registered trademark) object format is executed by the client terminal 100. For example, JSON. This can be realized by using a parse function.

  In step S817, the original image, annotation information, and memo information are received from the Web server 200. Annotation information is stored on the RAM. Since the annotation function stores the drawing function and the drawing parameter, the annotation information is deserialized and the annotation is sequentially displayed on the original image using the drawing function and the drawing parameter.

  In step S818, the received original image is displayed using a browser. The original image is displayed on, for example, HTML5 Canvas. An annotation can be drawn on the upper layer of the image displayed on the canvas. In addition, when displaying an image with high evaluation in a factory, it may be a thumbnail image as described above.

  Here, FIG. 9 will be described. FIG. 9 is a diagram illustrating an example of an image editing screen of the client terminal 100. The image editing screen is displayed using a browser, and an image editing example is displayed in 903. By selecting a part in 901, an image having a high evaluation total score and an editing example having a certain number of points or more are displayed among the selected parts. In addition, by selecting the type, thickness, and color of the line in 902, an image with a high evaluation total score, an editing example with a certain number of points or more, and an editing example in which the selected editing is performed among the selected parts. Can be displayed.

  When the factory user selects an editing example from 903, the type, thickness, and color of the line used in the selected editing example are automatically set. If the “Reflect comments to comment column” check box is checked, the comments used in the editing example are reflected to the comment column.

  Similarly, FIG. 10 is a diagram illustrating an example of the image editing screen of the client terminal 100, and FIG. 10 is a diagram illustrating a state after the editing example is selected in FIG. When the factory user selects an editing example from 903, the line type, thickness, and color used in the selected editing example such as 1001, 1002, and 1003 are automatically selected. If the “Reflect comments in comment column” check box is checked, the comment used in the editing example is reflected in the comment column as 1004.

  FIG. 11 will be described. FIG. 11 is a diagram illustrating an example of a feedback screen of the client terminal 401. The feedback screen is displayed using a browser. An edited image is displayed in 1103 and a comment is displayed in 1104. The user selects an edit to be evaluated at 1105 and performs evaluation at 1101. After the evaluation is completed, 1102 is pressed.

  FIG. 12 will be described. FIG. 12 is a diagram illustrating an example of a feedback result screen of the client terminal 100. The feedback result screen is displayed using a browser. An edited image is displayed at 1201 and a comment is displayed at 1202. In 1203, an evaluation and feedback comment by the user of the client terminal 401 are displayed.

  FIG. 13 will be described. FIG. 13 is a diagram illustrating an example of a ranking screen of the client terminal 100.

  FIG. 14 will be described. FIG. 14 is a diagram illustrating an example of data stored in the DB server 300. An original image information table 1400, an edited image information table 1410, a feedback table 1420, a part list 1430, and repair (accident) item information 1440 are stored.

  In the present embodiment, the image is stored in the Web server 200. However, the DB server 300 may be integrated with the Web server 200 and various data may be managed by the Web server 200.

  Here, FIG. 15 will be described. FIG. 15 is a diagram illustrating an example of an image list display screen of the client terminal 100. The image list display screen is displayed using a browser, and thumbnail images of original images registered in 1500 are displayed. In addition, a desired image can be registered by dragging and dropping an image on the client terminal 100.

  Reference numeral 1501 denotes a frame when an image to be edited is designated. Reference numeral 1502 denotes a mark indicating that the image is edited (annotation is added). When transmitting the thumbnail image, the Web server 200 checks that annotation information is stored in the serialized annotation 1202 in FIG. 12, adds a mark, and transmits it to the client terminal 100. Reference numeral 1503 denotes an edit button. When an image is selected in 1501 and the edit button is pressed, the image is displayed. An editing example is shown in FIG. Examples of editing showing the features of this embodiment are shown in FIGS.

  FIG. 16 will be described. FIG. 16 shows an example of editing, which shows an example before and after adding an annotation. When the annotation 1604 is designated, a character string 1605 is automatically inserted in the comment field.

  The functional configuration of this embodiment will be described. The client terminal 100 includes the following functional units.

  An acquisition unit that acquires an image list of edit images, a display unit that displays an image list acquired by the acquisition unit, an edit image selection unit that selects an edit image to be referred to from the image list, and an edit image selected by the edit image selection unit An adder that adds annotations on the image to be edited using the annotation attributes used.

  In addition, a setting unit that sets an annotation attribute used for editing using the annotation attribute used for the edited image and an attribute selection unit that selects an annotation attribute by the user are provided.

  The acquisition unit according to claim 1 or 2, wherein, when an attribute is selected by the attribute selection unit, the acquisition unit acquires a list of edited images having annotations of the selected attribute. Information processing device.

  As described above, according to the present embodiment, it is possible to support input of instruction content (input content) related to an image using an image. Specifically, a list of images as editing examples is displayed, and when the user selects, annotation setting is automatically performed according to the annotation information associated with the selected image, and annotations according to the editing examples are used. Instruction contents can be input, and efficient input can be supported.

  In addition, annotations and comments can be input at once, and instructions relating to images can be easily input. In particular, since the annotation number and the comment number are automatically assigned, the input efficiency is improved.

Furthermore, it is possible to add an annotation to an image displayed on the browser and edit the image directly without using a plug-in such as ActiveX. Then, by saving the edited image as a new image on the server, the edited image can be easily referred to. It is also possible to enter and save a memo for the image in conjunction with the annotation, and it is possible to easily give an instruction using the image.
It should be noted that the configuration and contents of the various data described above are not limited to this, and it goes without saying that the various data and configurations are configured according to the application and purpose.

  Although one embodiment has been described above, the present invention can take an embodiment as, for example, a system, apparatus, method, program, or recording medium, and specifically includes a plurality of devices. The present invention may be applied to a system including a single device.

  The program according to the present invention is a program that allows a computer to execute the processing methods of the flowcharts shown in FIGS. 4 to 8. The storage medium according to the present invention is a program that allows the computer to execute the processing methods of FIGS. Is remembered. The program in the present invention may be a program for each processing method of each apparatus in FIGS.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by executing the reading.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk, solid state drive, or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. It goes without saying that the present invention can also be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention.
In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

DESCRIPTION OF SYMBOLS 100 Client terminal 200 Web server 300 DB server 400 File server 401 Client terminal (reference terminal)

Claims (10)

An information processing apparatus capable of acquiring an edited image and an attribute of an annotation corresponding to the edited image,
Display means for displaying a plurality of the edited images in a viewable manner;
A designation receiving means for receiving a designation corresponding to an edited image to be referred to from a plurality of edited images displayed by the display means ;
An attribute acquisition unit that acquires the attributes of the annotation corresponding to the edited image received designation by said designation receiving means,
An information processing apparatus comprising: an adding unit that adds an annotation to an editing destination image using the annotation attribute acquired by the attribute acquiring unit . Using an annotation attribute acquired by the attribute acquisition means , further comprising a setting means for setting on the attribute setting screen of the annotation to be added to the editing destination image ;
It said additional means, in accordance with the set attribute to the attribute setting screen by the setting unit, the information processing apparatus according to claim 1, characterized in adding annotations to the edit destination image according to a user operation. A site selection means for selecting a site;
First edited image obtaining means for obtaining an edited image corresponding to the part selected by the part selecting means;
Further comprising
The information processing apparatus according to claim 1, wherein the display unit displays the edited image acquired by the first edited image acquisition unit so as to allow browsing. And attribute selection means for selecting the attributes of the annotation,
A second edited image acquiring means for acquiring the edited image edited by selected been attributes of the annotation by pre Symbol attribute selecting means
Further comprising
The display means, the information processing apparatus according to any one of claims 1 to 3, characterized in that visible for displaying the edited image acquired by the second edited image acquisition unit. Before Symbol editing image is attached corresponds to the evaluation information,
The display means, the information processing apparatus according to any one of claims 1 to 4, characterized in that visible for displaying the edited image in accordance with the evaluation information. The edited image is associated with comment information,
Information according to any one of claims 1 to 5, characterized in that further Ru comprising an input means <br/> for input based on comment information corresponding to the edited image received designation by said designation receiving means Processing equipment. An information processing system including a management apparatus and an information processing apparatus for managing the attributes of the annotation corresponding to the edited edited image and the edited image,
The management device
According to a request from the previous SL information processing apparatus, and transmission means for transmitting the attributes of the annotation corresponding to the editing image and the edited image,
The information processing apparatus includes:
Receiving means for receiving the attribute of the edited image and the annotation from the management device;
Display means for displaying the plurality of edited images received by the receiving means so as to be viewable;
A designation receiving means for receiving a designation corresponding to an edited image to be referred to from a plurality of edited images displayed by the display means ;
An attribute acquisition unit that acquires the attributes of the annotation corresponding to the edited image received designation by said designation receiving means,
An information processing system comprising: an adding unit that adds an annotation to an editing destination image using the annotation attribute acquired by the attribute acquiring unit . An information processing apparatus processing method capable of acquiring an edited image by adding an annotation and an attribute of the annotation used in the edited image,
A display step of displaying a plurality of the edited images so as to be viewable;
A designation receiving step for receiving a designation corresponding to an edited image to be referred to from a plurality of edited images displayed in the display step ;
An attribute acquisition step of acquiring the attribute of the annotation corresponding to the edited image whose specification has been received by the specification reception step ;
And a step of adding an annotation to the editing destination image using the annotation attribute acquired in the attribute acquisition step . A processing method for an information processing system including a management apparatus and an information processing apparatus for managing the attributes of the annotation corresponding to the edited edited image and the edited image,
The management device
According to a request from the previous SL information processing apparatus, and a transmission step of transmitting the attribute of the annotation corresponding to the editing image and the edited image,
The information processing apparatus includes:
A receiving step of receiving the attribute of the edited image and the annotation from the management device;
A display step of displaying a plurality of the edited images received in the reception step so as to be viewable;
A designation receiving step for receiving a designation corresponding to an edited image to be referred to from a plurality of edited images displayed in the display step ;
An attribute acquisition step of acquiring the attribute of the annotation corresponding to the edited image whose specification has been received by the specification reception step ;
And a step of adding an annotation to the editing destination image using the annotation attribute acquired in the attribute acquisition step . An information processing apparatus program capable of acquiring an edited image and an attribute of an annotation corresponding to the edited image,
The information processing apparatus;
Display means for displaying a plurality of the edited images in a viewable manner;
A designation receiving means for receiving a designation corresponding to an edited image to be referred to from a plurality of edited images displayed by the display means ;
An attribute acquisition unit that acquires the attributes of the annotation corresponding to the edited image received designation by said designation receiving means,
A program for causing an annotation attribute acquired by the attribute acquisition means to function as an adding means for adding an annotation to an editing destination image.

Images