JP2008098768A - Image processing program, image processing method and image processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide image processing technology for surely protecting security and privacy when image processing data are transferred between a server and a terminal connected to a network such as the Internet. <P>SOLUTION: A computer executes steps of: generating a plurality of partial data 41a to 41d by dividing image data 40; generating position information indicative of a position relationship between the partial data 41a to 41d and other parts 41a to 41d; making identification information related to the position information; imparting the identification information to the partial data 41a to 41d; and transmitting the partial data 41a to 41d imparted with the identification information to the server 10. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image processing program, an image processing method, and an image processing system.

  Conventionally, there has been proposed an image processing technique in which image data or video data is transmitted from a client terminal to a server via the Internet, and image data or video data subjected to predetermined image processing by the server is received by the client terminal. (For example, refer to Patent Documents 1 to 5.)

  Recently, in addition to image processing, various software functions are disclosed on the Internet, and services that can be used by a web browser on a terminal connected to the Internet have been provided.

  Software functions provided by these services include a software function called an office suite in which a word processor, spreadsheet, presentation, and the like are set.

Conventionally, when image processing is performed via a network such as the Internet, it is common to protect security and privacy by performing encryption on a data communication path or data encryption on a file system. Met.
JP 2005-267129 A JP 11-1112569 A JP 2006-115001 A Japanese Patent Laid-Open No. 2001-14806 JP 2004-13387 A

  However, in the conventional technology that performs image processing using a server connected to a network such as the Internet, image data sent from the client terminal to the server may be viewed and used without permission by the server administrator or a third party. was there. In this case, there is a risk that security and privacy relating to image data may be violated.

  The present invention has been made in view of such problems, and provides an image processing technique capable of reliably protecting security and privacy when transmitting / receiving image processing data between a server and a terminal connected to a network such as the Internet. Is an issue.

The present invention employs the following means in order to solve the above problems.
That is, the present invention
Image data or video data is transmitted to a server having an image processing function via a network, and is executed by a computer that receives the image data, the video data, or other processing results subjected to predetermined image processing from the server. An image processing program,
Dividing the image data or the video data to generate a plurality of partial data;
Generating position information indicating a positional relationship with the other partial data in the partial data;
Associating identification information with the location information;
Giving the identification information to the partial data;
Transmitting the partial data provided with the identification information to the server via the network;
Is executed.

  In the present invention, image data or video data is divided to create a plurality of partial data, and identification information is associated with position information of each partial data. Each partial data is given identification information and transmitted to the image processing server.

  Accordingly, since the image processing server cannot recognize the image data or the video data as a whole, security and privacy can be surely protected. Note that the image processing includes video processing.

Here, from the server, receiving the partial data subjected to the predetermined image processing from the server via the network;
Obtaining the position information of the partial data from the identification information included in the received partial data;
Combining the partial data based on the position information to generate the image data, the video data or other processing results;
Can be further executed.

  Thus, by combining the image-processed partial data received from the server at the client terminal to generate image data, video data, or other processing results, security and privacy protection for the server side can be ensured. Become.

  In the step of transmitting the partial data, the partial data is preferably transmitted at random. Thereby, the protection of security and privacy becomes stronger.

The present invention also provides:
This is executed by a computer that transmits image data or video data to a server having an image processing function via a network, and receives the image data, video data, or other processing results subjected to predetermined image processing from the server. An image processing method comprising:
Dividing the image data or the video data to generate a plurality of partial data;
Generating position information indicating a positional relationship with the other partial data in the partial data;
Associating identification information with the location information;
Giving the identification information to the partial data;
Transmitting the partial data provided with the identification information to the server via the network;
Execute.

The present invention also provides:
An image processing system that transmits image data or video data to a server having an image processing function via a network and receives the image data, the video data, or other processing results subjected to predetermined image processing from the server. There,
Means for dividing the image data or the video data to generate a plurality of partial data;
Means for generating position information indicating a positional relationship with the other partial data in the partial data;
Means for associating identification information with the location information;
Means for giving the identification information to the partial data;
Means for transmitting the partial data provided with the identification information to the server via the network;
Is provided.

  Further, the present invention may be a program in which a computer or other device, machine, or the like realizes any one of the functions described above is recorded on a computer-readable recording medium.

  Here, the computer-readable recording medium refers to a recording medium that accumulates information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read from the computer. .

  Examples of such a recording medium that can be removed from the computer include a flexible disk, a magneto-optical disk, a CD-ROM, a CD-R / W, a DVD, a DAT, an 8 mm tape, and a memory card.

  Further, there are a hard disk, a ROM (read only memory), and the like as a recording medium fixed to the computer.

  According to the present invention, image data or video data is divided to generate a plurality of partial data, and identification information associated with the position information is assigned to each partial data and transmitted to the server.

  Accordingly, it is difficult for the other terminal connected to the server side or the network to recognize the entire image data or video data, and security and privacy can be reliably protected.

  Hereinafter, an image processing program, an image processing method, and an image processing system according to the present invention will be described in detail with reference to FIGS. In the following description, it is assumed that image processing includes video processing.

<First Embodiment>
FIG. 1 shows an image processing system 1 according to the first embodiment of the present invention. The image processing system 1 includes a server 10 having a plurality of image processing functions, and a client terminal 12 that is a computer connected to the server 10 via a network 11 such as the Internet.

  The server 10 includes a transmission / reception unit 21 and an image processing unit 22 that performs predetermined image processing. As will be described later, the server 10 performs predetermined image processing on the partial data 41a to 41d (see FIG. 2) received from the client terminal 12, and then transmits the data to the client terminal 12. At this time, the ID (identification information) included in the partial data is transmitted as it is included in the partial data.

  The predetermined processing performed by the image processing unit 22 includes the following processing. General image processing by an operator includes blurring, sharpening, edge extraction, mosaic processing, embossing, and division processing with a margin according to the operator size.

  Further, as the color conversion processing, there is conversion processing performed by specifying threshold values and reference values as parameters, such as two-gradation, graying, color reduction / color increase, channel separation, and color space conversion.

  Further, scale conversion processing includes enlargement and reduction. Further, the recognition processing includes character recognition, voice recognition, and the like.

  In addition, as an application process for improving security, there is a process of rotating or inverting an image to send it to the server after not knowing its orientation, and a process of changing the shape of the image division (in units of lines, circles, triangles, etc. in addition to rectangles) is there. Video (moving image) processing includes cut detection, CM (Commercial Message) detection, and the like.

  In addition, since the above-mentioned various image processes are generally performed, the detailed description about the content and the structure for achieving this is abbreviate | omitted.

  The client terminal 12 includes a processing range specifying unit 31, a division processing unit 32 as a unit for generating partial data, an ID adding unit 33 as a unit for adding identification information to the partial data, a unit for generating position information of the partial data, and ID / position information associating section 34 as means for associating position information and identification information, storage section 35, reconstruction section 36 as means for generating image data by reconstructing (recombining) the received partial data, display A unit 37 and a transmission / reception unit 38 are provided.

  When the data to be subjected to image processing is image data, the processing range designation unit 31 designates a processing range to be subjected to predetermined image processing. When the data to be subjected to image processing is video data, the time range to be subjected to image processing is designated.

  The processing range designation unit 31 allows the user to designate a processing range of image data or a time range of video data through a user interface, or automatically designates a processing range or a time range.

  The division processing unit 32 divides the image data processing range or the video data time range specified by the processing range specifying unit 31 to generate a plurality of partial data. The size of the partial data may be automatically determined or specified by the user.

  The partial data preferably includes a portion that overlaps an adjacent portion, that is, a redundant portion. As described above, when a redundant portion is included in the partial data, the redundant portion is removed when the partial data subjected to the image processing by the server 10 is recombined by the client terminal 12.

  When the processing range of image data or the time range of video data is divided, the processing range or time range is displayed over the original image data or video data. Thereby, the user can confirm and change the division size.

  The ID assigning unit 33 assigns a unique ID (identification information) to the part generated by the division processing unit 32. This ID can be embedded as a comment in the part or embedded in a file name or the like.

  The ID / position information associating unit 34 generates position information indicating a positional relationship between each partial data and other partial data. Further, each ID is associated with position information. The storage unit 35 also stores association information between the ID and the position information.

The reconstruction unit 36 includes an ID included in the image-processed partial data received from the server 10.
And the position information corresponding to this ID is stored in the storage unit 35 as the ID / position.
It is obtained from the position information related table.

  Then, each partial data is reconfigured (recombined) based on the position information. Thus, image data or video data subjected to image processing is configured.

  The display unit 37 displays image data or video data before or after image processing, partial data before or after image processing, and the like.

  The transmission / reception unit 38 transmits the partial data to the server 10. Also, the image-processed partial data transmitted from the server 10 is received.

  The transmission / reception unit 38 automatically selects a predetermined server 10 from among the plurality of servers 10, or the user designates the server 10 to transmit / receive partial data. Here, the partial data is distributed and transmitted to the plurality of servers 10 without concentrating and transmitting the partial data to one server 10.

  Moreover, when transmitting partial data to the server 10, it transmits at random so that the spatial arrangement of partial data may not continue.

  Thus, even if the received partial data is arranged in the order of reception on the server 10 side or another terminal side connected on the network 11, the original image data or video data cannot be reproduced. Therefore, security and privacy protection are more reliable.

  Next, an image processing method by the image processing system 1 will be described. Here, a case where predetermined image processing is performed on the image data will be described.

  First, as shown in FIG. 2, a processing range 41 to be subjected to image processing is designated in the image data 40 by the client terminal 12.

  Next, the processing range 41 is divided to generate a plurality of partial data 41a to 41d. In FIG. 2, for ease of explanation, the case where the processing range 41 is divided into four parts is shown. However, as the number of divisions increases and the area of partial data decreases, security and privacy protection are ensured. .

  As shown in FIG. 3, the partial data 41 a to 41 d include redundant portions 43 and 44. In the present embodiment, each of the partial data 41a to 41d includes a part of the adjacent partial data 41a to 41d as the redundant portions 43 and 44.

  For example, in the partial data 41a, as shown in FIG. 4, a real region 42 having an area obtained by dividing the processing range 41 of the image data 40 into four equal parts and a portion near the boundary between the adjacent partial data 41b, 41c, and 41d are included. Redundant portions 43, 44, 45 are included.

  Similarly, the partial data 41b includes a real area 42 and redundant portions 43, 44, and 45 as shown in FIG. The same applies to the other partial data 41c and 41d.

  Simply by performing predetermined image processing on each divided partial data and then combining the partial data, a discontinuous portion is generated at the divided boundary portion.

In order to avoid this, the processing is performed in a redundant manner so as to overlap spatially, and when the result is reconstructed, the edge portion is not used.

  For example, when blurring a region of 5 pixels × 5 pixels, information for two pixels around the target pixel is used. Therefore, when the image is divided, image processing is performed with a margin of 2 pixels around the area actually required. When reconstructing the result, the information for the surrounding two pixels is discarded.

  Next, a different unique ID is assigned to each of the partial data 41a to 41d. This ID is irregular and difficult for a third party to guess.

  The position information of the partial data 41a to 41d is associated with the ID assigned to each partial data 41a to 41d. This position information indicates the relative positional relationship between the partial data 41a to 41d and the other partial data 41a to 41d.

  As shown in FIG. 2, after the partial data 41 a to 41 d are generated, the partial data 41 a to 41 d are distributed and transmitted to the plurality of servers 10 via the network 11. At this time, the partial data 41a to 41d are transmitted in a random transmission order.

  Further, the server 10 to which the partial data 41a to 41d is transmitted is automatically selected. Further, for example, the server 10 having a high processing speed can be selected by the user.

  After transmitting the partial data 41a to 41d, the client terminal 12 waits until the partial data 41a to 41d subjected to image processing is returned from the server 10.

  In this case, it is possible to perform management such as setting a timeout time and requesting the server 10 to process again when the timeout time is exceeded.

  In the server 10, if the received data includes parameters related to image processing (for example, information indicating the type of processing, filter size, etc.), these are confirmed. The ID included in the partial data 41a to 41d is also confirmed and saved for return. Then, predetermined image processing is performed on the partial data 41a to 41d.

  Next, the partial data 41a to 41d subjected to the image processing is transmitted to the client terminal 12 (see the solid line arrow in FIG. 2). At this time, the IDs included in the partial data 41a to 41d are transmitted as they are.

  The client terminal 12 receives the partial data 41a to 41d on which image processing has been performed from the server 10 (see broken line arrows in FIG. 2). Next, the position information is obtained based on the ID included in each of the partial data 41a to 41d.

  Next, the partial data 41a to 41d are reconstructed (recombined) based on the position information, and image data of the processing range 41 is generated. This image data looks as if predetermined image processing has been performed as integrated image data. This image data is displayed on the display unit 37.

  FIG. 6 shows a processing flow of the client terminal 12. Here, first, a processing range is designated (S1).

Next, the division size is confirmed (S2). Next, ID is given to each partial data (S3). Next, position information of partial data is associated with each ID (S4). Next, the partial data is transmitted to the server (S5).

  Next, partial data is received from the server, and it is determined whether all partial data have been returned (S6). If it is determined that all the partial data has been returned, the partial data are then recombined to generate image data (S7). Next, image data is displayed (S9). This completes the process.

  If it is determined in step (S6) that all partial data has not been returned, it is next determined whether or not a timeout has occurred (S9).

  Here, if it is determined that a timeout has occurred, then the partial data is retransmitted (S10). Next, the process after step (S6) is performed. If it is determined in step (S9) that the time-out has not occurred, the processing after step (S6) is performed.

  FIG. 7 shows a processing flow of the server 10. Here, first, partial data and the like are received (S21).

  Next, the parameters are confirmed (S22). Next, predetermined image processing is performed on each received partial data (S23). Next, the partial data subjected to the image processing is transmitted to the client terminal (S24). Thereby, the process ends.

  Thus, according to the image processing system 1 of the present invention, the processing range 41 of the image data 40 is divided to generate a plurality of partial data 41 a to 41 d, and these partial data 41 a to 41 d are transmitted to the server 10. The

  Therefore, it becomes difficult to reproduce the original image on the server 10 side or another terminal side connected to the network 11, and information leakage can be prevented.

  For example, when there is one server 10, the partial data 41a to 41d are transmitted randomly in terms of time and space. Therefore, even if all the partial data 41a to 41d are received by one server 10, it is difficult to reproduce the original image.

  Further, when there are a plurality of servers 10, the partial data 41a to 41d are distributed and transmitted to the plurality of servers 10. As a result, only a part of the partial data is transmitted to one server 10, so that it is difficult to reproduce the original image.

  For these reasons, according to the image processing system 1 of the present invention, security and privacy can be reliably protected for image data.

  Further, since the processing range 41 of the image data 40 is divided into partial data 41a to 41d and the image processing is distributed and processed by the plurality of servers 10, the time required for the image processing can be shortened.

  The processing on the client terminal 12 side can be made available on the web browser. As a result, software necessary for processing on the client terminal 12 side can be used without being installed. In this case, for example, processing on the client terminal 12 side is implemented using Java (registered trademark) script or the like.

For example, if a filtering process is performed on the entire image without specifying a processing range for the image data 40, the client side only needs to have a division function and a reconstruction function. Further, the communication path is not particularly limited, and for example, transmission / reception may be performed by attaching to a mail.

<Second Embodiment>
FIG. 8 shows a case where character recognition processing is performed. Here, the character strings 50a to 50c in the image data 50 are recognized.

  In the client terminal 12, the image data 50 is divided to generate partial data 51a to 51c. In the present embodiment, the character strings 50a to 50c are divided for each line.

  Each partial data 51a to 51c is given an ID associated with the position information. Next, these partial data 51 a to 51 c are randomly transmitted to the server 10.

  The server 10 recognizes the character strings 50a to 50c in the partial data 51a to 51c, and generates text data 52a to 52c. Next, the text data 52 a to 52 c is transmitted to the client terminal 12.

  In the client terminal 12, the position information of the text data 52a to 52c is obtained from the ID of the received text data 52a to 52c. Then, based on the position information, the text data 52a to 52c are rearranged to form a sentence 53. That is, image data is transmitted from the client terminal 12, but text data is returned from the server 10.

  Here, there is a problem in putting the entire document out, but if it is possible to go out if it is a short sentence unit that does not make sense even if it is leaked, the text is converted into a short sentence unit. FIG. 8 shows a case where the data is divided in units of rows, but can be divided in smaller units.

<Third Embodiment>
FIG. 9 illustrates a case where the scene change position 65 of the moving image data 60 that is video data is detected as the predetermined image processing. In this case, in the client terminal 12, a large number of frames 60a included in the moving image data 60 are divided on the time axis T, and a plurality of partial data 61a to 61d are generated.

  In addition, boundary portion data 62a to 62c including boundaries between the partial data 61a to 61d and predetermined ranges on both sides thereof are generated.

  An ID is assigned to each of the partial data 61a to 61d and the boundary partial data 62a to 62c. Further, each ID is associated with relative position information with respect to the first frame 60a of the moving image data 60 in the first frame 60a of each of the partial data 61a to 61d and each of the boundary partial data 62a to 62c.

  Next, the partial data 61 a to 61 d and the boundary partial data 62 a to 62 c are randomly transmitted to the server 10.

  In the server 10, the scene change position 65 is detected from the received partial data 61a to 61d and boundary partial data 62a to 62c. In the present embodiment, the scene change position 65 is detected at t seconds of the partial data 61c. The detection result is transmitted to the client terminal 12.

In the present embodiment, the scene change position 65 is detected at X seconds from the start position of the partial data 61 c and at t seconds from the start position of the moving image data 60. Also, the partial data 61a to 61d
The fact that the scene change position 65 is not included in the start position and the end position is understood from the detection processing results of the boundary portion data 62a to 62c.

  In the case of the moving image data 60, the consistency of the boundary portions of the partial data 61a to 61d becomes a problem. For this reason, in this embodiment, the range of the both sides including a boundary is produced | generated as the boundary part data 62a-62c, and is processed.

  Thereby, it can be determined whether the boundary position of the partial data 61a to 61d is a target frame, that is, a frame having the scene change position 65.

  The image processing program, the image processing method, and the image processing system of the present invention include the following additional items.

[Others]
The present invention can be specified as follows.

(Supplementary note 1) Image data or video data is transmitted to a server having an image processing function via a network, and the image data, the video data or other processing results subjected to predetermined image processing are received from the server. An image processing program to be executed by a computer,
Dividing the image data or the video data to generate a plurality of partial data;
Generating position information indicating a positional relationship with the other partial data in the partial data;
Associating identification information with the location information;
Giving the identification information to the partial data;
Transmitting the partial data provided with the identification information to the server via the network;
An image processing program for executing
(Supplementary Note 2) A step of receiving the partial data subjected to the predetermined image processing from the server;
Obtaining the position information of the partial data from the identification information included in the received partial data;
Combining the partial data based on the position information to generate the image data, the video data or other processing results;
The image processing program according to attachment 1, wherein the program is executed.
(Supplementary note 3) The image processing program according to supplementary note 1, wherein the step of transmitting the partial data includes transmitting the partial data at random.
(Additional remark 4) The image processing program of Additional remark 1 which further performs the step which distributes and transmits the said partial data to the said some server.
(Additional remark 5) The image processing program of Additional remark 4 which performs further the step which receives selection of the said server which should transmit the said partial data.
(Supplementary note 6) The image processing program according to supplementary note 1 or 2, wherein the partial data includes a redundant portion.
(Additional remark 7) The image processing program of Additional remark 6 which further performs the step which removes the said redundant part contained in the said partial data received from the said server.
(Additional remark 8) The image processing program of Additional remark 1 which further performs the step which receives designation | designated of the size of the said partial data.
(Supplementary Note 9) Transmits image data or video data to a server having an image processing function via a network, and receives the image data, the video data, or other processing results subjected to predetermined image processing from the server. An image processing method executed by a computer,
Dividing the image data or the video data to generate a plurality of partial data;
Generating position information indicating a positional relationship with the other partial data in the partial data;
Associating identification information with the location information;
Giving the identification information to the partial data;
Transmitting the partial data provided with the identification information to the server via the network;
An image processing method for executing.
(Supplementary note 10) receiving the partial data subjected to the predetermined image processing from the server;
Obtaining the position information of the partial data from the identification information included in the received partial data;
Combining the partial data based on the position information to generate the image data, the video data or other processing results;
The image processing method according to appendix 9, wherein:
(Supplementary Note 11) Image data or video data is transmitted to a server having an image processing function via a network, and the image data, video data, or other processing result subjected to predetermined image processing is received from the server. An image processing system,
Means for dividing the image data or the video data to generate a plurality of partial data;
Means for generating position information indicating a positional relationship with the other partial data in the partial data;
Means for associating identification information with the location information;
Means for giving the identification information to the partial data;
Means for transmitting the partial data provided with the identification information to the server via the network;
An image processing system comprising:
(Supplementary Note 12) Means for receiving the partial data subjected to the predetermined image processing from the server;
Means for obtaining the position information of the partial data from the identification information included in the received partial data;
Means for combining the partial data based on the position information and generating the image data, the video data or other processing results;
The image processing system according to claim 11, further comprising:

1 is a diagram illustrating an image processing system according to a first embodiment of the present invention. It is a figure which shows the division method of the image data by the client terminal of 1st Embodiment which concerns on this invention. It is a figure which shows the division | segmentation method and redundant part of the image data of 1st Embodiment concerning this invention. It is a figure which shows the partial data and redundant part of 1st Embodiment which concern on this invention. It is a figure which shows the other partial data and redundant part of 1st Embodiment which concern on this invention. It is a flowchart which shows the process of the client terminal of 1st Embodiment which concerns on this invention. It is a flowchart which shows the process of the server of 1st Embodiment which concerns on this invention. It is a figure which shows the processing content of the client terminal in the case of performing the character recognition process of 2nd Embodiment which concerns on this invention. It is a figure which shows the processing content of the client terminal in the case of detecting the scene change position of the moving image data of 3rd Embodiment which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image processing system 10 Server 11 Network 12 Client terminal 21 Transmission / reception part 22 Image processing part 31 Processing range designation part 32 Division | segmentation processing part 33 ID provision part 34 ID / position information correlation part 35 Storage part 36 Reconstruction part 37 Display part 38 Transmission / reception Part 40 Image data 41 Processing range 41a-41d Partial data 42 Real area 43, 44 Redundant part 50 Image data 50a-50c Character string 51a-51c Partial data 53 Text 60 Movie data (video data)
60a frame 61a to 61d partial data 62a to 62c boundary partial data 65 scene change position

Claims (5)

Image data or video data is transmitted to a server having an image processing function via a network, and is executed by a computer that receives the image data, the video data, or other processing results subjected to predetermined image processing from the server. An image processing program,
Dividing the image data or the video data to generate a plurality of partial data;
Generating position information indicating a positional relationship with the other partial data in the partial data;
Associating identification information with the location information;
Giving the identification information to the partial data;
Transmitting the partial data provided with the identification information to the server via the network;
An image processing program for executing Receiving the partial data subjected to the predetermined image processing from the server;
Obtaining the position information of the partial data from the identification information included in the received partial data;
Combining the partial data based on the position information to generate the image data or the video data;
The image processing program according to claim 1, wherein:   The image processing program according to claim 1, wherein in the step of transmitting the partial data, the partial data is transmitted at random. This is executed by a computer that transmits image data or video data to a server having an image processing function via a network, and receives the image data, video data, or other processing results subjected to predetermined image processing from the server. An image processing method comprising:
Dividing the image data or the video data to generate a plurality of partial data;
Generating position information indicating a positional relationship with the other partial data in the partial data;
Associating identification information with the location information;
Giving the identification information to the partial data;
Transmitting the partial data provided with the identification information to the server via the network;
An image processing method for executing. An image processing system that transmits image data or video data to a server having an image processing function via a network and receives the image data, the video data, or other processing results subjected to predetermined image processing from the server. There,
Means for dividing the image data or the video data to generate a plurality of partial data;
Means for generating position information indicating a positional relationship with the other partial data in the partial data;
Means for associating identification information with the location information;
Means for giving the identification information to the partial data;
Means for transmitting the partial data provided with the identification information to the server via the network;
An image processing system comprising:

Images