JP2002244827A - Image editing support system, image editing support method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system for constructing an environment where a user can easily perform the layout operation by using the user's favorite images and distributing the image edited according to the layout operation. SOLUTION: A server 2 distributes a user-edited AP according to the request for the layout operation from a client system 3. The client system 3 displays an image on the display screen for taking new image information executed by the user edited AP but not stored in the server 2 from a photo-sharing 4, an image input device 309 and an image file 307. When the layout operation using the image information provided from the server 2 and new image information is executed, the image edit is executed based on the contents of the operation and the edited image is distributed to the client system 3.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system technology for assisting a user in editing a print target image desired by a user.

[0002]

2. Description of the Related Art Conventionally, printed materials such as posters have been used for advertisement and publicity. There is a wide variety of such prints, from postcard size to large format posters. Usually, a user who wants to create such a printed matter requests a specialized trader.

[0003]

However, it is often experienced that, when requesting the production of a printed matter from a specialized trader, when the number of copies of the printed matter is small, the cost involved in the production becomes high. On the other hand, in recent years, the performance of color printers has been dramatically improved, and the price has been reduced. For this reason, purchasing a color printer by a user and printing the screen created by the user with the color printer may lower costs in some cases than requesting a specialized trader for printed matter.

[0004] However, even in this case, it is difficult for a user who is not a specialized trader to create a printed matter. There are various choices for the printing environment, the materials used in the printed matter (photo images and illustration images, etc., the same applies hereinafter), character fonts, editing, and color types,
Performing all of these layout creation on the user side imposes a heavy load on the operator who creates the layout and the computer system used. In particular, editing image information requires a great deal of processing, such as temporarily expanding compressed image information that represents the material to be used.

An object of the present invention is to provide a mechanism capable of efficiently supporting editing of image information while taking in the user's request.

[0006]

The present invention provides an image editing support system, a method, and a computer program for operating a computer as the image editing support system. The image editing support system of the present invention is provided on a network to which an image holding system that holds an image that can be processed and a user terminal to which a printing device is connected and that can execute a predetermined program can be connected. A program management means for transmitting an image editing program to the user terminal accessed through the network, and executing the image editing program to construct an image processing operation environment on the user terminal. Image distribution means for distributing an image to be processed in response to a request from a user terminal which has constructed an environment for the image processing operation, an image distributed by the image distribution means, and an image held by the user terminal itself Performed on at least one of the images obtained by the user terminal from the image holding system. Information acquisition means for acquiring the contents of the manipulation operation and the image subjected to the manipulation operation, and editing the image acquired by the information acquisition means in accordance with the content of the acquired manipulation operation; Editing support means for converting the information into information printable by the printing device of the user terminal and outputting the converted information. As used herein, "owned by the user terminal" means images stored in an internal storage device or an external storage of the user terminal in addition to images captured each time by an input device such as a digital camera or a scanner. Is also included.
The details of the processing operation performed on the user terminal are output from the user terminal in the form of definition information defined by character information. As a result, the capacity to be secured on the communication network is not increased, and the processing speed for editing support can be relatively increased. In the editing support means,
An edited image is generated based on this definition information.

The image holding system accepts, for example, registration of a public image for public use and a private image for private use from a plurality of computers connected to the computer network, and also accepts the registration. It is configured so that any of these images can be provided to the user terminal.

[0008] The image delivered from the image delivery means to the user terminal may be a second image obtained by reducing the resolution of a first image for printing expressed at a predetermined resolution. In this case, the image editing program is created so that an environment for an image processing operation on the second image is constructed on the user terminal. Further, the editing support means is configured to edit the first image in accordance with the contents of the processing operation performed on the second image.

In one embodiment, the program management means sends a communication setting program to a user terminal accessed through the computer network to establish communication with the user terminal and establish communication. In this case, the image editing program is transmitted, and the communication setting program and the image editing program are disabled at the user terminal at a predetermined time after the processing operation is completed at the user terminal.

[0010] A search request for a material of an image to be processed and / or a predetermined template for editing is received from a user terminal performing the processing operation, and a corresponding search result is returned to the user terminal. An image editing support system further including a search unit, or a request for registration of a material of an image to be processed and / or a predetermined template for editing is received and received from a user terminal performing the processing operation. The image editing support system may further include a registration unit that registers the material and / or the template in a searchable form according to search conditions including respective identification information or keywords.

When the second image is data-compressed, the image editing program has a function of performing a processing operation on the second image in an intermediate stage of expanding the compressed image information of the second image. It is formed on the user terminal. The image editing program forms, on the user terminal, a function of including, in a processing operation on the second image, additional information including characters, which is added to the second image, in the content of the processing operation. It may be.

[0012] The image editing support method of the present invention provides an image holding system for holding an image that can be manipulated and a computer network to which a printing device is connected and a user terminal that can execute a predetermined program is connectable. By connecting an image editing support system that performs image editing support to the user terminal, sending an image editing program to the accessing user terminal in the image editing support system, and executing the image editing program. A process of constructing an image processing operation environment on the user terminal, a process of distributing an image to be processed according to a request from the user terminal that has constructed the image processing operation environment, the distributed image, The number of images owned by the user terminal and the number of images acquired by the user terminal from the image holding system is small. Processing of acquiring the contents processed manipulated image processing operation is performed on the single image with,
Executing a process of editing the obtained image according to the content of the obtained processing operation, converting the obtained edited image into information printable by the printing device of the user terminal that has performed the processing operation, and outputting the information; It is characterized by.

[0013] A computer program according to the present invention comprises: an image holding system for holding an image capable of being processed;
Computer program for operating a computer provided on a computer network to which a printing device is connected and to which a user terminal capable of executing a predetermined program can be connected as an image editing support system for supporting image editing for the user terminal The image editing support system includes the above-described program management means, image distribution means, information acquisition means, and editing support means at the time of its operation.

[0014]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment in which the present invention is applied to an editing support system that supports editing of a material selected by a user according to the user's intention will be described below.

<System Configuration> FIG. 1 is an overall configuration diagram of a computer system 1 to which the present invention is applied. The illustrated computer system 1 includes a server 2 as an example of an image editing support system, a client system 3 as an example of a user terminal, and a photo sharing system 4 as an example of an image holding system. A computer network 5 serving as a data transmission medium is interposed between the server 2 and the client system 3.

The server 2 includes: 1) a client system 3
For communication settings etc. in response to access requests from
a (registered trademark) applet distribution, 2) distributed Ja
distribution of an image editing application (hereinafter, “user-edited AP”, “AP” is an abbreviation of an application) that can be started in accordance with the va applet, and 3) a client system in which the distributed Java applet and the user-edited AP are executed The main function is to execute various processes based on the communication with the C.3. Java Applet is Sun Microsystems
It is a type of program in the Java language developed by the company. This Java applet is a Java virtual terminal function
(JavaVM: Java Virtual Machine)
Is executed by the Web browser in which is embedded. The various processes described above include a process for providing image information representing the content of the material requested from the client system 3, an editing process according to a result of a user operation on the image information, and a process of editing an edited image created thereby. Distribution processing is included.

The client system 3 is operated by a user and has as its main functions 1) transmission of an access request to the server 2 and 2) execution of a Java applet and a user editing AP transmitted from the server 2. is there. By executing the Java applet and the user editing AP, in cooperation with the server 2, a request for a material for image editing, a provided material and an image processing operation for image editing (hereinafter, referred to as “layout operation”) are supported. For example, it is possible to perform display of image information to be performed, transmission of an operation result indicating a layout operation from an operator who is usually a user, printing of edited image information (edited image) received from the server 2, and the like.

In particular, in this client system 3,
In addition to the image information provided from the server 2, desired image information is obtained from another plurality of paths, and an environment is realized in which this can be laid out together with the image information provided from the server 2. Hereinafter, the term "layout operation" is a concept that includes, in addition to a normal image processing operation, an operation of adding another image, characters, symbols, and the like to the image while leaving the image itself intact. Use this expression.

The photo sharing system 4 is a computer for accepting or providing registration of image information stored in advance in the own system via a network 5. The image information held in the photo sharing system 4 is provided to a request source unconditionally, a public image for public use, a specific user registered in advance, or provided for each user. And private images for personal use.

As the network 5, a computer network using a wired line, for example, the Internet can be applied, but a network using satellite communication, which can secure a larger communication capacity, may be used. FIG. 1 shows the client system 3 for convenience.
In this embodiment, it is assumed that a plurality of client systems 3 can be connected to the network 5.

<Configuration Example of Server> A configuration example of the server 2 will be described. The server 2 is a computer having a communication function, and a communication control unit 201, a main control unit 202, a communication control unit 201 formed by a CPU (cental processing unit) reading and executing a predetermined computer program as appropriate.
It has the functions of an image processing unit 203, a storage unit 204, a template information storage unit 205, a display image information storage unit 206, and a print image information storage unit 207. This computer program is stored in an external storage medium (not shown) such as a hard disk or a CD-ROM (Compact Disk-Read-Onl).
(y Memory) 208 or the like, which is recorded in a computer-readable form.

The communication control unit 201 controls communication between the network 5 and the main control unit 202 according to a predetermined protocol for transmitting and receiving various data.
The main control unit 202 controls the entire operation of the server 2. In particular, in carrying out the present invention, the communication control unit 201, the image processing unit 203, and the storage unit 204 control various processing procedures, and distribute a Java applet and a user edit AP in response to an access request. An environment for performing a layout operation in the client system 3 and processing necessary for the support thereof is constructed in the server 2 together with the server 203.

The image processing unit 203 executes various processes related to image information under the control of the main control unit 202. More specifically, the image processing unit 203 has functions of an image search unit 203a, an image editing unit 203b, and an image registration unit 203c, and further includes a table T1. The image search unit 203a includes, in the client system 3, a template number for specifying a designated one of templates which are templates for the layout creation process.
Search for image information for template display according to a material number for specifying a material serving as an element when expressing an image, or search for a template or display image information according to characteristic information such as a keyword with reference to a table T1. . The image editing unit 203b, according to the result of the layout operation performed by the user in the client system 3,
Edit print image information. At that time, the image editing unit 203b
Uses a technique of arranging and superimposing materials without completely expanding compressed image information. The technique disclosed in Japanese Patent Application Laid-Open No. 11-331847 can be used for this technique. Image registration unit 203c
Performs processing for registering image information provided from the client system 3. In the table T1, a material number uniquely specified for each material represented by the image information stored in the display image information storage unit 206 or the print image information storage unit 207 is specified by the material number. Characteristic information for characterizing the material, for example, some keywords are stored. The table T1 further holds the same information for the template stored in the template information storage unit 205. A specific example of the table T1 will be described later.

The storage unit 204 stores a plurality of different Js.
A set of Java applets (hereinafter, “Java applet group”) and a user-edited AP 204b are stored.
The Java applet group includes a Java applet 204a that is distributed to the client system 3 and executed to support a layout operation in the client system 3 of the distribution destination.

The user editing AP 204b is an application program downloaded to the client system 3. This application program is executed in the client system 3 to obtain image information not only from the server 2 but also through a plurality of routes, and to perform a layout operation on an image represented by the image information on the same screen. Environment is realized.

The template information storage unit 205 stores information on the above-described template. The template also includes frame information and background image information. Each template is provided with a template number for uniquely specifying each template.

The display image information storage unit 206 stores image information (hereinafter, “display image information”) of a material displayed on the display device of the client system 3 in the layout operation processing.

The print image information storage unit 207 stores the server 2
Image information of the material used in the editing process of
“Print image information”) is stored. The display image information storage unit 206 and the print image information storage unit 207 hold image information expressing the same material, respectively. The difference between the display image information and the print image information is a difference in the amount of information. That is, even if the materials are the same, the display image information has a smaller information amount than the print image information, and when displayed, occupies a smaller area on the screen. This is because when a layout operation is performed in the client system 3, no burden is imposed on the system. A so-called “thumbnail” can be used for the display image information here. Normally, print image information is JPEG (Joint P
hotographic Expert Group) and GIF (Graphics Interch
Ange format) is stored in the print image information storage unit 207 in a form conforming to a compression method such as an image format.

<Configuration of Client System> A configuration example of the client system 3 will be described. The client system 3 can be constituted by a personal computer (PC). At least a printing device 304, an input device 305, a display device 306, and an image input device 309 are connected to the PC.
7, a character font file 308 is stored, and a communication control unit 301, a Web browser 302, and a print control unit 303 are formed by a CPU mounted on a PC reading and executing a predetermined computer program as appropriate. Has a function.

The communication control unit 301 communicates with the network 5
The communication according to a predetermined protocol for transmitting and receiving data to and from the web browser 302 is controlled. We
The b browser 302 has a built-in Java VM 302a having a function of executing a Java applet. We
As the b browser 302, “Internet Explore” of Microsoft Corporation or “Netsca” of Netscape Corporation
pe Navigator "can be applied. Various processes realized by executing the Java applet 204a and the user edit AP 204b supplied from the server 2 in the Web browser 302 will be described later.

The print control unit 303 includes the Web browser 30
2 is converted into print data suitable for the specifications of the printing apparatus 304, and is supplied to the printing apparatus 304. The printing device 304 is a device that prints the edited image converted into the print data on paper and outputs it. The printing device 304 is a device capable of printing on paper of a size desired by the user having the client system 3. The input device 305 is a mouse, a keyboard, a pen input device, or the like, and receives an instruction from a user who operates the client system 3. The display device 306 displays the above-mentioned template and other information to the user who operates the client system 3. The display device 306 includes an LCD (L
A flat panel display such as iquid Crystal Display) can be used.

The image file 307 stores original image information created in the client system 3 and image information read by a scanner or the like. The character font file 308 stores information expressed by various character fonts obtained via another device or the network 5 in addition to the original character font created in the client system 3.
The image input device 309 is a device for inputting an image not stored in the image file 307, and includes a scanner,
A digital camera or the like can be used.

<Photo Sharing System> A configuration example of the photo sharing system 4 will be described. The photo sharing system 4 is also a computer having a communication function, and a communication control unit 401, a main control unit 402, and a public image information storage unit which are formed by reading and executing a predetermined computer program as appropriate by the CPU. 403 and a function of a private image information storage unit 404.

The communication control unit 401 controls communication between the network 5 and the main control unit 402 in accordance with a predetermined protocol for transmitting or receiving various data.
The main control unit 402 recognizes the user who operates the client system 3 by providing the public image information to the client system 3 that requests the provision of the image information as needed, or by performing a predetermined authentication process. The control for providing the private image information is performed. At the time of providing the private image information, control is also performed so that the client system 3 can confirm with image information of a data amount that does not load the client system 3 such as a thumbnail before the image information itself is provided.

The public image information storage unit 403 stores the above-mentioned public image information which is unconditionally provided to the request source for providing the image. The private image information storage unit 404
Private image information is stored after security is ensured for each user registered in advance and each user.

There are the following examples of the use form of the public image information storage unit 403. Among amateurs, photographers and CG (Computer Graphics) creators who have advanced technology do not have the skills of creating so-called homepages such as HTML (HyperText Markup Language) even if they want to publish their work on the network 5. Or, it can be used by those who are not blessed with the opportunity to sell their own work due to the limitation of an administrator (provider) who provides and manages the homepage. It is also suitable when these persons give priority to the effort for creating their own work over the effort for creating a homepage or the like.

In addition, the “photo” sharing makes it easy for image information (works) having the same tendency to gather and to evaluate each other. It may stop. As a use form of the private image information storage unit 404,
For example, there is a form in which a registered user or group uses it as its own photo album.

<Outline of Operation Form> Next, an outline of an operation form of the computer system 1 configured as described above will be described. FIG. 2 shows a sequence of transmission and reception of various data between the server 2 and the client system 3.

First, the user enters the client system 3
To make an access request to the server 2. In response to the access request, the server 2 reads out the Java applet 204a stored in the storage unit 204 and distributes it to the client system 3 that has issued the access request. The client system 3 that has received the Java applet 204a activates and executes it by the Java VM 302. In this embodiment, after activating the Java applet 204a, a process for user authentication is executed. For example, the client system 3 sends a layout operation start request (layout operation request) to the server 2.
And accepts an input of a pre-assigned password or the like and transmits it. Server 2
Is a client system 3 requesting to start a layout operation based on the received data such as a password.
Is determined to be a legitimate user to whom the password is assigned, and this result is returned.

If the user is not an authorized user, the fact is displayed on the display device 306 of the client system 3, and the distributed applet is released. If the user is an authorized user, the server 2 distributes the user editing AP 204b to the client system 3. Client system 3
Downloads and executes the user-edited AP 204b. Thus, an execution environment for an image processing operation by the user is constructed in the client system 3.

In the client system 3, when an image processing operation command is received from a user, data transmission / reception between the Java applet 204a executed in the client system 3 and the server 2 is performed a plurality of times as necessary. Done. For example, the material condition input from the input device 305 of the client system 3 and indicating which material is desired and how to use it is sent to the server 2. The server 2 specifies display image information indicating a material having a high degree of matching of the characteristic information (keyword) with the material condition by search, and transmits this to the client system 3. In the client system 3, the material (image) received from the server 2, the material (image) that the user owns (including the one captured each time by a scanner or the like), and the photo sharing system 4 hold the material (image). An environment for processing operations for combining images (public images, private images) is established. This environment, specifically, W
The address (URL) of the photo sharing system 4 is embedded or a link is attached to the editing screen on the web browser, and a public image or a private image is required at the time of a layout operation (for example, combining images). If
Easily navigate to the desired public or private image and read and use those images.

When the layout operation in the client system 3 is completed, the server 2 is notified of the completion and the contents of the operation. The server 2 receives the notified information, and among the received information,
Edit the print image information according to the operated contents. Print image information obtained by this editing is returned to the client system 3. When the client system 3 receives the print image information returned from the server 2, the client system 3 controls the printing device 304 through the print control unit 303 and performs paper printing based on the print image information. The execution of the user edit AP 204b is completed by the end of the paper printing. The above is the overall operation and operation transition of the edited image distribution system 1.

<Detailed Operation in Operation> Next, the operation procedure of the server 2 and the client 3 for enabling the above-described operation mode will be described in more detail.

First, the operation procedure of the server 2 will be described with reference to FIG. When receiving the access request from the client system 3, the server 2 prepares Java prepared in advance.
The applet 204a is read from the storage unit 204, and distributed to the client system 3 that has issued the access request (steps S101 and S102). This allows the user operating the client system 3 to perform a layout operation for image editing. When the user actually performs the layout operation, the user operates the Java applet 204a and sends a request to that effect to the server 2.

The server 2 has a Java applet 204a
When a request to perform a layout operation is received from the client system 3 that has performed the above, authentication processing is performed to determine whether the requesting user is a registered user in advance, that is, an authorized user (step S103). For this, a Java applet 204a is created in advance so that the user can be requested to transmit the registered user name and password together with the request for the layout operation, and the authentication process is performed based on the password received by the execution. It is common practice to do so. The registered user name and password are stored in a predetermined storage area of a storage device (not shown) in advance.

If the authentication processing reveals that the user is not a legitimate user (step S103: NO), the server 2
Notifies the requesting client system 3 that the request is not authenticated, and terminates the reception of the request (step S10).
4). At this time, registration of a new user may be accepted.

If the authentication processing reveals that the user is a legitimate user (step S103: YES), the server 2
Notifies the requesting client system 3 that the user has been authenticated (step S105), sends the user editing AP 204b to the client system 3, and executes various processes for supporting the layout operation in the client system 3. Preparations are made (step S106).

Here, various processes for supporting the above-described layout operation will be described. These processes are mainly performed by the main control unit 202 and the image processing unit 20 of the server 2.
3 is performed. First, a procedure for providing and searching for template / display image information will be described with reference to FIGS.

The server 2 receives a request for providing a template or display image information from the client system 3 as needed (step S201). Upon receiving this request, the server 2 first determines whether the request is a material search request (step S202). Specifically, a search request with a keyword, a template number, and / or
It is determined whether the request is accompanied by a material number instruction (step S2).
02). If the request is not a material search request, that is, if the request is accompanied by an instruction of a template number and / or a material number, the server 2 sends the template information storage unit 20
5, the template information corresponding to the template number is read, or the display image information corresponding to the material number is read from the display image information storage unit 206 (step S).
202: NO, S203). Then, these pieces of information are transmitted to the requesting client system 3 (step S2).
04).

On the other hand, if the received request is a material search request (step S202: YES), the server 2 performs a keyword search according to the search conditions attached to the request (step S205).

In the keyword search, specifically, FIG.
This is performed as follows using a table T1 whose contents are exemplified in (a) and (b). FIG. 5A shows an example in which keywords indicating the characteristics of the material are recorded in each of the material numbers # 1, # 2, # 3,... Assigned to each material, and FIG. Are template numbers # T1, # T2, # assigned to each template.
An example is shown in which keywords indicating the characteristics of the template are recorded in each of T3.

The server 2 sets the conditions for searching for the material as
If the keywords “scenery”, “summer”, and “mountain” are attached, material number # 3 recorded as a keyword indicating all three conditions with reference to FIG.
Is specified as a search result. And this material number # 3
Is read out from the display image information storage unit 206. If a condition for searching for a template is attached as a search condition, the server 2
Refers to the template table in FIG. 5B, performs the same processing as in the case of material search, and reads the corresponding template from the template information storage unit 205.

The above-described search processing when reading out the material and the template is an example. In addition, numerical values indicating priorities are assigned to individual keywords registered in the table T1, and a material number or a template having the highest sum of numerical values of keywords that match search conditions attached to the received request. The number may be used as the search result. Further, instead of specifying one material or template, a plurality of materials or templates may be specified in descending order of priority. Alternatively, a priority may be set for the search condition itself, and a material or a template that satisfies the high priority condition may be specified.

When the material and / or the template is specified by the keyword search as described above, the server 2 transmits them to the requesting client system 3 (step S206: YES, S204). If a material or template that satisfies the search condition cannot be detected by the keyword search, the server 2 transmits information indicating that there is no material or template that satisfies the condition to the requesting client system 3 (step S206: NO, S207). Through the above-described processing procedure, the server 2 can provide the client system 3 with materials and / or templates as desired by the client system 3.

Next, the procedure of the editing process in the server 2 when the result of the layout operation performed on the material or the template on the client system 3 side will be described with reference to FIGS. 6 and 7. When the server 2 receives the result of the above-described layout operation from the client system 3 (step S301), the image editing unit 203b displays a print image expressing the same material as the material (display image information) transmitted to the client system 3. Information (image information used for printing on paper) is read from the print image information storage unit 207 (step S302).

However, in this embodiment, image information that is not stored in the server 2 may be used as the image information on which the layout operation has been performed in the client system 3. For example, image information indicating an original image stored in the image file 307, image information input from the image input device 309, or image information provided from the photo sharing 4 may be included. In this case, the used image information is sent together with the layout operation result, or image information registration processing is performed. Therefore, the image editing unit 203b
In some cases, the image information sent from the client system 3 may be supplied as print image information, or the registered print image information may be read from the print image information storage unit 207.

The image editing unit 203b edits the read or received print image information according to the layout operation result (step S303). Since the print image information is compressed, editing is performed in an intermediate step of expanding the print image information. The content of the edit is
For example, there are various processes such as moving, enlarging, reducing, and deleting print image information. Depending on the contents of the layout operation, a process in which a plurality of materials overlap may be required. In this case, the image editing unit 203b edits the print image information according to the information (Z-Order) defined on the overlapping direction axis so that the superposition of the materials is reflected. After encrypting the edited image created by the editing (step S304), the server 2 transmits the encrypted image to the client system 3 (step S305).

The contents of the editing process (step S303) performed by the image editing unit 203b will be described in more detail with reference to FIG. Since the print image information is usually a compressed image composed of data blocks based on a plurality of primary transformations, first, such print image information is subjected to entropy decoding, and It is extracted (steps S401, S402).

The extracted data blocks are rearranged and dequantized (steps S403 and S404). Thus, even if the compressed print image information is not completely decompressed, the decompression process is performed up to the intermediate stage. The above editing process is performed on the print image information in such a state (step S405). Thereafter, the edited image created as a result of the editing process is quantized, rearranged in data blocks, and then subjected to entropy coding (step S40).
6, S407, S408).

Through the above processing procedure, the print image information is moved, enlarged, or reduced without completely expanding the compressed print image information, that is, in the intermediate stage of expanding the compressed image. , Deletion can be easily performed.

Next, the procedure of the image information registration process in the server 2 will be described with reference to FIG. This registration process is mainly performed by the image registration unit 203c. When a layout operation using image information that is not stored in the server 2 is performed in the client system 3, a request to register the image information in the server 2 may be received from the client system 3. Server 2
When this request is received from the client system 3 (step S501), the requesting client system 3 is requested to provide image information to be registered, and the request is received (step S502). Then, using the received image information, display image information (thumbnail) representing the same material as the image information and reducing the amount of the information
Is generated (step S503).

Thereafter, the image information sent from the client system 3 is used as print image information, and the print image information and the display image information generated as
Display image information storage unit 206, print image information storage unit 207
(Step S504). At this time, a new material number common to each image information is assigned.

After registering the image information, the server 2 requests the keyword indicating the characteristic of the material represented by the image information from the client system 3 which has issued the registration request. Upon receiving one or more keywords transmitted from the client system 3 in accordance with this request (step S505), these keywords are registered in the table T1 in association with the previously assigned material numbers (step S506).

The image information is registered in the server 2 through the above processing procedure. Note that a password or the like may be set in the registered image information so that the user can use only the user. In this case, in step S504, when the image information is stored in the display image information storage unit 206 and the print image information storage unit 207, and when the image information is registered in the table T1 in step S506, only the user It is necessary to perform processing so that information can be used.

The timing for starting the registration process is as follows.
The process may be started in response to a registration request from the client system 3 as described above, or may be executed in response to reception of a layout operation result. Even in this case, the main processing procedure is the same as the above-described processing procedure, and a description thereof will be omitted. Further, not only image information but also a template can be registered in the same manner. In this case, in the above-described image information registration processing procedure, a template is substituted for the image information by the display image information storage unit 206 and the print image information storage unit 207.
Instead, the template information storage unit 205 may be used and the display image information generation processing in step S503 may be omitted.
In the above description, an example in which the display image information is generated based on the image information sent from the client system 3 has been described. However, the display image information is also supplied from the client system 3 so that the display image Information generation processing may be omitted.

Next, the operation of the photo sharing system 4 during operation will be described with reference to FIG. Upon receiving the image information provision request from the client system 3, the photo sharing system 4 determines whether the requested image is a request for a private image (step S601, step S601).
S602).

If the request is for providing private image information (step S602: YES), the photo sharing system 4 performs user authentication of the request source (step S60).
3). That is, whether the user operating the requesting client system 3 is a registered person (user) or a person (user) who can provide the requested private image. Is performed based on information registered in advance (step S603). As a result of the authentication, if it is determined that the request is a provision request from a legitimate person (user), the photo sharing system 4 performs preprocessing for providing the corresponding private image information to the request source. (Step S603: YES, S604). Specifically, a plurality of pieces of image information addressed to a pre-registered person (user) are sent to the requesting client system 3 as low-resolution image information such as a thumbnail, and only the selected image is sent to the client system 3. Private image information expressed in the original resolution is sent to the client system 3. If it is determined as a result of the authentication that the request is a provision request from a person who is not a legitimate person (user) (step S603: NO), the fact is notified to the requesting client system 3 and the process is terminated.

In step S602, if the image information requested by the client system 3 is not private image information (step S602: NO), the photo sharing system 4 determines that the requested image is a public image,
The requested public image information is stored in the public image information storage unit 403.
And sends it to the requesting client system 3 (step S605). Also in this case, it is preferable that the client system 3 can select the image information by using a thumbnail or the like before transmitting the public image information expressed in the original resolution.

Next, the operation of the client system 3 during operation will be described. First, the overall operation procedure will be described with reference to FIG.

When the client system 3 receives an access operation from the user to the server 2 through the Web browser 302, the client system 3 transmits an access request to the server 2 (step S611). Since the Java applet 204a is transmitted from the server 2 in response to the access request, the Java applet 204a is received, the JavaVM 302a is activated, and the execution of the Java applet 204a is started (steps S612 and S613). When the execution of the Java applet 204a starts, the user edit AP 204
There is an inquiry as to whether or not to download b. If the user agrees, the download of the user-edited AP 204b is started (step S614).

When the download of the user edit AP 204b is completed, the user edit A
When P204b becomes executable, the user edit AP
By performing bidirectional communication between the server 204b and the server 2, various processes for supporting a layout operation can be executed (step S615). When the necessary layout operation and printing of the edited image are completed on the client system 3 side, the user editing AP 204b is terminated, and Java is executed.
The applet 204a is released (Step S616,
S617).

Here, the operation of the client system 3 when the user editing AP 204b is being executed in the client system 3 will be described with reference to FIG. Note that the user-edited AP used in the following description of the operation of the client system 3 refers to the one after downloading to the client system 3, and when the user-edited AP is executed, it is also executed on the client system 3. The Java applet 204a performs a process for assisting various processes related to a layout operation and printing of an edited image.

When the user edit AP is executed, information for confirming whether or not to execute a layout operation is displayed on the display device 306 (step S701). When a command to perform a layout operation is input by the user, user editing A
P204b sends a layout operation request to server 2. In response to the layout operation request, a process for user authentication using a password or the like is performed between the server 2 and the client system 3. If you are not authenticated,
The user editing AP displays on the display device 306 that the user authentication has failed.

If the user authentication is successful, the user edit AP
Displays on the display device 306 screen information for requesting the server 2 to provide necessary templates and materials. In accordance with this screen information, the user inputs a template number and a material number for specifying a template and a material, and if these numbers cannot be specified, inputs search conditions for a keyword search. The user editing AP transmits a request for providing materials and the like to the server 2 together with the input information. When a template, a material, and the like are received from the server 2 in response to the provision request, the template and the material are displayed on the display device 306 (step S702). It should be noted that the transmission of the provision request and the reception of the template, the material, and the like corresponding to the provision request can be repeated as many times as necessary according to the instruction from the user until the layout operation is completed.
Is composed.

Thereafter, a layout operation by the user, that is, user editing is accepted (step S703). The user editing AP processes display image information (material, etc.) displayed on the display device 306 according to the content of the layout operation by the user. Along with this, the user editing AP
Changes the definition information for defining the display image information (material, etc.) according to the content of the layout operation, that is, the content of the processing instruction of the display image information. The changed definition information indicates a result of a user operation performed on a material or the like. Such processing is performed until the layout operation by the user is completed.

Here, an example of the definition information is shown in FIG. The drawing shows material definition information regarding two images Im1 and Im2 and one text data Tx1. The definition information includes the Z-Order order of the materials used, and detailed data of each material and additional information (here, a character font). For character fonts, detailed data includes font name, displayed character string, print (display)
, X, Y coordinates, display width, height, rotation, and color indicating the start position of the image. In the case of a material, the detailed data includes a UR indicating a position where print image information is held.
The information includes L (Uniform Resource Locator), X and Y coordinates indicating the start position of printing (display), display width, height, rotation. Note that FIG. 12 shows each item only for the text Tx1 and the image information Im1 in order to simplify the drawing display.

Returning to the description of the processing procedure of FIG. When a command to end the layout operation is received from the user, for example, by clicking a “Print” button on the display screen, the user editing AP transmits the latest definition information changed by the user editing to the server 2, It waits for the transmission of the edited image from the server 2 (step S70).
4, S705).

When the user instructs to paste a character font or create an underline on a material or the like, that is, when an operation to add a font or the like has been performed, the user editing AP executes this additional operation. Is generated, and this is stored in a memory area (not shown). The definition information changed according to the additional operation is transmitted to the server 2 as a result of the layout operation together with the definition information of the material and the like.

The "addition operation" is an operation for adding specific information to a material or the like, and includes, for example, an operation of pasting a character font above or below a material or the like, and an operation of underlining the character font. included. "Additional information"
Means a character font or underline generated by such an addition operation.

When the edited image is received from the server 2 (step S706), the edited image is decrypted by an encryption unit (not shown). If additional information is created and retained,
The decoded edited image and the additional information are combined. Then, the print control unit 303 converts the print data into print data corresponding to the printing device 304 and causes the printing device 304 to print the edited image (steps S707 and S708). The above is the operation on the client system 3 side.

Next, a procedure for editing image information not stored in the server 2 or editing text data created in the client system 3 will be described with reference to FIG. As described above, when editing image information that is not stored in the server 2, 1) receive the image information provided from the photo sharing system 4, 2) input using the image input device 309, ) The procedure is to use image information stored in the image file 307 in advance.

When such image information or text data is input (step S801), the user-edited AP
Converts the input image information and text data into an image file 307 and a character font file 308, respectively.
And the corresponding definition information is generated (step S802). Further, the user editing AP generates display image information from the input image information or text data (step S803). User edit AP
Changes the screen displayed on the display device 306 using the display image information (step S804).

The processing procedure at the time of the user editing described above is described on the assumption that the user performs a layout operation.
However, original image information and text data can be input at times other than during the layout operation. In this case, the image file 307 or the character font file 3 by a processing unit (not shown) other than the user edit AP
08 only needs to be stored. However, when the image information or the text data stored in these files is used at the time of the layout operation, the above-described step S
Steps 802 and S803 are required.

Next, a processing procedure for newly registering image information in the server 2 from the client system 3 will be described with reference to FIG. Upon receiving an image information registration instruction from the user (step S901), the user editing AP transmits an image information registration request to the server 2 (step S902). When there is a response from the server 2 in response to the image information registration request, the user edit AP
The new image information designated by the user is transmitted to the server 2 (step S903).

Thereafter, the user editing AP displays on the display device 306 screen information for prompting input of a keyword characterizing the image information to be registered. Upon receiving the keyword input from the user (step S904), the user-editing AP transmits the received keyword to the server 2 (step S905).

Thus, the above-described registration processing of the image information is performed in the server 2. In the processing procedure of FIG. 14, only new image information is transmitted to the server 2. However, the client system 3 generates display image information based on this image information in advance, and transmits the display image information at the same time. Is also good.

Next, an example of a screen displayed on the display device 306 of the client system 3 by executing the user edit AP will be described with reference to FIGS. In this embodiment, during the layout operation, the user operates the input device 305 to arrange a material at a desired position,
Materials can be added or deleted.

The operations here include: 1) printing environment operation (printing device type, paper type, paper size, printing method) 2) template selection (frame and background image selection) 3) material selection (photo image, Illustration image) 4) Character selection (font, size, color) 5) Character editing (insertion, movement, rotation, deletion) 6) Content editing (movement, rotation, enlargement, reduction, deletion), etc. are included. The content includes a character font and a material.

FIG. 15 is an example of a screen displayed on the display device 306 when the client system 3 accesses the server 2. Here, it is possible to specify a card, such as a Christmas card or a New Year's card, or another print use form, such as a book cover. When the user selects a New Year's card, a screen as shown in FIG. 16 is displayed. The illustrated screen is a screen for receiving designation of a layout direction (vertical or horizontal).

Further, when "vertical" of the free layout is selected in FIG. 16, a screen shown in FIG. 17 is displayed. This screen is for confirming the selection of the layout direction and accepting the designation of the printing apparatus 304 to be used as shown in the lower left of the screen. Here, when the user selects a desired model of the printing apparatus 304, a confirmation screen shown in FIG. 18 is displayed. If this is the case, the “enter” button at the lower right of the screen may be pressed.

FIG. 19 shows an example of a screen displayed after the “enter” button is pressed in FIG. This screen is the main screen in the layout operation. On the right side of the screen, icons for performing various editing tools are shown. The user can perform various processes related to the layout operation by selecting each item shown on the left side of the screen. The operation items (operation tags) include “template”, “user screen selection”, “material selection”, “character input”, “preview”, “print”, “save”, and “file recall”. FIG. 19 also shows a screen example when the item “template” is selected.

When the item “user selection” is selected, an image not stored in the server 2 can be displayed on the layout operation screen. FIG. 20 shows items (tags) for selecting an acquisition route for displaying the new image information. “Local” is an item for selecting to import new image information from the image file 307 of the client system 3, and “Direct import” is to import new image information using the image input device 309. Item to select,
“Photo sharing” is an item for selecting to take in image information provided by the photo sharing system 4 as new image information. At the time of capturing, a simple operation tool such as “trimming” shown on the right side of the screen can be used.

FIG. 21 shows an example of an image stored in the image file 307 when “local” is selected. The selector presses the "decision" button at the lower right if the displayed image is acceptable, and if the other image is desired,
What is necessary is just to press "cancel". FIG. 22 shows an example of a screen when the “Enter” button is pressed.

FIG. 23 shows an example of a screen when “direct capture” is selected. This screen shows that a scanner is connected as the image input device 309 of the client system 3 and that an image can be captured using this scanner. FIG. 24 is an example of a screen after an image is captured using this scanner.

FIG. 25 is an example of a screen when “photo sharing” is selected. Here, the photo sharing system 4 is accessed from the client system 3 via the network 5. In particular, in FIG. 25, the private image information storage unit 404 of the photo sharing system 4
Is attempted, and the user is prompted for a user name and password. FIG. 26 shows a state in which the image information held in the private image information storage unit 404 is displayed as a thumbnail.

FIG. 27 shows an example of a screen when "Material selection" is selected from the items shown in FIG. Here, the template information storage unit 20 of the server 2
5 and various image information stored in the display image information storage unit 206 can be selected. As shown in the figure, the image information that can be obtained from the server 2 includes a background,
There are frames, decorative letters, photos, illustrations, and stamps.

FIG. 28 shows an example of a screen when "character input" is selected from the items shown in FIG. Here, various settings such as the font and size of the characters to be input can be made. FIG. 29 shows an example of a screen when “preview” is selected from the items shown in FIG. This is for confirming on the screen how the image information generated by the layout operation is printed.

FIG. 30 shows an example of a screen when "print" is selected from the items shown in FIG. This is a screen for confirming the setting status, progress status, and the like in actual printing, and accepting settings such as the number of prints. Note that the other items “save” and “recall file” shown in FIG. 19 are items for saving and reading image information already created by the layout operation, and detailed screen examples are omitted. .

As described above, according to this embodiment, it is possible to appropriately provide an edited image according to a user's request via a network. In particular, in this embodiment, in response to an access request from the client system 3, a predetermined Java
The applet and the user editing AP are distributed to the client system 3. Then, between the client system 3 executing the distributed user editing AP and the server 2,
Mutual communication for supporting processing from layout operation to printing is performed. Therefore, the load on the server 2 and the client system 3 is reduced. Further, when the editing process is performed in the server 2, the processing load on the server 2 is greatly reduced because the method of entropy decoding and entropy coding in which the compressed image information is superimposed without being completely expanded is adopted. You.
As a result, it is possible to quickly distribute the edited image via the network.

Also, using a satellite line for the network 5,
When distributing edited images using such a satellite line,
In addition to improving the performance related to transmission, so-called broadcasting that simultaneously provides the same edited image to a plurality of client systems 3 becomes possible. Therefore, when the user has many branches, the edited image requested by the head office can be simultaneously distributed to each branch.

In particular, in this embodiment, when a user operating the client system 3 desires to perform a layout operation (user editing) using new image information not stored in the server 2, the new image As a path for importing information, image import from the image file 307, image import using the image input device 309,
Alternatively, an environment in which image information stored in the photo sharing system 4 can be captured via the network 5 is established in the client system 3. Therefore, the user has a greater degree of freedom in the image information used for the layout operation, and can perform the layout operation using the favorite image information.

As is apparent from the above description, according to this embodiment, an environment in which the layout operation can be easily performed is constructed in the client system 3, whereby the contents of the layout operation are returned to the server 2. On server 2,
Detailed image editing and conversion to print data are performed. At this time, the server 2 prompts the client 3 to perform a layout operation on the user side by using image information having a small amount of information, and edits the originally used image information according to the operation of the image information. It will be done efficiently. In addition, when the editing process is performed, a technique of superimposing the compressed image information without completely expanding it is used, so that the processing load at the time of the layout operation is reduced.

[0103]

As is apparent from the above description, according to the present invention, the editing support of the image desired by the user can be realized quickly and efficiently.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example of the overall configuration of an embodiment of the present invention.

FIG. 2 is a block diagram for explaining a state transition of data transmission / reception between a server and a client system in the embodiment.

FIG. 3 is a procedure explanatory diagram for explaining the overall operation of the server.

FIG. 4 is a procedure explanatory diagram for explaining a template / display image providing process of a server.

5A is a diagram illustrating an example of a material number and a keyword corresponding to the material number stored in a table of a server, and FIG. 5B is a diagram illustrating an example of a template number and a keyword corresponding to the template number stored in the table;

FIG. 6 is a procedure explanatory diagram for describing a process according to reception of an operation result of a server.

FIG. 7 is a procedure explanatory diagram for explaining the editing process of the server.

FIG. 8 is a diagram illustrating a procedure for explaining image information registration processing of a server.

FIG. 9 is a procedure explanatory diagram for explaining the overall operation of the photo sharing system.

FIG. 10 is a procedure explanatory diagram for explaining the overall operation of the client system.

FIG. 11 is a procedure explanatory diagram for explaining the operation of the user editing AP executed in the client system.

FIG. 12 is a view showing definition information created in the client system.

FIG. 13 is a procedure explanatory diagram for explaining processing of image information and text data acquired in the client system.

FIG. 14 is a procedure explanatory diagram for explaining a process of registering new image information from a client system to a server.

FIG. 15 shows an example of a screen displayed on the display device of the client system.

FIG. 16 is an example of a screen displayed on the display device of the client system.

FIG. 17 shows an example of a screen displayed on the display device of the client system.

FIG. 18 is an example of a screen displayed on the display device of the client system.

FIG. 19 is an example of a screen displayed on the display device of the client system.

FIG. 20 is an example of a screen displayed on the display device of the client system.

FIG. 21 is an example of a screen displayed on the display device of the client system.

FIG. 22 is an example of a screen displayed on the display device of the client system.

FIG. 23 is an example of a screen displayed on the display device of the client system.

FIG. 24 is an example of a screen displayed on the display device of the client system.

FIG. 25 is an example of a screen displayed on the display device of the client system.

FIG. 26 is an example of a screen displayed on the display device of the client system.

FIG. 27 is an example of a screen displayed on the display device of the client system.

FIG. 28 shows an example of a screen displayed on the display device of the client system.

FIG. 29 is an example of a screen displayed on the display device of the client system.

FIG. 30 is an example of a screen displayed on the display device of the client system.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Computer system 2 Server 3 Client 4 Photo sharing system 5 Network 201 Communication control unit 202 Main control unit 203 Image processing unit 203a Image search unit 203b Image editing unit 203c Image registration unit T1 table 204 Applet storage unit 205 Template information storage unit 206 Display image information storage unit 207 Print image information storage unit 208 Recording medium 301 Communication control unit 302 Web browser 302a JavaVM 303 Print control unit 304 Printing device 305 Input device 306 Display device 307 Image file 308 Character font file 309 Image input device 310 Storage medium 401 Communication control unit 402 Main control unit 403 Public image information storage unit 404 Private image information storage unit

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification FI FI Theme Court ゛ (Reference) H04N 1/387 G06F 9/06 660C (72) Inventor Ryuta Namiki 6-24-1, Nishishinjuku, Shinjuku-ku, Tokyo No. Epson Sales Co., Ltd. (72) Inventor Akemi Shoji 6-24-1, Nishishinjuku, Shinjuku-ku, Tokyo Epson Sales Co., Ltd. F-term (reference) 2H095 AB15 AC07 5B021 AA01 CC06 CC07 5B050 BA06 BA07 BA16 BA18 BA20 CA05 CA07 CA08 DA04 EA10 EA12 EA13 EA19 FA02 FA03 FA13 5B076 FB05 FB17 5C076 AA14 AA17 AA21 AA22 CB04

Claims (13)

[Claims] An image holding system for holding an image that can be processed and a user terminal to which a printing device is connected and capable of executing a predetermined program are provided on a network to which a user terminal can be connected. A program management means for transmitting an image editing program to the user terminal accessed through the network, and executing the image editing program to construct an image processing operation environment on the user terminal; Image distribution means for distributing an image to be processed in response to a request from a user terminal that has constructed an operation environment; an image distributed by the image distribution means; an image owned by the user terminal; and the user terminal. And the contents of the processing operation performed on at least one of the images obtained from the image holding system. Information acquisition means for acquiring an image that has been manipulated; and a user terminal that edits the image acquired by the information acquisition means in accordance with the content of the acquired manipulation operation, and edits the edited image obtained by the manipulation operation. An image editing support system for converting the information into information printable by a printing apparatus and outputting the converted information. 2. The image holding system receives, from a plurality of computers connected to the computer network, registration of a public image for public use and a registration of a private image for private use, and accepts the registration. The image editing support system according to claim 1, wherein the system is configured to be able to provide any of these images to the user terminal. 3. The image editing program according to claim 1, wherein the image distributed from the image distribution unit to the user terminal is a second image obtained by lowering a resolution of a first image for printing expressed at a predetermined resolution. Constructs an environment for an image processing operation on the second image on the user terminal, wherein the editing support unit converts the first image according to the content of the processing operation performed on the second image. The image editing support system according to claim 1, wherein the image editing support system edits. 4. The program management means sends a communication setting program to a user terminal accessed through the computer network to establish communication with the user terminal and, when communication is established, the image 2. The program according to claim 1, wherein an editing program is transmitted, and the communication setting program and the image editing program are disabled at the user terminal at a predetermined point in time when the processing operation is completed at the user terminal. Image editing support system. 5. A method according to claim 1, wherein the user terminal performs the processing operation.
A search means for receiving a search request for a material of an image to be processed and / or a predetermined template for editing and returning a corresponding search result to the user terminal. 1. The image editing support system according to 1. 6. A user terminal for performing the processing operation,
A registration request for a material of an image to be processed and / or a predetermined template for editing is received, and the received material and / or template can be searched according to search conditions including respective identification information or keywords. The image editing support system according to claim 1, further comprising a registration unit for registering in a simple form. 7. The image editing program, wherein the second image is data compressed, and wherein the image editing program performs a processing operation on the second image at an intermediate stage of expanding image information in a compressed state of the second image. 4. The image editing support system according to claim 3, wherein is formed on the user terminal. 8. A function on the user terminal, wherein the image editing program includes a function of including, in a processing operation on an image to be edited, additional information added to the image including characters in the content of the processing operation. The image editing support system according to claim 3, wherein the image editing support system is formed. 9. The image editing program causes an environment of a processing operation for synthesizing an image to be edited and an image held in the image holding system to be built on the user terminal. The image editing support system according to claim 3, wherein: 10. The execution environment displays, on a user operation screen of the user terminal, an address of an area where a target image is present among images held in the image holding system, and displays the target image by the display. The image editing support system according to claim 9, further comprising: an environment that enables the user to obtain an image. 11. The image editing program outputs contents of processing performed on an image to be edited as definition information in which an expression form of the image at the time of printing is defined by character information. The image editing support system according to claim 3, wherein the editing support unit is configured to edit the image acquired by the information acquiring unit according to the definition information received from the user terminal. 12. An image editing system for an image holding system that holds an image that can be manipulated and a computer network to which a printing device is connected and a user terminal that can execute a predetermined program are connected. An image editing support system for providing support is connected. In the image editing support system, an image editing program is sent to the user terminal that has accessed the image, and the image editing program is executed to execute image processing on the user terminal. A process of constructing an operation environment; a process of distributing an image to be processed in response to a request from a user terminal that has constructed the image processing operation environment; the distributed image; an image held by the user terminal itself , For at least one of the images obtained by the user terminal from the image holding system A process of acquiring the details of the performed processing operation and the processed image, a user terminal that edits the obtained image according to the content of the obtained processing operation, and edits the obtained edited image by the processing operation An image editing support method, which performs a process of converting the information into information printable by a printing device and outputting the converted information. 13. A computer provided on a computer network to which an image holding system that holds an image that can be processed and a user terminal to which a printing device is connected and that can execute a predetermined program are connected. A computer program for operating as an image editing support system that performs image editing support for the user terminal, wherein the image editing support system operates at the time of the operation, wherein the user terminal accessed through the computer network has an image editing program. And a program management means for constructing an environment for image processing operation on the user terminal by executing the image editing program, and processing in response to a request from the user terminal which has constructed the environment for image processing operation. Image distributor that distributes the image to be operated And the contents and processing of a processing operation performed on at least one of an image distributed by the image distribution means, an image held by the user terminal, and an image obtained by the user terminal from the image holding system. An information acquisition unit for acquiring an operated image; and an image acquired by the information acquisition unit, edited according to the content of the acquired processing operation, and an edited image obtained by the user terminal performing the processing operation. A computer program comprising editing support means for converting the information into information printable by a printing device and outputting the information.