JP6053365B2 - Server system, image processing system, program, and image processing method - Google Patents

Description

  The present invention relates to a server system, an image processing system, a program, an image processing method, and the like.

  In recent years, with the development of Internet technology, all processing is not performed within a single information terminal, but a part of the processing is performed by an external server device (server system) via the network. There has been an increase in the use form of computers to receive the processing results through the network. Such a utilization form is called so-called cloud computing.

  As an example of such a technique, for example, an image is captured by an information terminal device such as a camera-equipped mobile phone, and image processing is performed on the captured image by an external server device or the like via a network. There is a technique for receiving an image of a processing result.

  Specifically, as an invention related to these image processing systems, there are conventional techniques described in Patent Document 1 and Patent Document 2 below.

JP 2010-233138 A JP 2011-243187 A

  In image processing, there is a problem of how to shorten the waiting time from when the user gives an instruction to start image processing to when the image processing result is presented to the user.

  In this regard, in the image processing system as described above, the processing speed is increased by placing a part of the processing on a server device or the like having a higher processing capacity than the information terminal device, thereby reducing the image processing time. Shorten.

  However, on the other hand, a communication waiting time is newly generated while the information terminal device and the server device communicate with each other via the network. If the communication waiting time is long, even if the image processing time can be shortened, the total waiting time of the user is not shortened.

  Therefore, in the image processing system as described above, in order to shorten the total waiting time, it is necessary not only to shorten the image processing time but also to shorten the communication waiting time.

  In addition, the acquired image processing results often do not conform to the user's intention. In such a case, it is conceivable that the same image processing is performed again by redesignating the image processing parameters and the like.

  However, when image processing is performed again, a waiting time almost twice as long is required until an image according to the user's intention is acquired. In other words, the same waiting time is required for image processing (first image processing) that outputs a result that does not conform to the user's intention as in the case of performing image processing (second image processing) according to the user's intention. That is a problem.

  According to some aspects of the present invention, a server system, an image processing system, a program, an image processing method, and the like that can shorten the waiting time until image processing results are presented to the user for the first time after image processing is started. Can be provided.

  One aspect of the present invention includes a reception processing unit that performs information reception processing with an information terminal device via a network, an image processing unit that performs image processing on a processing target image, and the network via the network. A transmission processing unit that performs information transmission processing with the information terminal device, and the image processing unit performs first image processing on the first processing target image according to the first image processing parameter. And generating a first result image, wherein the transmission processing unit transmits information on the generated first result image to the information terminal device, and the image processing unit is configured to transmit the first result image. A second image processing parameter is set based on reaction information indicating a user's reaction to the second processing target image, which is an original image or an image generated from the original image. According to image processing parameters Performing a second image processing to generate a second result image, the transmission processing unit is related information generated second result image to a server system for transmitting to the information terminal device.

  In one aspect of the present invention, the server system performs first image processing on the first processing target image according to the first image processing parameter, generates a first result image, and generates the generated first Information on the result image is transmitted to the information terminal device via the network.

  Then, the information terminal device displays the received first result image.

  On the other hand, the server system sets a second image processing parameter based on reaction information indicating a user's reaction to the first result image, and a second processing target image that is an original image or an image generated from the original image In response to the second image processing parameter that has been set, second image processing is performed to generate a second result image, and information on the generated second result image is transmitted to the information terminal device via the network. To do.

  On the other hand, the information terminal device displays the received second result image on the display unit.

  As a result, it is possible to reduce the waiting time until the image processing result is presented to the user for the first time after the image processing is started. In addition, it is possible to obtain an image processing result more reflecting the user's intention.

  In the aspect of the invention, the reception processing unit receives first processing target image generation information, which is information used to generate the first processing target image, from the information terminal device, and the image The processing unit generates a first processing target image by performing a first processing target image generation process on the original image based on the first processing target image generation information, and generates the first processing target image. The first image processing may be performed on one processing target image according to the first image processing parameter.

  Thereby, the user can adjust the waiting time or the like until the first result image is presented by the first processing target image generation information.

  Moreover, in one aspect of the present invention, the reception processing unit receives size change instruction information as the first processing target image generation information, and the image processing unit is based on the received size change instruction information. The first processing target image may be generated by performing a resizing process on the original image.

  Thereby, for example, it is possible to generate a first processing target image, which is a reduced image having a smaller size than the original image, from the original image.

  In the aspect of the invention, the reception processing unit receives region designation information that is information for designating a region to be extracted from the original image as the first processing target image generation information, and the image processing unit The first processing target image may be generated by performing region extraction processing on the original image based on the received region designation information.

  This makes it possible to generate a first processing target image that is a partial image of the original image from the original image.

  In one aspect of the present invention, the reception processing unit receives registered face image information, which is information used to specify a face region extracted from the original image, as the region designation information, and the image processing unit The first processing target image may be generated by performing face area extraction processing on the original image based on the received registered face image information.

  This makes it possible to extract a region including a face that matches the registered face without specifying the region to be extracted each time image processing is performed.

  In the aspect of the invention, the reception processing unit receives second processing target image generation information, which is information used to generate the second processing target image, from the information terminal device, and the image The processing unit generates a second processing target image by performing a second processing target image generation process on the original image based on the second processing target image generation information, and generates the second processing target image. The second image processing may be performed on the second processing target image according to the second image processing parameter.

  As a result, the user who viewed the first result image can change the size of the second result image, the range corresponding to the second result image in the original image, or the like.

  In one aspect of the present invention, the image processing unit includes an extraction condition storage unit that stores an extraction condition used when specifying an area to be extracted from the original image, and the image processing unit is acquired from the extraction condition storage unit. An area extraction process may be performed on the original image according to an extraction condition to generate the first processing target image.

  Accordingly, it is possible to automatically extract a region satisfying the extraction condition without specifying a region to be extracted every time image processing is performed.

  In one aspect of the present invention, the transmission processing unit transmits information on the first result image to the information terminal device, and the reception processing unit performs the user's response to the first result image. Information of an additional input image may be received from the information terminal device as the reaction information to be displayed, and the image processing unit may perform the second image processing based on the additional input image.

  As a result, it is possible to perform the second image processing without taking again the first processing target image used by the user for the first image processing.

  In the aspect of the invention, the image processing unit performs a first panoramic image generation process on a plurality of processing target images to generate a first panoramic image, and the transmission processing unit is generated. The information of the first panoramic image is transmitted to the information terminal device, and the reception processing unit receives the information of the additional input image from the information terminal device as the reaction information for the first panoramic image. The image processing unit performs a second panoramic image generation process based on the received additional input image and the plurality of processing target images to generate a second panoramic image, and the transmission processing unit includes: Information on the generated second panoramic image may be transmitted to the information terminal device.

  Accordingly, for example, the first result image is not as expected by the user, and it is possible to replace a part of the image used for the first image processing and use another image as the second processing target image. Become.

  In the aspect of the invention, the image processing unit performs a first panoramic image generation process on a plurality of processing target images to generate a first panoramic image, and the transmission processing unit is generated. The information of the first panoramic image is transmitted to the information terminal device, and the reception processing unit receives the information of the additional input image from the information terminal device as the reaction information for the first panoramic image. The image processing unit performs a second panoramic image generation process based on the received additional input image and the first panoramic image to generate a second panoramic image, and the transmission processing unit includes: Information on the generated second panoramic image may be transmitted to the information terminal device.

  Thereby, for example, when the first result image is as expected by the user, but when it is desired to add an image to the first result image to compensate for the lacking portion, the first image processing result is used. The second image processing can be performed using the additional input image.

  In one aspect of the present invention, the reception processing unit receives first processing target image generation information, which is information used to generate the first processing target image, from a first information terminal device, The image processing unit performs a first processing target image generation process on the original image based on the first processing target image generation information, and generates and generates the first processing target image. The first image processing is performed on the first processing target image in accordance with the first image processing parameter, and the transmission processing unit and the information on the generated first result image and the first image The image processing parameters may be transmitted to the second information terminal device, and the reception processing unit may receive the reaction information for the first result image from the second information terminal device.

  Accordingly, the second information terminal device can receive the first result image that is the result of the first image processing started by the first information terminal device.

  In the aspect of the invention, the transmission processing unit transmits the information of the first result image and the first image processing parameter to the second information terminal device, and the reception processing unit Receiving the reaction information for the first result image, which is input by a user of the second information terminal device based on the first image processing parameter, from the second information terminal device; The unit may set the second image processing parameter based on the received reaction information.

  As a result, the user of the second information terminal device can determine the reaction information while referring to the first result image and the first image processing parameter. It is possible to perform the second image processing in accordance with the intention of the user of the information terminal device.

  Moreover, in one aspect of the present invention, it includes a menu screen information generation unit that generates menu screen information for displaying a plurality of original images in a menu, and the menu screen information generation unit is based on the plurality of original images, Menu screen information is generated, the transmission processing unit transmits the generated menu screen information to the information terminal device, and the reception processing unit is configured to display a display unit of the information terminal device based on the transmitted menu screen information. Receiving from the information terminal device the selection information indicating the image selected by the user from the menu screen displayed on the screen, and the image processing unit, based on the selection information, from among the plurality of original images The original image selected by the user is specified, and a first processing target image generation process is performed on the specified original image to generate the first processing target image. It may be.

  This makes it easy for the user to select an original image for image processing.

  In one aspect of the present invention, the transmission processing unit transmits information on the first result image to the information terminal device, and the reception processing unit performs the user's response to the first result image. The reaction information may be received from the information terminal device, and the image processing unit may set the second image processing parameter based on the received reaction information.

  This makes it possible to acquire user reaction information one by one from the information terminal device and perform second image processing reflecting the user's intention.

  In the aspect of the invention, the transmission processing unit transmits the information on the first result image to the information terminal device, and the image processing unit includes the reception processing unit on the first result image. When the reaction information indicating the reaction of the user to the information terminal device is received from the information terminal device, the second image processing parameter is set based on the received reaction information, and the reception processing unit When the information is not received from the information terminal device, the second image processing parameter may be set to a preset value.

  Accordingly, even when the reaction information input by the user is not received, the second image processing reflecting the user's intention can be performed.

  In the aspect of the invention, the reception processing unit may receive an image processing parameter or user operation information as the reaction information.

  Thereby, when the second image processing parameter is directly specified as the reaction information, it becomes possible to accurately reflect a fine user's intention, and when receiving the user operation information as the reaction information, It is possible to adjust the second image processing parameter intuitively.

  According to another aspect of the present invention, the image processing unit includes a parameter storage unit that stores the second image processing parameter in association with user operation information, and the image processing unit includes the second image processing unit associated with the received user operation information. The image processing parameters may be acquired from the parameter storage unit.

  Thus, the information terminal device only needs to send user operation information to the server system, and it is not necessary to perform processing such as recalculating the second image processing parameter each time based on the user operation information. It is possible to shorten the waiting time until the result image is presented.

  Moreover, in one aspect of the present invention, a parameter acquisition unit that acquires the second image processing parameter associated with the received user operation information from the outside may be included.

  Thus, the information terminal device only needs to send user operation information to the server system, and it is not necessary to perform processing such as recalculating the second image processing parameter each time based on the user operation information. It is possible to shorten the waiting time until the result image is presented.

  In the aspect of the invention, the reception processing unit receives the user operation information indicating an instruction to change the tone of the transmitted first result image, and the image processing unit receives The second image processing parameter may be set based on the user operation information.

  Accordingly, the user can input information such as how much the image tone is changed from the first result image as reaction information by operating a GUI such as a slider.

  In the aspect of the invention, the reception processing unit receives the user operation information representing an instruction to change the content of image processing performed on the transmitted first result image, and the image processing unit If it is determined that the user operation information representing the change instruction of the image processing content has been received, the second image processing having a content different from that of the first image processing is applied to the second input image. You may do it for.

  As a result, it is possible to perform second image processing that differs from the first image processing.

  In the aspect of the invention, the image processing unit performs the first image processing on the first processing target image according to a plurality of first image processing parameters, and a plurality of first results. An image is generated, and the transmission processing unit transmits information on the plurality of generated first result images to the information terminal device, and the image processing unit transmits the plurality of first results that have been transmitted. As the reaction information for the image, selection information indicating which of the plurality of first result images is selected is acquired, and the second processing target image is acquired based on the acquired selection information. The second image processing is performed on the second result image to generate the second result image, and the transmission processing unit may transmit the information on the generated second result image to the information terminal device. Good.

  Accordingly, the user can select a favorite first result image from among the plurality of presented first result images, and can perform second image processing with contents matching the user's intention. Become.

  Another aspect of the present invention includes a server system and an information terminal device, wherein the server system performs a first image processing on a first processing target image according to a first image processing parameter, Generating a first result image, transmitting information of the generated first result image to the information terminal device via a network, the information terminal device displaying the received first result image; The server system sets a second image processing parameter based on reaction information indicating a user's reaction to the first result image, and is a second processing target that is an original image or an image generated from the original image The image is subjected to second image processing in accordance with the set second image processing parameter, a second result image is generated, and information on the generated second result image is transmitted to the information terminal device. Ne And transmitted via network, the information terminal device is related to the image processing system of displaying a second result image received.

  Another aspect of the present invention relates to a program that causes a computer to function as each of the above-described units.

  According to another aspect of the present invention, the first processing target image is subjected to first image processing according to a first image processing parameter to generate a first result image, and the generated first image Information of the result image is transmitted to the information terminal device via the network, a second image processing parameter is set based on reaction information indicating a user reaction to the first result image, and the original image or the A second image processing is performed on the second processing target image, which is an image generated from the original image, in accordance with the set second image processing parameter, and a second result image is generated. The present invention relates to an image processing method for transmitting information on the second result image to the information terminal device via the network.

The system configuration example of 1st Embodiment-4th Embodiment. Basic system configuration example. 1 is a detailed system configuration example according to a first embodiment. 4A and 4B are examples of the processing target image and the result image in the first embodiment. Explanatory drawing of the flow of the data in 1st Embodiment. FIGS. 6A to 6C are transition diagrams of display screens of the information terminal device according to the first embodiment. The sequence diagram explaining the flow of a process of 1st Embodiment. The detailed system configuration example of 2nd Embodiment. Explanatory drawing of the flow of the data in 2nd Embodiment. FIG. 10A to FIG. 10D are transition diagrams of display screens of the information terminal device according to the second embodiment. The detailed system configuration example of 3rd Embodiment. Explanatory drawing of the flow of the data in 3rd Embodiment. FIGS. 13A to 13D are transition diagrams of display screens of the information terminal device according to the third embodiment. The detailed system configuration example of 4th Embodiment. FIGS. 15A and 15B are examples of the processing target image and the result image in the fourth embodiment. Explanatory drawing of the flow of the data in 4th Embodiment. FIGS. 17A to 17D are transition diagrams of display screens of the information terminal device according to the fourth embodiment. Explanatory drawing in the case of performing image processing with respect to a moving image. Explanatory drawing in the case of producing | generating several 1st result image.

  Hereinafter, the first to fourth embodiments will be described. First, an outline of the method of each embodiment will be described, and then a basic system configuration example will be described. Then, the flow of processing performed in the first to fourth embodiments will be described using flowcharts and the like. In addition, each embodiment described below does not unduly limit the content of the present invention described in the claims. In addition, all the configurations described in the embodiments are not necessarily essential configuration requirements of the invention.

1. Overview In recent years, with the development of Internet technology, all processing is not performed within a single information terminal, but a part of the processing is performed by an external server device (server system) via the network. There has been an increase in the use form of computers that receive the processing results via the Internet. Such a utilization form is called so-called cloud computing.

  As an example of such a technique, for example, an image is captured by an information terminal device such as a camera-equipped mobile phone, and image processing is performed on the captured image by an external server device or the like via a network. There is a technique for receiving an image of a processing result.

  Here, a user who frequently performs image processing often pays attention to the length of the waiting time until the image processing result is presented after the user gives an instruction to start image processing.

  In this regard, in the image processing system as described above, the processing speed is increased by placing a part of the processing on a server device or the like having a higher processing capacity than the information terminal device, thereby reducing the image processing time. Shorten.

  However, on the other hand, a communication waiting time is newly generated while the information terminal device and the server device communicate with each other via the network. If the communication waiting time is long, even if the image processing time can be shortened, the total waiting time of the user is not shortened.

  Therefore, in the image processing system as described above, in order to shorten the total waiting time, it is necessary not only to shorten the image processing time but also to shorten the communication waiting time. In addition, a complete image processing result is not always required from the beginning, and it is often considered that it is only necessary to obtain a result image to the extent that an overview of the image processing result can be grasped.

  Therefore, in the following embodiment, a preview image is presented in order to shorten the waiting time from the start of image processing until the user confirms the processing result for the first time. As will be described in detail later, for example, the preview image is an image having a smaller size than the original image, so both the image processing time and the communication waiting time can be shortened, and the user confirms the processing result for the first time. It is possible to shorten the time until

  Although the story changes, the image processing results are not always as intended by the user, and the image processing results often do not conform to the user's intention. In such a case, it is conceivable that the same image processing is performed again by redesignating the image processing parameters and the like.

  However, when image processing is performed again, a waiting time almost twice as long is required until an image according to the user's intention is acquired. If the user is not satisfied even with the result of redoing, the image processing is restarted from the beginning, and the waiting time is increased by the number of times of redoing the image processing.

  In addition, when the image processing is performed again, it is not necessary to perform the image processing from the beginning with the image processing parameters used in the last image processing because it is unnecessary except for the result of the last image processing. It is. From such an idea, the user feels that the time taken for image processing other than the last image processing was wasted time, and may feel dissatisfied with the image processing service using such an image processing system. is there. Such a situation is undesirable for the service provider.

  However, in practice, it is often difficult for the user to specify the ideal image processing parameters from the beginning, so the results of each processing, that is, preview images, are presented to the user from the viewpoint of improving usability. This process is useful and necessary.

  Therefore, in summary, the image processing (last image processing) according to the user's intention is performed for the image processing (each image processing other than the last image processing) that outputs a result that does not conform to the user's intention. The problem is that it takes the same waiting time as when it is performed, and it is desirable to spend as little time as possible for image processing that outputs a result that does not meet the user's intention. More specifically, if the timing for displaying the preview image to the user can be made as early as possible, the user will not feel dissatisfied.

  Therefore, in the server systems and the like according to the first to fourth embodiments, which will be described in detail later, the waiting time until the image processing result is presented to the user for the first time after the image processing is started is shortened.

  Further, as a specific example of displaying the above-described preview image, there is an invention relating to a client-server type image tone conversion service system disclosed in Patent Document 1 described above. Here, the outline of the invention disclosed in Patent Document 1 will be briefly described.

  In the invention disclosed in Patent Document 1, first, the information terminal device (terminal, image display device) selects a reduced image to be subjected to the tone conversion process from among a plurality of reduced images of the original image (main image) ( The selected reduced image is transmitted to the server apparatus (server). Further, the information terminal device selects (specifies) the type of image tone and transmits it to the server device.

  On the other hand, the server device performs a tone conversion process on the selected reduced image with the selected type of image tone, and transmits the image tone conversion process result to the information terminal device. Note that the image tone conversion processing result transmitted here corresponds to the preview image described above.

  At this time, the information terminal device may respecify an image tone type different from the previously transmitted image tone type and transmit this to the server device. In this case, the server device performs a tone conversion process on the reduced image based on the type of tone specified again, and transmits the tone conversion processing result to the information terminal device as in the previous case. .

  The information terminal device receives the tone conversion processing result, displays the processing result image on the display unit, designates the original image of the reduced image that was the processing target, and designates the designated original image as the server device Send to.

  On the other hand, the server device performs the same tone conversion processing as that performed on the reduced image for the designated original image, and transmits the processing result to the information terminal device. Then, the information terminal device displays the processing result image on the display unit. The above is the outline of the invention disclosed in Patent Document 1.

  Further, Patent Document 2 described above discloses an invention in which a different image processing filter is applied each time a reduced image to be processed is clicked. Similar to the invention of Patent Document 1, the same image processing is always performed on the reduced image and the preview image is displayed before performing the image processing on the original image.

  As described above, in the inventions disclosed in Patent Document 1 and Patent Document 2, as compared with the method of performing image processing on the original image every time, the image processing result is presented to the user for the first time after starting the image processing. The waiting time can be shortened.

  However, as described above, in the invention of Patent Document 1, when image processing is performed on an original image, the same image processing as that performed on the reduced image is performed. That is, when image processing is performed on the original image, the content of the image processing cannot be changed from the content of the previous image processing to another content. In other words, a preview image having the same content must be generated and displayed on the display unit before image processing is performed on the original image. This is because the user's reaction to the preview image cannot be directly reflected in the image processing for the original image.

  However, in a scene where such an image processing system or the like is actually used, it is not always necessary to refer to the preview image every time. In some cases, it may be better for the server system to perform image processing on the original image based on the changes and to allow the user to refer to the result. In this case, as will be described later, unnecessary communication processing and the like may be omitted, so that the total waiting time can be further reduced as compared with the invention of Patent Document 1.

  Therefore, in the first embodiment to be described later, the server system receives user reaction information for the first image processing result (preview image), and based on the received reaction information, the second image for the original image. Process. In addition, an example in which processing for generating a processing target image for the first image processing and processing for generating a processing target image for the second image processing is performed will be described.

  Further, in the invention disclosed in Patent Document 1 described above, the target of image processing for generating a preview image is limited to a reduced image. No information is disclosed about such cases.

  Therefore, a server system or the like according to the second embodiment described later performs a user face area extraction process as the first process target image generation process.

  Furthermore, when performing the panoramic image synthesis process, the server system or the like according to the third embodiment receives an additional input image as reaction information after the first image processing, and uses the additional input image as a second image. Process.

  Then, the server system or the like according to the fourth embodiment receives the original image from the first information terminal device, and transmits the image processing result to the second information terminal device.

2. System Configuration Example Next, a configuration example of a server system according to first to fourth embodiments and an image processing system including the server system will be described with reference to FIG.

  Server system 100 communicates with an information terminal device via network 500. The server system 100 may be configured by a single server device or may be configured by a plurality of server devices connected via a network.

  Further, the information terminal device that communicates with the server system 100 may be one or plural. For example, in FIG. 1, three terminal devices of a first information terminal device 200, a second information terminal device 300, and a third information terminal device 400 are illustrated as information terminal devices that communicate with the server system 100. Show.

  More specifically, the first information terminal device 200 illustrated in FIG. 1 is a smartphone, the second information terminal device 300 is a tablet terminal (multifunctional mobile terminal, tablet PC), and third information The terminal device 400 is a personal computer (PC). However, these are merely examples, and the server system 100 communicates with information terminal devices other than the examples given here, such as HMD (Head Mounted Display), handheld PC, feature phone (future phone), and the like. May be.

  The network 500 may be the Internet or an intranet.

  The image processing system includes the server system 100, and may further include a first information terminal device 200, a second information terminal device 300, a third information terminal device 400, and the like.

  Next, a detailed basic configuration example of the server system 100 according to a first embodiment to a fourth embodiment, which will be described later, will be described with reference to FIG. FIG. 2 shows an example in which the server system 100 communicates with the information terminal device 200 (first information terminal device 200).

  The server system 100 includes an image processing unit 110, a reception processing unit 120, and a transmission processing unit 130. The server system 100 is not limited to the configuration of FIG. 2, and various modifications such as omitting some of these components or adding other components are possible. As described above, when the server system 100 includes a plurality of server devices, the functions of the image processing unit 110, the reception processing unit 120, and the transmission processing unit 130 are realized by different server devices. May be.

  Next, the connection of each part is demonstrated. The image processing unit 110 is connected to the transmission processing unit 130. The reception processing unit 120 is connected to the image processing unit 110. The transmission processing unit 130 is connected to the reception processing unit 220 of the information terminal device 200.

  Next, processing performed in each unit of the server system 100 will be described. First, the image processing unit 110 performs image processing on the processing target image.

  Next, the reception processing unit 120 performs processing for receiving information about the processing target image from the transmission processing unit 230 of the information terminal device 200 via the network 500.

  Further, the transmission processing unit 130 performs processing for transmitting information such as a result image after image processing to the reception processing unit 220 of the information terminal device 200 via the network 500.

  Note that the functions of the image processing unit 110, the reception processing unit 120, and the transmission processing unit 130 can be realized by hardware such as various processors (CPU, etc.), ASIC (gate array, etc.), GPU, and programs. Although not shown in FIG. 2, the server system 100 may have an antenna unit, and the reception processing unit 120 and the transmission processing unit 130 control the antenna unit, and the antenna unit is each information terminal device. Wireless communication may be performed. Further, the server system 100 is not limited to one that communicates with each information terminal device wirelessly, and may communicate with each information terminal device by wire.

  Next, the information terminal device 200 of FIG. 2 will be described. The information terminal device 200 includes a display unit 210, a reception processing unit 220, a transmission processing unit 230, and a user interface unit 240. The information terminal device 200 is not limited to the configuration in FIG. 2, and various modifications such as omitting some of these components or adding other components are possible.

  Next, processing performed in each unit of the information terminal device 200 will be described. First, the display unit 210 displays the acquired image. The display unit 210 is a liquid crystal, for example. In addition, the display unit 210 may be an organic EL panel, electronic paper, or the like.

  Next, the reception processing unit 220 performs processing for receiving information such as a result image of the image processing from the transmission processing unit 130 of the server system 100 via the network 500.

  Then, the transmission processing unit 230 performs processing for transmitting information such as a processing target image to the reception processing unit 120 of the server system 100 via the network 500.

  Furthermore, the user interface unit 240 acquires input information from the user. The user interface unit 240 may be an operation unit. In this case, for example, the user interface unit 240 may be configured by a keyboard, a mouse, a touch panel, or the like.

  Further, the information terminal device 200 may have a storage unit not shown in FIG. 2 and may store information such as the received result image. Furthermore, the information terminal device 200 may have an imaging unit (not shown) or may be configured to capture an image. In addition, the information terminal device 200 may be configured to read video data from an external server or the like by the reception processing unit 220.

  Note that the functions of the server system 100 and the information terminal device 200 may be realized by software operating on a processor.

3. 3. First Embodiment 3.1. System Configuration Example FIG. 3 shows a system configuration example of a server system 100 and an image processing system including the server system 100 according to the first embodiment. A difference from the basic configuration example of FIG. 2 is that an image storage unit 140, a parameter storage unit 150, and a menu screen information generation unit 160 are provided. In the following, description of the same points as in the basic configuration example of FIG. 2 is omitted.

  Next, the connection of each part is demonstrated. The image processing unit 110 is connected to the transmission processing unit 130 and the image storage unit 140. The image storage unit 140 is connected to the image processing unit 110 and the menu screen information generation unit 160. The parameter storage unit 150 is connected to the image processing unit 110. The menu screen information generation unit 160 is connected to the transmission processing unit 130.

  Next, processing performed in each unit of the server system 100 will be described.

  First, the image processing unit 110 performs first image processing on the first processing target image, and performs second image processing on the second processing target image. Note that the first image processing and the second image processing may have the same contents or different contents.

  Next, the image storage unit 140 stores the received image. Specifically, the image storage unit 140 performs a read process or a write process on the received image in accordance with an instruction from the image processing unit 110.

  Further, the parameter storage unit 150 stores user operation information such as GUI (Graphical User Interface) operation information and image processing parameters in association with each other.

  The functions of the image storage unit 140 and the parameter storage unit 150 can be realized by a memory such as a RAM or an HDD.

  Then, the menu screen information generation unit 160 generates an image list generated from the image to be processed based on the image information stored in the image storage unit 140. The function of the menu screen information generation unit 160 can be realized by hardware such as various processors (CPU and the like), ASIC (gate array and the like), GPU, and programs.

3.2. Details of Processing First, image processing performed by the server system 100 of the present embodiment will be briefly described. Here, for example, the original image BIM shown in FIG. 4A is used as an input image (processing target image) for image processing. In the image processing according to the present embodiment, the edge of the original image BIM is detected, trimmed and emphasized, and converted into an illustration-like image to generate an image AIM as shown in FIG. In this image processing, an output image is generated without changing the size of the input image. However, the type of image processing is not limited to this, and other image processing contents may be selected.

  Next, the details of the processing flow of this embodiment will be described. In explaining the flow of processing, FIG. 5 shows a data flow, FIGS. 6A to 6C show screen transition diagrams of the display unit 210 of the information terminal device 200, and FIG. 7 shows a processing sequence. The figure is shown. In FIG. 7, for the sake of illustration, the image storage unit 140, the parameter storage unit 150, the menu screen information generation unit 160, and each unit of the information terminal device 200 (display unit 210, reception processing unit 220, transmission processing) of the server system 100 are illustrated. Section 230 and user interface section 240) are omitted.

  Hereinafter, the flow of processing will be described along the time stamps (T101 to T118) in the sequence diagram of FIG. 7 with reference to FIGS. 5 and 6A to 6C.

  First, the server system 100 (SV in FIG. 5) uses the menu screen information generation unit 160 to generate information on a list of original images (menu screen) stored in the image storage unit 140 (T101), and the generated menu screen The information is transmitted to the transmission processing unit 130 (T102), and the transmission processing unit 130 transmits the menu screen information to the information terminal device 200 (TU in FIG. 5) (T103). Then, the information terminal device 200 displays an image list of the original image on the display unit 210 based on the received menu screen information. The menu screen information is generated by the menu screen information generation unit 160 as described above, but the information terminal device 200 may appropriately display and display an image in accordance with the screen size of the display unit 210 or the like. In this example, the menu screen information generation unit 160 generates menu screen information as a web page, and the information terminal device 200 renders the web page. At this time, an image list such as DIM1 in FIG. 6A is displayed on the display unit of the information terminal device 200, for example.

  Next, the user selects an original image for image processing from the image list displayed on the display unit 210 of the information terminal device 200, and selects selection information of the selected original image via the user interface unit 240. input. As an example, in FIG. 5, the original image PIM is selected.

  Then, the user interface unit 240 transmits the acquired selection information to the reception processing unit 120 of the server system 100 via the transmission processing unit 230 (T104). Note that the original image specified by the user can be uniquely accessed on the server system 100. In this embodiment, the case where the image data of the selected original image itself is transmitted as selection information will be described. However, as will be described later, the selection information is not necessarily the image data itself of the selected original image. .

  On the other hand, when receiving the selection information, the reception processing unit 120 of the server system 100 transmits the selection information to the image processing unit 110 (T105).

  Then, as illustrated in FIG. 5, the image processing unit 110 performs a first processing target image generation process (reduction processing) PP1 on the selected original image PIM to generate a first processing target image IIM1. (T106). In the first processing target image generation process PP1, for example, the received original image PIM is reduced or compressed to perform a process of converting into an image having a data amount smaller than that of the original image.

  Next, the first image processing (filtering) IMP1 described with reference to FIG. 4 is performed on the generated first processing target image IIM1 to generate the first result image OIM1 (T107). That is, the first image processing IMP1 is performed on the image IIM1 obtained by reducing the original image. Therefore, it is possible to perform image processing in a shorter time than performing similar image processing on the original image PIM. Note that the image storage unit 140 stores the original image PIM for the second processing (second image processing IMP2).

  In the present embodiment, the first processing target image generation process PP1 is performed by the image processing unit 110. However, the present invention is not limited to this, and may be performed by the reception processing unit 120 or the information terminal device 200. The contents of the first process target image generation process PP1 can be specified (selected or changed) by first process target image generation information described later.

  Then, the image processing unit 110 transmits the first result image OIM1 to the transmission processing unit 130 (T108), and the transmission processing unit 130 transmits the first result image OIM1 to the information terminal device 200 (T109).

  On the other hand, the information terminal device 200 displays the received first result image OIM1 on the display unit 210 (T110). At this time, for example, an image such as DIM2 in FIG.

  Then, in order to perform the second image processing IMP2 more reflecting the user's intention, the user who viewed the displayed first result image OIM1 inputs user input information via the user interface unit 240 (T111). ). Specifically, the information input by the user at this time is as follows. For example, if the content of the first result image OIM1 is sufficiently in line with the user's intention and the user determines that it is not necessary to change the content of the image processing, the same processing as the first image processing IMP1 is performed. Instructs the image to be performed. On the other hand, when the user feels that the content of the first result image OIM1 is not as intended by the user, for example, the line is finer than intended, or the image processing is performed only on a part of the original image PIM. If you think that, enter the information to indicate them.

  Further, the user input information includes second processing target image generation information CIF shown in FIG. 5 and reaction information RIF for the first image processing IMP1. The user input information may be GUI operation information or the like.

  The second processing target image generation information CIF is information used to generate a second processing target image IIM2 that becomes an input of a second image processing IMP2, which will be described later, and is, for example, region extraction information. . As a specific example of inputting the region extraction information, FIG. 6B shows a state where a predetermined region of the display image DIM2 is selected (designated) like DA. In the example of FIG. 6B, the information terminal device 200 acquires the coordinates and the like of the selected area as area extraction information.

  Further, as the reaction information, the strength of filter processing such as the thickness of edge drawing is set. Specifically, FIG. 6B shows a state where the slider SL is operated on the GUI so as to increase the thickness of the edge.

  Then, the transmission processing unit 230 of the information terminal device 200 transmits user input information to the reception processing unit 120 of the server system 100 (T112), and the reception processing unit 120 transmits the received user input information to the image processing unit 110. (T113). In this example, since the original image is transmitted at T104 and T105, only the user input information is transmitted without transmitting the original image.

  Next, the image processing unit 110 performs the second processing target image generation processing PP2 on the original image based on the second processing target image generation information included in the acquired user input information (T114). Specifically, the region extraction process is performed here to generate the second processing target image IIM2. In the present embodiment, the second processing target image generation process PP2 is performed by the image processing unit 110, but may be performed by the reception processing unit 120 or the information terminal device 200. Further, enlargement / reduction processing, compression processing, or the like may be performed on the image after region extraction as necessary. In that case, for example, the size is adjusted according to the size of the display panel of the information terminal device 200.

  Furthermore, the image processing unit 110 specifies the second image processing parameter based on the reaction information included in the acquired user input information. In this example, the server system 100 stores GUI operation information in the parameter storage unit 150 in association with image processing parameters. Therefore, if the GUI operation information is designated, the corresponding image processing parameter can be read out. Note that conversion from GUI operation information to image processing parameters may be performed on the information terminal device 200. The second processing target image generation information described above may also be stored in association with GUI operation information.

  Then, based on the specified second image processing parameter, second image processing (filter processing) IMP2 is performed on the second processing target image IIM2, and a second result image OIM2 is generated (T115). Specifically, in the present embodiment, the thickness of edge drawing is reset according to the second image processing parameter, and the second image processing is performed.

  Thereafter, the image processing unit 110 transmits the second result image OIM2 to the transmission processing unit 130 (T116), and the transmission processing unit 130 transmits the second result image OIM2 to the reception processing unit 220 of the information terminal device 200. (T117). Then, the information terminal device 200 displays the second result image OIM2 on the display unit 210 (T118). At this time, for example, an image such as DIM3 in FIG.

3.3. Method Next, the method of the present embodiment will be described.

  The server system 100 according to the present embodiment described above includes the reception processing unit 120 that performs information reception processing with the information terminal device 200 via the network 500, and the image processing unit 110 that performs image processing on the processing target image. And a transmission processing unit 130 that performs transmission processing of information with the information terminal device 200 via the network 500. First, the image processing unit 110 performs first image processing on the first processing target image according to the first image processing parameter, and generates a first result image. Next, the transmission processing unit 130 transmits information on the generated first result image to the information terminal device 200. Then, the image processing unit 110 sets the second image processing parameter based on the reaction information indicating the user's reaction to the first result image, and performs the second process that is an original image or an image generated from the original image. A second image process is performed on the target image in accordance with the set second image processing parameter, and a second result image is generated. Further, the transmission processing unit 130 transmits information on the generated second result image to the information terminal device 200.

  In other words, the above operation can be restated as follows as the operation of the image processing system including the server system 100 and the information terminal device 200.

  First, the server system 100 performs first image processing on the first processing target image according to the first image processing parameter, generates a first result image, and information on the generated first result image. Is transmitted to the information terminal device 200 via the network 500.

  Then, the information terminal device 200 displays the received first result image.

  On the other hand, the server system 100 sets the second image processing parameter based on the reaction information indicating the user's reaction to the first result image, and the second processing target is an original image or an image generated from the original image. The image is subjected to the second image processing according to the set second image processing parameter, the second result image is generated, and the information of the generated second result image is transmitted to the information terminal device 200 through the network 500. Send through.

  On the other hand, the information terminal device 200 displays the received second result image on the display unit 210.

  Here, the original image refers to an image that is a source of a processing target image described later. Specifically, it refers to a captured image captured by the information terminal device 200, an image acquired by the information terminal device 200 from an external server device or the like via a network, and the like.

  The processing target image refers to an image that is a direct target of image processing. In other words, the processing target image is an image input to the image processing.

  The first processing target image is an image that is a target of the first image processing among the processing target images described above. As will be described later, the first processing target image may be an image generated from the original image by the first processing target image generation processing according to the first processing target image generation information, or the original image itself. There may be. Further, the first processing target image may be, for example, an image (reduced image or enlarged image) obtained by resizing the original image at a predetermined ratio, or a compressed image having a higher compression ratio than the original image. Alternatively, an image obtained by extracting a predetermined partial area from the original image may be used. That is, the first processing target image is based on the first processing target image generation information stored in advance in the server system 100 without receiving first processing target image generation information described later from the information terminal device 200. Includes generated images.

  On the other hand, the second processing target image refers to an image to be subjected to the second image processing among the processing target images described above. Similar to the first processing target image, the second processing target image is an image generated from the original image by the second processing target image generation processing according to second processing target image generation information described later (for example, reduced) Image, compressed image, partial image, etc.) or the original image itself. Note that the acquisition path of the second processing target image generation information does not matter as in the case of the first processing target image.

  Here, the data amount (data size) of the first processing target image is desirably smaller than the data amount of the second processing target image. In this case, the processing amount of the first image processing is smaller than the processing amount of the second image processing, and the time required for the first image processing is made shorter than the time required for the second image processing. It becomes possible.

  Furthermore, in the first image processing and the second image processing, since the size of the image is not changed, the data amount of the first result image becomes smaller than the data amount of the second result image, The transmission time of the result image can be made shorter than the transmission time of the second result image.

  Here, the first result image refers to an image generated as a result of the first image processing. Further, the information of the first result image may be the first result image itself, or other information such as link information (URL or the like) to an external server storing the first result image, for example. It may be. As will be described in detail later, a plurality of first result images may be provided.

  Similarly, the second result image is an image generated as a result of the second image processing.

  Therefore, when the size of the first processing target image is smaller than the size of the second processing target image, the first processing target image is smaller than the first processing and the second image processing in comparison with the case where image processing is performed. The time required for the image processing and the transmission time of the first result image can be shortened, and the waiting time until the image processing result is presented to the user for the first time after the image processing is started can be shortened.

  Further, as described above, in the invention of Patent Document 1, the user's reaction to the preview image cannot be directly reflected in the image processing for the original image. A preview image with the same content must be generated. That is, until the content of the preview image is in line with the user's intention, the first image processing in the present embodiment must be repeated.

  However, in a scene where such an image processing system or the like is actually used, it is not always necessary to refer to the preview image every time.

  Therefore, in the present embodiment, the server system 100 performs the second image processing on the second processing target image based on the reaction information on the user preview image, and the result is displayed on the display unit 210 of the information terminal device 200. Display.

  Here, the reaction information refers to information indicating a user's reaction to the first result image. Specifically, the reaction information indicates information indicating whether or not a parameter is changed, an image processing parameter after the change, and the like as in the above-described example.

  In the present embodiment, the second image processing parameter is set (changed) according to the reaction information. Therefore, when the reaction information includes information for instructing parameter change, the second image processing parameter is changed. On the other hand, when the reaction information includes information that does not change the parameter change, the same value as the first image processing parameter is used as the second image processing parameter. That is, the second image processing parameter may be the same as or different from the first image processing parameter.

  Therefore, in the present embodiment, the total waiting time can be further reduced as compared with the invention of Patent Document 1 while reflecting the user's intention more in the image processing result. As a result, the user can check the image processing result at a faster timing.

  Specifically, for example, when the content of the second image processing is changed from the content of the first image processing, in the invention of Patent Document 1, the first image processing (preview image generation processing) is performed twice. In this embodiment, the first image processing is performed once, while the second image processing needs to be performed once and the communication processing needs to be performed five times in total (when transmission processing and reception processing are counted separately). It is only necessary to perform the second image processing once and the communication processing three times in total. That is, the first image processing for one time and the communication processing for two times can be omitted.

  Further, the reception processing unit 120 may receive reaction information indicating a user's reaction to the first result image from the information terminal device 200. Then, the image processing unit 110 may set the second image processing parameter based on the received reaction information.

  This makes it possible to acquire user reaction information one by one from the information terminal device and perform second image processing reflecting the user's intention.

  In addition, for example, when the user does not like the first result image and wants to make a correction, the reaction information is input via the user interface unit 240 of the information terminal device 200, and only in this case. The reception processing unit 120 of the server system 100 may receive the reaction information.

  On the other hand, when the user determines that the first result image is as expected by the user and the second image processing may be performed as it is, the information terminal device 200 transmits the reaction information to the server system 100. You don't have to. In this case, the reception processing unit 120 of the server system 100 does not receive the reaction information, but in this case, “no response is returned from the information terminal device 200” itself is the reaction information. When the content of the response information is “no response is returned from the information terminal device 200”, the image processing unit 110 performs the second image processing with the same content as the first image processing. You may go.

  However, when the content of the response information is “no response is returned from the information terminal device 200”, the image processing unit 110 does not necessarily perform the second image processing with the same content as the first image processing. However, for example, second image processing in which a predetermined change is made to the contents of the first image processing may be performed. Further, the operation of the image processing unit 110 in this case may be fixed or changeable.

  That is, the transmission processing unit 130 may transmit information of the first result image to the information terminal device 200. Then, when the reception processing unit 120 receives the reaction information indicating the user's response to the first result image from the information terminal device 200, the image processing unit 110 performs the second processing based on the received reaction information. Image processing parameters may be set. On the other hand, the image processing unit 110 may set the second image processing parameter to a preset value when the reception processing unit 120 does not receive the reaction information from the information terminal device 200.

  Accordingly, even when the reaction information input by the user is not received, the second image processing reflecting the user's intention can be performed.

  Specifically, the reception processing unit 120 may receive image processing parameters or user operation information as reaction information. Here, the user operation information refers to information such as GUI operation information and operation history, for example.

  As a result, when the second image processing parameter is directly specified as the reaction information, it is possible to accurately reflect a fine user's intention.

  On the other hand, when user operation information is received as reaction information, even if the user is not guided by detailed image processing settings and cannot set the image processing parameter values himself, It is possible to adjust the second image processing parameter.

  More specifically, the reception processing unit 120 may receive, as reaction information, user operation information that represents an instruction to change the tone of the transmitted first result image. Then, the image processing unit 110 may set the second image processing parameter based on the received user operation information.

  In addition, changing the tone of tone means changing the hue, brightness, and saturation of an image. For example, in the second image processing in the example of FIG. 5, the image tone is changed so that the line is thicker than the first result image OIM1.

  Thereby, the user inputs information such as how much the tone is changed from the first result image by operating a GUI such as the slider SL shown in FIG. Is possible.

  The server system 100 according to the present embodiment may include a parameter storage unit 150 that stores the second image processing parameter in association with the user operation information. Then, the image processing unit 110 may acquire the second image processing parameter associated with the received user operation information from the parameter storage unit 150.

  Alternatively, the server system 100 of the present embodiment may include a parameter acquisition unit 170 that externally acquires the second image processing parameter associated with the received user operation information.

  Thereby, if user operation information is designated, it becomes possible to acquire the 2nd image processing parameter. Therefore, the information terminal device 200 only needs to send user operation information to the server system 100, and it is not necessary to perform processing such as recalculating the second image processing parameter each time based on the user operation information. As a result, it is possible to shorten the waiting time until the image is presented.

  Further, when user operation information and image processing parameters are stored in an external server device, these associations can be managed collectively.

  In addition to the second image processing parameter, information such as first processing target image generation information, second processing target image generation information, first image processing parameter, reaction information, and original image selection information described later. The entity may also be user operation information, or when such information is not user operation information, these information and user operation information may be stored in association with each other or acquired in association with each other. .

  As described above, in order to shorten the waiting time until the first result image is presented, it is necessary to make the data size of the first processing target image smaller than the data size of the original image. However, in this case, the image quality of the first result image is relatively deteriorated. On the other hand, in order to improve the image quality of the first result image, it is necessary to increase the data size of the first result image, and in this case, the waiting time becomes long. That is, the waiting time until the first result image is presented and the image quality of the first result image are in a trade-off relationship.

  Therefore, the image quality and the waiting time of the first result image to be obtained are different for each user, and it is desirable that the user can adjust them to a state suitable for him / her.

  In addition, there are other cases in which a part of the original image is cut out and an image obtained as a result of image processing only on the cut-out area is obtained.

  Therefore, the reception processing unit 120 may receive first processing target image generation information, which is information used to generate the first processing target image, from the information terminal device 200. Then, the image processing unit 110 performs a first processing target image generation process on the original image based on the first processing target image generation information, generates a first processing target image, and generates the generated first processing target image. The first image processing may be performed on one processing target image according to the first image processing parameter.

  Here, the first processing target image generation information is information used for generating the first processing target image, and may be, for example, a resizing ratio, or information specifying a partial area to be extracted (described later). Area designating information), or information designating the image compression rate.

  Thereby, the user can adjust the waiting time or the like until the first result image is presented by the first processing target image generation information. Since the first result image is used as a so-called preview image, it is generally sufficient that the image quality is such that the content of the image can be confirmed, and it is considered that a shorter waiting time is more important.

  Furthermore, it is possible to determine (set) the size of the first result image, the partial area of the original image input to the first image processing, and the like.

  Here, the first process target image generation process is a process of generating the first process target image as described above. Specifically, for example, a resize process of the original image may be performed.

  That is, the reception processing unit 120 may receive the size change instruction information as the first processing target image generation information. Then, the image processing unit 110 may perform a resizing process on the original image based on the received size change instruction information to generate a first processing target image.

  Here, the size change instruction information (resizing information) indicates the ratio of the first processing target image to the original image (resizing ratio), the size of the first processing target image itself, and the like. In this embodiment, since the reduction process is mainly performed on the original image, a size smaller than the original image is often specified.

  The size change instruction information may be GUI operation information, for example, information representing an operation of tracing an image displayed on the display unit 210 with a finger. In that case, the size change instruction information may be vector information indicating the movement of the finger.

  Thereby, for example, it is possible to generate a first processing target image, which is a reduced image having a smaller size than the original image, from the original image.

  In addition, region extraction processing may be performed on the original image as the first processing target image generation processing.

  That is, the reception processing unit 120 may receive region designation information that is information for designating a region to be extracted from the original image as the first processing target image generation information. Then, the image processing unit 110 may generate a first processing target image by performing region extraction processing on the original image based on the received region designation information.

  Here, the area designation information is information for designating a partial area of the original image. The area designation information may be absolute coordinates (absolute position) of a partial area in the original image, or may be relative coordinates (relative position). As a specific example of the relative position, for example, when extracting a region away from a human face in the image by a predetermined number of pixels, the number of pixels around the face can be cited. Note that the area designation information may designate the entire original image. The area designation information may also be GUI operation information, similar to the size change instruction information.

  This makes it possible to generate a first processing target image that is a partial image of the original image from the original image.

  Similarly to the first processing target image, the second processing target image may be generated by the second processing target image generation process.

  That is, the reception processing unit 120 may receive second processing target image generation information that is information used to generate a second processing target image from the information terminal device 200. Then, the image processing unit 110 performs a second processing target image generation process on the original image based on the second processing target image generation information, generates a second processing target image, and generates the generated second processing target image. The second image processing may be performed on the second processing target image according to the second image processing parameter.

  Here, the second processing target image generation information is information used to generate the second processing target image, and the content thereof is the same as the first processing target image generation information described above. However, unlike the first processing target image generation information, the second processing target image generation information may be input at the same time as the reaction information, may be integrated with the reaction information, and the contents may overlap. For example, consider a case where a range is selected by moving a finger on the touch panel when a range corresponding to the second processing target image in the original image is designated. At this time, it is also assumed that the thickness of all the lines included in the range selected as the second processing target image is changed to a predetermined thickness. In this case, the user once moves his / her finger on the touch panel to specify a range corresponding to the second processing target image in the original image, and at the same time, select the selected range as a range for changing the line thickness. Identify. That is, in order to specify the range corresponding to the second processing target image and the range where the line is thickened, the user does not move the finger twice to select the same range, but moves the finger only once, Determine both ranges simultaneously. In this embodiment, in this case, information indicating the finger movement (GUI operation information) is handled as information corresponding to both the second processing target image generation information and the reaction information.

  As a result, the user who viewed the first result image can change the size of the second result image, the range corresponding to the second result image in the original image, or the like.

  In addition, the following are methods for acquiring the first processing target image, the second processing target image, and the original image.

  First, the first processing target image, the second processing target image, and the original image may be acquired from outside the server system 100.

  Here, the outside of the server system 100 refers to the information terminal device 200, another server device, an external storage device, or the like.

  As a result, image processing can be performed on the image stored in the information terminal device 200 at hand of the user, so that the degree of freedom of image selection can be increased. In addition to being convenient for one-time use, it is not necessary to store images in the server system 100, so that it is possible to perform image processing with peace of mind even for private images and the like. . Furthermore, even when the information terminal device 200 does not have an image processing function, it is possible to perform image processing on an image captured by the information terminal device 200.

  Conversely, the image storage unit 140 of the server system 100 may store the first processing target image, the second processing target image, and the original image.

  As a result, even if the storage capacity of the information terminal device 200 at hand of the user is small, it is possible to perform image processing on a large number of captured images by transmitting captured images to the server system 100 one by one. become. Furthermore, there is also an advantage that it is not necessary to retransmit an image when different image processing is continuously performed on the same image.

  In addition, the reception processing unit 120 of the server system 100 acquires link information for acquiring an image from the outside of the server system 100, and based on the link information, the original image, the first processing target image, the second image The processing target image may be acquired from outside the server system 100.

  As a result, the communication data size of the image data can be suppressed, and communication efficiency can be improved.

  When the user selects an original image to be subjected to image processing, it is convenient to display an image list of the original image such as the display image DIM1 in FIG. 6A on the display unit 210 of the information terminal device 200 as a menu screen. It is.

  Therefore, the server system 100 of the present embodiment may include a menu screen information generation unit 160 that generates menu screen information for displaying a plurality of original images as menus. Then, the menu screen information generation unit 160 may generate menu screen information based on a plurality of original images. Next, the transmission processing unit 130 may transmit the generated menu screen information to the information terminal device 200. Then, the reception processing unit 120 sends selection information indicating an image selected by the user from the information terminal device 200 from the menu screen displayed on the display unit 210 of the information terminal device 200 based on the transmitted menu screen information. You may receive it. Further, the image processing unit 110 identifies an original image selected by the user from a plurality of original images based on the selection information, and performs a first processing target image generation process on the identified original image. Thus, the first processing target image may be generated.

  Here, the menu display of the original image refers to displaying information indicating a plurality of original images in a format in which a specific original image can be selected from a plurality of original images, for example, the file name of the original image or the original image Is displayed as a list. When displaying a list of original images, the size of the displayed image is not necessarily the same size as the original image, and a thumbnail image (reduced) of the original image may be displayed.

  Further, the menu screen information refers to information used for displaying the menu screen, and may be, for example, a reduced image of the original image and image arrangement information, or the information terminal device 200 stores the original image. In such a case, only image arrangement information may be used. In addition, tag information may be used when the menu screen is a web page.

  Further, the selection information refers to information indicating the original image selected by the user. For example, the selection information may be link information (such as a URL) indicating the file name of the original image, the location where the selected original image is stored, or the image data of the original image itself. Good.

  This makes it easy for the user to select an original image for image processing. The menu screen information generation process may be performed on the information terminal device 200 side.

  In addition, images in the present embodiment and other embodiments described later include not only still images but also moving images. That is, the original image, the first processing target image, the second processing target image, the first result image, the second result image, and the like may be moving images. Hereinafter, these moving images are referred to as an original moving image, a first processing target moving image, a second processing target moving image, a first result moving image, and a second result moving image, respectively.

  A specific example will be described below with reference to FIG. For example, when the original moving image is a moving image of 2 hours of full HD (Full High Definition: 1920 × 1080) and 30 fps (frame per second), the time interval from timing T0 to timing T1 in FIG. A first processing target image generation process for extracting only the first 10 seconds is performed to generate a 15 fps first processing target moving image having a size of 480 × 270. Then, first image processing is performed on the generated first processing target moving image to generate a first result moving image, which is transmitted to the information terminal device 200.

  Further, as in the case of the still image, the response information from the user with respect to the first result moving image is received, and the second image processing parameter is determined based on the reaction information. Then, based on the second image processing parameter, the second image processing is performed using the full HD original moving image as the second processing target moving image to generate a full HD second resultant moving image.

  According to this, it is possible to significantly reduce the amount of processing compared to the case where image processing is performed on all frames at the original size. Specifically, if the same amount of processing is required for each pixel, the first image processing described above is (10 sec / (120) compared to the case where image processing is performed for all frames at the original size. It becomes possible to compress the processing amount up to x60) sec) x (15 frame / 30 frame) x (480/1920) x (270/1080) = 1/23040.

  In addition, assuming that the appropriate processing is different for each scene, the first image processing is performed for each time interval, user reaction information for each time interval is acquired, and all the intervals are obtained based on the reaction information. Image processing may be performed.

  In the present embodiment, a plurality of first result images may be generated as shown in FIG.

  That is, the image processing unit 110 may perform the first image processing on the first processing target image according to the plurality of first image processing parameters to generate a plurality of first result images. Next, the transmission processing unit 130 may transmit information on the plurality of generated first result images to the information terminal device 200. Then, the image processing unit 110 acquires selection information indicating which one of the plurality of first result images has been selected as the reaction information with respect to the plurality of transmitted first result images. Based on the selection information, a second result image may be generated by performing second image processing on the second processing target image. Note that the image processing unit 110 may acquire selection information indicating a plurality of images selected from the plurality of first result images. Further, the transmission processing unit 130 may transmit information on the generated second result image to the information terminal device 200.

  In the case of the example in FIG. 19, the above operation will be described again. First, the image processing unit 110 applies a first image processing IMP1 having different processing contents to the first processing target image IIM1, for example, 3 And generate three first result images (OIM11, OIM12, OIM13). Next, the transmission processing unit 130 transmits the information of the generated three first result images to the information terminal device 200. Then, the image processing unit 110 acquires selection information indicating which of the three first result images has been selected as the reaction information RIF for the three first result images that have been transmitted. Here, it is assumed that the first result image OIM12 is selected. Further, for example, the image processing unit 110 converts the second image processing IMP2 having the same content as the first image processing IMP1 performed on the first result image OIM12 specified by the selection information to the second processing target. Perform on the image IIM2 to generate a second result image OIM2. Then, the transmission processing unit 130 transmits the information of the generated second result image to the information terminal device 200.

  Accordingly, the user can select a favorite first result image from among the plurality of presented first result images, and can perform second image processing with contents matching the user's intention. Become. Furthermore, in this case, since the user can view a plurality of types of image processing results at a time, the user can determine the second image processing content while comparing with other image processing results. This makes it possible to make the user's decision-making regarding the second image processing content smoother.

  In this case, the reaction information may also include information for changing the value of the image processing parameter, and the patent document is that the content of the second image processing can be changed by the reaction information. 1 differs from the invention disclosed in FIG. Also in this case, the reception processing unit 120 may receive the second processing target image generation information CIF in addition to the reaction information RIF.

4). Second Embodiment 4.1. System Configuration Example Next, FIG. 8 shows a system configuration example of a server system 100 and an image processing system including the server system 100 in the second embodiment. 3 is different from the system configuration example of the first embodiment in FIG. 3 in that a parameter acquisition unit 170 is provided instead of the parameter storage unit 150, and an extraction condition storage unit 180 is further provided. In the following, description of the same points as in the basic configuration example of FIG. 2 and the system configuration example of the first embodiment in FIG. 3 will be omitted.

  Next, the connection of each part is demonstrated. The image processing unit 110 is connected to the transmission processing unit 130, the image storage unit 140, and the extraction condition storage unit 180. The parameter acquisition unit 170 is connected to the image processing unit 110 and an external server device.

  Next, processing performed in each unit of the server system 100 will be described.

  First, the parameter obtaining unit 170 obtains image processing parameters associated with user operation information, for example, GUI (Graphical User Interface) operation information, from the outside. Here, the external may be another server device that communicates with the server system 100, or may be an external storage device such as an external HDD or a USB memory. The parameter acquisition unit 170 may be a communication unit that performs wired or wireless communication. In this case, the reception processing unit 120 and the transmission processing unit 130 realize the function of the parameter acquisition unit 170. It may be.

  Next, the extraction condition storage unit 180 stores extraction conditions used when a predetermined area is cut out from the image. The function of the extraction condition storage unit 180 can be realized by a memory such as a RAM or an HDD.

4.2. Details of Processing In the present embodiment, a face reflected in the selected original image is detected, and image processing (filter processing) for applying makeup to the detected face is performed on the server system 100. Hereinafter, the processing flow of this embodiment will be described with reference to FIG. 10A to 10D show screen transition diagrams of the display unit 210 of the information terminal device 200. FIG. In the following, description of the same parts as those in the first embodiment will be omitted or simplified.

  First, the user registers his / her face image in the extraction condition storage unit 180 of the server system 100 in advance.

  Then, in the menu screen information generation unit 160, the server system 100 generates an image list of the original images on the image storage unit 140 and transmits it to the information terminal device 200. Note that the original image assumed in this example is an image captured by the information terminal device 200, for example. In this case, the information terminal device 200 may transmit an original image to the server system 100 at an arbitrary timing after shooting and store the original image in the image storage unit 140. However, the present invention is not limited to this, and the original image may be an image acquired from another server device or an external storage device.

  Next, the user selects an original image to be processed from the image list displayed on the display unit 210 of the information terminal device 200. Here, it is assumed that the image shown in FIG. The image in FIG. 10A is shown as an original image PIM in FIG. 9, and both indicate the same image.

  Next, the image processing unit 110 of the server system 100 reads the original image PIM selected by the user from the image storage unit 140, and selects the same face as the face registered in advance in the selected original image PIM. And a first processing target image generation process PP1 (face area extraction process) for cutting out the peripheral area of the face is performed. Thereby, the first processing target image IIM1 of FIG. 9 is generated. The range to be extracted (extraction area size / range) may be, for example, an area that is twice as long as the face image, and the conditions for extracting the periphery of the face are stored in the extraction condition storage of the server system 100 in advance. It may be registered in the unit 180. Further, in the first process target image generation process PP1, the first process target image IIM1 may be generated by performing an enlargement process or a reduction process on the extracted image. As for the face to be registered, learning data such as a classifier may be registered in addition to registering a face image. In addition, the face data of a plurality of persons may be registered, and an image in which all face images are registered may be processed. As another modification, instead of registering a face image in advance, a user specifies a condition (information) for cutting out the face image to be recognized and the periphery of the face each time makeup processing is performed as a processing parameter. The information terminal device 200 may notify the server system 100.

  Then, the image processing unit 110 performs the first image processing IMP1 for applying makeup only to the detected face on the first processing target image IIM1, and generates the first result image OIM1. Here, a makeup process for coloring the cheek is performed.

  Thereafter, the transmission processing unit 130 transmits the first result image OIM1 to the reception processing unit 220 of the information terminal device 200, and the display unit 210 displays the first result image OIM1. At this time, an image as shown in FIG. 10B is displayed on the display portion 210.

  Next, the user confirms the first result image OIM1, determines whether to continue the process, change the image processing parameter, or interrupt, and inputs the reaction information RIF via the user interface unit 240. . Then, the information terminal device 200 transmits the reaction information RIF input by the user to the server system 100.

  Specifically, when the user likes the makeup applied to his / her face on the first result image OIM1, it is determined that the process is continued as it is, and the user selects “ Select the “OK” button. Then, the information terminal device 200 notifies the server system 100 that there is no change in the image processing parameter, and the server system 100 performs the second image processing IMP2 on the entire original image PIM. Therefore, in the second image processing IMP2, an image having the same makeup applied to the friends who are shown together is generated as the second result image OIM2, and the display unit 210 of the information terminal device 200 is generated as the second processing result. To display. At this time, for example, an image as shown in FIG. In this example, the second processing target image is the original image PIM itself, but is not limited to this, and the second processing target image is a reduced image, an enlarged image, a partial image, or the like of the original image PIM. May be. That is, the processing target range of the second image processing may be specified in the same manner as in the first embodiment described above. Moreover, you may output the image in which makeup was applied only to one's registered face without applying makeup to a friend who is shown together in the image.

  On the other hand, if the user does not like the makeup applied to his / her face on the first result image OIM1, it is determined that the image processing parameter is to be changed, and the user clicks the “Modify” button in FIG. Select. Then, the display unit 210 displays a screen for changing the makeup type as shown in FIG. 10D, for example, and the user instructs the change of the makeup type via the user interface unit 240. At this time, the server system 100 or the information terminal device 200 may generate a menu screen as shown in FIG. 10D that displays a list of a plurality of makeup types displayed on the information terminal device 200.

  Further, the server system 100 determines an image processing parameter corresponding to the changed makeup type based on the operation information of the GUI. However, the user may directly specify the image processing parameters. Note that the image processing parameter indicating the type of makeup may be managed by the server system 100 downloading a parameter set from another server device, an external storage device, or the like in accordance with the fashion and associating it with UI operation information. Further, the server system 100 may change the makeup type without downloading from another server device or the like.

  When the image processing parameter is changed, the first image processing IMP1 is performed again on the first processing target image IIM1 in accordance with the changed image processing parameter to generate a first result image OIM1. Also good. Alternatively, the first image processing IMP1 is not performed, the second image processing IMP2 is performed on the original image PIM (or the second processing target image) according to the changed image processing parameters, and the second result image OIM2 May be generated.

  If the user views the display image of FIG. 10B and determines that the image processing is to be interrupted, the “interrupt” button is selected. Then, a message to that effect is transmitted to the server system 100, and the second image processing is not performed and all the processes are terminated.

4.3. Method When extracting a region in which a user's face is shown from a photograph as in the image IIM1 in FIG. 9, it is necessary to determine in which position in the image the face is shown. For example, if the face always appears in the same position, such processing is easy, but in reality, the user's face to be extracted appears in different positions for each photograph (image) at different angles. There are many. Therefore, in the method of the first embodiment described above, this can be realized by designating a region that the user wants to extract one by one. However, when performing image processing many times, such an operation is not performed. It is very time-consuming and troublesome for the user.

  In many cases, the face to be extracted is a face of a specific individual such as a user's own face or a user's friend or family face, and does not change every time image processing is performed.

  Therefore, in the server system 100 of the present embodiment, the reception processing unit 120 uses registered face image information, which is information used to specify a face area extracted from the original image, as one of the first processing target image generation information. May be received as the area designation information. Then, the image processing unit 110 may generate a first processing target image by performing face area extraction processing on the original image based on the received registered face image information.

  Here, the registered face image information is information representing a face to be extracted in the face area extraction process. Further, it can be said that the registered face image information is a concept included in the area designation information that is one of the first processing target image generation information described in the first embodiment. For example, the registered face image information may be the face image to be extracted, or may be link information to a location where the face image to be extracted is stored. Further, as described above, the registered face image information may be learning data such as a classifier.

  Also, the face area extraction process refers to a process of extracting a predetermined area including a registered face image from the original image. The size of the peripheral area of the face to be extracted may be set in the server system 100 in advance, or may be received from the information terminal device 200 together with the face image extracted as the registered face image information described above. .

  That is, in the present embodiment, the partial region described in the first embodiment is automatically extracted based on the registered face image information to generate the first processing target image. Therefore, there is no problem even if the position of the face area to be extracted changes one by one.

  This makes it possible to extract a region that includes a face that matches the registered face without specifying the region to be extracted each time image processing is performed, thereby reducing user effort and improving convenience. It becomes possible to plan.

  This can also be rephrased as follows.

  That is, the server system 100 of the present embodiment may include an extraction condition storage unit 180 that stores extraction conditions used when specifying an area to be extracted from the original image. Then, the image processing unit 110 may perform a region extraction process on the original image according to the extraction condition acquired from the extraction condition storage unit 180 to generate a first processing target image.

  Here, the extraction condition refers to a determination condition referred to when determining whether or not a predetermined area of the original image is an area to be extracted. Therefore, it can be said that the registered face image information described above is one of the extraction conditions. In addition, other extraction conditions include a luminance value (pixel value) threshold value, an image frequency threshold value, color information, an image coordinate value, learning data for recognizing an object other than a face, and the like.

  This makes it possible to automatically extract areas that satisfy the extraction conditions without specifying an area to be extracted each time image processing is performed, thereby reducing user effort and improving convenience. Etc. becomes possible.

5. Third Embodiment 5.1. System Configuration Example Next, FIG. 11 illustrates a system configuration example of a server system 100 and an image processing system including the server system 100 according to a third embodiment. In the present embodiment, the configuration of the server system 100 is the same as the basic configuration example of FIG. 2, but the information terminal device 200 includes a display unit 210, a reception processing unit 220, a transmission processing unit 230, and a user interface unit 240. 2 is different from the basic configuration example of FIG. 2 in that an image storage unit 250 and a menu screen information generation unit 260 are included. In the following, description of the same points as in the basic configuration example of FIG. 2 is omitted.

  Next, processing performed in each unit of the information terminal device 200 will be described.

  First, the image storage unit 250 stores the acquired image. Although the image acquisition method is not limited, for example, the image storage unit 250 stores an image captured by the imaging unit, an image acquired through a network, and the like. The function of the image storage unit 250 can be realized by a memory such as a RAM or an HDD.

  Next, the menu screen information generation unit 260 generates an image list generated from the images to be processed based on the image information stored in the image storage unit 250. The function of the menu screen information generation unit 260 can be realized by hardware such as various processors (CPU and the like), ASIC (gate array and the like), GPU, and programs.

5.2. Details of Processing In this embodiment, image processing for performing panorama synthesis on a plurality of selected original images is performed on the server system 100. Hereinafter, the processing flow of this embodiment will be described with reference to FIG. 13A to 13D show screen transition diagrams of the display unit 210 of the information terminal device 200. FIG.

  Further, the panorama composition processing of the present embodiment is realized by extracting and collating feature points from all input images and performing geometric transformation. As the image processing parameter, in addition to the number of input images, a threshold value, the number of feature points, an algorithm for extracting feature points, and the like can be designated. However, parameters other than the number of input images may be fixed.

  First, in this example, the information terminal device 200 acquires an original image that is a panoramic composition material. For example, when the information terminal device 200 includes an imaging unit, an image captured by the imaging unit may be an original image, an image acquired via a network, an external storage device, another camera, or the like. The image may be an original image. Then, the image storage unit 250 of the information terminal device 200 stores these original images.

  Next, the menu screen information generation unit 260 of the information terminal device 200 generates information of an image list (menu screen) of the original image stored in the image storage unit 250 and displays the image list on the display unit 210. Then, the user selects a plurality of original images to be panorama synthesized from the image list as the first processing target image, and the transmission processing unit 230 receives the plurality of first processing target images selected by the server system 100. Transmit to the processing unit 120.

  In the example of FIG. 12, the image processing unit 110 performs the first image processing IMP1 (panorama synthesis processing) on the two received first processing target images (IIM11 and IIM12). A result image OIM1 is generated, and the first result image OIM1 is transmitted to the information terminal device 200. Note that the image processing unit 110 may perform reduction processing, compression processing, or the like on the plurality of first processing target images before performing the first image processing IMP1.

  Thereafter, the display unit 210 of the information terminal device 200 displays the received first result image OIM1. At this time, an image as shown in FIG.

  On the other hand, when the user who has seen the first result image OIM1 wants to add a new image to be synthesized, he / she additionally inputs a designated stored image, or acquires or captures a new image. . The newly acquired or captured additional input image IIM23 (FIG. 13B) is stored in the image storage unit 250, and the menu screen information generation unit 260 updates the menu screen.

  When the user designates an image to be added from the image list, the transmission processing unit 230 transmits the additional input image IIM23 to the server system 100 as reaction information RIF.

  On the other hand, as illustrated in FIG. 12, the image processing unit 110 of the server system 100 adds the newly received additional input image IIM23 to the first processing target image (IIM11 and IIM12), and adds the second processing target image ( IIM21, IIM22, and IIM23), the second image processing IMP2 (panorama synthesis processing) is performed on these three second processing target images to generate the second result image OIM2, and the transmission processing unit 130 Transmits the second result image OIM2 to the information terminal device 200. In the example of FIG. 12, the images IIM11 and IIM21, and the images IIM12 and IIM22 are images having the same contents. However, since the image sizes may be different due to reduction processing or the like, different symbols are used. Used.

  Thereafter, the display unit 210 of the information terminal device 200 displays the received second result image OIM2. At this time, an image as shown in FIG.

  Note that the image processing unit 110 may perform image forming processing that performs color correction of a joint portion, clipping of a rectangular region, and the like on the second result image OIM2. Further, this process may be performed by the information terminal device 200. At this time, an image as shown in FIG.

  As a modification, in the present embodiment, as described above, in the first image processing, panorama synthesis processing is performed on the reduced image, and in the second image processing, panorama synthesis processing is performed on the original image. You can go. In addition, the number of times of image processing performed in the present embodiment is not limited to two. For example, third image processing that performs color correction after performing the first image processing and the second image processing described above. Etc. may be performed.

5.3. Method When generating the panoramic image described above, a plurality of images to be used for composition are required. For this reason, the panorama image generated as the first result image is not as expected by the user, and it may be desired to add an image to the generated panorama image and perform recombination.

  However, conventionally, in such a case, it is necessary to re-capture the first processing target image used for the first image processing or to transmit the image to the server system 100 again. These are very time-consuming actions for the user. Furthermore, because it is not always possible to capture the same image as the image captured last time, the image processing did not work despite the fact that the user liked the previous image, so the photo must be discarded. In some cases.

  That is, when the user once transmits images to the server system 100, it is often considered that it is better not to re-photograph and retransmit those images.

  Therefore, in the server system 100 of the present embodiment, the transmission processing unit 130 may transmit information of the first result image to the information terminal device 200. And the reception process part 120 may receive the information of an additional input image from the information terminal device 200 as reaction information which shows a user's reaction with respect to a 1st result image. Furthermore, the image processing unit 110 may perform the second image processing based on the additional input image.

  Here, the additional input image refers to an image that is additionally input to the second image processing. Further, it can be said that the additional input image is one of the reaction information described above and is an image to be added as the second processing target image. Further, the additional input image may be an image newly captured by the information terminal device 200 or an image originally stored in the information terminal device 200 or the server system 100. For example, in the example of FIG. 12, the image IIM23 is an additional input image.

  Further, the additional input image information may be the data of the additional input image itself, or the file name or link information of the additional input image.

  As a result, it is possible to perform the second image processing without taking again the first processing target image used by the user for the first image processing.

  In the present embodiment, the original image is usually used as the first processing target image. However, an image generated from the original image as in the first embodiment, that is, a reduced image, a partial image, or the like is used. You may use as a 1st process target image.

  In addition, when performing the second image processing based on the additional input image, there are the following two methods. As shown in FIG. 12, the first processing target image (IIM11, IIM12) and the additional input image (IIM23) used in the first image treatment are combined to form a second processing target image (IIM21, As the IIM22 and IIM23), there is a method of performing the second image processing.

  That is, the image processing unit 110 may perform a first panoramic image generation process on a plurality of processing target images to generate a first panoramic image. Then, the transmission processing unit 130 may transmit the information of the generated first panoramic image to the information terminal device 200. Further, the reception processing unit 120 may receive information of the additional input image from the information terminal device 200 as reaction information for the first panoramic image. Then, the image processing unit 110 may perform a second panoramic image generation process based on the received additional input image and the plurality of processing target images, and generate a second panoramic image. Next, the transmission processing unit 130 may transmit information on the generated second panoramic image to the information terminal device 200.

  In this case, not all of the first processing target images have to be used as the second processing target images, and some images may be removed or added.

  Accordingly, for example, the first result image is not as expected by the user, and it is possible to replace a part of the image used for the first image processing and use another image as the second processing target image. Become. That is, when it is not desired to use the first image processing result, for example, when the first image processing does not reflect the user's intention at all and the panorama synthesis process is to be performed again from the beginning, such a method is used. Is suitable.

  On the other hand, as another method of performing the second image processing based on the additional input image, the first result image (image OIM1 in FIG. 12) and the additional input image (image IIM23 in FIG. There is a method of performing second image processing using the image to be processed.

  That is, the image processing unit 110 may perform a first panoramic image generation process on a plurality of processing target images to generate a first panoramic image. Then, the transmission processing unit 130 may transmit the information of the generated first panoramic image to the information terminal device 200. Next, the reception processing unit 120 may receive information of the additional input image from the information terminal device 200 as reaction information with respect to the first panoramic image. Further, the image processing unit 110 may perform a second panoramic image generation process based on the received additional input image and the first panoramic image to generate a second panoramic image. Then, the transmission processing unit 130 may transmit the information of the generated second panoramic image to the information terminal device 200.

  Thereby, for example, when the first result image is as expected by the user, but when it is desired to add an image to the first result image to compensate for the lacking portion, the first image processing result is used. The second image processing can be performed using the additional input image.

  Further, in this case, since it is not necessary to perform the combining process for the portion that has been combined in the first image processing, in the second image processing, only the combining process of the first result image and the additional input image is performed. It is only necessary to reduce the processing amount of the second image processing, and the second result image can be presented to the user at an earlier timing.

6). Fourth Embodiment 6.1. System Configuration Example Next, FIG. 14 shows a system configuration example of a server system 100 and an image processing system including the server system 100 according to the fourth embodiment. The image processing system according to the present embodiment includes a server system 100, a first information terminal device 200, and a second information terminal device 300.

  The configuration of the server system 100 and the first information terminal device 200 and the function of each unit are the same as the basic configuration example of FIG. 2, and the configuration of the second information terminal device 300 is that of the first information terminal device 200. The configuration is the same.

6.2. Details of Processing In this embodiment, the first information terminal device 200 transmits an original image to the server system 100, the server system 100 performs the first image processing and the second image processing, The first result image and the second result image are transmitted to the second information terminal device 300. That is, the point which transmits an image processing result not to the 1st information terminal device 200 but to the 2nd information terminal device 300 differs from the 1st Embodiment-3rd Embodiment mentioned above.

  Further, the server system 100 according to the present embodiment performs image processing as illustrated in FIGS. 15A and 15B as the first image processing or the second image processing. That is, in the present embodiment, an image to which a filter for converting a photograph taken with a toy camera is applied to the image BIM as shown in FIG. Processing is performed to generate an image AIM as shown in FIG. As the image processing parameter, it is possible to specify the filter range and the strength of the filter for adjusting the shadow transparency.

  Hereinafter, the processing flow of the present embodiment will be described with reference to FIG. 17A to 17D show screen transition diagrams of the display unit 210 of the first information terminal device 200 or the display unit 310 of the second information terminal device 300.

  First, the first user designates the original image PIM and further designates the numerical value of the image processing parameter via the user interface unit 240 of the first information terminal device 200 (TU1 in FIG. 16). At this time, an image as shown in FIG. 17A is displayed on the display unit 210 of the first information terminal device 200. Also, in this embodiment, unlike the second embodiment described above, it is assumed that numerical values of image processing parameters are directly specified. For example, the inner circle and the outer circle are specified for the range to be filtered, and a shadow is applied between the inner circle and the outer circle in a gradation so that the center and diameter of each of the inner circle and the outer circle can be specified. In addition, the transparency of the shadow may be designated as the strength of the filter, or the color of the shadow or the gradation pattern may be designated.

  Next, the image processing unit 110 of the server system 100 performs a first processing target image generation process PP (reduction processing) on the designated original image PIM to generate a first processing target image IIM1. Then, the image processing unit 110 performs the first image processing IMP1 on the generated first processing target image IIM1 to generate the first result image OIM1. Further, the transmission processing unit 130 transmits the generated first result image OIM1 to the second information terminal device 300 (TU2 in FIG. 16).

  Moreover, since the 1st user of the 1st information terminal device 200 and the 2nd user of the 2nd information terminal device 300 are not necessarily the same person, a 2nd user is a 1st image. You may not know the processing parameters.

  Accordingly, the first image processing parameter used for the first image processing IMP1 is transmitted to the second information terminal device 300 together with the information of the first result image OIM1.

  Accordingly, as described later, the second image processing parameter can be set while referring to the first image processing parameter.

  Then, the second information terminal device 300 displays the first result image OIM1 on the display unit 310. At this time, an image as shown in FIG.

  Next, the second user of the second information terminal device 300 confirms the first result image OIM1 and determines whether to continue the process, change the image processing parameter, or interrupt the user. Reaction information RIF is input via the interface unit 340. Then, the second information terminal device 300 transmits the reaction information RIF input by the user to the server system 100.

  Specifically, if the second user likes the first result image OIM1, it is determined that the process is continued as it is, and the second user clicks the “OK” button in FIG. select. Then, the second information terminal device 300 notifies the server system 100 that there is no change in the image processing parameters, and the server system 100 performs the second image processing IMP2 on the entire original image PIM, thereby A result image OIM2 is generated and transmitted to the second information terminal device 300. Then, the display unit 310 of the second information terminal device 300 displays the second result image OIM2. In this example, the second processing target image is the original image PIM itself, but is not limited to this, and the second processing target image is a reduced image, an enlarged image, a partial image, or the like of the original image PIM. May be. That is, the processing target range of the second image processing may be specified in the same manner as in the first embodiment described above.

  On the other hand, if the second user does not like the first result image OIM1, it is determined to change the image processing parameter, and the second user selects the “Modify” button in FIG. 17B. Then, the display unit 310 of the second information terminal device 300 displays an image processing parameter editing screen as shown in FIG. At this time, the second information terminal device 300 sets the first image processing parameter received together with the first result image OIM1 as an initial value, and displays it on the editing screen.

  Accordingly, the second user can set (change) the second image processing parameter with reference to the first image processing parameter used in the first image processing. Further, even when the first information terminal device 200 and the second information terminal device 300 that have requested the first process are different, the setting of the image processing parameter can be restored.

  Then, the set second image processing parameter is transmitted to the server system 100, the server system 100 performs the second image processing IMP2 based on the second image processing parameter, and the second result image OIM2 Is transmitted to the second information terminal device 300. Then, the display unit 310 displays the second result image OIM2.

  When performing the second image processing IMP2, it may be possible to select a filter different from the filter used in the first image processing IMP1, and in this case, the second information terminal device 200 A menu screen displaying a sample of an image filter as shown in FIG. Here, as in the case of displaying the makeup pattern list shown in FIG. 10D described above, it is desirable that the server system 100 generates the menu screen, but even if the second information terminal device 300 generates the menu screen, It doesn't matter. Then, for example, the second user newly selects a filter for conversion to the illustration style shown in the first embodiment, and the server system 100 performs the second image processing IMP2 for conversion to the illustration style.

  If the second user views the display image of FIG. 17B and determines that the image processing is to be interrupted, the “interrupt” button is selected. Then, a message to that effect is transmitted to the server system 100, and the second image processing is not performed and all the processes are terminated.

6.3. Method As in the example described above, when there are two information terminal devices, the first information terminal device 200 and the second information terminal device 300, an image captured by the first information terminal device 200 It may be convenient if the second information terminal device 300 can refer to the result of image processing performed on the image information. For example, when the image processing results are transmitted between users, or when the first information terminal apparatus 200 having an imaging unit but having a small display screen captures an image and does not have an imaging unit, This is a case where the image processing result is confirmed by the information terminal device 2 in FIG.

  Furthermore, depending on the communication environment, the first information terminal device 200, the server system 100, and the like after the first information terminal device 200 instructs the start of the first image processing until the second image processing is performed. May be disconnected. In such a case, the user of the second information terminal device 300 cannot confirm the first image processing parameter according to what first image processing parameter, and the second image processing parameter There may also be a situation where the reaction information that determines the response cannot be determined.

  Therefore, in the server system 100 according to the present embodiment, the reception processing unit 120 receives, from the first information terminal device 200, first processing target image generation information that is information used to generate the first processing target image. May be. Then, the image processing unit 110 performs a first processing target image generation process on the original image based on the first processing target image generation information, generates a first processing target image, and generates the generated first processing target image. The first image processing may be performed on one processing target image according to the first image processing parameter. Further, the transmission processing unit 130 may transmit the generated information of the first result image and the first image processing parameter to the second information terminal device 300. Next, the reception processing unit 120 may receive reaction information for the first result image from the second information terminal device 300.

  Accordingly, the second information terminal device 300 can receive the first result image that is the result of the first image processing started by the first information terminal device 200, and the like. Further, even when the first information terminal device 200 does not store the setting of the first image processing parameter, or when the connection is once lost and the connection is reconnected with another information terminal device, the first image processing is performed. It is possible to restore parameter settings. Note that the first information terminal device 200 and the second information terminal device 300 may be different information terminal devices or the same information terminal device.

  Further, the transmission processing unit 130 may transmit the information of the first result image and the first image processing parameter to the second information terminal device 300. And the reception process part 120 receives the reaction information with respect to the 1st result image input by the user of the 2nd information terminal device 300 from the 2nd information terminal device 300 based on the 1st image processing parameter. May be. Further, the image processing unit 110 may set the second image processing parameter based on the received reaction information.

  As a result, the user of the second information terminal device 300 can determine the reaction information while referring to the first result image and the first image processing parameter. Therefore, the server system 100 can perform the second image processing in accordance with the intention of the user of the second information terminal device 300.

  Further, as shown in FIG. 17D, the reaction information may be information indicating an instruction to change image processing content.

  That is, the reception processing unit 120 may receive, as reaction information, user operation information representing an instruction to change the content of image processing performed on the transmitted first result image. If the image processing unit 110 determines that user operation information representing an instruction to change the image processing content has been received, the image processing unit 110 converts the second image processing having a content different from the first image processing to the second input image. You may do it for.

  As a result, it is possible to perform second image processing that differs from the first image processing.

  Note that the server system 100, the image processing system, and the like of the present embodiment may realize part or most of the processing by a program. In this case, a server system 100, an image processing system, and the like according to the present embodiment are realized by a processor such as a CPU executing a program. Specifically, a program stored in the information storage medium is read, and a processor such as a CPU executes the read program. Here, the information storage medium (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (DVD, CD, etc.), HDD (hard disk drive), or memory (card type). It can be realized by memory, ROM, etc. A processor such as a CPU performs various processes according to the present embodiment based on a program (data) stored in the information storage medium. That is, in the information storage medium, a program for causing a computer (an apparatus including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit) Is memorized.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term described at least once together with a different term having a broader meaning or the same meaning in the specification or the drawings can be replaced with the different term in any part of the specification or the drawings. The configurations and operations of the server system, the image processing system, the program, and the image processing method are not limited to those described in this embodiment, and various modifications can be made.

100 server system, 110 image processing unit, 120 reception processing unit,
130 transmission processing unit, 140 image storage unit, 150 parameter storage unit,
160 menu screen information generation unit, 170 parameter acquisition unit,
180 extraction condition storage unit, 200 information terminal device (first information terminal device),
210 display unit, 220 reception processing unit, 230 transmission processing unit,
240 user interface unit, 300 second information terminal device,
400 third information terminal device, 500 network

Claims (12)

A reception processing unit that performs information reception processing with the information terminal device via the network;
An image processing unit that performs a first image synthesis process on a plurality of processing target images using a first image processing parameter and generates a first synthesized image;
A transmission processing unit that performs transmission processing of information with the information terminal device via the network;
Including
The transmission processing unit
Transmitting the information of the generated first composite image to the information terminal device;
The image processing unit
When the reception processing unit receives reaction information indicating a user's response to the first composite image from the information terminal device, a second image processing parameter is set based on the received reaction information. ,
When the reception processing unit does not receive the reaction information from the information terminal device, the second image processing parameter is set to a preset value,
Performing a second image synthesis process using the second image processing parameter to generate a second synthesized image;
The image processing unit
When performing the second image synthesis process, the plurality of processes used by adding a new image to the plurality of processing target images used in the first image synthesis process or used in the first image synthesis process A part of the target image is removed, or a part of the plurality of processing target images used in the first image composition processing is replaced with a new image, and the second composite image is obtained. Generate
The transmission processing unit
A server system, wherein information of the generated second composite image is transmitted to the information terminal device. In claim 1,
  The image processing unit
  A server system, wherein the second image processing parameter relating to extraction of the number of processing target images or feature points of the processing target images is set. In claim 1 or 2 ,
The reception processing unit
As the reaction information indicating the reaction of the user, information on an additional input image to be newly added to the second image composition process is received from the information terminal device,
The image processing unit
A server system that performs the second image composition processing based on information of the additional input image. In claim 3 ,
The image processing unit
A server system that performs the second image composition processing based on the received additional input image and the plurality of processing target images to generate a second composite image. In claim 3 ,
The image processing unit
A server system characterized by performing a second image composition process based on the additional input image and the first composite image to generate a second composite image. In any one of Claims 1 thru | or 5 ,
The image processing unit
A server system characterized in that the first image synthesis process is performed after performing a data amount reduction process for reducing an image data amount for the plurality of processing target images. In claim 6 ,
The image processing unit
A server system, wherein the first image composition processing is performed on the plurality of processing target images after performing image reduction processing as the data amount reduction processing. In claim 6 ,
The image processing unit
A server system, wherein the first image composition processing is performed on the plurality of processing target images after performing image compression processing as the data amount reduction processing. In any one of Claims 1 thru | or 8 .
The image processing unit
A server system, wherein a first panoramic image is generated as the first composite image, and a second panoramic image is generated as the second composite image. A server system;
An information terminal device;
Including
The server system is
A first image synthesis process is performed on a plurality of processing target images using a first image processing parameter , a first synthesized image is generated, and information on the generated first synthesized image is used as the information terminal. Send it over the network to the device,
The information terminal device
Displaying the received first composite image;
The server system is
When reaction information indicating a user's reaction to the first composite image is received from the information terminal device, a second image processing parameter is set based on the received reaction information,
If the reaction information is not received from the information terminal device, the second image processing parameter is set to a preset value,
Performing a second image synthesis process using the second image processing parameter to generate a second synthesized image;
When performing the second image composition processing, a new image is added to the plurality of processing target images used in the first image composition processing, or the plurality of images used in the first image composition processing The second composite image is obtained by removing a part of the processing target image or replacing a part of the plurality of processing target images used in the first image composition processing with a new image. And transmitting the generated information of the second composite image to the information terminal device via the network,
The information terminal device
An image processing system, wherein the received second composite image is displayed on a display unit. A reception processing unit that performs information reception processing with the information terminal device via the network;
An image processing unit that performs a first image synthesis process on a plurality of processing target images using a first image processing parameter and generates a first synthesized image;
As a transmission processing unit that performs transmission processing of information with the information terminal device via the network,
Make the computer work,
The transmission processing unit
Transmitting the information of the generated first composite image to the information terminal device;
The image processing unit
When the reception processing unit receives reaction information indicating a user's response to the first composite image from the information terminal device, a second image processing parameter is set based on the received reaction information. ,
When the reception processing unit does not receive the reaction information from the information terminal device, the second image processing parameter is set to a preset value,
Performing a second image synthesis process using the second image processing parameter to generate a second synthesized image;
The image processing unit
When performing the second image synthesis process, the plurality of processes used by adding a new image to the plurality of processing target images used in the first image synthesis process or used in the first image synthesis process A part of the target image is removed, or a part of the plurality of processing target images used in the first image composition processing is replaced with a new image, and the second composite image is obtained. Generate
The transmission processing unit
A program for transmitting information on the generated second composite image to the information terminal device. Performing a first image composition process on the plurality of processing target images using the first image processing parameter to generate a first composite image;
Transmitting the information of the generated first composite image to the information terminal device via the network;
When reaction information indicating a user's reaction to the first composite image is received from the information terminal device, a second image processing parameter is set based on the received reaction information,
If the reaction information is not received from the information terminal device, the second image processing parameter is set to a preset value,
Performing a second image synthesis process using the second image processing parameter to generate a second synthesized image;
When performing the second image composition processing, the plurality of images used by adding a new image to the plurality of processing target images used in the first image composition processing or used in the first image composition processing The second synthesis may be performed by removing a part of the images to be processed or replacing a part of the plurality of images to be used in the first image synthesis process with a new image. Generate an image,
An image processing method, comprising: transmitting information on the generated second composite image to the information terminal device via the network.