JP2004173320A - Image providing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To distribute an image for a composition when a user confirmation is made by a composite image with high amusement factor that is presented to the user. <P>SOLUTION: The image providing apparatus 100 provides a composite image to user equipment such as a picture phone device 200, etc. which is connected through a communication line 300. The image providing apparatus 100 extracts the image for composition such as a back ground image, etc. which is specified by the picture phone device 200, etc. from a database of the image for a composition 106, at the same time, continuously receives an original image which is a moving picture transmitted from the picture phone device 200, etc., continuously extracts the image to be combined such as an image of the user, etc. from the original image, produces the composite image, such as a user image is located at the front of the back ground image specified, by superimposing the image to be combined on the image for a composition, transmits and presents the composite image to the picture phone device 200 in about real time of the original image transmission, and furthermore provides the image for a composition such as a back ground image, etc. whose distribution is requested from the picture phone device 200. <P>COPYRIGHT: (C)2004,JPO

Description

  The present invention relates to an image providing apparatus, an image providing method, and an image providing program for displaying a composite image on a user device such as a videophone device.

  2. Description of the Related Art Conventionally, there is Patent Literature 1 as a related art related to displaying a composite image on a user device such as a videophone device. In Patent Literature 1, each user device is connected to each other via a service provider system so that live video can be transmitted, and the user permits the service provider system to use his or her own live video as an advertisement medium. Setting and setting the product to be advertised, the service provider system synthesizes the live video transmitted from the user device in a manner such as wearing a product image, and transmits the live video to the communication partner user device. Discloses a system for connecting to a sponsor system that can obtain a description of a product or information on a transaction in response to a click on a product image of a communication partner.

  Also, in Patent Documents 2 and 3, a transmitting-side videophone device, a relay station, and a receiving-side videophone device are connected by communication means, and an image captured by the transmitting videophone device is defined as a subject image and a background image. A sponsor that provides an advertisement image by processing the background image separately and not displaying the background of the transmission side on the image of the videophone device on the reception side. A system is disclosed in which revenues obtained from the above are used for telephone charges, and banner advertisements are displayed on images and linked to the Internet.

  Further, in Patent Document 4, an advertisement image is stored in a video phone device on the transmission side, a composite image obtained by combining the advertisement image and the captured image is transmitted, and a composite image including the advertisement image is transmitted to the video phone device on the reception side. There is disclosed a system for displaying an advertisement image, transmitting the advertisement image to a videophone device on the transmission side via a network, and updating the advertisement image by storing the advertisement image in a storage unit of the videophone device.

  Further, in Patent Document 5, an identification code for identifying a captured image and a background image is transmitted from a video telephone device on the transmission side, and the background image identified by the identification code is transmitted by the video telephone device on the reception side. There is disclosed a system capable of synthesizing and displaying images, receiving a background image and an identification code from the outside via a network, and updating the contents of the background image storage means.

  As another reference technology, Patent Document 6 discloses a system for distributing an illustration selected as a PHS from a server as a standby screen. A system is disclosed in which image data in the range is converted into a standby screen according to a model-specific parameter and transmitted to a mobile communication terminal.

JP 2001-283079 A JP 2001-326918 A JP 2001-326917 A JP 2000-188741 A JP 2000-175167 A JP 2002-14750 A JP 2001-345896 A

  By the way, in recent years, new communication environments such as mobile phones, the Internet, and their broadband are gradually being developed, but there is a lack of attractive services that provide strong motivation for users to participate in such communication environments. Is a very big problem. In order to provide users with strong motivation, for example, it is required that the service be a service that satisfies the individual preferences of various users and is highly entertaining.

  The present invention has been made in view of the above problems, and has a strong motivation for satisfying individual tastes of various users, having high entertainment, and actively participating in new communication environments such as broadband. It is an object of the present invention to provide an image providing apparatus, an image providing method, and an image providing program for displaying a composite image on a user device, which is capable of realizing a service for giving an attachment and creating a new business model. .

  An image providing apparatus according to the present invention is an image providing apparatus that displays a composite image on a user device connected via an information transmission medium, and includes means for storing the composite image, Means for accepting the designation, means for extracting a compositing image corresponding to the accepted designation, means for capturing a compositing target image of a moving image transmitted from the user device, and a compositing image for extracting the compositing target image. Means for superimposing and synthesizing a combined image, or means for taking in the original image of the moving image transmitted from the user device, means for extracting the image to be combined with the moving image from the original image, and combining Means for generating a composite image by superimposing and synthesizing the composite image to be extracted, and providing the generated composite image to the user device in substantially real time upon transmission of the composite target image or transmission of the original image. Characterized in that it comprises means for.

  Generating and presenting a composite image by combining a compositing target image of a moving image transmitted in substantially real time from a user device and a compositing image selected or designated by the user, and greatly reflects the intention and movement of the user It is possible to generate a synthesized image to be processed. Then, the user can check the state in which the desired image for combination is combined with the image to be combined and enjoy it as if trying on it. By giving a change such as movement or change, the combined state of the image to be combined and the image for combination can be freely changed and adjusted substantially in real time and enjoyed, thereby greatly improving the user's entertainment. In addition, since the user is presented with a composite image based on a favorite composite image, the user's preference can be satisfied. Further, since the user device is connected to the image providing device via the information transmission medium, the user can enjoy a desired synthesized image without being restricted by a place or time. In particular, if a configuration in which various or a large number of synthesis images are stored and a designated desired synthesis image is synthesized with the synthesis target image and can be presented as the synthesis image, the user can perform various operations for a long time. This is preferable because it is possible to enjoy a composite image using various composite images. Further, the image providing apparatus sends the image to be combined or the original image including the image to be combined once to the image providing apparatus, and the image providing apparatus returns the image to be combined to the user apparatus. Can be processed in various ways to generate and present a composite image in consideration of the user's preference, entertainment, and entertainment.

  Further, the image providing apparatus of the present invention receives a request for distributing a composition image from a user device and a means for distributing a composition image corresponding to the distribution request, or receives a registration request for a composition image from the user device. And a means for registering a compositing image corresponding to the registration request.

  For example, a videophone device having an image combining function and capable of transmitting a combined image to a communication partner, such as a user device capable of generating a combined image by combining a combining target image and a combining image and transmitting or displaying the combined image. When the configuration is such that the composite image is delivered to the user, the composite image in the same state as when the composite image is generated by the user device is presented on the image providing device, and the user is presented with the composite image presented by the image providing device. It is possible to confirm the image in the combined state in advance with the image, and to receive the delivery of the combined image to the user device after the confirmation. In other words, the user can use the composite image provided by the image providing apparatus in advance to check the image by using the composite image provided by the image providing apparatus, and then receive the desired composite image. The user's expectations are not disappointed, for example, the synthesized image based on the image or the image of the synthesized image received is different from the expected one, and it is possible to reliably provide the synthesized image that matches the user's preference. Also, when communicating using a composite image with a videophone device or the like that has an image compositing function and can transmit the composite image to a communication partner, both the user and the other party of the communication have a variety of combinations that match their tastes. It is possible to enjoy a composite image using the image for use, and it is possible to improve both entertainments. In addition, it is possible to germinate or raise the user's consciousness of treating the image for synthesis as an ornament in a virtual space, and to create a new demand and a new market for the image for synthesis and the like.

  Further, the image providing device of the present invention is a means for receiving a request for fixing a moving image combining image from a user device, and fixing the moving image combining image in response to the fixing request to form a still combining image. Acquiring means, means for receiving a distribution request for a still composition image from the user device, and means for distributing the still composition image corresponding to the distribution request, or means for receiving a registration request for the still composition image from the user device; Means for registering a still-synthesis image corresponding to the registration request.

  A composite image is generated by combining a compositing target image with a moving image transmitted in substantially real time from a user device and a compositing image of the moving image, and a desired image is generated from the composing image of the moving image based on an input such as pressing a shutter. By fixing and enabling acquisition of the still image for the user's favorite or favorite at the timing, the user can obtain the still image for the desired synthesis while checking the state of the synthesized image in advance. Further, it is possible to obtain an image for synthesizing various moving images and a still image for synthesizing a favorite scene from various scenes, and to surely satisfy the user's preference. In addition, since the user can freely select from various synthesis images and scene selection options to obtain a still synthesis image of a desired scene, the user's entertainment can be greatly enhanced.

  Further, the image providing apparatus of the present invention is configured to receive a request to start clipping of a moving image combining image from a user device, and to start clipping of the moving image combining image in response to the clipping start request. Means for receiving, from the user apparatus, a request for terminating the extraction of the image for compositing of the moving image, and in response to the request for terminating the compositing, terminating the extraction of the image for compositing and composing the image from the start to the end. Means for acquiring an image for use, or means for measuring a predetermined time from the start of extraction, and ending the extraction of the image for synthesis according to the lapse of the predetermined time, and obtaining an image for extraction synthesis from the start to the end Means, means for receiving a distribution request for a cut-out composition image from a user device, and means for distributing a cut-out composition image corresponding to the distribution request, or means for receiving a registration request for a cut-out composition image from the user device And cutout corresponding to registration request Characterized in that it comprises a means for registering the image for formation. The predetermined time for cutting out the image for cutting out and synthesizing after the lapse of the predetermined time is appropriate, for example, a fixed time set uniformly.

  A synthetic image is generated by synthesizing the image to be synthesized with the moving image and the image for synthesizing the moving image, which are transmitted in substantially real time from the user device, and the user generates the synthesized image based on the input and the like at a desired timing from the image for synthesizing the moving image. By making it possible to obtain a cut-out composition image that is a moving image of a favorite or favorite part of the user, the user can obtain a cut-out composition image that meets expectations while checking the state of the combined image in advance. In addition, it is possible to obtain an image for synthesizing various moving images or an image for extracting and synthesizing a favorite scene from various scenes, and it is possible to reliably satisfy the user's preference. In addition, since the user can freely select from a variety of synthesis images and scene selection options to obtain a cut-out synthesis image of a desired scene, the user's entertainment can be greatly enhanced.

  Further, the image providing apparatus according to the present invention includes a means for receiving a request for fixing a composite image from a user device, a means for fixing a composite image including a moving image in response to the request for fixing to obtain a still composite image, A means for receiving a distribution request for a still composite image from a user device and a means for distributing a still composite image corresponding to the distribution request, or a means for receiving a registration request for a static composite image from the user device and a still composite image corresponding to the registration request. Registering means.

  A composite image is generated by synthesizing a compositing target image and a compositing image based on a moving image transmitted substantially in real time from the user device, and the user likes the composite image at a desired timing based on an input such as pressing a shutter. Alternatively, by fixing and obtaining a desired still synthetic image, the user can freely adjust the image to be synthesized in substantially real time, try synthetic images with various synthetic images, and obtain various synthetic images. The user can freely select from the selection options and scenes to obtain the desired still composite image according to the desired scene, so that the user's entertainment can be greatly enhanced and the preference can be ensured. Can be satisfied. In addition, when the image for composition is a moving image, the above-mentioned effect is further enhanced.

  Further, the image providing apparatus of the present invention is configured to receive a request to start cutting out a composite image from a user device, to start cutting out a composite image including a moving image in response to the request to start cutting out, Means for receiving a cut-out request for a combined image from a user device, means for ending cut-out of the combined image in response to the cut-out request, and obtaining a cut-out combined image from the start to the end, or Means for measuring a predetermined time, means for ending the extraction of the composite image in accordance with the lapse of the predetermined time and obtaining a composite image from the start to the end, and a request for distribution of the composite image from the user device Means for receiving a cut-out composite image corresponding to the distribution request, or means for receiving a registration request for the cut-out composite image from the user device, and means for registering the cut-out composite image corresponding to the registration request. thing And it features. Note that the predetermined time when the clipping is performed after a predetermined time has elapsed is, for example, a reproduction time from the start to the end of the compositing image, which is a moving image of the predetermined time, or a fixed time that is set uniformly.

  A compositing image is generated by compositing a compositing target image and a compositing image based on a moving image transmitted substantially in real time from the user device, and the user likes or likes the composite image at a desired timing based on an input or the like. By fixing the cropped composite image so that it can be acquired, the user can freely adjust the compositing target image almost in real time, try composite images with various compositing images, and obtain various composite images and scenes. Since the user can freely select from the selections and obtain a desired cut-out composite image according to a desired scene, the entertainment of the user can be greatly enhanced, and the user's preference is reliably satisfied. be able to. In addition, when the image for composition is a moving image, the above-mentioned effect is further enhanced.

  Further, the image providing apparatus of the present invention includes: a unit for capturing a moving image; a unit for continuously acquiring a synthesis target image of the moving image to be captured; or extracting a synthesis target image of the moving image from an original image of the captured moving image. Means for continuously obtaining the synthesis target image by combining the image to be synthesized and receiving the image to be synthesized and the synthesis target image substantially in real time after receiving the image for synthesis continuously or substantially in real time after receiving the image for synthesis continuously And a means for generating a composite image by superimposing and synthesizing a composite image. The image providing apparatus is connected via an information transmission medium to display the composite image on the user device, and stores the composite image. Means for receiving, from the user device, a designation of a composition image to be superimposed on the composite image, means for extracting a composition image corresponding to the received designation, and a user Means for transmitting to the device, or means for storing the image for synthesis, means for receiving from the user device the specification of the image for synthesis to be synthesized with the synthesized image generated substantially in real time, and the received specification And means for transmitting the extracted synthesis image capable of generating the synthesized image in substantially real time to the user device. In the above configuration, together with the composite image to be extracted and transmitted, in cooperation with the composite image generating means of the user device, the composite image to be transmitted to the composite target image acquired by the user device is converted to the composite image. Preferably, a means for transmitting to the user device at least a part of data or a program to be superimposed and synthesized substantially in real time with the transmission is provided.

  An image to be combined is transmitted from the image providing device to the user device, and the combined image and the image to be combined received by the user device are superimposed and combined almost in real time with the reception of the combined image to generate and display a combined image. This makes it possible to generate a composite image that largely reflects the user's intention and movement. Then, the user can check the state in which the desired image for combination is combined with the image to be combined and enjoy it as if trying on it. By giving a change such as movement or change, the combined state of the image to be combined and the image for combination can be freely changed and adjusted substantially in real time and enjoyed, thereby greatly improving the user's entertainment. In addition, since the user is displayed with the synthesized image based on the favorite image for synthesis, the user's preference can be satisfied. Further, since the user device is connected to the image providing device via the information transmission medium, the user can enjoy a desired synthesized image without being restricted by a place or time. In particular, if a plurality of or a large number of various compositing images are stored, and the designated desired compositing image is composed with the compositing target image so that the composite image can be displayed, the user can perform various operations over a long period of time. This is preferable because it is possible to enjoy a composite image using various composite images.

  Also, the present invention provides a means for capturing a moving image, a means for continuously acquiring a synthesis target image of a moving image to be captured, or a method for extracting and combining a synthesis target image from a source image of the captured moving image. A means for continuously acquiring a target image and a means for receiving a designation of a compositing image from a user device including means for composing a compositing target image with a presented or transmitted compositing image to generate an integrated composite image Means for extracting a composition image corresponding to the received specification, and means for presenting or transmitting the extracted composition image to the user device. A means for receiving a distribution request for an image or the like and a means for distributing a composition image or the like corresponding to the distribution request, or a means for receiving a registration request for a composition image or the like from a user device and a means for composing the registration request Also it includes an image providing apparatus comprising means for registering an image or the like. Note that the same configuration as that of the image providing device can be appropriately adopted as the configuration for acquiring the composite target image and the configuration for generating the composite image in the user device.

  Also, the present invention provides a means for storing a composition image, a means for receiving designation of a composition image, a means for extracting a composition image corresponding to the received designation, and a method for storing the extracted composition image in a user device. , A means for receiving a distribution request such as a composition image from a user device, and a means for distributing a composition image or the like corresponding to the distribution request, or a composition image or the like from the user device as necessary. An image receiving program for receiving, via a communication network, a compositing image for compositing with a compositing target image from an image providing apparatus including means for receiving a registration request of Means for continuously obtaining a synthesis target image of a moving image to be captured, or extracting a synthesis target image of a moving image from the captured moving image and continuously obtaining a synthesis target image Means that also include those causing a computer to function as means for generating an integral composite image by combining the synthesis target image in the synthesized image presented or transmitted. In addition, the configuration of the image providing device or the user device can be appropriately adopted as each configuration of the image receiving program, and the same operation and effect as described above can be obtained by the image receiving program.

  Also, in the case where the image for composition is transmitted from the image providing device to the user device and the composite image received by the user device and the image to be composed are superimposed and composed to generate a composite image, It is possible to appropriately use a configuration or the like of image distribution or registration, acquisition or distribution or registration of a still composite image, acquisition, distribution or registration of a cut-out composite image, and the same operation and effect as described above can be achieved by such a configuration. Play. Further, in the case of a configuration in which the image to be combined is transmitted from the image providing device to the user device and the combined image received by the user device and the image to be combined are overlaid and combined to generate a combined image, A configuration in which a predetermined means cooperating with a program receives an input fixing request, and acquires a still composite image by fixing a composite image of a compositing target image and a compositing image to be received in response to the fixing request. A cutout start request is received, a cutout of a synthesized image is started by the synthesis target image and the synthesis image to be received in response to the cutout start request, and a cutout end request of the input synthesis image is received, and the cutoff is received. The cutout of the composite image is ended in response to the output end request to obtain a cutout composite image from the start to the end, or a predetermined time is measured from the start of the cutout, and the composite image is calculated according to the elapse of the predetermined time. Finish cutting and open From the end to the end, and by storing the still composite image and the cut composite image as necessary, the acquisition of the above-described still composite image and the cut composite image can be performed. The same operational effects as those of the configuration of distribution or registration can be obtained.

  Further, the image providing apparatus of the present invention is an image providing apparatus for displaying a composite image on a user device connected via an information transmission medium, and a means for storing a composite image, and Means for receiving an image specification, means for extracting a compositing image corresponding to the received specification, means for taking in a compositing target image, or taking in an original image containing a compositing target, and Means for extracting the image to be synthesized, means for overlaying and synthesizing the image to be synthesized with the extracted synthesizing image to generate an integrated image, means for presenting the synthesized image to the user device, and Means for receiving a distribution image or a composite image distribution request, means for distributing the composite image or composite image corresponding to the distribution request, or registration of the composite image or composite image from the user device. Characterized in that it comprises a means for registering the synthesis image or synthetic image corresponding to the unit and the registration request is accepted requests. The combining image can be a moving image or a still image, and the combining target image can be a moving image or a still image. Further, the compositing target image stores a plurality of compositing target images, accepts designation of a compositing target image from a user device, extracts a compositing target image corresponding to the received specification, and extracts the extracted compositing target image. It is also possible to adopt a configuration in which the image is overlaid with the image for use, or a configuration without means for the distribution and registration.

  By generating and presenting a composite image by combining the compositing image selected or designated by the user and the compositing target image, the user can enjoy the state of combining the compositing target image with the desired compositing image. And the user's entertainment can be enhanced. In addition, since the user is presented with a composite image based on a favorite composite image, the user's preference can be satisfied. In particular, if the composition target image can be designated from a plurality, the combinations are diversified, and the above-mentioned effects are further enhanced. Further, since the user device is connected to the image providing device via the information transmission medium, the user can enjoy a desired synthesized image without being restricted by a place or time. In particular, if a plurality of various compositing images are stored and the designated desired compositing image is composed with the compositing target image so that the composite image can be presented, the user can perform various compositing over a long period of time. This is preferable because it becomes possible to enjoy a composite image based on the use image.

  In addition, for example, a user who can generate a synthesized image by synthesizing an image to be synthesized with an image for synthesis and transmit or display the synthesized image, such as a videophone device having an image synthesis function and capable of transmitting the synthesized image to a communication partner. If the composition image is delivered to the device, etc., the composite image in the same state as when the composite image is generated by the user device is presented by the image providing device, and is presented to the user by the image providing device. It is possible to confirm the image in the combined state in advance with the combined image to be provided, and to deliver the combined image to the user device after the confirmation. In other words, the user can use the composite image provided by the image providing apparatus in advance to check the image by using the composite image provided by the image providing apparatus, and then receive the desired composite image. It is possible to eliminate the disappointment of the user such that the synthesized image based on the image or the image of the synthesized image received is different from the expected one, and to surely provide the synthesized image matching the user's preference. Further, in the case of performing communication using a composite image with a videophone device or the like that has an image compositing function and can transmit the composite image to a communication partner, both the user and the communication partner use the composite image using the composite image. Can be enjoyed, and the entertainment of both parties can be improved. In addition, it is possible to germinate or raise the user's consciousness of treating the image for synthesis as an ornament in a virtual space, and to create a new demand and a new market for the image for synthesis and the like.

  Further, the image providing apparatus according to the present invention is characterized in that the image for combination is a background image for a videophone. With the above-described configuration, the user can test the background image in advance by using the composite image provided by the image providing device to check the image, and then obtain a desired background image. The user's expectations are not disappointed, for example, the image of the image and the synthesized image of the background image are different from the expected ones, and the background image that matches the user's preference can be reliably provided. Also, when communicating using a composite image with a videophone device having an image compositing function and capable of transmitting the composite image to a communication partner, for example, both the user and the communication partner use a variety of background images that match their tastes. The composite image can be enjoyed, and both entertainments can be improved. In addition, it is possible to germinate or raise the user's consciousness of treating the background image as an ornament in a virtual space, and to create a new demand and a new market for the background image of the videophone device. . It should be noted that the image for synthesis is appropriate as a background image other than for a videophone, a foreground image, or the like, as described later.

  Further, the image providing apparatus of the present invention is characterized in that the image providing apparatus includes means for charging a user for providing, distributing, registering, or a combination of the images by using a composite image. By charging, it is possible to reliably obtain profits, and to secure a profit base for business, such as provision of composite images and distribution of predetermined images.

  For example, for the generation and presentation of the composite image or the presentation of the composite image, the display time of the composite image measured by the timer is set separately for each unit time corresponding to the unit price or the type of the image for composition, which is set uniformly per unit time. The unit price multiplied by the unit price, the amount obtained by multiplying the connection time between the image providing device and the user device by the set unit price per unit time, the unit price set uniformly for the number of generations or presentations of the composite images to be counted, or A configuration including means for charging a user for an amount or the like multiplied by a unit price set specifically according to the type of the image for synthesis, or an appropriate combination of these, or an image for synthesis or static synthesis Setting for distribution or registration / storage of images for use, cut-out combined images, still combined images, or cut-out combined images, corresponding to a predetermined image unit such as one image unit Or a means for charging the user for the amount set separately for each type of image to be synthesized or for synthesis, or a still synthesis image, cutout synthesis image, still synthesis image, or cutout synthesis A configuration that includes means for charging the user for a set amount for acquiring or presenting an image, or a reproduction time or a cutoff for distributing or storing a composite image, a cut-out composite image, or a cut-out composite image. It is possible to provide a configuration including means for charging the user with a unit price set uniformly per unit time for the departure time or a unit price multiplied by a unit price set individually according to the type of image for composition or the like. is there.

  Or, a configuration including means for charging a fixed amount of usage fee to a user, such as charging a fixed amount to a user on a monthly basis, or registering authentication information of a user set to be charged a fixed amount and registering the user A means for providing a composite image by authenticating by collating authentication information entered and the like with input authentication information and charging the user, or a method for presenting a composite image or an image for compositing. A configuration including means for charging a user for an amount obtained by multiplying a transmission data amount to be received or transmitted such as image data by a unit price set per unit data amount with respect to distribution or transmission of a moving image or a synthesis target image, or It is also possible to provide an appropriate charging configuration, such as a configuration of an appropriate combination of these, and a configuration including means for storing charging information to the user as necessary. In addition, the image providing apparatus is provided with monetary information recognizing means for receiving and recognizing electronic money data via short-range wireless communication or the like. In accordance with the recognition of, the configuration for generating and presenting a composite image, or presenting a composite image or distributing and storing an image for compositing, etc., and the like, and the present configuration can be combined with a required charging configuration .

  Further, the image providing method of the present invention is an image providing method by a computer which presents a composite image at a user device connected via an information transmission medium, and uses designation of a composite image to be superimposed and composited with the composite image. Prompting the user device to transmit a compositing target image of a moving image to be superimposed on the compositing image or transmitting an original image of a moving image from which the compositing target image can be extracted; A composite image generated by superimposing and synthesizing a composite image and a received compositing target image or a composite image generated by superimposing and synthesizing a designated compositing image and a compositing target image extracted from a received original image are output from the user device. The method further comprises a step of presenting the synthesized image or the original image on the user device substantially in real time with the transmission. In the present invention, the prompting of designation and prompting of each request are performed by, for example, an image display unit of the user device, a menu having the menu items or icons or the like or the menu items of the request or the like by data transmission. A configuration that prompts visually by displaying etc., a configuration that prompts audibly by generating a voice that prompts designation and each request by data transmission with a speaker of the user device, and a predetermined combination thereof, It is possible to adopt an appropriate configuration that can prompt the user to specify or request each request.

  Furthermore, the image providing method of the present invention includes a step of prompting the user device to transmit a distribution request of a composite image to be distributed or a registration request of a composite image to be registered, or a request to fix a composite image of a moving image. And prompting the user device to transmit a distribution request or a registration request of a still compositing image in which the compositing image is fixed in response to the fixing request, or A step of prompting the user device to transmit a cutout start request for the composition image, and a prompting of the user device to transmit a cutout end request for the composite image whose cutout has been started in response to the cutout start request, if necessary. Step S: transmitting a distribution request or a registration request of a clipping-synthesis image from the clipping start to the clipping end obtained in response to the clipping end request or in response to the end of the measurement of the predetermined clipping time. Promoted by Or prompting the user device to transmit a request for fixing a composite image including a moving image, and using a transmission request for a distribution or registration request of a static composite image in which the composite image is fixed in response to the fixing request. Prompting the user device to transmit a composite image including a moving image, or prompting the user device to transmit a composite image including a moving image, and, if necessary, starting the composite image in response to the clipping start request. Prompting the user device to transmit a cutout end request, and a cutout synthesized image from the start of cutout to the end of cutout obtained in response to the cutout end request or in response to the end of measurement of a predetermined cutout time And prompting the user device to transmit the distribution request or the registration request.

  Further, the image providing method of the present invention includes a means for capturing a moving image, a means for continuously acquiring a synthesis target image of a moving image to be captured, or an image for combining a moving image from an original image of the captured moving image. Means for continuously obtaining the synthesis target image by combining the image with the synthesis target image in substantially real time with the continuous acquisition of the synthesis target image or in substantially real time with the continuous acquisition of the synthesis target image and receiving the image for synthesis. Means for providing a composite image by a user device connected via an information transmission medium, comprising: means for generating a composite image by superimposing and synthesizing images, comprising: A step of prompting the user device to specify the image for use, and a step of presenting the image for synthesis corresponding to the specification to be superimposed on the image to be synthesized by the user device. .

  Further, the image providing method of the present invention is an image providing method by a computer which presents a composite image at a user device connected via an information transmission medium, and includes a method of transmitting a composite target image to be superimposed with a composite image. The computer prompts the user device to transmit an original image from which the synthesis target image can be extracted, or inputs a synthesis target image to be superimposed and synthesized with the synthesis image or an input of an original image from which the synthesis target image can be extracted. A prompting step, a step of prompting the user device to designate a compositing image to be superimposed on the composite image, and a composite image generated by superimposing and compositing the compositing target image obtained by reception or capture with the specified compositing image. Or a step of presenting, at the user device, a composite image generated by superimposing and synthesizing a synthesis target image extracted from an original image obtained by reception or capture with a designated synthesis image; Characterized in that it comprises a step of prompting at the user device to transmit the delivery request or a registration request of the composite image. Note that the image providing method of the present invention, an image providing program described below, and the like exhibit the same operational effects as those described above for an image providing apparatus having a substantially corresponding configuration.

  Further, the image providing program of the present invention is an image providing program that causes a computer to function as a means for presenting a composite image to a user device connected via an information transmission medium, and a means for storing a composite image, Means for receiving a designation of a composition image from a user device, means for extracting a composition image corresponding to the received designation, means for taking in a composition target image of a moving image transmitted from the user device, and the composition target image Means for generating a synthesized image by superimposing and synthesizing the image for synthesis to extract, or means for taking in the original image of the moving image transmitted from the user device, and means for extracting the image to be synthesized of the moving image from the original image Means for generating a synthesized image by superimposing and synthesizing the synthesis target image with the synthesis image to be extracted; and transmitting the synthesis target image or transmitting the original image. And characterized by causing a computer to function as means for presenting a composite image to the generated in real time to the user device.

  Further, the image providing program according to the present invention is a means for receiving a distribution request for a composition image from a user device, a means for distributing a composition image corresponding to the distribution request, or a registration request for a composition image from the user device. Means for causing a computer to function as means for registering a compositing image corresponding to the registration request, or means for receiving a request for fixing a compositing image of a moving image from a user device; and Means for fixing the image for synthesis and obtaining the image for still synthesis, means for receiving a distribution request for the image for static synthesis from the user device, and means for distributing the image for static synthesis corresponding to the distribution request, or the user device Functioning a computer as a means for receiving a registration request for a still composition image from a user and a means for registering a still composition image corresponding to the registration request A means for receiving a request to start clipping of a moving image from a user device; a means for starting clipping of a moving image to be combined in response to the request to start cutting; Means for receiving a cut-out end request for the compositing image of the moving image, and means for ending the cut-out of the compositing image in response to the cut-out end request and obtaining a cut-out composite image from the start to the end, or Means for measuring a predetermined time from the start of the extraction, means for ending the extraction of the image for synthesis according to the lapse of the predetermined time, and obtaining an image for the extraction synthesis from the start to the end; Means for accepting a distribution request for an outgoing composition image and means for distributing a clipping / combining image corresponding to the distribution request, or means for receiving a registration request for a compositing / combining image from a user device and a corresponding clipping request How to register an image for composition And characterized by causing a computer to function as a.

  Further, the image providing program according to the present invention includes means for receiving a request for fixing a composite image from a user device, means for fixing a composite image including a moving image in response to the request for fixing to obtain a still composite image, A means for receiving a distribution request for a still composite image from a user device and a means for distributing a still composite image corresponding to the distribution request, or a means for receiving a registration request for a static composite image from the user device and a still composite image corresponding to the registration request. Functioning the computer as a means for registering, or means for receiving a request to start cutting out a composite image from the user device, and means for starting cutting out a composite image including a moving image in response to the request to start cutting out, Means for receiving a composite image cutout end request from a user device, and in response to the cutout end request, terminating cutout of the composite image and starting the cutout composite image from start to end Means for obtaining a composite image, or means for measuring a predetermined time from the start of clipping, and means for ending the clipping of the composite image according to the lapse of the predetermined time and obtaining a clipped composite image from the start to the end, A means for receiving a distribution request for a cut-out composite image from a user device and a means for distributing a cut-out composite image corresponding to the distribution request, or a means for receiving a registration request for a cut-out composite image from a user device, and a unit corresponding to the registration request. The computer is caused to function as means for registering the output composite image.

  The image providing program according to the present invention may further include a unit that captures a moving image, a unit that continuously obtains an image to be combined with a captured moving image, or an image to be combined with a moving image extracted from an original image of the captured moving image. Means for continuously obtaining the synthesis target image by combining the image with the synthesis target image in substantially real time with the continuous acquisition of the synthesis target image or in substantially real time with the continuous acquisition of the synthesis target image and receiving the image for synthesis. Means for generating a composite image by superimposing and synthesizing images, and an image providing program for causing a computer to function as means for presenting the composite image to a user device connected via an information transmission medium. Means for storing an image, means for receiving, from the user device, a designation of a composition image to be superimposed on the composite image, and extraction of a composition image corresponding to the received designation. Means, that causes a computer to function as means for transmitting the synthesized image for the extracted to the user device, wherein.

  Further, the image providing program according to the present invention includes a means for receiving an image for synthesis from an image providing apparatus connected via an information transmission medium, and a means for continuously obtaining a synthesis target image of a moving image captured by an imaging means. A means for extracting a compositing target image of a moving image from an original image of a moving image picked up by an image pickup means and continuously obtaining a compositing target image; Means for generating a synthesized image by superimposing and synthesizing the image to be synthesized and the image for synthesis to be received in substantially real-time and receiving the image for synthesis continuously, and a means for displaying the generated synthesized image on the image display means. Means for receiving an image for combination from an image providing apparatus connected via an information transmission medium, and means for extracting an image to be combined to be stored. A computer for generating a composite image by superimposing the composite image to be extracted and the received composite image in substantially real time upon reception of the composite image, and a computer for displaying the generated composite image on the image display unit. Is made to function. The image providing program is, for example, stored in a memory of the user device, it is preferable to obtain a composition target image substantially in parallel with the reception of the composition image, and the like, and the stored composition target image is, An image captured and captured and stored by the image capturing means, an image obtained by extracting and storing an image to be combined from an original image captured and captured by the image capturing means, a data received or read and captured and stored, a data received or stored The original image can be read and taken in, and a composition target image can be extracted from the original image.

  With the image providing program, the user can enjoy the feeling of trying on the image by combining the image to be synthesized with the desired image for synthesis, and enjoy the feeling of trying on the image. It is possible to make changes such as movements and changes in the image to be synthesized in substantially real time, and freely change and adjust the combined state of the image to be synthesized and the image for synthesis almost in real time to enjoy the user's entertainment. Can be increased. In addition, since the user is displayed with the synthesized image based on the favorite image for synthesis, the user's preference can be satisfied. Further, since the user device is connected to the image providing device via the information transmission medium, the user can enjoy a desired synthesized image without being restricted by a place or time. In particular, if a plurality of or a large number of various compositing images are stored, and the designated desired compositing image is composed with the compositing target image so that the composite image can be displayed, the user can perform various operations over a long period of time. This is preferable because it is possible to enjoy a composite image using various composite images.

  Further, the image providing program of the present invention is an image providing program that causes a computer to function as a unit that presents a composite image to a user device connected via an information transmission medium, and a unit that stores a composite image. Means for receiving the designation of the image for synthesis from the user device, means for extracting the image for synthesis corresponding to the received specification, means for capturing the image to be synthesized, or for capturing the original image including the image to be synthesized and synthesizing from the original image Means for extracting a target image, means for overlaying and synthesizing the synthesis target image with the extracted synthesizing image to generate an integrated synthetic image, means for presenting the synthetic image to a user device, A means for receiving a distribution request for a composition image or a composite image from the device, and a means for distributing a composition image or a composite image corresponding to the distribution request, or a user device. Means and synthesizing the image or synthetic image corresponding to the registration request accepting registration requests synthesis images or synthetic images characterized by causing a computer to function as means for registering.

  The image providing program according to the present invention includes, for example, an image display program, an image editing program, a composition target image extraction program, a composition image generation program, a composition target image extraction and a composition image generation program, and the like. And a program stored in the image providing device, a program stored in the user device, and an image providing device as required when communicating between the image providing device and the user device such as when presenting a composite image. And a program that causes the user device to temporarily function as the predetermined means, and a program that appropriately selects and configures the predetermined means of each invention. Further, the image providing apparatus and the image providing method of the present invention include a configuration having means and steps for transmitting or receiving a required image providing program. At an appropriate time such as at the time of transmission, a composition target image extraction program or a composition image generation program or a composition for transmitting the composition target image extraction and composition image generation program to the user device can be adopted. A configuration in which transmission is automatically performed in a PUSH type, a configuration in which transmission is performed in response to a request in a PULL type, or the like is possible. In addition, similarly, transmission of various data can also be performed by PUSH type or PULL type as necessary. In addition, the image providing device or the user device may be configured to store or transmit a program or a control program that causes each device to function as appropriate predetermined means within a range where a composite image can be provided. It is.

  In addition, as an example of a configuration having means and steps for transmitting or receiving the required image providing program according to the present invention, for example, a means for capturing a moving image and an image to be combined with the captured moving image are acquired. A user device having means for extracting and acquiring a composition target image from an original image of a moving image to be captured is provided with a composition target image acquired by the user device in substantially real time upon reception of a composition image and the composition. A configuration in which an image providing apparatus transmits a program for causing a computer to function as a unit for generating a composite image by superimposing images for use, a unit for capturing a moving image, a unit for acquiring a moving image to be captured, and an image to be combined The user device having means for superimposing and synthesizing the composite image to receive the composite image and generating the composite image substantially in real time is provided to the user device. A user having a configuration in which an image providing apparatus transmits a program for causing a computer to function as a unit for extracting a compositing target image from a moving image acquired in real time, a unit for capturing a moving image, and a unit for acquiring a moving image to be captured A program for causing a computer to function as a means for extracting a synthesis target image from a moving image to be acquired and generating a composite image by superimposing and synthesizing the synthesis target image and the synthesis image in substantially real time upon reception of the synthesis image. May be configured to be transmitted by the image providing apparatus.

  The present invention also includes a transfer device for transferring various data, for example, a transfer device for transferring a composite image of an image providing device for presenting a composite image to a user device connected via an information transmission medium. The designation of the image for synthesis is transferred from the user device to the image providing device, and the image to be synthesized of the captured moving image or the original image of the moving image is transferred from the user device to the image providing device and stored. A composition image corresponding to the received specification is extracted from the composition image to be combined, and a composition image to be continuously captured is superimposed on the composition image to be extracted to generate a composite image substantially in real time with the capture. An image providing device or an image to be synthesized of a moving image is extracted from an original image to be continuously captured, and the extracted image to be synthesized is superimposed and synthesized with the extracted image to be synthesized, and the captured image is substantially in real time. Transferring the synthesized image from the image providing device that generates the synthesized image to the user device, and transmitting the synthesized image or the original image and presenting the synthesized image by the image providing device in substantially real time. A transfer device for transferring a composite image of an image providing device that presents a composite image to a user device connected via an information transmission medium, or a user device connected via an information transmission medium, wherein the user specifies a synthesis image. From the image to be provided to the image providing apparatus, and extracts the image to be combined corresponding to the received designation from the image to be stored and extracts the image to be stored to be extracted from the image to be stored or the original image and stored. The composite image is transferred from the image providing apparatus that generates the composite image by superimposing and compositing the composite image to the user device, and the distribution request or registration request of the composite image is transmitted to the user. It includes transfer apparatus that is characterized in that forwarded towards the place we image providing apparatus.

  The information transmission medium according to the present invention includes, for example, various communication lines or communication networks, such as a dedicated line or a public line, the Internet or an IP network, satellite communication, or a telephone line network such as a mobile phone. Alternatively, communication by short-range communication means such as wireless LAN, Bluetooth (registered trademark), infrared communication, dedicated short range communication (DSRC), or a combination thereof may be used. Combinations of the two are included, and communication using radio waves, communication using light, combinations thereof, and the like are also included. In addition to these, the information transmission medium includes any appropriate medium that can communicate with the image providing apparatus and the user apparatus and can transmit and receive data such as images and sounds. This includes a configuration in which the device broadcasts an image or the like by digital broadcasting or the like, and a configuration in which the user device transmits data to the image providing device via a communication line. Further, the form of the system of the image providing apparatus and the user apparatus connected by an information transmission medium such as a communication line or a communication network may be a client-server system or a peer-to-peer form. Further, when the image providing apparatus and the user apparatus are connected via a long-distance communication line, for example, a configuration in which the user apparatus accesses and connects to a URL or an IP address set in the image providing apparatus, or a telephone It is possible to connect the communication line between the image providing device and the user device by making a call to the image providing device to which the number is set by the user device such as a mobile phone or a fixed telephone using the telephone number. However, in the latter configuration, it is possible to easily charge by telephone charges, so that it is possible to secure profit more reliably.

  Further, the image providing device is not particularly limited as long as it functions as a computer functioning as a predetermined means, such as a server, a personal computer, a plurality of computers connected via a network, a dedicated device for remotely communicating with a user device, or a multifunctional device. It may be a dedicated device or a multi-function device which is installed at a required place such as a shopping center or a convenience store and communicates with the user device in a short distance, or a required combination thereof. The predetermined means or the predetermined unit in the image providing apparatus can be realized by being constituted by required parts such as a CPU and a memory cooperating with a predetermined program to be stored, and can be realized by the predetermined means in the user device. Alternatively, the same applies to the predetermined portion.

  Further, the user device is not particularly limited as long as it is a computer functioning as a predetermined means. For example, a personal computer, a TV game machine, a combination of a TV game machine and a TV device, a fixed telephone, a mobile phone, a mobile terminal, a vehicle-mounted terminal, a digital It is possible to use a television device such as a television, a radio device with an image display function, a set-top box, a combination of a set-top box and a television device, various devices having a videophone function, and the like. When receiving from the image providing device a composite image composed of the image to be composed and the image to be composed by the moving image to be transmitted, the user action is to transmit the moving image in substantially real time and receive and display the presented composite image. It is appropriate as long as it has a function of performing the above. The user device is preferably a videophone device such as a mobile phone or a fixed phone. The videophone device of the present invention captures and transmits audio data and image data, and transmits audio data transmitted from the other party. And a video telephone device using a personal computer as long as the device can receive the image data and the image data and can communicate in two directions.

  Further, when the predetermined unit of the image providing device distributes an image to the user device, for example, the user device receiving the distribution is a user device having an image combining function or the like, or another user device having an image combining function or the like. A user device or the like that receives and stores the information for use by the user may be used. In addition, for example, a user device that receives distribution of an image such as a composition image or a user device different from the user device that receives the distribution designates a composition image for generating a composite image via an information transmission medium. The user device or the another user device in transmitting a request or selection request or a designation of a composition image or the like to be distributed as required and a distribution request, and displaying the presented composite image. As long as it has a data transmission / reception function and a composite image browsing function, it is suitable for a personal computer or the like in the same manner as the above-mentioned user device. In such a case, it is preferable to have a function of receiving and storing an image such as an image for synthesis. In the distribution of the image providing apparatus of the present invention, for example, a predetermined unit of the image providing apparatus stores a predetermined image in a predetermined storage unit in association with identification information such as an address, and stores the identification information such as the address. To the user device and presenting the predetermined image to the connected user device by specifying and inputting the identification information such as the address.

  In addition, when the predetermined unit of the image providing apparatus distributes an image such as a composition image or a composite image to the user device, for example, a user who transmits a designation request or selection request of a composition image or a distribution request of a composition image or the like. A configuration for distributing images for synthesis to the device, a user designated or registered by the same user device as the user device transmitting the designation request, the selection request or the distribution request, or another user device A configuration for distributing a composition image or the like to a device, or a composition image or the like to a user device designated or registered when a designation request, a selection request, or a distribution request is directly input to an image providing device. When the image providing apparatus receives a request for designating or selecting a composition image or a distribution request for an image such as a composition image, for example, an image such as a composition image is distributed. Profit A configuration that receives a specification request or a distribution request transmitted from a user device, a configuration that receives a specification request or a distribution request transmitted from a user device different from a user device to which an image such as a composition image is distributed, A configuration for receiving a specification request or a distribution request directly input from the input unit or the like to the image providing apparatus, a configuration for receiving a specification request and a distribution request transmitted from another user device, and a specification request or direct input for transmission An appropriate configuration, such as a configuration for receiving a requested distribution request or the reverse thereof, or a combination thereof can be adopted. Also, when the predetermined unit of the image providing apparatus accepts a designation request or a selection request of a composition image, for example, a configuration for accepting a designation request transmitted from a user device, or a configuration that is directly input from the input unit or the like to the image providing apparatus. A suitable configuration such as a configuration for receiving a specification request or a combination thereof can be adopted. In addition, the configuration of distributing to another user device or the like can improve the convenience of the user, for example, the distribution can be received by the user device using the image for combination or the composite image. By distributing the image for synthesis, the synthesized image, and the like to the user device, the image for synthesis and the like can be presented to other users.

  When the image providing apparatus acquires the image to be combined, for example, the moving image or the still image is stored in a user device to which the image for synthesis is distributed or a user device other than the user device. From a user device having an imaging unit such as a camera that captures an image, a predetermined unit of an image providing device receives and captures an original image including an imaged synthesis target transmitted via an information transmission medium, and performs the synthesis. A configuration in which an image to be combined is separated and acquired from an original image including a target, or a user device to which the image for combination is distributed or a user device such as a user device different from the user device, a moving image Alternatively, a synthesis target separated from an original image including an imaged synthesis target transmitted via an information transmission medium from a user device having an imaging unit that captures a still image and having a function of separating a synthesis target image the image A configuration in which an image is captured by an imaging unit provided in an image providing apparatus, an original image including a synthesis target is captured, and a synthesis target image is separated and obtained. It is possible to adopt a configuration in which the image providing apparatus acquires the synthesis target image by capturing the synthesis target image itself by the apparatus or the imaging unit of the image providing apparatus, or a combination of these. , The composition target image is acquired almost in real time, the composition target image is acquired in advance, or a combination thereof is possible.

  In addition, the presentation of the synthesized image by the image providing device is performed, for example, by a predetermined unit of the image providing device transmitting the generated synthesized image to the synthesis target image or the original image of the synthesis target image via the information transmission medium or the user device. A configuration for transmitting to a user device different from the transmitting user device and presenting it by displaying it on an image display unit, or a user device for transmitting a compositing image to a user device having an image compositing function A composite image is generated and displayed on the image display unit, and the composition is presented to a user device or another user device to which a composition image is distributed via an information transmission medium. A configuration in which data such as an image for synthesis is transmitted and presented by displaying the image on an image display unit, a configuration in which the data is presented on an image display unit provided in an image providing apparatus, and a configuration in which the data is presented. It is possible to employ such suitable arrangement combination of al.

  In addition, the number of images to be combined used when combining with the image to be combined can be one or more. For example, a predetermined unit of the image providing apparatus presents a plurality of images for combination so as to be able to be specified, and A request for designating a plurality of images for synthesis may be received by a request for designating a plurality of images for synthesis, and the plurality of images for synthesis for which the request for specification has been received may be combined with the image to be synthesized. In addition, the image for synthesis may be an image to be synthesized on a layer behind the image to be synthesized, such as a background image or an image of an object or a character to be synthesized as a background or a partial background of the image to be synthesized, or at a predetermined position such as substantially in the center. A compositing target image such as a foreground image such as a frame image or a frame image having a hole through which a part of the compositing target image can be visually recognized, or a partial image that can be arranged at a predetermined position of the compositing target image such as an object or a character It is also possible to use an image or the like to be synthesized on the layer in front of the image, and to use a combination of them. A configuration in which a predetermined unit of the user apparatus writes or replaces a composition image as a background image on a composition target image and composes the composition image, or a composition image A configuration in which writing or replacement is performed as a foreground image, a composition for synthesizing an image to be synthesized so as to sandwich an image to be synthesized or an image including a synthesis target as a foreground image and a background image, a required combination thereof, etc. Can be adopted. Also, for example, one or both of the composition target image and the composition image are made translucent, and the translucent composition target image is arranged in front of the composition image to generate a composite image, or It is also possible to adopt a configuration in which the synthesized image is arranged in front of the synthesis target image to generate a synthesized image. Further, each of the compositing images can be a moving image or a still image.

  Further, the contents of the image for synthesis include an indoor image such as a predetermined room, an outdoor image such as a landscape, an image of space, an image of a virtual space such as a virtual three-dimensional space, an image of a movie or a program, for example, clothes, hair, etc. An image of an object such as a product such as ornaments such as glasses, accessories, and interior furniture, and an image of a character such as a person, a flora and fauna, and a virtual creature, and a desired combination of these are appropriate. In addition, in the image for synthesis, for example, an image in which the same object changes, such as an image in which the same person or the same animal or plant has a different posture, or the same object, such as an image viewed from a different viewpoint in the same article or the same space, is changed. It is possible to appropriately use a viewed image or a combination thereof. Further, it is preferable that the composition image to be distributed is mainly a composition image to be used by the user in a timely manner. For example, a videophone device having a composite image function, a video conference device, a game device, a computer, etc. It is good to distribute the image for synthesis used by the user for the communication of the user, and to distribute the image corresponding to the model of the user device and the size of the image display unit. In the case of a user device such as a videophone device to be used, the image is a background image or a foreground image having a resolution or the like that can be finely displayed on the screen. Further, the image for composition may be an image such as a character image operated by the control unit of the user device in cooperation with a predetermined program.

  Further, as the combining image to be combined with the combined image, the same combining image as the combining image to be distributed or registered may be used. However, a sample image corresponding to the combining image to be distributed or registered is stored or stored. The composite image may be generated and the composite image may be used as the composite image, and the composite image may be generated as a composite image. Or a partial short-time image of a moving image combining image such as a moving image of a representative short-time scene of the content of the image of a plurality of scenes or the contents of the combining image, or a short edited image, a combining image Image of a predetermined area, an image having a resolution lower than that of the image for synthesis, or the like, and can be a still image such as a moving image or a photographic image, and the sample image is the same as the image for synthesis. Further is a possible appropriate sample image corresponding to the synthesized image, for example used in synthesizing the synthesis target image can be single or multiple. Further, it is preferable to perform the duplication preventing process on the synthesizing image or the sample image, and the present invention includes a case where the duplication preventing process is performed on only the synthesizing image, only the sample image, or both the synthesizing image and the sample image.

  Examples of the composition target image or the composition target of the original image including the composition target include persons such as the person, family, and friends, animals and plants that the user has attachment to, accessories and vases that the user has attachment to, and the like. Of the user, the character image that the user has attachment to, the indoor or outdoor predetermined location or area where the user has attachment, or these objects having necessity, or a desired combination thereof, etc. The original image captured without performing the above operation may be used as the synthesis target image. Further, the number of images to be combined is not limited to one, and one or a plurality of images to be combined can be combined with one or more images for combination as appropriate. Receiving one or more moving images from one or more user devices and extracting a plurality of combining target images from one moving image or extracting a plurality of combining target images corresponding to each of the plurality of moving images; Acquire or receive and acquire a plurality of images to be combined from one or a plurality of connected user devices, accept designation of an image to be combined from one user device, or combine from a predetermined number or more user devices. A composition image is generated by accepting the designation of the composition image or by accepting the designation of the composition image from all the user devices, and combining the acquired plurality of composition target images with the received composition image. It is possible to an equal. In the above-described configuration, for example, a configuration in which designation of a composition image is received from one or a plurality of user devices, and composition of combining all the received composition images with one or a plurality of composition target images at a predetermined position or the like, The designation of the image for composition is received from a plurality of user devices, the designated number of the images for composition is counted, and the designated image is combined with the largest number of designated images, or the designated number is set by recognizing the order of the designated number. It is possible to adopt a configuration in which images for combination up to a predetermined order are combined, or images for combination having a designated number equal to or greater than a predetermined threshold value or exceeding a predetermined threshold value are combined. Further, the synthesis target image or the original image including the synthesis target can be a still image such as a moving image or a photographic image.

  Also, the image to be synthesized or the original image including the image to be synthesized, which is a moving image, is continuously transmitted from, for example, a user device to the image providing apparatus. In addition to the configuration in which the predetermined unit generates a composite image and continuously transmits the composite image from the image providing device to the user device, for example, an image is provided in advance from the user device to the image providing device by a video mail or continuous transmission. A synthesis target image or an original image that is a moving image is transmitted to the device, and a predetermined unit of the image providing device receives and receives the synthesis target image or the original image of the moving image, and immediately or for a predetermined time in response to the completion of the reception. Alternatively, a predetermined unit of the image providing apparatus generates a synthesized image based on the synthesis target image or the original image at an appropriate timing such as after a required time has elapsed, and It may be configured such that transmitting the synthesized image from the provider to the user device in a continuous transmission or video mail or the like. In addition, the predetermined unit of the image providing apparatus receives a composition target image or an original image including a composition target in advance by, for example, a moving image mail, and generates and presents a composite image by combining the composition target image and the composition image later. In such a case, when a synthesized image is generated and the generated synthesized image is stored in a predetermined storage unit that is a presentation location, information that can be connected to the presentation location such as a URL is transmitted by e-mail or the like and used. The generated composite image may be presented according to the connection of the user device to the presentation location by the connectable information.

  In addition, the composition for generating a composite image by integrating and superimposing the composition target image and the composition image is appropriate. For example, the composition target image obtained by separating and extracting the image of the user himself / herself from the composition image of the background image may be used. A configuration that integrates to generate a composite image, or a composition target image that includes an image of the user himself or herself is combined with a synthesis image of a foreground image such as a frame image, a character image, an image of an article, an image of a pattern or a color. It is possible to adopt a configuration for generating a combined image, or a combining position for combining a partial combining target image when combining a combining target image that is a partial image with a combining image, or When combining a composition image, which is a partial image, with a composition target image, the composition position at which the partial composition image is composed can be set with an appropriate configuration. Predetermined A predetermined position with respect to the image for synthesis or the image to be synthesized may be set as a synthesis position by using a coordinate value or the like in the memory, and a predetermined unit of the image providing apparatus may synthesize the image at the predetermined position. The predetermined position can be appropriately set in accordance with the content and type of the image, and the predetermined unit of the image providing apparatus stores information on an object by extracting a feature point or the like as in Patent Document 1. It is also possible to adopt a configuration in which an object in an image is recognized by the knowledge database and a composition target image or a composition image, which is a partial image, is composed at a position set according to the object. Also, the size of the compositing target image when compositing a compositing target image that is a partial image with the compositing image, or the compositing when composing a partial compositing image with the compositing target image The size of the image for use can be set by an appropriate configuration. For example, the image for synthesis or the image for synthesis which is a partial image of the image for synthesis or the image for synthesis as a whole is stored in a predetermined memory such as an image providing device. A predetermined size ratio of the image is stored, and a predetermined unit of the image providing apparatus is a synthesis target image or a partial image with the predetermined size ratio corresponding to the size of the entire synthesis image or the synthesis target image. It is possible to adopt a configuration in which the size of the image for synthesis is changed and the image is synthesized.

  In addition, the composition and the size of the compositing target image or the compositing image, which is a partial image, may be changed. For example, a predetermined unit of the image providing apparatus may transmit a predetermined image, which is a partial image, from the user device. A moving request for moving the composing position of the compositing target image or the compositing image in the predetermined direction is received and accepted, and the compositing target image or the compositing image for the moving distance set according to the reception of the moving request in the predetermined direction. Or a predetermined unit of the image providing apparatus receives an enlargement request or a reduction request for a predetermined synthesis target image or synthesis image, which is a partial image, from the user device. A configuration for generating a composite image by enlarging or reducing a compositing target image or a compositing image at a predetermined magnification set in response to reception of the enlargement request or reduction request It is possible to. In addition, the composition target image or the composition image that is a partial image may be configured to be rotatable. For example, the predetermined unit of the image providing apparatus may be configured to transmit a predetermined composition target image or a partial image that is a partial image from the user device. It is also possible to adopt a configuration in which a request to rotate a composition image is received, and a composition target image or a composition image is rotated at a predetermined angle set in accordance with the rotation request to generate a composite image.

  Further, the image to be combined or the original image including the image to be combined is captured by, for example, an imaging unit of the user device, and the image providing device receives an image that is transmitted substantially in real time as the image is captured. What the image providing device receives and saves and sends from the user device, what is captured by the user device and taken into the user device, what is taken in advance by the image providing device and saved, It is possible for the device to directly image in substantially real time or the like.

  Further, the configuration in which the predetermined unit of the image providing device or the user device separates and extracts the synthesis target image from the original image which is the image including the synthesis target is appropriate. For example, the predetermined unit of the image providing device or the user device The predetermined unit obtains an inter-frame difference based on the density, brightness, or color of a pixel between past frames such as a previous frame continuous with the current frame with respect to the original image of the moving image, and sets the inter-frame difference. A configuration in which the moving region and the other region are separated by binarization by comparing with a predetermined threshold value, and the moving region is extracted as an image to be combined, or pixels of a background image stored in advance and an original image of the moving image A configuration in which a moving region and other regions are separated by binarizing the background region by comparing the background region with a predetermined threshold value, and extracting the moving region as an image to be combined. The difference between the neighboring pixels with respect to the original image of the still image is obtained, and the difference is compared with a predetermined threshold value to be binarized to separate the target region from the other region. A configuration for extracting an image or the like can be used. In some cases, the background difference can be obtained by a chroma key technique using a chroma key screen. In the configuration for extracting the target synthesis target image from the original image, the configuration and the like of the target such as a person are set and stored in advance, and the desired target is extracted by pattern matching or the like such as a template. Alternatively, it is possible to extract a target image to be combined with an appropriate configuration, such as a configuration in which a moving region having a predetermined threshold or more is extracted and extracted as a composition target image.

  Further, an active contour model may be used in a configuration for extracting a compositing target image from an original image. An outline function as an initial outline is set in the vicinity of the outside of the image to be synthesized in the image to be synthesized, and an energy function including image energy due to image features, energy for contracting the outline, energy representing smoothness of the outline, and the like. , The control points on the outline are moved to extract the outline of the image to be synthesized, and the image to be synthesized is separated and extracted. The configuration for setting the initial contour is, for example, to execute the process of the inter-frame difference or the background difference, and to enlarge and set the edge of the moving area to be extracted by the process at a predetermined magnification or the like, or to set a preset initial contour. It is appropriate to use and set.

 Further, for example, the predetermined unit of the image providing device or the predetermined unit of the user device acquires the distance information for the image region, and stores and retains the reference distance or the image region existing within the reference distance or the reference distance range and the other region. The image area may be determined based on a predetermined threshold or the like, and the image area such as the reference distance may be separated and extracted as the image to be combined. The distance image is, for example, the focus of the camera, such as the focus in the rejection frame set at approximately the center of the image of the original image captured by a camera having an autofocus function, such as ultrasound and infrared It is appropriate to execute the measurement and rejection for the image area by interlocking the sensor and the camera or stereo shooting by a plurality of cameras, etc., and to obtain the reference distance, and to set the reference distance to, for example, about 20 to 80 cm. The distance can be set. Further, for example, a configuration may be adopted in which the predetermined unit of the image providing device or the predetermined unit of the user device acquires a basic contour of the synthesis target image in advance and extracts the synthesis target image from the original image of the moving image based on the basic outline. .

  In addition, for example, the predetermined unit of the image providing device or the predetermined unit of the user device calculates a feature amount such as luminance or color of the pixel of the original image, and represents a pixel having a small difference from the feature amount of the pixel at the set representative position. A configuration in which the extracted pixel region is extracted as a continuous region with respect to the pixel at the position, and the extracted pixel region is separated and extracted as a region of the image to be synthesized, or a feature amount such as color information such as skin color of a specific person is stored, and the pixel of the original image is stored. A configuration in which pixels having little or the same difference as the stored characteristic amount are extracted from the calculated characteristic amounts as continuous regions, and the extracted pixel regions are separated and extracted as regions of the image to be combined. It may be. Further, if necessary, the predetermined unit of the image providing device or the predetermined unit of the user device calculates an optical flow to detect a moving area, or a predetermined shape of a synthesis target image such as a shape of a person. The configuration may be such that the image is stored, the shape is compared with the separated and extracted image, pattern matching is performed, and a required image to be synthesized is extracted. In addition to the above, the configuration for separating and extracting the synthesis target image from the original image including the synthesis target includes an existing separation configuration other than the above-described configuration, or an appropriate configuration such as one using these configurations in a required combination. Can be adopted.

  In addition, it is preferable that a copy preventing process is performed on a composite image to be distributed, a still composite image, a cut-out composite image, and a composite image such as a still composite image and a cut composite image. By using copy protection such as a watermark, for example, when using a celebrity image for synthesis, it is possible to appropriately protect portrait rights and copyrights, and to provide images with more attractive contents. Become. In addition, without providing a means for distributing or registering a composition image, a still composition image, a clipping composition image, a still composition image, a clipping composition image, etc. A configuration for presenting a still composite image, a cut-out composite image, a still composite image, a cut-out composite image, or the like to the user device, or an image display device provided with an image display unit, and a predetermined unit of the image provision device A configuration in which the display unit displays a composite image, a still composite image, a cut-out composite image, a still composite image, a cut-out composite image, or the like, or an image providing device provided with an output unit such as a printer, and a predetermined unit of the image providing device. However, it is also possible to appropriately provide a configuration or the like that outputs an image at the output unit, such as printing an image for synthesis, an image for still synthesis, an image for cutout synthesis, a still synthesized image, a cutout synthesized image, or the like. , Users can choose their favorite stationary Watch various images such as a formed image and clipping the composite image, it is possible to obtain in or check, image data or paper and seal or the like. In addition, the image for synthesis, the image for still synthesis, the image for cutout synthesis, the still synthesized image, the cutout synthesized image, and the like can be distributed in various formats. It is good to distribute as a standby screen, and it is possible to use the synthesized image generated by the user's preference on the mobile phone, to improve the user's entertainment and satisfaction of the mobile phone Can be. Although the cut-out combined image is a moving image, the cut-out combined image is a moving image in which the combining target image is a moving image, or a still image in which the combining target image is a still image, or a moving image in which the combining target image is a still image. Both the compositing target image and the compositing image include a moving image.

  Further, the image providing device may be configured to present, for example, a degree of adjustment of the blur amount of the combining image so as to be able to be designated by an icon or the like on a predetermined screen such as a combining image presentation screen, and a degree of adjustment of the blur amount of the designated combining image. Receiving means, storing means for storing the image for synthesis corresponding to the degree of adjustment of the blur amount, and means for extracting the image for synthesis corresponding to the degree of adjustment of the designation and the amount of blur, or the blur amount of the image for synthesis Means for presenting the degree of adjustment of the image to be specified, means for receiving the degree of adjustment of the blur amount of the designated image for synthesis, and means for adjusting the degree of blur of the image for synthesis corresponding to the specification to the received degree of adjustment. It is also possible to provide a composition image by combining the composition image and the composition target image having the received adjustment degree. For example, an image for synthesis or a sample image corresponding to each hierarchical adjustment degree of the blur amount is stored, and a synthetic image is generated by synthesizing the image and the synthesis target image, or synthesized in accordance with each adjustment degree. By hierarchically adjusting the blur amount of the image for use or the sample image, and synthesizing the image and the image to be synthesized to generate a synthesized image, the user can obtain a synthesized image having a desired three-dimensional effect. In addition, it is possible to further improve the user's recreation and satisfy the preference. Similarly, for example, a predetermined unit or predetermined means of the image providing apparatus receives a request for adjusting the blur amount of the composition image to be transmitted or input, and the synthesis image is adjusted by a predetermined blur amount set in accordance with the reception. May be configured to generate a composite image from the adjusted compositing image.Alternatively, a request to reduce the amount of blur and increase the sharpness may be accepted, and a process of sharpening may be performed in the same manner. Good.

  In the adjustment to the degree of adjustment of the amount of blur to be accepted or the generation of an image for synthesis with a predetermined amount of blur, for example, a predetermined unit of the image providing apparatus performs a filtering process on a predetermined spatial frequency characteristic, and the blur corresponding to each degree of adjustment is performed. An appropriate configuration such as a configuration in which a filter parameter for generating an amount is set and stored, and a blur amount is adjusted by filtering a synthesis image or the like with a filter parameter corresponding to an adjustment degree, or a configuration in which pixel density is adjusted can be adopted. . In addition, in the case of adjusting the blur amount of a synthesis image or the like for a predetermined blur amount corresponding to the degree of adjustment of the blur amount, for example, when the synthesis image is a background image or the like, the degree of the blur amount is smaller than that of the synthesis target image. May be made larger, or when the image for synthesis is a foreground image or the like, the degree of the amount of blur may be made smaller than that of the image to be synthesized to make it clearer, or both may be appropriately executed.

  In addition, when a composite image is generated from a plurality of composite images, the image providing apparatus may use a configuration in which the adjustment degree is specified by specifying the composite image by, for example, moving a cursor or specifying with a pointer. Means for presenting the degree of adjustment of the blur amount of the image in a specifiable manner; means for receiving the degree of adjustment of the degree of blur specified for each image for synthesis; and means for each synthesis corresponding to the degree of adjustment of each specification and each amount of blur. A means for extracting an image or a means for adjusting the degree of blurring of each compositing image corresponding to each designation to the degree of adjustment that has been accepted, and blurring each compositing image by making the amount of blurring different for each compositing image The amount may be individually adjustable, or the image providing apparatus may adjust the blurring amount by, for example, designating a predetermined location or the like by specifying with a pointer or the like and specifying the degree of adjustment. Means for presenting a predetermined position or predetermined area of the image for use and the degree of adjustment of the blur amount in a specifiable manner; means for receiving a predetermined position or predetermined area of the synthesis image for adjusting the specified amount of blur and the degree of adjustment of the blur amount It is also possible to provide a means for recognizing a specified predetermined location or predetermined area and adjusting the degree of adjustment to the degree of adjustment received, so that the blur amount of the specified predetermined location or predetermined area of the composition image can be adjusted. The predetermined location or region in which the blur amount can be adjusted can be, for example, a predetermined location in the composition image, an object in the composition image, or the like. Also, in the above configuration, similarly to the above, a configuration may be adopted in which only a predetermined amount of blur set in accordance with the degree of adjustment is adjusted. May be applied.

  Further, when distributing or registering a composition image, a composition for extracting and distributing a composition image corresponding to the degree of adjustment of the designated blur amount from the stored composition image, or adjusting the degree of adjustment of the designated blur amount In the case where a composite image is generated using a sample image as a composition image, a composition image for distribution is extracted and adjusted to the degree of adjustment of the designated blur amount, and the composition is distributed. And the like. Further, a configuration may be adopted in which the blur amount of the composition target image can be adjusted. Means for accepting the degree of adjustment of the blur amount of the synthesis target image, and means for adjusting the degree of adjustment of the received blur amount of the synthesis target image, and synthesizing the synthesis target image and the image for synthesis with the received adjustment degree. It is also possible to generate a composite image, and similarly to the above and the case of the image for composition, for example, the predetermined unit or the predetermined means of the image providing device receives a request for adjusting the blur amount of the image to be composited, and A configuration may be adopted in which the synthesis target image is blur-adjusted by a predetermined blur amount set in accordance with the image, and a synthesized image is generated from the adjusted synthesis target image. It reduced accepting a request to the crisp may be subjected to a treatment to clear in the same manner as in the synthesis image. In addition, the configuration may be such that the blur amounts of both the image for synthesis and the image to be synthesized can be adjusted.

  In addition, the same processing as the above-described synthesis image and the synthesis target image can be performed on a still synthesis image, a cutout synthesis image, a still synthesis image, a cutout synthesis image, and a synthesis image. Means for presenting the degree of adjustment of the blur amount of the image in a specifiable manner; means for receiving the degree of adjustment of the blur amount of the specified image; and means for adjusting the amount of blur of the image to the degree of adjustment of the received blur amount , And may be configured to generate an image in which the blur amount of each image is adjusted. Further, the user device may be configured to execute the same filtering or the like as the image providing device to adjust the image for synthesis or the like to a predetermined degree of adjustment of the blur amount. For example, the user device is set. A means for displaying the degree of adjustment of the blur amount of the image for synthesis or the like in cooperation with a program for adjusting the amount of blur of the image for synthesis or the like, and recognizing the degree of adjustment of the amount of blur of the specified image for synthesis or the like. It is also possible to provide a means for adjusting the degree of adjustment of the blur amount by recognizing the image for synthesis or the like, and to display a synthesized image based on the adjusted image for synthesis or the image for synthesis.

  Further, the present invention includes those in which the configuration of each invention is appropriately changed to the configuration of another invention as long as a partial operation and effect can be obtained. For example, the configurations of apparatuses, systems, methods, and programs are mutually different. Of the invention of the category, and those in which the category of the device or the like is changed to the category of the method or the program. Also, the present invention includes those in which the configurations of other inventions are appropriately added to the configurations of the respective inventions, and those in which the configurations of the respective inventions are deleted to make them a higher-level concept can obtain the partial operation and effect of the present invention. Included in the present invention to a limited extent. Further, each predetermined means or each predetermined unit of the image providing device or the user device in the present invention is constituted by required hardware and software, and is realized by, for example, a CPU, a memory, a program stored in the memory, required data, and the like. Alternatively, it is realized by a CPU, a memory, or the like that cooperates with a predetermined program or required data.

  The image providing apparatus, the image providing method, the image providing program, and the like of the present invention can present a composite image to a user, such as displaying a composite image on a user device, and can also provide various user individual preferences. And it is possible to provide the user with high entertainment. And a service that gives users strong motivation to actively participate in a new communication environment such as broadband can be realized, a new business model can be created, and furthermore, a communication-related industry can be developed. . In addition, it is possible to satisfy various sensual desires and preferences of the user of the composite image and the communication by the composite image, and the other party of the user's communication, and to improve the entertainment, and it is possible to improve the interactive performance including the image. Attraction can be improved. In addition, by providing a composite image using a moving image to a user, the shortage of services and contents provided by a broadband information infrastructure can be resolved, and attractive services and contents can be enhanced and diversified. In addition, the transmission time can be extended by transmitting and receiving data of a composition target image, a composition image, and a composite image between the image providing device and the user device, or transmitting and receiving data between the user devices. Since it is possible, the profit of the communication company or the image provider can be secured or the profit can be increased by charging according to the communication fee or the amount of transmission data.

  An image providing apparatus and a user apparatus according to the first embodiment of the present invention, and a flow of providing an image to the user apparatus by the image providing apparatus will be described. As shown in FIGS. 1 and 2, a basic configuration of the image providing apparatus and the basic flow of the image providing apparatus and a basic flow of the image providing apparatus according to the first embodiment are as follows. An image providing apparatus 100 connected to a video communication apparatus 200 via a communication line 300, which is an IP network, transmits a moving image continuously captured by the video telephone apparatus 200 and continuously transmitted from the video telephone apparatus 200 in real time to the imaging. Receiving, extracting and continuously extracting a moving image synthesis target image from the received moving image substantially in real time with the imaging and transmission / reception, and synthesizing a background image of a specified moving image or a background image of a still image. The image and the image to be continuously extracted are superimposed and synthesized in substantially real time with the imaging, transmission / reception, and extraction to generate a synthesized image in which the image to be synthesized and the image for synthesis are integrated. Similarly, the composite image is transmitted to the videophone device 200 in substantially real time and is reflected and presented, and the composite image including the composite target image extracted from the captured image is displayed in the videophone device 200 in substantially real time with the imaging. In addition, a composite image desired by the user is distributed to the videophone device 200, and the user is charged for the distribution of the composite image.

  As shown in FIG. 1, the image providing apparatus 100 according to the first embodiment includes an authentication processing unit 101 that executes a user authentication process, a designation processing unit 102 that performs a process related to designation of a composition image, a television, and the like. The image to be combined with the moving image is continuously extracted and extracted from the moving image received from the telephone device 200, and the designated combined image and the combined image are combined to continuously generate a combined image. Is continuously transmitted to the videophone device 200 and presented, and a menu item or an icon for a request to download a composition image used in the generated composite image and a request to return to the composite image designation screen. A program that causes the control unit 201 of the videophone device 200 to execute a control to display a composite image at a predetermined position on the image presentation screen and the composite image presentation screen, and the like. An image synthesizing unit 103 that transmits the image to the image processing unit 200; a distribution processing unit 104 that executes a distribution process of downloading the image for synthesis in response to the download request; and a charging process for a user who distributes the image for synthesis. A billing processing unit 105, a synthesizing image database 106 storing a synthesizing image of a still image background image or a moving image background image subjected to duplication prevention processing corresponding to the identification information, and use of each user; Necessary data such as authentication information such as user ID and corresponding registration password, name / address, billing information, and billing destination information such as account number of a financial institution and credit card number are stored in accordance with the user ID as necessary. User database 107, a timer 108 for measuring the presentation time of the synthesized image, etc., which functions as a communication interface A communication processing unit 109 that functions as a means for processing data so that it can be transmitted and received in packets, such as conversion and restoration, and other necessary units such as another processing unit, a storage unit, an input unit, and an image display unit. Prepare. The authentication processing unit 101, the designation processing unit 102, the image synthesizing unit 103, the distribution processing unit 104, the billing processing unit 105, and other necessary units are a CPU, a memory, a program stored in the memory, required data, and the like. Is realized by:

  The data to be transmitted by the image providing apparatus 100 to the videophone device 200 described later, the data of each screen, and the like include a necessary program for causing the control unit 201 and the memory 202 of the videophone device 200 to function as predetermined means, a browser, and the like. A necessary program or the like for causing the control unit 201 and the memory 202 of the videophone device 200 to function as predetermined means in cooperation with a program having a function is included as appropriate. Note that the image providing apparatus 100 can be, for example, a single computer or a network computer including a plurality of computers connected via a network. It is possible.

  As shown in FIG. 1, the videophone device 200 according to the first embodiment includes a control unit 201 such as a CPU or a required memory that controls an operation in cooperation with a predetermined operation program or the like. A memory 202 for storing predetermined data such as image data, an image display unit 203 as a display for displaying an image, an input unit 204 such as a button, an imaging unit 205 such as a CMOS camera or a CCD camera capable of capturing a moving image, a microphone 206, a speaker 207, a communication processing unit 208 that functions as a communication interface and also functions as a means for processing data so that it can be transmitted and received in packets, such as packetizing and restoring data, and the operation program has a browser function. The moving image is fetched from the imaging unit 205, A program for transmitting the moving image at a time, a synthesizing target image which is continuously extracted and extracted in real time from the moving image picked up by the image pickup unit 205 in synchronization with the image pickup and stored in a predetermined storage area of the memory 202. The image for synthesis selected by the input unit 204 or the like is superimposed and synthesized from the image to continuously generate a synthesized image in real time with the imaging, and the other videophone device to communicate with via the communication line 300 A program for continuously transmitting the combined image in real time with the imaging is appropriately included, and a speech recognition program is also included as needed.

  When the image providing device 100 provides an image to the videophone device 200, as shown in FIG. 2, the videophone device 200 is connected to the image providing device via an IP network communication line 300 in response to a user input. 100, the image providing apparatus 100 receives the connection request of the videophone apparatus 200 and establishes a connection (S101). Then, the authentication processing unit 101 of the image providing apparatus 100 transmits an authentication screen or the like having an input field of an ID and a password stored and held in accordance with the establishment of the connection, a button and an icon of the transmission request to the videophone apparatus 200, and the like. Present. The control unit 201 of the videophone device 200 receives the presented authentication screen, displays it on the image display unit 203, and is input to the input field of the authentication screen by input from the input unit 204 or the like or read from the memory 202. The ID and the password are transmitted to the image providing apparatus 100 in response to the designation input of the transmission request from the input unit 204. The authentication processing unit 101 of the image providing apparatus 100 receives the received ID and password, extracts the registered password of the user from the user database 107 based on the received ID, compares the received password with the registered password, and executes the authentication processing. Execute (S102). If the result of the password verification indicates that authentication is not possible, the authentication processing unit 101 transmits a screen displaying a message indicating that authentication was not successful to the videophone device 200 and presents the screen.

  On the other hand, if the authentication is successful, in response to the authentication, the designation processing unit 102 displays the image-for-synthesis designation screen or the like having identification information that can be designated by the title or number of a plurality of images for composition to be stored and held. And presents the image to prompt the user to designate or select an image for synthesis. Note that the composition image designation screen is a screen that displays the contents of the composition image or a sample image indicating typical contents together with identification information that can be designated by, for example, a title or a number, or a screen of the composition image. It is preferable that the sample image itself showing the contents or representative contents be displayed as identification information that can be specified for the composition image, since the user can more easily understand the contents of the composition image. Alternatively, a screen that prompts the user to input or transmit identification information of a predetermined combination image that the user has previously recognized or that is held by the user device 200 may be used. The control unit 201 of the videophone device 200 displays the presented image-for-synthesis designation screen on the image display unit 203, and outputs a desired image for composition by a user's input from the input unit 204 or voice input from the microphone 206. The designated identification information is transmitted to the image providing apparatus 100 in accordance with the designation of the identification information.

  The designation processing unit 102 of the image providing apparatus 100 accepts the designation identification information of the composition image received via the communication processing unit 109 (S103), and displays a screen having a message prompting to capture and transmit the moving image on the television. The message is transmitted to the telephone device 200 and presented, and the control unit 201 of the videophone device 200 displays the message screen on the image display unit 203. When the user of the videophone device 200 captures a moving image such as an image including the user himself in the imaging unit 205 in accordance with the message, and inputs the moving image to be captured and the imaging in real time using the input unit 204 or the like. In response to the input, the control unit 201 captures a moving image by the imaging unit 205, continuously captures the moving image captured by the imaging unit 205, and transfers the captured moving image to the image providing apparatus 100 via the communication line 300. The moving image is continuously transmitted in real time when it is captured and captured.

  The image synthesizing unit 103 of the image providing apparatus 100 continuously receives or recognizes the moving image continuously received via the communication processing unit 109 (S104), and according to the reception or recognition, the continuously received moving image. The image to be synthesized is continuously extracted from the image, and the image to be synthesized such as the user's own image is extracted and acquired continuously in real time with the reception or recognition (S105), and the image is synthesized based on the received specified identification information. The composition image corresponding to the designated identification information is extracted from the use image database 106, and for example, if necessary, the composition image as the background image of the moving image is identical in shape and the same as the moving image (original image) from which the composition target image is extracted. The size and the position and size of the image to be synthesized with respect to the original image are determined based on the coordinate value of the predetermined reference point located at the outer edge of the image to be synthesized with respect to the coordinate axis of the original image. Then, in the same relationship as the position and size of the compositing target image with respect to the original image, the compositing target image such as the user's own image is integrally composed in front of the compositing image (background image), or The image for synthesis as the background image has the same shape and the same size as the moving image (original image) from which the image to be synthesized is extracted, and the opacity α, which is set for the image other than the image to be synthesized of the original image, is set to 0 and the process is transparent. The image processing and image transmission are performed in the videophone device 200 by combining the image to be synthesized, which is the user's own image, in front of the image for synthesis (background image). The image for synthesis and the image to be synthesized are integrally and continuously synthesized in real time to generate a synthesized image (S106). In the present embodiment, the image combining unit 103 separates and extracts a compositing target image from a moving image that is an original image. An inter-frame difference based on pixel density, brightness, or color between frames is obtained, and the inter-frame difference is compared with a predetermined threshold value to be binarized to separate the moving region from the other region, thereby obtaining a moving image. Although the configuration is such that a region is extracted as a compositing target image, an appropriate configuration other than the above configuration can be used.

  Further, the image synthesizing unit 103 outputs a synthesized image presenting screen having a menu item or an icon for a request to download and return to the synthetic image designating screen for storing and holding the synthesized image, and a synthesized image at a predetermined position on the synthesized image presenting screen. The control unit 201 of the videophone device 200 extracts a program or the like for causing the control unit 201 to perform control for displaying, and transmits the synthesized image presentation screen and the program to the videophone device 200 via the communication processing unit 109, and A synthesized image generated substantially continuously in real time with the capturing and transmission of a moving image in the device 200 is continuously transmitted in substantially real time to the videophone device 200 via the communication processing unit 109 to be presented (S107). The videophone device 200 receives and captures the composite image presentation screen, the program, the composite image, and the like via the communication line 300, and the control unit 201 cooperates with the received program and a program having a browser function. For example, in order to enhance the viewability, most of the synthesized image presentation screen, such as the upper 3/4 and the right 2/3, is a synthesized image, and a predetermined menu item or icon is displayed in other areas. A synthesized image is synthesized at a predetermined position or a predetermined location on the presentation screen, and a synthesized image presentation screen including the synthesized image is displayed on the image display unit 203 instead of the message screen prompting the moving image transmission. As the composite image in the composite image presentation screen, an image continuously received from the image providing apparatus 100 is displayed substantially in real time continuously with capturing and transmission of a moving image in the videophone apparatus 200.

  Then, in response to the start of generation or transmission of the synthesized image, the image synthesizing unit 103 starts measuring a predetermined set time, such as a short time, which is a presentation time of the synthesized image to be stored and stored, with the timer 108, and From the start of measurement to the reception of a download request to be described later during the set time, the processing of extracting and acquiring the synthesis target image and the generation and presentation of the synthesized image are continued. When there is no reception and the measurement of the set time by the timer 108 is completed and the elapse of the set time is recognized, processing such as extraction and acquisition of a synthesis target image and generation and presentation of a synthesized image is ended, and in response to the end, The designation processing unit 102 transmits the combined image designation screen and the like to the videophone device 200 again and presents the same. Also, when the user inputs on the composite image presentation screen specifying a request to return to the composite image presentation screen during the set time, the request to return to the screen transmitted by the control unit 201 is provided as an image. The designation processing unit 102 of the device 100 receives and accepts the image, and transmits and presents a composition image designation screen or the like to the videophone device 200 in the same manner as described above, so that another composition image can be designated or selected. Note that a menu item or the like for a request to end presentation of a composite image is provided on the composite image presentation screen, and the image compositing unit 103 receives and accepts a request to terminate presentation of a composite image transmitted from the videophone device 200. The processing for extracting and acquiring the synthesis target image and generating and presenting the synthesis image may be terminated.

  On the other hand, during the set time, which is the presentation time of the composite image, the control unit 201 of the videophone device 200 transmits in response to the user's designation input of the download request on the input unit 204 or the like on the composite image presentation screen. When the distribution processing unit 104 of the image providing apparatus 100 receives and receives the download request via the communication processing unit 109 (S108), the distribution processing unit 104 extracts a composition target image from the composite image presentation screen, for example, a moving image. The reproduction of the composite image, the generation and presentation of the composite image, and the like are completed, the screen having the information on the distribution process is transmitted and presented, and the composite image of the composite image presentation screen that has received the download request is composed. The specified composite image is recognized, acquired as necessary, or extracted and acquired from the composite image database 106, and is subjected to a copy protection process. The data of the image through the communication processing unit 109 to the TV telephone apparatus 200 delivers to download (S109). The control unit 201 of the videophone device 200 stores the data of the composition image received and downloaded via the communication line 300 in a predetermined storage area of the memory 202 in a selectable manner. Note that, as described above, with a configuration in which distribution can be performed only for a predetermined set time, it is possible to prompt a user to transmit a download request, and further, a predetermined unit such as the image combining unit 103 of the image providing apparatus 100 By subtracting the time during the measurement by the timer 108 from the predetermined set time which is the presentation time of the composite image, the remaining time at which the composite image can be presented or the remaining time at which the composite image in the composite image can be downloaded is obtained, When the remaining time is transmitted to the videophone device 200 and presented so as to be displayed at a predetermined position on the composite image presentation screen, the display of the remaining time or the deadline further prompts the user to execute a download such as transmitting a download request. It is preferable because it is possible.

  Further, in response to the completion of the distribution of the image data for synthesis, the charging processing unit 105 of the image providing apparatus 100 refers to the set amount to be stored and charges the user of the user ID for the set amount (S110), The accounting information is stored in the user data of the user ID in the user database 107. Then, the distribution processing unit 104 measures the screen having the information indicating that the distribution processing and the charging is completed by the timer 108 and transmits and presents the screen for a predetermined time, instead of the screen having the information during the distribution processing. Then, in accordance with the elapse of the set time, the designation processing unit 102 presents the image-for-synthesis designation screen again in place of the distribution processing and billing completion screen, and a series of processing is completed. It should be noted that the delivery processing unit 104 may deliver the composition image after the billing processing unit 105 completes the billing process, and the set amount charged for the delivery of the composition image may be It is possible to set according to the type or content, or to set a uniform amount of money.

  Thereafter, when the user mutually communicates with the user of another videophone device using the videophone device 200, the user inputs the input image from the input unit 204 or the like in accordance with the designation of the composite image mode and the designation of the desired composite image. The control unit 201 of the videophone device 200 extracts and extracts a compositing target image of a moving image from a moving image captured by the imaging unit 205, and selects and specifies a compositing image selected from compositing images stored in a predetermined storage area of the memory 202. A composite image is extracted, and the composite target image and the composite image are continuously and continuously composited to generate a composite image, and the composite image is transmitted to another videophone device of the communication partner via the communication line 300. At this time, if the composition image received for use in the image composition of the videophone device 200 is a moving image, the entertainment of the user and the other party of the communication can be further improved.

  As described above, the image providing device 100 receives the original image of the moving image from the videophone device 200, continuously extracts the image to be combined, and combines the extracted image to be combined with the image for combination to generate a combined image. Then, by presenting the composite image to the videophone device 200 almost in real time with the transmission of the original image, it is possible to check in advance the actual use of the composite image as the composite image. Since the image to be combined is reflexively presented in almost real time, it is possible to freely adjust the state in which the image for combination is actually used as the image to be combined in almost real time and confirm the state. In addition, the user selects a desired composition image from various composition images, and is presented with the selected composition image and the composition target image. Therefore, the user has a variety of selections to try on the composition image. So you can try it. Accordingly, it is possible to make the user visualize the state using the image for synthesis, and it is possible to sufficiently satisfy the user's entertainment and taste. In addition, since the user can receive a distribution of a trial-use composite image in advance, the user obtains a composite image that is different from the user's image or taste when paying for the composite image. This makes it possible to eliminate complications, so that the user can surely obtain an image for synthesis that matches his / her taste, and can obtain an image for synthesis that matches his / her taste by rational consumption. In addition, by charging for the delivery of the image for synthesis or the presentation of the synthesized image, the operator of the image providing apparatus 100 and the like can reliably secure profits, and furthermore, the television which the user continuously uses. Since the distribution of the composite image to the telephone device 200 and the presentation of the composite image based on the composite image to be distributed are performed, profits can be obtained with high stability. Furthermore, as a synergistic effect of these, a very excellent business model having a strong incentive to users and a reliable profit base can be obtained.

  Next, a first modification of the first embodiment will be described. In the first modified example of the first embodiment, as shown in FIGS. 1 and 3, an image to be combined is continuously extracted and extracted from a moving image continuously captured by the videophone device 200. Is connected to the image providing apparatus 100 connected via the communication line 300, which is an IP network, in place of the configuration in which the moving images of the first embodiment are continuously transmitted. The image providing apparatus 100 continuously receives the image to be synthesized and the extraction and extraction substantially in real time from the video telephone apparatus 200 via the communication line 300 in almost real time, and transmits the background of the designated moving image. The image to be synthesized, which is a background image of an image or a still image, and the image to be continuously received are superimposed and synthesized in substantially real time with the imaging, extraction, and transmission / reception. A composite image in which the images are integrated is generated, and the generated composite image is transmitted substantially in real time to the videophone device 200 and is presented in a reflective manner. The composite image including the image is displayed. Further, the image for composition desired by the user is distributed to the videophone device 200, and the user is charged for the distribution of the image for composition.

  The basic configuration of an image providing apparatus 100 according to a first modification is the same as that of the first embodiment. As shown in FIG. 1, an authentication processing unit 101, a designation-related processing unit 102, an image synthesizing unit 103, a distribution process The image combining unit 103 includes a unit 104, a billing unit 105, a combining image database 106, a user database 107, a timer 108, a communication processing unit 109, and other necessary units. Instead of continuously extracting and extracting a synthesis target image of a moving image from a received moving image and generating a synthesized image, a synthesis target image is received and acquired from the videophone device 200, and a designated synthesis image is received. The first embodiment differs from the first embodiment in that the configuration is such that a composite image is continuously generated by synthesizing the image to be composed and the composition target image.

  The basic configuration of the videophone device 200 of the first modification is also the same as that of the first embodiment. As shown in FIG. 1, the control unit 201, the memory 202, the image display unit 203, the input unit 204, 205, a microphone 206, a speaker 207, a communication processing unit 208, etc., a program having a browser function in a predetermined storage area of the memory 202, fetching a moving image from the imaging unit 205, and real-time imaging with the imaging unit 205. A program for transmitting the moving image, an image to be combined with a moving image continuously extracted and extracted in real time with the imaging from the moving image captured by the imaging unit 205, and extracted from the image for combination stored in a predetermined storage area of the memory 202. The image for synthesis selected by the input unit 204 or the like is synthesized with the image to be synthesized to continuously generate a synthesized image in real time with the imaging. A program for continuously transmitting the synthesized image and the image in real time to the other videophone device of the communication partner via the communication line 300 is stored in the predetermined storage area of the memory 202 by the image pickup unit 205. A program for continuously extracting and extracting a synthesis target image of a moving image from the moving image to be captured in real time with the imaging in real time, and continuously transmitting the synthesized image in real time with the imaging and extraction to the image providing apparatus 100 via a communication line 300 Is stored.

  When the image providing apparatus 100 of the first modification provides an image to the videophone apparatus 200, first, as shown in FIG. 3, a connection is established by the same processing as in the first embodiment (S101). The authentication processing unit 101 executes an authentication process by receiving an ID and a password on the authentication screen (S102), and the designation processing unit 102 receives designation identification information of a composition image on the composition image designation screen (S103). Then, the designation processing unit 102 transmits and presents a screen having a message prompting to transmit the image to be combined to the videophone device 200, and the control unit 201 of the videophone device 200 displays the message screen on the image display unit 203. To be displayed. According to the message, the user of the videophone device 200 captures a moving image with the image capturing unit 205, extracts a compositing target image from the moving image to be captured, and inputs an input for transmitting the extracted compositing target image and the imaging in real time. When the control is performed by the unit 204 or the like, the control unit 201 captures a moving image with the imaging unit 205 in accordance with the input, continuously captures a moving image captured by the imaging unit 205, and continuously synthesizes a synthesis target image from the captured moving image. Then, the image to be combined is transmitted to the image providing apparatus 100 in real time, via the communication line 300, in real time with the capturing of the moving image and the extraction of the image to be combined. In the present embodiment, the control unit 201 separates and extracts a compositing target image from a moving image that is an original image. An inter-frame difference based on the density, brightness, or color of pixels between pixels is obtained, and the inter-frame difference is compared with a predetermined threshold value to be binarized to separate the moving region from the other region, thereby obtaining the moving region. Is extracted as a composition target image, but an appropriate configuration other than the above configuration may be used.

  The image synthesizing unit 103 of the image providing apparatus 100 continuously receives or recognizes the synthesis target image continuously received via the communication processing unit 109 (S111), and in response to the reception or recognition, the received specified identification. Based on the information, a composition image corresponding to the designated identification information is extracted from the composition image database 106, for example, at a predetermined position and a predetermined size with respect to the composition image to be stored and held in front of the composition image which is the background image of the moving image. The image for synthesis and the image to be synthesized are continuously integrated in almost real time with the capturing and transmission of the moving image in the videophone device 200 by, for example, integrally synthesizing the image to be synthesized such as the image of the user himself. And combine them to generate a combined image (S106). Note that the control unit 201 of the videophone device 200 determines whether or not the synthesis target image is to be extracted from the moving image (original image) from which the synthesis target image is extracted, such as the coordinate value of a predetermined reference point on the outer edge of the synthesis target image with respect to the coordinate system of the original image. The position and size data is transmitted to the image providing apparatus 100, and the image combining unit 103 uses the combining image having the same shape and the same size as the original image and the received position and size data, and synthesizes the image to be combined with the original image. In the same relationship as the position and the size of the image to be synthesized, the composition of the image to be synthesized is synthesized in front of the image for synthesis to generate a synthesized image. This is preferable because it can be reflected on the synthesized image, and an image that has been subjected to transparency processing by, for example, setting the opacity α set to 0 other than the image to be synthesized of the original image to 0 is processed. May be configured such that transmitting the formed object image.

  Then, similarly to the first embodiment, the image synthesizing unit 103 causes the control unit 201 of the videophone device 200 to execute control such as display of the synthesized image at a predetermined position on the synthesized image presentation screen and the synthesized image presentation screen. Is transmitted to the videophone device 200, and a synthesized image that is generated substantially continuously in real time with the capturing and transmission of the moving image in the videophone device 200 is transmitted to the videophone device 200 via the communication processing unit 109. The control unit 201 of the video phone 200 cooperates with the received program and a program having a browser function to compose a composite image at a predetermined position on the composite image presentation screen, in the form of continuous transmission and presentation (S107). The composite image and the composite image presentation screen that are continuously received in substantially real time are displayed on the image display unit 203. Further, in response to the download request during the measurement of the set time (S108), the distribution processing unit 104 distributes the data of the composition image specified in the download request to the videophone device 200 (S109), and the charging processing unit 105. Charges the set amount to the user (S110), and stores the charging information in the user data of the user database 107, thereby completing a series of processes.

  As described above, the image providing apparatus 100 receives the synthesis target image from the videophone device 200, synthesizes the received synthesis target image with the synthesis image to generate a synthesis image, and transmits the synthesis target image substantially in real time. By presenting the synthesized image to the videophone device 200, it is possible to confirm in advance the state in which the image for synthesis is actually used as the synthesized image. Since it is presented, it is possible to confirm the state in which the image for synthesis is actually used as the image to be synthesized while freely adjusting it substantially in real time. In addition, the user selects a desired composition image from various composition images, and is presented with the selected composition image and the composition target image. Therefore, the user has a variety of selections to try on the composition image. So you can try it. Accordingly, it is possible to make the user visualize the state using the image for synthesis, and it is possible to sufficiently satisfy the user's entertainment and taste. In addition, since the user can receive a distribution of a trial-use composite image in advance, the user obtains a composite image that is different from the user's image or taste when paying for the composite image. This makes it possible to eliminate complications, so that the user can surely obtain an image for synthesis that matches his / her taste, and can obtain an image for synthesis that matches his / her taste by rational consumption. In addition, by charging for the delivery of the image for synthesis or the presentation of the synthesized image, the operator of the image providing apparatus 100 and the like can reliably secure profits, and furthermore, the television which the user continuously uses. Since the distribution of the composite image to the telephone device 200 and the presentation of the composite image based on the composite image to be distributed are performed, profits can be obtained with high stability. Further, as a synergistic effect of the above, it is possible to obtain a very excellent business model having a strong incentive to users and a reliable profit base.

  Next, an image providing apparatus and a user apparatus according to the second embodiment, and a flow of providing an image to the user apparatus by the image providing apparatus will be described. As shown in FIGS. 1 and 4, the basic configuration of the image providing device and the user device and the basic flow of image providing according to the second embodiment are connected to a videophone device 200 as a user device via an IP network. The image providing apparatus 100 connected via a certain communication line 300 receives a moving image continuously captured by the video telephone 200 and transmitted from the video telephone 200 continuously in real time with the imaging, and And extracting and continuously extracting a synthesis target image of a moving image from the received moving image in substantially real time with transmission and reception, the synthesis target image which is a background image of the specified moving image and the synthesis target image to be continuously extracted are Image, transmission / reception, and extraction are superimposed and synthesized in substantially real time to generate a synthesized image in which the image to be synthesized and the image for synthesis are integrated, and the generated synthesized image is sent to the videophone device 200 in the same manner. A composite image including a compositing target image extracted from the captured image is displayed on the videophone device 200 almost in real time as the image is transmitted, and is displayed in a reflective manner in real time. A request for fixing the image for synthesis, which is the background image of the moving image, is received from 200, and the image for synthesis is fixed at the received timing, and almost at the same time as the image for static synthesis, that is, the timing at which the desired fixed request or stop request is transmitted. A still image obtained by stopping a background image of a moving image is obtained, and further, a still composition image desired by the user is delivered to the videophone device 200, and the user is charged for delivery of the still composition image. is there.

  The basic configuration of the image providing apparatus 100 according to the second embodiment is the same as that of the image providing apparatus 100 according to the first embodiment. As shown in FIG. 1, an authentication processing unit 101, a designation processing unit 102, an image combining unit 103, a distribution processing unit 104, a billing processing unit 105, a compositing image database 106, a user database 107, a timer 108, a communication processing unit 109, and other necessary units as necessary. An image to be combined with a moving image is continuously extracted and extracted from a moving image received from the videophone device 200, and an image to be combined with a designated moving image is combined with an image to be combined with the specified moving image to create a combined image. A composite image in which both of the images for composition are moving images is continuously generated, and the composite image is continuously transmitted to the videophone device 200 for presentation. Compositing having menu items or icons for a request for downloading a still compositing image of the composing image, a request for fixing the composing image (pause request), a request for reproducing the composing image, and a request to return to the composing image designation screen A program that causes the control unit 201 of the videophone device 200 to execute control for displaying the composite image at a predetermined position on the image presentation screen and the composite image presentation screen is transmitted to the videophone device 200, and further, in response to the reception of the fixing request. At the time of the reception, the image for synthesis, which is a moving image, is fixed or temporarily stopped to obtain a still image for synthesis, the generation of a synthesized image by synthesizing the image for synthesis and the still image for synthesis is continued, In response to the reception, the reproduction of the compositing image, which is a moving image, is started from the still compositing image, that is, the paused image of the compositing image, and again the compositing target image and the compositing image. Both of them continuously generate a composite image that is a moving image. Further, the distribution processing unit 104 executes a distribution process of downloading a still composition image in response to a download request, and the charging processing unit 105 performs a static composition. This is to execute a charging process for the user who distributes the image for distribution. The authentication processing unit 101, the designation processing unit 102, the image synthesizing unit 103, the distribution processing unit 104, the billing processing unit 105, and the like are realized by a CPU that functions as each unit, a memory that stores programs and data, and the like.

  The videophone device 200 according to the second embodiment also has the same basic configuration as the videophone device 200 according to the first embodiment, but stores a predetermined operation program, data of a still image for synthesis, and the like in a predetermined storage area. A memory 202 for storing the moving image to be synthesized in the predetermined operation program. The still composition image and the compositing target image selected by the input unit 204 and the like are combined from the still composition image stored in the storage area to continuously generate a combined image in real time with the imaging, via the communication line 300. A program for continuously transmitting the synthesized image and the imaging in real time to another videophone device of the communication partner is included.

  When the image providing apparatus 100 of the second embodiment provides an image to the videophone device 200, the processing is basically the same as that of the first embodiment until the image providing apparatus 100 presents the composite image. Execute That is, as shown in FIG. 4, the image providing apparatus 100 establishes a connection (S101), the authentication processing unit 101 executes an authentication process by receiving an ID and a password on the authentication screen (S102), and the designation processing unit 102 The designated identification information of the image for synthesis is received (S103), the designated processing unit 102 transmits a message screen prompting to transmit the moving image, and in response to the input of the user of the videophone device 200, the control unit 201 The imaging unit 205 captures a moving image, continuously captures the moving image captured by the imaging unit 205, and continuously transmits the captured moving image to the image providing apparatus 100 in real time with capturing and capturing the moving image. The image synthesizing unit 103 of the image providing apparatus 100 continuously recognizes the received moving image (S104), and continuously extracts the synthesis target image from the moving image using the inter-frame difference or the like as in the first embodiment. An image to be combined with a moving image is acquired (S105), and a composite image subjected to copy prevention processing corresponding to the designated identification information is extracted from the composite image database 106, and a moving image in the videophone device 200 is obtained. The image for synthesis and the image to be synthesized are integrally synthesized almost in real time with image capturing and transmission, and a synthesized image is continuously generated (S106). Further, the image synthesizing unit 103 includes a menu item for requesting a download of the still image to be stored, a request for fixing the image for synthesis (pause request), a request for reproducing the image for synthesis, and a request for returning to the screen for specifying the image for synthesis. A composite image presentation screen having an icon, and a program for causing the control unit 201 of the videophone device 200 to execute control for displaying a composite image at a predetermined position on the composite image presentation screen are extracted. In addition to transmitting the synthesized image to the videophone device 200, the composite image that is continuously generated is continuously transmitted to the videophone device 200 and presented (S107). The control unit 201 of the videophone device 200 cooperates with the received program and a program having a browser function, synthesizes a composite image at a predetermined position on the composite image presentation screen, and outputs a moving image of the videophone device 200. A composite image presentation screen including a composite image generated substantially in real time with imaging and transmission is displayed on the image display unit 203.

  The user of the videophone device 200 operates the input unit 204 or the like when the combined image of the combined moving image and the combined image of the moving images is continuously displayed on the combined image presentation screen. When the request for fixing the image for synthesis is designated and input so as to press the shutter at the timing of, the control unit 201 transmits the request for fixing the image for synthesis to the image providing apparatus 100 in response to the designation input of the request for fixing. The image synthesizing unit 103 of the image providing apparatus 100 receives and accepts a request for fixing an image for synthesis via the communication processing unit 109 (S201), and generates and presents the image at the time of the reception in response to the request for fixing. The image for synthesizing the moving image in the current synthetic image is fixed or temporarily stopped, and the image for still synthesis is obtained (S202), and the continuous image to be synthesized is extracted from the received moving image by acquisition. And continuously synthesizing the continuously acquired synthesizing target image and the acquired still synthesizing image in substantially real time with the capturing and transmission of the moving image in the videophone device 200 to continuously generate a synthesized image. (S203), and the continuously generated synthesized images are continuously transmitted to the videophone device 200 and presented (S204). The control unit 201 of the videophone device 200 cooperates with a program for displaying a composite image at a predetermined position on the composite image presentation screen and a program having a browser function, and composites the composite image at a predetermined position on the composite image presentation screen, The image display unit 203 displays a composite image of a compositing target image and a still compositing image generated in substantially real time upon capturing and transmitting a moving image in the videophone device 200 on a composite image presentation screen.

  When the user of the videophone device 200 designates and inputs a reproduction request of the compositing image using the input unit 204 or the like while displaying the composite image including the compositing target image and the still compositing image, the control unit 201 In response to the specification input of the reproduction request, a request to reproduce the image for synthesis is transmitted to the image providing apparatus 100. The image synthesizing unit 103 of the image providing apparatus 100 receives and accepts a reproduction request for a compositing image via the communication processing unit 109 (S205), and in response to the reception of the reproduction request, receives the still compositing image, that is, the The reproduction of the compositing image which is a moving image is started from the paused image, and the compositing target image of the moving image continuously extracted from the received moving image and the compositing image of the moving image which has started the reproduction are used. The continuous generation of the composite images is restarted, and the composite images to be continuously generated are continuously transmitted to the videophone device 200 and presented.

  On the other hand, when the user of the videophone device 200 specifies and inputs a download request for a still-synthesis image using the input unit 204 or the like while displaying the synthesized image including the synthesis target image and the still-synthesis image, the control unit 201 transmits a request for downloading a still-synthesis image to the image providing apparatus 100 in response to the designation input of the download request. The distribution processing unit 104 of the image providing apparatus 100 receives and accepts the download request for the still composite image via the communication processing unit 109 (S206), and generates and presents a composite image on the composite image presentation screen according to the reception. And the like, and transmits and presents a screen having information during the distribution process, and obtains a still-composition image synthesized with the composite image of the composite-image presentation screen that has received the download request, and obtains the still-composition image. Is downloaded and distributed to the videophone device 200 via the communication processing unit 109 (S207). The control unit 201 of the videophone device 200 selectively stores the data of the still-synthesis image received and downloaded via the communication line 300 in a predetermined storage area of the memory 202. Therefore, the user can acquire a desired still image for synthesis from various scenes of various images for synthesis while checking the state of the synthesized image together with the effect of the first embodiment. Note that the distribution processing unit 104 may be configured to distribute the data of the still-synthesis image acquired by the fixing request to the videophone device 200 in response to the reception of the request for fixing the image for synthesis.

  Further, in response to the completion of the distribution of the still-synthesis image data, the charging processing unit 105 of the image providing apparatus 100 refers to the set amount to be stored and charges the set amount of money to the user of the user ID (S208). , And stores the charging information in the user data of the user ID in the user database 107. Then, the distribution processing unit 104 measures the screen having the information indicating that the distribution processing and the charging is completed by the timer 108 and transmits and presents the screen for a predetermined time, instead of the screen having the information during the distribution processing. Then, in accordance with the elapse of the set time, the designation processing unit 102 presents the image-for-synthesis designation screen again in place of the distribution processing and billing completion screen, and a series of processing is completed. Further, the set amount of money to be charged for the delivery of the still image for synthesis can be set according to the type or content of the image for synthesis or still image, or a uniform amount can be set.

  Note that the image synthesis unit 103 ends the extraction of the synthesis target image and the generation and presentation of the synthesis image when the reproduction time of the synthesis image ends by generating the synthesis image including the synthesis target image and the synthesis image, In response to the end, the designation processing unit 102 transmits the combined image designation screen to the videophone device 200 again and presents it. Also, when the user inputs on the composite image presentation screen to specify a request to return to the composite image presentation screen during the presentation of the composite image, the request to return to the screen transmitted by the control unit 201 is displayed as an image. The designation processing unit 102 of the providing device 100 receives and accepts the same, and transmits and presents the image-for-synthesis designation screen to the videophone device 200 as described above.

  Thereafter, when the user mutually communicates with the user of another videophone device using the videophone device 200, the user inputs the input unit 204 or the like to specify the composite image mode and the desired still composite image. Accordingly, the control unit 201 of the videophone device 200 extracts and extracts an image to be combined with the moving image from the moving image captured by the imaging unit 205, and selects and specifies the still image from the images for still combination stored in a predetermined storage area of the memory 202. The still image to be synthesized is extracted, and the image to be synthesized and the still image to be synthesized are integrally and continuously synthesized to generate a synthesized image. Send to

  Next, an image providing apparatus and a user apparatus according to the third embodiment and a flow of providing an image to the user apparatus by the image providing apparatus will be described. As shown in FIGS. 1 and 5, the basic configuration of the image providing apparatus and the user apparatus according to the third embodiment and the basic flow of image providing are as follows. The image providing apparatus 100 connected via a certain communication line 300 receives a moving image continuously captured by the video telephone 200 and transmitted from the video telephone 200 continuously in real time with the imaging, and And extracting and continuously extracting a synthesis target image of a moving image from the received moving image in substantially real time with transmission and reception, the synthesis target image which is a background image of the specified moving image and the synthesis target image to be continuously extracted are Image, transmission / reception, and extraction are superimposed and synthesized in substantially real time to generate a synthesized image in which the image to be synthesized and the image for synthesis are integrated, and the generated synthesized image is sent to the videophone device 200 in the same manner. A composite image including a compositing target image extracted from the captured image is displayed on the videophone device 200 almost in real time as the image is transmitted, and is displayed in a reflective manner in real time. A cutout start request and a cutout end request for a synthesis image as a background image of a moving image are received from 200, and a cutout synthesis image which is a moving image from the start of cutout to the end of cutout is obtained, A desired image for synthesizing is delivered to the videophone device 200, and a user is charged for the delivery of the image for synthesizing according to the cutout time of the image for synthesizing.

  The basic configuration of the image providing apparatus 100 according to the third embodiment is the same as that of the image providing apparatus 100 according to the first embodiment. As shown in FIG. 1, an authentication processing unit 101, a designation processing unit 102, an image combining unit 103, a distribution processing unit 104, a billing processing unit 105, a compositing image database 106, a user database 107, a timer 108, a communication processing unit 109, and other necessary units as necessary. An image to be combined with a moving image is continuously extracted and extracted from a moving image received from the videophone device 200, and an image to be combined with a designated moving image is combined with an image to be combined with the specified moving image to create a combined image. A composite image in which both of the images for compositing are moving images is continuously generated, and the composite image is continuously transmitted to the videophone device 200 for presentation. Request to download a composite image, request to start extracting a composite image, request to finish extracting a composite image, request to play back a composite image, and request to return to the composite image designation screen. A composite image presentation screen having menu items or icons, and a program for causing the control unit 201 of the videophone apparatus 200 to execute control for displaying a composite image at a predetermined position on the composite image presentation screen are transmitted to the videophone apparatus 200. Starts the acquisition of a moving image or an image for clipping synthesis from the image at the time of the reception in response to the reception of the clipping start request, starts the measurement of the clipping time by the timer 108, and Generation of a synthesized image by synthesizing the image and the image for synthesis is continued, and in response to the reception of the cutout end request, the image for synthesis of the moving image is fixed or stopped with the image at the time of the reception, and the image is statically stopped. An image for synthesis is obtained, and an image for synthesis for extraction which is a moving image from the image at the time of receiving the cutout start request to the image at the time of receiving the cutout end request is obtained. At the end of the measurement, a combined image is generated by combining the combined image and the still combined image, transmitted and presented, and further, the still combined image, that is, the paused image of the combined image in response to the reception of the reproduction request , The reproduction of the compositing image that is a moving image is started, and both the compositing target image and the compositing image continuously generate a composite image that is a moving image again. The charging processing unit 105 executes the distribution process of downloading the cut-out composition image according to the distribution of the cut-out composition image to the user who distributes the cut-out composition image in accordance with the cut-out time of the cut-out composition image. That perform billing. is there. The authentication processing unit 101, the designation processing unit 102, the image synthesizing unit 103, the distribution processing unit 104, the billing processing unit 105, and the like are realized by a CPU that functions as each unit, a memory that stores programs and data, and the like.

  The basic configuration of the videophone device 200 according to the third embodiment is the same as that of the videophone device 200 according to the first embodiment, except that a predetermined operation program, data of a cut-out composition image, and the like are stored in a predetermined storage area. A memory 202 for storing the moving image to be synthesized in the predetermined operation program. The cut-out synthesizing image selected in the input unit 204 or the like is synthesized from the cut-out synthesizing image stored in the storage area and the synthesis target image to continuously generate a synthesized image in real time with the imaging. A program for continuously transmitting the synthesized image and the imaging in real time to another videophone device of the communication partner via the remote controller is included.

  When the image providing device 100 of the third embodiment provides an image to the videophone device 200, the process is basically the same as that of the first and second embodiments until the image providing device 100 presents the composite image. The processing of is performed. That is, as shown in FIG. 5, the image providing apparatus 100 establishes a connection (S101), the authentication processing unit 101 executes an authentication process by receiving an ID and a password (S102), and the designation processing unit 102 (S103), transmits a message screen prompting to transmit a moving image, and the image synthesizing unit 103 continuously receives the captured moving image from the videophone device 200 and continuously recognizes the moving image. In step S104, a compositing target image is extracted from the moving image using the inter-frame difference or the like in the same manner as in the first embodiment or the like, and a compositing target image of the moving image is continuously obtained (S105). An image for synthesis that has been subjected to the duplication prevention processing corresponding to the designated identification information is extracted from 106 and is used for imaging and transmission of a moving image in the videophone device 200 in almost real time. An image composited image continuously generating a synthesized image by integrally combining (S106). Further, the image synthesizing unit 103 includes a download request of a cut-out synthesis image to be stored and stored, a cut-out start request of the synthesis image, a cut-out end request of the synthesis image, a reproduction request of the synthesis image, a synthesis image designation screen A program for causing the control unit 201 of the videophone device 200 to execute a composite image presenting screen having a menu item or an icon of a request to return to and a control to display a composite image at a predetermined position on the composite image presenting screen is extracted. The image presentation screen and the program are transmitted to the videophone device 200, and the continuously generated synthesized images are continuously transmitted and presented to the videophone device 200 (S107). The control unit 201 of the videophone device 200 cooperates with the received program and a program having a browser function, synthesizes a composite image at a predetermined position on the composite image presentation screen, and outputs a moving image of the videophone device 200. A composite image presentation screen including a composite image generated substantially in real time with imaging and transmission is displayed on the image display unit 203.

  Then, when the combined image of the moving image and the combined image of the moving image are continuously displayed on the combined image presentation screen, the user of the videophone device 200 can input a desired image using the input unit 204 or the like. When the request to start the extraction of the image for synthesis is designated and input at the timing of, the control unit 201 transmits a request to start the extraction of the image for synthesis to the image providing apparatus 100 in response to the designation input of the request to start the extraction. The image synthesizing unit 103 of the image providing apparatus 100 receives and accepts the cutout start request of the synthesis image via the communication processing unit 109 (S301), and receives the synthesis image in response to the cutout start request. From the image at the point of time, the extraction and acquisition of the image for clipping synthesis as a moving image is started by separately recording in a storage area of a predetermined memory (S302), and the timer 108 starts measuring the clipping time. Then, extraction of the compositing target image from the received moving image, generation of an integrated composite image by superimposing the compositing target image and the compositing image, and presentation of the composite image by continuous transmission to the videophone device 200 are continued.

  After that, when the videophone device 200 specifies and inputs a cutout end request of the image for synthesis at a desired timing, and transmits the cutout end request to the image providing device 100, the image synthesizing unit 103 outputs Receiving and accepting the cutout end request for the image (S303), and fixing the moving image combining image in the combined image generated and presented with the image at the time of reception in response to the receipt of the cutout end request Alternatively, stop and acquire the still synthesis image, and end the extraction and acquisition of the extraction synthesis image that is a moving image from the image at the time of receiving the extraction start request to the image at the time of receiving the extraction end request ( In step S304, the measurement of the cut-out time by the timer 108 is terminated, and the cut-out synthesis image and the measured cut-out time from the start of the cut-out to the end of the cut-out are stored in a storage area of a predetermined memory. Further, continuous acquisition by continuously extracting the compositing target image from the received moving image is continued, and the compositing target image and the acquired still compositing image are integrally combined to continuously generate a composite image. (S305), the continuously generated synthesized images are continuously transmitted and presented to the videophone device 200 (S306). The control unit 201 of the videophone device 200 cooperates with a program for displaying a composite image at a predetermined position on the composite image presentation screen and a program having a browser function, and composites the composite image at a predetermined position on the composite image presentation screen, The image display unit 203 displays a composite image of a compositing target image and a still compositing image generated in substantially real time upon capturing and transmitting a moving image in the videophone device 200 on a composite image presentation screen.

  When the user of the videophone device 200 designates and inputs a reproduction request of the compositing image using the input unit 204 or the like while displaying the composite image including the compositing target image and the still compositing image, the control unit 201 In response to the specification input of the reproduction request, a request to reproduce the image for synthesis is transmitted to the image providing apparatus 100. The image synthesizing unit 103 of the image providing apparatus 100 receives and accepts a reproduction request for a synthesizing image via the communication processing unit 109 (S307). The reproduction of the moving image, which is a moving image, is started from the stopped image, and the moving image is continuously extracted from the received moving image. The continuous generation of images is restarted, and the synthesized images to be continuously generated are continuously transmitted to the videophone device 200 and presented.

  On the other hand, the user of the videophone device 200 designates the download request of the cut-out synthesis image by the input unit 204 or the like while the cut-out is ended and the synthesized image of the synthesis target image and the still synthesis image is being displayed. In this case, the control unit 201 transmits a download request for the image for synthesizing to the image providing apparatus 100 in response to the designation input of the download request. The distribution processing unit 104 of the image providing apparatus 100 receives and receives the download request of the cut-out composite image via the communication processing unit 109 (S308), and generates a composite image on the composite image presentation screen according to the reception. Ending the presentation and the like, transmitting and presenting the screen having the information on the distribution process, and extracting and synthesizing images from the start of extraction to the end of extraction in the composite image of the composite image presentation screen that has received the download request. Is acquired from the predetermined storage area, and the data of the image for clipping / synthesis is downloaded and distributed to the videophone device 200 via the communication processing unit 109 (S309). The control unit 201 of the videophone device 200 selectively stores the data of the cut-out composition image received and downloaded via the communication line 300 in a predetermined storage area of the memory 202. Therefore, the user can acquire a desired cut-out composition image from various scenes of various composition images while checking the state of the composite image together with the effect of the first embodiment. . Note that the distribution processing unit 104 may be configured to distribute the data of the cut-out composite image cut out by the cut-out end request to the videophone device 200 in response to the reception of the cut-out end request.

  Further, the charging processing unit 105 of the image providing apparatus 100 cuts out the unit price by referring to the unit price per unit time to be stored and held and the cut-out time to be stored in accordance with the completion of the delivery of the data of the cut-out composition image. The predetermined amount multiplied by the time is charged to the user of the user ID (S310), and the charging information is stored in the user data of the user ID in the user database 107. Then, the distribution processing unit 104 measures the screen having the information indicating that the distribution processing and the charging is completed by the timer 108 and transmits and presents the screen for a predetermined time, instead of the screen having the information during the distribution processing. Then, in accordance with the elapse of the set time, the designation processing unit 102 presents the image-for-synthesis designation screen again in place of the distribution processing and billing completion screen, and a series of processing is completed. Note that, as in the second embodiment, when the reproduction time of the compositing image ends in generating the composite image, the image compositing unit 103 ends the extraction of the compositing target image and the generation and presentation of the composite image, The designation processing unit 102 transmits and presents the composition image designation screen to the videophone device 200, and the designation processing unit 102 of the image providing apparatus 100 receives a request to return to the composition image presentation screen during presentation of the composite image. Also in this case, the image-for-synthesis designation screen is transmitted and presented to the videophone device 200. Also, the unit price per unit time of the amount charged for the delivery of the cut-out composition image can be set according to the type or content of the composition image, or a uniform amount can be set.

  Thereafter, when the user mutually communicates with the user of another videophone device using the videophone device 200, the input of the input unit 204 or the like specifies the composite image mode and the specification of the desired cutout composite image. In response, the control unit 201 of the videophone device 200 extracts and extracts an image to be combined with the moving image from the moving image captured by the imaging unit 205, and selects the extracted image from the clipping image to be stored in a predetermined storage area of the memory 202. The specified cut-out synthesizing image is extracted, and the synthesis target image and the cut-out synthesizing image are continuously and integrally synthesized to generate a synthesized image. To the videophone device.

  Next, an image providing apparatus, a user apparatus, and a flow of providing an image to a user apparatus by the image providing apparatus according to the fourth embodiment will be described. As shown in FIGS. 1 and 6, the basic configuration of the image providing apparatus and the user apparatus according to the fourth embodiment and the basic flow of image provision are as follows. An image providing apparatus 100 connected via a certain communication line 300 receives a moving image continuously captured by the video telephone apparatus 200 and continuously transmitted from the video telephone apparatus 200 in real time to the image capturing. The image to be synthesized of the moving image is extracted and continuously extracted from the received moving image in substantially real time with the transmission and reception, and the image to be synthesized, which is the background image of the specified still image or moving image, and the synthesis object to be continuously extracted The image capturing, transmission / reception, and extraction are superimposed and synthesized in substantially real time to generate a synthesized image in which the image to be synthesized and the image for synthesis are integrated. Similarly, the synthesized image including the image to be synthesized extracted from the captured image is displayed on the videophone device 200 in the videophone device 200 substantially in real time, and the synthesized image is displayed. A request for fixing a composite image is received from the device 200, a composite image is fixed at the received timing, a still composite image is obtained, and a still composite image desired by the user is delivered to the videophone device 200, and the static composite is performed. The user is charged for the image distribution.

  The basic configuration of the image providing apparatus 100 according to the fourth embodiment is the same as that of the image providing apparatus 100 according to the first embodiment. As shown in FIG. 1, an authentication processing unit 101, a designation processing unit 102, an image synthesis The image synthesizing unit 103 includes a unit 103, a distribution processing unit 104, a billing processing unit 105, an image database for composition 106, a user database 107, a timer 108, and a communication processing unit 109. Is extracted and extracted continuously from the moving image received from the videophone device 200, and the synthesized image of the specified still image or moving image is synthesized with the synthesized image of the moving image. An integrated composite image is continuously generated, and the synthesized image is continuously transmitted to the videophone device 200 to be presented, and a still composite image of the generated composite image is downloaded. Request, a request to fix the composite image (pause request), a request to reproduce the composite image, a request to return to the composite image designation screen, a composite image presentation screen having menu items or icons, and a composite image at a predetermined position on the composite image presentation screen Is transmitted to the videophone device 200, and the control unit 201 of the videophone device 200 transmits a program to the videophone device 200, and further fixes the synthesized image generated at the time of the reception in response to the reception of the fixing request. Pause to obtain a still composite image, and in response to the reception of the reproduction request, continuously extract and extract the synthesis target image from the moving image received at the time of the reception, and the synthesis image is the moving image. In this case, the reproduction of the compositing image is started from the still composite image, and a composite image in which both the compositing target image and the compositing image to be extracted are moving images is continuously generated. If the compositing image is a still image, a composite image of the compositing target image to be extracted again and the compositing image of the still composite image is continuously generated. The distribution processing for downloading the still composite image is executed in response to the request, and the charging processing unit 105 executes the charging processing for the user who distributes the still composite image for distribution. The authentication processing unit 101, the designation processing unit 102, the image synthesizing unit 103, the distribution processing unit 104, the billing processing unit 105, and the like are realized by a CPU that functions as each unit, a memory that stores programs and data, and the like.

  The basic configuration of the videophone device 200 according to the fourth embodiment is the same as that of the videophone device 200 according to the first embodiment, except that a predetermined operation program, data of a still composite image, and the like are stored in a predetermined storage area. The predetermined operation program includes, in accordance with an input from the input unit 204, a moving image to be picked up by the image pickup unit 205, and selection from a still composite image stored in a predetermined storage area of the memory 202. A program for transmitting the obtained still composite image to another videophone device of the communication partner via the communication line 300 is included.

  When the image providing apparatus 100 of the fourth embodiment provides an image to the videophone device 200, the processing is basically the same as that of the first to third embodiments until the image providing apparatus 100 presents the composite image. The processing of is performed. That is, as shown in FIG. 6, the image providing apparatus 100 establishes a connection (S101), the authentication processing unit 101 executes an authentication process by receiving an ID and a password (S102), and the designation processing unit 102 (S103), transmits a message screen prompting to transmit a moving image, and the image synthesizing unit 103 continuously receives the captured moving image from the videophone device 200 and continuously recognizes the moving image. In step S104, a compositing target image is extracted from the moving image using the inter-frame difference or the like in the same manner as in the first embodiment or the like, and a compositing target image of the moving image is continuously obtained (S105). For example, an image for synthesizing a moving image, which has been subjected to the duplication prevention processing corresponding to the designated identification information, is extracted from The synthetic image compositing target image by integrally combining to produce a continuous composite image Im (S106). Further, the image synthesizing unit 103 has menu items or icons for a request to download a still synthetic image to be stored and stored, a request to fix the synthetic image (pause request), a request to reproduce the synthetic image, and a request to return to the image specification screen for synthesis. A composite image presentation screen, and a program for causing the control unit 201 of the videophone device 200 to execute control for displaying a composite image at a predetermined position on the composite image presentation screen are extracted. In addition to transmitting the synthesized image to the videophone 200, the synthesized image is continuously transmitted to the videophone device 200 and presented (S107). The control unit 201 of the videophone device 200 cooperates with the received program and a program having a browser function, synthesizes a composite image at a predetermined position on the composite image presentation screen, and outputs a moving image of the videophone device 200. A composite image presentation screen including a composite image generated substantially in real time with imaging and transmission is displayed on the image display unit 203.

  When, for example, a combined image of a moving image and an image to be combined with a moving image are continuously displayed on the combined image presentation screen, the user of the videophone device 200 operates the input unit 204 or the like. When a request for fixing a composite image is designated and input so as to press the shutter at a desired timing, the control unit 201 transmits a request for fixing the composite image to the image providing apparatus 100 in response to the designation input of the request for fixing. The image compositing unit 103 of the image providing apparatus 100 receives and accepts a request for fixing a composite image via the communication processing unit 109 (S401), and in response to the reception of the request for fixing, generates a composite image generated at the time of the reception. Is fixed or temporarily stopped to obtain a still composite image, and the extraction of the compositing target image, for example, the reproduction of the moving image for compositing and the generation of the composite image are stopped (S402), and the still composite image is transferred to the videophone 200. And presents it (S403). The control unit 201 of the videophone device 200 cooperates with a program for displaying a composite image at a predetermined position on the composite image presentation screen and a program having a browser function, and synthesizes a still composite image at a predetermined position on the composite image presentation screen. Displayed by the image display unit 203.

  When the user of the videophone device 200 designates and inputs a request for reproducing a composite image using the input unit 204 or the like while the still composite image is being displayed, the control unit 201 provides an image in response to the specification input of the reproduction request. A request for reproducing a composite image is transmitted to the device 100. The image synthesizing unit 103 of the image providing apparatus 100 receives and accepts the request for reproducing the synthesized image via the communication processing unit 109 (S404), and responds to the reception of the reproduction request, and receives the moving image received at the time of the reception. The image to be synthesized is continuously extracted and extracted from the image, and the reproduction of the image for synthesizing the moving image is started from the image of the still synthesized image, and the image to be synthesized of the moving image to be extracted again and the moving image having started the reproduction are extracted. The continuous generation of the composite image using the composite image is restarted, and the composite image to be continuously generated is continuously transmitted to the videophone device 200 and presented. When the image for synthesis is a still image, the image to be synthesized is continuously extracted and extracted from the moving image received at the time of the reception in response to the reception of the reproduction request, and the moving image to be extracted is synthesized. The continuous generation of the composite image from the target image and the composite image as the still composite image is restarted.

  On the other hand, when the user of the videophone device 200 designates and inputs a download request for a still composite image using the input unit 204 or the like while the still composite image is being displayed, the control unit 201 responds to the designation input of the download request. Then, a request to download the still composite image is transmitted to the image providing apparatus 100. The distribution processing unit 104 of the image providing apparatus 100 receives and accepts a download request for a still composite image via the communication processing unit 109 (S405), and generates and presents a composite image on a composite image presentation screen according to the reception. And transmitting and presenting a screen having information on the distribution process, obtains a still composite image presented on the composite image presentation screen that has received the download request, and transmits the data of the still composite image to the videophone device 200. It is downloaded and distributed via the communication processing unit 109 (S406). The control unit 201 of the videophone device 200 selectively stores the data of the still composite image received and downloaded via the communication line 300 in a predetermined storage area of the memory 202. Therefore, together with the effect achieved by the first embodiment, the user selects a desired scene from various scenes of various synthesis images and remotely adjusts poses and the like freely in real time, while creating a desired still composite image. It becomes possible to acquire. Note that the distribution processing unit 104 may be configured to distribute the data of the still composite image acquired by the fixing request to the videophone device 200 in response to the reception of the request for fixing the composite image.

  Further, in response to the completion of the distribution of the still composite image data, the charging processing unit 105 of the image providing apparatus 100 refers to the set amount to be stored and charges the user of the user ID for the set amount (S407). The accounting information is stored in the user data of the user ID in the user database 107. Then, the distribution processing unit 104 measures the screen having the information indicating that the distribution processing and the charging is completed by the timer 108 and transmits and presents the screen for a predetermined time, instead of the screen having the information during the distribution processing. Then, in accordance with the elapse of the set time, the designation processing unit 102 presents the image-for-synthesis designation screen again in place of the distribution processing and billing completion screen, and a series of processing is completed. It should be noted that the set amount to be charged for the distribution of the still composite image can be set according to the type or content of the composite image, or a uniform amount can be set.

  Note that the image synthesizing unit 103 extracts the synthesis target image and generates or presents the synthesis image when the reproduction time of the synthesis image of the moving image ends in the generation of the synthesis image by the synthesis target image and the synthesis image. Is terminated, and in response to the termination, the designation processing unit 102 transmits and presents the image-for-synthesis designation screen to the videophone device 200 again. Also, when the user inputs on the composite image presentation screen to specify a request to return to the composite image presentation screen during the presentation of the composite image, the request to return to the screen transmitted by the control unit 201 is displayed as an image. The designation processing unit 102 of the providing device 100 receives and accepts the same, and transmits and presents the image-for-synthesis designation screen to the videophone device 200 as described above. Further, when the image for synthesis is a still image or the like, similarly to the first embodiment, the timer 108 may present the synthesized image for a predetermined set time.

  After that, when the user mutually communicates with the user of another videophone device using the videophone device 200, display of a substitute image such as a still composite image and desired still composite image by inputting through the input unit 204 or the like. In response to the designation, the control unit 201 of the videophone device 200 extracts the still composite image selected and designated from the still composite images stored in the predetermined storage area of the memory 202, and extracts the static composite image via the communication line 300. It transmits to the other videophone device of the communication partner.

  Next, an image providing apparatus, a user apparatus, and a flow of providing an image to a user apparatus by the image providing apparatus according to the fifth embodiment will be described. As shown in FIGS. 1 and 7, the basic configuration of the image providing apparatus and the user apparatus according to the fifth embodiment and the basic flow of providing an image are connected to the videophone apparatus 200 as the user apparatus via an IP network. An image providing apparatus 100 connected via a certain communication line 300 receives a moving image continuously captured by the video telephone apparatus 200 and continuously transmitted from the video telephone apparatus 200 in real time to the image capturing. The image to be synthesized of the moving image is extracted and continuously extracted from the received moving image in substantially real time as the transmission or reception and the image to be synthesized is a background image of the specified moving image or still image and the image to be continuously extracted The image capturing, transmission / reception, and extraction are superimposed and synthesized in substantially real time to generate a synthesized image in which the synthesis target image and the synthesis image are integrated, and the generated synthesized image is a videophone device. 00 is transmitted substantially in real time and presented in a reflective manner, and a composite image including a composite target image extracted from the captured image is displayed by the videophone device 200 in substantially real time with the imaging. The clipping start request and the clipping end request of the composite image are received from the videophone device 200, the clipping composite image from the start of the clipping to the clipping end is obtained, and the clipping composite image desired by the user is displayed on the videophone device. 200 and charges the user for the delivery of the cut-out composite image according to the cut-out time of the composite image.

  The basic configuration of the image providing apparatus 100 according to the fifth embodiment is the same as that of the image providing apparatus 100 according to the first embodiment. As shown in FIG. 1, an authentication processing unit 101, a designation processing unit 102, an image combining unit 103, a distribution processing unit 104, a billing processing unit 105, a compositing image database 106, a user database 107, a timer 108, a communication processing unit 109, and other necessary units as necessary. An image to be combined with a moving image is continuously extracted and extracted from a moving image received from the videophone device 200, and an image to be combined with a designated moving image or still image is combined with an image to be combined with the moving image to be integrated. The synthesized image is continuously generated, and the synthesized image is continuously transmitted to the videophone device 200 for presentation. A composite image presentation screen having menu items or icons for requesting the start of a composite image, a request to start the extraction of a composite image, a request to end the extraction of a composite image, a request to reproduce the composite image, and a request to return to the composite image designation screen A program that causes the control unit 201 of the videophone device 200 to execute control for displaying a composite image at a predetermined position on the screen is transmitted to the videophone device 200, and further, in response to reception of the cutout start request, The acquisition of the cut-out composite image from the composite image is started, the measurement of the cut-out time is started by the timer 108, the generation of the composite image by synthesizing the target image and the image for synthesis is continued, and the reception of the cut-out end request is received. The stationary composite image at the time of reception is fixed or stopped to obtain a still composite image, and the still composite image is transmitted and presented. To obtain a cut-out synthesized image up to the synthesized image at the time of receiving the cut-out end request, end the measurement of the cut-out time by the timer 108, and further, in response to the request for reproducing the synthesized image, obtain the synthesized image. Is a moving image, reproduction is started from the first image of the compositing image, and a composite image is sequentially generated from the compositing target image extracted from the moving image received at the time of the reception and the compositing image that has started the reproduction. In the case where the image for synthesis is a still image, the synthesis image is continuously generated by the synthesis target image extracted from the moving image received at the time of the reception and the synthesis image which is a still image. The delivery processing unit 104 executes a delivery process of downloading the cut-out composite image in response to the download request, and the charging processing unit 105 performs the delivery of the cut-out composite image in response to the download request. When cutting out This is to execute a process of charging the user for distribution in time. The authentication processing unit 101, the designation processing unit 102, the image synthesizing unit 103, the distribution processing unit 104, the billing processing unit 105, and the like are realized by a CPU that functions as each unit, a memory that stores programs and data, and the like.

  The basic configuration of the videophone device 200 according to the fifth embodiment is the same as that of the videophone device 200 according to the first embodiment. However, a predetermined operation program, data of a cut-out composite image, and the like are stored in a predetermined storage area. A memory 202 for storing, and the predetermined operation program includes a cut-out composite image stored in a predetermined storage area of the memory 202 in place of a moving image captured by the imaging unit 205 in response to an input from the input unit 204. And a program for transmitting the cut-out composite image selected from the above to another videophone device of the communication partner via the communication line 300.

  When the image providing apparatus 100 of the fifth embodiment provides an image to the videophone device 200, the processing is basically the same as the processing of the first to fourth embodiments until the image providing apparatus 100 presents the composite image. Execute the processing of That is, as shown in FIG. 7, the image providing apparatus 100 establishes a connection (S101), the authentication processing unit 101 executes an authentication process by receiving an ID and a password (S102), and the designation processing unit 102 (S103), transmits a message screen prompting to transmit a moving image, and the image synthesizing unit 103 continuously receives the captured moving image from the videophone device 200 and continuously recognizes the moving image. In step S104, a compositing target image is extracted from the moving image using the inter-frame difference or the like in the same manner as in the first embodiment or the like, and a compositing target image of the moving image is continuously obtained (S105). For example, an image for synthesizing a moving image, which has been subjected to the duplication prevention processing corresponding to the designated identification information, is extracted from The synthetic image compositing target image by integrally combining to produce a continuous composite image Im (S106). Further, the image synthesizing unit 103 receives a request to download a cut-out synthesized image to be stored, a request to start cutting out a synthesized image, a request to end cutting-out of a synthesized image, a request to play back a synthesized image, and a request to return to the image-for-synthesis designation screen. A composite image presentation screen having menu items or icons, and a program for causing the control unit 201 of the videophone device 200 to execute control for displaying a composite image at a predetermined position on the composite image presentation screen are extracted. The program is transmitted to the videophone device 200, and the continuously generated synthesized images are continuously transmitted to the videophone device 200 and presented (S107). The control unit 201 of the videophone device 200 cooperates with the received program and a program having a browser function, synthesizes a composite image at a predetermined position on the composite image presentation screen, and outputs a moving image of the videophone device 200. A composite image presentation screen including a composite image generated substantially in real time with imaging and transmission is displayed on the image display unit 203.

  Then, when, for example, an image for synthesizing a moving image and an image for synthesizing a moving image are continuously displayed on the synthesized image presenting screen, the user of the videophone device 200 operates the input unit 204 or the like. When a request to start clipping of a composite image is designated and input at a desired timing, the control unit 201 transmits a request to start clipping of a composite image to the image providing apparatus 100 in response to the designation input of the clipping start request. The image synthesizing unit 103 of the image providing apparatus 100 receives and accepts the cutout start request of the synthesized image via the communication processing unit 109 (S501), and in response to the cutout start request, receives the synthesized image at the time of the reception. Then, the extraction and acquisition of the cut-out composite image is started by separately recording in a storage area of a predetermined memory, for example (S502), the measurement of the cut-out time is started by the timer 108, and the synthesis target from the received moving image is started. Extraction of an image, generation of an integrated image by superimposing an image to be synthesized and an image for synthesis, and presentation of the synthesized image by continuous transmission to the videophone device 200 are continued.

  After that, when a request for terminating the extraction of the composite image is designated and input at a desired timing by the videophone device 200 and the request for termination of the extraction is transmitted to the image providing apparatus 100, the image compositing unit 103 outputs the composite image. The clipping end request is received and received (S503), and in response to the reception of the clipping end request, a still composite image is acquired by fixing or stopping with the composite image at the time of the reception and synthesizing the received moving image. After the extraction of the target image and the generation of the composite image are completed, the still composite image is transmitted and presented (S504), and the composite image at the time of receiving the cut-out request from the composite image at the time of receiving the cut-out start request. The extraction and acquisition of the cut-out composite image up to and including are ended (S505), the measurement of the cut-out time by the timer 108 is terminated, and the cut-out time from the start of the cut-out composite image and the measured cut-out to the end of the cut-out are set. Of the given memory And stores it in the 憶領 area. The control unit 201 of the videophone device 200 cooperates with a program for displaying a composite image at a predetermined position on the composite image presentation screen and a program having a browser function, and a still composite image presented at a predetermined position on the composite image presentation screen. Are combined and displayed by the image display unit 203.

  When the user of the videophone device 200 designates and inputs a request for reproducing a composite image using the input unit 204 or the like while the still composite image is being displayed, the control unit 201 provides an image in response to the specification input of the reproduction request. A request for reproducing a composite image is transmitted to the device 100. The image synthesizing unit 103 of the image providing apparatus 100 receives and accepts the request for reproducing the synthesized image via the communication processing unit 109 (S506), and responds to the reception of the reproduction request, and receives the moving image received at the time of the reception. The image to be synthesized is continuously extracted and extracted from the image, and when the image to be synthesized is a moving image, reproduction is started from the first image of the image to be synthesized, and the image to be synthesized and the image to be reproduced that have started the reproduction are started. If the composite image is a still image, the composite image to be continuously generated is resumed when the composite image is a still image. Is continuously transmitted to the videophone device 200 and presented. Note that by performing reproduction of the synthesis image from the beginning, the synthesis image and the synthesis image are adjusted while freely adjusting the synthesis target image again or until a desired cut synthesis image is obtained. You can try to get an image.

  When a request to reproduce a synthesized image is made during the display of a still synthesized image, the image synthesizing unit 103 or the distribution processing unit 104 needs to acquire and store the cut-out synthesized image and the cut-out time data. Erase accordingly. Also, the composition image to be reproduced in response to the composite image reproduction request can start reproduction from a predetermined image in the composition image, such as starting reproduction from a still composite image composed image. Further, the image synthesizing unit 103 responds to the rewind request, the fast-forward request, or the stop request by setting a menu item or an icon on the synthesized image presenting screen for the fast-forward request, the rewind request, or the stop request. May be rewound or fast-forwarded to a predetermined image and stopped, and the combined image may be reproduced from the image at that time to generate a combined image. Such a configuration improves the convenience of the user. Can be. Also, an index is set for each predetermined scene of the image for synthesis, and the identification information of the index of the scene is set together with the identification information of the image for synthesis on the image for specifying image for synthesis, etc. Accordingly, the image compositing unit 103 may reproduce the composite image from the designated index of the designated composite image to generate the composite image.

  On the other hand, if the user of the videophone device 200 specifies and inputs a download request for a cut-out composite image using the input unit 204 or the like while the still composite image is being displayed, the control unit 201 determines whether to input the download request. In response, a request to download the cut-out composite image is transmitted to image providing apparatus 100. The distribution processing unit 104 of the image providing apparatus 100 receives and accepts the cut-out composite image download request via the communication processing unit 109 (S507), and generates and presents a composite image on the composite image presentation screen according to the reception. And the like, and transmits and presents a screen having information on the distribution process, obtains a cut-out composite image of the composite image presentation screen that has received the download request, and transmits the data of the cut-out composite image to the videophone device 200. Is downloaded via the communication processing unit 109 and distributed (S508). The control unit 201 of the videophone device 200 selectively stores the data of the cut-out composite image received and downloaded via the communication line 300 in a predetermined storage area of the memory 202. Therefore, in addition to the effects achieved by the first embodiment, the user selects a desired scene from various scenes of various synthesis images, and remotely adjusts poses and the like freely in real time, while selecting a desired cut composite image. Can be obtained. Note that the distribution processing unit 104 may be configured to distribute the data of the cut-out composite image cut out by the cut-out end request to the videophone device 200 in response to the reception of the cut-out end request.

  Further, the charging unit 105 of the image providing apparatus 100 refers to the unit price per unit time to be stored and stored and the cut-out time to be stored in accordance with the completion of the distribution of the cut-out composite image data, and adds the cut-out time to the unit price. Is charged to the user of the user ID (S509), and the charging information is stored in the user data of the user ID in the user database 107. With such a billing configuration, billing according to the degree of use of the user becomes possible. Then, the distribution processing unit 104 measures the screen having the information indicating that the distribution processing and the charging is completed by the timer 108 and transmits and presents the screen for a predetermined time, instead of the screen having the information during the distribution processing. Then, in accordance with the elapse of the set time, the designation processing unit 102 presents the image-for-synthesis designation screen again in place of the distribution processing and billing completion screen, and a series of processing is completed.

  Note that the image synthesizing unit 103 extracts the synthesis target image and generates or presents the synthesis image when the reproduction time of the synthesis image of the moving image ends in the generation of the synthesis image by the synthesis target image and the synthesis image. Is terminated, and in response to the termination, the designation processing unit 102 transmits and presents the image-for-synthesis designation screen to the videophone device 200 again. Also, when the user inputs on the composite image presentation screen to specify a request to return to the composite image presentation screen during the presentation of the composite image, the request to return to the screen transmitted by the control unit 201 is displayed as an image. The designation processing unit 102 of the providing device 100 receives and accepts the same, and transmits and presents the image-for-synthesis designation screen to the videophone device 200 as described above. Further, when the image for synthesis is a still image or the like, similarly to the first embodiment, the timer 108 may present the synthesized image for a predetermined set time. Further, the unit price per unit time of the amount charged for the delivery of the cut-out composite image can be set according to the type or content of the composite image, or a uniform amount can be set.

  Thereafter, when the user mutually communicates with the user of another videophone device using the videophone device 200, display of a substitute image such as a cut-out composite image and desired clipping by inputting through the input unit 204 or the like. In response to the designation of the composite image, the control unit 201 of the videophone device 200 extracts the selected and specified composite image from the composite image stored in the predetermined storage area of the memory 202, and converts the composite image to the extracted composite image. The data is transmitted to another videophone device via the communication line 300.

  Next, an image providing apparatus, a user apparatus, and a flow of providing an image to a user apparatus by the image providing apparatus according to the sixth embodiment will be described. The basic configuration of the image providing apparatus and the user apparatus according to the sixth embodiment and the basic flow of image provision are as shown in FIG. 8 and FIG. 200, in cooperation with a predetermined program, receives a compositing image that is a moving image or a still image, and continuously extracts and extracts a compositing target image from a moving image to be captured in real time with the reception. It functions as a means for generating an integrated image by superimposing and synthesizing an image and an image to be synthesized, or continuously extracting and extracting an image to be synthesized from a moving image to be captured, in real time with the continuous extraction. The composite image is a background image of a moving image or a still image to be received and is superimposed on the compositing target image to function as a unit for generating an integrated composite image. The image forming apparatus 100 connected to the image providing apparatus 200 via the communication line 300, which is an IP network, extracts and transmits the specified synthesizing image from the synthesizing image stored therein, and the synthesizing image received by the videophone device 200. A composite image is generated and displayed based on the compositing target images to be continuously extracted, and further, a composite image desired by the user is distributed to the videophone device 200, and the user is charged for the distribution of the composite image. Things.

  As shown in FIG. 8, the image providing apparatus 100 according to the sixth embodiment includes an authentication processing unit 111 that executes a user authentication process, a specification processing unit 112 that performs a process related to the specification of an image for combination, Image presentation unit 113 for executing processing such as transmission of the synthesized image, distribution processing unit 114 for executing distribution processing for downloading the synthesized image in response to the download request, and use for distributing the image for synthesis Image processing unit 115 for executing a charging process for a user, a synthesizing image database 116 for storing a synthesizing image of a still image background image or a moving image background image to which duplication prevention processing has been performed, corresponding to the identification information. Authentication information such as the user ID of each user and the corresponding registration password, name and address, billing information, and billing destination information such as the account number of a financial institution and credit card number. Functions as a user database 117, a timer 118, and a communication interface for storing required data in accordance with a user ID in accordance with the user ID, and functions as a means for processing data so as to be able to transmit and receive data in packets, such as packetizing and restoring data. A communication processing unit 119 for performing the processing, and other necessary units such as another processing unit, a storage unit, an input unit, and an image display unit as needed. The authentication processing unit 111, the designation processing unit 112, the image presentation unit 113, the distribution processing unit 114, the billing processing unit 115, and the like are realized by a CPU functioning as each unit, a memory, a program stored in the memory, required data, and the like.

  As shown in FIG. 8, the videophone device 200 of the sixth embodiment includes a control unit 211 such as a CPU that controls an operation in cooperation with a predetermined operation program, a predetermined operation program and data of an image for synthesis. A memory 212 for storing predetermined data, an image display unit 213 as a display for displaying images, an input unit 214 such as a button, an imaging unit 215 such as a CMOS camera or a CCD camera capable of capturing moving images, a microphone 216, a speaker 217, A communication processing unit 218 or the like that functions as a communication interface and also functions as a means for processing data so that it can be transmitted and received in packets, such as packetizing and restoring data, and the predetermined operation program has a browser function, and has a browser function. The image for synthesis is displayed, and the moving image captured by the The image to be synthesized of the moving image is continuously extracted and extracted in the image, the image to be synthesized is displayed at a predetermined size, and the image to be synthesized to be continuously extracted in real time is superimposed on the image for synthesizing the received background image and synthesized. A program for generating a composite image by using the image capturing unit 215, continuously extracting and extracting the image to be combined with the moving image in real time from the image captured by the imaging unit 215, and extracting the extracted image from the composite image stored in a predetermined storage area of the memory 212. The image to be synthesized and the image to be synthesized selected by the input unit 214 and the like are superimposed and synthesized to continuously generate a synthesized image in real time with the imaging, and the synthesized image is transmitted to another videophone device of the communication partner via the communication line 300. And a program for continuously transmitting the image and the image in real time.

  When the image providing device 100 according to the sixth embodiment provides an image for synthesis to the videophone device 200, the control unit 211 of the videophone device 200 has the browser function in accordance with an input from the input unit 214. Then, a program for generating a composite image with respect to the received composite image is started, and the control unit 211 displays a browsing screen on the image display unit 213 in cooperation with the program, and transmits a connection request to the image providing apparatus 100. I do. Then, as shown in FIG. 9, similarly to the first embodiment, the image providing device 100 and the videophone device 200 establish a connection (S601), and the authentication processing unit 111 of the image providing device 100 responds to the connection establishment. An authentication screen or an authentication image having input fields for an ID and a password to be stored and held is transmitted to the videophone device 200 and presented. The control unit 211 of the videophone device 200 cooperates with the program to display an authentication screen or an authentication image to be received in the browsing screen displayed on the image display unit 213, similarly to the first embodiment. The ID and the password input in the authentication screen or the authentication image input field are transmitted to the image providing apparatus 100 in response to the authentication screen or the authentication image transmission request button or the icon input from the input unit 214. . The authentication processing unit 111 of the image providing apparatus 100 receives the ID and the password and executes the authentication processing as in the first embodiment (S602).

  After the completion of the authentication in the authentication processing, the designation processing unit 112 of the image providing apparatus 100 urges the user to designate or select an image to be combined. The image designation screen for synthesis or the image designation image for synthesis is transmitted to the videophone device 200 and presented, and the control unit 211 of the videophone device 200 displays the image on the image display unit 213 in cooperation with the program. The received image is displayed in the browsing screen, and the received image is displayed in accordance with the identification information of the desired image to be synthesized from the input unit 214 or the like. The information is transmitted to the image providing apparatus 100. On the other hand, the designation processing unit 112 of the image providing apparatus 100 receives and accepts the designation identification information of the image for combination (S603). The image presenting unit 113 of the image providing apparatus 100 extracts a compositing image corresponding to the designated identification information from the compositing image database 116, and, when the compositing image is a moving image, a compositing image of the extracted moving image. The data of the combination is transmitted by transmitting the data of the predetermined identification information of the combination image and the control data associated with the transmission and presentation of the combination image, and the combination image is transmitted. In the case of a still image, the data of the extracted composition image is transmitted to present the composition image, and the predetermined identification information of the composition image and the control data associated with the transmission and presentation of the composition image are transmitted. (S604). It is preferable to use an image subjected to duplication prevention processing for the image to be transmitted and presented.

  The control unit 211 of the videophone device 200 receives the data of the composition image transmitted from the image providing apparatus 100, the data of the identification information of the composition image, and the control data associated with the transmission and presentation of the composition image, and performs the control. In cooperation with the data and the above-mentioned program, when the compositing image is a moving image, the compositing images of the sequentially received moving images are sequentially reproduced, and the compositing image is displayed in the browsing screen displayed on the image display unit 213. The images are sequentially displayed, and when the compositing image is a still image, the received compositing image is displayed in the browsing screen where the received still image compositing image is displayed on the image display unit 213 ( Along with S605), at a predetermined position in the browsing screen displayed on the image display unit 213, a download request for a composition image storing and holding data and a composition image designation screen or a composition image To display a menu item or icon Back to the specified image request.

  Further, the control unit 211 of the videophone device 200 cooperates with the above program in response to the display input of the image to be synthesized from the input unit 214 or the like, and the user's own image or the user's own image captured by the imaging unit 215. A moving image such as an image containing images is continuously captured, and an image to be combined with a moving image (for example, a moving image of the user himself or a part of the moving image of the user's face, etc.) is captured from the captured moving image in real time. As in the first embodiment and the like, continuous extraction and extraction are performed using the inter-frame difference or the like (S606), and at a predetermined position of the compositing image in the browsing screen displayed on the image display unit 213, A composite image is generated by, for example, extracting an image of only a user without a background and synthesizing the same with an image for synthesis as a background by adjusting the synthesis target image to a predetermined size and superimposing and displaying the image forward. To view Te (S607). The overlapping composition can be performed in the same manner as in the first embodiment.

  In addition, the control unit 211 of the videophone device 200 extracts the image to be combined according to the display input of the image to be combined, displays the image at a predetermined position in the browsing screen in a predetermined size, and acquires the image to be combined. The image presenting unit 113 of the image providing apparatus 100 receives and receives the predetermined signal, and extracts and transmits data and the like of the image for combination in response to the reception. Then, the control unit 211 of the videophone device 200 generates and displays a synthesized image by superimposing and synthesizing the synthesis image received behind the synthesis target image in the browsing screen displayed on the image display unit 213. In addition, the control unit 211 of the videophone device 200 starts the capture of the synthesis target image in response to the start of the capture of the synthesis target image and the generation input of the composite image, and the predetermined signal of the start of the capture of the synthesis target image. Is transmitted to the image providing apparatus 100, and the image presenting unit 113 of the image providing apparatus 100 receives and receives the predetermined signal, extracts and transmits data of an image for combination according to the reception, and transmits the The control unit 211 of the 200 arranges the synthesis target image at a predetermined position of the synthesis image at the rear and the synthesis target image at a predetermined size at the front and overlaps and synthesizes to generate a synthesis image, and displays the synthesized image on the image display unit 213. It may be configured to display a synthesized image generated in the browsing screen.

  Thereafter, when the user of the videophone device 200 designates and inputs a download request for the image for synthesis using the input unit 214 or the like, the control unit 211 responds to the input of the download request, and displays The data of the identification information of the image is recognized, and a download request for the presenting or displaying composite image or the composite image corresponding to the identification information is transmitted to the image providing apparatus 100. The distribution processing unit 114 of the image providing apparatus 100 receives and receives, via the communication processing unit 119, a request to download the presenting or displaying composite image or the composite image corresponding to the identification information (S608). In response to the reception, if necessary, end the continuous transmission of the image for synthesizing the moving image, etc., transmit and present the screen or image having the information during the distribution process, and display the image for synthesis corresponding to the identification information. Based on the identification information, the data of the composition image corresponding to the identification information extracted from the composition image database 116 and subjected to the duplication preventing process is downloaded to the videophone device 200 via the communication processing unit 119 and distributed ( S609). The control unit 211 of the videophone device 200 selectively stores the data of the composition image received and downloaded via the communication line 300 in a predetermined storage area of the memory 212. Note that the image presentation unit 113 of the image providing apparatus 100 does not transmit predetermined identification information of the composition image to be transmitted and presented. The distribution processing unit 114 temporarily stores predetermined identification information of the image or the image for synthesis that is being transmitted, and extracts the synthesis image based on the temporarily held identification information when receiving the download request; Alternatively, the image presenting unit 113 may update the identification information of the temporarily stored composition image in response to transmission of another composition image.

  Further, in response to the completion of the distribution of the image data for synthesis, the charging processing unit 115 of the image providing apparatus 100 refers to the set amount to be stored and charges the user of the user ID for the set amount (S610), The accounting information is stored in the user data of the user ID in the user database 117. Then, instead of the screen or image having information during the distribution process, the distribution processing unit 114 measures the screen or image having information indicating that the distribution process and the billing are completed by the timer 118 and transmits the screen or image for a predetermined set time. In response to the elapse of the set time, the designation processing unit 112 presents again the image-for-synthesis designation screen or the image-for-synthesis designation image in place of the delivery processing and billing completion screen or image. Is completed. It should be noted that the set amount of money to be charged for the distribution of the image for composition can be set according to the type or content of the image for composition or a uniform amount can be set. Accordingly, it is also possible to appropriately adopt a configuration for distributing the still composite image, the cut-out composite image, the still composite image, and the cut-out composite image. In the present embodiment, the same effect as in the first embodiment can be obtained, and the synthesis target image is separated by the user device. Therefore, the timing difference between the imaging and the display of the synthesized image due to the communication speed can be reduced. It can be completely eliminated.

  In the above-described configuration, when the image presenting unit 113 finishes transmitting data for the reproduction time of the moving image, for example, the image providing unit 100, the designation processing unit 112 responds to the end. It is preferable that the composition image designation screen is transmitted again or the composition image designation image is transmitted to the videophone device 200 to be presented, and the user may be presented with the composition image presentation screen or the composition image while presenting the composition image. When a request to return to the designated image is input, the request to return to the screen transmitted by the control unit 211 is received and accepted by the designation processing unit 112 of the image providing apparatus 100, and the designated image for combining or the designated image for combining is The designated image is transmitted to the videophone device 200 and presented. In the case where the image for synthesis is a still image or a moving image, the presentation time of the predetermined image for synthesis to be stored and held by the timer 118 in response to the start of transmission of the image for synthesis is substantially the same processing as in the first embodiment. The measurement may be started, and the presentation of the image for synthesis may be ended in accordance with the end of the set time.

  Thereafter, when the user uses the videophone device 200 to communicate with users of other videophone devices, the user inputs the input image via the input unit 214 or the like according to the specification of the composite image mode and the specification of the desired composite image. The control unit 211 of the videophone device 200 extracts and extracts a moving image to be combined from a moving image captured by the imaging unit 215, and selects and specifies a combining image selected from the combining images stored in a predetermined storage area of the memory 202. A composite image is extracted, and the composite target image and the composite image are continuously and continuously integrated to generate a composite image, and the composite image is transmitted to another videophone device of the communication partner via the communication line 300.

  Next, an image providing apparatus, a user apparatus, and a flow of providing an image to a user apparatus by the image providing apparatus according to the seventh embodiment will be described. As shown in FIGS. 10 and 11, the basic configuration of the image providing apparatus and the user apparatus according to the seventh embodiment and the basic flow of image providing are as follows. The target image is registered and stored, and the image providing apparatus 100 connected via a communication line 300 as an IP network to a video telephone apparatus 200 of an IP telephone system or the like as a user apparatus has a background of a moving image or a still image. Accepting the designation of the image for synthesis, which is an image, extracting the registered synthesis image, overlaying and synthesizing the specified synthesis image and the registered synthesis target image to generate an integrated image, The composite image to be generated is presented to the videophone device 200. Further, the composite image desired by the user is distributed to the videophone device 200, and the user is charged for the distribution of the composite image. Is shall.

  As illustrated in FIG. 10, the image providing apparatus 100 according to the seventh embodiment executes an authentication processing unit 121 that executes user authentication processing, and performs processing related to designation of a composition image and designation of a composition target image. When one or both of the combining target image and the combining image are moving images, the designation processing unit 122 combines the designated combining image and the combining target image to continuously generate a combined image, The synthesized image is continuously transmitted to the videophone device 200 for presentation. If both the synthesis target image and the synthesis image are still images, the specified synthesis image and the synthesis target image are synthesized. A menu item for generating a composite image, transmitting the composite image to the videophone device 200, presenting the composite image, and requesting a download of the composite image used in the generated composite image and a return to the composite image designation screen. An image synthesizing unit 123 that transmits to the videophone device 200 a program that causes the control unit 221 of the videophone device 200 to execute, for example, control for displaying a synthesized image at a predetermined position on the synthesized image presentation screen having the icon, The distribution processing unit 124 performs a distribution process of downloading the image for synthesis in response to the download request, the charging unit 125 performs a process of charging a user who distributes the distribution of the image for synthesis, and a copy prevention process. A synthesizing image database 126 which stores a background image of a still image or a synthesizing image of a background image of a moving image corresponding to identification information, a user ID of each user, a corresponding registration password, and the like. Authentication information, name / address, billing information, billing information such as account numbers and credit card numbers of financial institutions, registration of users A user database 127 for storing necessary data corresponding to the user ID, such as data to be combined, identification information thereof, and data of a combined image designation screen for presenting the registered combined image so as to be specified; A timer 128 for measuring the presentation time of the synthesized image, etc., and a communication processing unit 129 which functions as a communication interface and also functions as a means for processing data so as to be able to transmit and receive data in packets, such as packetizing and restoring data, etc. In accordance therewith, necessary processing units such as other processing units, storage units, input units, and image display units are provided. The authentication processing unit 121, the designation processing unit 122, the image synthesizing unit 123, the distribution processing unit 124, the billing processing unit 125, and the like are realized by a CPU that functions as each unit, a memory that stores programs and data, and the like.

  As shown in FIG. 10, the videophone device 200 of the seventh embodiment includes a control unit 221 such as a CPU that controls the operation in cooperation with a predetermined operation program, a predetermined operation program, data of an image for synthesis, and the like. A memory 222 for storing predetermined data, an image display unit 223 as a display for displaying an image, an input unit 224 such as a button, an imaging unit 225 such as a CMOS camera or a CCD camera capable of capturing a moving image, a microphone 226, a speaker 227, The communication program includes a communication processing unit 228 that functions as a communication interface and a unit that processes data so that it can be transmitted and received in packets, such as packetizing and restoring data. The operation program includes a program having a browser function, and an imaging unit 225. From the moving image to be captured, an image to be combined with the moving image The image is successively extracted and extracted, and the synthesis image selected by the input unit 224 and the synthesis target image are synthesized from the synthesis image stored in a predetermined storage area of the memory 222, and the synthesized image is continuously generated in real time with the imaging. And a program for continuously transmitting the synthesized image and the imaging in real time to the other videophone device of the communication partner via the communication line 300 as appropriate.

  When the image providing apparatus 100 provides an image to the videophone device 200, the image to be combined is registered and stored in the image providing apparatus 100 before presenting the combined image. The registration of the compositing target image is performed, for example, by receiving an image including the compositing target image to be registered from the videophone device 200 via the communication line 300 by a registration processing unit or the like (not shown) of the image providing apparatus 100 and receiving the received image. An image to be combined is extracted and acquired from the image, and the extracted and acquired image to be combined is attached to the user database 127 with identification information as an image to be combined of the user having the user ID recognized by the authentication process, and the like. A compositing target image designation screen that embeds identification information that can designate a registered compositing target image in the same compositing target image and presents one or more compositing target images, or the same identification information that can designate a registered compositing target image. A configuration in which a synthesis target image designation screen to be presented together with the synthesis target image is generated and registered in the user database 127 as the user data; An image including a synthesis target image is captured by an imaging unit installed in the image providing apparatus 100 or an imaging unit of a device connected to the image providing apparatus 100 via a communication network, and a synthesis target image is extracted and obtained from the captured image. Then, the extracted and acquired synthesis target image is added to the user database 127 with identification information as the synthesis target image of the user with the user ID recognized by the input to the image providing apparatus 100 or the device, and In the same manner as described above, it is possible to adopt a configuration in which a synthesis target image designation screen is generated and registered in the user database 127, or a configuration in which these are combined. The registration processing section and the like are also realized by a CPU functioning as the registration processing section and the like and a memory for storing programs and data.

  For example, the registration of an image to be synthesized by the image providing apparatus 100 receiving an image from the videophone apparatus 200 is performed by establishing a connection between the image providing apparatus 100 and the videophone apparatus 200 via the communication line 300 and performing authentication processing using a user ID. Thereafter, a predetermined processing unit of the image providing apparatus 100 transmits and presents a menu screen having menu items or icons such as a registration request of the compositing target image, and requests the registration of the compositing target image specified on the menu screen. The registration processing unit, which is omitted in the drawing of the image providing apparatus 100 in response to the reception of the registration request for the compositing target image, inputs an input field of specific information of an original image of the compositing target image to be registered, such as a file name; Sends and presents a compositing target image registration screen that has a menu item or icon for a transmission request, and responds to specific information input in the input field. The control unit 221 transmits a program or the like that allows the control unit 221 to extract the data of the original image from a predetermined storage area of the memory 222, and on the other hand, the synthesis target image to the input field of the synthesis target image registration screen displayed on the videophone device 200. In response to the input of the specific information of the original image and the designation of the transmission request, the control unit 221 of the videophone device 200 extracts the original image of the synthesis target image corresponding to the specific information from the predetermined storage area of the memory 222 and transmits it. The registration processing unit of the image providing apparatus 100 receives the original image of the specific information, extracts an image to be combined such as a user image from the original image, and recognizes the image by authentication processing or the like. As the data of the user having the user ID, the image to be combined is attached with identification information in a predetermined storage area of the user database 127, and stored as described above. It generates a run such as by storing in the user database 127.

  Note that, in the configuration of the present embodiment for extracting a compositing target image from an original image, when the original image is a moving image, the registration processing unit of the image providing apparatus 100 uses the inter-frame difference or the like as in the first embodiment. Is used to extract a compositing target image, and when the original image is a still image, the registration processing unit of the image providing apparatus 100 acquires a difference between neighboring pixels with respect to the original image of the still image, and sets the difference. The target region and the other region are separated by binarization by comparing with a predetermined threshold value to be extracted, and the target region is extracted as a synthesis target image. However, other appropriate configurations can be applied. is there. In addition, when registering an image to be combined or the like, a configuration may be adopted in which the image data is transmitted from the videophone device 200 to the image providing device 100 as an attached file of an e-mail. A configuration in which an attached image to be combined or the like is extracted from an e-mail, subjected to necessary processing, and stored is provided.

  When an image is provided from the image providing apparatus 100 of the seventh embodiment to the videophone device 200 after the image to be combined is registered as described above, as shown in FIG. The device 100 and the videophone device 200 establish a connection (S701), the authentication processing unit 121 of the image providing device 100 receives the ID and the password and executes the authentication process (S702), and the designation processing unit 122 Is transmitted to the videophone device 200 and has the identification information that can be specified, and the specified identification information of the synthesis image is received from the videophone device 200 (S703). Further, the designation processing unit 122 extracts data such as a synthesis target image presentation screen that presents the registered synthesis target image in a specifiable manner from the user database 127 based on the authenticated user ID, and Is transmitted to the videophone device 200 and presented. On the synthetic image presentation screen, for example, identification information that can specify a registered synthesis target image is embedded in the same synthesis target image as the registered synthesis target image, and the synthesis target image in which the specifiable identification information is embedded is embedded. Is displayed. The control unit 221 of the videophone device 200 displays the presented image-for-synthesis designation screen on the image display unit 223, and responds to the user's input from the input unit 224 or the like to specify the identification information of the desired image to be composed. Then, the designated identification information is transmitted to the image providing apparatus 100, and the designated identification information of the compositing target image registered in the designation processing unit 122 of the image providing apparatus 100 is received (S704).

  The image synthesizing unit 123 of the image providing apparatus 100 performs a copy prevention process corresponding to the specified identification information from the synthesizing image database 126 in response to the reception of the specified identification information of the image for synthesis and the specified identification information of the image to be synthesized. The combined image is extracted, and a combined image corresponding to the designated identification information is extracted from the user database 127, and the combined image and the combined image are overlaid and combined to generate a combined image (S705). . Further, the image synthesizing unit 123 controls the display of the synthesized image at a predetermined position on the synthesized image presentation screen having a menu item or an icon for a request for downloading the synthesis image and returning to the synthesis image designation screen. A program that causes the control unit 221 of the videophone device 200 to execute the process is extracted and transmitted to the videophone device 200, and the generated composite image is transmitted to the videophone device 200 for presentation (S706). At this time, when one or both of the compositing target image and the compositing image are moving images, the designated compositing image and the compositing target image are composited to continuously generate a composite image, and the compositing image is generated. The images are continuously transmitted and presented to the videophone device 200, and when both the compositing target image and the compositing image are still images, the designated compositing image and the compositing target image are combined and composed. An image is generated, and the synthesized image is transmitted to the videophone device 200 and presented. The control unit 221 of the videophone device 200 cooperates with the received program and a program having a browser function to synthesize a synthesized image at a predetermined position on the synthesized image presentation screen, and to display a synthesized image including a generated synthesized image. Is displayed on the image display unit 203.

  Then, in response to the start of the generation or transmission of the synthesized image, the image synthesizing unit 123 starts measuring a predetermined set time, which is the presentation time of the stored synthesized image, with the timer 128, and starts measuring the set time. Until a download request described later is received during the set time, processing such as presentation of the composite image is continued, and a download request described later is not received during the set time and the timer 128 stops measuring the set time. Then, when the elapse of the set time is recognized, the processing of presenting the composite image and the like is terminated, and in response to the termination, the designation processing unit 122 transmits the composite image designation screen and the like to the videophone device 200 again. Present. In addition, even if the user inputs on the composite image presentation screen specifying a request to return to the composite image presentation screen during the set time, the request to return to the screen transmitted by the control unit 221 is provided by the image providing unit. The designation processing unit 122 of the device 100 receives and accepts the image, and transmits and presents a synthesis image designation screen and the like to the videophone device 200 in the same manner as described above.

  On the other hand, during the set time, which is the presentation time of the composite image, the control unit 221 of the videophone device 200 transmits in response to the user's designation input of the download request from the input unit 224 or the like on the composite image presentation screen. When the distribution processing unit 124 of the image providing apparatus 100 receives and receives the download request (S707), the distribution processing unit 124 ends the presentation of the composite image on the composite image presentation screen, and has information on the distribution process. The screen is transmitted and presented, and the specified compositing image that has been composed with the composite image of the composite image presentation screen that has received the download request is recognized and extracted from the compositing image database 126, and the duplication prevention process is performed. The data of the combined image is downloaded to the videophone device 200 and distributed (S708). The control unit 221 of the videophone device 200 selectively stores the data of the composition image received and downloaded via the communication line 300 in a predetermined storage area of the memory 222. Further, in response to the completion of the distribution of the image data for synthesis, the charging processing unit 125 of the image providing apparatus 100 refers to the set amount to be stored and charges the user of the user ID for the set amount (S709), The accounting information is stored in the user data of the user ID in the user database 127. Then, the distribution processing unit 124 measures the screen having the information indicating that the distribution processing and the charging is completed by the timer 128 and transmits and presents the screen for a predetermined time, instead of the screen having the information during the distribution processing. Then, in accordance with the elapse of the set time, the designation processing unit 122 presents the image-for-synthesis designation screen again in place of the distribution processing and billing completion screen, and a series of processing is completed. The set amount of money to be charged for the distribution of the image for composition can be set according to the type or content of the image for composition, or a uniform amount can be set. In the present embodiment, for example, the same effects as those in the first embodiment other than the free adjustment of the real-time image to be synthesized can be obtained. In addition, according to the present embodiment, the image for still synthesis, the image for cutout synthesis, the still synthesis A configuration or the like for distributing an image and a cut-out composite image can be appropriately performed.

  Thereafter, when the user mutually communicates with the user of another videophone device using the videophone device 200, the user inputs an input to the input unit 224 or the like in accordance with the designation of the composite image mode and the designation of the desired composite image. The control unit 221 of the videophone device 200 extracts and extracts a compositing target image of a moving image from a moving image captured by the imaging unit 225, and selects and specifies a compositing image selected from compositing images stored in a predetermined storage area of the memory 222. A composite image is extracted, and the composite target image and the composite image are continuously and continuously integrated to generate a composite image, and the composite image is transmitted to another videophone device of the communication partner via the communication line 300.

  The image providing apparatus 100 according to the first to seventh embodiments has been described to provide an image to the videophone apparatus 200 as a user apparatus. However, the present invention is not limited to the above embodiment. The present invention also includes a configuration in which the configuration of the embodiment or a modification thereof is appropriately applied as a configuration of another embodiment. Included in the present invention. Further, each configuration such as the image providing apparatus 100 and the videophone apparatus 200 can be appropriately adopted for the image providing apparatus, the user apparatus, and the like of the present invention.

  For example, in the above-described embodiment, the image providing apparatus 100 is configured to distribute the image for composition and the like. However, the image providing apparatus 100 may be configured to present the composite image without distributing the image for composition and the like. The providing apparatus 100 or its registration processing unit receives a registration request for a predetermined composition image, still composition image, clipping composition image, still composition image, or clipping composition image from the user device 200, and responds to the registration request. The combined image, the still combined image, the cutout combined image, the still combined image, or the cutout combined image to be connected to the predetermined storage unit of the image providing apparatus 100 or the image providing apparatus 100 via a network such as a LAN or a communication line. It may be configured to be registered in a predetermined storage unit of another predetermined device or the like. The reception of the registration request and the registration of each image in the predetermined storage unit may be performed, for example, by replacing the download request of the composite image presentation screen with the registration request and storing the image in the predetermined memory in response to the reception of the registration request of each image. The registration request is made based on the data in the storage unit and the information such as the telephone number, the user ID, and the password of the video telephone 200 or the user who can identify the video telephone 200, which is stored or obtained in the user database or the like. It is appropriate to register each corresponding image together with the identifiable information in a predetermined storage unit. In addition, in the case of registration in response to a registration request, the same configuration as in the case of distribution in response to a distribution request is used. Billing is possible.

  Although the registration configuration in the predetermined storage unit is appropriate, for example, as in Patent Document 1, a function of performing an intermediary connection of a videophone including mutual transmission of moving images between a plurality of videophone devices 200, and a configuration of a videophone The combining target image is extracted from the original image transmitted from the videophone device 200 at the time of the intermediary connection, the registered image in the predetermined storage unit is extracted and combined with the combining target image, and the combined image is transmitted to the other party's videophone device 200. A predetermined function in the image providing apparatus 100 having a function of extracting a registered image in a predetermined storage unit and synthesizing a registered image with an image to be synthesized transmitted from the videophone apparatus 200 and transmitting the synthesized image to the videophone apparatus 200 of the other party. The registration processing unit of the image providing apparatus 100 stores the image for synthesis, the image for still synthesis, or A configuration for registering an image for use, or the mediation connection function, and registration in which the original image transmitted from the videophone device 200 is replaced with a registered image extracted from a predetermined storage unit and replaced with the videophone device 200 of the other party. The image providing apparatus 100 having a function of transmitting an image or a function of extracting a registered image from a predetermined storage unit in response to receiving a request for transmitting a registered image, and transmitting the extracted registered image to the videophone device 200 of the other party. In a predetermined storage unit or a predetermined storage unit of the predetermined device having the above function, the registration processing unit of the image providing apparatus 100 stores the image for synthesis, the image for still synthesis, the image for cutout synthesis, the still synthesized image, or the cutout synthesis. A predetermined storage unit in a configuration for registering an image or a user device connected by specifying an address or a user device authenticated with identification information such as a password. In a predetermined storage unit of the image providing apparatus 100 having a function capable of presenting an image to be stored, or in a predetermined storage unit of the predetermined apparatus having the function, the registration processing unit of the image providing apparatus 100 stores an image for synthesis, It is preferable to adopt a configuration in which a composition image, a clipping composition image, a still composite image, or a clipping composite image is registered.

  For example, the image synthesizing unit 103 or the like of the image providing apparatus 100 transmits a synthesized image presenting screen having a menu item or an icon of a registration request of an image for synthesis or the like to the videophone device 200, and the registration processing unit or the like of the image providing apparatus 100 Receives and receives a registration request for a composition image or the like transmitted from the videophone device 200, and recognizes and composes a designated composition image or the like that has been composed with the composite image on the composite image presentation screen that has received the registration request. The registration is performed based on the data of a predetermined storage unit extracted from the user image database 106 and the like and stored in a predetermined memory such as the user database 107 or a registration processing unit and the telephone number of the videophone device 200 stored in the user database 107. The image for synthesis corresponding to the request is stored in a predetermined storage unit of the image providing apparatus 100 or a network with the image providing apparatus 100. The telephone to which the predetermined part of the image providing apparatus 100 or the predetermined part of the other predetermined device is registered, together with the telephone number of the videophone device 200 in a predetermined storage unit of another predetermined device or the like to be connected. In accordance with the recognition of the number, it is possible to adopt a configuration in which a composition image or the like corresponding to the telephone number registered in the predetermined storage unit is extracted. In addition, the registration processing unit or the like extracts a composition image or the like in response to the registration request, and generates and stores identification information such as an address or an image ID for the extracted composition image or the like. Based on the data and the identification information, a composition image or the like corresponding to the registration request is registered together with the identification information in a predetermined storage unit of the image providing device 100 or another predetermined device, and the generated identification information is used as necessary for the videophone device. 200 and the predetermined unit of the image providing device 100 or the predetermined unit of the other predetermined device according to the recognition of the identification information transmitted from the appropriate user device such as the videophone device 200. A configuration may be adopted in which a synthesizing image or the like corresponding to the identification information registered in the predetermined storage unit is extracted, and if necessary, transmitted to the appropriate videophone device 200 or the like and presented.

  The configuration for registering the various images for synthesis or the composite images and the like can provide the same operation and effect as the case of distributing the various images for synthesis or the composite images and the like. Images can be stored and viewed by communication partners and users themselves.

  In the above-described embodiment, the distribution processing unit 104 or the like of the image providing apparatus 100 receives and receives the download request, extracts or acquires a composition image or the like corresponding to the received download request, and outputs the data of the composition image or the like. Is distributed to the videophone device 200 and distributed. However, the distribution form is arbitrary, and the distribution processing unit 104 or the like responds to the distribution request by receiving the respective images such as the images for synthesis corresponding to the distribution request. An electronic mail having an image may be generated and stored in the user database 107 or the like, or the electronic mail may be transmitted to a mail address obtained by receiving from the videophone device 200 or the like and distributed. For example, an e-mail address of an image distribution destination for a user is stored in the user database 107 or the like, the distribution processing unit 104 or the like receives a distribution request for a designated composition image or the like, and a composition image or the like corresponding to the received distribution request. And extracts from the user database 107 the mail address of the image delivery destination of the user corresponding to the user ID authenticated in the authentication processing, and extracts the extracted image for synthesis, etc. It may be processed to be able to be transmitted as the main body of the e-mail or as an attached file of the e-mail, and the e-mail including the image for synthesis may be transmitted to the extracted e-mail address and distributed.

  In the above-described embodiment, a menu item or the like for a download request is provided on the composite image presentation screen, and the distribution processing unit 104 or the like receives a download request for an image such as a specified composite image and distributes the received image. However, without providing a menu item or the like for a distribution request such as a download request on the composite image presentation screen, the distribution processing unit 104 or the like stores and retains the composite image or the composite image in response to a fixing request or a clipping end request. An image distribution screen having a menu item or the like of a distribution request such as a download request to be extracted, and a still composite image, a still composite image, a cut-out composite image, or a cut-out composite image and an image distribution screen acquired in response to the request And the like, and an image distribution screen for synthesizing a still composite image, a still composite image, a cut-out composite image, or a cut-out composite image at a predetermined position by a videophone. It is possible to adopt a configuration such as to present the location 200. In the same manner as described above, the image presentation on the image distribution screen is performed by transmitting a program and synthesizing and presenting the image by the control unit 201 or the like, or by the distribution processing unit 104 or the like at a predetermined position on the image distribution screen. It is possible to adopt a configuration or the like in which data obtained by combining images and the like is transmitted and presented. Also, without providing a menu item or the like of a distribution request on the composite image presentation screen, the distribution processing unit 104 or the like may change the menu item or the like of the distribution request of the compositing image stored and held in accordance with the end of the generation and presentation of the composite image. Sending and presenting an image distribution screen having the above, confirming the necessity / non-necessity of the distribution of the compositing image used in the composite image immediately before the presentation of the image distribution screen, and presenting the presentation immediately before receiving the distribution request A configuration or the like for acquiring and distributing a composition image combined with the completed composite image may be adopted.

  In addition, in addition to the videophone device 200 presenting the composite image, the distribution destination may be another user device such as another videophone device 200. For example, the distribution processing unit 104 or the like responds to the reception of the distribution request. An electronic mail having each image such as a compositing image corresponding to the distribution request is generated and stored in the user database 107 or the like or obtained by receiving from the video telephone 200 or the like. The electronic mail may be transmitted to the mail address of the user device and distributed. Also, the predetermined unit of the image providing device registers the image for synthesis, the image for still synthesis, the image for cutout synthesis, the still synthesized image, the cutout synthesized image, and the like in a predetermined storage unit or a predetermined storage unit of the predetermined device so as to be viewable. Generating an e-mail having connectable information such as a URL of the browsing place, and transmitting the e-mail to a mail address of another user device received from the user device or stored in a predetermined storage unit; A configuration in which a predetermined unit of an image providing device or a predetermined device transmits and presents the registered image to the another user device in response to a connection from the another user device by designating the connectable information, and the like. It may be. The communication line used at the time of distribution may be the same as the communication line 300 used for transmission / reception of presentation of a composite image or the like, but may be another communication line, and distribution may be performed according to a distribution request. It may be configured to execute immediately, or may be configured to be distributed after a set time elapses or at a predetermined time such as the end of the month.

  In addition, a function of performing a videophone intermediary connection including mutual transmission of moving images between a plurality of videophone devices 200 and extracting a synthesis target image from an original image transmitted from the videophone device 200 at the time of the videophone intermediary connection. A function of extracting and combining the registered image in the predetermined storage unit with the image to be synthesized, and transmitting the synthesized image to the other party's videophone device 200 or the registered image in the predetermined storage unit as the synthesis target image transmitted from the videophone device 200 The distribution processing unit 104 and the like of the image providing apparatus 100 transmit the synthesized image to the predetermined device of the base station or the relay station having a function of transmitting the synthesized image to the other party's videophone device 200. Or a configuration for distributing an image for clipping or an image for clipping synthesis so that it can be registered in a predetermined storage unit, or transmitted from the mediation connection function and the videophone device 200. The original image is replaced with the registered image extracted from the predetermined storage unit, and the registered image is extracted from the predetermined storage unit in response to the function of transmitting the replaced registered image to the other party's videophone device 200 or the reception of the registration image transmission request. The distribution processing unit 104 or the like of the image providing apparatus 100 transmits the combined image, the still combined image, and the cutoff image to a predetermined device of the base station or the relay station having a function of transmitting the extracted registered image to the other party's videophone device 200. A configuration for distributing an outgoing / combining image, a still combined image, a cutout combined image, or the like in a predetermined storage unit, or a user device connected by designating an address or a use authenticated by a password, identification information, or the like. The distribution processing unit 104 and the like of the image providing apparatus 100 add the image for synthesizing and the static synthesizing to the predetermined device having a function capable of presenting the image stored in the predetermined storage unit to the user device. Image, clipping synthesis image, the still combined image or clipped composite image may be used as the components, etc., that can be registered delivered in a predetermined storage unit.

  In the above-described configuration, distribution can be performed with an appropriate configuration substantially similar to that in the case of registration in the predetermined storage unit. For example, the image combining unit 103 or the like of the image providing apparatus 100 may select a menu item or icon for a distribution request of a composition image or the like. Is transmitted to the videophone device 200, and the distribution processing unit 104 or the like of the image providing device 100 receives and accepts the distribution request of the composition image or the like transmitted from the videophone device 200, and transmits the distribution request. Recognizes the designated compositing image or the like that has been combined with the combined image on the combined image presentation screen that has received the image, and extracts it from the combining image database 106 or the like as necessary, and stores it in the user database 107 or the distribution processing unit 104 or the like. The data of the predetermined device of the base station or the relay station stored in the predetermined memory, and the data of the videophone device 200 stored in the user database 107 are stored. Based on the talk number, the image for composition corresponding to the distribution request is distributed to the predetermined device together with the telephone number of the videophone device 200. On the other hand, the predetermined unit of the predetermined device transmits the image such as the image for composition and the videophone. A configuration in which the telephone number of the device 200 is stored in a predetermined storage unit in association with the telephone number, and an image for synthesis or the like corresponding to the telephone number registered in the predetermined storage unit is extracted in response to recognition of the telephone number transmitted or the like. It is possible. In addition, the distribution processing unit 104 extracts a composition image and the like in response to the reception of the distribution request, and generates and stores identification information such as an address and an image ID for the extracted composition image and the like. Based on the data and the identification information, the image for synthesis corresponding to the distribution request is transmitted to the predetermined device together with the identification information, and the identification information is transmitted to the user device such as the videophone device 200 if necessary. The predetermined unit of the predetermined device stores the image such as the image for synthesis and the identification information in a predetermined storage unit in association with each other, and responds to recognition of the identification information transmitted from a user device such as an appropriate videophone device 200. Alternatively, a composition image or the like corresponding to the identification information stored in the predetermined storage unit may be extracted, and if necessary, transmitted to the appropriate videophone device 200 or the like and presented.

  In the first to seventh embodiments, the billing configuration is such that the distribution or registration of the composition image or the like is based on the set amount or unit price set uniformly for each type of the composition image or the like. However, an appropriate configuration capable of securing the profit base of the business model can be adopted as the charging configuration. For example, the image providing apparatus may periodically charge the data by a predetermined unit or predetermined means cooperating with a predetermined program. The charging time such as the fixed amount or the end of the month to be charged is stored, the charging time is recognized by measuring a timer or the like, the fixed amount is charged to the registered user, and the charging information for the registered user is stored in the user database 107 or the like. Distribution and registration of the number of times, time, amount of transmission data, etc. related to generation and presentation of the number of generations of composite images, etc., or the number of times of distribution of composite images and images for compositing, etc. May be configured such that charging at a metered rate, such as counting a predetermined amount for counting the number of times or the number of times of charging a predetermined set amount against. In addition, means for counting the number of times, time, amount of transmitted data, etc. relating to the image for synthesis including the specific image such as an advertisement image or an image of an entertainer, etc., is provided, and according to the count number and the set amount set uniformly or exceptionally Or means for calculating and storing royalties to entertainers etc. according to the count number and the set amount set uniformly or individually. . In addition to the post-payment configuration, a pre-payment configuration, such as a configuration in which the image providing apparatus recognizes the money data and then performs an image synthesizing process or a distribution process, is also possible. Further, a mechanism for receiving a predetermined percentage of the amount of the communication fee for the connection between the image providing device and the user device or a predetermined amount of the communication fee from the communication company that collects the communication fee of the communication line, A configuration including a storage unit may be employed. Further, the image providing apparatus presents a screen having menu items for selecting a resolution, an image size, or a model type, and distributes a composition image or the like to be stored or generated according to the designation of the menu items. Furthermore, a configuration may be adopted in which a set amount such as each is charged according to the designation.

  In the first and seventh embodiments, the image synthesizing units 103 and 123 of the image providing apparatus 100 can specify the blurring amount of the combining image in a predetermined stage or adjust the blurring amount of the combining image stepwise. A synthesized image presentation screen having menu items or icons of the degree of adjustment of the possible blur amount is stored and transmitted, and the synthesized image presentation screen and the like are transmitted to the videophone device 200, and the generated composite image is transmitted substantially in real time or the like. The control units 201 and 221 of the videophone device 200 receive these and display a composite image presentation screen including the composite image on the image display units 203 and 223. The designated adjustment degree transmitted by the control units 201 and 221 of the videophone device 200 in accordance with the designation of the adjustment degree of the stage blur amount is represented by the image of the image providing apparatus 100. When the synthesizing units 103 and 123 receive and receive, the image synthesizing units 103 and 123 acquire filter parameters corresponding to the degree of adjustment of the blurring amount at a predetermined stage received from the filter parameters stored and held, and synthesize with the filter parameters. Performing filtering for blurring the combining image combined with the image to the predetermined stage blur amount, combining the combining image adjusted to the predetermined stage blur amount and the synthesis target image to be combined, and performing filtering. The control unit 201, 221 of the videophone device 200 generates an image, transmits and presents the generated composite image in substantially real time or the like, and receives the composite image with the composite image adjusted to the predetermined amount of blur. May be displayed on the image display units 203 and 223. The menu item or the icon of the degree of adjustment of the blur amount is, for example, an icon of stage 1 having a relatively low degree of blur, an icon of stage 2 having a moderate degree of blur, or a relatively low degree of blur. One or more is set for each predetermined stage, such as an icon of the strong stage 3.

  Further, in the second to fifth embodiments, in addition to the configuration in which the blur amount of the synthesis image can be adjusted in the same manner as described above, the acquisition of a still synthesis image, a cutout synthesis image, a still synthesis image, and a cutout synthesis image The blur amount of the still-synthesis image, the cut-out synthesis image, the still-synthesis image, and the cut-out synthesis image may be adjusted later. For example, the image synthesis unit 103 may perform the predetermined-stage still-synthesis image, A composite image presentation screen having menu items or icons of an adjustment degree capable of designating a blur amount of an image, a still composite image or a cut composite image is stored and held, and the composite image presentation screen and the composite image are stored in the videophone device 200. The transmitted image is presented with the synthesized image and the synthesized image presenting screen, and is filtered into a still synthesized image, a cut-out synthesized image, a still synthesized image, or a cut-out synthesized image according to the reception of the degree of adjustment of the blur amount at a predetermined stage. To obtain a still-synthesis image or a cut-out synthesis image adjusted to the predetermined amount of blur at the predetermined stage, and if necessary, adjust the blur amount for the still-synthesis image, the cut-out synthesis image, or the still image. A composite image or a composite image based on a cut-out composite image is transmitted and presented, or these images are distributed or registered as required. Further, in the sixth embodiment, for example, the image presenting unit 113 stores and holds a synthetic image presenting screen having menu items or icons of an adjustment degree capable of designating the blur amount of the synthetic image, and synthesizes the synthetic image presenting screen with the synthetic image presenting screen. Transmitting the image for video and the like to the videophone device 200, and in response to the reception of the degree of adjustment of the blur amount at the predetermined stage, executes filtering on the image for synthesis to obtain the image for synthesis adjusted to the blur amount at the predetermined stage, The composition image for which the blur amount has been adjusted is transmitted so as to be capable of being combined with the composition target image and presented. Also, a plurality of compositing images having the same content and having a blur amount corresponding to the degree of adjustment at each stage are previously stored in the compositing image database 106 or the like, and the image compositing unit 103 or the like receives the designated adjustment degree. Accordingly, a configuration may be adopted in which the synthesized image having the blurring amount at the received predetermined stage is extracted, and the synthesized image and the synthesis target image are synthesized to generate a synthesized image, or the synthesized image is transmitted. Further, the blur amount of the image to be combined may be adjustable by a similar configuration or the like. With such a configuration in which the blur can be adjusted, it is possible to obtain an image or the like with a more three-dimensional effect, and it is possible to enhance the convenience and amusement of the user and the like, and to further satisfy the preference.

  In the above-described embodiment, the composition target image is separated and extracted from the original image, and a composition image that is a background image is arranged behind the composition target image to generate a composite image. The image synthesizing unit 103 of the image providing apparatus 100 or the control units 201 and 221 of the user apparatus 200 cooperating with a predetermined program obtains the original image itself to be received or imaged as a synthesis target image, and A configuration in which a composite image such as a frame image or a partial image of a character image is arranged in front of the image to generate a composite image may be adopted. Further, the image synthesizing unit 103 of the image providing apparatus 100 or the control units 201 and 221 of the user apparatus 200 cooperating with a predetermined program makes the synthesis target image semi-transparent, and sets the synthesis target image in front of the synthesis image. If necessary, for example, if the image to be synthesized is a partial image, the image to be synthesized is generated by arranging the image to be rearward, or the image to be synthesized is made semi-transparent, and the image to be synthesized is placed in front of the image to be synthesized or as necessary. Or a configuration in which the composite image is generated by arranging the composite image behind. The translucent processing of each image is appropriately performed by performing α branding or the like. For example, the predetermined unit of the image providing device 100 or the predetermined unit of the videophone device 200 determines whether the pixel value such as the color value of the front image and the rear image Is obtained, a pixel value blended at a ratio according to the set opacity α is obtained, and a synthesized image in which the front image is made translucent by the obtained pixel value is executed.

  In addition, the image providing apparatus 100 may be configured to receive a moving image or an image to be combined from the videophone device 200 before designating an image to be combined or before presenting a screen for designating an image to be combined. And the like, extract and acquire a compositing target image from a received moving image, or acquire a compositing target image to receive or acquire or store a compositing target image, and obtain a compositing target image and a compositing image designation screen and a compositing target image. Is transmitted to the videophone device 200, and the image to be synthesized is synthesized with the same configuration as when the synthesized image is displayed on the synthesized image presentation screen. It is configured to be reflected at a predetermined position on the image designation screen, and preferably, when a sample image of the synthesis image that can be designated is presented on the synthesis image designation screen, Advance user can recognize some images of the composite image before generating the image. Further, the designation processing unit 102 or the like makes the obtained synthesis target image semi-transparent, and synthesizes the semi-transparent synthesis target image, the synthesis image designation screen, and the semi-transparent synthesis target image in front of the synthesis image designation screen. A configuration in which a semi-transparent composition target image is combined and presented in front of a composition image designation screen by a process of the video phone device 200 which cooperates with the program, and a designation process. The unit 102 or the like extracts the semi-transparent synthesis image designation screen for translucent or storing the synthesis image designation screen, acquires the synthesis target image and the semi-transparent synthesis image designation screen, and sets the A program for synthesizing the image designation screen for synthesis in front of the image to be synthesized is transmitted to the videophone device 200, and the process of the videophone device 200 cooperating with the program is performed. It is also possible to adopt a configuration in which a translucent image-for-synthesis designation screen is synthesized and presented in front of the image to be synthesized, and in addition, for example, the user recognizes both identification information of the image to be synthesized and the image for synthesis. If possible, it is possible to adopt an appropriate configuration for combining and presenting the combining target image and the combining image designation screen.

  In the first embodiment and the like, the image synthesizing unit 103 and the like of the image providing apparatus 100 generate a synthesized image, and generate the synthesized image, the synthesized image presentation screen, and the synthesized image at a predetermined position on the synthesized image presentation screen. By transmitting a program or the like that causes the control unit 201 or the like of the videophone device 200 to execute the control or the like for displaying, the synthesized image received at a predetermined position of the synthesized image presentation screen received by the control unit 201 or the like of the videophone device 200 is transmitted. Although the image is synthesized and displayed, the image synthesizing unit 103 or the like of the image providing apparatus 100 generates the synthesized image, synthesizes the synthesized image at a predetermined position on the synthesized image presentation screen, and displays the synthesized image and the synthesized image presentation screen. May be transmitted to the videophone device 200 and presented. Also, for example, the synthesized image presentation screen is a partial image such as an elongated shape, and the image synthesizing unit 103 and the like of the image providing device and the control unit 201 and the like of the videophone device 200 cooperate with a predetermined program to form a partial image. The synthesized image presenting screen, which is an image, or the synthesized image presenting image is arranged at a predetermined position with respect to the stored synthesized image such that the synthesized image is horizontally synthesized forward at the bottom of the synthesized image or horizontally synthesized outside the lower side of the synthesized image. And the like. Also, a program that causes the control unit or the like of the user device to function as the predetermined means is a program that transmits a synthetic image to the user device or the like in real time or in advance, or a program that is set in a predetermined storage unit of the user device in advance. And so on. Further, the control unit or the like of the user device cooperates with a predetermined program or required data and inputs each request to be transmitted to the image providing device by, for example, displaying a request menu or the like on the image display unit as needed. It is possible to adopt a configuration in which transmission is possible in accordance with a predetermined input of the unit, and a configuration in which the image providing apparatus does not transmit a predetermined screen such as a composite image presentation screen to the user apparatus.

  Further, the image providing device 100 distributes or registers a composition image, a still composition image, a clipping composition image, a still composite image, a clipping composite image, or the like, to the image providing device 100 or a compositing image such as advertising information. It is preferable to include or add information that can be connected to a predetermined connection destination such as a predetermined site of an information providing apparatus that provides information related to the content of the image providing apparatus. Information such as an address that can be connected to a predetermined site or the like of the image providing apparatus 100 or the like can be designated or embedded in a part or the whole of the composition image or the like so that the composition image is distributed. Alternatively, the registered user device such as the videophone device 200 communicates with the other user device such as the videophone device 200 and has the connectable information. For example, when transmitting and presenting a combined image having the combined image or the like, the combined image or the combined image is displayed on the image display unit 203 in the other party's videophone device 200 or the like. When the designation of the connectable information is input and the other party's videophone device 200 or the like accesses a predetermined site or the like, the image providing device 100 or the like or a predetermined part thereof transmits the predetermined site or the like to the other party's videophone or the like. It is configured to be transmitted to the device 200 and presented. According to the configuration, for example, when a user device such as a videophone device having an image combining function communicates using a combined image based on a combining image, the communication partner is a combined image transmitted from the user device or a combining image. It is possible to immediately access a predetermined site or the like that provides information related to an image and obtain necessary information. Further, for example, by presenting a composite image presentation site or an image distribution site by presenting the composite image in the connectable information, the demand for the composite image, or the composite image of the communication partner of the user who transmits the composite image. , And the other party can immediately acquire a desired image for synthesis or the like, and furthermore, the user can be presented with the synthesized image or the image for synthesis or voice communication. Since the advertisement of the image for composition or the like is to be advertised and the communication between the user and the other party has a great advertising effect, the business of presenting the image for composition and distributing the image for composition and the like can be expanded.

  The format in which the connectable information is included or added is appropriate. For example, the information is included or added in the image for synthesis or the like in a format to be added to a predetermined object such as a character or an image in the image for synthesis or the like. For example, it is possible to include or add to a predetermined area such as a predetermined object, a top edge, a bottom edge, and a corner of the synthesis image or a predetermined area outside the margin of the synthesis image. Further, the configuration in which the image providing apparatus 100 distributes or registers a composition image or the like including or added to the connectable information is appropriate. Is stored and stored in the compositing image database 106 or the like in a state where it is set and included or added, and the distribution processing unit 104 or the like distributes or registers the compositing image or the like including or added the connectable information. In addition, the distribution processing unit 104 or the like, in response to reception of a distribution request or the like, extracts information that can be connected to a predetermined connection destination to be stored, and synthesizes an image for distribution and the like, a still image for synthesis, an image for clipping synthesis, Include or add to a composite image or a cut-out composite image, and distribute or register a composition image or the like that includes or has added the connectable information. Possible it is.

  In addition, the user and the other party's videophone device 200 can separately communicate with the image providing device 100 and the like in parallel with the communication using the composite image in the communication between the user and the other party by the multi-access function. If the configuration is such that the communication is continued and separately connected to the image providing apparatus 200 or the like to receive the distribution or the like of the composition image, the other party can immediately acquire the favorite composition image or the like, In addition, it is also preferable to immediately obtain a composition image or the like because it becomes a topic of communication and the advertising effect is further enhanced. In addition, the user or the other party's videophone device 200 transmits the connectable information such as a compositing image or the like displayed in cooperation with a predetermined program, such as changing the URL added to the compositing image or the like to an active URL. A configuration may be provided in which a means for activating is provided so that the connectable information is activated by the videophone device 200, and the image forming apparatus 100 or the like is connected in response to a designated input of the activated connectable information.

  The predetermined site presented by the image providing apparatus 100 to which the videophone apparatus 200 of the other party is guided by the connectable information by the predetermined unit is, for example, the above-described authentication screen or image designation screen for combination. May be configured so that the other party can acquire a synthesizing image that is the same as or different from the synthesizing image transmitted by the user's own videophone device 200 by processing similar to that of the user's own videophone device 200 or the like. For example, the image is guided to the predetermined site that directly distributes the same image for synthesis or the like as the image for synthesis transmitted by the user's own videophone device 200 using the connectable information including information for specifying the image for synthesis, A predetermined unit of the providing apparatus 100 is configured to display an image for synthesis corresponding to the specific information on the predetermined site such as a confirmation screen in response to reception of the connectable information. Etc., and a distribution request, etc., and a composition image or the like is distributed in response to the reception of the distribution request or the like. It may be possible to immediately obtain an image for use or the like. Further, the connectable information includes a distribution request or the like of the same composite image transmitted by the user himself, and the predetermined unit of the image providing apparatus 100 responds to the reception of the connectable information, The same image for synthesis may be immediately distributed to the other party's videophone device 200 or the like connected.

  Further, the image combining unit 103 or the like of the image providing apparatus 100 receives a moving request of the combining target image or the combining image transmitted from the videophone device 200, and moves the combining target image or the combining image in response to the movement request. Alternatively, a configuration may be adopted in which a synthesized image is generated from the moved synthesis target image or the synthesis image. For example, the image synthesizing unit 103 or the like of the image providing apparatus 100 transmits a synthesized image presenting screen having a menu item or an icon of a movement request indicating a moving direction as necessary, and a synthesis target input and transmitted by the videophone device 200. A predetermined moving request having a moving direction of the image or the image for synthesis is received and accepted, the moving direction is recognized based on the predetermined moving request, and the coordinate value of the representative point of the front image is moved with respect to the coordinate system of the rear image. A configuration in which the composition target image or the composition image is moved in the recognized movement direction by the unit distance stored and held by the method described above, and a composite image is generated from the moved composition target image or the composition image, or an image of the image providing apparatus 100. An image to be synthesized or an image for synthesis that is input and transmitted by the synthesizing unit 103 or the like via the touch panel or the like of the videophone device 200 A predetermined moving request having a moving direction and a moving distance is received and accepted, the moving direction and the moving distance are recognized based on the predetermined moving request, and the coordinate value of the representative point of the front image is moved with respect to the coordinate system of the rear image. It is possible to adopt a configuration in which the synthesis target image or the synthesis image is moved in the recognized movement direction by the recognized movement distance, and a synthesized image is generated from the moved synthesis target image or synthesis image. It is possible to adopt an appropriate configuration other than the above configuration. Further, in basically the same processing as in the above example, the control unit 201 and the like of the videophone device 200 receives the input request for moving the image to be combined or the image to be combined, and outputs the image to be combined or It is possible to adopt a configuration in which the composition image is moved, and a composite image is generated from the moved composition target image or the composition image.

  It is preferable that the compositing target image in which the display position of the image display unit 203 or the like of the videophone device 200 can be moved is, for example, a compositing target image such as a user's own image extracted from an original image. Can be a foreground image such as a background image or a frame image, but is preferably an image for synthesizing a partial image of an item, a character, or the like. By making the position of the image available for movement, it is possible to freely adjust the position and generate and check various synthesized images, and furthermore, based on the synthesized image, a still synthesized image, a cut-out synthesized image, etc. Since it is also possible to acquire, it is possible to further satisfy the user's taste and entertainment.

  Further, when the image for synthesis, the image to be synthesized, or the synthesized image is a moving image, the image synthesizing unit 103 of the image providing apparatus 100 or the like responds to the suspension request transmitted from the videophone device 200 and outputs the image for synthesis. A scene where the compositing target image or the composite image is paused, the pause is released in response to the reception of the pause release request transmitted from the videophone device 200, and the composite image or the compositing target image or the composite image is paused. From the first scene, an image to be synthesized or an image to be synthesized or a synthesized image to be reproduced from the first scene in response to the reception of a reproduction request transmitted from the videophone device 200, or a normal configuration transmitted from the videophone device 200. An image for synthesis or an image to be synthesized according to the reception of a playback request at a playback speed slower or faster than the playback speed of Or synthetic image can be properly employed a configuration for reproducing a predetermined slow or fast reproduction speed for storing and holding the. For example, the request is presented as a menu item or an icon on the composite image presentation screen so that it can be specified, and the request is transmitted to the image providing apparatus 100 by the input unit 204 in accordance with the specification of a predetermined menu item or the input unit. It is possible to adopt a configuration or the like that is transmitted to the image providing apparatus 100 in response to a predetermined input in 204.

  In a configuration in which reproduction is performed in accordance with the normal reproduction speed, the slow reproduction speed, or the high reproduction speed, the image synthesizing unit 103 or the like of the image providing apparatus 100 performs the reproduction speed of the synthesized image in which the synthesis image and the synthesis target image are integrated. May be changed in response to the reception of a predetermined playback request, and may be changed so as to change the relative playback speed between the image for synthesis and the image to be synthesized. 100, the image synthesizing unit 103 or the like displays a synthesized image presenting screen having a menu item or an icon of a reproduction request for reproducing the image for synthesis at a slower or faster reproduction speed than the normal reproduction speed, or a synthesis target image at a normal reproduction speed. Presents a composite image presenting screen having a menu item or an icon for a playback request to be played back at a slow or fast playback speed; In response to the reception of a playback request at a predetermined playback speed that is input and transmitted, while playing back the synthesis target image or the synthesis image at a normal playback speed, the synthesis image or the synthesis that has received the playback request at the predetermined playback speed. The target image is reproduced at a predetermined slow or fast reproduction speed for storing and holding, and the image to be synthesized or the image for synthesis at the normal reproduction speed is combined with the image for synthesis or the image to be synthesized at the predetermined low or fast reproduction speed. It is configured to generate and present an image. Further, for example, a composition image or a composition target image to be reproduced at a slow or fast reproduction speed by the videophone device 200 is designated by a pointer or a cursor by input from the input unit 204 or the like, and the designation information of the composition image or the composition target image is designated. And a reproduction request of a slow or fast reproduction speed is transmitted to the image providing apparatus 100, and the image synthesizing unit 103 or the like of the image providing apparatus 100 responds to the received specification information and the reception of the reproduction request at a predetermined slow or fast reproduction speed. It is also possible to adopt a configuration in which an image for synthesis of the designation information or an image to be synthesized is played back at a predetermined slow or fast playback speed for storing and holding.

  With the above configuration, for example, a synthesized image generated and presented by continuous transmission of an original image or a synthesis target image and a synthesis target image that is reflectively presented in substantially real time and a synthesis image that is reproduced at a slow or fast reproduction speed, and the like. Can be viewed by the user of the videophone device 200, so that the degree of freedom in adjusting the synthesized image, the image for synthesis and the image to be synthesized can be improved, and the taste and entertainment of the user can be further enhanced. it can. Note that the predetermined slow or fast playback speed can be set stepwise, for example, by changing the playback speed stepwise according to the number of inputs or the input time of the slow or fast playback request, etc. It is preferable that the control unit 201 and the like of the videophone device 200 can execute basically the same processing as the image synthesizing unit 103 and the like of the image providing device 100. Receiving the input of each request, and changing the reproduction speed of the composite image or the composite target image or the composite image generated in response to the reception, and compositing with the composite image or the composite target image with the changed reproduction speed. The configuration may be such that an image is generated and presented, or a composite image with a changed reproduction speed is generated and presented.

  In addition, the videophone device 200 or another user device or another predetermined device can upload and store a new composition image in the composition image database 106 that stores the composition image of the image providing apparatus 100. For example, the registration processing unit or the like of the image providing apparatus 100 may provide a menu item for specifying the predetermined image data for synthesis in the memory 202 or a predetermined An upload screen having a designation field for holding a file name of image data and the like and an upload request is presented. On the other hand, predetermined image data for synthesis in the memory 202 to be uploaded by the video telephone 200 is designated. When the upload request and the designated image data for synthesis are transmitted from the , Depending on the upload request and reception of the specified synthetic image data received, a configuration for storing the combined images of the designated in a predetermined storage area of the synthesis image database 106. In addition, for example, the registration processing unit or the like of the image providing apparatus 100 receives the image for synthesis by an attached file or the like by e-mail from the video telephone device 200 or the like to be connected, extracts the image for synthesis from the e-mail, and May be configured to perform a predetermined process and store the synthesized image in a predetermined storage area of the synthesized image database 106.

  Further, when the distribution processing unit 104 or the registration processing unit or the like of the image providing apparatus 100 distributes or registers a predetermined composition image or the like, the identification information or the like of the composition image in the composition image database 106 or the like is used. When the image is stored in the user database 107 or the like as a history, and when the image for composition or the like is separately distributed or registered, the identification information of the image for composition or the like requested to be distributed or registered is stored in the image for composition in the history. If it is the same as the compositing image in the history of the compositing image or the like that has been distributed or registered, it is distributed or registered to the videophone device 200. May be sent and presented. Further, when the distribution processing unit 104 or the registration processing unit or the like of the image providing apparatus 100 distributes or registers a predetermined compositing image or the like, the identification information or the like of the compositing image in the compositing image database 106 or the like is used. The history image presentation request transmitted from the videophone device 200 is stored as a history in the user database 107 or the like, and the predetermined unit of the image providing apparatus 100 presents a predetermined screen having a menu item of the history image presentation request or the like. Receiving and accepting, recognizing identification information such as a composition image of a history to be stored according to the reception, extracting a composition image or the like corresponding to the identification information from the composition image database 106 or the like, and extracting the extracted composition. For example, a configuration may be adopted in which the image for use is transmitted to the videophone device 200 by being synthesized with a predetermined screen and presented.

  When the designation processing unit 102 or the like of the image providing apparatus 100 presents identification information capable of designating a composition image to be used in a composition image, for example, the category and content of the composition image of the identification information in the history are Approximate images for synthesis are extracted or extracted in descending order of similarity based on a predetermined similarity based on a predetermined score or correlation function to be set, and the identification information of the synthesis image is used as the specifiable identification information. The present invention may be configured to present the identification information of the synthesis image to be recommended from the user's past history and present the identification information, so that the synthesis image of the specifiable identification information is more suitable for the user's preference. Can be

  In addition, the predetermined unit of the image providing apparatus 100 presents a screen on which a user ID or the like of another user can be registered, for example, and the user of another user input and transmitted from the videophone device 200 of the user. Upon receiving the ID and the registration approval data, the user ID and the like of the other user are registered in advance in the user data such as the user database 107, and the registered other user receives distribution or registration. When the user wants to receive the synthesized image or the like of the history, the predetermined unit of the image providing apparatus 100 can input, for example, the user ID of another user who wants to receive the synthesized image or the like. It presents a screen, receives and accepts the user ID and the like of another user input and transmitted from the user's videophone device 200, and receives other user IDs registered in the user data such as the user database 107. User I of user The authentication is performed by collating the received user ID and the like of the other user with the received user ID, and when the authentication is performed, the identification information such as the image for synthesis of the history is recognized from the data of the other user such as the user database 107. It is also possible to adopt a configuration in which a composition image or the like corresponding to the identification information is extracted from the composition image database 106 or the like, and the extracted composition image or the like is transmitted to the videophone device 200 by being combined with a predetermined screen, and is presented. Often, the above configuration allows a user to easily recognize a composition image or the like distributed or registered by another user such as a registered friend.

  In the present invention, it is also possible to adopt a configuration or the like for distributing or registering a synthesized image to be presented. For example, in the first to fifth and seventh embodiments and the like, the predetermined unit of the image providing apparatus 100 generates Images are continuously stored in a predetermined storage unit and distributed to a user device or another user device in response to a distribution request or a registration request or automatically, or to a user device or another user device. The configuration is such that the composite image is registered in a predetermined storage unit or the like that stores the presentable image so that the composite image can be presented. It is assumed that billing is performed using the above-described predetermined billing configuration or the like. Alternatively, for example, in the sixth embodiment or the like, the predetermined unit of the image providing apparatus 100 directly delivers a synthesis image to be presented by generating a real-time composite image, and the predetermined unit of the user device such as the videophone device 200 In cooperation with a program or the like fetched from the image providing apparatus 100 or the like, a composition image generated by the distributed composition image is stored in a predetermined storage area. Alternatively, billing may be performed by the above-described predetermined billing structure, such as measuring communication time and multiplying by a unit time unit price. With this configuration, for example, the user can remotely obtain a composite image including the desired composite image and the desired composite target image, and when presenting or displaying the original image or the composite target image in real time, It is possible to freely adjust the target image or the like in real time, thereby enhancing the user's entertainment and satisfying the preference.

  In the above-described embodiment, for example, a case has been described in which the image providing apparatus 100 is connected to the remote videophone apparatus 200 via the communication line 300 and presents a composite image, distributes a composite image, and the like. For example, an image providing apparatus having appropriate short-range communication means such as infrared communication, wireless LAN, Bluetooth (registered trademark) is installed at an appropriate place such as a restaurant, a department store, a retail store, a game center, in a car or on a roadside, A configuration may be adopted in which an image providing device and a user device such as a mobile phone establish a short-distance communication path by connection by the short-distance communication means, and the image providing device or the like basically executes the same processing as described above. With such a configuration, it is possible to obtain substantially the same operation and effect as described above except for remote locations, and, for example, at an appropriate place such as a restaurant, a department store, a retail store, a game center, the inside of a car, or a roadside. Short-distance communication means that can greatly enhance the entertainment at the site, increase the customer incentive in places where customers come to the store, and can perform short-range communication simultaneously with a large number of user devices. In the case of an image providing apparatus having a personal computer, for example, a customer in a store or the like holding a user device such as a mobile phone having a short-range communication means can simultaneously receive services such as presentation of a composite image.

  In the case of a configuration in which the image providing apparatus and the user apparatus perform short-range communication, for example, the predetermined unit of the image providing apparatus receives the original image from the user apparatus in a continuous manner or the like and extracts and acquires the synthesis target image in a continuous manner or the like. , Or the image to be combined is received and obtained continuously from the user device or the like, or the original image is continuously captured or the like by the imaging unit of the image providing apparatus, and the image to be combined is extracted and obtained continuously or the image. The image to be combined is continuously captured by the imaging unit of the providing device and acquired, and the designation identification information of the combination image input from the combination image designation screen transmitted to the user device in the same manner as above is received, for example. Or by taking in the designated identification information of the composition image input from the input unit of the image providing device in accordance with the composition image designation screen displayed on the image display unit of the image providing device, or the like. Receiving the specified identification information of the image, extracting the compositing image corresponding to the specified identification information from the compositing image to be stored, and synthesizing the extracted or acquired image to be obtained in the continuous or the like in substantially real time or the like with the reception or imaging. A composite image is generated by synthesizing the image for use, and the generated composite image is transmitted to the user device continuously or the like, and the reception or imaging is presented in substantially real time or the like, or the generated composite image is abbreviated as the reception or imaging. The image is displayed on the image display unit of the image providing apparatus in real time or the like, and, if necessary, the image for synthesis, the image for still synthesis, Distribution or registration of outgoing / combining images, still combined images, cutout combined images, or combined images, and, if necessary, receipt of electronic money monetary information It is possible such as to charge an appropriate billing structure by prepayment or such as a fixed system by accounting billing structure such as described above by.

  In addition, the predetermined unit of the image providing apparatus detects a moving region from the original image by using an inter-frame difference or a background difference, and extracts the moving region as an image to be combined, or a preset template. It is possible to adopt a configuration in which a predetermined synthesis target image such as a user's image is recognized from the original image by comparing the original synthesis image, and the predetermined synthesis target image is tracked by setting an initial contour of the active contour model. is there. Furthermore, a predetermined unit of the image providing apparatus recognizes the specified synthesis target image from the original image, extracts the recognized synthesis target image, and generates a synthesized image with the synthesis image. A configuration in which a predetermined unit of the apparatus recognizes an entire composition image or a composition image which is a partial image specified from the images, extracts the recognized composition image, and generates a composition image with the composition target image. Alternatively, it is also possible to adopt a configuration having both of them. For example, a predetermined unit of the user device displays an original image or a composition image to be continuously received on an image display unit of a touch panel type or the like, and determines predetermined position information in the original image or the image in the composition image in response to input from the touch panel or the like. The predetermined position information is obtained, and the position information is transmitted to the image providing device, and the predetermined portion of the image providing device receives and receives the predetermined position information in the original image or the predetermined position information in the combining image. Recognize a moving area detected from the original image by a difference method or the like that includes the position information or detects a moving area corresponding to the position information, and extracts the moving area as an image to be synthesized, or is set in advance. Or a configuration for extracting an image for synthesis of a partial image corresponding to the position information, or a predetermined unit of the image providing apparatus continuously receives from the user apparatus or from the imaging unit. An original image that is continuously acquired by imaging, or a composition image that has been designated in the stored composition image is displayed on an image display unit of a touch panel type or the like, and the original image or the composition image is input in response to input from the touch panel or the like. It is possible to adopt a configuration in which predetermined positional information in the image is recognized, and a composition image to be composed or a partial image is extracted by a configuration similar to the above.

  The present invention can be used, for example, when providing an image to a user or the like of a videophone device.

FIG. 2 is a block diagram showing a basic configuration of an image providing device and a videophone device according to the first to fifth embodiments. 5 is a flowchart illustrating a flow of providing an image according to the first embodiment. 9 is a flowchart showing a flow of providing an image in a first modification of the first embodiment. 9 is a flowchart illustrating a flow of providing an image according to the second embodiment. 9 is a flowchart illustrating a flow of providing an image according to the third embodiment. 14 is a flowchart illustrating a flow of providing an image according to a fourth embodiment. 15 is a flowchart illustrating a flow of providing an image in the fifth embodiment. FIG. 16 is a block diagram showing a basic configuration of an image providing device and a videophone device according to a sixth embodiment. 15 is a flowchart illustrating a flow of providing an image in the sixth embodiment. FIG. 17 is a block diagram showing a basic configuration of an image providing device and a videophone device according to a seventh embodiment. 17 is a flowchart illustrating a flow of providing an image according to a seventh embodiment.

Explanation of reference numerals

100 Image providing devices 101, 111, 121 Authentication processing units 102, 112, 122 Designation processing units 103, 123 Image synthesis units 113 Image presentation units 104, 114, 124 Distribution processing units 105, 115, 125 Billing processing units 106, 116, 126 Image database 107 for composition 107, 117, 127 User database 200 Videophone device 201, 211, 221 Control unit 202, 212, 222 Memory 203, 213, 223 Image display unit 204, 214, 224 Input unit 205, 215, 225 Imaging unit 300 Communication line

Claims (3)

An image providing apparatus for displaying a composite image on a user device connected via an information transmission medium, the unit storing a composition image, a unit receiving designation of a composition image from the user device, and Means for extracting a compositing image corresponding to the designation, means for taking in a compositing target image of a moving image transmitted from the user device, translucent the compositing target image, and extracting the translucent composite target image Means for generating a composite image by superimposing and synthesizing the generated composite image, and transmitting and presenting the generated composite image to the user apparatus in substantially real time and transmitting and presenting the generated composite image to the user apparatus. An image providing device characterized by the above-mentioned. An image providing apparatus for displaying a composite image on a user device connected via an information transmission medium, comprising: a unit for storing a composite image; a unit for receiving designation of a composite image from the user device; Means for extracting a compositing image corresponding to the designation, means for taking in the original image of the moving image transmitted from the user device, means for extracting a compositing target image from the original image, and the composing target image Means for generating a synthesized image by superimposing a semi-transparent synthesis target image on the extracted synthesis image, and transmitting the original image from the user device and generating the synthesized image substantially in real time Providing means for transmitting to the user device and presenting the same to the user device. A means for receiving a distribution request for a composition image from a user device and a means for distributing a composition image corresponding to the distribution request, or a means for receiving a composition image registration request from the user device and a composition image corresponding to the registration request The image providing apparatus according to claim 1, further comprising a unit for registering the image.

Images