JP6417511B2 - Image generation system and image generation apparatus - Google Patents

Description

  The present invention relates to an image generation system and an image generation apparatus.

  2. Description of the Related Art Conventionally, a technique for synthesizing image data of a 3D image of a product downloaded in advance with image data of a room through image in real time is known (for example, Patent Document 1).

JP 2007-323516 A

  As described above, since the technique of Patent Document 1 handles image data of 3D images, there is a problem in that the calculation cost increases when the position or orientation of a product is changed.

  Therefore, an object of the present invention is to provide an image generation system and an image generation apparatus that can superimpose an image of an object on a captured image by a simple method.

In order to solve the above problems, the invention of claim 1 is an image generation system that generates a composite image based on a target image displayed on each display unit on a display medium, and each display unit has a background A sample image obtained by superimposing a corresponding target image on the image is displayed, and an image composition device and an image storage device are provided. The image composition device corresponds to each display unit on the display medium. A reading unit that reads identification information associated with a corresponding target image from a storage unit provided; a first communication unit that transmits and receives data to and from the image storage device; and A first acquisition unit that causes the image storage device to transmit the identification information, and that acquires data transmitted from the image storage device to the first communication unit in response to transmission of the identification information as first related data; Shooting the target space The data associated with the image, a second acquisition unit for acquiring a second associated data, which has a function as a display device, a touch panel unit that accepts an operation from the user, according to the operation from the touch panel, the second The first acquisition unit acquires the first related data, the second acquisition unit acquires the second related data, and the identification information on the captured image based on the first and second related data. A composite unit that generates the composite image in which the corresponding target images are superimposed, and the image storage device includes first image data corresponding to the target image of each display unit, and targets included in the target image Data transmission / reception is performed between the first storage unit storing the database that stores the first size information that is an index of the size of the object in association with the image synthesizer The second communication unit and the first image data and the first size information selected based on the identification information received by the second communication unit are extracted from the database as the first related data, and the first An extraction unit that transmits the first related data from the communication unit to the image synthesizer, wherein the second related data includes second image data corresponding to the captured image, and the target in the target space. Second size information serving as an index of the size of the object, and the second size information is such that a skeleton line of the object is drawn on the captured image displayed on the screen of the touch panel unit, and the skeleton line Is input as a dimension line, and the combining unit combines the second image data expanded and contracted based on the first and second size information and the first image data. To generate third image data corresponding to the composite image.

The invention of claim 2 is an image generation system for recombining each display unit of the first display medium based on a target image displayed on each display unit on the first display medium, The unit displays a sample image obtained by superimposing a corresponding target image on a background image, and includes an image synthesis device and an image storage device, and the image synthesis device is provided on the first display medium. A reading unit that reads identification information associated with the first display medium from the storage unit, a first communication unit that transmits and receives data to and from the image storage device, and the first communication unit A first acquisition unit that causes the image storage device to transmit the identification information, and that acquires data transmitted from the image storage device to the first communication unit in response to transmission of the identification information as first related data; Related to the captured image of the target space The chromatography data, a second acquisition unit for acquiring a second associated data, which has a function as a display device, a touch panel unit that accepts an operation from the user, according to the operation from the touch panel, the first obtaining section And a second display medium in which each of the display units is recombined based on the first and second related data. The image storage device includes a medium number for specifying the first display medium, first image data corresponding to the target image of each display unit, and the target image. Data transmission / reception between the first storage unit storing the database that stores the first size information as an index of the size of the object to be stored as one record and the image composition device The second communication unit to be executed and one or more records selected based on the identification information received by the second communication unit are extracted from the database as the first related data, and the second communication And an extraction unit that transmits the first related data to the image synthesizer, wherein the second related data includes second image data corresponding to the captured image, and a size of the object in the target space. Second size information serving as an index of the image, wherein the second size information is such that a skeleton line of the object is drawn on the captured image displayed on the screen of the touch panel unit, and the skeleton line has a dimension. The composition unit is expanded and contracted after expanding and contracting the second image data based on the first size information and the second size information corresponding to each display unit. The second image data and the first image data are combined to generate third image data to be a combined image of each display unit, and the third image data corresponding to each display unit. The second display medium data is generated by replacing the sample image of the display unit with the corresponding composite image.

According to a third aspect of the present invention, there is provided an image generation system for generating a composite image based on a target image including an object, comprising an image composition device and an image storage device, wherein the image composition device comprises the object From a storage unit attached to an object, a reading unit that reads identification information associated with the target image, a first communication unit that transmits and receives data to and from the image storage device, and a first communication unit A first acquisition unit that causes the image storage device to transmit the identification information, and that acquires data transmitted from the image storage device to the first communication unit in response to transmission of the identification information as first related data; , data associated with the captured image of the target space, a second acquisition unit for acquiring a second associated data, which has a function as a display device, a touch panel unit that accepts an operation from a user, Following the procedure of the serial touch panel unit, the first relevant data to the first obtaining unit, the second related data to the second acquisition unit, causes each acquisition, based on the first and second associated data A composite unit that generates the composite image obtained by superimposing the target image on the captured image, and the image storage device includes first image data corresponding to the target image and the target image A first storage unit that stores therein a database that associates and stores first size information that is an index of the size of the target object, and a second communication unit that performs transmission and reception of data between the image synthesis device and The first image data and the first size information selected based on the identification information received by the second communication unit are extracted from the database as the first related data. An extraction unit that transmits the first related data from the second communication unit to the image synthesizer, wherein the second related data includes second image data corresponding to the captured image, and in the target space. Second size information serving as an index of the size of the object, and the second size information is such that a skeleton line of the object is drawn on the captured image displayed on the screen of the touch panel unit, The skeleton line is input as a dimensional line, and the combining unit combines the second image data expanded and contracted based on the first and second size information and the first image data. By doing so, the third image data corresponding to the composite image is generated.

According to a fourth aspect of the present invention, in the image generation system according to any one of the first to third aspects, the target space can be imaged by an imaging unit of the image synthesis device, and the second The acquisition unit acquires the second image data captured by the imaging unit as an element of the second related data.

In addition, according to a fifth aspect of the present invention, in the image generation system according to any one of the first to third aspects, the image synthesizing apparatus further includes a second storage unit capable of storing the second image data. The second acquisition unit acquires the second image data stored in the second storage unit as an element of the second related data.

Further, the invention of claim 6 is an image generation device that generates a composite image based on a target image displayed on each display unit on a display medium, and each display unit corresponds to a background image. A sample image overlaid with the target image to be displayed is displayed, and the first image data corresponding to the target image of each display unit is associated with the first size information serving as an index of the size of the target object included in the target image A storage unit that stores a database to be stored, a reading unit that reads identification information associated with a corresponding target image from a storage unit provided corresponding to each display unit on the display medium, and the reading unit A first acquisition unit that acquires first image data and first size information extracted from the database based on the identification information read as described above as first related data, and is related to a captured image of the target space The chromatography data, a second acquisition unit for acquiring a second associated data, which has a function as a display device, a touch panel unit that accepts an operation from the user, according to the operation from the touch panel, the first obtaining section And the second acquisition unit to acquire the second related data, and the object corresponding to the identification information on the captured image based on the first and second related data A composition unit that generates the composite image obtained by superimposing the images, and the second related data is a second image data corresponding to the captured image and an index of the size of the object in the target space. and a second size information, the second size information, skeleton line of the object is drawn on the captured image displayed on the screen of the touch panel unit, said backbone By There is a dimension line is input, the combining unit, and the second image data that has been allowed to expand and contract based on the first and second size information, by combining the first image data The third image data corresponding to the composite image is generated.

Further, the invention of claim 7 is an image generation device for recombining each display unit of the first display medium based on a target image displayed on each display unit on the first display medium, wherein each display The unit displays a sample image obtained by superimposing a corresponding target image on a background image, a medium number for specifying the first display medium, and a first image corresponding to the target image of each display unit Provided on the first display medium is a storage unit for storing a database that stores data and first size information that is an index of the size of an object included in the target image in association with each other. A reading unit that reads identification information associated with the first display medium from the storage unit, and one or more records extracted from the database based on the identification information read by the reading unit, Data and A touch panel for accepting a first obtaining unit for obtaining the data associated with the captured image of the target space, a second acquisition unit for acquiring a second associated data, which has a function as a display device, an operation from the user Te And the first acquisition unit and the second acquisition unit acquire the second related data according to an operation from the touch panel unit and the first and second related data, respectively. And a combining unit that generates a second display medium in which each display unit is recombined based on the second image data, the second related data includes second image data corresponding to the captured image, and the target in the target space and a second size information indicative of the size of the object, the second size information, skeleton line of the object on the captured image displayed on the screen of the touch panel section drawing Is, by the backbone line is a dimension line is input, the combining unit, was stretch the second image data on the basis of the first size information and the second size information corresponding to the display unit The second image data that has been expanded and contracted and the first image data are combined to generate third image data that is a combined image of each display unit, and the second image data corresponding to each display unit. Three image data Therefore, the data of the 2nd display medium replaced with the corresponding synthesized image from the sample image of each display part is produced.

The invention according to claim 8 is an image generation device that generates a composite image based on a target image including a target object, wherein the first image data corresponding to the target image and the target image include the target image. Read the identification information associated with the target image from the storage unit that stores the database that stores the first size information that is an index of the size of the target object in association with each other, and the storage unit that is attached to the target object A first acquisition unit that acquires first image data and first size information extracted from the database based on the identification information read by the reading unit as first related data, and imaging of a target space the data associated with the image, a second acquisition unit for acquiring a second associated data, which has a function as a display device, a touch panel for accepting an operation from a user When, in accordance with an operation from the touch panel unit, the first relevant data to the first obtaining unit, the second related data to the second acquisition unit, causes each acquisition, the first and second associated data And a combining unit that generates the composite image obtained by superimposing the target image on the captured image, and the second related data includes second image data corresponding to the captured image, and the target space Second size information serving as an index of the size of the object in the image, and the second size information is obtained by drawing a skeleton line of the object on the captured image displayed on the screen of the touch panel unit. by backbone line is a dimension line is input, the combining unit, the said second image data that has been allowed to expand and contract based on the first and second size information, the first image data By combining, and generates the third image data corresponding to the composite image.

The invention according to claim 9 is the image generation apparatus according to any one of claims 6 to 8 , wherein the target space can be imaged by an imaging unit, and the second acquisition unit is The second image data captured by the imaging unit is acquired as an element of the second related data.

The invention according to claim 10 is the image generation apparatus according to any one of claims 6 to 8 , wherein the storage unit is capable of storing the second image data, and the second acquisition unit. Is characterized in that the second image data stored in the storage unit is acquired as an element of the second related data.

According to the invention of claim 1, claim 4 , claim 5, claim 9 , claim 9 and claim 10 , the object can be virtually arranged in the object space by a simple operation. it can. Therefore, it is possible to confirm the feeling of use of the object in the object space without preparing an actual object.

Further, according to the invention of claim 2 , claim 5, claim 7, claim 9, and claim 10 , the second display in which the sample image of each display unit is replaced with a corresponding composite image The medium can be generated by a simple operation. That is, the object included in each display unit can be virtually arranged in the object space. Therefore, it is possible to confirm the feeling of use of each object in the object space without preparing the actual object.

Moreover, according to the invention of Claims 3 to 5 and Claims 8 to 10 , the object can be virtually arranged in the object space by a simple operation. Therefore, the feeling of use of the target object in the target space can be confirmed without using the target object in the target space.

It is a figure which shows an example of a structure of the image generation system in the 1st and 3rd embodiment of this invention. It is a figure which shows an example of a structure of the image composition apparatus in the 1st and 3rd embodiment of this invention. It is a figure which shows an example of the structure of the catalog in the 1st to 4th embodiment of this invention. It is a figure which shows an example of a structure of the identification information in 1st, 2nd, 5th, and 6th Embodiment of this invention. It is a figure which shows an example of a structure of the image storage apparatus in the 1st and 5th embodiment of this invention. It is a figure which shows an example of the data structure of the 1st table in the 1st-6th embodiment of this invention. It is a flowchart for demonstrating the image generation procedure in the 1st and 5th embodiment of this invention. It is a figure which shows an example of the screen displayed on a touchscreen part in the 1st and 2nd embodiment of this invention. It is a figure which shows an example of the screen displayed on a touchscreen part in the 1st to 6th embodiment of this invention. It is a figure which shows an example of the screen displayed on a touchscreen part in the 1st to 6th embodiment of this invention. It is a figure which shows an example of the screen displayed on a touchscreen part in the 1st to 6th embodiment of this invention. It is a figure which shows an example of the screen displayed on a touchscreen part in the 1st and 6th embodiment of this invention. It is a figure which shows an example of a structure of the image generation apparatus in the 2nd Embodiment of this invention. It is a flowchart for demonstrating the image generation procedure in the 2nd and 6th embodiment of this invention. It is a figure which shows an example of a structure of the image storage apparatus in the 3rd Embodiment of this invention. It is a figure which shows an example of the data structure of the 2nd table in the 3rd and 4th embodiment of this invention. It is a figure which shows an example of the data structure of the virtual table comprised based on the 1st and 2nd table in the 3rd and 4th embodiment of this invention. It is a figure which shows an example of a structure of the identification information in the 3rd and 4th embodiment of this invention. It is a flowchart for demonstrating the image generation procedure in the 3rd Embodiment of this invention. It is a figure which shows an example of the cover of the 1st display medium in the 3rd and 4th embodiment of this invention. It is a figure which shows an example of the screen displayed on a touchscreen part in the 3rd and 4th embodiment of this invention. It is a figure which shows an example of the display part recombined in the 3rd and 4th embodiment of this invention. It is a figure which shows an example of a structure of the image generation apparatus in the 4th Embodiment of this invention. It is a flowchart for demonstrating the image generation procedure in the 4th Embodiment of this invention. It is a figure which shows an example of a structure of the image generation system in the 5th Embodiment of this invention. It is a figure which shows an example of a structure of the target object in the 5th and 6th embodiment of this invention. It is a figure which shows an example of a structure of the image synthesizing | combining apparatus in the 5th Embodiment of this invention. It is a figure which shows an example of a structure of the image generation apparatus in the 6th Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<1. First Embodiment>
<1.1. Configuration of image generation system>
FIG. 1 is a diagram illustrating an example of the configuration of the image generation system 100. Here, the image generation system 100 generates a composite image based on the target image displayed on each display unit 5 on the catalog 1. As shown in FIG. 1, the image generation system 100 mainly includes an image composition device 20 and an image storage device 40. The image composition device 20 and the image storage device 40 are connected to be communicable via the network 2.

  The image composition device 20 is a user terminal that instructs generation of a composite image. In the present embodiment, the image composition device 20 is configured by a mobile terminal such as a so-called smart phone or tablet terminal. The detailed configuration of the image composition device 20 will be described later.

  The image storage device 40 is a data server that stores image data used for generating a composite image, for example. In the present embodiment, the image storage device 40 is configured by an electronic computer such as a so-called personal computer or workstation. The detailed configuration of the image storage device 40 will be described later.

<1.2. Configuration of Image Synthesizer>
FIG. 2 is a diagram illustrating an example of the configuration of the image composition device 20. As shown in FIG. 2, the image composition device 20 mainly includes a CPU 21, a RAM 32, a ROM 33, a first communication unit 35, a touch panel unit 36, and an image input unit 37. The CPU 21, RAM 32, ROM 33, first communication unit 35, display processing unit 38, and input / output processing unit 39 are electrically connected via a bus 21a.

  The RAM 32 (second storage unit) is configured by a so-called volatile memory. In the second storage unit, data used in the calculation of the CPU 21 can be stored. The ROM 33 is configured by a so-called nonvolatile memory. The ROM 33 stores a program 33a, for example. As the RAM 32 and the ROM 33, a flash memory which is a readable / writable nonvolatile memory may be used.

  The CPU 21 executes operation control and data processing according to the program 33 a of the ROM 33. 2 is implemented by the CPU 21. The arithmetic functions corresponding to the blocks described in the CPU 21 in FIG. In addition, the calculation function corresponding to each block 22-24 is mentioned later.

  The first communication unit 35 transmits / receives data to / from the image storage device 40 (see FIG. 1) connected via the network 2 in accordance with a command from the CPU 21. For example, as shown in FIGS. 1 and 2, the first communication unit 35 can transmit the identification information ID <b> 1 to the image storage device 40. In addition, the first communication unit 35 can receive the first related data RD11 transmitted from the image storage device 40.

  The touch panel unit 36 has a function as a “display device” such as a liquid crystal display, and a function as a “touch panel” that can specify a position on the screen by touching the screen with a finger or a dedicated pen. ing. That is, the touch panel unit 36 functions as an operation unit that receives an operation from the user.

  FIG. 3 is a diagram illustrating an example of the configuration of the catalog 1. FIG. 4 is a diagram illustrating an example of the configuration of the identification information ID1. The image input unit 37 is configured as a so-called camera and is used for inputting image data.

  Here, the catalog 1 (display medium) of the present embodiment is a printed material (display medium) for placing a product. As shown in FIG. 3, the catalog 1 of the present embodiment is provided with a plurality of display units 5 (5a, 5b) for displaying products (objects). More specifically, in the present embodiment, a uniform (uniform) is adopted as an object displayed on each display unit 5. Each display unit 5 (5a, 5b) displays a sample image 10 in which an image 11 of a person wearing a corresponding uniform (hereinafter referred to as “target image”) 11 is superimposed on the background image 12. To do.

  Further, storage units 6 (6a, 6b) are provided adjacent to the respective display units 5 (5a, 5b). In the present embodiment, a two-dimensional barcode is adopted as the storage unit 6, and the storage unit 6 can be read by the image input unit 37.

  Each storage unit 6 (6a, 6b) stores identification information ID1 (see FIG. 4) including the object number TN. The object number TN is a code for uniquely specifying the object displayed on the display unit 5. Here, in the present embodiment, the same object number TN is assigned to the same type of object (for example, a product having the same model).

  As described above, the image input unit 37 can also be used as a reading unit that reads the identification information ID1 associated with the corresponding target image 11 from the storage unit 6 provided corresponding to each display unit 5 on the catalog 1. .

  The display processing unit 38 and the video controller are configured, and are electrically connected to the touch panel unit 36 through a signal line 38a. Therefore, when a drawing process is executed by the display processing unit 38, characters, graphics, and the like are displayed on the screen of the touch panel unit 36.

  The input / output processing unit 39 is used for data exchange between the image composition device 20 and an external device of the image composition device 20. As shown in FIG. 2, the input / output processing unit 39 is electrically connected to the touch panel unit 36 and the image input unit 37 through a signal line 39a. Thereby, the CPU 21 of the image composition device 20 can acquire position information designated by the user on the touch panel unit 36 and image data captured by the image input unit 37.

<1.3. Configuration of Image Storage Device>
FIG. 5 is a diagram illustrating an example of the configuration of the image storage device 40. FIG. 6 is a diagram illustrating an example of the data structure of the first table 61. As shown in FIG. 5, the image storage device 40 mainly includes a CPU 41, a large-capacity storage unit 51, a RAM 52, a ROM 53, a monitor 54, a second communication unit 55, and an input unit 56. ing. The CPU 41, the large-capacity storage unit 51, the RAM 52, the ROM 53, the second communication unit 55, the display processing unit 58, and the input / output processing unit 59 are electrically connected via the bus 41a.

  The large-capacity storage unit 51 is configured by an element having a larger storage capacity than the RAM 52, such as a silicon disk drive or a hard disk drive, and exchanges data with the RAM 52 as necessary.

  The RAM 52 (first storage unit) is configured by a so-called volatile memory. The RAM 52 can store data (for example, the database 60) used in the calculation of the CPU 41.

  Here, the database 60 has a first table 61 as shown in FIG. The first table 61 stores information on the target image 11 displayed on each display unit 5 of the catalog 1. As shown in FIG. 6, the first table 61 mainly has fields (columns) of “object number TN”, “first size information SD1”, and “first image data PD1”.

  In the “object number TN” field, codes (for example, alphanumeric characters and / or symbols) assigned to the respective target images 11 are stored. A “non-overlapping value” is stored in “object number TN” of each record (row). Accordingly, each record in the first table 61 is uniquely identified by the “object number TN”.

  In the “first image data PD1” field, a character string indicating the storage location of the first image data PD1 corresponding to each target image 11 is stored. For example, as shown in FIG. 6, the first image data PD1 of the target image 11 corresponding to the record with “target number TN” = “10091” is stored in “●●● / ● ○ ● .JPG”. ing. Here, the storage location of each of the first image data PD1 may be the large-capacity storage unit 51 and the RAM 52 provided in the image storage device 40, or on a device connected via the network 2. good.

  In the “first size information SD1” field, information serving as an index of the size of the target object included in each target image 11 is stored. Here, the height (unit: pixel) of the target image 11 may be adopted as the first size information SD1.

  Then, among the records in the first table 61, a record in which the value of the “object number TN” is equal to a specific value is selected, whereby the first image data PD1 and the first image data PD1 corresponding to the specific target image 11 are selected. One-size information SD1 is extracted from the first table 61. Thus, the database 60 stores the first image data PD1 corresponding to the target image 11 and the first size information SD1 in association with each other.

  The ROM 53 is configured by a so-called nonvolatile memory. In the ROM 53, for example, a program 53a is stored. As the RAM 52 and the ROM 53, a flash memory that is a readable / writable nonvolatile memory may be used.

  The CPU 41 executes operation control and data processing according to the program 53 a of the ROM 53. In addition, the calculation function corresponding to the block (indicated by reference numeral 42) described in the CPU 41 in FIG. The calculation function corresponding to the block 42 will be described later.

  The second communication unit 55 transmits / receives data to / from the image composition device 20 (see FIG. 1) connected via the network 2 in accordance with a command from the CPU 41. For example, as illustrated in FIGS. 1 and 5, the second communication unit 55 can transmit the first related data RD11 to the image composition device 20. Further, the second communication unit 55 can receive the identification information ID1 transmitted from the image composition device 20.

  The input unit 56 is an input device such as a keypad, a keyboard, or a mouse, for example. Thereby, in the image storage device 40, an input operation based on the display content of the monitor 54 can be executed.

  The monitor 54 is a display device configured by a so-called liquid crystal display, plasma display, or organic EL (Electro Luminescence) display, and displays characters, images, and the like on the screen.

  Similar to the display processing unit 38, the display processing unit 58 includes a video controller, and is electrically connected to the monitor 54 via a signal line 58a. Therefore, when the drawing processing is executed by the display processing unit 58, characters, graphics, and the like are displayed on the screen of the monitor 54.

  The input / output processing unit 59 is used for data exchange between the image storage device 40 and an external device of the image storage device 40. As shown in FIG. 5, the input / output processing unit 59 is electrically connected to the input unit 56 via a signal line 59a. Accordingly, the CPU 41 of the image storage device 40 can accept input information from the input unit 56 at an appropriate timing.

<1.4. Arithmetic functions realized by CPU>
Here, arithmetic functions realized by the CPU 21 of the image composition device 20 and the CPU 41 of the image storage device 40 will be described.

  The first acquisition unit 22 (see FIG. 2) of the image composition device 20 causes the first communication unit 35 to transmit the identification information ID1 to the image storage device 40. The first acquisition unit 22 acquires data transmitted from the image storage device 40 to the first communication unit 35 in response to transmission of the identification information ID1 as first related data RD11.

  The second acquisition unit 23 (see FIG. 2) of the image composition device 20 is used to acquire the second related data RD12. Here, the second related data RD12 includes data of a captured image obtained by capturing a place where the user uses the object (product) (hereinafter also referred to as “target space”), and data related to the captured image. As a specific example of the target space imaged in the captured image, an indoor space of a user's store can be cited.

  In the present embodiment, the second related data RD12 mainly has second image data PD2 and second size information SD2.

  The second image data PD2 is data corresponding to an image obtained by imaging the target space. The second size information SD2 is information serving as an index of the size of the target object (product) in the target space. In the present embodiment, the second size information SD2 is input by an input operation from the touch panel unit 36.

  The synthesizing unit 24 (see FIG. 2) of the image synthesizing device 20 receives the first related data RD11 in the first acquiring unit 22 and the second related data RD12 in the second acquiring unit 23 according to the operation from the touch panel unit 36 by the user. Are acquired respectively. The synthesizing unit 24 generates a synthesized image in which the target image 11 corresponding to the identification information ID1 is superimposed on the captured image based on the first and second related data RD11 and RD12.

  More specifically, the combining unit 24 expands and contracts the second image data PD2 based on the ratio RT of the pixel values of the first and second size information SD1 and SD2, and the expanded and contracted second image data PD2. The third image data PD3 corresponding to the synthesized image is generated by synthesizing the first image data PD1.

  Here, the expansion / contraction of the second image data PD2 changes the vertical size (height) and horizontal size (width) of the second image data PD2 based on the ratio RT of the second size information SD2 to the first size information SD1. It is executed by doing.

  The extraction unit 42 (see FIG. 5) of the image storage device 40 receives the identification information ID1 (more specifically, the object number TN included in the identification information ID1: see FIG. 4) by the second communication unit 55. Then, the first image data PD1 and the first size information SD1 selected based on the identification information ID1 are extracted from the database 60 as the first related data RD11 (see FIG. 6). Further, the extraction unit 42 causes the second communicator 55 to transmit the extracted first related data RD11 to the image composition device 20.

<1.5. Synthesis Image Generation Procedure in First Embodiment>
FIG. 7 is a flowchart for explaining the image generation procedure. Each of FIG. 8 to FIG. 12 is a diagram illustrating an example of a screen displayed on the touch panel unit 36. Here, a synthetic image generation procedure will be described with reference to FIGS.

  First, the identification information ID1 associated with the target image 11 is read from the storage unit 6 adjacent to the display unit 5 by the image input unit 37 of the image composition device 20 (S101). When the read identification information ID1 corresponds to the desired object, the process proceeds to step S102 by pressing the “Yes” command button 36b of the confirmation dialog 36a displayed on the touch panel unit 36 of FIG. Make it.

  Next, the target space is imaged by the image input unit 37 of the image composition device 20 (S102). That is, when a desired image is displayed on the touch panel unit 36, the button 36c drawn on the touch panel unit 36 of FIG. Thereby, the target space is imaged and the second image data PD2 is acquired.

  Thus, the target space can be imaged by the image input unit 37 of the image composition device 20, and the image input unit 37 also functions as an imaging unit for the captured image 16. The second acquisition unit 23 acquires the second image data PD2 captured by the image input unit 37 as an element of the second related data RD12.

  Subsequently, after the reading of the second image data PD2 by the image input unit 37 is completed, the second size information SD2 is input by an input operation from the touch panel unit 36 (S103).

  More specifically, as shown in FIG. 10, on the captured image displayed on the screen of the touch panel unit 36, a dimension line (skeleton line) 36d of the object extending in the height direction (vertical direction) is drawn. . If there is no problem with the drawn dimension line 36d, the process proceeds to step S104 by pressing the “Yes” command button 36f of the confirmation dialog 36e displayed on the touch panel unit 36.

  After the input of the second size information SD2 by the touch panel unit 36 is completed, the identification information ID1 input in step S101 is transmitted from the image composition device 20 to the image storage device 40 (S104).

  When the identification information ID1 is received by the image storage device 40, the extraction unit 42 of the image storage device 40 extracts a record that matches the object number TN included in the identification information ID1 from the first table 61. Subsequently, among the extracted records, the value of the “first size information SD1” field and the image data corresponding to the “first image data PD1” field are imaged as the first related data RD11 (see FIG. 6). The data is transmitted from the storage device 40 to the image composition device 20 (S105).

  Then, based on the second related data RD12 acquired in steps S102 and S103 and the first related data RD11 acquired in step S105, the target image 11 corresponding to the identification information ID1 is displayed on the captured image 16. The superimposed composite image 15 is generated (FIG. 12: S106).

<1.6. Advantages of Image Generation System of First Embodiment>
As described above, according to the image generation system 100 of the first embodiment, an object can be virtually placed in the target space (that is, the captured image 16) by a simple operation. Therefore, it is possible to confirm the feeling of use of the object in the object space without preparing an actual object.

<2. Second Embodiment>
Next, a second embodiment of the present invention will be described. The image synthesizing apparatus 20 according to the first embodiment and the image generating apparatus 200 according to the second embodiment are different except that the configurations of the corresponding first acquisition units 22 and 122 and RAMs 32 and 132 are different. It has the same configuration. Therefore, in the following, this difference will be mainly described.

  In addition, the same code | symbol is attached | subjected to the same component by the image composition apparatus 20 and the image generation apparatus 200, and the component to which this same code | symbol was attached | subjected has been demonstrated in 1st Embodiment. Therefore, description is abbreviate | omitted in this Embodiment.

<2.1. Configuration of Image Generation Device>
FIG. 13 is a diagram illustrating an example of the configuration of the image generation apparatus 200. Similar to the image composition device 20 of the first embodiment, the image generation device 200 is configured by a mobile terminal such as a so-called smartphone or tablet terminal.

  As illustrated in FIG. 13, the image generation apparatus 200 mainly includes a CPU 121, a RAM 132, a ROM 33, a first communication unit 35, a touch panel unit 36, and an image input unit 37. The CPU 121, the RAM 132, the ROM 33, the first communication unit 35, the display processing unit 38, and the input / output processing unit 39 are electrically connected via the bus 21a.

  The RAM 132 (storage unit) is configured by a so-called volatile memory. The RAM 132 can store data (for example, the database 60) used in the calculation of the CPU 121.

  The CPU 121 executes operation control and data processing according to the program 33 a of the ROM 33. In addition, the arithmetic functions corresponding to blocks (indicated by reference numerals 122, 23, and 24, respectively) described in the CPU 121 in FIG.

  When the identification information ID1 is read by the image input unit 37, the first acquisition unit 122 obtains the first image data PD1 and the first size information SD1 extracted from the database 60 based on the identification information ID1 as the first related data. Obtained as RD11.

<2.2. Synthetic Image Generation Procedure in Second Embodiment>
FIG. 14 is a flowchart for explaining an image generation procedure. Here, a procedure for generating a composite image will be described with reference to FIGS. 14 and 8 to 12.

  First, the identification information ID1 associated with the target image 11 is read from the storage unit 6 adjacent to the display unit 5 by the image input unit 37 of the image generation device 200 (S201). When the read identification information ID1 corresponds to the desired object, the process proceeds to step S202 by pressing the “Yes” command button 36b of the confirmation dialog 36a displayed on the touch panel unit 36 in FIG. Make it.

  Next, the target space is imaged by the image input unit 37 of the image generation device 200 (S202). That is, when a desired image is displayed on the touch panel unit 36, the button 36c drawn on the touch panel unit 36 of FIG. Thereby, the target space is imaged and the second image data PD2 is acquired.

  Subsequently, after the reading of the second image data PD2 by the image input unit 37 is completed, the second size information SD2 is input by an input operation from the touch panel unit 36 (S203).

  More specifically, as in the first embodiment, a dimension line (skeleton line) 36d of an object extending in the height direction (vertical direction) on the captured image displayed on the screen of the touch panel unit 36. Is drawn (see FIG. 10). If there is no problem with the drawn dimension line 36d, the process proceeds to step S204 by pressing the “Yes” command button 36f of the confirmation dialog 36e displayed on the touch panel unit 36.

  After the input of the second size information SD <b> 2 by the touch panel unit 36 is completed, the first acquisition unit 122 of the image generation device 200 stores a record that matches the object number TN included in the identification information ID <b> 1 from the first table 61. Extract.

  Subsequently, among the extracted records, the value of the “first size information SD1” field and the image data corresponding to the “first image data PD1” field are set as the first related data RD11 (see FIG. 6). (S204).

  Then, based on the second related data RD12 acquired in steps S202 and S203 and the first related data RD11 acquired in step S204, the target image 11 corresponding to the identification information ID1 is displayed on the captured image 16. The superimposed composite image 15 is generated (FIG. 12: S205).

<2.3. Advantages of Image Generating Device of Second Embodiment>
As described above, similarly to the image generation system 100 of the first embodiment, the image generation apparatus 200 of the second embodiment virtually removes an object from the target space (that is, a captured image) by a simple operation. 16). Therefore, it is possible to confirm the feeling of use of the object in the object space without preparing an actual object.

<3. Third Embodiment>
Next, a third embodiment of the present invention will be described. The image generation systems 100 and 300 of the first and third embodiments have the same configuration except that the configurations of the corresponding extraction units 42 and 242 and the RAMs 52 and 252 are different. Therefore, in the following, this difference will be mainly described.

  In addition, the same code | symbol is attached | subjected to the same component in the image generation systems 100 and 300, and the component to which this same code | symbol was attached | subjected has been demonstrated in 1st Embodiment. Therefore, description is abbreviate | omitted in this Embodiment.

<3.1. Configuration of Image Storage Device>
FIG. 1 is a diagram illustrating an example of the configuration of the image generation system 300. FIG. 3 is a diagram illustrating an example of the configuration of a catalog. FIG. 15 is a diagram illustrating an example of the configuration of the image storage device 240. FIG. 16 is a diagram illustrating an example of the data structure of the second table 262. FIG. 17 is a diagram illustrating an example of a data structure of the virtual table 263 configured based on the first and second tables 61 and 262. FIG. 18 is a diagram illustrating an example of the configuration of the identification information ID3.

  Here, the image generation system 300 re-synthesizes each display unit 5 of the catalog 201 based on the target image 11 (see FIG. 3) displayed on each display unit 5 on the catalog 201 (first display medium). . As shown in FIG. 1, the image generation system 300 mainly includes an image composition device 20 and an image storage device 240. The image composition device 20 and the image storage device 240 are connected via the network 2 so as to communicate with each other.

  Similar to the image storage device 40, the image storage device 240 is a data server that stores image data used to generate a composite image. As shown in FIG. 15, the image storage device 240 mainly includes a CPU 241, a large-capacity storage unit 51, a RAM 252, a ROM 53, a monitor 54, a second communication unit 55, and an input unit 56. Have. The CPU 241, the large capacity storage unit 51, the RAM 252, the ROM 53, the second communication unit 55, the display processing unit 58, and the input / output processing unit 59 are electrically connected via the bus 41a.

  The RAM 252 (first storage unit) is configured by a so-called volatile memory like the RAM 52. The RAM 252 can store data (for example, the database 260) used in the calculation of the CPU 241.

  Here, the database 260 includes a first table 61 and a second table 262, as shown in FIG. The second table 262 stores information indicating the correspondence between each catalog 1 and the target image 11. As shown in FIG. 16, the second table 262 mainly has fields of “medium number MN” and “object number TN”.

  In the “medium number MN” field, codes (for example, alphanumeric characters and / or symbols) assigned to each catalog 201 are stored. In the “object number TN” field, a value that matches the value stored in any of the “object number TN” in the first table 61 is stored.

  Therefore, by selecting one or a plurality of records in which the value of the “medium number MN” is equal to the specific value among the records of the second table 262, the “object number TN corresponding to the specific catalog 201” is selected. Is extracted.

  Then, by adding “first size information SD1” and “first image data PD1” corresponding to “object number TN” to each of one or a plurality of records selected from the second table 262, A virtual table 263 (see FIG. 17) is configured.

  Thus, the database 260 can be regarded as a database that can store the medium number MN, the first image data PD1, and the first size information SD1 as one record in association with each other.

  Similar to the CPU 41, the CPU 241 executes operation control and data processing according to the program 53a of the ROM 53. In addition, the calculation function corresponding to the blocks (indicated by reference numeral 242) described in the CPU 241 in FIG.

  The extraction unit 242 transmits the first related data RD31 extracted based on the identification information ID3 (see FIG. 18) to the image composition device 20. That is, the extraction unit 242 identifies the value of “medium number MN” in each record of the second table 262 based on the identification information ID3 (more specifically, the medium number MN included in the identification information ID3). Select one that is equal to information ID3.

  Subsequently, the extraction unit 242 generates a virtual table 263 in which “first size information SD1” and “first image data PD1” corresponding to “object number TN” are added to each selected record (FIG. 5). 17).

  Then, the extraction unit 242 causes the second communicator 55 to transmit each record (that is, one or a plurality of records) of the virtual table 263 as the first related data RD31 extracted from the database 260 to the image composition device 20.

<3.2. Generation Procedure of Composite Image in Third Embodiment>
FIG. 19 is a flowchart for explaining an image generation procedure. FIG. 20 is a diagram illustrating an example of a cover 201 b of the catalog 201. FIG. 21 is a diagram illustrating an example of a screen displayed on the touch panel unit 36. FIG. 22 is a diagram illustrating an example of the recombined display unit 5. Here, the recombination procedure of each display unit will be described with reference to FIGS. 19 to 22 and FIGS. 9 to 11.

  Here, the catalog 201 (first display medium) of the present embodiment is a printed matter for placing a product, as with the catalog 1 of the first embodiment. As shown in FIG. 3, the paper surface 1a of the catalog 201 is provided with a plurality of display units 5 (5a, 5b) for displaying products (objects).

  Further, the cover 201b of the catalog 201 is provided with a storage unit 206 for specifying the catalog 201. In the present embodiment, a two-dimensional barcode is adopted as the storage unit 206, and the storage unit 206 can be read by the image input unit 37.

  The storage unit 206 stores identification information ID3 (see FIG. 18) including the medium number MN. The medium number MN is a code for uniquely identifying each catalog 201. Here, in the present embodiment, the same medium number MN is assigned to the same type of catalog (for example, the catalog having the same revision number).

  First, the image input unit 37 of the image synthesizing apparatus 20 reads the identification information ID3 associated with the catalog 201 from the storage unit 206 provided on the cover 201b of the catalog 201 (S301). When the read identification information ID3 corresponds to the desired catalog 201, the process proceeds to step S302 by pressing the “Yes” command button 36h of the confirmation dialog 36g displayed on the touch panel unit 36 of FIG. Make it.

  Next, the target space is imaged by the image input unit 37 of the image composition device 20 (S302). That is, when a desired image is displayed on the touch panel unit 36, the button 36c drawn on the touch panel unit 36 of FIG. Thereby, the target space is imaged and the second image data PD2 is acquired.

  Subsequently, after the reading of the second image data PD2 by the image input unit 37 is completed, the second size information SD2 is input by an input operation from the touch panel unit 36 (S303).

  More specifically, as in the first embodiment, a dimension line (skeleton line) 36d of an object extending in the height direction (vertical direction) on the captured image displayed on the screen of the touch panel unit 36. Is drawn (see FIG. 10). If there is no problem with the drawn dimension line 36d, the process proceeds to step S304 by pressing the “Yes” command button 36f of the confirmation dialog 36e displayed on the touch panel unit 36.

  After the input of the second size information SD2 by the touch panel unit 36 is completed, the identification information ID3 input in step S301 is transmitted from the image composition device 20 to the image storage device 240 (S304).

  When the identification information ID3 is received by the image storage device 240, the extraction unit 42 of the image storage device 240 generates a virtual table 263 based on the identification information ID3. Further, the extraction unit 242 transmits one or more records included in the virtual table 263 as the first related data RD31 (see FIG. 17) from the image storage device 240 to the image composition device 20 (S305).

  Then, based on the second related data RD12 acquired in steps S302 and S303 and the first related data RD31 acquired in step S305, the catalog 202 (second display medium) in which each display unit 5 is recombined. ) Is generated (FIG. 22: S306).

  Specifically, the composition unit 24 of the image composition device 20 expands and contracts the second image data PD2 based on the first size information SD1 and the second size information SD2 corresponding to each display unit 5. Next, the synthesizing unit 24 synthesizes the second image data PD2 that has been expanded and contracted with the first image data PD1, thereby generating third image data PD3 that is a synthesized image of each display unit 5.

  Subsequently, the synthesis unit 24 replaces the sample image 10 of each display unit 5 with the corresponding composite image 15 in accordance with the third image data PD3 corresponding to each display unit 5. As a result, a catalog 202 is created by recombining the display sections 5 on the paper surface 202a (FIG. 22).

<3.3. Advantages of Image Generation System of Third Embodiment>
As described above, the image generation system 300 according to the third embodiment generates the catalog 202 (second display medium) in which the sample image 10 of each display unit 5 is replaced with the corresponding composite image 15 by a simple operation. can do. That is, the objects included in each display unit 5 can be virtually arranged in the target space (that is, the captured image 16). Therefore, it is possible to confirm the feeling of use of each object in the object space without preparing the actual object.

<4. Fourth Embodiment>
Next, a fourth embodiment of the present invention will be described. Except that the image synthesizing apparatus 20 according to the third embodiment and the image generating apparatus 400 according to the fourth embodiment have different configurations of the corresponding first acquisition units 22 and 322 and RAMs 32 and 332, It has the same configuration. Therefore, in the following, this difference will be mainly described.

  It should be noted that the same constituent elements in the image synthesizing apparatus 20 and the image generating apparatus 400 are denoted by the same reference numerals, and the constituent elements having the same reference numerals have been described in the first and third embodiments. It is. Therefore, description is abbreviate | omitted in this Embodiment.

<4.1. Configuration of Image Generation Device>
FIG. 23 is a diagram illustrating an example of the configuration of the image generation apparatus 400. Similar to the image composition device 20 of the first embodiment, the image generation device 200 is configured by a mobile terminal such as a so-called smartphone or tablet terminal.

  As illustrated in FIG. 23, the image generation apparatus 400 mainly includes a CPU 321, a RAM 332, a ROM 33, a first communication unit 35, a touch panel unit 36, and an image input unit 37. Further, the CPU 321, the RAM 332, the ROM 33, the first communication unit 35, the display processing unit 38, and the input / output processing unit 39 are electrically connected via the bus 21a.

  The RAM 332 (storage unit) is configured by a so-called volatile memory. The RAM 332 can store data (for example, the database 260) used in the calculation of the CPU 321.

  The CPU 321 executes operation control and data processing according to the program 33 a of the ROM 33. In addition, arithmetic functions corresponding to blocks (indicated by reference numerals 322, 23, and 24, respectively) described in the CPU 321 in FIG.

  The first acquisition unit 322 acquires the first related data RD31 extracted based on the identification information ID3 (see FIG. 18). That is, the first acquisition unit 322 determines the value of “medium number MN” among the records of the second table 262 based on the identification information ID3 (more specifically, the medium number MN included in the identification information ID3). Is selected to be equal to the identification information ID3.

  Subsequently, the first acquisition unit 322 generates a virtual table 263 in which “first size information SD1” and “first image data PD1” corresponding to “object number TN” are added to each selected record. (See FIG. 17).

  Then, the first acquisition unit 322 acquires each record (that is, one or a plurality of records) of the virtual table 263 as the first related data RD31 extracted from the database 260.

<4.2. Synthetic Image Generation Procedure in Fourth Embodiment>
FIG. 24 is a flowchart for explaining the image generation procedure. Here, the recombination procedure of each display unit will be described with reference to FIGS. 24, 9 to 11, and 21.

  First, the image input unit 37 of the image generation apparatus 400 reads the identification information ID3 associated with the catalog 201 from the storage unit 206 provided on the cover 201b of the catalog 201 (S401). When the read identification information ID3 corresponds to the desired catalog 201, the process proceeds to step S402 by pressing the “Yes” command button 36h of the confirmation dialog 36g displayed on the touch panel unit 36 of FIG. Make it.

  Next, the target space is imaged by the image input unit 37 of the image generating apparatus 400 (S402). That is, when a desired image is displayed on the touch panel unit 36, the button 36c drawn on the touch panel unit 36 of FIG. Thereby, the target space is imaged and the second image data PD2 is acquired.

  Subsequently, after the reading of the second image data PD2 by the image input unit 37 is completed, the second size information SD2 is input by an input operation from the touch panel unit 36 (S403).

  More specifically, as in the first embodiment, a dimension line (skeleton line) 36d of an object extending in the height direction (vertical direction) on the captured image displayed on the screen of the touch panel unit 36. Is drawn (see FIG. 10). If there is no problem with the drawn dimension line 36d, the process proceeds to step S404 by pressing the “Yes” command button 36f of the confirmation dialog 36e displayed on the touch panel unit 36.

  After the input of the second size information SD2 by the touch panel unit 36 is completed, the first acquisition unit 322 of the image generation device 400 generates the virtual table 263 based on the identification information ID3. The first acquisition unit 322 acquires one or more records included in the virtual table 263 as the first related data RD31 (see FIG. 17) (S404).

  Then, based on the second related data RD12 acquired in steps S402 and S403 and the first related data RD31 acquired in step S404, the catalog 202 (second display medium) in which each display unit 5 is recombined. ) Is generated (FIG. 22: S405).

  Specifically, the composition unit 24 of the image composition device 20 expands and contracts the second image data PD2 based on the first size information SD1 and the second size information SD2 corresponding to each display unit 5. Next, the synthesizing unit 24 synthesizes the second image data PD2 that has been expanded and contracted with the first image data PD1, thereby generating third image data PD3 that is a synthesized image of each display unit 5.

  Subsequently, the synthesis unit 24 replaces the sample image 10 of each display unit 5 with the corresponding composite image 15 in accordance with the third image data PD3 corresponding to each display unit 5. As a result, a catalog 202 is created by recombining the display sections 5 on the paper surface 202a (FIG. 22).

<4.3. Advantages of Image Generation System of Fourth Embodiment>
As described above, the image generation apparatus 400 according to the fourth embodiment replaces the sample image 10 of each display unit 5 with the corresponding composite image 15 in the same manner as the image generation system 300 according to the third embodiment. The catalog 202 (second display medium) can be generated by a simple operation. That is, the objects included in each display unit 5 can be virtually arranged in the target space (that is, the captured image 16). Therefore, it is possible to confirm the feeling of use of each object in the object space without preparing the actual object.

<5. Fifth embodiment>
Next, a fifth embodiment of the present invention will be described. The image generation systems 100 and 500 of the first and fifth embodiments have the same configuration except that the configurations of the storage units 6 and 406 to be read are different. Therefore, in the following, this difference will be mainly described.

  In addition, the same code | symbol is attached | subjected to the same component in the image generation systems 100 and 500, and the component to which this same code | symbol was attached | subjected has been demonstrated in 1st Embodiment. Therefore, description is abbreviate | omitted in this Embodiment.

<5.1. Configuration of Image Synthesizer>
FIG. 25 is a diagram illustrating an example of the configuration of the image generation system 500. FIG. 26 is a diagram illustrating an example of the configuration of an object. FIG. 27 is a diagram illustrating an example of the configuration of the image composition device 420. Here, the image generation system 500 generates a composite image based on a target image of a target prepared in advance. As shown in FIG. 25, the image generation system 500 mainly includes an image composition device 420 and an image storage device 40. Further, the image composition device 420 and the image storage device 40 are connected to be communicable via the network 2.

  Here, the target object 401 of the present embodiment is, for example, a product itself that is a target of a transaction. More specifically, a uniform (uniform) is adopted as the object 401 in the present embodiment. Further, the first table 61 stored in the image storage device 40 stores information related to the image of the person wearing the uniform (that is, the target image 11 of the first embodiment).

  As shown in FIG. 26, the object 401 is provided with a storage unit 406 of an electronic storage medium such as RFID (Radio Frequency IDentification). In the storage unit 40, identification information ID1 is stored in the same manner as the storage unit 6 of the first embodiment.

  The image composition device 420 is a user terminal that instructs generation of a composite image, similarly to the image composition device 20 of the first embodiment. As shown in FIG. 27, the image composition device 420 mainly includes a CPU 21, a RAM 32, a ROM 33, a first communication unit 35, a touch panel unit 36, an image input unit 37, and a reading unit 437. ing. The CPU 21, RAM 32, ROM 33, first communication unit 35, display processing unit 38, and input / output processing unit 39 are electrically connected via a bus 21a.

  The reading unit 437 reads the identification information ID1 associated with the target image 11 from the storage unit 406 attached to the target object 401. In this embodiment, an RFID reader or an RFID reader / writer may be employed as the reading unit 437.

  In the present embodiment, as in the first embodiment, the first related data RD11 extracted by the image storage device 40 based on the identification information ID1 and the second related data acquired by the image composition device 420 are used. Based on the data RD12, a composite image 15 in which the target image 11 is superimposed on the captured image 16 is generated (see FIGS. 8 to 12).

<5.2. Advantages of Image Generation System of Fifth Embodiment>
As described above, according to the image generation system 500 of the fifth embodiment, similar to the image generation system 100 of the first embodiment, the object is virtually moved to the target space (that is, by a simple operation). The captured image 16) can be arranged. Therefore, the feeling of use of the target object in the target space can be confirmed without using the target object in the target space.

<6. Sixth Embodiment>
Next, a sixth embodiment of the present invention will be described. The image generation apparatuses 200 and 600 of the second and sixth embodiments have the same configuration except that the configurations of the storage units 6 and 406 to be read are different. Therefore, in the following, this difference will be mainly described.

  In addition, the same code | symbol is attached | subjected to the same component in the image generation apparatuses 200 and 600, and the component to which this same code | symbol was attached | subjected is demonstrated in 1st, 2nd, and 5th embodiment. It is done. Therefore, description is abbreviate | omitted in this Embodiment.

<6.1. Configuration of Image Generation Device>
FIG. 28 is a diagram illustrating an example of the configuration of the image generation apparatus 600. FIG. 26 is a diagram illustrating an example of the configuration of an object. FIG. 27 is a diagram illustrating an example of the configuration of the image composition device 420. Here, similarly to the image generation system 500 of the fifth embodiment, the image generation apparatus 600 generates a composite image based on a target image of a target prepared in advance. The image generation device 600 is configured by a portable terminal such as a so-called smartphone or tablet terminal, as with the image composition device 20 of the first embodiment.

  As shown in FIG. 28, the image generation apparatus 600 mainly includes a CPU 121, a RAM 132, a ROM 33, a first communication unit 35, a touch panel unit 36, an image input unit 37, and a reading unit 437. ing. The CPU 121, the RAM 132, the ROM 33, the first communication unit 35, the display processing unit 38, and the input / output processing unit 39 are electrically connected via the bus 21a.

  In the present embodiment, as in the second embodiment, the first related data RD11 extracted based on the identification information ID1, the second data acquired via the touch panel unit 36 and the image input unit 37 are used. Based on the related data RD12, a composite image 15 is generated by superimposing the target image 11 on the captured image 16 (see FIGS. 8 to 12).

<6.2. Advantages of Image Generation System of Sixth Embodiment>
As described above, according to the image generation apparatus 600 of the sixth embodiment, as in the image generation system 500 of the fifth embodiment, the object is virtually moved to the target space (that is, by a simple operation). The captured image 16) can be arranged. Therefore, the feeling of use of the target object in the target space can be confirmed without using the target object in the target space.

<7. Modification>
Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications can be made.

  (1) In the first to fourth embodiments, the storage units 6 and 206 have been described as being configured by two-dimensional barcodes, but the present invention is not limited to this. For example, as the storage units 6 and 206, a one-dimensional barcode may be employed, or an electronic storage medium such as an RFID may be employed. Note that when RFID is employed, it is necessary to separately provide an RFID reader, an RFID reader / writer, or the like as a reading unit.

  (2) In the fifth and sixth embodiments, the storage unit 406 is described as being configured by an electronic storage medium such as RFID, but the present invention is not limited to this. For example, a one-dimensional or two-dimensional barcode may be employed as the storage unit 406. In this case, reading of the storage unit 406 is executed by the image input unit 37.

  (3) In the first to fourth embodiments, the catalog 1 has been described as a printed material, but the present invention is not limited to this. For example, the catalog 1 may be displayed by an electromagnetic method on a personal computer monitor or a so-called smartphone touch panel. That is, the catalog 1 is sufficient if it is a display medium that can display an object.

  (4) In the first to sixth embodiments, the second size information SD2 has been described as being input by an input operation from the touch panel unit 36. However, the present invention is not limited to this. For example, as the second size information SD2, information set in advance before reading the identification information ID1 and ID3 may be used.

  For example, “the size of the touch panel unit 36 in the vertical direction of the screen” × “0.9” (unit: pixel) may be adopted as the value of the second size information SD2 set in advance. Further, when the preset value of the second size information SD2 is used, the target image 11 is displayed on the screen of the touch panel unit 36 so that the center position of the target image 11 matches the screen center of the touch panel unit 36. It may be arranged.

  (5) In the first to sixth embodiments, the second image data PD2 has been described as being imaged during the synthesis process, but the present invention is not limited to this.

The second image data PD2 is stored in advance in a storage unit (second storage unit) such as the RAM 32, 52, 132, 252, 332, or the large-capacity storage unit 51, and is stored in advance during the execution of the synthesis process. The second image data PD2 may be acquired as an element of the second related data RD12.

  In this case, the second size information SD2 may be (A) stored in the storage unit along with the second image data PD2, or (B) the second image data PD2 stored in advance in the touch panel unit 36. It may be input by an input operation from the touch panel unit 36 after being displayed.

  (6) In the first, third, and fifth embodiments, the identification information ID1 and ID3 are stored in the image synthesizing apparatus 20 after the input of the second size information SD2 by the touch panel unit 36 is completed. Although described as what is transmitted to the apparatuses 40 and 240, the transmission timing of the identification information ID1 and ID3 is not limited to this. The transmission of the identification information ID1 and ID3 may be executed at an arbitrary timing between the reading time of the identification information ID1 and ID3 and the input time of the second size information SD2 by the touch panel unit 36.

  (7) Furthermore, in the first to sixth embodiments, the imaging of the target space has been described as being performed by a mobile terminal such as a smartphone or a tablet terminal, but is not limited thereto. It may be executed by an electronic computer such as a personal computer or a workstation.

1, 201, 202 Catalog (display medium, first display medium, second display medium)
5 (5a, 5b), 205 (205a, 205b) Display unit 6, 206, 406 Storage unit 10 Sample image 11 Target image 12 Background image 15 Composite image 16 Captured image 20, 420 Image composition device 22, 122, 322 First Acquisition unit 23 Second acquisition unit 24 Combining unit 32, 52, 132, 252, 332 RAM
35 First communication unit 36 Touch panel unit (operation unit)
37 Image input unit 40, 240 Image storage device 42, 242 Extraction unit 55 Second communication unit 60, 260 Database 61, 262 First and second tables 100, 300, 500 Image generation system 200, 400, 600 Image generation device 263 Virtual table 401 Object 437 Reading unit ID1, ID3 Identification information MN Medium number PD1-PD3 First to third image data RD11, RD31 First related data RD12 Second related data SD1, SD2 First and second size information TN Target Item number

Claims (10)

An image generation system that generates a composite image based on a target image displayed on each display unit on a display medium,
Each display unit displays a sample image in which a corresponding target image is superimposed on a background image,
(a) an image composition device;
(b) an image storage device;
With
The image composition device includes:
(a-1) a reading unit that reads identification information associated with a corresponding target image from a storage unit provided corresponding to each display unit on the display medium;
(a-2) a first communication unit that transmits and receives data to and from the image storage device;
(a-3) The identification information is transmitted from the first communication unit to the image storage device, and data transmitted from the image storage device to the first communication unit in response to transmission of the identification information is 1st acquisition part acquired as 1 related data,
(a-4) a second acquisition unit that acquires data related to the captured image of the target space as second related data;
(a-5) A touch panel unit having a function as a display device and receiving an operation from a user;
(a-6) According to an operation from the touch panel unit, the first acquisition unit acquires the first related data, the second acquisition unit acquires the second related data, and the first and second A combining unit that generates the combined image obtained by superimposing the target image corresponding to the identification information on the captured image based on related data;
Have
The image storage device includes:
(b-1) A database that stores first image data corresponding to the target image of each display unit and first size information that is an index of the size of the target object included in the target image in association with each other is stored. A first storage unit;
(b-2) a second communication unit that transmits and receives data to and from the image composition device;
(b-3) First image data and first size information selected based on the identification information received by the second communication unit are extracted from the database as the first related data, and the second An extraction unit that causes the communication unit to transmit the first related data to the image composition device;
Have
The second related data is
Second image data corresponding to the captured image;
Second size information serving as an index of the size of the object in the target space;
Have
The second size information is input by drawing a skeleton line of the object on the captured image displayed on the screen of the touch panel unit, and making the skeleton line a dimension line,
The synthesizing unit synthesizes the second image data expanded and contracted based on the first and second size information and the first image data to thereby generate third image data corresponding to the synthesized image. Generating an image composition system. An image generation system that re-synthesizes each display unit of the first display medium based on a target image displayed on each display unit on the first display medium,
Each display unit displays a sample image in which a corresponding target image is superimposed on a background image,
(a) an image composition device;
(b) an image storage device;
With
The image composition device includes:
(a-1) a reading unit that reads identification information associated with the first display medium from a storage unit provided on the first display medium;
(a-2) a first communication unit that transmits and receives data to and from the image storage device;
(a-3) The identification information is transmitted from the first communication unit to the image storage device, and data transmitted from the image storage device to the first communication unit in response to transmission of the identification information is 1st acquisition part acquired as 1 related data,
(a-4) a second acquisition unit that acquires data related to the captured image of the target space as second related data;
(a-5) A touch panel unit having a function as a display device and receiving an operation from a user;
(a-6) According to an operation from the touch panel unit, the first acquisition unit acquires the first related data, the second acquisition unit acquires the second related data, and the first and second A combining unit that generates a second display medium in which each display unit is recombined based on related data;
Have
The image storage device includes:
(b-1) A medium number for specifying the first display medium, first image data corresponding to the target image of each display unit, and a first index serving as an index of the size of the target object included in the target image A first storage unit that stores a database that stores the size information in association with each other; and
(b-2) a second communication unit that transmits and receives data to and from the image composition device;
(b-3) One or more records selected based on the identification information received by the second communication unit are extracted from the database as the first related data, and from the second communication unit An extraction unit that causes the image composition device to transmit the first related data;
Have
The second related data is
Second image data corresponding to the captured image;
Second size information serving as an index of the size of the object in the target space;
Have
The second size information is input by drawing a skeleton line of the object on the captured image displayed on the screen of the touch panel unit, and making the skeleton line a dimension line,
The synthesis unit is
(i) The second image data expanded and contracted after the second image data is expanded and contracted based on the first size information and the second size information corresponding to each display unit, and the first image data And generating third image data to be a combined image of each display unit,
(ii) Third image data corresponding to each display unit. Accordingly, an image composition system is characterized in that data of a second display medium in which a sample image of each display unit is replaced with a corresponding composite image is created. An image generation system that generates a composite image based on a target image including an object,
(a) an image composition device;
(b) an image storage device;
With
The image composition device includes:
(a-1) a reading unit that reads identification information associated with the target image from a storage unit attached to the target;
(a-2) a first communication unit that transmits and receives data to and from the image storage device;
(a-3) The identification information is transmitted from the first communication unit to the image storage device, and data transmitted from the image storage device to the first communication unit in response to transmission of the identification information is 1st acquisition part acquired as 1 related data,
(a-4) a second acquisition unit that acquires data related to the captured image of the target space as second related data;
(a-5) A touch panel unit having a function as a display device and receiving an operation from a user;
(a-6) According to an operation from the touch panel unit, the first acquisition unit acquires the first related data, the second acquisition unit acquires the second related data, and the first and second A compositing unit that generates the composite image in which the target image is superimposed on the captured image based on related data;
Have
The image storage device includes:
(b-1) A first database that stores first image data corresponding to the target image and first size information that is an index of the size of the target object included in the target image in association with each other. A storage unit;
(b-2) a second communication unit that transmits and receives data to and from the image composition device;
(b-3) First image data and first size information selected based on the identification information received by the second communication unit are extracted from the database as the first related data, and the second An extraction unit that causes the communication unit to transmit the first related data to the image composition device;
Have
The second related data is
Second image data corresponding to the captured image;
Second size information serving as an index of the size of the object in the target space;
Have
The second size information is input by drawing a skeleton line of the object on the captured image displayed on the screen of the touch panel unit, and making the skeleton line a dimension line,
The synthesizing unit synthesizes the second image data expanded and contracted based on the first and second size information and the first image data to thereby generate third image data corresponding to the synthesized image. Generating an image composition system. The image generation system according to any one of claims 1 to 3,
The target space can be imaged by an imaging unit of the image synthesis device,
The second acquisition unit, an image generating system for the second image data captured by the imaging unit, characterized that you get as an element of the second associated data. The image generation system according to any one of claims 1 to 3,
The image composition device includes:
(a-7) a second storage unit capable of storing the second image data;
Further comprising
The second acquisition unit, an image generation system according to the said second image data stored in the second storage unit, characterized that you get as an element of the second associated data. An image generation device that generates a composite image based on a target image displayed on each display unit on a display medium ,
Each display unit displays a sample image in which a corresponding target image is superimposed on a background image,
(a) A storage unit that stores a database that associates and stores first image data corresponding to a target image of each display unit and first size information that is an index of the size of the target object included in the target image When,
(b) a reading unit that reads identification information associated with a corresponding target image from a storage unit provided corresponding to each display unit on the display medium;
(c) a first acquisition unit that acquires first image data and first size information extracted from the database based on the identification information read by the reading unit as first related data;
(d) a second acquisition unit that acquires data related to the captured image of the target space as second related data;
(e) a touch panel unit having a function as a display device and receiving an operation from a user;
(f) According to an operation from the touch panel unit, the first acquisition unit acquires the first related data, the second acquisition unit acquires the second related data, and the first and second related data. A composite unit that generates the composite image obtained by superimposing the target image corresponding to the identification information on the captured image based on
With
The second related data is
Second image data corresponding to the captured image;
Second size information serving as an index of the size of the object in the target space;
Have
The second size information is input by drawing a skeleton line of the object on the captured image displayed on the screen of the touch panel unit, and making the skeleton line a dimension line,
The synthesizing unit synthesizes the second image data expanded and contracted based on the first and second size information and the first image data to thereby generate third image data corresponding to the synthesized image. image generating apparatus and generating a. Based on the displayed object image on the display unit on the first display medium, an image generating apparatus for re-combining the display of the first display medium,
Each display unit displays a sample image in which a corresponding target image is superimposed on a background image,
(a) Medium number for specifying the first display medium, first image data corresponding to the target image of each display unit, and first size information that serves as an index of the size of the target object included in the target image And a storage unit for storing a database that stores them as one record in association with each other,
(b) a reading unit that reads identification information associated with the first display medium from a storage unit provided on the first display medium;
(c) a first acquisition unit that acquires, as first related data, one or more records extracted from the database based on the identification information read by the reading unit;
(d) a second acquisition unit that acquires data related to the captured image of the target space as second related data;
(e) a touch panel unit having a function as a display device and receiving an operation from a user;
(f) According to an operation from the touch panel unit, the first acquisition unit acquires the first related data, the second acquisition unit acquires the second related data, and the first and second related data. A combining unit for generating a second display medium in which each display unit is recombined based on:
With
The second related data is
Second image data corresponding to the captured image;
Second size information serving as an index of the size of the object in the target space;
Have
The second size information is input by drawing a skeleton line of the object on the captured image displayed on the screen of the touch panel unit, and making the skeleton line a dimension line,
The synthesis unit is
(i) The second image data expanded and contracted after the second image data is expanded and contracted based on the first size information and the second size information corresponding to each display unit, and the first image data And generating third image data to be a combined image of each display unit,
(ii) follow third image data corresponding to each display unit, an image generating apparatus according to claim, characterized in that to create the data of the second display medium was replaced by the corresponding composite image from a sample image of each display unit. An image generation device that generates a composite image based on a target image including a target object,
(a) a first image data corresponding to the target image, and the first size information indicative of the size of the object contained in the target image, a database that stores in association with, a storage unit for storing,
(b) from been stored portion attached to the object, a reading unit reads the identification information associated with the target image,
(c) a first acquisition unit that acquires first image data and first size information extracted from the database based on the identification information read by the reading unit as first related data;
(d) a second acquisition unit that acquires data related to the captured image of the target space as second related data;
(e) a touch panel unit having a function as a display device and receiving an operation from a user;
(f) According to an operation from the touch panel unit, the first acquisition unit acquires the first related data, the second acquisition unit acquires the second related data, and the first and second related data. a synthesizing portion for the composite image by superimposing the object image on the captured image generated based on,
With
The second related data is
Second image data corresponding to the captured image;
Second size information serving as an index of the size of the object in the target space;
Have
The second size information is input by drawing a skeleton line of the object on the captured image displayed on the screen of the touch panel unit, and making the skeleton line a dimension line,
The synthesizing unit synthesizes the second image data expanded and contracted based on the first and second size information and the first image data to thereby generate third image data corresponding to the synthesized image. An image generation apparatus characterized by generating Claims 6 Te image generating apparatus odor according to claim 8,
The target space can be imaged by an imaging unit,
The second acquisition unit acquires the second image data captured by the imaging unit as an element of the second related data . Claims 6 Te image generating apparatus odor according to claim 8,
The storage unit can store the second image data,
The second acquisition unit acquires the second image data stored in the storage unit as an element of the second related data .

Images