JP2022173968A - Image generation device - Google Patents

Abstract

To enable a virtual object superimposed on a base image to be designed depending on a user.SOLUTION: An image generation device 1 includes: a first user information obtaining unit 11 that obtains first user information on a first user who is a shop staff serving a customer; a second user information obtaining unit 12 that obtains second user information on a second user who is the customer receiving service by the first user; and an image obtaining unit 14 that obtains a virtual object J to be superimposed on a base image B for generating a superimposed image S. Upon a request given from the second user, the image obtaining unit 14 obtains a first virtual object J1 that is the virtual object J having a design decided on the basis of input information containing the first user information and the second user information.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to image generation devices.

For example, by displaying a superimposed image in which various virtual objects are superimposed on a base image such as a landscape on a display or the like, the user can visually recognize a virtual object that does not actually exist as if it were present on the base image. technology is known. AR (Augmented Reality) and VR (Virtual Reality) are exemplified as means for realizing such technology. Patent Literature 1 discloses a technology that enables virtual objects linked to two users to communicate with each other in a virtual space using VR.

Here, “AR” refers to a world in which reality is augmented by allowing the user to visually recognize an image (superimposed image) in which a virtual image (virtual object) is superimposed on an image representing the real space (base image). It is a means for users to experience. "VR" is means for allowing the user to experience a world in which the virtual space is recognized as if it were a real space by allowing the user to visually recognize an image representing a virtual space. In VR as well, there are cases where the user is allowed to visually recognize an image (superimposed image) in which another virtual image (virtual object) is superimposed on a base image (base image).

Japanese Patent Application Laid-Open No. 2021-2145

In the techniques described above, the design of the virtual object to be superimposed on the base image is generally determined in advance. On the other hand, there are cases where it is desired to change the design of the virtual object according to the user. For example, when there are two users, a store clerk and a customer who receives service or entertainment from the store clerk, by designing the virtual object according to the relationship between the two users, the relationship between the two users can be made special. It is conceivable to show that it is

Therefore, an image generating apparatus according to the present disclosure aims to design a virtual object superimposed on a base image according to the user.

An image generation device (1) according to an aspect of the present disclosure includes a first user information acquisition unit (11) that acquires first user information about a first user who is a salesclerk who serves or entertains customers; A second user information acquisition unit (12) for acquiring second user information about a second user who is a customer who receives service or entertainment from one user, and a superimposed image (S) is generated by superimposing it on a base image (B). and an image acquisition unit (14) for acquiring the virtual object (J) for the first user information and the second user information in response to a request from the second user. A first virtual object (J1), which is a virtual object (J) whose design is determined based on input information including information, is obtained.

According to this image generating device (1), a virtual object (J) for generating a superimposed image (S) by superimposing it on a base image (B) is obtained in response to a request from a second user. This superimposed image (S) is displayed, for example, on a display or the like so that the user can visually recognize the virtual object (J) that does not exist in reality as if it were present on the base image (B). Used for AR or VR. Here, according to the image generation device (1), for example, a virtual The design of object (J) is determined. Therefore, according to the image generation device (1), the virtual object (J) superimposed on the base image (B) can be designed according to the user.

In the image generation device (1) according to one aspect of the present disclosure, the base image (B) may be an image of a store where the first user serves or entertains the second user. According to this, it is possible to reproduce the act of decorating the store with a gift presented by the second user to the first user by AR or VR.

In the image generation device (1) according to one aspect of the present disclosure, the virtual object (J) may be an image of a flower stand. According to this, the act of giving a stand flower as a gift from the second user to the first user can be reproduced by AR or VR.

In the image generation device (1) according to one aspect of the present disclosure, the input information may include flower information regarding the characteristics of flowers included in the flower stand. According to this, the stand flower containing the flower which has the characteristic suitable for the 1st user and the 2nd user can be made into the gift from the 2nd user to the 1st user.

An image generation device (1) according to an aspect of the present disclosure is a first user terminal (T1) used by a first user and a second user terminal (T2) used by a second user. A communication history information acquisition unit (13) for acquiring communication history information relating to the history of executed communication may be provided, and the input information may include the communication history information. According to this, the virtual object (J) designed according to the past communication history between the first user and the second user can be given as a gift from the second user to the first user.

An image generation device (1) according to an aspect of the present disclosure, when an image acquisition unit (14) acquires a first virtual object (J1) triggered by a request from a second user, the second user A billing unit (15) may be provided for billing. According to this, the charge for the gift from the second user to the first user can be received from the second user.

In the image generation device (1) according to one aspect of the present disclosure, the input information may include amount information regarding the amount of money to be charged to the second user by the charging unit (15). According to this, the virtual object (J) designed according to the amount of money received from the second user can be given as a gift from the second user to the first user.

An image generation device (1) according to an aspect of the present disclosure may include an arrangement position setting section (17) that sets an arrangement position where a virtual object (J) is arranged in a superimposed image (S). According to this, it is possible to suitably set the position of the virtual object (J) on the base image (B).

In the image generation device (1) according to one aspect of the present disclosure, the image acquisition unit (14) uses the first virtual object (J1) and the virtual object (J) different from the first virtual object (J1). A certain second virtual object (J2) is acquired, and the placement position setting unit (17) determines the priority associated with the first virtual object (J1) with respect to the placement position where the first virtual object (J1) is placed. is acquired, and according to the acquired priority, either the first virtual object (J1) or the second virtual object (J2) is emphasized in the superimposed image (S) , the placement position may be set. According to this, the virtual object J can be appropriately emphasized and displayed according to the priority determined by various conditions.

In the image generation device (1) according to one aspect of the present disclosure, the base image (B) is imaged by the imaging devices (T11, T21) and image display devices (T12, T12, T21) provided side by side with the imaging devices (T11, T21). T22), and the image acquisition unit (14) outputs the virtual object (J) to the image display devices (T12, T22) to display the virtual object (J) in the base image (B). The superimposed image (S) may be displayed on the image display devices (T12, T22). According to this, the superimposed image (S) is displayed on the AR display or the like, so that the user can feel as if the virtual object (J) that does not exist in reality exists on the base image (B). AR for visual recognition is specifically realized.

An image generation device (1) according to an aspect of the present disclosure includes a marker setting unit that sets a marker (M) for use as a reference for an arrangement position in a base image (B) captured by an imaging device (T11, T21) (16) may be provided. According to this, by setting a marker (M) for setting an arrangement position where the virtual object (J) is arranged in AR, the virtual object (J) that does not exist in reality appears as if in the base image (B ) AR is specifically implemented to make the user see it as if it were on it.

In the image generation device (1A) according to one aspect of the present disclosure, the base image (B) is an image configured as a virtual image, and the image acquisition unit (14A) acquires the base image (B), acquires A superimposed image (S) is generated by superimposing the virtual object (J) on the generated base image (B), and the superimposed image ( S) may be displayed on the image display device (T12, T22). According to this, by displaying the superimposed image (S) on a VR display or the like, the user can feel as if the virtual object (J) that does not exist in reality exists on the base image (B). VR for visual recognition is specifically realized.

It should be noted that the reference numerals in parentheses above indicate the reference numerals of the constituent elements in the embodiment described later as an example of the present disclosure, and are not intended to limit the present disclosure to the aspect of the embodiment.

In this way, the image generation device according to the present disclosure can design the virtual object superimposed on the base image according to the user.

FIG. 1 is a block diagram showing an image generation device according to the first embodiment. FIG. 2 is a flowchart showing first image generation processing executed by the image generation device. FIG. 3 is a diagram showing an image of a login screen displayed on the image display device on the sender side. FIG. 4 is a diagram showing an image of a top page screen displayed on the image display device. FIG. 5 is a diagram showing an image of a birthday list screen displayed on the image display device. FIG. 6 is a diagram showing an image of a sender list screen displayed on the image display device. FIG. 7 is a diagram showing an image of a message input screen displayed on the image display device. FIG. 8 is a diagram showing an image of a virtual object selection screen displayed on the image display device. FIG. 9 is a diagram showing an image of a virtual object confirmation screen displayed on the image display device. FIG. 10 is a diagram showing an image of an arrangement position setting screen displayed on the image display device. FIG. 11 is a diagram showing an image of a gift transmission screen displayed on the image display device. FIG. 12 is a diagram showing an image of a transmission completion screen displayed on the image display device. FIG. 13 is a diagram showing an image of the My Page screen displayed on the image display device on the recipient side. FIG. 14 is a diagram showing an image of a message display screen displayed on the image display device. FIG. 15 is a diagram showing a superimposed image displayed on the image display device. FIG. 16 is a diagram showing an image of a management screen displayed on the image display device of the administrator. FIG. 17 is a block diagram showing an image generation device according to the second embodiment. FIG. 18 is a flowchart showing second image generation processing executed by the image generation device. FIG. 19 is a diagram showing an image of a management screen displayed on the image display device of the administrator.

Exemplary embodiments are described below with reference to the drawings. In addition, the same reference numerals are given to the same or corresponding parts in each figure, and overlapping explanations are omitted.

[First embodiment]
FIG. 1 is a block diagram showing an image generation device 1 according to the first embodiment. The image generation device 1 shown in FIG. 1 is a device that obtains a virtual object J for superimposing a superimposed image S on a base image B (see FIG. 15), and the generated superimposed image S is displayed on a display or the like. is displayed and viewed by the user. This allows the user to visually recognize the virtual object J, which does not actually exist, as if it were present on the base image B. FIG. In this embodiment, the base image B is based on, for example, a captured image of the user's field of view. That is, the image generation device 1 is a device that generates a virtual object J of a superimposed image S displayed on a display or the like in AR. Any technique can be applied as a specific method of AR.

Here, the “base image” is an image that serves as a background of the superimposed image S visually recognized by the user, and is, for example, a real space image (real space image) captured by a camera or the like. That is, the base image B is the background image in AR. The base image B is an image captured by the imaging devices T11 and T21 and displayed on the image display devices T12 and T22 (details will be described later). A “virtual object” is an image to be superimposed on the base image B to generate a superimposed image S. FIG. A virtual object J is, for example, a virtual image of an article that does not exist in reality. "Not actually existing" means that it does not exist at that location, and for example, a captured image of an article that actually exists at another location may be used as the virtual object J.

The image generation device 1 generates a superimposed image S that is visually recognized by at least one of a staff member and a customer in a restaurant where a staff member entertains a customer (so-called restaurant with entertainment). “Entertainment” means that a clerk entertains a customer by communicating with the customer, and may, for example, entertain the customer in a manner that creates a pleasant atmosphere. A restaurant with entertainment may be specifically a restaurant such as a cabaret or a nightclub.

Generally, in a restaurant with entertainment, a customer may give a gift (present) to a clerk. For example, in order to celebrate some event (such as the arrival of a salesclerk's birthday), a customer presents a salesclerk with a flower or the like as a gift to be displayed outside or inside the restaurant. As such a gift, the image generating apparatus 1 acquires a virtual object J representing a flower or the like for generating a superimposed image S by superimposing it on the base image B representing the restaurant. Then, when the superimposed image S in which the virtual object J is superimposed on the base image B is visually recognized by the user using the AR, the user such as the store clerk or the customer can decorate the restaurant with a gift such as a flower that has been presented. It will be recognized as if

In the following description, a first user and a second user are exemplified as users. A "first user" is a store clerk who entertains customers, and a "second user" is a customer who receives entertainment from the first user. A gift is given from the second user to the first user. Also, assume that the base image B is, for example, an image of a store where the first user entertains the second user, and the virtual object J is an image of a stand flower displayed in the store. A "stand flower" is a flower decoration in which one or more flowers (bouquets) are arranged on a stand, and is also called a flower stand. The stand flower may include a notice board placed near the stand, inside the stand, or the like. For example, the name of the first user may be displayed on the notice board.

The image generation device 1 is composed of a computer 10 (server) capable of communicating with a first user terminal T1 and a second user terminal T2, which will be described later, via a network N. As shown in FIG. The image generation device 1 has a control operation device, a storage device, and an input/output device as physical components. The control arithmetic device is composed of a controller such as a CPU (Central Processing Unit), for example, and performs arithmetic processing and controls the storage device and the input/output device. The storage device has, for example, a main storage device and an auxiliary storage device. The main storage device is composed of, for example, a RAM (Random Access Memory). Also, the auxiliary storage device is composed of, for example, a ROM (Read Only Memory). The input/output device has, for example, an input device that receives data from the outside and transmits it to the storage device, and an output device that outputs to the outside the results of calculations performed by the control calculation unit and stored in the storage device. there is

The image generating apparatus 1 executes predetermined processing by, for example, reading a program stored in a ROM into a RAM and executing the program read into the RAM by a CPU. It should be noted that the computer 10 constituting the image generating apparatus 1 may physically have a configuration different from the configuration described above.

A first user terminal T1 is a terminal used by a first user, and a second user terminal T2 is a terminal used by a second user. Each of the first user terminal T1 and the second user terminal T2 has a control arithmetic device, a storage device, and an input/output device as a physical configuration. The control arithmetic device is composed of a controller such as a CPU, for example, and performs arithmetic processing and controls the storage device and the input/output device. The storage device has, for example, a main storage device and an auxiliary storage device. The main memory is composed of RAM, for example. Also, the auxiliary storage device is composed of, for example, a ROM. The input/output device has, for example, an input device that receives data from the outside and transmits it to the storage device, and an output device that outputs to the outside the results of calculations performed by the control calculation unit and stored in the storage device. there is

Each of the first user terminal T1 and the second user terminal T2, for example, reads a program stored in the ROM into the RAM, and executes the program read into the RAM by the CPU, thereby executing a predetermined process. Each of the first user terminal T1 and the second user terminal T2 is configured to be able to communicate with another device such as the image generation device 1 via the network N. As shown in FIG. Each of the first user terminal T1 and the second user terminal T2 may be, for example, a smart phone, a tablet, a notebook computer, a desktop computer, or the like. Here, smartphones are exemplified as each of the first user terminal T1 and the second user terminal T2.

The first user terminal T1 has an imaging device T11 such as a camera as an input device, and an image display device T12 such as a display as an output device. Similarly, the second user terminal T2 has an imaging device T21 such as a camera as an input device, and an image display device T22 such as a display as an output device.

The image display device T12 is provided side by side with the imaging device T11 (provided in the vicinity of the imaging device T11). Specifically, in the first user terminal T1, the imaging device T11 and the image display device T12 are provided so as to be positioned on the back side of each other (back to back). That is, the direction in which an image is captured by the imaging device T11 with the position of the first user terminal T1 as a reference and the direction in which the image display device T12 can be viewed with the position of the first user terminal T1 as a reference are opposite to each other. . Here, the first user terminal T1 captures (obtains) the base image B with the imaging device T11, and the captured base image B is displayed on the image display device T12.

Similarly, the image display device T22 is provided side by side with the imaging device T21 (provided in the vicinity of the imaging device T21). Specifically, in the second user terminal T2, the imaging device T21 and the image display device T22 are provided so as to be positioned on the back side of each other (back to back). In other words, the direction in which the image is captured by the imaging device T21 with the position of the second user terminal T2 as a reference and the direction in which the image display device T22 can be viewed with the position of the second user terminal T2 as a reference are opposite to each other. . Here, the second user terminal T2 captures (obtains) the base image B with the imaging device T21, and the captured base image B is displayed on the image display device T22.

A functional configuration of the image generation device 1 will be described. The computer 10 of the image generation device 1 functionally includes a first user information acquisition unit 11, a second user information acquisition unit 12, a communication history information acquisition unit 13, an image acquisition unit 14, a charging unit 15, a marker setting unit 16, and a , and an arrangement position setting unit 17 .

The first user information acquisition unit 11 acquires first user information. The first user information acquisition unit 11 may acquire the first user information by receiving the first user information from a terminal such as the first user terminal T1. "First user information" is information about the first user. For example, the first user information may be information that identifies the first user (personal identification information). Personal identification information may be, for example, name, address, birthplace, age, birthday, and the like. Also, the first user information may be information (preference information) about the preference of the first user. Preference information may include, for example, hobbies, favorite words, favorite music, favorite food and drink, and favorite colors.

The second user information acquisition unit 12 acquires second user information. The second user information acquisition unit 12 may acquire the second user information by receiving the second user information from a terminal such as the second user terminal T2. "Second user information" is information about the second user. For example, the second user information may be information that identifies the second user (individual identification information), or may be information about the preferences of the second user (preference information).

The communication history information acquisition unit 13 acquires communication history information. “Communication history information” is information related to the history of communication performed between the first user terminal T1 and the second user terminal T2. For example, the communication history information may be information (call history information) about a telephone call history between the first user terminal T1 and the second user terminal T2. It may be information (e-mail history information) about the history of e-mail transmission and reception with T2, and the history of comment exchange using the chat tool between the first user terminal T1 and the second user terminal T2 (chat history information). Alternatively, the communication history information may be an SNS (Social networking service) between the first user's account linked to the first user terminal T1 and the second user's account linked to the second user terminal T2. It may be information (communication history information) related to the communication history used.

The communication history information acquisition unit 13 may acquire communication history information by receiving communication history information from, for example, the first user terminal T1 or the second user terminal T2. Alternatively, the communication history information acquisition unit 13 may acquire communication history information by receiving the communication history information from an external device such as an external server (for example, an SNS server) that holds the communication history information. .

The image acquisition unit 14 acquires the virtual object J. FIG. Specifically, the image acquisition unit 14 acquires the virtual object J (for example, a first virtual object J1, which will be described later), triggered by a request from the second user. Specifically, when the image acquisition unit 14 receives a virtual object generation request for newly generating the first virtual object J1 from the second user terminal T2, the image acquisition unit 14 acquires the first virtual object J1. good too. The image acquisition unit 14 may acquire virtual objects J corresponding to a plurality of base images B. FIG. For example, the image acquisition unit 14 acquires the virtual object J corresponding to the base image B, which is the image of the store, and the virtual object J, corresponding to the base image B which is the image of the home of the first user or the second user. You may

The image acquisition unit 14 may acquire the virtual object J by generating the virtual object J based on the input information, for example. “Input information” is information for determining the design of the virtual object J based on the information. For example, the input information includes first user information and second user information. That is, the image acquisition unit 14 determines the design of the virtual object J based on the compatibility between the first user and the second user. The input information includes communication history information, amount information, flower information, and fortune information.

The “amount information” is information regarding the amount of money charged to the second user by the charging unit 15, which will be described later. Specifically, the money amount information may be information about the money amount for obtaining the virtual object J as a gift. The “flower information” may be information about the characteristics of flowers, and in particular, information about the characteristics of flowers included in the stand flower of the virtual object J. FIG. Specifically, the flower information may be information on the language of flowers set for each type of flower, or information on the color, shape, and size of each type of flower. It may be information on the place of origin of the Also, the "flower information" may be information about the types of flowers to be included in the flower stand. In this case, the type of flower related to the flower information may be specified by the first user or the second user. "Fortune information" is information about the fortune of the first user or the second user. The image acquisition unit 14 may store in the database in advance the fortune information determined according to the information about the first user and the second user.

The image acquisition unit 14 acquires first user information from the first user information acquisition unit 11, acquires second user information from the second user information acquisition unit 12, and acquires communication history information from the communication history information acquisition unit 13. Then, the amount information is acquired from the charging unit 15 . The image acquisition unit 14 may store flower information in advance, or may acquire flower information from an external device such as an external server via the network N.

The image acquisition unit 14 may generate the virtual object J by any means based on the acquired input information. For example, the image acquisition unit 14 may generate the virtual object J based on the acquired input information by referring to a correspondence map in which the input information and the virtual object J are associated with each other. In this case, the image acquisition unit 14 may refer to a correspondence map stored in advance. For example, the image acquisition unit 14 accesses an external device such as an external server via the network N and obtains the correspondence map stored in the external device. You can refer to it.

Alternatively, the image acquisition unit 14 may generate the virtual object J based on the acquired input information using so-called AI (Artificial Intelligence). Deep learning using a neural network may be adopted as AI. Specifically, the image acquiring unit 14 uses a trained model in which a neural network is trained so that the input information is input data and the virtual object J is output data. Object J may be generated.

In the following description, virtual objects J are assumed to include a first virtual object J1 and a second virtual object J2. A "first virtual object" is a virtual object J whose design is determined based on input information including first user information and second user information. In this case, the second user information means second user information about the second user who is the user of interest in the context. A "second virtual object" is a virtual object J different from the first virtual object J1. For example, while the first virtual object J1 is a virtual object J associated with the second user, the second virtual object J2 is a virtual object J associated with a user other than the second user. There may be. The second virtual object may be, for example, an image of a flower stand, or an image of the first user (planar image or stereoscopic image).

The image acquisition unit 14 outputs the virtual object J to the image display device T12 of the first user terminal T1 or the image display device T22 of the second user terminal T2. At this time, since the first user terminal T1 or the second user terminal T2 has acquired the base image B, the image acquisition unit 14 displays the superimposed image S in which the virtual object J is superimposed on the base image B. It can be displayed on the devices T12 and T22. In this manner, the image generation device 1 realizes the AR function in cooperation with the first user terminal T1 or the second user terminal T2.

The charging unit 15 charges the second user when the image acquiring unit 14 acquires the first virtual object J1 in response to a request from the second user. The billing unit 15 may bill the second user for the amount of money input by the second user via the second user terminal T2. In this case, the billing unit 15 may present a plurality of price options to the second user terminal T2, and may bill the second user for the price corresponding to the option selected by the second user. The charging unit 15 may give points to the second user according to the amount of money charged. Points may be available for payment at stores, for example.

The billing unit 15 may bill the second user as follows. That is, the billing unit 15 may execute processing for debiting from a bank account registered in advance, and transmits information instructing debiting from the bank account to an external server (for example, a bank server). Processing may be executed, or processing of transmitting information instructing charging to a server such as a credit card company (agent acting on behalf of charging) may be executed. In this manner, the timing at which the billing unit 15 executes billing may or may not coincide with the timing at which payment is actually made.

The marker setting unit 16 sets a marker M to be used as a reference for the arrangement position of the virtual object J in the base image B captured by the imaging device T11 of the first user terminal T1 or the imaging device T21 of the second user terminal T2. (See FIG. 16). A “marker” is a mark whose shape or the like is set in advance and serves as a reference when displaying AR content on an image. The marker M serves as a reference for the position where the virtual object J is displayed on the base image B when the superimposed image S is generated by superimposing the virtual object J on the base image B. FIG. Here, since the base image B is the image of the store, the marker M may be, for example, an image of the store or a mark displayed in the vicinity of the store (logo mark of the store, etc.). It may be an image of a signboard, etc. displayed on a street), or an image of a structure (a door, etc.) that constitutes a store.

Information about the marker set by the marker setting unit 16 is transmitted from the marker setting unit 16 to the first user terminal T1 or the second user terminal T2. The first user terminal T1 detects (extracts) an image portion corresponding to the marker M from the base image B by performing image processing on the base image B captured by the imaging device T11. For example, the first user terminal T1 may perform image processing by pattern matching. Specifically, the first user terminal T1 may perform edge detection on the base image B and perform template matching on the image after edge detection using a template image stored in advance. These processes are the same for the second user terminal T2.

The arrangement position setting unit 17 sets the arrangement position where the virtual object J is arranged in the superimposed image S. FIG. Specifically, the placement position setting unit 17 sets the placement position where the virtual object J is placed according to a predetermined condition, using the position of the marker M set by the marker setting unit 16 as a reference. Also, the arrangement position setting unit 17 may change (set) the arrangement position of the virtual object J based on information received from the first user terminal T1 or the second user terminal T2, for example.

The arrangement position setting unit 17 may acquire the priority associated with the first virtual object J1 regarding the arrangement position where the first virtual object J1 is arranged in the base image B. FIG. “Priority” is an index representing the degree to which each of a plurality of virtual objects J should be preferentially displayed compared to other virtual objects J. FIG. The priority may be determined, for example, according to the amount of money charged by the charging unit 15 . Further, when the superimposed image S is displayed by the second user terminal T2 of the second user, the priority of the first virtual object J1 related to the second user is higher than that of the virtual object J related to other users. It may be determined to be higher than the priority. That is, for the second user, the priority of his own virtual object J may be determined to be higher than the priority of the virtual objects J of other users.

Then, the arrangement position setting unit 17 determines whether either the first virtual object J1 or the other virtual object J (that is, the second virtual object J2) is the virtual object J in the superimposed image S according to the acquired priority. The arrangement positions of the first virtual object J1 and the second virtual object J2 are determined so that they are more emphasized. “One of the virtual objects J is emphasized” means that the one of the virtual objects J is displayed in the superimposed image S in a state where it is more visible than the other virtual objects J. For example, when one of the virtual objects J is emphasized more than the other virtual objects J, the one of the virtual objects J is closer to the center of the superimposed image S than the other virtual objects J (closer to the image of the store). , may be displayed in front of other virtual objects J, may be displayed larger than other virtual objects J, and may be displayed in a color that is easier to see than other virtual objects J. may For example, the placement position is determined such that the higher the priority of the virtual object J, the more emphasized. Note that the placement position setting unit 17 may determine the placement position so that the first virtual object J1 is superimposed on the actual flower stand displayed in the store. For example, the placement position setting unit 17 determines the placement position so that the first virtual object J1 is superimposed on the flower stand given by another user among the actual flower stands displayed in the store. may

[First Image Generation Processing]
A first image generation process executed by the image generation device 1 will be described. FIG. 2 is a flow chart showing the first image generation process executed by the image generation device 1. As shown in FIG. The first image generation process is a process in which the image generation device 1 acquires the virtual object J. FIG. A superimposed image S is generated by superimposing the virtual object J acquired by the image generating device 1 through the first image generating process on the base image B in the second user terminal T2. That is, the first image generation process is a process of generating the virtual object J used in the superimposed image S for AR.

Hereinafter, while explaining the flowchart of FIG. The image of the screen displayed on each of the image display devices on the side of the person in charge who manages the transfer is exemplified. Here, as an example, it is assumed that the sender is the second user and the image display device on the sender side is the image display device T22 of the second user terminal T2. Further, as an example, the recipient and the administrator are assumed to be the same first user, and the image display device on the recipient side and the image display device on the administrator side are assumed to be the image display device T12 of the same first user terminal T1.

In step S10, the first user information acquisition unit 11 of the image generation device 1 acquires first user information. The first user information acquisition unit 11 may acquire the first user information, for example, by receiving the first user information from the first user terminal T1. After that, the first image generation process proceeds to step S12.

In step S12, the second user information acquisition unit 12 of the image generation device 1 acquires second user information. The second user information acquisition unit 12 may acquire the second user information, for example, by receiving the second user information from the second user terminal T2. After that, the first image generation process proceeds to step S14.

In step S14, the communication history information acquisition unit 13 of the image generation device 1 acquires communication history information. The communication history information acquisition unit 13 may acquire communication history information by receiving communication history information from, for example, the first user terminal T1 or the second user terminal T2. Alternatively, the communication history information acquisition unit 13 may acquire communication history information by receiving the communication history information from an external device such as an external server that holds the communication history information. After that, the first image generation process proceeds to step S16.

Here, apart from the flowchart of FIG. 2, the image displayed on the image display device T22 of the second user terminal T2 will be described. FIG. 3 is a diagram showing an image of a login screen displayed on the image display device T22 on the sender side. When the second user terminal T2 accesses the image generation device 1, a login screen is displayed on the image display device T22. When a user ID and password are entered on the login screen, login processing is executed.

FIG. 4 is a diagram showing an image of the top page screen displayed on the image display device T22. When the second user terminal T2 logs in, the top page screen is displayed on the image display device T22. When the button labeled "BIRTHDAY" on the top page screen is touched, the birthday gifting process is started. “Birthday gifting” is a process of giving a gift from a sender (second user) to a recipient (first user).

FIG. 5 shows an image of a birthday list screen displayed on the image display device T22. When the birthday gifting process is started, a birthday list screen is displayed on the image display device T22. The birthday list screen displays, for example, a salesclerk whose birthday has arrived or a salesclerk whose birthday will come soon, among the salesclerks employed at the target store. When the image of one of these salesclerks is touched, the screen transitions to the screen related to the salesclerk.

FIG. 6 is a diagram showing an image of a sender list screen displayed on the image display device T22. The sender list screen lists the gifts given to the store clerk and the customers (senders) who gave the gifts. Specifically, the sender list screen displays the name of the customer who gave the gift, the content of the message attached to the gift, and the amount charged when giving the gift. When the button labeled "+Birthday card" on the sender list screen is touched, a message input screen for creating a new birthday card is displayed.

FIG. 7 is a diagram showing an image of a message input screen displayed on the image display device T22. An image of a birthday card is displayed on the message input screen, and a message is input to the birthday card via the second user terminal T2.

FIG. 8 is a diagram showing an image of a virtual object selection screen displayed on the image display device T22. When the input of the message to be written on the birthday card is completed, a virtual object selection screen for selecting the virtual object J (that is, the first virtual object J1) as a gift is displayed. Image diagrams of a plurality of virtual objects J are displayed on the virtual object selection screen, and the touched virtual object J is selected. Here, for each of the plurality of virtual objects J, a billing amount is set as a consideration for generating the virtual object J. FIG.

FIG. 9 is a diagram showing an image of a virtual object confirmation screen displayed on the image display device T22. The virtual object confirmation screen is a screen for confirming that the virtual object J (first virtual object J1) selected on the virtual object selection screen is to be newly generated. When the button labeled “OK” on the virtual object determination screen is touched, a virtual object generation request is transmitted to the image generation device 1 .

Returning to the flowchart of FIG. 2, in step S16, the image acquisition unit 14 of the image generation device 1 receives a virtual object generation request for newly generating the first virtual object J1 from the second user terminal T2. After that, the first image generation process proceeds to step S18.

In step S18, the billing unit 15 of the image generating device 1 bills the second user. Specifically, the charging unit 15 charges the second user the amount of money for the virtual object J selected by the second user on the virtual object selection screen. The billing unit 15 may execute a process of debiting from a pre-registered bank account, and performs a process of transmitting information instructing debiting from the bank account to an external server (for example, a bank server). Alternatively, a process of transmitting information instructing charging to a server such as a credit card company (a company acting as an agent for charging) may be performed. After that, the first image generation process proceeds to step S20.

In step S<b>20 , the image obtaining unit 14 of the image generating device 1 obtains amount information regarding the amount of billing executed for the second user based on the information regarding the billing executed by the billing unit 15 . As a result, the input information will include amount information. After that, the first image generation process proceeds to step S22.

In step S22, the image acquisition unit 14 of the image generation device 1 acquires the first virtual object J1. Specifically, the image acquiring unit 14 acquires the virtual object J by generating the virtual object J based on the input information. The input information includes first user information, second user information, communication history information, amount information, and flower information. The image acquisition unit 14 may generate the virtual object J based on the acquired input information by referring to a correspondence map that associates the input information with the virtual object J. A virtual object J may be generated based on the information. After that, the first image generation process proceeds to step S24.

In step S24, the marker setting unit 16 of the image generation device 1 sets a marker to be used as a reference for the arrangement position of the virtual object J in the base image B captured by the imaging device T21 of the second user terminal T2. Here, since the base image B is the image of the store, the marker may be, for example, an image of the store or a mark displayed in the vicinity of the store (such as a logo mark of the store). It may be an image of a displayed signboard, etc.), or an image of a structure (a door, etc.) that constitutes a store (see FIG. 16). Information about the marker set by the marker setting unit 16 is transmitted from the marker setting unit 16 to the second user terminal T2. After that, the first image generation process proceeds to step S26.

In step S<b>26 , the placement position setting unit 17 of the image generation device 1 acquires the priority associated with the first virtual object J1 regarding the placement position in the base image B where the first virtual object J1 is placed. The priority may be determined, for example, according to the amount of billing executed by the billing unit 15, and the priority of the first virtual object J1 related to the second user is the priority of the virtual object J related to other users. It may be determined to be higher than the priority. After that, the first image generation process proceeds to step S28.

In step S<b>28 , the placement position setting unit 17 of the image generation device 1 sets the placement position where the virtual object J is placed in the superimposed image S. Specifically, the placement position setting unit 17 sets the placement position where the virtual object J is placed according to a predetermined condition, using the position of the marker M set by the marker setting unit 16 as a reference. Here, the arrangement position setting unit 17 arranges the first virtual object J1 or the second virtual object J2 so that the virtual object J, which is either the first virtual object J1 or the second virtual object J2, in the superimposed image S is more emphasized according to the acquired priority. The arrangement positions of the first virtual object J1 and the second virtual object J2 are determined. After that, the first image generation process proceeds to step S30.

Here, apart from the flowchart of FIG. 2, the image displayed on the image display device T22 of the second user terminal T2 will be described. FIG. 10 is a diagram showing an image of an arrangement position setting screen displayed on the image display device T22. As shown in FIG. 10, the placement position setting unit 17 may set the placement position of the virtual object J to the position specified by the second user. Also, the placement position setting unit 17 may change the placement position of the virtual object J, for example, based on information received from the first user terminal T1 or the second user terminal T2.

FIG. 11 is a diagram showing an image of a gift transmission screen displayed on the image display device T22. When the placement position where the virtual object J is placed in the superimposed image S is set, a gift transmission screen for sending a gift with a message associated with the virtual object J is displayed.

FIG. 12 is a diagram showing an image of a transmission completion screen displayed on the image display device. As shown in FIG. 12, when the second user approves the transmission (giving) of the gift, gift transmission processing is executed and a transmission completion screen is displayed.

Next, the image displayed on the image display device T12 of the first user terminal T1 will be described. FIG. 13 is a diagram showing an image of the My Page screen displayed on the image display device T12 on the recipient side. The My Page screen displays a list of gifts given by a plurality of senders including the second user. Specifically, the My Page screen displays the name of the customer who gave the gift, the content of the message attached to the gift, and the amount charged along with the gift.

FIG. 14 is a diagram showing an image of a message display screen displayed on the image display device T12. When a screen area related to one of the gifts displayed on the My Page screen is touched, a message linked to the gift is displayed on the message display screen.

Returning to the flowchart of FIG. 2, in step S30, the image acquisition unit 14 of the image generation device 1 extracts the first virtual object J1 from the first user terminal T1 (the image display device T12 of the first user terminal T1) and the second user terminal. Output to at least one of T2 (the image display device T22 of the second user terminal T2). With the above, the first image generation processing ends.

Note that the first user terminal T1 or the second user terminal T2 that has received the first virtual object J1 performs image processing on the base image B captured by the imaging devices T11 and T21, thereby converting the base image B into An image portion corresponding to the marker M is detected (extracted). For example, the first user terminal T1 or the second user terminal T2 may perform image processing by pattern matching. Specifically, the first user terminal T1 or the second user terminal T2 performs edge detection on the base image B, and performs template matching on the image after edge detection using a template image stored in advance. You may

FIG. 15 is a diagram showing a superimposed image S displayed on the image display devices T12 and T22. As shown in FIG. 15, the image acquisition unit 14 causes the image display devices T12 and T22 to display a superimposed image S in which the virtual object J is superimposed on the base image B. FIG. More specifically, the marker M is detected in the base image B when the base image B is acquired by imaging the store with the imaging device T11 of the first user terminal T1 or the imaging device T21 of the second user terminal T2. Then, a superimposed image S in which the virtual object J is superimposed at a preset position based on the marker M is displayed on the image display device T12 of the first user terminal T1 or the image display device T22 of the second user terminal T2. . In this manner, the image generation device 1 realizes the AR function in cooperation with the first user terminal T1 or the second user terminal T2.

For example, when a code such as a QR code (registered trademark) posted at a store is read by the imaging device T11 of the first user terminal T1 or the imaging device T21 of the second user terminal T2, the superimposed image S is displayed as an image. It may be displayed on the device T12 or the image display device T22. Alternatively, the superimposed image S may be displayed on the image display device T12 or the image display device T22 when the first user terminal T1 or the second user terminal T2 and the equipment on the store side come within a predetermined distance. The separation distance between the first user terminal T1 or the second user terminal T2 and the device on the store side may be determined based on communication by Bluetooth (registered trademark), for example. An image such as the superimposed image S displayed on the image display device T12 or the image display device T22 may be stored in the terminal as a screen shot or the like, and may be automatically displayed on the image display device T22 as a trigger. may be transmitted (or made public) to an SNS (Social networking service), a video sharing service server, or the like.

Here, the AR management screen displayed on the image display device T12 of the first user terminal T1 will be described. FIG. 16 is a diagram showing an image of a management screen displayed on the image display device T12 on the administrator side. In addition to the image of the store, the management screen displays the settings of the marker M and a list of gifts given by the second user in the past. On the management screen, for example, it is possible to change the image used as the marker M and obtain information on the second user who has given a gift in the past. Further, comments, music, images, moving images, or the like may be set in advance by the first user on the management screen. In this case, when the superimposed image S is displayed on the image display device T22 of the second user terminal T2, the set comment, music, image, video, or the like is reproduced (or pushed notification) on the second user terminal T2. etc.).

[Action and effect]
As described above, the image generating apparatus 1 includes the first user information acquisition unit 11 that acquires the first user information about the first user who is the salesclerk who entertains the customer, and the customer who receives the entertainment from the first user. and an image acquisition unit 14 for acquiring a virtual object J for generating a superimposed image S by superimposing it on the base image B. In response to a request from the second user, the image acquisition unit 14 acquires a first virtual object J whose design is determined based on input information including the first user information and the second user information. Get object J1.

According to this image generating device 1, the virtual object J for generating the superimposed image S by superimposing it on the base image B is acquired in response to the second user's request. This superimposed image S is displayed on a display, for example, and is used for AR, VR, or the like to allow the user to visually recognize the virtual object J, which does not actually exist, as if it were present on the base image B. be done. Here, according to the image generation device 1, the design of the virtual object J is determined according to the information of the first user and the second user who are in a relationship between the staff and the customer of the restaurant, for example. Therefore, according to the image generation device 1, the virtual object J superimposed on the base image B can be designed according to the user.

In the image generation device 1, the base image B is an image of a store where the first user entertains the second user. According to this, it is possible to reproduce the act of decorating the store with a gift presented by the second user to the first user by AR or VR.

In the image generation device 1, the virtual object J is an image of a flower stand. According to this, the act of giving a stand flower as a gift from the second user to the first user can be reproduced by AR or VR.

In the image generating device 1, the input information includes flower information regarding the characteristics of the flowers included in the flower stand. According to this, the stand flower containing the flower which has the characteristic suitable for the 1st user and the 2nd user can be made into the gift from the 2nd user to the 1st user.

The image generation device 1 acquires communication history information relating to the history of communication performed between the first user terminal T1 used by the first user and the second user terminal T2 used by the second user. A communication history information acquisition unit 13 is provided, and the input information includes communication history information. According to this, the virtual object J designed according to the past communication history between the first user and the second user can be given as a gift from the second user to the first user.

The image generating device 1 includes a billing unit 15 that bills the second user when the image obtaining unit 14 obtains the first virtual object J1 in response to a request from the second user. According to this, the charge for the gift from the second user to the first user can be received from the second user.

In the image generating device 1 , the input information includes amount information regarding the amount of billing to be performed for the second user by the billing unit 15 . According to this, the virtual object J having a design corresponding to the amount of money received from the second user can be used as a gift from the second user to the first user.

The image generation device 1 includes an arrangement position setting unit 17 that sets the arrangement position where the virtual object J is arranged in the superimposed image S. FIG. According to this, the position of the virtual object J on the base image B can be preferably set.

In the image generation device 1, the image acquisition unit 14 acquires the first virtual object J1 and the second virtual object J2, which is a virtual object J different from the first virtual object J1, and the placement position setting unit 17 The priority associated with the first virtual object J1 is acquired with respect to the arrangement position where the first virtual object J1 is arranged, and the first virtual object J1 and the second virtual object J1 are arranged in the superimposed image S according to the acquired priority. The placement position is set so that any virtual object J with the object J2 is more emphasized. According to this, the virtual object J can be appropriately emphasized and displayed according to the priority determined by various conditions.

In the image generating device 1, the base image B is an image captured by the imaging devices T11 and T21 and displayed on the image display devices T12 and T22 provided side by side with the imaging devices T11 and T21. By outputting the object J to the image display devices T12 and T22, the superimposed image S in which the virtual object J is superimposed on the base image B is displayed on the image display devices T12 and T22. According to this, by displaying the superimposed image S on an AR display or the like, the AR is used to allow the user to visually recognize the virtual object J, which does not actually exist, as if it were present on the base image B. Concretely implemented.

The image generation device 1 includes a marker setting unit 16 that sets a marker M for use as a reference for the placement position in the base image B captured by the imaging devices T11 and T21. According to this, by setting the marker M for setting the placement position where the virtual object J is placed in the AR, it is possible to determine whether the virtual object J, which does not actually exist, exists on the base image B. AR for making the user visually recognize is specifically realized as follows.

[Second embodiment]
An image generation device 1A according to the second embodiment will be described. FIG. 17 is a block diagram showing an image generation device 1A according to the second embodiment. An image generation device 1A shown in FIG. 17 is a device that obtains a virtual object J for superimposing a superimposed image S on a base image B, similar to the image generation device 1 according to the first embodiment. The generated superimposed image S is displayed on a display or the like and visually recognized by the user. This allows the user to visually recognize the virtual object J, which does not actually exist, as if it were present on the base image B. FIG. On the other hand, in the present embodiment, the base image B is an image configured as a virtual image (in other words, an image representing an artificially generated virtual space). That is, the base image B is a background image in VR, and the image generation device 1A is a device that generates a virtual object J of the superimposed image S displayed on a display or the like in VR. Any technology can be applied as a specific method of VR. Note that the base image B may be an image representing a virtual space simulating a real space.

The computer 10A of the image generating apparatus 1A functionally includes a first user information acquisition section 11A, a second user information acquisition section 12A, a communication history information acquisition section 13A, an image acquisition section 14A, a billing section 15A, and an arrangement position setting unit. A portion 17A is provided. Compared to the functional configuration of the image generation device 1, the functional configuration of the image generation device 1A does not include the marker setting unit 16, and the image acquisition unit 14A has functions for VR instead of AR. It is different in that it has a function for and is equivalent in other respects. That is, each of the first user information acquisition unit 11A, the second user information acquisition unit 12A, the communication history information acquisition unit 13A, the billing unit 15A, and the layout position setting unit 17A of the image generation device 1A It has functions equivalent to those of the 1-user information acquisition unit 11, the second user information acquisition unit 12, the communication history information acquisition unit 13, the charging unit 15, and the placement position setting unit 17, respectively. Main differences between the image generating apparatus 1A and the image generating apparatus 1 will be described below.

14 A of image acquisition parts acquire the base image B. FIG. The base image B is a virtual image generated by the image generating device 1 or an external computer or the like. When the base image B is generated by an external computer or the like, the image acquisition unit 14A may acquire the base image B by accessing the computer or the like through the network N, or may store a predetermined storage medium. The base image B may be obtained via

The image acquisition unit 14A generates a superimposed image S by superimposing the virtual object J on the acquired base image B. FIG. Then, the image acquisition unit 14A outputs the generated superimposed image S to the first user terminal T1 (the imaging device T11 of the first user terminal T1) or the second user terminal T2 (the image display device T22 of the second user terminal T2). By doing so, the superimposed image S in which the virtual object J is superimposed on the base image B is displayed on the image display devices T12 and T22. In this manner, the image generation device 1A cooperates with the first user terminal T1 or the second user terminal T2 to realize the VR function.

[Second Image Generation Processing]
A second image generation process executed by the image generation device 1A will be described. FIG. 18 is a flow chart showing the second image generation process executed by the image generation device 1A. The second image generation process is a process in which the image generation device 1A acquires the base image B and the virtual object J, generates the superimposed image S, and outputs the generated superimposed image S. FIG. That is, the second image generation processing is processing for generating the superimposed image S for VR.

The flowchart of FIG. 18 will be described below. The second image generation processing shown in FIG. 18 is substantially the same as the first image generation processing shown in FIG. 2 in the following points. That is, steps S40 to S52 in the second image generation process are substantially the same as steps S10 to S22 in the first image generation process. In other words, steps S56 and S58 in the second image generation process are substantially the same as steps S26 and S28 in the first image generation process. Main differences between the second image generation process and the first image generation process will be described below.

In step S54, the image acquisition unit 14A of the image generation device 1A acquires the base image B. FIG. When the base image B is generated by an external computer or the like, the image acquisition unit 14A may acquire the base image B by accessing the computer or the like through the network N, or may store a predetermined storage medium. The base image B may be obtained via

Further, when the arrangement position of the virtual object J in the base image B is determined in step S58, the image acquisition unit 14A of the image generation device 1A superimposes the virtual object J on the base image B to generate a superimposed image S in S60. . After that, the second image generation process proceeds to step S62.

In step S62, the image acquisition unit 14A of the image generation device 1A transmits the generated superimposed image S to the first user terminal T1 (the image display device T12 of the first user terminal T1) and the second user terminal T2 (the second user terminal T2). image display device T22). With the above, the first image generation processing ends.

Note that the superimposed image S is displayed on the image display device T12 of the first user terminal T1 or the image display device T22 of the second user terminal T2, which is input from the image acquisition unit 14A. In this manner, the image generation device 1A cooperates with the first user terminal T1 or the second user terminal T2 to realize the VR function.

Here, the VR management screen displayed on the image display device T12 of the first user terminal T1 will be described. FIG. 19 is a diagram showing an image of a management screen displayed on the image display device T12 on the administrator side. In addition to the image of the store, the management screen displays a list of gifts given by the second user in the past. On the management screen, for example, it is possible to acquire information about second users who have given gifts in the past.

[Action and effect]
As described above, in the image generation device 1A, the base image B is an image configured as a virtual image, and the image acquisition unit 14A acquires the base image B and adds the virtual object J to the acquired base image B. By superimposing to generate a superimposed image S and outputting the generated superimposed image S to the image display devices T12 and T22, the superimposed image S is displayed on the image display devices T12 and T22. According to this, by displaying the superimposed image S on a VR display or the like, a VR for allowing the user to visually recognize a virtual object J that does not actually exist as if it were present on the base image B. Concretely realized.

[Modification]
The above-described embodiments can be implemented in various forms modified or improved based on the knowledge of those skilled in the art.

For example, the matter described as "entertainment" in the above-described first and second embodiments may be described as "customer service." "Customer service" means that a clerk mainly responds to a customer in a standardized manner in order to allow the customer to eat and pay the bill. Compared to entertainment, customer service does not have close communication between staff and customers, and does not create a particularly pleasant atmosphere. The restaurant where the customer is served may specifically be a restaurant. In this case, the first user is a store clerk who serves a customer, the second user is a customer who is served by the first user, and the base image B is provided by the first user to the second user. It is an image of a store where customers are served. Also, regarding definitions and explanations of terms other than the above, the term "entertainment" in the first and second embodiments can be read as "customer service."

For example, in the above-described first embodiment, the image acquisition unit 14 of the image generation device 1 may acquire the base image B and superimpose the virtual object J on the acquired base image B to generate the superimposed image S. . Further, the image acquisition unit 14 transmits the generated superimposed image S to the first user terminal T1 (the image display device T12 of the first user terminal T1) and the second user terminal T2 (the image display device T22 of the second user terminal T2). You may output to at least one. In this manner, the image generation device 1 may realize the AR function in cooperation with the first user terminal T1 or the second user terminal T2.

Further, the image generation device 1 may have the functions of the image generation device 1A. That is, the image generation device 1 has a function of generating a virtual object J for AR and displaying a superimposed image S in which the virtual object J is superimposed on the base image B on the image display devices T12 and T22; A function of acquiring B, generating a virtual object J for VR, generating a superimposed image S from the base image B and the virtual object J, and displaying the generated superimposed image S on the image display devices T12 and T22; may also have That is, the image generation device 1 may be a device that generates (obtains) a virtual object J for generating a superimposed image S by superimposing it on a base image B that serves as a background image in at least one of AR and VR. .

The image generation device 1 in the first embodiment is a device that generates a superimposed image S for AR, and the image generation device 1A in the second embodiment is a device that generates a superimposed image S for VR. However, the image generation device is not limited to a device that generates a superimposed image S for AR or VR. For example, the image generation device may be a device that generates a superimposed image S for MR (Mixed Reality).

Further, the design of the first virtual object J1 may not be determined for each stand flower, and for example, the design may be determined for each flower. The image acquisition unit 14 may also randomly determine the type of flower included in the virtual object J, which is the image of the flower stand.

1, 1A Image generation devices 10, 10A Computers 11, 11A First user information acquisition units 12, 12A Second user information acquisition units 13, 13A Communication history information acquisition units 14, 14A Image acquisition units 15, 15A Charging unit 16 Marker setting Units 17 and 17A Placement position setting unit B Base image J Virtual object J1 First virtual object J2 Second virtual object M Marker N Network S Superimposed image T1 First user terminal T2 Second user terminal T21 Imaging device T22 Image display device

Claims (12)

a first user information acquisition unit that acquires first user information about a first user who is a store clerk who serves or entertains customers;
a second user information acquisition unit that acquires second user information about the second user who is the customer who receives service or entertainment from the first user;
an image acquisition unit that acquires a virtual object to be superimposed on the base image to generate a superimposed image,
Triggered by a request from the second user, the image acquisition unit is the first virtual object whose design is determined based on input information including the first user information and the second user information. An image generation device that acquires a virtual object. 2. The image generating apparatus according to claim 1, wherein said base image is an image of a shop where said first user serves or entertains said second user. 3. The image generation device according to claim 1, wherein said virtual object is an image of a flower stand. 4. The image generating apparatus according to claim 3, wherein said input information includes flower information relating to features of flowers included in said flower stand. a communication history information acquisition unit that acquires communication history information relating to a history of communication executed between a first user terminal used by the first user and a second user terminal used by the second user; prepared,
5. The image generation device according to claim 1, wherein said input information includes said communication history information. 6. The method according to any one of claims 1 to 5, further comprising a charging unit for charging said second user when said image acquiring unit acquires said first virtual object in response to a request from said second user. 1. The image generation device according to claim 1. 7. The image generating apparatus according to claim 6, wherein said input information includes amount information relating to the amount of said billing executed for said second user by said billing section. 8. The image generation device according to claim 1, further comprising a placement position setting unit that sets a placement position where the virtual object is placed in the superimposed image. The image acquisition unit acquires the first virtual object and a second virtual object that is the virtual object different from the first virtual object,
The placement position setting unit
obtaining a priority associated with the first virtual object with respect to the placement position where the first virtual object is placed;
9. The placement position is set such that the virtual object of either the first virtual object or the second virtual object is emphasized in the superimposed image according to the acquired priority. The image generation device according to . The base image is an image captured by an imaging device and displayed on an image display device provided together with the imaging device,
10. The image acquisition unit according to claim 8, wherein by outputting the virtual object to the image display device, the superimposed image obtained by superimposing the virtual object on the base image is displayed on the image display device. image production device. 11. The image generation apparatus according to claim 10, further comprising a marker setting unit that sets a marker for use as a reference for the arrangement position in the base image captured by the imaging device. the base image is an image configured as a virtual image;
The image acquisition unit acquires the base image, superimposes the virtual object on the acquired base image to generate the superimposed image, and outputs the generated superimposed image to an image display device to obtain the superimposed image. 10. The image generation device according to claim 8, wherein an image is displayed on said image display device.

Images