JP2021022297A - User terminal, server, character exchange system, character exchange method, and program - Google Patents

Abstract

To provide a user terminal, etc., with which exchanges are made possible that enable the character of a virtual world, etc. to be felt closer to users and such exchanges also become useful from commercial points of view.SOLUTION: A user terminal 4 includes reproduction means 420 for reproducing the speech data of a character. The speech data reproduced by the reproduction means 420 includes one that indicates to a user the use of a photograph taking service and one with which the service ID, etc., inputted to a photograph taking device 6 when using the photograph taking service is reproduced after inputting to the photograph taking device 6.SELECTED DRAWING: Figure 7

Description

The present invention relates to a user terminal or the like for interacting with a character such as a virtual world in the real world.

In the field of subculture content such as anime, manga, and games, traditional users are limited to passively enjoying the content, simply watching anime, reading manga, and manipulating in-game characters. It was. However, at present, there is a great need for users to have some kind of active interaction with characters such as these virtual worlds in the real world.

As an example, games using AR (Augmented Reality) are now widely enjoyed, and users can interact with game characters appearing in the real world in various ways. Further, Patent Documents 1 and 2 disclose a stationary display device capable of displaying a character in three dimensions and enjoying a dialogue between the user and the character.

JP-A-2018-146965 JP-A-2018-14575

However, in the case of a game using AR, the interaction between the user and the character is usually within the range of the game system. On the other hand, the display devices of Patent Documents 1 and 2 can perform daily exchanges such as "good morning" and "welcome back" with the three-dimensionally displayed character.

By the way, in order to interact with a character in a virtual world or the like, it is also effective for the user to have a feeling of encouraging the user to take positive action and doing something for the character in the interaction scene. Is considered to be.

In this regard, the display devices of Patent Documents 1 and 2 are limited to interaction in which the character responds when the user speaks to the character, and by encouraging the user to take more positive actions, the character becomes closer to the user. There is a possibility that a felt exchange can be realized.

Furthermore, if the user is encouraged to take positive actions as described above, the actions can lead to the use of a specific service, promotion of products, etc., which is also useful from a commercial point of view.

The present invention has been made in view of the above problems, and provides a user terminal or the like that enables an exchange in which a character such as a virtual world can be felt more closely to the user, and the exchange is useful from a commercial point of view. The purpose is to do.

The first invention for solving the above-mentioned problems is a user terminal having a reproduction means for reproducing the voice data of a character, and the voice data indicates a user's action and responds to the instruction. Predetermined input information to be input to a device different from the user terminal when using a predetermined service or purchasing a predetermined product according to the instruction shall be reproduced after being input to the device. It is a user terminal characterized by including.

The user terminal of the present invention reproduces voice data of a character instructing a user's action, and when the user uses a predetermined service according to the instruction or when the user purchases a predetermined product according to the instruction. By inputting predetermined input information to a device (a device different from the user terminal), another voice data such as a character's appreciation is reproduced. As a result, in the present invention, an exchange scene is created in which the character reacts to the character by the action of the user, and the user feels as if the character has received gratitude by doing something for the character. be able to. As described above, in the present invention, by encouraging the user to take positive action, it is possible to realize an exchange in which the character feels closer to the user. Moreover, since the action is to use a predetermined service or purchase a predetermined product, it can be linked to promotion of the use of the service or promotion of the product, which is also useful from a commercial point of view. ..

It is desirable that the audio data be recorded by a stereophonic system.
This allows the user to feel as if the character actually exists on their side.

It is also desirable that the user terminal has a voice receiving means for receiving the voice data from the server and an input information receiving means for receiving the input information from the server.
As a result, the service can be provided to the user by the character exchange system consisting of the user terminal and the server.

The audio data includes data to be reproduced after the input information input to the photography device, which is the device, is input to the photography device when the photography service, which is the predetermined service, is used. Is desirable. It is also desirable that the user terminal receives an image obtained by combining the image of the user and the image of the character taken by the photography device from the server or the photography device.
As a result, it becomes possible to connect the instruction of the action to the user to promote the use of the photography service. As the photography service, by providing the user with a composite image in which the user and the character are combined, the user can get the feeling that the photograph was taken together with the character.

The second invention includes a voice transmission means for transmitting character voice data to a user terminal and an input information transmission means for transmitting predetermined input information to the user terminal, and the voice data is a user's action. And the input information to be input to a device different from the user terminal when using a predetermined service according to the instruction or purchasing a predetermined product according to the instruction, to the device. A server characterized by including one that is replayed after being input.
The second invention is a server that can realize an exchange that makes the character feel closer to the character, and the exchange becomes useful from a commercial point of view.

A third invention is a character exchange system having a user terminal and a server, wherein the user terminal has a voice receiving means for receiving character voice data from the server, a playback means for reproducing the voice data, and predetermined. It has an input information receiving means for receiving the input information of the above from the server, and the voice data indicates the action of the user, and when using a predetermined service according to the instruction or in response to the instruction. The character exchange system is characterized in that the input information input to a device different from the user terminal when purchasing a predetermined product includes the input information input to the device and then reproduced. ..
The third invention is a character exchange system that can realize an exchange that makes the character feel closer to the character and that the exchange is useful from a commercial point of view.

A fourth invention is a step in which a user terminal reproduces voice data of a character instructing a user's action, and when using a predetermined service according to the instruction or purchasing a predetermined product according to the instruction. It is characterized in that, after the predetermined input information to be input to a device different from the user terminal is input to the device, a step of reproducing another voice data of the character is executed. It is a character exchange method to do.
The fourth invention is a character exchange method that can realize an exchange that makes a character feel closer to a user terminal and is also useful from a commercial point of view.

A fifth invention is a program for making a user terminal function as a reproduction means for reproducing the voice data of a character, and the voice data indicates a user's action and a predetermined one in response to the instruction. When the predetermined input information to be input to the device different from the user terminal when using the service or purchasing the predetermined product according to the instruction is input to the device and then reproduced. It is a program characterized by including.
The fifth invention is a program for making a user terminal such as a mobile terminal owned by the user function as the user terminal of the first invention.

A sixth invention is a program for making a computer function as a server having a voice transmission means for transmitting character voice data to a user terminal and an input information transmission means for transmitting predetermined input information to the user terminal. The voice data is different from the user terminal when instructing the user's action and when using a predetermined service according to the instruction or when purchasing a predetermined product according to the instruction. The program is characterized in that the input information input to the device includes a data to be reproduced after being input to the device.
The sixth invention is a program for making a computer function as a server of the second invention.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a user terminal or the like that enables an exchange in which a character such as a virtual world can be felt closer to the user, and the exchange is useful from a commercial point of view.

The figure which shows the schematic structure of the character exchange system 1. The figure which shows the hardware configuration of a server 3. The figure which shows the user information 300 and the event information 400. Example of exchange time zone 305. The figure which shows the hardware configuration of a user terminal 4. The figure which shows the photography apparatus 6. The figure explaining the functional structure of the character exchange system 1. A flowchart showing the procedure of the part of the character exchange event in which the character greets the user. An example of display on the display unit 45 of the user terminal 4. The figure explaining the interaction between character A and user B. A flowchart showing the procedure of the part of the character exchange event in which the user acts for the character. The figure explaining the interaction between character A and user B. An example of display on the display unit 45 of the user terminal 4. An example of ordering menu C or purchasing product D using an electronic coupon.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

(1. Character exchange system 1)
FIG. 1 is a diagram showing a schematic configuration of a character exchange system 1 according to an embodiment of the present invention. The character exchange system 1 provides an event (hereinafter referred to as a character exchange event) in which a user interacts with a character in a virtual world such as a cartoon or an animation in the real world. However, the characters to be exchanged are not limited to this, and may be those of celebrities in the real world such as entertainers.

In the character exchange event of this embodiment, one that receives a reward by clearing the event achievement condition (hereinafter referred to as a condition achievement type) and one that does not have such a condition (hereinafter referred to as a non-condition achievement type). However, these details will be described later. Further, in the present embodiment, an example will be described in which the above-mentioned event achievement condition is "to use the photography service with the photography apparatus 6 at a predetermined place".

As shown in FIG. 1, the character exchange system 1 includes a server 3, a user terminal 4, an analysis device 5, a photography device 6, and the like.

The server 3 executes various processes in the character exchange system 1. FIG. 2 is a diagram showing a hardware configuration of the server 3, and the server 3 can be realized by a computer configured by connecting a control unit 31, a storage unit 32, a communication unit 33, and the like by a bus. However, the configuration of the server 3 is not limited to this, and can be changed as appropriate. Further, the server 3 may be realized by a plurality of computers.

The control unit 31 includes a CPU, ROM, RAM, and the like. The CPU calls a program stored in a storage medium such as a storage unit 32 and a ROM into a work area on the RAM and executes the program. The ROM is a non-volatile memory and permanently holds a boot program, a program such as a BIOS, data, and the like. The RAM is a volatile memory, and includes a work area used by the control unit 31 to perform various processes while temporarily holding programs and data loaded from the storage unit 32, ROM, and the like.

The storage unit 32 is a hard disk drive, a solid state drive, or the like, and stores a program executed by the server 3 in a process described later, data necessary for program execution, an OS, and the like. These programs and data are read out and executed by the control unit 31 as needed.

The communication unit 33 has a communication control device, a communication port, and the like, and mediates communication via a network. The server 3 is communicably connected to the user terminal 4, the analysis device 5, the photography device 6, and the like via a network, and can transmit and receive various data.

User information 300 and event information 400 are stored in the storage unit 32 of the server 3.

The user information 300 is information about the user and is registered in advance. As shown in FIG. 3A, in the present embodiment, the user ID 301, the registration information 302, the destination 303, the face image 304, the exchange time zone 305, and the like are stored in association with each other as the user information 300.

User ID 301 is identification information that identifies the user. The user ID 301 is issued by the server 3, for example, when the user pre-registers.

The registration information 302 is information for which the user pre-registers, for example, the user's name, address, age, and the like.

The destination 303 is information that specifies the destination when the server 3 transmits data related to the character exchange event, and is registered at the time of pre-registration of the user. The destination 303 is, for example, the identification information of the user terminal 4, the telephone number, the e-mail address, and the like, but is not limited thereto.

The face image 304 is a face image of the user. For example, when performing pre-registration, the user captures his / her face image with the camera 46 (see FIG. 5) of the user terminal 4 and transmits the face image to the server 3 for registration.

The exchange time zone 305 is a time zone in which the character exchange event occurs, and is set by the user at the time of pre-registration, and can be changed and reset later.

FIG. 4 is an example of the exchange time zone 305. In the present embodiment, a plurality of non-overlapping divisions of the day, that is, three divisions of morning, noon, and afternoon are defined as time zones in which the character exchange event occurs. .. The time zone of each division is set by the user. In the example of FIG. 4, the morning exchange time zone 305 is from 8:00 to 10:00, and the daytime exchange time zone 305 is 11:30. From 12:30 to 12:30, the afternoon exchange time zone 305 is set from 15:00 to 22:00.

The event information 400 is information about the character exchange event, and is recorded in advance in the storage unit 32. As shown in FIG. 3B, in the present embodiment, the event information 400 includes date 401, time zone division 402, voice data (regular) 403, voice data (when arriving at a predetermined place) 404, service ID 405, and voice data ( (At the time of event achievement) 406, event image 407, etc. are stored in association with each other.

Date 401 is the date on which the character exchange event occurs. In the present embodiment, for example, it is assumed that an event occurs on each day for a certain period from summer to autumn, and time zone division 402, voice data (regular) 403, voice data (when arriving at a predetermined place) 404, service ID 405, voice Data (at the time of event achievement) 406, event image 407, etc. are determined on a daily basis.

The time zone division 402 is a division of the time zone in which the character exchange event occurs. In the present embodiment, as described above, three non-overlapping divisions (morning, noon, and afternoon) of the day are defined.

The voice data (regular) 403 is voice data to be reproduced by the user terminal 4 in the exchange time zone 305 as a part of the character exchange event. The voice data 403 is voice data emitted by the character, and is predetermined according to the event scenario. Further, it is assumed that the audio data 403 is recorded by a stereophonic method such as binaural recording.

The voice data (when arriving at a predetermined place) 404 is voice data to be reproduced by the user terminal 4 of the user who has arrived at the predetermined place in order to clear the above-mentioned event achievement condition. The voice data 404 is voice data emitted by the character as described above, and is predetermined according to the event scenario. Further, it is the same as the above that it is recorded by a stereophonic method such as binaural recording.

The service ID 405 is input information that the user inputs to the photographing device 6 in order to clear the event achievement condition, and is information that identifies the photographing service provided by the photographing device 6. The service provides a user who has taken a picture with the photography device 6 with an image in which the user and the character are taken together, which will be described later.

The voice data (at the time of event achievement) 406 is defined separately from the voice data 403 and 404 as voice data to be reproduced on the user terminal 4 of the user who has cleared the event achievement condition. The voice data 406 is also voice data emitted by the character as described above, and is predetermined according to the event scenario. Further, it is the same as the above that it is recorded by a stereophonic method such as binaural recording.

The event image 407 is image data provided as a reward to a user who has cleared the event achievement condition, and is transmitted from the server 3 to the user terminal 4 of the user.

As described above, in the present embodiment, the character exchange event includes a condition achievement type event and a non-condition achievement type event, and the voice data (when arriving at a predetermined place) 404, the service ID 405, the voice data (when the event is achieved) 406, The event image 407 is set only for the former.

Returning to the description of FIG. The user terminal 4 is a terminal owned by a user who uses the service, and is, for example, a mobile terminal such as a smartphone or a tablet terminal.

FIG. 5 is a diagram showing a hardware configuration of the user terminal 4. As the user terminal 4, for example, a computer terminal configured by connecting a control unit 41, a storage unit 42, a communication unit 43, an input unit 44, a display unit 45, a camera 46, an audio input / output unit 47, and the like by a bus is used. However, the configuration of the user terminal 4 is not limited to this, and can be changed as appropriate.

The functions of the control unit 41, the storage unit 42, and the communication unit 43 of the user terminal 4 are substantially the same as those of the control unit 31, the storage unit 32, and the communication unit 33 described above, and the storage unit 42 has a process described later by the user terminal 4. A dedicated application program for executing is stored.

The display unit 45 is, for example, a liquid crystal display or the like, and a touch panel as an input unit 44 is provided. The camera 46 is a digital camera provided with an image sensor such as a CCD or CMOS. The voice input / output unit 47 includes a microphone for inputting voice, a speaker for outputting voice, and the like.

The analysis device 5 executes various analysis processes when the character exchange event is carried out. As the analysis device 5, a computer having a control unit, a storage unit, a communication unit, and the like can be used as in the server 3.

The photography device 6 is for taking a picture of a user, printing a photographed image, and the like, and is installed outdoors such as a street or a tourist spot, or a commercial facility such as a shopping center. FIG. 6A is a diagram showing the appearance of the photography device 6, and FIG. 6B is a diagram showing the system configuration of the photography device 6.

The photography device 6 has a box-like appearance in which a user enters and takes a picture, and has a control device 60, a display unit 61, a billing unit 62, a photographing unit 63, a lighting 64, a printer 65, a printed matter outlet 67, and the like. It has a background plate 68 and the like.

The control device 60 is provided inside the photography device 6 and controls the entire processing of the photography device 6. The control device 60 can be realized by, for example, a computer having a control unit, a storage unit, and a communication unit. However, the present invention is not limited to this, and various configurations can be taken as appropriate.

The display unit 61 is realized by a display with a touch panel or the like that also serves as an input unit of the photography device 6. The display unit 61 displays various screens related to the user's operation and selection, and accepts the user's instruction input and the like on the screen.

The billing unit 62 includes a coin / banknote slot, a change return slot, a receipt outlet, a receipt printer, etc. (not shown), and manages billing and issuance of receipts from users.

The photographing unit 63 is provided with a camera or the like inside the photographing window. For example, a high-resolution digital camera is used as the camera, but the camera is not limited to this.

The illumination 64 is an illumination for photographing the user. The illumination 64 is, for example, a surface light source that irradiates white light, and is provided above the photographing unit 63, but is not limited thereto.

The printer 65 prints an image and is provided inside the photography apparatus 6. The printed matter on which the image is printed is discharged to the printed matter outlet 67. The method of the printer 65 and the number of installed printers are not particularly limited.

The background plate 68 is provided at the rear portion of the photography device 6 (corresponding to the right side of FIG. 6A) and serves as a background for the user to take a picture. The background plate 68 is composed of a panel of a predetermined color or the like.

Next, the functional configuration of the character exchange system 1 will be described with reference to FIG. 7. As shown in FIG. 7, in the character exchange system 1, the server 3 has a voice transmitting means 310, an input information transmitting means 320, and the like, and the user terminal 4 has a voice receiving means 410, a reproducing means 420, an input information receiving means 430, and the like. Has.

In the voice transmission means 310, the control unit 31 of the server 3 transmits voice data 403, 404, and 406 to the user terminal 4 via the communication unit 33. Of these, the voice data 403 and 404 may include an instruction of the user's action, and in the present embodiment, the instruction is "to use the photography service with the photography device 6 at a predetermined place". The voice data 406 is reproduced after the user inputs the service ID 405 or the like into the photographing device 6 corresponding to the instruction and uses the photographing service, and the details thereof will be described later.

In the input information transmitting means 320, the control unit 31 of the server 3 transmits the service ID 405 or the like input to the photography device 6 to the user terminal 4 via the communication unit 33.

In the voice receiving means 410, the control unit 41 of the user terminal 4 receives voice data 403, 404, 406 from the server 3 via the communication unit 43.

In the reproduction means 420, the control unit 41 of the user terminal 4 reproduces the audio data 403, 404, and 406 by the speaker of the audio input / output unit 47.

In the input information receiving means 430, the control unit 41 of the user terminal 4 receives the service ID 405 and the like from the server 3 via the communication unit 43.

(2. Character exchange event)
Next, a character exchange event (character exchange method) to be carried out by the character exchange system 1 will be described. In the character exchange event of the present embodiment, the characters in the virtual world interact with the user at the exchange time zone 305 set in advance by the user.

In particular, in the present embodiment, a scenario is set on the premise that the user and the character have a romantic relationship, and in the character exchange event, the voice data 403, 404, and 406 predetermined according to the scenario are the user terminals. Reproduced in 4. As a scenario, the character meets the user and greets the user, and the user takes further action for the character after the greeting. Each procedure will be described below.

(2-1. Scenario 1; Character greeting)
FIG. 8 is a flowchart showing the procedure of the part of the character exchange event in which the character greets the user. S101, S106 to S109, and S111 in FIG. 8 are processes in which the control unit 31 of the server 3 controls and executes each part of the server 3, and the control unit 41 of the user terminal 4 controls each part of the user terminal 4 in other processes. Control and execute.

As shown in FIG. 8, in the present embodiment, when the start time of the preset exchange time zone 305 is reached, the server 3 transmits an event start notification to the user terminal 4 (S101).

When the user terminal 4 receives the event start notification (S102), the user terminal 4 displays the notification on the display unit 45 of the user terminal 4 (S103). FIG. 9A is an example of this event start notification 501, and "She has come" is displayed on the display unit 45 of the user terminal 4. This assumes that the character A is coming to see the user in the scenario as shown in FIG. 10A, and at this point, the user (indicated by B in the figure) is still meeting the character. Absent. The event start notification 501 of the present embodiment does not involve the reproduction of voice, but may include the reproduction of voice such as "She has come".

For example, the user activates the application by flicking the event start notification 501, and the user terminal 4 causes the display unit 45 to display the selection screen as shown in FIG. 9B. On the selection screen, the "Meet immediately" button 502 and the "Wait" button 503 are displayed. When the user selects the "Meet immediately" button 502 by tapping or the like, the user terminal 4 activates the camera 46 and the user. The camera 46 captures a user's face image in response to the operation of, and accepts the input (S104). When the user selects the "wait" button 503, the screen returns to the previous screen shown in FIG. 9A.

Here, the user captures his / her face image and inputs it to the user terminal 4 by showing the user's face to the character in the scenario, that is, as shown in FIG. 10B, the user B takes the character A. It is supposed to go to meet and meet.

The user terminal 4 transmits the face image to the server 3 (S105). When the server 3 receives the user's face image (S106), whether or not the received face image and the person in the face image 304 of the user information 300 (see FIG. 3A) match as authentication by the face image. (S107). In S107, for example, the server 3 transmits the double-faced image to the analysis device 5 to request analysis, the analysis device 5 determines whether or not the persons in the double-faced image match, and the determination result is obtained from the analysis device 5. Receive. Various known methods can be used as the determination method, and the determination method is not particularly limited.

If the people in the two face images do not match, the server 3 considers the authentication to be unsuccessful (S108; NG), and transmits the authentication failure to the user terminal 4 (S109). The user terminal 4 receives the fact that the authentication has failed, displays it on the display unit 45 (S110), and ends the process.

When the persons in the two face images match, the server 3 considers the authentication to be successful (S108; OK), and transmits the predetermined character voice data 403 to the user terminal 4 (S111). When the user terminal 4 receives the voice data 403 (S112), the user terminal 4 reproduces the voice data 403 (S113).

As shown in FIG. 10 (c), the voice data 403 assumes a greeting by character A such as "Yahho how are you?", And the user can feel as if he / she met character A and was greeted. it can. However, the content of the voice data 403 is not particularly limited, and various data can be considered depending on the content of the scenario and the character setting. Further, the image of the character may be transmitted to the user terminal 4 together with the voice data 403 so as to be displayed on the display unit 45 when the voice data 403 is reproduced. Further, the voice data 403 and the above image may be stored in the storage unit 42 of the user terminal 4.

Some character exchange events will end with the above process. The server 3 transmits an event end to the user terminal 4 when a predetermined time elapses after the transmission of the voice data 403 or when the end time of the exchange time zone 305 is reached, and the user terminal 4 sends an event to the display unit 45. A display indicating the end is displayed.

The event is such that the user greets the character in the virtual world when the user reaches the preset exchange time zone 305, and corresponds to the above-mentioned non-condition achievement type event. In the present embodiment, by having the user actively perform the action of taking and inputting a face image at the time of the event, the user can get the feeling that he / she has met and faced the character, and the character is familiar to the user. You can realize the exchange that you can feel.

On the other hand, in other character exchange events, after the above greeting, the user takes further actions for the character, and the user aims to clear the event achievement conditions by the actions. This corresponds to the above-mentioned condition achievement type event, and the voice data 403 reproduced in S113 emits not only the above-mentioned greeting but also the voice instructing the above-mentioned action after the greeting.

FIG. 10D is an example, and after the above greeting, a voice such as "Let's go to the XX shopping center" is continuously played, and the user depends on the target location ("XX shopping center"). Action is specified. The method of designating the user's behavior is not limited to the method of specifying the name of the place, but can also be performed by the category or attribute of the place, keywords that can be easily associated with the place, or the like.

(2-2. Scenario 2; Action for character)
The user who hears the above voice goes to a predetermined place (“○○ shopping center”) designated by the voice data 403 because of the character. FIG. 11 is a flowchart showing the procedure of the part of the character exchange event in which the user acts for the character. S201, S205 to S206, and S212 to S213 of FIG. 11 are processes in which the control unit 41 of the user terminal 4 controls and executes each part of the user terminal 4, and S207 to S209 are photographs taken by the control device 60 of the photographing device 6. This is a process of controlling and executing each part of the photographing device 6. The control unit 31 of the server 3 controls and executes each unit of the server 3 for other processes.

While the user goes to the predetermined location, the user terminal 4 periodically transmits the location information to the server 3 (S201), and the server 3 receives the location information from the user terminal 4 (S202), and the location information To determine whether or not there is a user at a predetermined location (S203).

When the server 3 determines that the user is not in the predetermined location (S203; NO), the server 3 waits for the reception of the position information again, but when it determines that the user is in the predetermined location (S203; YES), it is predetermined. The voice data 404 of the character, the user ID 301, the service ID 405, and the position information of the photography device 6 are transmitted to the user terminal 4 (S204). The user ID 301 and the service ID 405 are transmitted to the user terminal 4 as a code or a two-dimensional code obtained by encrypting the user ID 301 and the service ID 405, for example. However, it is not limited to this.

When the user terminal 4 receives the voice data 404, the user ID 301, the service ID 405, and the position information of the photography device 6 (S205), the user terminal 4 reproduces the voice data 404 (S206).

As shown in FIG. 12A, the voice data 404 directly specifies the user's behavior, that is, the use of the photography service in the photography apparatus 6, such as "Let's take a picture together". .. However, as described above, the method of designating the user's behavior is not particularly limited. Further, the image of the character may be transmitted to the user terminal 4 together with the voice data 404 so as to be displayed on the display unit 45 when the voice data 404 is reproduced. Further, the voice data 404 and the above image may be stored in the storage unit 42 of the user terminal 4.

The position information of the photography device 6 can be displayed as a mark 505 on the map 504 of the predetermined location (“○○ shopping center”) described above, for example, as shown in FIG. 13 (a) on the display unit 45 of the user terminal 4. The user who has heard the above sound can go to the installation location of the photography device 6 provided with the photography service with reference to the map 504.

The user who arrives at the installation location of the photography device 6 inputs the user ID 301 and the service ID 405 to the photography device 6, and the photography device 6 accepts the input of the user ID 301 and the service ID 405 (S207).

In the present embodiment, the "receive service" button 506 is displayed together with the map 504 on the display screen shown in FIG. 13 (a), and by selecting the button 506, the user as shown in FIG. 13 (b). The code 507 and the two-dimensional code 508, which are the character strings that encrypt the ID 301 and the service ID 405, are displayed. In S207, the user directly inputs the code 507 using the touch panel or the like of the display unit 61 of the photography device 6, or displays the code 507 when the photography device 6 includes a reading unit of the two-dimensional code 508. The two-dimensional code 508 displayed on the unit 45 is read by the reading unit. That is, in the present embodiment, the photography device 6 corresponds to the "device for inputting input information such as the service ID 405 (different from the user terminal 4)" in the present invention.

The photography device 6 decodes the input code 507 or the two-dimensional code 508 to acquire the user ID 301 and the service ID 405, and provides the user with a photography service corresponding to the service ID 405. The service is to provide an image in which the user and the character are taken together to the user who has taken a picture with the photography device 6 as described above, and the photography device 6 takes a picture of the user (S208). ..

Taking a picture with the photography device 6 assumes that, in the scenario, the user takes the character A to the photography device 6 and takes a picture together, as shown in FIG. 12B. It is a thing. Reference numeral 500 in FIG. 12C is an example of an image in which the user and the character are captured together (composite image of the user and the character), which will be provided to the user later, which will be described later.

The photography device 6 transmits the photographed image taken in S208 to the server 3 together with the user ID 301 and the service ID 405 (S209).

When the server 3 receives the user ID 301, the service ID 405, and the photographed image from the photography device 6 (S210), it is assumed that the event achievement condition for the user is cleared, and the predetermined character voice data 406 and the event image 407 are satisfied. , And the composite image 500 of the user and the character is transmitted to the user terminal 4 (S211).

The composite image 500 is created by, for example, the server 3 extracting the user's image from the captured image received in S210 by chroma key processing or the like, and combining this with the image of the character A stored in the storage unit 32 in advance. .. An image obtained by further synthesizing a special frame image or the like may be used.

When the user terminal 4 receives the voice data 406, the event image 407, and the composite image 500 (S212), the user terminal 4 reproduces the voice data 406 (S213).

As shown in FIG. 12 (c), this voice data 406 is assumed to be thankful to the user of character A such as "Wow thank you", but various data can be considered depending on the content of the scenario and the character setting. As the audio data 406, as shown in FIG. 12 (d), a farewell greeting, for example, "It was fun today" may be included and played after "Wow thank you". Similar to the above, the voice data 406 may be stored in the storage unit 42 of the user terminal 4.

The event image 407 is image data distributed to the user separately from the composite image 500 as an event achievement reward. The event image 407 is, for example, a privilege image of a character, and is displayed on the display unit 45 when the voice data 406 is reproduced. As an event achievement reward, data such as music may be transmitted to the user terminal 4 and played back instead of the event image 407 or in combination with the event image 407.

As described above, the condition achievement type event ends. Also in this case, the server 3 transmits the event end to the user terminal 4 when a predetermined time elapses after the transmission of the voice data 406 or when the end time of the exchange time zone 305 is reached, and the user terminal 4 displays the event. A display indicating the end of the event is displayed on the unit 45.

In the condition achievement type event, the user is made to take the action of using the photography service with the photography device 6 positively, and then the voice such as the character's appreciation is played, so that the user is as if for the character. By doing something to the character, it is possible to get a feeling that the character has received gratitude for the action, and it is possible to realize an exchange in which the character feels familiar to the user. In addition, since the photography service of the photography apparatus 6 is used as part of the event, it is also useful from a commercial point of view.

After the voice data 406 is reproduced, it may be a condition-achieving event end condition that the user inputs voice data such as "Baibai" to the user terminal 4 via the microphone of the voice input / output unit 47.

In this case, the user terminal 4 transmits the voice data to the server 3. For example, the voice data of the user is registered in advance in the server 3 as the user information 300, and the transmitted voice data is used by the user by using the similarity between the voice data and the voiceprint of the transmitted voice data. Judge whether or not. The similarity of voiceprints can be calculated by an analyzer 5 or the like by a known method. For example, when the similarity of the voiceprints of both voice data is equal to or higher than a predetermined value, the server 3 assumes that the transmitted voice data belongs to the user and transmits to the user terminal 4 that the event has ended.

Further, when the similarity is equal to or higher than a predetermined value and the meaning and content of the transmitted voice data is a predetermined value (for example, a farewell greeting such as "Baibai"), the user terminal 4 is notified that the event has ended. You may send it. The analysis of the meaning and content can also be performed by the analysis device 5 or the like by a known method.

The above is the same for the non-condition achievement type event (event that ends only in the flow of FIG. 8), and after the reproduction of the above-mentioned voice data 403, the user inputs voice data such as "Baibai" to the voice input / output unit 47. The event end condition may be that input to the user terminal 4 is performed via the microphone or the like.

As described above, the user terminal 4 of the present embodiment reproduces the voice data 403 of the character instructing the user's action, and photographs the service ID 405 and the like when the user uses the photography service in response to the instruction. By inputting it to the photographing device 6, another voice data 406 such as a character's appreciation is reproduced. As a result, in this embodiment, an exchange scene is created in which the character reacts to the character by the action of the user, and the user feels as if he / she received the appreciation from the character by doing something for the character. You can get it and feel the character close to you.

In this way, in the present embodiment, by encouraging the user to take positive action, it is possible to realize an exchange in which the character feels closer to the user. Moreover, since the action uses a photography service, it can be linked to the promotion of the use of the photography service, which is also useful from a commercial point of view. Further, as the photography service, by providing the user with a composite image 500 in which the user and the character are combined, the user can get the feeling that the photograph is taken together with the character. Encouraging user actions is also effective as a withdrawal measure.

Further, it is assumed that the voice data 403, 404, and 406 are recorded by the stereophonic method, and the user can feel as if the character actually exists on his / her side by listening to the voice data through an earphone or the like. ..

Further, in the present embodiment, the user terminal 4 receives the voice data 403, 404, 406, the service ID 405 and the like input to the photography device 6 from the server 3, and the character exchange system 1 including the user terminal 4 and the server 3 The service can be provided to the user.

However, the present invention is not limited to this. For example, in the present embodiment, the server 3 creates a composite image 500 in which the user and the character are captured together and transmits the composite image 500 to the user terminal 4. However, the composite image 500 is created by the photography device 6 and the composite image is created by the photography device 6. The 500 may be printed, or the user terminal 4 may be able to receive (download) the composite image 500 from the photography device 6.

Further, in the present embodiment, the voice data 403 instructs the user to go to a predetermined place (“○○ shopping center”), and the voice data 404 instructs the user to use the photography device 6 at that place. It is also possible to directly instruct to use the photography device 6 at the predetermined location by the voice data 403.

Further, in the present embodiment, the use of the photography service in the photography device 6 is promoted as a part of the character exchange event, but the service for encouraging the user to use the photography service is not limited to this. For example, it is possible to encourage the use of a predetermined restaurant such as a coffee chain as shown in FIG. 14 (a). In this case, for example, the electronic data available at the predetermined restaurant in S111 (see FIG. 8). The coupon (predetermined input information) and the user ID 301 are transmitted to the user terminal 4 together with the voice data 403 as the two-dimensional code 508, and the user's action (event achievement condition) instructed by the voice data 403 or the like is described as "the event achievement condition". Use the designated restaurant using an electronic coupon. "

When the user places an order for menu C (for example, coffee) at a restaurant according to the above instruction, the user causes the store's reading device 100 to read the two-dimensional code 508, and the reading device 100 obtains the two-dimensional code 508 by decoding the two-dimensional code 508. The electronic coupon and the user ID 301 are transmitted to the server 3. When the server 3 receives this information, it is assumed that the event achievement condition is cleared for the above user.

It is also possible to encourage the user to purchase a predetermined product as part of the character exchange event. For example, as described above, an electronic coupon (predetermined input) that can be used when purchasing a predetermined product in S111 (see FIG. 8). Information) and the user ID 301 are transmitted to the user terminal 4 together with the voice data 403 as the above-mentioned two-dimensional code 508, and the user's action (event achievement condition) instructed by the voice data 403 or the like is described as "using the electronic coupon. To purchase a prescribed product. "

As shown in FIG. 14B, when purchasing a predetermined product D according to the above instruction at a retail store or the like, the user causes the store's reading device 100 to read the two-dimensional code 508 in the same manner as described above. The device 100 transmits the electronic coupon obtained by decoding the two-dimensional code 508 and the user ID 301 to the server 3. When the server 3 receives this information, it is assumed that the event achievement condition is cleared for the above user. In this case as well, the action instruction to the user can be linked to the promotion of the product D, which is useful from a commercial point of view. It should be noted that these electronic coupons can also be transmitted to the user terminal 4 in S211 (see FIG. 11) as a reward when the event is achieved. In the examples of FIGS. 14A and 14B, the reading device 100 corresponds to the "device for inputting input information such as an electronic coupon (different from the user terminal 4)" in the present invention.

Further, in the present embodiment, the authentication by the user's face image is performed in S107 of FIG. 8, but the authentication by the face image can be omitted. In this case, when the "meet immediately" button 502 is selected on the selection screen shown in FIG. 9B, the server 3 transmits the voice data 403 including the action instruction to the user terminal 4. In addition, it is also possible to reproduce the voice data 403 by reading the code distributed in a predetermined area or the like with the user terminal 4. In this case, the above code is recorded as event information 400 in the storage unit 32 of the server 3, and when the above code read by the user terminal 4 is received from the user terminal 4, the voice data 403 is transmitted to the user terminal 4. And play it.

Further, at the time of reproducing the voice data 403, 404, 406, in addition to the character image, a text version of the voice data 403, 404, 406 may be displayed on the display unit 45. These texts can be transmitted from the server 3 together with the voice data 403, 404, and 406, and may be stored in the user terminal 4.

Further, in the present embodiment, the voice data 403 is transmitted from the server 3 to the user terminal 4 when the authentication by the face image is successful. For example, when the application is downloaded, the voice data 403 is also downloaded in advance for authentication. At the time of success, the server 3 may send a playback instruction of the voice data 403 to the user terminal 4 so that the voice data 403 is played back on the user terminal 4. This also applies to the voice data 404 when arriving at a predetermined place, the voice data 406 when the event is achieved, and the event start notification 501 when the start time of the exchange time zone 305 is reached.

Further, in the present embodiment, it is determined that the user is in a predetermined place based on the position information of the user terminal 4, but for example, the server 3 transmits a specific code together with the voice data 403 to the user terminal 4, and the predetermined code is transmitted. When the code is read by a reading device (not shown) installed at a place, it may be determined that the user is at the place. Further, the operation may be such that the user is determined to be in the place by reading the code distributed in the predetermined place by the user terminal 4. In these cases, the above code is recorded as event information 400 in the storage unit 32 of the server 3, and when the code read by the reading device or the user terminal 4 is received from the reading device or the user terminal 4, the user can use the code. Assuming that the user is in that location, the voice data 404 is transmitted to the user terminal 4 for reproduction. In these cases, the determination based on the position information of the user terminal 4 becomes unnecessary.

Further, in the present embodiment, the event achievement condition is cleared by transmitting the service ID 405 or the like from the photography device 6 to the server 3, but the photographed image transmitted from the photography device 6 to the server 3 is that of the user. It may be a condition necessary for clearing the event achievement condition. In this case, the server 3 uses the same procedure as when authenticating with the face image (see S107 in FIG. 8) to see if the person in the photographed image matches the person in the face image 304, that is, the photographed image is the user. It is possible to determine whether or not it is a thing. Further, it is also possible that the server 3 receives the service ID 405 or the like from both the photography device 6 and the user terminal 4 as well as the photography device 6, which is a necessary condition for clearing the event achievement condition. Can be enhanced.

In addition, if the event start notification 501 is given but the face image is not authenticated after that and the event is not carried out, the event in the exchange time zone 305 should be carried over to another day, for example, the next day in the same division. Is also possible. Similarly, if the event is not held as described above in all the time zones of the day, it is possible to carry over all the events to another day.

Although preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications or modifications within the scope of the technical idea disclosed in the present application, and these also naturally belong to the technical scope of the present invention. Understood.

1: Character exchange system 3: Server 4: User terminal 5: Analysis device 6: Photographing device 300: User information 301: User ID
302: Registration information 303: Destination 304: Face image 305: Exchange time zone 310: Voice transmission means 320: Input information transmission means 400: Event information 401: Date 402: Time zone division 403, 404, 406: Voice data 405: Service ID
407: Event image 410: Voice receiving means 420: Playing means 430: Input information receiving means 500: Composite image 501: Event start notification

Claims (10)

A user terminal having a reproduction means for reproducing the voice data of a character.
The voice data is
Those that direct the user's actions and
After the predetermined input information to be input to the device different from the user terminal when using the predetermined service according to the instruction or purchasing the predetermined product according to the instruction is input to the device. What will be played and
A user terminal characterized by including. The user terminal according to claim 1, wherein the voice data is recorded by a stereophonic system. A voice receiving means for receiving the voice data from the server,
An input information receiving means for receiving the input information from the server, and
The user terminal according to claim 1 or 2, wherein the user terminal has. The audio data includes data to be reproduced after the input information input to the photography device, which is the device, is input to the photography device when the photography service, which is the predetermined service, is used. The user terminal according to any one of claims 1 to 3, wherein the user terminal is characterized by the above. The user terminal according to claim 4, wherein an image obtained by synthesizing a user image and a character image taken by the photography device is received from a server or the photography device. A voice transmission means for transmitting character voice data to a user terminal,
An input information transmitting means for transmitting predetermined input information to the user terminal, and
Have,
The voice data is
Those that direct the user's actions and
When the input information to be input to a device different from the user terminal when using a predetermined service according to the instruction or when purchasing a predetermined product according to the instruction is input to the device and then reproduced. What is done and
A server characterized by containing. A character exchange system that has a user terminal and a server.
The user terminal is
A voice receiving means for receiving character voice data from the server, and
A reproduction means for reproducing the audio data and
An input information receiving means for receiving predetermined input information from the server, and
Have,
The voice data is
Those that direct the user's actions and
When the input information to be input to a device different from the user terminal when using a predetermined service according to the instruction or when purchasing a predetermined product according to the instruction is input to the device and then reproduced. What is done and
A character exchange system characterized by including. The user terminal
The step of playing the voice data of the character that instructs the user's action,
After the predetermined input information to be input to the device different from the user terminal when using the predetermined service according to the instruction or when purchasing the predetermined product according to the instruction is input to the device. Steps to play another voice data of the character,
A character interaction method characterized by performing. A program for making a user terminal function as a reproduction means for reproducing voice data of a character.
The voice data is
Those that direct the user's actions and
After the predetermined input information to be input to the device different from the user terminal when using the predetermined service according to the instruction or purchasing the predetermined product according to the instruction is input to the device. What will be played and
A program characterized by including. Computer,
A voice transmission means for transmitting character voice data to a user terminal,
An input information transmitting means for transmitting predetermined input information to the user terminal, and
It is a program to function as a server with
The voice data is
Those that direct the user's actions and
When the input information to be input to a device different from the user terminal when using a predetermined service according to the instruction or when purchasing a predetermined product according to the instruction is input to the device and then reproduced. What is done and
A program characterized by including.

Images