JP2021034977A - Server, reproduction device, content reproduction system, content reproduction method, and program - Google Patents

Abstract

To provide a server and the like capable of enriching a user's sightseeing experience.SOLUTION: A server 3 is communicably connected to a reproduction device 2 for a user to view content data including video and voice of a character. The server 3 includes: transmission means 31 for transmitting reproduction information on content data to a reproduction device 2 so that video of a character with a background of an actual space is displayed on the reproduction device 2; reception means 32 for receiving image information and voice information acquired by the reproduction device 2 using a sensor 22; and analysis means 33 for analyzing the image information and the voice information. When a result of analysis by the analysis means 33 shows that the voice information includes an instruction to designate a position of the character using relation with another user differing from the user and the image information includes the other user, the transmission means 31 transmits to the reproduction device 2 reproduction information for displaying the video of the character at the designated position.SELECTED DRAWING: Figure 6

Description

The present invention relates to a server or the like for playing back content on a user's playback device.

Tourists enjoy sightseeing by taking pictures of the scenery with a camera and taking pictures of themselves and their companions against the background of the scenery. In addition, a stationary photography device such as Patent Document 1 may be installed in a tourist facility, a tourist spot, etc., and a tourist's person image is extracted from an image taken by the tourist by chroma key processing, and the tourist facility is used. It can be provided to tourists by synthesizing it with a predetermined background image according to the tourist spot or the like.

Further, Patent Document 2 discloses that AR (Augmented Reality) technology is used to display contents such as a virtual building on an image of a real space with an observation mirror of a tourist facility or a tourist spot. , Tourists can feel as if the building etc. exists in the real space.

Japanese Unexamined Patent Publication No. 2019-003304 Japanese Patent Application Laid-Open No. 2003-264740

These technologies enrich the user's tourism experience, but in tourist facilities and tourist destinations, the user's overall tourism experience is enriched, the user's satisfaction is increased, and the number of visitors is increased. It is required to connect to.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a server or the like that can enrich a user's sightseeing experience.

The first invention for solving the above-mentioned problems is a server communicatively connected to a playback device for a user to view content data including video and audio of a character, and the playback device is connected by a sensor. The content data so that the receiving means for receiving the acquired image information and the voice information, the analysis means for analyzing the image information and the voice information, and the video of the character are displayed on the playback device against the background of the real space. The transmission means includes a transmission means for transmitting the reproduction information of the character to the reproduction device, and the transmission means designates the position of the character in the voice information in relation to a person different from the user as a result of analysis by the analysis means. When the image information includes the person, the server is characterized by transmitting the reproduction information for displaying the image of the character at the designated position to the reproduction device. is there.

In the present invention, while the user is sightseeing, the video and audio of the character are played back on the playback device worn by the user against the background of the real space, so that the user feels as if he / she is enjoying sightseeing with the character. Can be obtained, and the user's comprehensive sightseeing experience can be enriched. Moreover, the user can display the image of the character at the designated position by giving an instruction to specify the position of the character in relation to the person in the image information by voice. As a result, in the present invention, the user can instruct the character to move and the character can take concrete communication to respond to the movement, so that the feeling of enjoying sightseeing with the character is deepened and the person is also. The character can be placed in an appropriate position according to various situations during sightseeing such as shooting.

It is desirable that the server stores the face image and the nickname of the person as member information in the storage unit, and the analysis means performs analysis using the member information.
When a plurality of users such as family members and friends go sightseeing together, each person's face image and name can be registered in advance and used for the above analysis. This allows each user to specify the position of the character in relation to another user.

It is desirable that the server be communicably connected to a glasses-type wearable device as the playback device.
This enhances the user's immersive feeling and makes the character feel as if it actually exists.

It is desirable that the transmission means transmits reproduction information of content data displaying a common character to the reproduction devices of a plurality of users.
This makes it possible to enrich each person's sightseeing experience when sightseeing with family and friends.

The second invention is a playback device for a user to view content data including video and audio of a character, and reproduces the content data so that the video of the character is displayed against a background of real space. The reproduction means includes an instruction that the voice information obtained by the sensor of the reproduction device specifies the position of the character in relation to a person other than the user, and the reproduction device. When the person is included in the image information obtained by the sensor of the above, the reproduction device is characterized in that the image of the character is displayed at the designated position.
The second invention is a reproduction device capable of voice-instructing the position of a character according to the relationship with a person in image information.

It is desirable that the playback device captures the person so that a composite image of the person and the character is created after displaying the image of the character at the designated position.
As a result, the character can be moved to a preferable position to take a picture of the person, and a composite image of the person and the character can be obtained.

A third invention is a content reproduction system including a playback device for a user to view content data including video and audio of a character and a server, wherein the server is an image acquired by the playback device by a sensor. Reproduction information of the content data so that the reception means for receiving the information and the audio information, the analysis means for analyzing the image information and the audio information, and the image of the character are displayed on the reproduction device against the background of the real space. The transmission means includes, as a result of analysis by the analysis means, an instruction to specify the position of the character in the voice information in relation to a person other than the user. It is a content reproduction system characterized in that when the image information includes the person and the person is included, the reproduction information for displaying the image of the character at the designated position is transmitted to the reproduction device. ..
A third invention is a content reproduction system including the server of the first invention.

In the fourth invention, a server communicatively connected to a playback device for viewing content data including character video and audio by a user receives image information and audio information acquired by the playback device by a sensor. A step of analyzing the image information and the audio information, and a step of transmitting the reproduction information of the content data to the reproduction device so that the image of the character is displayed on the reproduction device against the background of the real space. , And as a result of the analysis, when the voice information includes an instruction to specify the position of the character in relation to a person other than the user, and the image information includes the person, the above. This is a content reproduction method characterized in that reproduction information for displaying a character image at a designated position is transmitted to the reproduction device.
The fourth invention is the content reproduction method by the server of the first invention.

A fifth invention receives image information and audio information acquired by a sensor of a server connected to a reproduction device for viewing content data including video and audio of a character so as to be communicable with the reproduction device. The receiving means, the analysis means for analyzing the image information and the audio information, and the reproduction information of the content data are transmitted to the reproduction device so that the image of the character is displayed on the reproduction device against the background of the real space. A program for functioning as a transmission means, the transmission means instructing the voice information to specify the position of the character in relation to a person other than the user as a result of analysis by the analysis means. Is included, and when the person is included in the image information, the program is characterized in that the reproduction information for displaying the image of the character at the designated position is transmitted to the reproduction device.
The fifth invention is a program for operating the server of the first invention.

A sixth aspect of the present invention is to reproduce a playback device for a user to view content data including a character's video and audio so that the character's video is displayed against a background of real space. As a means, the audio information obtained by the sensor of the playback device includes an instruction to specify the position of the character in relation to a person other than the user, and the image information obtained by the sensor of the playback device. Is a program for functioning as a reproduction means for displaying the image of the character at the designated position when the person is included in the.
The sixth invention is a program for making the reproduction device of the second invention function.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a server or the like that can enrich a user's sightseeing experience.

The figure which shows the structure of the content reproduction system 1. The figure which shows the appearance of the reproduction device 2. The figure which shows the hardware composition of the reproduction device 2. The figure which shows the hardware configuration of a server 3. The figure which shows the purchase information 322, the landmark data 323, and the member information 324. The figure which shows the functional structure of the content reproduction system 1. The flowchart which shows the process performed in the content reproduction system 1. An example of image information 350. The figure which shows the positional relationship between the user a and the character b. An example of displaying the image of character b. An example of the display of the image of character b and the composite image 360. An example of sharing the position of the character b with respect to a plurality of users a1 and a2.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

(1. Content playback system 1)
FIG. 1 is a diagram showing a configuration of a content reproduction system 1 according to an embodiment of the present invention. As shown in FIG. 1, the content reproduction system 1 is configured by connecting a plurality of reproduction devices 2 and a server 3 or the like so as to be communicable by a network 5.

In the content playback system 1 of the present embodiment, a plurality of users who are sightseeing together wear the playback device 2 at a tourist facility or a tourist spot, for example, an amusement facility, a theme park, a zoo, an art museum, a museum, a historic site, or the like. It is for viewing data.

The playback device 2 is a device for a user to view content data including video and audio of a character against a background of a real space, and for example, a wearable device such as a glasses-type smart glass or a head-mounted display is used. In this embodiment, an example of using smart glasses as the reproduction device 2 will be described.

FIG. 2 is a diagram showing the appearance of the reproduction device 2 (smart glasses), and FIG. 3 is a diagram showing the hardware configuration of the reproduction device 2. The playback device 2 includes a control unit 201, a storage unit 202, a communication unit 203, a motion sensor 204, a position sensor 205, a transmissive display 206, a microphone 207, a speaker 208, a camera 209, a peripheral device I / F unit 210, and the like on the frame 200. Is provided. However, the configuration of the reproduction device 2 is not limited to this, and various configurations can be appropriately taken.

The control unit 201 is composed of a CPU, ROM, RAM, and the like. The CPU calls and executes a program stored in a storage medium such as a storage unit 202 and a ROM in a work memory area on the RAM, and drives and controls each unit of the playback device 2. ROM permanently holds computer boot programs, programs such as BIOS, and data. The RAM temporarily holds the loaded program and data, and also includes a work area used by the control unit 201 to perform various processes.

The storage unit 202 is a storage medium such as a flash memory. The storage unit 202 stores a program executed by the control unit 201, data necessary for program execution, an operating system, and the like.

The communication unit 203 has a communication device such as wireless LAN, Bluetooth (registered trademark), short-range wireless communication, etc., and communicates via network 5, Bluetooth (registered trademark) compatible device, contactless IC card, etc. Control communication.

The motion sensor 204 includes a 9-axis sensor (geomagnetic sensor, acceleration sensor, gyro sensor), and acquires information such as the direction and orientation (tilt and rotation) of the reproduction device 2 and movement.

The position sensor 205 acquires the current position of the reproduction device 2. The position sensor 205 may detect the position of its own device by a signal from a satellite like GPS (Global Positioning System), or may detect the position of its own device by a radio wave strength from a wireless base station of a mobile phone or an access point of a wireless LAN. The position of the own device may be detected.

The transmissive display 206 is a see-through type display device, and is provided on each of the binocular portions of smart glasses, for example. The transmissive display 206 displays the image of the character input under the control of the control unit 201 against the background of the real space ahead of the transmissive display 206. The display of the character may be either 2D or 3D. It is also possible to use a retinal scanning type display instead of the transmissive type display 206.

The microphone 207 is a voice sensor that collects the voice of the user or the like, and the speaker 208 outputs the voice to the user or the like.

The camera 209 is an image sensor using an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and captures a moving image or a still image. As shown in FIG. 2, the camera 209 includes a center camera 209a arranged at the center of the reproduction device 2 and stereo cameras 209b arranged on the left and right sides.

The peripheral device I / F section 210 is a port for connecting peripheral devices, and data is transmitted / received to / from the peripheral device via the peripheral device I / F section 210. The connection form with peripheral devices may be wired or wireless. In the present embodiment, a controller (not shown) for inputting an operation instruction for the playback device 2 is connected to the peripheral device I / F unit 210. It is also possible to give an operation instruction to the reproduction device 2 by voice via the microphone 207.

Returning to the description of FIG. The server 3 executes various processes in the content reproduction system 1. Details of these processes will be described later.

FIG. 4 is a diagram showing a hardware configuration of the server 3. The server 3 can be realized by a computer having a control unit 301, a storage unit 302, a communication unit 303, and the like. However, the configuration of the server 3 is not limited to this, and various configurations can be appropriately taken. Further, the server 3 may be composed of a plurality of computers.

The control unit 301 is composed of a CPU, ROM, RAM, and the like. The CPU calls and executes a program stored in a storage medium such as a storage unit 302 and a ROM in a work memory area on the RAM, and drives and controls each unit of the server 3. ROM permanently holds computer boot programs, programs such as BIOS, and data. The RAM temporarily holds the loaded program and data, and also includes a work area used by the control unit 301 to perform various processes.

The storage unit 302 is a storage medium such as a hard disk drive, a solid state drive, or a flash memory. The storage unit 302 stores a program executed by the control unit 301, data necessary for program execution, an operating system, and the like.

The communication unit 303 has a communication control device and a communication port, and controls communication via the network 5 and the like. The server 3 is communicably connected to the playback device 2 via the network 5 and can transmit and receive various data.

(2. Data recorded on the server 3)
As shown in FIG. 4, content data 321 and purchase information 322, landmark data 323, member information 324, and the like are recorded in the storage unit 302 of the server 3.

The content data 321 is, for example, video or audio data of a predetermined character. The character is, for example, a fictitious character such as an animation or a game, but is not limited to this, and may be a real celebrity or the like. In the present embodiment, it is assumed that the content data 321 purchased in advance by the user is played back on the user's playback device 2.

The purchase information 322 is information registered when the content data 321 is purchased. As shown in FIG. 5A, for example, the purchase information 322 is associated with information such as purchase ID 3221, content ID 3222, and purchaser information 3223.

The purchase ID 3221 is identification information that identifies the purchase record such as the content ID 3222 and the purchaser information 3223, and is generated when the content data 321 is purchased.
The content ID 3222 is identification information that identifies the content data 321 purchased by the user.
The purchaser information 3223 is the name, contact information, payment information, etc. of the purchaser of the content data 321 and is registered at the time of purchasing the content data 321.

As shown in FIG. 5B, the landmark data 323 is associated with the landmark 3231 in the tourist facility or tourist spot, its position 3232, the image 3233, and the like.

Landmark 3231 is the name of a landmark in a tourist facility or tourist area. However, the landmark 3231 may be anything as long as it can specify a tourist facility or a place within the tourist spot.
The position 3232 is information indicating the position of the landmark 3231, and is represented by, for example, latitude and longitude.
Image 3233 is an image of landmark 3231.

The member information 324 is information about a user who goes sightseeing together, and as shown in FIG. 5C, the purchase ID 3221 of the content data 321 is associated with a face image 3241 and a name 3242.

The face image 3241 and the nickname 3242 are face images and nicknames of the users who are sightseeing together, and are registered when the content data 321 is purchased. In the present embodiment, the content data 321 corresponding to the purchase ID 3221 can be viewed on each of the playback devices 2 of the plurality of users registered in association with the purchase ID 3221, and the video of the same character can be viewed on these playback devices 2. Is displayed.

(3. Functions of content playback system 1)
Next, the functional configuration of the content reproduction system 1 will be described. As shown in FIG. 6, in the content reproduction system 1, the reproduction device 2 has a reproduction means 21 and a sensor 22, and the server 3 has a transmission means 31, a reception means 32, an analysis means 33, and the like.

In the reproduction means 21, the control unit 201 of the reproduction device 2 reproduces the video and audio (content data 321) of the character by the transmissive display 206 and the speaker 208.

The sensor 22 corresponds to the motion sensor 204, the position sensor 205, the microphone 207, the camera 209, and the like of the reproduction device 2, and acquires sensor information including image information and audio information.

In the transmission means 31, the control unit 301 of the server 3 transmits the reproduction information of the content data 321 to the reproduction device 2 via the communication unit 303 at the time of sightseeing by the user. The reproduction information of the content data 321 is, for example, moving image data for displaying the image of the character or audio data for outputting the sound, and the image of the character is ahead of the transmissive display 206 in the reproduction device 2. It is displayed against the background of real space.

In the receiving means 32, the control unit 301 of the server 3 receives the sensor information transmitted from the reproduction device 2 via the communication unit 303.

In the analysis means 33, the control unit 301 of the server 3 analyzes the sensor information. In the present embodiment, the reproduction information according to the analysis result is transmitted to the reproduction device 2, and the details thereof will be described later.

(4. Content playback method)
Next, the processing (content reproduction method) in the content reproduction system 1 according to the embodiment of the present invention will be described.

When using this system, it is necessary to purchase the content data 321 in advance as described above. The user accesses the server 3 using a user terminal (not shown) and purchases the content data 321 on the website provided by the server 3. At this time, the purchaser information 3223 described above is input, and the content data 321 is selected. The server 3 issues a purchase ID 3221 to the user, associates the content ID 3222 corresponding to the selected content data 321 with the purchase ID 3221 and the purchaser information 3223, and registers the purchase information 322.

Further, at the time of purchasing the content data 321, the face image 3241 and the name 3242 of each of the plurality of users who are sightseeing together are registered, and these data are recorded as member information 324 in association with the purchase ID 3221.

After purchasing the content data 321, the user receives the playback device 2 from a staff member of a tourist facility, a tourist spot, or the like, and inputs the purchase ID 3221 to the playback device 2, so that the purchased content data 321 can be viewed. The purchase ID 3221 may be input by a staff member when the reproduction device 2 is rented, or the purchase ID 3221 transmitted from the server 3 to the user terminal (not shown) may be input to the reproduction device 2 by the user himself / herself. In addition, the purchase ID 3221 may be recorded in the user's wearable device or contactless IC card, and the purchase ID 3221 may be transmitted from these media to the playback device 2.

The user wears the above-mentioned playback device 2 and tours tourist facilities, sightseeing spots, and the like. At this time, the playback device 2 appropriately reproduces the content data 321 corresponding to the purchase ID 3221, so that the user can feel as if he / she is sightseeing with the character.

FIG. 7 is a flowchart showing a process performed by the content reproduction system 1 at the time of a user's sightseeing. S101 to S102 and S106 to S107 of FIG. 7 are processes in which the control unit 201 of the playback device 2 controls and executes each part of the playback device 2, and in S103 to S105, the control unit 301 of the server 3 controls each part of the server 3. It is a process that is controlled and executed.

When the user is sightseeing, the playback device 2 uses the sensors 22 such as the motion sensor 204, the position sensor 205, the microphone 207, and the camera 209 to provide image information, audio information, and position information of the playback device 2 around the playback device 2. The orientation information and the like of the playback device 2 are acquired as sensor information (S101). The image information is obtained by taking an image in the line-of-sight direction of the user with the camera 209, and the voice information is obtained by collecting the surrounding voice with the microphone 207. As described above, the position information can be obtained as data such as latitude and longitude by the position sensor 205, and the orientation information can be obtained as data such as angle by the motion sensor 204.

FIG. 8 is an example of the above image information 350. In the present embodiment, when a plurality of users such as family members and friends are renting the playback device 2 and sightseeing together, and the user is looking at another user (person), the image information 350 corresponds to the image information 350. Another user's face image 3241 is included.

The reproduction device 2 transmits the above sensor information to the server 3 together with the purchase ID 3221 of the reproduction device 2 (S102). Sensor information is periodically acquired and transmitted at short time intervals. The sensor information is also information regarding the experience of a user who wears the reproduction device 2 and goes sightseeing.

When the server 3 receives the above sensor information and the purchase ID 3221 (S103), the server 3 analyzes the sensor information (S104), and if necessary, displays and sounds the image and sound of the character of the content data 321 corresponding to the purchase ID 3221. The reproduction information for outputting the above is transmitted to the reproduction device 2 (S105). As described above, the reproduction information is, for example, moving image data for displaying a video of a character or audio data for outputting audio.

When the reproduction device 2 receives the reproduction information (S106), the reproduction device 2 reproduces the content data 321 based on the reproduction information (S107). At this time, the video and audio of the above-mentioned character will be reproduced by the reproduction device 2. The image of the character is displayed on the transmissive display 206 against the background of the real-time real space existing in front of the transmissive display 206.

The relationship between the analysis result of the sensor information received by the server 3 in S103 and the reproduction information transmitted by the server 3 in S106 can be set in various ways. It is possible to reproduce a specific video or audio of the character accordingly.

For example, as shown in FIG. 9 (a), when the user a (playback device 2) is facing a direction c other than a specific direction, the video or audio of the character b is not played, but as shown in FIG. 9 (b). When the user a shifts his / her line of sight to a specific direction c', the image of the character b is displayed against the background of the real space as shown in FIG. 10 (a), and the specific voice of the character b is reproduced. To. These video and audio are, for example, contents that excite the user's sightseeing, but are not particularly limited.

The above process sets a virtual situation in which the user a and the character b have a positional relationship as shown in FIG. 9 (a) (the character b exists on the right side when viewed from the user a), and the character As shown in FIG. 9B, when the character b enters the user's field of view d, the character b is visible to the user a, and voice communication is performed from the character b to the user a.

In addition, the landmark 3231 at the position 3232, which is close to the position information received as the sensor information in S103, exists in the landmark data 323, and the image information 350 also received as the sensor information in S103 is subjected to image processing. When it is determined that a landmark matching the image 3233 of the landmark 3231 exists in the image information 350, the image of the character b is displayed on the playback device 2 against the background of the real space as shown in FIG. 10 (b). It is also conceivable to display and output the sound of the character b corresponding to the landmark 3231. These videos and audios are intended to introduce landmarks 3231, for example, but are not particularly limited.

The above processing realizes an exchange scene in which the character b introduces the landmark 3231 to the user a when the user is near the landmark 3231 and is looking at the landmark 3231.

Further, in particular, in the present embodiment, another user's name 3242 (“A-chan”) registered as member information 324, such as “Go to the left of A-chan”, is added to the voice information received as sensor information in S103. An instruction to specify the position of the character b is included in relation to the character b, and the face image 3241 of the other user corresponding to the name 3242 is included in the image information 350 received as sensor information in S103 as shown in FIG. If so, the character b is displayed at the designated position (“A-chan's left”) as shown in FIG. 11 (a).

The analysis by the server 3 can be performed using the member information 324 registered in advance, and AI (artificial intelligence) can be used for the analysis of the image information 350 and the voice information. The server 3 obtains the position of the character b on the image information 350 corresponding to the above voice instruction (“Go to the left of A-chan”), and the character b moves to the position on the transmissive display 206 corresponding to the position. The reproduction information is transmitted in S105 so as to be displayed.

The designation of the position of the character b is not particularly limited as long as it is performed by the relationship with the person included in the image information 350, that is, another user who is sightseeing together, for example, "Come to the right of A-chan". It is also possible to say, "Go behind A-chan." It is also possible to specify according to the relationship with a plurality of users. For example, when the image information 350 includes face images 3241 of a plurality of users (for example, "A-chan" and "B child"), "A-chan and B" It is also possible to give a voice instruction such as "Go between children".

As described above, in the present embodiment, the user can instruct the character b to move, and the character b can respond to the specific communication. Further, by the above processing, in the present embodiment, the character b can be arranged at an appropriate position according to various situations during sightseeing.

For example, after displaying the character b at the position shown in FIG. 11 (a), a shooting instruction is input to the playback device 2, and the camera 209 takes a picture of the other user, as shown in FIG. 11 (b). As described above, it is possible to create a composite image 360 in which the character b is synthesized at the above position of the captured image of the other user. The composite image 360 can be created by the playback device 2, and the composite image 360 can also be created by the server 3 by transmitting the captured image to the server 3. The composite image 360 can be provided to the user by data, printed matter, or the like, and may be downloaded from the server 3 by the user at a later date for a fee or free of charge.

As described above, in the present embodiment, while the user is sightseeing, the video and audio of the character are played back on the playback device 2 worn by the user against the background of the real space, so that the user can play with the character as if. You can get the feeling that you are enjoying sightseeing, and you can enrich the overall sightseeing experience of the user. Moreover, the user can display the image of the character at the designated position by giving an instruction to specify the position of the character in relation to the person in the image information 350 by voice. As a result, in the present embodiment, the user can instruct the character to move, and the character can take concrete communication to respond to the movement, so that the feeling of enjoying sightseeing with the character is further deepened. Further, the character can be arranged at an appropriate position according to various situations during sightseeing. For example, the character can be moved to a preferable position when shooting a person, and a composite image 360 of the person and the character can be obtained. ..

Further, in the present embodiment, since the smart glasses, which are eyeglass-type wearable devices, are used as the playback device 2, the user can feel more immersive and feel as if the character actually exists.

Further, in the present embodiment, by inputting the purchase ID 3221 issued when the content data 321 is purchased into the plurality of playback devices 2, the content data 321 of the common character can be reproduced by these playback devices 2. , When sightseeing with family and friends, it will be possible to enrich each person's sightseeing experience.

However, the present invention is not limited to the above embodiments. For example, it is also possible to use a mobile terminal such as a smartphone as the playback device 2. In this case, a character image superimposed on a real-space image taken by a camera such as a smartphone is displayed on the display unit of the smartphone or the like during sightseeing. Is displayed.

Further, in the present embodiment, moving information for displaying the image of the character and audio data for outputting the audio are transmitted from the server 3 to the reproduction device 2 as the reproduction information of the content data 321. For example, these The video data and audio data of the above may be downloaded to the playback device 2 in advance, and the playback information transmitted from the server 3 to the playback device 2 may be used as information for designating the video data and voice data to be played back by the playback device 2.

Further, in the present embodiment, the server 3 analyzes the sensor information in S104 (see FIG. 7), but by having the playback device 2 download necessary information such as landmark data 323 in advance, the playback device It is also possible for 2 to do this.

Further, in the example of FIG. 9A, the location of the character b is set for each individual user (playback device 2), and the image of the character b is displayed according to the setting. Then, since the server 3 acquires the position information and the orientation information from the playback devices 2 of the plurality of users, as shown in FIG. 12 (a), the plurality of users a1 and a2 (plurality of playback devices 2) are described. It is also possible to standardize the setting of where the character b is and to display the image of the character b according to the setting.

That is, when it is set that the character b is at the position shown in FIG. 12A, the image or the like of the character b is not reproduced by the playback device 2 of the user a1 facing the direction shown in c1, but the image of the character b is not reproduced in c2. On the playback device 2 of the user a2 facing the direction shown, the image or the like is reproduced so that the character b can be seen in front. Further, from this state, when the user a1 gives an instruction to move the character b to the left of the user a2 as shown in FIG. 12B as described above, this time, the image of the character b or the like is displayed on the playback device 2 of the user a1. It is reproduced so that the image or the like of the character b is not reproduced on the reproduction device 2 of the user a2. This further deepens the feeling of enjoying sightseeing with the character when sightseeing with family and friends.

Although preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications or modifications within the scope of the technical idea disclosed in the present application, and these also naturally belong to the technical scope of the present invention. Understood.

1: Content playback system 2: Playback device 3: Server 21: Playback means 22: Sensor 31: Transmission means 32: Reception means 33: Analysis means 321: Content data 322: Purchase information 323: Landmark data 324: Member information 3221: Purchase ID
3222: Content ID
3223: Purchaser information 3231: Landmark 3232: Position 3233: Image 3241: Face image 3242: Name 350: Image information 360: Composite image

Claims (10)

A server that is communicatively connected to a playback device for users to view content data, including character video and audio.
A receiving means for receiving the image information and the audio information acquired by the playback device by the sensor, and
An analysis means for analyzing the image information and audio information,
A transmission means for transmitting the reproduction information of the content data to the reproduction device so that the image of the character is displayed on the reproduction device against the background of the real space.
With
The transmission means
As a result of the analysis by the analysis means, when the voice information includes an instruction to specify the position of the character in relation to a person other than the user and the image information includes the person, the character A server characterized by transmitting playback information for displaying an image at a designated position to the playback device. The server stores the face image and the nickname of the person as member information in the storage unit.
The server according to claim 1, wherein the analysis means performs analysis using the member information. The server according to claim 1 or 2, wherein the playback device is communicably connected to a spectacle-type wearable device. The server according to any one of claims 1 to 3, wherein the transmission means transmits playback information of content data displaying a common character to the playback devices of a plurality of users. A playback device for users to view content data including character video and audio.
It has a reproduction means for reproducing the content data so that the image of the character is displayed against the background of the real space.
The regeneration means
The audio information obtained by the sensor of the playback device includes an instruction to specify the position of the character in relation to a person other than the user, and the image information obtained by the sensor of the playback device includes the person. If so, a playback device characterized in that the image of the character is displayed at the designated position. The playback device according to claim 5, wherein after displaying the image of the character at the designated position, the person is photographed so that a composite image of the person and the character is created. A content playback system that includes a playback device and a server for users to view content data including video and audio of characters.
The server
A receiving means for receiving the image information and the audio information acquired by the playback device by the sensor, and
An analysis means for analyzing the image information and audio information,
A transmission means for transmitting the reproduction information of the content data to the reproduction device so that the image of the character is displayed on the reproduction device against the background of the real space.
With
The transmission means
As a result of the analysis by the analysis means, when the voice information includes an instruction to specify the position of the character in relation to a person other than the user and the image information includes the person, the character A content reproduction system characterized in that reproduction information for displaying an image at a designated position is transmitted to the reproduction device. A server that is communicatively connected to a playback device for users to view content data, including character video and audio,
The step of receiving the image information and the audio information acquired by the playback device by the sensor, and
Steps to analyze the image information and audio information,
A step of transmitting the reproduction information of the content data to the reproduction device so that the image of the character is displayed on the reproduction device against the background of the real space.
And
As a result of the analysis, when the audio information includes an instruction to specify the position of the character in relation to a person other than the user, and the image information includes the person, the video of the character is displayed. A content reproduction method characterized in that reproduction information for displaying at a designated position is transmitted to the reproduction device. A server that is communicatively connected to a playback device for users to view content data, including character video and audio.
A receiving means for receiving the image information and the audio information acquired by the playback device by the sensor, and
An analysis means for analyzing the image information and audio information,
A transmission means for transmitting the reproduction information of the content data to the reproduction device so that the image of the character is displayed on the reproduction device against the background of the real space.
It is a program to make it work
The transmission means
As a result of the analysis by the analysis means, when the voice information includes an instruction to specify the position of the character in relation to a person other than the user and the image information includes the person, the character A program characterized by transmitting playback information for displaying an image at a designated position to the playback device. A playback device for the user to view content data including character video and audio.
It is a reproduction means for reproducing the content data so that the image of the character is displayed against the background of the real space.
The audio information obtained by the sensor of the playback device includes an instruction to specify the position of the character in relation to a person other than the user, and the image information obtained by the sensor of the playback device includes the person. If so, a program for functioning as a reproduction means for displaying the image of the character at the designated position.

Images