JP2021018473A - Information processing device and information processing system - Google Patents

Abstract

To provide a functionally superior technique that can simultaneously satisfy various demands associated with travel and the like for those who travel using a device that can photograph the surroundings.SOLUTION: A first information processing device 3 includes a first photographing unit 63, a first display unit 71, an avatar display control unit 101, and a character display control unit 103. The first photographing unit 63 photographs surroundings of the first information processing device 3. The first display unit 71 displays an image of the surroundings photographed by the first photographing unit 63. The avatar display control unit 101 displays an image of an avatar, which is an image showing the alter ego of a user of the first information processing device 3 on the image of the surroundings displayed on the first display unit 71. The character display control unit 103 displays an image of a character on a story related to a position based on information on the position on a map obtained by photographing the surroundings on the image of the surroundings displayed on the first display unit 71.SELECTED DRAWING: Figure 2

Description

The present disclosure relates to an information processing device and an information processing system capable of displaying an image of the surroundings.

Recently, there are many events such as the Cosplay Summit, and the number of foreigners who come to Japan as a result of animation (that is, animation) is increasing. For example, posters that welcome people at airports and other places are almost always printed with characters, and are becoming representative of Japan.

Here, the character is a virtual image in which a person, an animal, an object, or the like appearing in a story or the like, which is a fiction of an animation or a movie, is imaged or simulated.
In addition, there are many young people who mention games, SNS, animation, etc. as hobbies, and the animation industry market in recent years has been increasing significantly. Also, in the movie industry, most of the top 10 income from business is changing as shown by anime, and more and more people are familiar with anime.

SNS is an abbreviation for Social Networking Serves, and is a tool that can build human relationships by exchanging information via the Internet.
Furthermore, in recent years, pilgrimages to sacred places that visit places (that is, sacred places) where anime and movies have been set have become popular, and the number of people performing pilgrimages to sacred places is increasing. Therefore, due to the increase in the number of people who perform pilgrimage to sacred places, a great economic effect is being produced in the place where the stage was set.

As a technique for improving the convenience of sightseeing at a travel destination, for example, in the following Patent Document 1, a technique for presenting various information to a mobile terminal such as a smartphone is known.

Japanese Patent No. 6229655

By the way, when you actually arrive at a travel destination, for example, a sacred place, you have a desire to take a picture with the characters of the anime or movie related to that sacred place, and you also want to upload that picture to the SNS. There is also a desire.

However, uploading your own photo to SNS as it is has an aspect that it is distracting from the viewpoint of privacy.
In other words, there is a desire to upload a photo of yourself and the character to SNS, but there is also a feeling that you are reluctant to upload that photo, and there is currently no technology that considers both. ..

One aspect of the present disclosure is to provide a functionally superior technology capable of simultaneously satisfying various demands associated with travel, etc., for a person who travels, etc. using a device capable of photographing the surroundings. ..

The information processing device (3, 5) of one aspect of the present disclosure includes a photographing unit (63, 83), a display unit (71, 91), an avatar display control unit (101), and a character display control unit (103). ..
The photographing unit is configured to photograph the surroundings of the information processing apparatus.

The display unit is configured to display the surrounding image captured by the photographing unit.
The avatar display control unit is configured to display an image of the avatar, which is an image showing the alter ego of the user of the information processing device, on the surrounding image displayed on the display unit.

The character display control unit is configured to display an image of the character in the story related to the position on the surrounding image displayed on the display unit based on the information of the position on the map in which the surrounding is photographed. ..

According to such a configuration, the user of the information processing device who has reached the target position displays an image (that is, a surrounding image) obtained from a photograph of his / her surroundings on the display unit of the information processing device. At the same time, the image of the own avatar and the image of the character showing the characters in the story related to the position can be displayed, for example, superimposed on the surrounding image.

That is, in the image displayed on the display unit, in addition to the surrounding image, the image of the own avatar and the image of the character are displayed together instead of the own photograph. Therefore, even if this image is uploaded to SNS, privacy problems are unlikely to occur.

In this way, when there is a desire to upload a picture of oneself and a character to SNS and a feeling of being reluctant to upload the picture, an avatar is displayed instead of oneself. As a result, it is possible to fulfill the desire to upload an image in which the own avatar and the character are displayed on the surrounding image to the SNS without worrying about privacy.

Therefore, for a person who travels on a pilgrimage to a sacred place or the like using an information processing device capable of photographing the surroundings, it is possible to simultaneously satisfy the various requirements as described above, which has a remarkable effect of increasing satisfaction in the trip or the like. Play.

In addition, the reference numerals in parentheses described in this column and the scope of claims indicate the correspondence with the specific means described in the embodiment described later as one embodiment, and the technical scope of the present disclosure is defined. It is not limited.

The explanatory view which shows the outline of the information processing system of embodiment. The block diagram which functionally shows the structure of the information processing system of embodiment. A block diagram that functionally shows the configuration of the main server. Explanatory drawing which shows the structure of the avatar database. Explanatory drawing showing the structure of the work database. Explanatory drawing showing the structure of the sacred place database. Explanatory drawing which shows the structure of a group database. Explanatory drawing which shows the structure of a character database. The block diagram functionally showing the structure of the 1st information processing apparatus. The flowchart which shows the registration process of the 1st information processing apparatus. The flowchart which shows the image display processing of the 1st information processing apparatus. Explanatory drawing which shows the surrounding image. Explanatory drawing which shows the image which superposed the image of the avatar on the surrounding image. Explanatory drawing which shows the image which superposed the image of the avatar and the character on the surrounding image. A flowchart showing character processing of the main server.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.
[1. First Embodiment]
[1-1. overall structure]
First, the overall configuration of the information processing system of the present embodiment will be described.

<Application example of information system>
First, an application example in which the information processing system of the present embodiment is used will be described.
In the present embodiment, as shown in FIG. 1, in the information processing system 1, for example, when there is a group consisting of a plurality of members, each member of the group carries information processing devices 3 and 5 capable of displaying an image. Then, it can be used for so-called pilgrimage to the sacred place to visit the place where the story of the animation or movie was set.

Then, when performing a pilgrimage to a sacred place, communication is performed between each information processing device 3, 5 and the server 7 using a communication network such as the Internet. As a result, a desired image can be displayed on the information processing devices 3 and 5 based on the information from the server 7.

In addition, when performing this pilgrimage to the sacred place, each member uses, for example, vehicles (that is, automobiles) 9 and 11, respectively, and a predetermined course selected in advance according to a story (that is, a work) such as animation. You can move according to.

Here, examples of the vehicles 9 and 11 include vehicles that are automatically driven and do not require a driving operation by the driver. Therefore, it is possible to carry out a pilgrimage to the sacred place by automatic driving according to the above course. It should be noted that the vehicle may not be an automatically driven vehicle, but may be, for example, a vehicle operated by a driver. In addition, the purpose of moving the members is not limited to pilgrimage to sacred places, but may be trips to various places such as Tokyo and Kyoto.

<Configuration of information information system>
Next, the configuration of the information processing system 1 of the present embodiment will be described.
As shown in FIGS. 1 and 2, the information processing system 1 of the present embodiment includes information processing devices 3 and 5 which are mobile terminals such as smartphones that can be carried by each individual, and information processing devices 3 and 5 respectively. It includes a server 7 capable of transmitting and receiving information to and from the server 7.

As the information processing devices 3 and 5, for example, two information processing devices 3 and 5, that is, a first information processing device 3 and a second information processing device 5 are listed according to two members. , The number is not limited, and one unit or a plurality of three or more units may be used.

That is, although the group having two members is taken as an example here, the number of members may be three or more or one. If there is only one member, it is not necessary to perform processing related to other members. In addition to smartphones, the information processing devices 3 and 5 include devices such as tablet terminals capable of various communications and shooting.

In the following, the user (that is, the user) of the first information processing device 3 is referred to as the first user, and the user (that is, the user) of the second information processing device 5 is referred to as the second user.
The server 7 includes, for example, an information server 13 which is a local server that manages personal information of members, and a main server 15 that manages information such as characters. The main server 15 may be configured to have the function of the information server 13.

[1-2. Each configuration]
Next, each configuration of the information processing system 1 of the present embodiment will be described in detail.
[1-2-1. Information server]
As functionally shown in FIG. 2, the information server 13 includes a sub-server storage unit 21, a sub-server information processing unit 23, and a sub-server communication unit 25.

The sub-server information processing unit 23 is mainly composed of a well-known microcomputer having a CPU and semiconductor memories such as RAM, ROM, and flash memory. Various functions of the sub-server information processing unit 23 are realized by the CPU executing a program stored in a non-transitional substantive recording medium. In this example, the semiconductor memory corresponds to a non-transitional substantive recording medium in which a program is stored.

The sub-server communication unit 25 is a wireless communication device for realizing communication with each of the information processing devices 3 and 5. The communication method, standard, etc. are not limited in any way. For example, it is conceivable to communicate with each information processing device 3 and 5 by wireless communication using a computer network such as the above-mentioned communication via the Internet.

The sub-server storage unit 21 is a storage device composed of a semiconductor memory such as a flash memory, a hard disk, or the like.
The sub-server storage unit 21 stores user information of users of the information processing devices 3 and 5, that is, information about each user corresponding to each member of the group (that is, user information). Examples of this user information include a user ID, a name, a gender, an age, an address, a login password, and the like that identify each user. This user information is stored, for example, associated with (that is, associated with) a user ID.

When the information server 13 receives the user information transmitted from the information processing devices 3 and 5, the user information is stored in the sub server storage unit 21 by the processing of the sub server information processing unit 23. To.

On the other hand, when any user information is requested to be output from the information processing devices 3 and 5, the user information stored in the sub-server storage unit 21 is subordinated by the processing of the sub-server information processing unit 23. It is transmitted to each information processing device 3 and 5 via the server communication unit 25.

[1-2-2. Main server]
The main server 15 includes a main server storage unit 27, a main server information processing unit 29, and a main server communication unit 31.

The main server information processing unit 29 is mainly composed of a well-known microcomputer having a CPU and semiconductor memories such as RAM, ROM, and flash memory. Various functions of the main server information processing unit 29 are realized by the CPU executing a program stored in a non-transitional substantive recording medium. In this example, the semiconductor memory corresponds to a non-transitional substantive recording medium in which a program is stored.

The main server communication unit 31 is a wireless communication device for realizing communication with each of the information processing devices 3 and 5. The communication method, standard, etc. are not limited in any way. For example, it is conceivable to communicate with each information processing device 3 and 5 by wireless communication using a computer network such as the above-mentioned communication via the Internet.

The main server storage unit 27 is a storage device composed of a semiconductor memory such as a flash memory, a hard disk, or the like.
As functionally shown in FIG. 3, the main server storage unit 27 has an avatar material information unit 35, a work information unit 37, a sacred place information unit 39, and a group information unit 41 as a configuration for storing various types of information. And a character information unit 43. It should be noted that these information units 35 to 43 are configured as a database (that is, a DB) described later.

On the other hand, the main server information processing unit 29 includes an avatar processing unit 45, a work processing unit 47, a sacred place processing unit 49, a group processing unit 51, and a character processing unit 53 in order to process various types of information. I have.

Here, as will be described later, the avatar processing unit 45 mainly processes the information of the avatar material information unit 35, the work processing unit 47 processes the information of the work information unit 37, and the sacred place processing unit 49 processes the sacred place information. The information of the unit 39 is processed, the group processing unit 51 processes the information of the group information unit 41, and the character processing unit 53 processes the information of the character information unit 43.

Here, the information processing means various processing such as writing, reading, and processing of information.
Hereinafter, each configuration will be described in detail.

<Each configuration of the main server storage unit>
First, each configuration of the main server storage unit 27 will be described.
The avatar material information unit 35 is a database (that is, an avatar DB) that stores materials for displaying an avatar, which is an image showing the user's alter ego of each of the information processing devices 3 and 5. That is, the avatar material information unit 35 is a database that stores image data necessary for constructing an avatar image.

FIG. 4 shows a configuration example of the avatar DB. As shown in FIG. 4, the avatar table (that is, the avatar table) contains components of the avatar, for example, a part ID that identifies a part that is a part of the avatar such as a face and clothes, a user ID that identifies a user, and a part. Avatar data, which is image information of avatars corresponding to IDs, is stored in association with each other. For example, the information in this avatar table is stored in association with (that is, associated with) the user ID.

As a result, when a certain user ID is specified, the avatar data of the part ID related to the user ID is selected. Therefore, when a certain user ID is specified, it is possible to draw an image corresponding to a certain user by using the avatar data of a plurality of part IDs related to the user ID. That is, as will be described later, each of the information processing devices 3 and 5 that has received the avatar data can display an image of a predetermined avatar corresponding to a predetermined user.

The avatar data selected by the user ID is downloaded to each information processing device 3 and 5 and stored in advance as described later, but only when necessary, each information processing device 3 is stored from the main server 15. You may download it to 5 and display it.

The work information unit 37 is a database (that is, a work DB) that stores information (that is, work information) related to an animation or movie work.
FIG. 5 shows a configuration example of the work DB. As shown in FIG. 5, for example, in the case of animation, in the animation work table (that is, the animation work table), the work ID, the work name, the director name, and the broadcast year that identify the work are associated with each other. It is remembered. For example, the information in this animation work table is stored in association with (that is, associated with) the work ID.

The sacred place information unit 39 is a database (that is, sacred place information) that stores information (that is, sacred place information) indicating a characteristic place that appears in an animation or movie work, that is, a popular place (that is, a sacred place) that one wants to visit. , Sanctuary DB).

FIG. 6 shows a configuration example of the sacred place DB. As shown in FIG. 6, on the sacred place table (that is, the sacred place table), a sacred place ID that identifies the sacred place, a work ID that identifies a work including the sacred place, and a sacred place scene showing a moving image or a still image of the sacred place. The location of the sanctuary, which indicates the location of the sanctuary, is remembered in association with each other.

For example, the information in this sanctuary table is stored in association with (that is, associated with) the work ID. As the location of the sacred place, in addition to the usual place name on the map, an individual name corresponding to the location of the sacred place (for example, "a bridge where two people met") may be given.

The group information unit 41 is a database (that is, a group DB) that stores information of each user in a group composed of users of both information processing devices 3 and 5.
FIG. 7 shows a configuration example of the group DB. As shown in FIG. 7, in the group table (that is, group table), a group ID for specifying a group, a user ID for specifying a user, a representative user ID for specifying a representative user among users, and the purpose of this group The work ID that identifies the work related to the sacred place to be done and the course information that shows the route of the pilgrimage to the sacred place corresponding to this work are stored in association with each other.

For example, the information in this group table is stored in association with (that is, associated with) the group ID. When there are a plurality of groups, different group IDs are set for each group.

Here, all user IDs, all group IDs, all representative user IDs, and the like are stored in the group DB.
The character information unit 43 is a database (character DB) that stores character information to be displayed on both information processing devices 3 and 5.

FIG. 8 shows a configuration example of the character DB. As shown in FIG. 8, in the character table (that is, character table), a character ID that identifies a character, a work ID that identifies a work in which the character appears, a sacred place ID that specifies a sacred place where the character appears, and a character are displayed. Character data, which is image information necessary for drawing, is stored in association with each other. For example, the information in this character table is stored in association with (that is, associated with) the sacred place ID.

In the same sacred place, characters can be randomly selected and displayed from a plurality of characters. For example, for a certain sacred place ID, a plurality of character IDs and character data corresponding to each character ID are stored, and for example, when checking in to a sacred place, a character is randomly selected from a plurality of characters. Can be displayed.

Further, since the character table is set for each season, different characters are displayed on both information processing devices 3 and 5 when the seasons are different even in the same sacred place. As the different characters, characters indicating completely different characters and the like can be considered. For example, the characters and the like may be the same, and characters whose clothes may be changed for each season may be adopted.

Although this character may be displayed as an MR agent in MR, it may be displayed as an AR image.
In addition, MR is an abbreviation of Mixed Reality (that is, mixed reality), and MR agent is an interface agent having physical characteristics in MR space. Also, AR is an abbreviation for Augmented Reality (that is, augmented reality).

<Each configuration of the main server information processing unit>
Next, each configuration of the main server information processing unit 27 will be described.
As shown in FIG. 3, the avatar processing unit 45 processes the information of the avatar material information unit 35.

For example, when a part for generating a desired avatar is selected from the avatar parts stored in the avatar material information unit 35 based on the instructions from the information processing devices 3 and 5, the part is selected. An avatar is generated based on this. That is, since the parts are selected according to the instructions of each user, the ID of the selected parts (that is, the part ID) is associated with the user ID and stored in the avatar DB.

Further, the information for generating this avatar, that is, the whole data including the avatar data of each part for generating the whole image of the avatar (that is, the image information of the avatar) is mainly obtained from the avatar processing unit 45. It is transmitted to each information processing device 3 of each user via the server communication unit 31, and is stored in the first storage unit 69 or the second storage unit 89 shown in FIG. The next time you log in to each of the information processing devices 3 and 5, the avatar at the time of the final login will be displayed.

Since the first information processing device 3 and the second information processing device 5 are similar devices, the first information processing device 3 will be mainly described below as an example.
The work processing unit 47 processes the information of the work information unit 37.

For example, when a search word for searching a work is transmitted from the first information processing device 3, the information in the work DB is searched. Then, when a candidate work that seems to correspond to the search word is found, the information about the candidate work is transmitted to the first information processing apparatus 3. For example, when a plurality of candidate works are found, information such as the work name, director name, and broadcast year of each candidate work is transmitted to the first information processing apparatus 3.

Therefore, the first information processing apparatus 3 can display the information regarding the transmitted work described above.
The sanctuary processing unit 49 processes the information of the sanctuary information unit 39.

For example, when a specific work name selected from the candidate works is transmitted from the first information processing device 3, the information in the sacred place DB is searched. Then, based on the sacred place DB, information on the sacred place ID, the sacred place scene, and the sacred place location corresponding to the work name is extracted, and the information on the sacred place scene and the sacred place location is transmitted to the first information processing device 3.

Therefore, the first information processing apparatus 3 can display the above-mentioned information regarding the transmitted sacred place.
When the work processing unit 47 extracts the work name corresponding to the search word, the sanctuary processing unit 49 automatically searches the sacred place DB and provides information on the sacred place according to the work name. May be extracted and transmitted to the first information processing apparatus 3.

The group processing unit 51 processes the information of the group information unit 41.
For example, when a user ID that identifies a user is transmitted from the first information processing device 3, the user ID is stored in the group DB. Here, the user ID of the user who has determined the course of the pilgrimage to the sacred place is stored in the group DB as the representative user ID. When the user determines a work related to the sacred place, the work ID that identifies the work is stored in the group DB. Further, when the user decides the course of the pilgrimage to the sacred place, a group ID for specifying the group is automatically issued and the group ID is stored in the group DB in order to define the group to go to the pilgrimage to the sacred place. The information stored in the group DB is stored in association with each other.

Therefore, when a user ID is transmitted from each information processing device 5 other than the first information processing device 3, by referring to the group DB, the user (that is, the member) having the user ID is in which group. It is possible to recognize whether it belongs to.

The character processing unit 53 processes the information of the character information unit 43.
For example, when the position information of the first information processing device 3 is transmitted from the first information processing device 3 after the sacred place check-in described later, the sacred place ID corresponding to the position information is extracted from the character DB and the sacred place is extracted. Select the character corresponding to the ID.

Prior to the check-in to the sanctuary, the user ID of the first user is transmitted from the first information processing device 3 to the main server 15, so that the first user belongs to the main server 15 based on the group DB. The group is recognized. Therefore, the character corresponding to the sacred place ID becomes the character related to the recognized group. That is, as will be described later, the same character is displayed on the information processing devices 3 and 5 of the same group.

As described above, a plurality of characters may be set corresponding to the sacred place ID. In addition, a specific character may be selected from a plurality of characters according to the season.

Then, when the character is selected as described above, the character data which is the image information of the selected character is transmitted to the first information processing apparatus 3. When a plurality of characters are set, one of the characters is randomly selected and the character data is transmitted. As a result, the first information processing apparatus 3 can draw one character.

When there is another group other than the group to which the first user and the second user belong (that is, the main group), and the user ID is transmitted from the information processing device (not shown) of the other group to the main server 15. , A character different from the character selected in the main group is selected even in the same sacred place. Therefore, another character is displayed on the information processing apparatus of the other group.

[1-2-3. Information processing device]
Next, both information processing devices 3 and 5 will be described.
As shown in FIG. 2, the first information processing apparatus 3 includes a first communication unit 61, a first photographing unit 63, a first sensor unit 65, a first control unit 67, a first storage unit 69, and a first display unit. A 71 and a first sound output unit 73 are provided.

Further, the second information processing apparatus 5 includes a second communication unit 81 similar to the first communication unit 61, a second imaging unit 83 similar to the first imaging unit 63, and a second imaging unit 83 similar to the first sensor unit 65. The sensor unit 85, the second control unit 87 similar to the first control unit 67, the second storage unit 89 similar to the first storage unit 69, and the second display unit 91 similar to the first display unit 71. It includes a second sound output unit 93 similar to the first sound output unit 73.

Since the first information processing device 3 and the second information processing device 5 have the same configuration, the first information processing device 3 will be mainly described below as an example.
The first communication unit 61 is a wireless communication device for realizing communication with the server 7, similarly to the main server communication unit 31. The communication method, standard, etc. are not limited in any way. For example, it is possible to communicate with the server 7 by wireless communication using a computer network, such as the above-mentioned communication via the Internet.

The first photographing unit 63 includes a camera (for example, a CCD camera) capable of photographing the surroundings of the first information processing apparatus 3 itself and obtaining an image (that is, a surrounding image) which is a photograph of the surroundings.
The first sensor unit 65 includes a well-known GPS device capable of acquiring position information on a map of the first information processing device 3. Further, a gyro device capable of detecting the north, south, east, and west directions, a tilt sensor capable of detecting the tilt of the first information processing device 3 in the vertical direction, and the like may be provided.

The first display unit 71 includes a display capable of displaying an image or the like by, for example, a liquid crystal display. With this display, it is possible to display a surrounding image taken by a camera or an image in which an avatar or a character is superimposed on the surrounding image.

The first sound output unit 73 includes a device that outputs sounds such as voice from a speaker, earphone terminals, and the like.
The first control unit 67 is mainly composed of a well-known microcomputer having a CPU and a semiconductor memory such as a RAM, a ROM, and a flash memory. Various functions of the first control unit 67 are realized by the CPU executing a program stored in a non-transitional substantive recording medium. In this example, the semiconductor memory corresponds to a non-transitional substantive recording medium in which a program is stored.

As functionally shown in FIG. 9, the first control unit 67 displays the avatar display control unit 101, which performs processing for displaying (that is, drawing) the avatar on the display, and the character on the display (that is, drawing). That is, it includes a character display control unit 103 that performs processing for drawing).

The first storage unit 69 is a storage device composed of a semiconductor memory such as a flash memory, a hard disk, or the like.
Further, in the first information processing device 3, an image (for example, a still image or a moving image) in which the avatars and characters of both users are displayed in the surrounding image can be stored in the first storage unit 69. Therefore, the stored image can be uploaded to SNS, played back, or transmitted to a friend or the like.

[1-3. Each process]
Next, each process carried out in this embodiment will be described.
Personal information about the user (that is, user information) is registered in the information server 13 in advance by the first user of the first information processing device 3 and the second user of the second information processing device 5 prior to each process. ing.

<Information system registration process>
First, the registration process for registering the group ID in the main server 15 performed by the information processing system 1 will be described.

As shown in FIG. 10, in step 100 (hereinafter referred to as S) 100, the first information processing apparatus 3 starts an application (that is, an application) which is a program for executing the processing of the present embodiment. Determine if it is.

That is, it is determined whether or not the login password for operating the application is input after the icon indicating the application is touched on the display of the first information processing device 3 and the application is selected. If an affirmative judgment is made here, the process proceeds to S110, while if a negative judgment is made, the present process is temporarily terminated.

In S110, it is determined whether to input the group ID or select the work of the pilgrimage to the sacred place. That is, for example, a display for selecting whether to input a group ID or select a work of pilgrimage to the sacred place is displayed on the screen of the application on the display, and which process is to be performed is determined according to this selection.

In S120, a work selection screen is displayed on the display, and when a work is selected from the selection screen, the process proceeds to S130.
For example, when a search word for searching a work is input in the first information processing apparatus 3, this search word is transmitted to the main server 15, and the main server 15 can select works corresponding to the search word. To be elected. Since the candidate of the selected work is transmitted to the first information processing apparatus 3 and displayed on the display, the target work can be selected from the display screen.

In S130, a plurality of courses according to the course of the pilgrimage to the sacred place are proposed according to the work selected by the first information processing device 3 and the current position of the user, and are displayed on the display. When the course is selected, the process proceeds to S140. The selection result of this course is transmitted to the main server 15.

In S140, the main server 15 automatically issues a group ID according to the selected course.
In the subsequent S150, the main server 15 stores the user ID, the group ID, the representative user ID, and the information of the selected course (that is, the course information) in the course DB, and temporarily ends this process. Here, the ID of the user who has determined the course is used as the representative user ID.
On the other hand, in S160, which is negatively determined in S110 and proceeds, the process of inputting the group ID is selected. Therefore, in the main server 15, for example, whether or not the group ID input to the second information processing device 5 is appropriate. To judge. For example, it is determined whether or not the corresponding group ID exists. If affirmative judgment is made here, the process proceeds to S170.

In S170, since the input group ID is appropriate, the user ID of this user is associated with the group ID, stored in the group DB, and this process is temporarily terminated.
Therefore, once the group ID is determined, the members belonging to the group (that is, each user and each information processing device 3 and 5) can be specified.

<Image display processing of the first information processing device>
Next, an image display process for displaying an image of an avatar or a character, which is performed by the first information processing apparatus 3, will be described.

As shown in FIG. 11, it is determined in S200 whether or not the application has been started. If an affirmative judgment is made here, the process proceeds to S210, while if a negative judgment is made, the present process is temporarily terminated.
In S210, processing for check-in to the sacred place is carried out.

Specifically, the position information of the current position of the first information processing device 3 (hence, the first user) obtained by the GPS device or the like is transmitted to the main server 15. At the time of this sacred place check-in, the user ID of the first user is also transmitted to the main server 15.

The main server 15 determines whether or not the current position is the location of the sacred place based on the sacred place DB, and transmits information on whether or not the first user is in the sacred place to the first information processing device 3. For example, if the current position of the first information processing device 3 is within a radius of 10 mm of the location of the sacred place, it is determined that the first information processing device 3 (hence, the first user) has reached the sacred place.

Further, as will be described later, in the main server 15, when the current position of the first user is the sacred place location, the first information processing device 3 refers to the character DB based on the sacred place ID indicating the sacred place location. Select the character to be displayed on the display. Then, the selected character data (that is, character image information) is transmitted to the first information processing apparatus 3.

Therefore, the first information processing apparatus 3 can obtain information on whether or not the current position is a sacred place, and if the current position is a sacred place, image information of the character.
In the following S220, it is determined whether or not to activate the camera and perform shooting. If an affirmative judgment is made here, the process proceeds to S230, while if a negative judgment is made, this processing is temporarily terminated in order to perform another processing.

For example, a selected image (for example, an icon) for selecting the content of "shooting the surroundings with the camera" is displayed on the display of the first information processing device 3, so that when the icon for starting shooting is touched. Activates the camera and starts shooting the surroundings.

In S230, the image of the avatar or the character is displayed so as to be superimposed on the surrounding image (that is, the surrounding image) obtained by the shooting of the camera, and the present process is temporarily terminated.
Specifically, the images of the avatars of the first user and the second user are displayed on the surrounding image. Furthermore, if the current position is a sacred place, an image of the character is also displayed.

For example, when the surrounding image as shown in FIG. 12 is obtained by shooting, as shown in FIG. 13, the first avatar of the first user and the second avatar of the second user are superimposed on the surrounding image. And are arranged side by side and displayed. If the image information of the second avatar cannot be obtained, only the image of the first avatar is displayed. Further, the position and size of displaying each avatar can be set in advance, but can be arbitrarily adjusted by looking at the display state.

Since the image information of the first avatar is stored in the first storage unit 69 of the first information processing device 3, the first avatar is displayed (that is, drawn) on the display using this image information. Can be done.

Further, when the second information processing device 5 is logged in by the second user, the image information of the second avatar is transmitted from the second information processing device 5 to the first information processing device 3 via the main server 15. Will be sent. Therefore, the first information processing apparatus 3 can display the second avatar on the display by using the transmitted image information of the second avatar.

If the second user is not logged in to the second information processing device 5, the second avatar is not displayed on the first information processing device 3.
Further, when the first information processing device 3 is located in the sacred place, the image information of the character corresponding to the sacred place is transmitted from the main server 15 to the first information processing device 3 as described above. Based on the image information, the character image can be superimposed and displayed at a predetermined position of the surrounding image.

Since the characters are set according to the seasons, different characters can be displayed even in the same sacred place if the seasons change.
That is, as described above, as the different characters, for example, completely different characters randomly selected from a plurality of characters can be considered, but for example, even if the characters are the same and the clothes of the characters are changed for each season. Good.

For example, if you visit the same sanctuary twice in spring and once in summer, the first time is character A in spring clothes, the second time is character B in spring clothes, and the third time is character A in summer clothes. Can be displayed.

Then, for example, when displaying a character image based on AR technology, for example, in the case of location-based AR, in addition to the position information of the first information processing device 3, information such as the direction of the camera is added. As illustrated in FIG. 14, the character can be displayed at a predetermined position. For example, a character can be displayed near the display plate of an observatory in a sanctuary.

In addition, when displaying an image of a character (that is, an MR agent) based on MR technology, the coordinates of the actual real world and the coordinates of the virtual world in which the MR agent exists are matched, and the positions of the predetermined coordinates are matched. The MR agent is displayed in.

Specifically, the MR agent has its image data (that is, 3D data) and information on the place to be displayed (that is, position information in the real world) registered in a predetermined database (for example, character DB). .. Coordinates are set in the virtual world so as to match this registered position information.

Then, for example, only when the first user checks in to the sanctuary and activates the camera, the character is drawn at the registered position in the actual size. The drawing position of the character is fixed, and only the size can be adjusted.

For example, the distance and position of the first user as seen from the drawing position of the character are calculated based on the position information of the first information processing device 3 and the direction in which the camera is facing, and the drawing is adjusted. For example, if the first user stands next to the character, the profile of the character can be drawn.

In this way, the MR agent can be displayed on the display of the first information processing apparatus 3.
A display mode may be set to indicate what kind of image is to be displayed overlaid on the surrounding image, and what kind of image to be displayed may be selected based on the display mode.

For example, a mode in which only the first avatar is displayed without displaying the character, a mode in which all avatars in the same group are displayed without displaying the character, a mode in which the first avatar and the character are displayed, and all avatars in the same group. The mode for displaying the character may be selected.

(Processing by the second information processing device)
Here, the processing in the second information processing apparatus 5 will be described.
For example, a case where the user logs in with the second information processing device 5 after logging in with the first information processing device 3 will be described as an example. Here, the second user has the same group ID as the first user.

When logged in by the second information processing device 5, a user ID indicating the second user is transmitted to the main server 15. Further, the login information of the second user is transmitted from the main server 15 to the first information processing device 3.

Therefore, the main server 15 can recognize that the second user belongs to the same group as the first user from the user ID of the second user.
Further, the image information of the avatar of the first user is transmitted from the first information processing device 3 to the second information processing device 5 via the main server 15.

Further, when the second user is in the same sacred place as the first user, the image information of the same character as the first user is transmitted from the main server 15 to the second information processing device 5.
Therefore, as shown in FIG. 14, the display of the second information processing apparatus 5 has, although the surrounding image and the like are slightly different, the surrounding image includes the second user's own second avatar, the first avatar, and the above. Characters can be displayed on top of each other.

<Character processing of main server>
Next, character processing for processing a character image, which is performed by the main server 15, will be described.

As shown in FIG. 15, it is determined whether or not the position information of the first information processing device 3 is received from the first information processing device 3. If an affirmative judgment is made here, the process proceeds to S310, while if a negative judgment is made, the present process is temporarily terminated.

In S310, it is determined whether or not the first information processing apparatus 3 has reached the sacred place based on the position information. For example, if the current position of the first information processing device 3 is within a radius of 10 mm of the location of the sacred place, it is determined that the first information processing device 3 (hence, the first user) has reached the sacred place.

If an affirmative judgment is made here, the process proceeds to S320, while if a negative judgment is made, this processing is temporarily terminated in order to perform another processing.
In S320, the character is selected based on the position information. That is, the character corresponding to the sacred place indicated by the position information is selected. That is, the main server 15 refers to the character DB based on the sacred place ID indicating the location of the sacred place, and selects the character to be displayed on the display of the first information processing apparatus 3. That is, the character data (that is, the image information of the character) corresponding to the character ID indicating the character is selected.

However, since the same character is selected in the same group, the first information processing apparatus 3 selects the character according to the group to which the first user belongs. That is, when a plurality of characters are set in the same sanctuary, for example, one character is randomly assigned to the first user. In this case, other characters are assigned to other groups.

In the following S330, the image information of the selected character is transmitted to the first information processing apparatus 3, and this process is temporarily terminated.
In addition, in the main server 15, the same processing as for the first information processing apparatus 3 is performed on the second information processing apparatus 5.

That is, when the second user reaches the sanctuary, since it is in the same group as the first user, the image information of the same character transmitted to the first information processing device 3 is also transmitted to the second information processing device 5. To.

[1-4. effect]
In the above embodiment, the following effects can be obtained.
(1a) The first information processing apparatus 3 of the present embodiment includes a first photographing unit 63, a first display unit 71, an avatar display control unit 101, and a character display control unit 103. The same applies to the second information processing device 5.

Therefore, the first user of the first information processing device 3 who has reached the target sacred place displays an image of his / her surroundings (that is, a surrounding image) on the first display unit 71 (that is, the display) of the first information processing device 3. It is possible to display its own avatar (that is, the first avatar) and the character related to the sacred place.

That is, in the image displayed on the first display unit 71, the first avatar and the character of the player are displayed together, not the photograph of the player. Therefore, it is easy to get the impression that the pilgrimage to the sacred place was performed together with the character, and even if the image showing the pilgrimage to the sacred place is uploaded to the SNS, the problem of privacy is unlikely to occur.

In this way, even if there is a desire to upload a picture of oneself and a character to SNS and a feeling of being reluctant to upload the picture to SNS, in this embodiment, an avatar is used instead of oneself. By displaying the above, it is possible to fulfill the desire to upload the image displayed on the first display unit 17 corresponding to the photograph to the SNS without worrying about privacy.

As a result, for those who perform pilgrimage to the sacred place, it is possible to satisfy various requirements as described above at the same time, and it has a remarkable effect of increasing the satisfaction level in the pilgrimage to the sacred place.
(1b) The information processing system 1 of the present embodiment includes the information processing devices 3 and 5 and a main server 15 capable of transmitting and receiving information between the information processing devices 3 and 5.

The main server 15 holds image information of a character indicating a character or the like in a story related to a position on a map. Therefore, when each user reaches the sacred place, the image information of the character can be transmitted from the main server 15 to the information processing devices 3 and 5. Therefore, each of the information processing devices 3 and 5 can draw a character on each display by using the image information of the character acquired from the main server 15.

(1c) In the information processing system 1 of the present embodiment, the characters are set according to the season.
That is, a plurality of characters are set corresponding to the same sacred place, and the clothes of each character are determined according to the season. Therefore, when a pilgrimage to a sacred place is performed in different seasons, characters having different clothes or different clothes are displayed on the information processing devices 3 and 5 even in the same sacred place, which improves entertainment. There is an advantage to do.

(1d) In the information processing system 1 of the present embodiment, each user of each information processing device 3 and 5 is defined as the same group. Other members may also be in the same group.
Then, for example, the first avatar can be displayed on the first information processing device 3 of the first user, and the second avatar of the second user in the same group can be displayed. The same applies to the second information processing device 5.

Therefore, for example, when both users log in and view the displays of the information processing devices 3 and 5, the first avatar and the second avatar are aligned on the displays of the information processing devices 3 and 5. Since it is displayed, it seems that both users share the same space. In other words, it feels like all the members of the same group share the space. Therefore, there is an advantage that the feeling of familiarity between members is enhanced.

(1e) Further, when the first user and / or the second user is in the sacred place, the characters are also displayed in addition to both avatars on the displays of the information processing devices 3 and 5 in the sacred place. , It feels like all the members of the same group share the space. Moreover, when the displayed character is an MR agent, it seems that they share the same space even more.

(1f) Further, in each of the information processing devices 3 and 5, an image (for example, a still image or a moving image) in which the avatars and characters of both users are displayed on the surrounding image can be created and stored in the respective storage units 69 and 89. it can.

Therefore, it is possible to take such a photograph (that is, an image) in which all members are gathered without asking another person, that is, to create and save an image. Therefore, such an image can be uploaded to SNS, played back, or transmitted to a friend.

[1-5. Correspondence of wording]
In the present embodiment, the information processing system 1 corresponds to the information processing system, the first information processing device 3 and the second information processing device 5 correspond to the information processing device, the main server 15 corresponds to the server, and the character information unit. 43 corresponds to the character information unit, the first photographing unit 63 and the second photographing unit 83 correspond to the photographing unit, the first display unit 71 and the second display unit 91 correspond to the display unit, and the avatar display control unit 101. Corresponds to the avatar display control unit, and the character display control unit 103 corresponds to the character display control unit.

[2. Other embodiments]
Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and can be implemented in various modifications.

(2a) For example, the present disclosure can be applied even when the person performing the pilgrimage to the sacred place is only the first user. In this case, the avatars of other members (for example, the second user) are not displayed on the display.

This disclosure is also applicable when there are three or more members performing pilgrimage to the sacred place. In this case, the display can show the avatars of all members of the same group participating in the pilgrimage to the Holy Land.

(2b) The processing method in the server or information processing apparatus described in the present disclosure is by configuring a processor and a memory programmed to execute one or more functions embodied by a computer program. It may be realized by the dedicated computer provided. Alternatively, the processing method in the server or information processing apparatus described in the present disclosure may be realized by a dedicated computer provided by configuring a processor with one or more dedicated hardware logic circuits.

Alternatively, the processing method in the server or information processing apparatus described in the present disclosure is composed of a processor and memory programmed to execute one or more functions and one or more hardware logic circuits. It may be realized by one or more dedicated computers configured in combination with a processor. The computer program may also be stored on a computer-readable non-transitional tangible recording medium as an instruction executed by the computer.

In addition, the method for realizing the functions of each part included in the server or information processing device does not necessarily include software, and all the functions are realized by using one or more hardware. May be good.

(2c) A plurality of functions possessed by one component in the embodiment may be realized by a plurality of components, or one function possessed by one component may be realized by a plurality of components. .. Further, a plurality of functions possessed by the plurality of components may be realized by one component, or one function realized by the plurality of components may be realized by one component. Further, a part of the configuration of the above embodiment may be omitted. In addition, at least a part of the configuration of the above embodiment may be added or replaced with the configuration of the other above embodiment.

(2d) In addition to the above-mentioned server and information processing device, a system having the server and information processing device as a component, a program for operating a computer as the server and information processing device, and a semiconductor memory recording this program. The present disclosure can also be realized in various forms such as a non-transitional substantive recording medium such as.

1: Information processing system 3: 1st information processing device, 5: 2nd information processing device, 15: Main server, 43: Character information unit, 63: 1st imaging unit, 83: 2nd imaging unit, 71: No. 1 display unit, 91: second display unit, 101: avatar display control unit, 103: character display control unit

Claims (5)

Information processing device (3, 5)
Imaging units (63, 83) configured to photograph the surroundings of the information processing device, and
Display units (71, 91) configured to display the surrounding image captured by the photographing unit, and
An avatar display control unit (101) configured to display an image of an avatar, which is an image showing an alter ego of a user of the information processing device, on the surrounding image displayed on the display unit.
A character display control unit configured to display an image of a character in a story related to the position on the surrounding image displayed on the display unit based on information on a position on a map obtained by photographing the surrounding area. (103) and
Information processing device equipped with. Information system (1)
The information processing device according to claim 1 and
A server (15) capable of transmitting and receiving information to and from the information processing device, and
With
The server
A character information unit (43) for holding image information of the character in the story related to the position on the map is provided.
The information processing device
Based on the image information of the character acquired from the character information unit of the server, the character display control unit is configured to display the image of the character on the surrounding image displayed on the display unit. ,
Information processing system. The information processing system according to claim 2.
The character is set according to the season,
Information processing system. The information processing system according to claim 2 or 3.
When a plurality of members including the user of the information processing device are defined as a specific group,
An image of the avatar of the other member, which is an image showing the alter ego of another member other than the user in the group, is displayed on the surrounding image displayed on the display unit of the information processing device of the user. Configured to
Information processing system. The information processing system according to any one of claims 2 to 4.
When a plurality of members including the user of the information processing device are defined as a specific group,
Same as the character displayed on the display unit of the information processing device of a member other than the user in the group, based on the position information on the map, on the display unit of the information processing device of the user. An information processing system configured to display an image of a character.

Images