JP7219859B2 - Communication system, communication method and communication program - Google Patents

Description

The present invention relates to a communication system, communication method and communication program.

In recent years, HMDs (Head Mounted Displays) and the like have been proposed that allow users to experience virtual reality (VR) and augmented reality (AR). Among these, as an HMD using AR technology, AR glasses, which are worn on the user's head and used in the same manner as general eyeglasses, have been proposed.

The AR glasses capture an image of the real space in front of the user, and display the captured image of the real space on a display corresponding to the lens portion of the AR glasses. In addition, AR glasses display virtual content generated by CG on a display by superimposing it on a captured image of the real space. As a result, a user wearing AR glasses can experience an AR space in which virtual content is superimposed on a real space.

Japanese Patent No. 6655751

A system has been proposed that allows a user to experience an RPG (Role-Playing Game) by displaying RPG (Role-Playing Game) content on an AR glass display. There has been a demand for this system to provide users with a realistic AR experience.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a communication system, a communication method, and a communication program capable of providing a user with a realistic virtual space experience.

In order to solve the above-described problems and achieve the object, the communication system of the present invention is a communication system that includes a display device used by a user, a smart device carried by the user, and a server that communicates with the smart device. The display device has a communication unit that performs wireless communication with a display device used by another user, and the server provides at least location information and map information of the smart device carried by each user. a determination unit that determines the state between the user and the other user based on the display device used by the user and the display used by the other user according to the state between the user and the other user a setting unit for setting restrictions on communication with a device, the smart device at least detecting location information of the smart device and transmitting the location information to a server; and setting by the setting unit. and a restriction unit that restricts communication between a display device used by a user and a display device used by another user.

According to the present invention, it is possible to provide a user with a realistic virtual space experience.

FIG. 1 is a diagram showing an example of an image displayed on a display of AR glasses. FIG. 2 is a diagram illustrating the configuration of the communication system according to the embodiment. FIG. 3 is a block diagram showing an example of the configuration of the communication system according to the embodiment. 4 is a block diagram showing an example of the configuration of the AR glasses shown in FIG. 3. FIG. FIG. 5 is a block diagram showing an example of the configuration of the smart device shown in FIG. 3. As shown in FIG. FIG. 6 is a block diagram showing an example of the configuration of the server shown in FIG. 3; 7 is a diagram showing an example of the data configuration of the communication restriction rule shown in FIG. 6. FIG. 8 is a diagram showing an example of the data configuration of the communication restriction rule shown in FIG. 6. FIG. FIG. 9 is a diagram for explaining communication restrictions between users in a communication system. FIG. 10 is a diagram for explaining communication restrictions between users in a communication system. FIG. 11 is a sequence diagram illustrating a procedure of communication processing in the communication system according to the embodiment; FIG. 12 is a diagram showing a computer that executes a program.

Hereinafter, embodiments of a communication system, a communication method, and a communication program according to the present application will be described in detail with reference to the drawings. Note that the communication system, communication method, and communication program according to the present application are not limited by this embodiment.

In the following embodiments, a communication system, a communication method, and a processing flow of a communication program according to the embodiments will be described in order, and finally effects of the embodiments will be described.

[Embodiment]
First, an embodiment will be described. In the embodiment, a user visiting a sightseeing spot (for example, an island) wears, for example, AR glasses capable of displaying virtual RPG content as a display device used by the user, and tours the tourist spot. , RPG will also be described.

FIG. 1 is a diagram showing an example of an image displayed on a display of AR glasses. As exemplified in FIG. 1, the image of the actual island is superimposed, for example, with contents C1 of enemy monsters and contents C2 of coins, displayed on the AR glass, and the user defeats the monsters, collects coins, and so on. It enables game experiences such as working on missions.

Further, communication is possible between users wearing AR glasses. For this reason, in the embodiment, the entire small island is used to allow the user to move his/her body and communicate with his or her companions, thereby enabling an RPG experience unique to the area.

Then, while communicating with other users by communication, the users can cooperate with each other for events or send support items when other users are in trouble.

Here, in the embodiment, a more realistic AR experience is provided by incorporating game elements into the way of communication between users. Specifically, in the embodiment, communication between users is restricted when the distance between users is long and when there is an obstacle between users. For example, if there is a virtual enemy character between a user and another user, the enemy jams and communication between the user and the other user becomes impossible. , Incorporate gameplay.

[Configuration of communication system]
A configuration of a communication system according to an embodiment will be described. FIG. 2 is a diagram illustrating the configuration of the communication system according to the embodiment. FIG. 3 is a block diagram showing an example of the configuration of the communication system according to the embodiment.

In this embodiment, for example, a case in which user A (user) and user B (another user) who experience an RPG while sightseeing in a sightseeing spot use the communication system 1 will be described as an example. As shown in FIGS. 2 and 3, the communication system 1 according to the embodiment includes AR glasses 10A and 10B (display devices) worn by users A and B, respectively, and a motion controller 20A held by each of the users A and B. , 20B, smart devices 30A and 30B carried by users A and B, respectively, and a server 40 located in a data center or the like.

The AR glasses 10A are worn on the head of the user A like general eyeglasses. The AR glasses 10A have an imaging function, an audio input function, a communication function, a display function, and an audio output function. The AR glasses 10A capture an image of the real space, and display the captured image of the real space on a display corresponding to the lens portion of the AR glasses 10A. Under the control of the smart device 30A, the AR glasses 10A superimpose the CG-generated virtual content on the captured image of the real space and display it on the display. Under the control of the smart device 30A, the AR glasses 10A display virtual content such as character images such as RPG elements such as enemies, allies, and coins. Also, if the virtual content is audio, the AR glasses 10A may output this audio.

The AR glasses 10B are worn on the head of the user B and have the same functions as the AR glasses 10A. The AR glasses 10B execute various processes under the control of the smart device 30B. In the following description, the AR glasses 10A and 10B are collectively referred to as the AR glasses 10. FIG.

The motion controller 20A is a controller held by the user A. The motion controller 20A has, for example, an acceleration sensor and a communication function to transmit the detection result of the acceleration sensor to the smart device 30A. The motion controller 20B is a controller held by the user B and has the same functions as the motion controller 20A. The motion controller 20B transmits the detection result of the acceleration sensor to the smart device 30B.

The smart device 30A is a device carried by the user A, for example, a smart device such as a tablet or a smart phone, and has a position detection function, an image recognition function, and a voice recognition function. The smart device 30A controls the AR glasses 10A. The smart device 30A acquires the motion of the user A's hand based on the detection result of the acceleration sensor transmitted from the motion controller 20A. Hereinafter, the smart devices 30A and 30B are collectively referred to as the smart device 30. FIG.

The smart device 30A connects to the server 40 via the network N and transmits the location information of the user A and the like to the server 40 . The smart device 30A receives virtual content output from the AR glasses 10A from the server 40 via the network N. FIG. The smart device 30A causes the AR glasses 10A to output virtual content provided by the server 40. FIG.

Furthermore, the smart device 30A restricts communication between the AR glasses 10A worn by the user A and the AR glasses 10B worn by the user B according to the setting by the server 40. FIG. Note that the smart device 30B has the same function as the smart device 30A, and causes the AR glasses 10B to output virtual content provided by the server 40. FIG. The smart device 30B restricts communication between the AR glasses 10B worn by the user B and the AR glasses 10A worn by the user A according to the setting by the server 40 .

The server 40 holds map information and virtual content in the AR space, selects virtual content, and transmits it to the smart device 30 . The server 40 determines the status between the users A and B based on the location information of the users A and B transmitted from the smart devices 30A and 30B. Then, the server 40 sets communication restrictions between the AR glasses 10A worn by the user A and the AR glasses 10B worn by the user B according to the state between the users A and B. FIG.

[AR glass]
Next, the AR glass 10A will be explained. FIG. 4 is a block diagram showing an example of the configuration of the AR glasses 10A shown in FIG. 3. As shown in FIG. The AR glass 10B has the same configuration as the AR glass 10A.

As shown in FIG. 4 , the AR glasses 10 have an imaging unit 11 , an audio input unit 12 (recording unit), a communication unit 13 , a display unit 14 and an audio output unit 15 .

The imaging unit 11 images the real space. For example, when the imaging direction of the imaging unit 11 is in front of the AR glasses 10 , the imaging unit 11 images the real space in front of the AR glasses 10 . The imaging unit 11 generates an image of a real space by processing a photoelectric conversion element such as a CCD or a CMOS and a photoelectric conversion signal output from the imaging element. The imaging unit 11 acquires a two-dimensional image of three colors of R (red), G (green), and B (blue), for example.

The voice input unit 12 is configured by a device that receives input of voice and records the input voice.

The communication unit 13 performs wireless communication with the smart device 30 . The communication unit 13 transmits the image captured by the imaging unit 11 and the audio recorded by the audio input unit 12 to the smart device 30 . The communication unit 13 receives virtual content transmitted from the smart device 30 . In addition, the communication unit 13 communicates with the AR glasses 10B worn by the user B to enable conversation between the users A and B. FIG.

The display unit 14 is configured by a display. The display unit 14 displays the image of the real space captured by the imaging unit 11 . The display unit 14 displays the virtual content received by the communication unit 13, such as character images such as enemies, allies, and coins, superimposed on images in real space. Note that the display unit 14 is a display capable of transmissive display, and may display character images such as enemies, allies, coins, etc. among virtual contents.

The audio output unit 15 outputs audio. The audio output unit 15 outputs sounds such as animal barks and footsteps from the virtual content received by the communication unit.

[Smart Device]
Next, the smart device 30A will be described. FIG. 5 is a block diagram showing an example of the configuration of the smart device 30A shown in FIG. 3. As shown in FIG. Note that the smart device 30B has the same configuration as the smart device 30A. As shown in FIG. 5 , the smart device 30 has a communication section 31 , a storage section 32 and a control section 33 .

The communication unit 31 performs wireless or wired communication with other devices. The communication unit 21 is a communication interface that transmits and receives various information to and from another device connected via a network or the like. The communication unit 31 is realized by a NIC (Network Interface Card) or the like, and performs communication between another device and the control unit 33 (described later) via an electric communication line such as a LAN (Local Area Network) or the Internet. For example, the communication unit 31 receives images and sounds from the AR glasses 10A and transmits virtual content to the AR glasses 10A. The communication unit 31 transmits location information of the smart device 30</b>A to the server 40 and receives virtual content from the server 40 .

The storage unit 32 is a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), an optical disc, or the like. Note that the storage unit 32 may be a rewritable semiconductor memory such as a RAM (Random Access Memory), a flash memory, or an NVSRAM (Non Volatile Static Random Access Memory). The storage unit 32 stores an OS (Operating System) and various programs executed by the smart device 30A. Furthermore, the storage unit 32 stores various information used in executing the program. The storage unit 32 stores content information 321 including virtual content transmitted from the server 40 . The storage unit 32 stores image data (not shown) transmitted from the AR glasses 10A.

The control unit 33 controls the entire smart device 30A. The control unit 33 is, for example, an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 33 also has an internal memory for storing programs defining various processing procedures and control data, and executes each processing using the internal memory. Further, the control unit 33 functions as various processing units by running various programs. The control unit 33 has a position detection unit 331, a motion detection unit 332, and an AR glasses control unit 333 (control unit).

The position detector 331 detects the position of the smart device 30A. The position detection unit 331 can acquire the position information of the smart device 30A by GPS (Global Positioning System), for example. The position detection unit 331 periodically acquires the position of the smart device 30A and transmits the position information represented by latitude and longitude to the server 40 via the communication unit 31 .

The motion detection unit 332 acquires the motion of the user's hand based on the detection result of the acceleration sensor transmitted from the motion controller 20A. In addition, in the communication system 1, use of the motion controller 20 may be optional. The motion detector 332 may be omitted from the smart device 30 when the motion controller 20 is not used.

The AR glasses control unit 333 controls the processing of the AR glasses 10A. For example, the AR glasses control unit 333 controls image display processing on the display of the lens unit of the AR glasses 10A and audio output processing by the AR glasses 10A. The AR glasses control unit 333 has a content synthesis unit 334 and a communication control unit 335 .

When the virtual content transmitted from the server 40 is a character image to be superimposed on the real space image, the content synthesizing unit 334 performs synthesizing processing of the character image and the real space image. After the composition processing by the content composition unit 334, the AR glasses control unit 333 causes the display unit 14 of the AR glasses 10A to display an image in which the character image is superimposed on the image of the real space. The superimposition position of the character image is set in advance, for example. Alternatively, the character image superimposition position is set by an instruction from the server 40 .

In addition, the virtual content may be character images such as enemies, allies, and coins, which are RPG elements, as well as sounds such as animal cries and footsteps. The AR glasses control unit 333 causes the audio output unit 15 of the AR glasses 10A to output audio when the acquired content is audio such as animal cries and footsteps.

[server]
Next, the server 40 will be explained. FIG. 6 is a block diagram showing an example of the configuration of server 40 shown in FIG. As shown in FIG. 6 , the server 40 has a communication section 41 , a storage section 42 and a control section 43 .

The communication unit 41 performs wireless or wired communication with other devices. The communication unit 41 is a communication interface that transmits and receives various information to and from another device connected via a network or the like. The communication unit 41 is implemented by a NIC or the like, and performs communication between another device and the control unit 43 (to be described later) via an electric communication line such as a LAN or the Internet. For example, the communication unit 41 receives location information, image recognition results, and voice recognition results from the smart devices 30A and 30B, and transmits virtual content to the smart devices 30A and 30B.

The storage unit 42 is a storage device such as an HDD, an SSD, an optical disc, or the like. Note that the storage unit 42 may be a rewritable semiconductor memory such as a RAM, a flash memory, or an NVSRAM. The storage unit 42 stores the OS and various programs executed by the server 40 .

Further, the storage unit 42 stores various information used in executing the program. The storage unit 42 stores map information 421 , content information 422 , user information 423 , obstacle information 424 and communication restriction rules 425 .

The map information 421 is a map including forests, rivers, mountains, plains, famous places, etc. of sightseeing spots such as islands that the user visits. The map information 421 indicates the elevation of the land by contour lines.

Content information 422 includes various virtual contents. Various virtual contents are character images such as enemies, allies, coins, etc., or sounds of animal footsteps or cries. Character images such as enemies, allies, coins, etc. have preset positions to appear. The character images of enemies and allies have strengths set in advance. In addition, virtual content is created in advance in association with predetermined areas (sightseeing spots), forests, rivers, mountains, plains, famous places, etc. It can be unique content. Also, the content unique to each predetermined location of the tourist spot may be created separately for each enemy or friend.

The user information 423 includes various information of users who use the communication system 1 and experience RPGs in a predetermined area. The user information 423 includes, for example, user identification information, user's RPG experience start time, RPG experience end time, level in RPG, owned support items, identification information of accompanying users, and the like.

The obstacle information 424 is information indicating the types and positions of obstacles that hinder the progress of the user. The obstacle information 424 includes the position, size, and height of terrain irregularities, forests, rivers, and buildings that are obstacles. Further, the obstacle information 424 includes an enemy character image that serves as an obstacle, and its position and strength.

A communication restriction rule 425 is a restriction rule for restricting communication between users A and B. FIG. The extent to which communication between users A and B is limited by the distance between users A and B, the presence or absence of obstacles, the type, size, and number of obstacles is set in advance. Modifications are possible.

7 and 8 are diagrams showing an example of the data configuration of the communication restriction rule 425 shown in FIG. 6. FIG. In FIG. 7, each distance between users A and B is associated with the content of communication restriction corresponding to each distance. For example, as shown in FIG. 7, if the distance between user A and user B is less than 10 m, there is no communication restriction, but if the distance is 10 m or more and less than 30 m, only 10 minutes every 30 minutes Limited to what communication is possible. In the example of FIG. 7, the communication between the users A and B is restricted as the distance between the users A and B increases.

Further, in FIG. 8, the types, sizes, and levels (strengths) of obstacles between users A and B are associated with the contents of communication restrictions corresponding thereto. As shown in FIG. 8, if there is no obstacle between user A and user B, there is no communication limit. is restricted as possible. If there is a forest larger than a predetermined size, communication is limited to one minute every 30 minutes. In the example of FIG. 8, communication between users is restricted as the obstacle becomes larger. If there is an enemy character between user A and user B, communication between users A and B is restricted as the level (strength) of the enemy increases.

The control unit 43 controls the server 40 as a whole. The control unit 43 is, for example, an electronic circuit such as a CPU or MPU, or an integrated circuit such as an ASIC or FPGA. The control unit 43 also has an internal memory for storing programs defining various processing procedures and control data, and executes each processing using the internal memory. Further, the control unit 43 functions as various processing units by running various programs. The control unit 43 has a determination unit 431 and a communication restriction setting unit 432 (setting unit).

Based on at least the location information of the smart devices 30A and 30B received from the smart devices 30A and 30B and the map information 421, the determination unit 431 detects the locations of the users A and B, determine the state between Specifically, the determination unit 431 determines the distance between the user A and the user B.

Then, the determination unit 431 determines whether or not there is an obstacle between the user A and the user B. For example, the determining unit 431 refers to the map information 421 and the obstacle information 424, and determines that the enemy character is an obstacle when there is an enemy character between the user A and the user B. Further, the determination unit 431 refers to the map information 421 and the obstacle information 424, and if there is a terrain unevenness, a forest, a river, or a building between the users A and B, the terrain unevenness, the forest, the river, etc. Alternatively, the building is determined to be an obstacle. Based on the contour lines included in the map information 421, the determination unit 431 may determine mountains, hills, depressions, and the like as obstacles. The determination unit 431 may determine whether or not there is a friendly character between the users A and B.

The communication restriction setting unit 432 limits the distance between the AR glasses 10A worn by the user A and the AR glasses 10B worn by the user B according to the state between the user A and the user B determined by the determination unit 431. set communication limits. The communication restriction setting unit 432 sets the AR glasses 10A worn by the user A and the Set restrictions on communication with the AR glasses 10B to be worn.

The communication restriction setting unit 432 refers to the communication restriction rule 425 illustrated in FIGS. Setting is made so that communication with the AR glasses 10B worn by the user B is restricted.

The communication restriction setting unit 432 refers to the communication restriction rule 425 illustrated in FIGS. Accordingly, communication restrictions between the AR glasses 10A worn by user A and the AR glasses 10B worn by user B are set.

The communication restriction setting unit 432 refers to the communication restriction rule 425 illustrated in FIGS. Restrictions on communication between the AR glasses 10A worn by user A and the AR glasses 10B worn by user B are set according to the size of unevenness, a forest, a river, or a building. The communication restriction setting unit 432 sets the AR glasses 10A worn by the user A and the It may be set to cut off communication with the AR glasses 10B to be worn.

At this time, the communication limit setting unit 432 may limit the communication time or worsen the communication state in accordance with the distance between users A and B and obstacles. For example, the communication limit setting unit 432 may set a communication limit such that noise increases as the distance between users A and B increases. Further, the communication restriction setting unit 432 may set a communication restriction such that the larger the forest between the users A and B or the higher the level of the enemy character, the more noise there is. Further, the communication restriction setting unit 432 may cut off the communication between the users A and B when the level of the enemy character exceeds a predetermined level.

Further, the communication restriction setting unit 432 may release the communication restriction when the users A and B are separated from the obstacle by a predetermined distance or more, and when the user A or the user B defeats the enemy character, the defeated character Communication restrictions may be lifted in stages according to the number of If there are friendly characters between users A and B, the communication restriction setting unit 432 sets the AR glasses 10A worn by user A and the AR glasses 10A worn by user B according to the number and strength of the friendly characters. Restrictions on communication with the AR glasses 10B may be relaxed.

[Example of communication restrictions]
9 and 10 are diagrams for explaining communication restrictions between users in the communication system 1. FIG. In FIGS. 9 and 10, for ease of explanation, each user is pseudo-arranged on a map for explanation.

Communication restrictions between user U11 and user U12 illustrated in FIG. 9 will be described. A forest B1 is located between the user U11 and the user U12. This forest B1 is larger than a predetermined scale. Therefore, in the communication system 1, communication is always restricted so that the user U11 and the user U12 cannot communicate ((1) in FIG. 9). For example, since the forest B1 is larger than the predetermined size, the communication system 1 limits the communication between the user U11 and the user U12 to only one minute every 30 minutes. On the other hand, since there is no obstacle between the user U12 and the user U13, there is no communication restriction and communication is possible ((2) in FIG. 9).

Next, communication restrictions between the user U13 and the user U14 shown in FIG. 10 will be described. Between the user U13 and the user U14 are three enemy monsters B2 to B4. These monsters B2 to B4 are arranged as virtual contents, and their levels are also set. Therefore, in the communication system 1, communication is always restricted so that the user U13 and the user U14 cannot communicate ((1) in FIG. 10).

For example, if monsters B2-B4 are all level 1, the levels of monsters B2-B4 are added. In the communication system 1, each level is added to the value "3", and the user U13 and the user U14 are limited to communication for only one minute every 30 minutes. When the user U13 and the user U14 defeat the monsters, the communication system 1 also cancels the communication restriction for the user U13 and the user U14 by the amount of the defeated monsters. In addition, in the communication system 1, when there are a plurality of monsters, communication may be restricted based on the highest level monster among the monsters.

The communication system 1 may restrict communication based on the size and height of obstacles such as uneven terrain, forests, rivers, and buildings, as well as monsters. Then, in the communication system 1, when there are a plurality of obstacles, the communication may be restricted based on the obstacle with the most restriction among the communication restrictions corresponding to each obstacle. Of course, in the communication system 1, communication may be restricted according to the distance between users according to the communication restriction rule shown in FIG. In addition, the communication system 1 may limit communication based on the most restrictive obstacle among the communication limit according to the distance between users and the communication limit according to obstacles between users.

[Processing procedure of communication processing]
FIG. 11 is a sequence diagram showing the procedure of communication processing in the communication system 1 according to the embodiment.

As shown in FIG. 11, the server 40 refers to the user information 423 in order to recognize users A and B subject to communication restriction (step S1). The server 40 refers to the map information 421 (step S2).

Each time the smart devices 30A and 30B detect the positions of the smart devices 30A and 30B (steps S3 and S6), they transmit position information to the server 40 (steps S4 and S7). The server 40 determines the positions of the users A and B based on the received position information and map information 421 (steps S5 and S8).

Server 40 determines the status between User A and User B. First, the server 40 determines the distance between the user A and the user B (step S9). The server 40 refers to the obstacle information 424 (step S10) and determines whether or not there is an obstacle between the user A and the user B (step S11).

The server 40 refers to the communication restriction rule 425 (step S12), and determines whether or not to restrict communication based on the determination results of steps S9 and S11 (step S13).

When the server 40 determines not to restrict communication (step S13: No), the process returns to step S5. For example, as illustrated in the communication restriction rule 425 in FIGS. If not, it is determined that communication restriction is not performed.

If the server 40 determines to restrict communication (step S13: Yes), communication between the AR glasses 10A worn by the user A and the AR glasses 10B worn by the user B is restricted according to the communication restriction rule 425. A limit is set (step S14). Then, the smart devices 30A and 30B are instructed to restrict communication (steps S15 and S17). The smart devices 30A and 30B restrict communication between the AR glasses 10A worn by the user A and the AR glasses 10B worn by the user B according to the setting by the server 40 (steps S16 and S18).

[Effects of Embodiment]
As described above, in the present embodiment, communication between the AR glasses 10A worn by the user A and the AR glasses 10B worn by the user B is restricted according to the state between the users A and B. . For example, in the embodiment, when the distance between the users is long, or when there is an obstacle such as an enemy character between the users, communication between the users is restricted so that the game can be used as a communication method. It is possible to provide the user with a more realistic virtual space experience.
[System configuration, etc.]
Also, each component of each device illustrated is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to the one shown in the figure, and all or part of them can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. Can be integrated and configured. Furthermore, all or any part of each processing function performed by each device is realized by a CPU or GPU and a program analyzed and executed by the CPU or GPU, or as hardware by wired logic can be realized.

Further, among the processes described in this embodiment, all or part of the processes described as being automatically performed can be performed manually, or the processes described as being performed manually can be performed manually. All or part of this can also be done automatically by known methods. In addition, information including processing procedures, control procedures, specific names, and various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified.

[program]
It is also possible to create a program in which the processes executed by the AR glasses 10, the smart devices 30A and 30B, and the server 40 described in the above embodiment are described in a computer-executable language. For example, it is possible to create a program in which the processes executed by the AR glasses 10, the smart devices 30A and 30B, and the server 40 in the embodiment are described in a computer-executable language. In this case, the same effects as those of the above embodiments can be obtained by having the computer execute the program. Further, such a program may be recorded in a computer-readable recording medium, and the program recorded in this recording medium may be read by a computer and executed to realize processing similar to that of the above embodiments.

FIG. 12 is a diagram showing a computer that executes a program. As illustrated in FIG. 12, computer 1000 includes, for example, memory 1010, CPU 1020, hard disk drive interface 1030, disk drive interface 1040, serial port interface 1050, video adapter 1060, and network interface 1070. , and these units are connected by a bus 1080 .

The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM 1012 as illustrated in FIG. The ROM 1011 stores a boot program such as BIOS (Basic Input Output System). Hard disk drive interface 1030 is connected to hard disk drive 1090 as illustrated in FIG. A disk drive interface 1040 is connected to the disk drive 1100 . A removable storage medium such as a magnetic disk or optical disk is inserted into the disk drive 1100 . Serial port interface 1050 is connected to mouse 1110 and keyboard 1120, for example. Video adapter 1060 is connected to display 1130, for example.

Here, as illustrated in FIG. 12, the hard disk drive 1090 stores an OS 1091, application programs 1092, program modules 1093, and program data 1094, for example. That is, the above program is stored, for example, in hard disk drive 1090 as a program module in which instructions to be executed by computer 1000 are described.

Various data described in the above embodiments are stored as program data in the memory 1010 or the hard disk drive 1090, for example. Then, the CPU 1020 reads the program modules 1093 and program data 1094 stored in the memory 1010 and the hard disk drive 1090 to the RAM 1012 as necessary, and executes various processing procedures.

Note that the program module 1093 and program data 1094 related to the program are not limited to being stored in the hard disk drive 1090. For example, they may be stored in a removable storage medium and read by the CPU 1020 via a disk drive or the like. . Alternatively, the program module 1093 and program data 1094 related to the program are stored in another computer connected via a network (LAN (Local Area Network), WAN (Wide Area Network), etc.), and are transmitted via the network interface 1070. It may be read by CPU 1020 .

The above-described embodiments and modifications thereof are included in the scope of the invention described in the claims and their equivalents, as well as in the technology disclosed in the present application.

10, 10A, 10B AR glasses 11 imaging unit 12 audio input unit 13, 31, 41 communication unit 14 display unit 15 audio output unit 20A, 20B motion controller 30, 30A, 30B smart device 32, 42 storage unit 33, 43 control unit 40 server 321, 422 content information 331 position detection unit 332 motion detection unit 333 AR glasses control unit 334 content synthesis unit 335 communication control unit 421 map information 423 user information 424 obstacle information 425 communication restriction rule 431 determination unit 432 communication restriction setting unit

Claims (6)

A communication system comprising a display device worn on the head of a user, a smart device carried by the user, and a server communicating with the smart device,
The display device
an imaging unit that captures an image of a real space;
a display unit that superimposes and displays virtual content on the image of the real space;
a communication unit that performs wireless communication with a display device worn on the head of another user;
has
The server is
a determination unit that determines a state between the user and the other user based on at least location information and map information of the smart device carried by each user;
communication between the display device worn on the user's head and the display device worn on the head of the other user according to the state between the user and the other user; a setting unit for setting limits;
has
The smart device is
a location detection unit that detects at least location information of the smart device and transmits the location information to a server;
a restriction unit that restricts communication between the display device worn on the head of the user and the display device worn on the head of the other user according to the setting by the setting unit;
has
The determination unit determines whether the smart device carried by each user is located on the basis of map information, and obstacle information indicating the type and position of an obstacle that hinders the progress of the user. Determining the distance to another user and the presence or absence of an obstacle between the user and the other user,
The setting unit configures the display mounted on the user's head according to the distance between the user and the other user and the presence or absence of an obstacle between the user and the other user. A communication system characterized by setting restrictions on communication between the device and the display device worn on the head of the other user . The setting unit adjusts the distance between the user and the other user and the presence/absence of an obstacle between the user and the other user. 2. The communication system according to claim 1 , wherein blocking of communication with the display device used by the user is set. The virtual content includes an enemy character of the user whose position and strength are set in advance,
The determining unit determines that, when there is an enemy character between the user and the other user, the enemy character is the obstacle,
The setting unit sets communication restrictions between the display device used by the user and the display device used by the other user according to the number and strength of the enemy characters. The communication system according to claim 1 or 2 , wherein The virtual content includes a character who is an ally of the user whose position and strength are preset,
When the determination unit determines that the character serving as an ally exists between the user and the other user,
The setting unit relaxes restrictions on communication between the display device used by the user and the display device used by the other user, according to the number and strength of the friendly characters. The communication system according to any one of claims 1 to 3 , wherein A communication method executed by a communication system having a display device worn on the head of a user, a smart device carried by the user, and a server communicating with the smart device, comprising:
a step in which the display device captures an image of a real space;
a step in which the display device superimposes and displays virtual content on the image of the real space;
performing wireless communication between the display device and a display device worn on the head of another user;
a step in which the server determines a state between the user and the other user based on at least location information and map information of the smart device carried by each user;
The server is configured to select between the display device worn on the user's head and the display device worn on the other user's head according to the state between the user and the other user. setting limits for communication between
the smart device detecting at least location information of the smart device and transmitting the location information to a server;
the smart device restricting communication between the display device worn on the user's head and the display device worn on the head of the other user according to the settings in the setting step; ,
including
In the determining step, based on location information of the smart device carried by each user, map information, and obstacle information indicating the type and position of an obstacle that hinders the progress of the user, Determining the distance between the other user and the presence or absence of an obstacle between the user and the other user,
In the setting step, according to the distance between the user and the other user and the presence/absence of an obstacle between the user and the other user, the A communication method , comprising: setting restrictions on communication between a display device and the display device worn on the other user's head . A communication program that causes a computer to perform the method, comprising:
A computer as a display device worn on the user's head ,
imaging a real space;
a step of superimposing and displaying virtual content on the image of the real space;
wireless communication with a display device worn on the head of another user;
and
computer as a server,
determining a state between the user and the other user based on at least location information and map information of a smart device carried by each user;
communication between the display device worn on the user's head and the display device worn on the head of the other user according to the state between the user and the other user; setting limits;
and
a computer as the smart device;
detecting location information of at least the smart device and transmitting the location information to a server;
the smart device restricting communication between a display device worn on the user's head and a display device worn on the head of the other user according to the settings in the setting step; ,
and
In the determining step, based on location information of the smart device carried by each user, map information, and obstacle information indicating the type and position of an obstacle that hinders the progress of the user, Determining the distance between the other user and the presence or absence of an obstacle between the user and the other user,
In the setting step, according to the distance between the user and the other user and the presence/absence of an obstacle between the user and the other user, the A communication program for setting restrictions on communication between a display device and the display device worn on the head of the other user .

Images