JP2020123261A - Radio communication device, method, and program - Google Patents

Abstract

To provide a radio communication device, method, and program capable of reducing delay due to data sharing while alleviating load of a server in data processing and data sharing.SOLUTION: The radio communication device 100A includes a receiving unit 101A which receives first data containing first information indicating a virtual image to be displayed by overlapping and its display range, a processing unit 102A which determines, on the basis of the first information and second information indicating a communicable range of at least one first radio communication device other than this radio communication device, a first transmission destination of the first data from among the first radio communication devices, and a transmission unit 104A for transmitting the first data to the first transmission destination. The processing unit determines a radio communication device, as the first transmission destination, having at least a part of the communication range overlaps at least a part of the display range among the first communication devices.SELECTED DRAWING: Figure 3

Description

Embodiments of the present invention relate to a wireless communication device, a method, and a program.

Technology has been developed for sharing shared data including virtual images among a plurality of wireless terminals and wireless communication devices. For example, a virtual image includes a three-dimensional object (three-dimensional image) together with a two-dimensional picture and character graphics CG (Computer Graphics). This data sharing is performed using a cloud server. When the server performs the process of changing the virtual image, the server transmits the processed data to the plurality of wireless terminals, thereby sharing the data. There is a demand for a wireless communication device capable of reducing the load on the server and reducing the delay in sharing data when processing and sharing such data.

Japanese Patent No. 6336110

The problem to be solved by the embodiment of the present invention is to reduce the load on the server when processing and sharing shared data including a virtual image between the wireless communication device and the wireless terminal. It is to provide a wireless communication device, method and program capable of performing the above.

In order to solve the above problems, a wireless communication device according to an embodiment includes a receiving unit that receives first data including first information indicating a virtual image displayed in an overlapping manner and its display range, and a first receiving unit. Based on the information and the second information indicating the communicable range of at least one first wireless communication device different from the wireless communication device, the first destination of the first data of the first wireless communication device And a transmitter that transmits the first data to the first destination. The processing unit determines, as the first destination, a wireless communication device in which at least a part of the communication range overlaps with at least a part of the display range among the first wireless communication devices.

The figure showing the radio|wireless communications system in 1st Embodiment. The figure for demonstrating the display range of the image contained in shared data. 1 is a configuration diagram of a wireless communication device according to a first embodiment. FIG. The figure showing arrangement|positioning and communication range of a some wireless communication apparatus. The figure showing arrangement|positioning and a display range of several virtual objects. The figure showing arrangement|positioning of the wireless terminal which displays a virtual object in the state of FIG. The figure showing arrangement|positioning of the wireless terminal which transmits the command which changes the appearance of a virtual object in the state of FIG. FIG. 8 is a sequence diagram of a wireless communication system that changes the appearance of a virtual object in the state of FIG. 7. 3 is a flowchart of a wireless communication device that changes the appearance of a virtual object A in the first embodiment. The figure showing sharing of the data after a change between wireless communication apparatuses after changing the appearance of a virtual object. The figure showing movement of the wireless terminal which displays a virtual object from the state of FIG. FIG. 12 is a sequence diagram of a wireless communication system that changes the appearance of the virtual object C in the state of FIG. 11. FIG. 7 is a diagram for explaining a change in the display range of a virtual object from the state of FIG. 6. FIG. 14 is a sequence diagram of a wireless communication system that changes the display range of a virtual object in the state of FIG. 13.

Hereinafter, embodiments for carrying out the invention will be described.

(First embodiment)
FIG. 1 is a diagram showing a wireless communication system in this embodiment. The outline will be described with reference to FIG. Communication can be performed between the wireless communication device 1 and the wireless communication devices 100A and 100B. Here, the wireless communication device 1 is a server having a large-capacity storage unit, and is a wireless communication device capable of holding a large amount of data and performing data processing. This server includes cloud servers. These communications are done via the Internet.

The wireless communication devices 100A, 100B and 100C are repeaters that can communicate with each other, and are, for example, access points. The wireless communication devices 100A, 100B and 100C form a wireless mesh network by an existing method. The wireless communication devices 100A and 100B can directly communicate with the wireless communication device 1.

The wireless communication device 100C is a wireless communication device that complements the communication range of the wireless communication devices 100A and 100B. When the wireless communication device 1 directly communicates with a large number of wireless communication devices, the load increases, so the wireless communication device 100C is a wireless communication device that does not directly communicate with the wireless communication device 1.

The wireless communication device 100C receives the shared data transmitted from the wireless communication device 1 by this wireless mesh network. That is, it is possible to share shared data among the wireless communication devices 100A, 100B and 100C. Further, the wireless communication devices 100A, 100B and 100C communicate with the wireless terminals, and the shared data transmitted from the wireless communication device 1 is also shared by the wireless terminals. In FIG. 1, the wireless communication device 100A can communicate with the wireless terminals 200 and 300 existing within its wireless communication range. Through this communication, the shared data is also shared by the wireless terminals 200 and 300.

The shared data in the present embodiment includes data regarding a virtual image to be displayed by being superimposed on a projected video. The wireless terminals 200 and 300 are wireless terminals that display the image included in the shared data in an overlapping manner with the acquired video. The wireless terminals 200 and 300 are terminals compatible with XR (X-Reality), and can add an image set as shared data to the real world. Through such wireless terminals 200 and 300, the user can see the world in which a virtual image is added to the real world. The XR includes virtual reality, augmented reality (AR), mixed reality, alternative reality, and newly developed technologies in the future.

In this embodiment, the wireless terminals 200 and 300 are wireless terminals compatible with augmented reality. The wireless terminal 200 is a wearable terminal, for example, a goggle type wireless terminal. When the user views an image through the wireless terminal 200, the image included in the shared data appears to overlap the actual image. The wireless terminal 300 is a wireless terminal that has a camera and can display this image by superimposing the image on the image acquired by the camera. The wireless terminal 300 is, for example, a tablet equipped with a camera, a smartphone, a laptop, a monitor, or the like. That is, the wireless communication devices 100A and 100B receive, from the wireless communication device 1, shared data including an image displayed by being superimposed on an image projected by the wireless terminal 200 and the wireless terminal 300, and the wireless communication device 100C, the wireless terminal 200, and Send to 300. Finally, the wireless communication devices 100A, 100B and 100C and the wireless terminals 200 and 300 have shared data including this image.

Here, the image of the shared data includes a three-dimensional object (stereoscopic image) as well as a two-dimensional object such as a picture, a character, and a figure. Further, these images may be CGs (Computer Graphics) regardless of whether they are two-dimensional or three-dimensional. The images of these shared data are also expressed as virtual images. Positions, appearances, postures, display ranges, motions, etc. are set in the shared data including this image. The position represents the position in the three-dimensional space where this image is arranged. For example, when this image is set as a stereoscopic image of a three-dimensional object, the position of this three-dimensional object is set in the shared data.

Appearance represents visual information of an image, such as shape, color, and texture. The appearance of the image may be, for example, a two-dimensional character, a picture, or a figure. The appearance of this figure may be a three-dimensional object represented as a stereoscopic image. In the description of the present embodiment, for example, a finished product of a product in a factory, a product module, a bulletin board, or the like is used. These examples are set for convenience of description, and the image is not limited to these.

The posture represents the posture of the image, and is, for example, the direction in which the image is facing or the inclination. The motion represents a motion of an image. For example, when this image is an image that three-dimensionally represents a finished product of a product in a factory, it is possible to set an operation of rotating the image or moving the image vertically or horizontally. The virtual image may be a moving image accompanied by the movement of the object itself.

The display range refers to a range in which the wireless terminals 200 and 300 display virtual images in a superimposed manner. Specifically, it is a range in which the connected wireless communication device of the wireless communication devices 100A, 100B, and 100C transmits shared data including this image. That is, the wireless communication devices 100A, 100B and 100C transmit the shared data to the wireless terminals 200 and 300 that have entered this range.

For example, in FIG. 2, a virtual image and its display range are shown by broken lines. The wireless communication device 100A is assumed to be connected to the wireless terminals 200 and 300. Since the wireless terminal 200 is located within the display range of the virtual image, the wireless communication device 100A transmits shared data including this virtual image to the wireless terminal 200. On the other hand, since the wireless terminal 300 is located outside the display range of this virtual image, the wireless communication device 100A does not transmit this shared data to the wireless terminal 300. Therefore, the wireless terminal 200 can display the virtual images in an overlapping manner, but the wireless terminal 300 cannot display the virtual images in an overlapping manner.

The reason why the display range is set in the shared data is that the load of the processing of displaying the images in a superimposed manner increases for the wireless terminals 200 and 300. Another reason is to limit the shared data transmitted by the wireless terminals 200 and 300 and reduce the load on the wireless terminals 200 and 300.

Further, this display range is also used to determine which of the wireless communication devices 100A, 100B and 100C transmits the shared data. The wireless communication device 1 transmits the shared data to the wireless communication devices 100A and 100B in which at least a part of the respective communication range and at least a part of the display range set in the shared data overlap. .. The wireless communication devices 100A and 100B also determine whether to transmit the received shared data to the wireless communication device 100C, based on the display range set in the received shared data and the communication range of the wireless communication device 100C.

The wireless communication devices 100A and 100B transmit this shared data when at least part of the display range set in this shared data and at least part of the communication range of the wireless communication device 100C overlap. That is, the wireless communication devices 100A, 100B and 100C, and the wireless terminals 200 and 300 do not all share the data held by the wireless communication device 1. The transmission destination of the shared data is determined by the display range, the communication range of the wireless communication devices 100A, 100B and 100C, and the positions of the wireless terminals 200 and 300.

Further, the wireless communication devices 100A, 100B and 100C can change this shared data. For example, when changing the appearance of the image included in the shared data, it was set to display the completed form of the product as an image, but instead of the completed form of this product, a bulletin board with information is displayed as an image. Can be changed.

The data in which the image is changed is also shared between the wireless communication devices 100A, 100B and 100C and the wireless terminals 200 and 300, similarly to the shared data transmitted from the wireless communication device 1. Similarly, the position, orientation, display range, movement, etc. of this image can be changed in the same manner. Further, the change of the shared data may be performed by a command from the wireless communication devices 100A, 100B, 100C or a wireless terminal.

By doing so, the processing load on the wireless communication device 1 such as a server can be reduced, and data can be shared more quickly because no server is involved.

Further, the wireless communication device as the transmission source can reduce the amount of data held by the wireless communication devices 100A, 100B and 100C and the wireless terminals 200 and 300 by selecting the data to be shared, and can reduce the load.

In order for the wireless communication device of the transmission source to select shared data, the display range of the image set in each data and the communication range of the wireless communication device of the transmission destination (for example, the wireless communication devices 100A, 100B, 100C) And the data in which at least part of the communication range of this wireless communication device and at least part of the set display range overlap are extracted. When the transmission destination is a wireless terminal (for example, the wireless terminal 200), the display range set in each data is compared with the position of the wireless terminal, and the display range including the position of this wireless terminal is set. Existing data. The source wireless communication device selects the extracted data to the destination wireless communication device and the wireless terminal, and transmits the selected data as shared data.

FIG. 3 is a diagram showing the configuration of the wireless communication device 100A. The wireless communication device 100A includes a receiving unit 101A, a processing unit 102A, a storage unit 103A, and a transmitting unit 104A. Note that the wireless communication device 100A has a function as a relay connecting the wireless terminal and the Internet and a function of forming a wireless mesh network, and this function is assumed to be included in the existing relay configuration. Is omitted.

The reception unit 101A receives shared data, a command to change the shared data, and information indicating the position of the wireless terminal. This shared data is finally transmitted to the selected wireless communication device and/or wireless terminal among the wireless communication devices 100B and 100C and the wireless terminals 200 and 300. The instruction to change the shared data is used in the process of changing the corresponding shared data in the processing unit 102A. The information indicating the position of the wireless terminal is used in the processing unit 102A to determine the wireless terminal to which this shared data is transmitted. The shared data, the command for changing the shared data, and the information indicating the position of the wireless terminal are respectively sent to the processing unit 102A.

The processing unit 102A determines the transmission destination of the shared data based on the image display range, the positions of the communication terminals 200 and 300, and the communication ranges of the wireless communication devices 100B and 100C. Both this shared data and this transmission destination are sent to the transmission unit 104A. The processing unit 102A can also estimate the communication range of the wireless communication devices 100A, 100B, and 100C. Specifically, the rough communication range is estimated based on the positions of the wireless communication devices 100A, 100B, and 100C and the standard with which the wireless communication device 100A communicates. Further, the processing unit 102A estimates the communication range of each wireless communication device from the position of the object that is an obstacle to communication and is sent from the storage unit 103A. This communication range is used to determine the destination of shared data. The processing unit 102A causes the storage unit 103A to hold the shared data sent from the receiving unit 101A and the information indicating the communication range of each wireless communication device.

Further, the processing unit 102A can change the position, appearance, posture, display range, motion, etc. included in the shared data. When the processing unit 102A receives a command to change the shared data from the receiving unit 101A, the processing unit 102A performs a process of changing the shared data and stores the changed data in the storage unit 103A. The processing unit 102A may update and change the shared data, for example, every time a fixed period elapses. The processing unit 102A similarly determines the transmission destination for the changed data. When the transmission destination is determined, an instruction to update the changed data, the transmission destination, and the shared data with the changed data is sent to the transmission unit 104A.

The storage unit 103A holds shared data. The storage unit 103A also holds information indicating the communication range of the wireless communication devices 100B and 100C, and information necessary to configure a wireless mesh network with the wireless communication devices 100B and 100C. The information indicating the communication range of the wireless communication devices 100B and 100C is used by the processing unit 102A together with the display range of the virtual image included in the shared data to determine the wireless communication device that transmits the shared data. The storage unit 103A also holds information indicating the position and size of an object that is an obstacle to communication. This information is used by the processing unit 102A to estimate the communication range of the wireless communication devices 100A, 100B and 100C. The storage unit 103A is an arbitrary device that holds data, and is, for example, a RAM, ROM, HDD, SSD, or the like.

The transmission unit 104A transmits the shared data to the destination determined by the processing unit 102A. In addition, when the shared data is changed, the transmission unit 104A instructs the transmission destination determined by the processing unit 102A to update the changed data and the shared data sent from the processing unit 102A to the changed data. To send.

The wireless communication devices 100B and 100C have the same configuration as the wireless communication device 100A. That is, the wireless communication device 100B has a reception unit 101B, a processing unit 102B, a storage unit 103B, and a transmission unit 104B, and the wireless communication device 100C has a reception unit 101C, a processing unit 102C, a storage unit 103C, and a transmission unit 104C. Since the respective constituent elements are the same as the constituent elements of the wireless communication device 100A, the description thereof will be omitted.

Next, the operation of the wireless communication system in this embodiment will be described. 4 to 10 are layout diagrams and sequence diagrams of the wireless communication devices 100A, 100B and 100C, and the wireless terminals 200 and 300. Using these, the relationship and operation of the wireless communication devices 100A, 100B and 100C, the wireless terminals 200 and 300 in the present embodiment will be described.

FIG. 4 is a diagram showing an arrangement of the wireless communication devices 100A, 100B and 100C in the present embodiment.

The area 10 is an area in which the wireless communication devices 100A, 100B, and 100C are arranged, and represents, for example, one room of a factory. The arcs representing the communication ranges of the respective wireless communication devices are estimated by the wireless communication devices 100A, 100B and 100C, respectively. Although the communication range is an arc in the present embodiment, the wireless communication devices 100A, 100B, and 100C may estimate the communication range in consideration of the presence of an object that obstructs communication.

Three wireless communication devices 100A, 100B, and 100C enable communication within the area 10. Further, the wireless communication devices 100A, 100B and 100C form a wireless mesh network, and each can communicate with each other. The wireless communication device 1 has acquired in advance information regarding the communication range of the wireless communication devices 100A, 100B, and 100C. Further, the wireless communication devices 100A, 100B, and 100C pre-estimate and share information regarding the communication range of each wireless communication device, and the storage units 103A, 103B, and 103C hold this information.

FIG. 5 is a diagram showing an arrangement of the images when the wireless communication devices 100A and 100B receive shared data to be displayed on the video from the wireless communication device 1 in a superimposed manner. In the present embodiment, this image is described as a three-dimensional object and is called a virtual object. In FIG. 5, it is assumed that virtual objects A, B, and C are set in the area 10. This virtual object A represents the completed product as a three-dimensional object. For example, it is an electric appliance, and is a fan here. The virtual object B represents the module of this product as a three-dimensional object. For example, a motor in an electric fan. Similarly, the virtual object C also represents the module of this product as a three-dimensional object. For example, a substrate in a fan.

In the present embodiment, if at least a part of the communication range of the wireless communication devices 100A and 100B and at least a part of the display range of the virtual object included in the shared data overlap, the wireless communication device 1 is in the virtual state. Data containing a physical object. For example, in the wireless communication device 100A of FIG. 5, the display ranges of the virtual objects A and B exist within the communication range. Therefore, the wireless communication device 1 transmits data including the virtual object A and data including the virtual object B to the wireless communication device 100A. Further, in the wireless communication device 100B of FIG. 5, the display range of the virtual objects A and C exists within the communication range. Therefore, the wireless communication device 1 transmits data including the virtual object A and data including the virtual object C to the wireless communication device 100B.

In the wireless communication device 100A, the receiving unit 101A receives the data including the virtual object A and the data including the virtual object B, and sends the data to the processing unit 102A. The processing unit 102A stores these data in the storage unit 103A. Similarly, the receiving unit 101B of the wireless communication device 100B receives the data including the virtual object A and the data including the virtual object C, and sends the data to the processing unit 102B. The processing unit 102B stores these data in the storage unit 103B.

The wireless communication device 100C is not directly connected to the wireless communication device 1, but a wireless mesh network is formed between the wireless communication devices 100A, 100B and 100C. The processing unit 102A of the wireless communication device 100A and the processing unit 102B of the wireless communication device 100B determine whether to transmit the respective data including the virtual objects A, B, and C to the wireless communication device 100C.

For example, in FIG. 5, the display range of the virtual object A and the display range of the virtual object C are at least partially included in the communication range of the wireless communication device 100C. Therefore, the processing unit 102A determines that the wireless communication device 100C is a target to share the data including the virtual object A, and the processing unit 102B determines that the wireless communication device 100C includes the data including the virtual object A and the virtual data. It is determined that the data including the physical object C is to be shared. Here, it is assumed that the processing unit 102A transmits data including the virtual object A to the wireless communication device 100C, and the processing unit 102B determines to transmit data including the virtual object C to the wireless communication device 100C.

The transmitting unit 104A transmits data including the virtual object A to the wireless communication device 100C, and the transmitting unit 104B transmits data including the virtual object C to the wireless communication device 100C. The receiver 101C receives the data including the virtual objects A and C, and sends the data to the processor 102C. The processing unit 102C stores these data in the storage unit 103C. In this way, at least some of the virtual objects A, B, and C are shared between the wireless communication devices 100A, 100B, and 100C, respectively.

FIG. 6 is a diagram in which the wireless terminal 200 is arranged in the area 10 shown in FIG. Sharing of data including a virtual object between a wireless communication device and a wireless terminal will be described with reference to FIG. The wireless terminal 200 at the position shown in FIG. 6 is referred to as a wireless terminal 200P1. It is assumed that the wireless terminal 200P1 communicates with the wireless communication device 100A, and the wireless communication device 100A receives information indicating the position of the wireless terminal 200P1 from the wireless terminal 200P1.

The processing unit 102A determines a wireless communication device that shares data including the virtual object from the information indicating the position of the wireless terminal 200P1 and the display range of the virtual object held in the storage unit 103A. For example, in FIG. 6, the position of the wireless terminal 200P1 is within the display range of both virtual objects A and B. The processing unit 102A determines to transmit the data including the virtual object A and the data including the virtual object B to the wireless terminal 200P1. The transmission unit 104A transmits data including the virtual objects A and B to the wireless terminal 200P1.

When the wireless terminal 200P1 acquires an image from the display range set for each of the virtual objects A and B, the wireless terminal 200P1 superimposes the virtual objects A and B on the image showing this position and displays it. For example, in FIG. 6, the virtual object A is arranged in the center of the area 10. When the user of the wireless terminal 200P1 looks through the wireless terminal 200P1 toward the center of the area 10, the virtual fan that is the virtual object A is seen to be superimposed on the image viewed through the wireless terminal 200P1. When the user of the wireless terminal 200P1 looks through the wireless terminal 200P1 toward the position where the virtual object B is arranged, a virtual motor that is the virtual object B sees an image viewed through the wireless terminal 200P1. You can see it on top of each other.

As described above, the data including the virtual object A and the data including the virtual object B are shared by the wireless communication device 100A to the wireless terminal 200P1. Similarly, data including a virtual object is shared between the wireless communication device and the wireless terminal connected to the wireless communication device.

FIG. 7 is a diagram in which the wireless terminal 300 is arranged in the area 10 shown in FIG. The wireless terminal 300 at the position shown in FIG. 7 is referred to as a wireless terminal 300P1. It is assumed that the wireless terminal 300P1 communicates with the wireless communication device 100A, and the wireless communication device 100A receives information indicating the position of the wireless terminal 300P1 from the wireless terminal 300P1.

The wireless terminal 300P1 transmits a command to change shared data to a wireless communication device that is communicatively connected. In this embodiment, it is assumed that a command to change the appearance of a virtual object is transmitted. In FIG. 7, the wireless terminal 300P1 sends a command to the wireless communication device 100A to change the appearance of the virtual object A to a. For example, the wireless terminal 300P1 transmits, to the wireless communication device 100A, a command to change the completed virtual fan as the virtual object A to a virtual bulletin board that displays information and the like as the virtual object a. To do.

8, 9, and 10 about the movement of the wireless communication system including the wireless communication device 100A after the wireless communication device 100A receives a command to change the appearance of the virtual object A to a from the wireless terminal 300P1. Will be explained.

FIG. 8 is a sequence diagram showing the operations of the wireless communication devices 100A, 100B and 100C, and the wireless terminals 200P1 and 300P1 that form the wireless communication system of this embodiment. A command for changing the appearance of the virtual object A to a is transmitted from the wireless terminal 300P1 to the wireless communication device 100A, and the operation of the wireless communication device 100A will be described with reference to FIG.

The reception unit 101A receives the command transmitted from the wireless terminal 300P1 to change the appearance of the virtual object (step S101). This command is sent from the receiving unit 101A to the processing unit 102A. In the present embodiment, the receiving unit 101A receives a command from the wireless terminal 300P1 to change the appearance of the virtual object A to a. Further, although the instruction is transmitted from the wireless terminal 300P1 in the present embodiment, it may be transmitted from the wireless communication apparatuses 100B and 100C other than the wireless communication apparatus 100A and the wireless terminal 200P1.

The processing unit 102A extracts shared data for changing the appearance of the virtual object from the storage unit 103A, and changes the appearance of the virtual object based on this command (step S102). In addition, the processing unit 102A causes the storage unit 103A to hold the changed data. The processing unit 102A may replace the changed data with shared data and store the shared data in the storage unit 103. In the present embodiment, the processing unit 102A performs a process of changing from the virtual object A to a and stores it in the storage unit 103A.

The processing unit 102A may change not only the appearance of the virtual object but also the position and display range of the virtual object as the change of the shared data. In the present embodiment, the positions and display range of the virtual objects A and a are not changed. For example, the storage unit 103A has previously stored shared data including a completed virtual fan as the virtual object A, but includes a virtual bulletin board for displaying information and the like as a new virtual object a. Retain the changed shared data.

Next, the processing unit 102A determines a wireless communication device and a wireless terminal to which the changed shared data will be transmitted (step S103). That is, the processing unit 103A is a target for transmitting the changed shared data from the information indicating the changed display range of the virtual object, the communication ranges of the wireless communication devices 100B and 100C, and the positions of the wireless terminals 200P1 and 300P1. To decide. In this embodiment, from FIG. 7, at least a part of the communication range of the wireless communication devices 100B and 100C is included in the display range of the virtual object a. The wireless terminals 200P1 and 300P1 are located within the display range of the virtual object a. Therefore, the processing unit 102A determines all of the wireless communication devices 100B and 100C and the wireless terminals 200P1 and 300P1 as transmission destinations of the changed shared data.

In the present embodiment, the shared data after the change is used as the transmission target, but it may be a command to change the appearance of the virtual object A to a, or both. The objects of this transmission may be divided into the wireless communication devices 100B and 100C and the wireless terminals 200P1 and 300P1, respectively.

Next, the processing unit 102A sends the changed shared data to the transmission unit 104A to the destination determined in step S103. The transmission unit 104A transmits the changed shared data to the determined transmission destination (step S104). In the present embodiment, the transmission unit 104A transmits the changed shared data to the wireless communication devices 100B and 100C and the wireless terminals 200P1 and 300P1. Note that in FIG. 8, the wireless communication device 100A sends to a plurality of destinations at different times, but the transmitting unit 104A may send them simultaneously using an existing method.

Next, the processing unit 102A confirms whether or not the end instruction has arrived (step S105). The end instruction is an instruction to end the operation of the wireless communication device 100A in this flow, and is transmitted to the processing unit 102A by the input by the user or the reception unit 101A receiving a signal including the end instruction. This end command may be a command to immediately end the operation of the wireless communication device 100A.

When this end command has not arrived at the processing unit 102A (step S105: No), the process returns to step S101 and stands by so that a command for changing the appearance of the virtual object can be received. On the other hand, when the end command has arrived at the control unit 112 (step S105: Yes), the flow ends, and the wireless communication device 100A ends the operation.

The operation of the wireless communication device 100A starting from the reception of the command to change the appearance of the virtual object A to a has been described above. In the present embodiment, since this command is transmitted to the wireless communication device 100A, the operation of the wireless communication device 100A has been described, but the same applies when this command is transmitted to the wireless communication devices 100B and 100C. Is.

Further, in the present embodiment, this command is transmitted from the wireless terminal 300P1, but may be transmitted from the wireless terminal 200P1 or may be transmitted from the wireless communication device 100B or C. When this command is transmitted from the wireless communication device 100B or C, step S103 is slightly different.

For example, when a command to change the appearance of the virtual object A to a is transmitted from the wireless communication device 100B to the wireless communication device 100A, the wireless communication device 100B performs the same operation as the wireless communication device 100A. The processing unit 102B has already changed it to the virtual object a and holds it in the storage unit 103B. Therefore, the processing unit 102A determines the transmission destination from the wireless communication device and the wireless terminal which are determined not to change the appearance of the virtual object A to a except for the wireless communication device 100B.

Since the operation of the wireless communication device 100A in which the command to change the appearance of the virtual object A to the a is transmitted has been described, the updated shared data including the virtual object a is transmitted using FIGS. 8 and 10. The operations of the wireless communication device and the wireless terminal that have been described will be described. FIG. 8 shows operations of the wireless communication devices 100A, 100B and 100C and the wireless terminals 200P1 and 300P1 along the time axis. FIG. 10 shows the arrangement and operation of the wireless communication devices 100A, 100B and 100C, the wireless terminals 200P1 and 300P1, and the virtual objects A, B and C.

The wireless communication devices 100B and C and the wireless terminals 200P1 and 300P1 that have received the data including the virtual object a from the wireless communication device 100A convert the data including the virtual object A held in their respective storage units into the virtual data. Data with a physical object a. Here, the wireless communication devices 100B and C and the wireless terminals 200P1 and 300P1 may store the data including the virtual object a in their respective storage units, and may not replace the data including the virtual object A. ..

When the wireless communication devices 100B and C and the wireless terminals 200P1 and 300P1 send a command to change the appearance of the virtual object A to a from the wireless communication device 100A, the respective processing units are held in the storage unit. The data including the virtual object A may be changed to be the data including the virtual object a.

Note that the wireless terminals 200P1 and 300P1 display the virtual object a after replacing the data including the virtual object A with the data including the virtual object a.

As described above, even when the appearance of a virtual object is changed, the data including the virtual object after the appearance is changed is shared among the wireless communication devices 100A, 100B and 100C and the wireless terminals 200P1 and 300P1. can do.

It is conceivable that the user may move the wireless terminal that displays a virtual object by superimposing it on the acquired video. For example, a wearable terminal such as the wireless terminal 200 may move with the user. Similarly, the wireless terminal 300 may be carried by the user. The operation of the wireless system when the wireless terminal moves in this way will be described with reference to FIG. FIG. 11 illustrates a case where the wireless terminal 200 moves from the display range of the virtual object B in the state of FIG. 6 to the display range of the virtual object C. Note that the wireless terminal 200 at the position after movement shown in FIG. 11 is referred to as a wireless terminal 200P2. This wireless terminal 200P2 is assumed to communicate with the wireless communication device 100C at the destination.

Further, the wireless terminal 200 has moved out of the display range of the virtual object B due to the movement. At this time, the wireless communication device 100A may transmit a command not to display the virtual object B to the wireless terminal 200, or the wireless device 200 may display a display range of the virtual object B with respect to its own position. The virtual object B may be determined not to be displayed and the virtual object B may not be displayed.

When the wireless terminal 200 moves and becomes the wireless terminal 200P2, the wireless communication device 100C and the wireless terminal 200P2 communicate with each other, so that the receiving unit 101C receives information indicating the position of the wireless terminal 200P2. From this information and the display range of the virtual objects A and C, the processing unit 102C determines that the wireless terminal 200P2 is within the display range of the virtual objects A and C.

The processing unit 102C instructs the transmission unit 104C to transmit the data including the virtual object A and the data including the virtual object C to the wireless terminal 200P2. The transmission unit 104C transmits these two shared data to the wireless terminal 200P2. At this time, the processing unit 102C may cause the transmission unit 104C to transmit a notification of transmitting the two shared data.

The wireless terminal 200P2 that has received this notification already has the data including the virtual object A, and therefore transmits the information requesting the data including the virtual object C to the wireless communication device 100C. The processing unit 102C receives this information through the receiving unit 101C, and instructs the transmitting unit 104C to transmit the data including the virtual object C to the wireless terminal 200P2. The transmission unit 104C transmits data including the virtual object C to the wireless terminal 200P2.

In this way, even when the wireless terminal 200 moves, the wireless terminal 200 can receive shared data according to the position of the moving destination.

FIG. 12 is a sequence diagram showing the operation of the wireless communication system when the wireless terminal 200P2 transmits a command for changing the appearance of the virtual object C to c in the state of FIG. 11 to the wireless communication device 100C. ..

The receiver 101C receives the command to change the appearance of the virtual object C to c and sends it to the processor 102C. The processing unit 102C extracts the data including the virtual object C stored in the storage unit 103C, and changes the virtual object C to c based on this command. The processing unit 102C causes the storage unit 103C to hold the data including the virtual object c. In addition, the processing unit 102C may replace the data including the virtual object C stored in the storage unit 103C with the data including the virtual object c and store the data. It should be noted that, similarly to the case where the appearance of the virtual object A is changed to a, the positions and display ranges of the virtual objects C and c are not changed.

Next, the processing unit 102C determines the transmission destination of the data including the virtual object c. In the state of FIG. 11, the wireless communication device in which at least part of the display range of the virtual object c and at least part of the communication range overlap is the wireless communication device 100B. The wireless terminal located within the display range of the virtual object c is the wireless terminal 200P2. The processing unit 102C determines the transmission destination of the data including the virtual object c as the wireless communication device 100B and the wireless terminal 200P2. Since the communication range and the display range of the virtual object c do not overlap with each other, the wireless communication device 100A is not the transmission destination.

The processing unit 102C instructs the transmission unit 104C to transmit the data including the virtual object c to the determined transmission destination, and the transmission unit 104C transmits the data including the virtual object c to the wireless communication device 100B and the wireless communication device 100B. It is transmitted to the terminal 200P2.

Upon receiving the data including the virtual object c, the wireless communication device 100B and the wireless terminal 200P2 replace the data including the virtual object C with the data including the virtual object c. The wireless terminal 200P2 comes to display the virtual object c.

As described above, even when the moved wireless terminal transmits a command to change the appearance of the virtual object, the data after changing the appearance can be shared between the wireless communication device and the wireless terminal.

The shared data may have its position, display range, posture, etc. changed in addition to the appearance of the virtual image. As an example, FIG. 13 illustrates a wireless communication system when the appearance and display range of the virtual object B in the data including the virtual object B is changed by the wireless communication device 100A. Here, it is assumed that the wireless communication device 100A receives the user's input and changes the virtual object B to b. The wireless communication device 100A may receive this command from a wireless communication device or a wireless terminal other than the wireless communication device 100A to make this change.

The operation of the wireless communication system when the wireless communication device 100A changes the data including the virtual object B will be described with reference to FIGS. 13 and 14. FIG. 14 is a sequence diagram of the wireless communication system when the data including the virtual object B is changed by the wireless communication device 100A. The position of the wireless terminal 200 shown in FIG. 13 is assumed to be the same as the position described in FIGS. 6, 7, and 8. Therefore, the wireless terminal 200 will be referred to as a wireless terminal 200P1. As described with reference to FIGS. 11 and 12, the wireless terminal 200 may be moved.

First, the wireless communication device 100A changes data including the virtual object B into data including the virtual object b. In the present embodiment, the display range of the object b is assumed to be larger than the display range of the object B and overlap the communication range of the wireless communication device 100B. Since the wireless communication device 100A changes this data, it has information on the display range of the virtual object b. The wireless communication device 100A also has information about the communication range of the wireless communication devices 100B and 100C and information about the position of the wireless terminal 200P1. From these pieces of information, the wireless communication device 100A selects a wireless communication device and a wireless terminal that transmit and share data including the virtual object b.

Specifically, the wireless communication device 100A transmits a wireless communication device in which at least a part of the communication range of each of the wireless communication devices 100B and 100C overlaps with at least a part of the display range of the virtual object b. Select as destination. In FIG. 13, since the wireless communication device that satisfies this condition is the wireless communication device 100B, the wireless communication device A selects the wireless communication device 100B as the transmission destination.

In addition, the wireless communication device 100A selects a wireless terminal located within the display range of the virtual object b as the transmission destination. In FIG. 13, since the wireless terminal that satisfies this condition is the wireless terminal 200P1, the wireless communication device 100A selects the wireless terminal 200P1 as the transmission destination.

The wireless communication device 100A transmits and shares data including the virtual object b to the wireless communication device 100B and the wireless terminal 200P1 selected as the transmission destinations. The wireless communication device 100B and the wireless terminal 200P1 hold data including this virtual object b. The wireless terminal 200 may replace the data including the virtual object B before the change with the data including the virtual object b.

Further, since the wireless terminal 200P1 holds data including the virtual object B before the change, the wireless communication device 100A may transmit a command to change to the virtual object b to the wireless terminal 200P1. .. The wireless terminal 200P1 may change the data including the virtual object B into the virtual object b based on this command. After that, the wireless terminal 200P1 comes to superimpose and display the virtual image b.

Further, in the present embodiment, the appearance and the display range of the virtual image in the shared data are both changed, but only the display range may be changed, and the position and orientation of the virtual image may be changed. It may be changed. The wireless communication system performs the same operation even when the position or orientation of the virtual image is changed.

As described above, even when the display range of the virtual image included in the shared data is changed, the changed shared data can be shared between the wireless communication device and the wireless terminal.

Although the present embodiment has been described above, various modifications can be implemented and executed. For example, in the present embodiment, one room in the factory is set as the area 10, but it is not limited to the indoor area. If the plurality of wireless communication devices 100 is a space that constitutes a mesh network, the wireless communication devices 100 can be operated similarly even outdoors.

Further, in the present embodiment, examples of the virtual object are the finished product of the virtual fan, the virtual motor, the virtual board, and the virtual bulletin board, but the invention is not limited to these. Since the virtual object is data, the surface of an object existing in an object, a person, a landscape, or an image may be decorated.

Further, in the present embodiment, the wireless communication device 100A estimates the communication range of the wireless communication devices 100A, 100B, and 100C, but each wireless communication device may estimate and share its own communication range. Good. Further, when estimating the communication range of the user, information on the strength of the communication signal with respect to the communication distance may be acquired from the wireless communication device and the wireless terminal connected to the user to estimate the communication range of the user. Further, each wireless communication device may store the communication range in each storage unit in advance according to the standard for communication, and read out and set the communication range according to the standard used in the constructed mesh network. ..

Further, although the case where three wireless communication devices 100A, 100B and 100C are used in the present embodiment has been described, the number of wireless communication devices may be two or four or more. Further, in the present embodiment, the case where the number of the wireless terminals 200 and 300 is one each has been described, but the number may be two or more, or any one.

Further, in the present embodiment, the wireless terminal 200 is illustrated as a goggle type wireless terminal, but wearable terminals other than the goggle type imitate the shape of something worn on the user's body, such as a wristwatch type or a belt type. The wireless terminal may be embedded in the human body of the user.

Further, in the present embodiment, the wireless communication device 100A performs the process of changing the shared data based on the command from the wireless terminal 300, but the wireless communication device 100A changes the shared data without the command. May be performed. For example, the wireless communication device 100A may change the appearance of a virtual image included in shared data at regular intervals. Alternatively, the wireless communication device 100A may change the shared data by inputting a user to the wireless communication device 100A.

Further, in the present embodiment, sharing of data between the wireless communication devices 100A, 100B and 100C and the wireless terminals 200 and 300 has been described. In addition to this, it may be shared with the wireless communication device 1. The frequency of sharing with the wireless communication device 1 is also arbitrary. Each time the shared data including the virtual object is changed, it may be transmitted to the wireless communication device 1, or may be transmitted at a fixed time. Further, instead of the changed shared data, a command for changing the shared data may be shared. Similar to the wireless communication device 100A described in the present embodiment, the wireless communication device 1 may change the appearance of a virtual object based on a command to change the shared data, or change the shared data. The shared data may be replaced later.

Further, in the present embodiment, the wireless communication device 100A determines the transmission destination for the shared data from the wireless communication device and the wireless terminal. However, after determining the transmission destination, the wireless communication device 100A determines whether to transmit the shared data to be transmitted. You may In this case, it is premised that the wireless communication device 100A holds a plurality of shared data. For example, the wireless communication device 100A according to the present embodiment receives from the wireless communication device 1 the data including the virtual object A and the data including the virtual object B as described in FIG. The wireless communication device 100A determines the wireless communication device 100C as the transmission destination. From the display range of the virtual object A, the display range of the virtual object B, and the communication range of the wireless communication device 100C, the wireless communication device 100A determines to transmit the data including the virtual object A, and transmits the data. May be.

The functions of the wireless communication device 100A in this embodiment can also be realized by a program. This program is provided as an installable or executable file stored in a computer-readable storage medium such as a CD-ROM, a memory card, a CD-R and a DVD (Digital Versatile Disk). Good. In addition, this program may be stored on a computer connected to a network such as the Internet and provided via the network, or may be provided by being incorporated in a storage medium such as a ROM, HDD, or SSD. May be.

As described above, the wireless communication device 100A described in the present embodiment receives, from a wireless communication device such as a server, shared data including a virtual image to be displayed so as to be superimposed on a video image. Further, the wireless communication device 100A estimates the communication range of the wireless communication devices forming the wireless mesh network.

The wireless communication device 100A determines and transmits the wireless communication device to which the shared data is transmitted, based on the display range of the image included in the shared data and the communication range of the wireless communication device. The wireless communication device 100A also receives the information indicating the position of the wireless terminal, determines the wireless terminal to which the shared data is transmitted from the information indicating the display range of the image and the position of the wireless terminal, and transmits the shared data. Even when the shared data is changed, the wireless communication device 100A similarly transmits the changed shared data to the wireless communication device that configures the wireless terminal and the wireless mesh network.

By doing so, the processing load on the wireless communication device such as a server can be reduced, and the data can be shared more quickly between the wireless terminal and the wireless communication device configuring the wireless mesh network. In addition, the amount of data held by each wireless communication device and wireless terminal can be reduced, and the load can be reduced.

Further, the wireless communication device 100A may determine the transmission destination from the wireless communication device and the wireless terminal and select the data to be transmitted from the plurality of shared data. The wireless communication device 100 compares the communication range or position of the transmission destination and the display range of the virtual image included in each shared data, and selects the shared data to be transmitted. Also by doing so, it is possible to share data more quickly between the wireless terminal and the wireless communication device forming the wireless mesh network. In addition, the amount of data held by each wireless communication device and wireless terminal can be reduced, and the load can be reduced.

While some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and the gist of the invention, and are also included in the invention described in the claims and the scope equivalent thereto.

1... Wireless communication device 10... Area 100A... Wireless communication device 100B... Wireless communication device 100C... Wireless communication device 101A... Receiving part 102A... Processing part 103A... Storage part 104A... Transmitting part 200... Wireless terminal 200P1... Wireless terminal 200P2... Wireless Terminal 300... Wireless terminal 300P1... Wireless terminal

Claims (19)

A wireless communication device,
A receiving unit for receiving first data including first information indicating a virtual image displayed in an overlapping manner and its display range;
Based on the first information and second information indicating a communicable range of at least one first wireless communication device different from the wireless communication device, the first data of the first data among the first wireless communication devices is determined. 1 a processing unit that determines a destination,
A transmitter for transmitting the first data to the first destination,
Equipped with
In the first wireless communication device, the processing unit determines, as the first destination, a wireless communication device in which at least a part of a communication range overlaps with at least a part of the display range.
Wireless communication device. The receiving unit receives third information indicating a position of at least one first wireless terminal that displays the virtual images in an overlapping manner,
The processing unit determines, based on the first information and the third information, a wireless terminal, of the first wireless terminals, whose position is included in the display range, as a second destination of the first data. ,
The transmitter transmits the first data to the second destination,
The wireless communication device according to claim 1. The processing unit performs a changing process of changing the first data into second data,
At least a part of the communication range of the first wireless communication device overlaps with at least a part of the display range of the second data based on the second information and the fourth information indicating the display range of the second data. The wireless communication device is determined as the third destination,
The transmission unit transmits at least one of the second data and information related to the change processing to the third transmission destination,
The wireless communication device according to claim 1. The processing unit performs a process of changing the first data into second data,
The fourth information indicating the display range of the second data is acquired, and based on the third information and the fourth information, among the first wireless terminals, a wireless terminal whose position is included in the display range is 4 Determined as the destination,
The transmission unit transmits at least one of the second data and information related to the processing to the fourth destination,
The wireless communication device according to claim 2. A wireless communication device,
A receiving unit that receives at least one first data including first information indicating a virtual image displayed in an overlapping manner and its display range, and
A first transmission of the first data to be transmitted to the first wireless communication device based on the first information and second information indicating a communicable range of the first wireless communication device different from the wireless communication device. A processing unit that determines data,
A transmitter that transmits the first transmission data to the first wireless communication device;
Equipped with
In the first data, the processing unit determines, as the first transmission data, data in which at least a part of the display range overlaps with at least a part of a communication range of the first wireless communication device.
Wireless communication device. The receiving unit receives third information indicating a position of the first wireless terminal that displays the virtual images in an overlapping manner,
The processing unit transmits, to the first wireless terminal, data in which the position of the first wireless terminal is included in the display range in the first data, based on the first information and the third information. Decide as the second transmission data to
The transmission unit transmits the second transmission data to the first wireless terminal,
The wireless communication device according to claim 5. The processing unit performs a process of changing at least a part of the first data into second data,
Based on the second information and the fourth information indicating the display range of the second data, at least part of the display range of the second data overlaps with at least part of the communication range of the first wireless communication device. The data is determined as the third transmission data,
The transmitting unit transmits at least one of the third transmission data and information related to the processing to the first wireless communication device,
The wireless communication device according to claim 5. The processing unit performs a process of changing at least a part of the first data into second data,
Data in which the fourth information indicating the display range of the second data is acquired, and the first wireless terminal position is included in the display range of the second data based on the third information and the fourth information. As the fourth transmission data,
The transmission unit transmits at least one of the fourth transmission data and information related to the processing to the first wireless terminal,
The wireless communication device according to claim 6. The receiving unit receives the first data from a second wireless communication device,
The transmitting unit transmits at least one of the second data and information related to the processing to the second wireless communication device,
The wireless communication device according to any one of claims 3 to 4 and 7 to 8. The processing unit estimates the communication range based on at least a standard used for communication with the first wireless communication device,
The wireless communication device according to claim 1. The first data is data regarding XR (X-Reality), and includes information indicating a position of the image and information indicating an appearance of the image,
The wireless communication device according to claim 1. The appearance of the image is at least one of information indicating the shape of the image, information indicating the color of the image, and information indicating the texture of the image,
The wireless communication device according to claim 11. The first data further includes at least one of information indicating a posture of the image and information indicating a motion of the image,
The wireless communication device according to claim 11. The first wireless communication device is an access point,
The wireless communication device according to any one of claims 1 to 13. The first wireless terminal is at least one of a wearable terminal, a tablet, a smartphone, a laptop, and a monitor,
9. The wireless communication device according to claim 2, 4, 6, or 8. Receiving first data including first information indicating a virtual image displayed in an overlapping manner and its display range,
Determining a first destination of the first data among the first wireless communication devices based on the first information and second information indicating a communicable range of at least one first wireless communication device;
Transmitting the first data to the first destination,
Among the first wireless communication devices, a wireless communication device in which at least a part of the communication range overlaps with at least a part of the display range is determined as the first destination.
Method. Receiving at least one first data each including first information indicating a virtual image displayed in an overlapping manner and its display range,
Of the first data, the first transmission data to be transmitted to the first wireless communication device is determined based on the first information and the second information indicating the communicable range of the first wireless communication device,
Transmitting the first transmission data to the first wireless communication device,
Of the first data, data in which at least a part of the display range overlaps with at least a part of the communication range of the first wireless communication device is determined as the first transmission data.
Method. Receiving first data including first information indicating a virtual image displayed in an overlapping manner and its display range,
Based on the first information and second information indicating a communicable range of at least one first wireless communication device, a first destination of the first data is determined among the first wireless communication devices,
Causing the first destination to transmit the first data,
Among the first wireless communication devices, a wireless communication device in which at least a part of the communication range overlaps with at least a part of the display range is determined as the first destination.
program. At least one first data including first information indicating a virtual image displayed in an overlapping manner and a display range thereof is received,
Based on the first information and the second information indicating the communicable range of the first wireless communication device, the first transmission data to be transmitted to the first wireless communication device among the first data is determined,
Causing the first wireless communication device to transmit the first transmission data,
In the first data, the processing unit determines, as the first transmission data, data in which at least a part of the display range overlaps with at least a part of a communication range of the first wireless communication device.
program.

Images