JP5529927B2 - Wireless communication system, transmission output control method, information processing apparatus, and control method thereof - Google Patents

Description

The present invention relates to wireless data communication technology, based on the distance information between the transmitting and receiving obtained from particular three-dimensional position information, to wireless communications systems and transmission output control method, an information processing apparatus and its control method for controlling a radio transmission output It is.

  In recent years, in the field of wireless communication systems, there is a concern about an increase in power consumption accompanying the enhancement of functions of wireless terminals, and power saving technology is regarded as important. Conventionally, as a method for realizing power saving of a wireless terminal, a method of measuring a reception state (quality) at a receiving wireless terminal and performing transmission control according to the change has been proposed.

  FIG. 16 is a block diagram illustrating a schematic functional configuration of a wireless terminal that measures radio wave intensity and controls transmission output in accordance with the radio wave intensity in a radio communication system (see Patent Documents 1 and 2). .

  When the radio terminal receives radio waves with the receiver 1601, the radio field intensity measurement unit 1602 measures the received radio wave intensity. The transmission control unit 1603 determines the size of its own wireless transmission output based on the magnitude of the radio field intensity measured by the radio field intensity measurement unit 1602, and transmits data with the output determined by the transmitter 1604. . In the transmission output control in the transmission control unit 1603, for example, when the received radio field intensity measured by the radio field intensity measurement unit 1602 is small, it is determined that the propagation loss of the space between transmission and reception is large, and the transmission output is increased. Be controlled. On the contrary, when the received radio field intensity measured by the radio field intensity measuring unit 1602 is large, it is determined that the propagation loss is small, and control is performed such that the own transmission output is decreased. Thereby, even when the propagation loss is small, it is possible to suppress wasteful power consumption such as transmission with a large output.

  Alternatively, there is also a technique for controlling transmission power by calculating a BER (Bit Error Rate) representing a ratio of the number of error bits in the total number of bits of data received by the wireless terminal, instead of measuring the radio field intensity. Proposed. In this case, control is performed such that when the BER is high, the transmission output is increased, and when the BER is lower than a certain reference value, the transmission output is decreased (Patent Document 3).

  Both methods are the same in that the communication quality is monitored and transmission control is performed by the receiving wireless terminal.

  FIG. 17 is a simple functional block diagram of a wireless terminal that performs power control of the wireless I / F unit using position information acquired by GPS (see Patent Document 4).

  The control unit 1701 measures the intensity of the received radio wave, associates it with the position coordinate information acquired by the GPS receiver 1702, and then stores the information of the position coordinate and the received radio wave intensity in the memory 1703. By repeatedly performing this operation while moving, the received radio wave intensity information on the locus of movement of the wireless terminal is stored in the memory 1703 together with the position coordinate information. After data storage, the radio wave of the position coordinates where the radio terminal exists is referred to the database in the memory 1703 based on the location information of the radio terminal acquired by the GPS receiver 1702 without measuring the received radio wave intensity again. The strength can be grasped. For example, from the position information acquired by the GPS receiver 1702 and the database in the memory 1703, the control unit 1701 indicates that the wireless terminal is located at position coordinates where the radio wave intensity is very small and stable communication cannot be performed. judge. In this case, the control unit 1701 supplies power to the wireless circuit block of the wireless I / F unit 1705 supplied from the first power supply unit 1704 and to the baseband codec unit 1707 supplied from the second power supply unit 1706. Control such as shutting off the power supply becomes possible. In addition, when it is determined that a wireless terminal exists at a position coordinate having a radio wave intensity that allows stable communication, the control unit 1701 resumes power supply to each unit. In restarting power supply, power supply from the first power supply unit 1704 to the wireless circuit block of the wireless I / F unit 1705 and power supply from the second power supply unit 1706 to the baseband codec unit 1707 are started. According to such a configuration, wasteful power consumption when outside the communication range can be suppressed.

JP 2004-193745 A JP 7-212303 A Japanese Patent Laid-Open No. 5-22211 Japanese Patent Application Laid-Open No. 2002-246977

  However, the conventional techniques described above have the following problems.

  FIG. 2 is a diagram showing the relationship between the radio field intensity and distance, and the radio field intensity and time in an ideal environment and a fading environment.

  In FIGS. 2A and 2B, the broken lines indicate the relationship between the radio wave intensity and distance and the radio wave intensity and time in an ideal environment. However, in real space, radio waves transmitted from a transmitter are repeatedly reflected and diffracted by surrounding structures, topography, moving objects, etc., and are distributed and propagated to a plurality of paths. As a result, the receiver receives a composite wave in which a plurality of radio waves whose phases are shifted due to the distance difference between the paths are superimposed. This is called fading, and as shown by a solid line in FIGS. 2A and 2B, a very complicated change in radio field intensity occurs both in terms of distance and time.

  Considering wireless communication under the fading environment described above, a case is considered in which a communication state (quality) such as received radio wave intensity and BER is measured on the reception-side wireless terminal side, and transmission control is performed according to such changes. . In this method, since the communication quality that is constantly fluctuating on the wireless terminal side is continuously measured and reflected in the control, the processing load of the wireless terminal increases and the power saving effect decreases. In addition, in a method in which position coordinates and radio field strength are associated and stored in a memory and transmission control is performed using information in the memory of the wireless terminal, transmission output is controlled based on the radio field strength acquired at the time of measurement. End up. For this reason, it is difficult to perform stable communication in a fading environment where the intensity varies greatly even at the same position. In addition, the power saving effect is low as in the above method in that GPS information is continuously acquired on the wireless terminal side. Further, position measurement by GPS can be used only outdoors, and a position measurement error is as large as several tens of meters. For this reason, it cannot be used for transmission control of a wireless terminal used indoors or for transmission control of short-range wireless communication having a maximum transmission distance of about 10 meters, such as UWB included in the WPAN wireless standard. Note that WPAN is a wireless personal area network, and UWB is an ultra wide band.

  The present invention has been made in view of such a problem, and an object of the present invention is to provide transmission output control that enables stable wireless communication without constantly monitoring communication quality at a receiving wireless terminal.

In order to achieve the above object, a wireless communication system according to an aspect of the present invention has the following arrangement. That is,
A wireless communication system in which a first device and a second device are connected by wireless communication,
In any one of the first and second devices, an index whose relative positional relationship with the second device is included in an image photographed by an imaging device included in the first device and the first device is known. Position detecting means for detecting a three-dimensional position of the first device based on a relative positional relationship with an imaging device included in the device;
Distance calculation for calculating an inter-device distance between the first device and the second device based on the three-dimensional position detected by the position detection unit in any of the first and second devices. Means,
Wherein the other device from a device having the distance calculating unit of the first and second devices, the calculated inter-device distance by the distance calculation means, a distance transmitting means for transmitting via the wireless communication,
Each of the first and second devices includes output control means for controlling a transmission output for the wireless communication based on the distance between the devices.

  According to the present invention, it is possible to realize stable wireless communication without constantly monitoring communication quality at a receiving wireless terminal.

It is a functional block diagram showing a system configuration example in the first embodiment. (A) is the figure which showed the relationship between radio wave intensity and distance, (b) is the figure which showed the relationship between radio wave intensity and time. It is the figure which showed the structural example of MR system in 1st Embodiment. It is the flowchart which showed the flow of the process in 1st Embodiment. (A) is the figure which showed the relationship between the electromagnetic wave intensity and distance in 1st Embodiment, (b) is the figure which showed the relationship between the electromagnetic wave intensity and time in 1st Embodiment. It is a figure explaining the production | generation of the three-dimensional position information using the image information in 1st Embodiment. It is the figure which showed the concept of the transmission level control in 2nd Embodiment. It is the functional block diagram which showed the system configuration | structure which performs transmission level control by BER measurement in 2nd Embodiment. It is the flowchart which showed the flow of the process in the system which performs transmission level control by BER measurement in 2nd Embodiment. It is the functional block diagram which showed the system configuration | structure which performs transmission level control by the radio field intensity measurement in 3rd Embodiment. It is the flowchart which showed the flow of the process of the system which performs transmission level control by the field intensity measurement in 3rd Embodiment. It is a functional block diagram of a system configuration in a 4th embodiment. It is the flowchart which showed the flow of the process of the system in 4th Embodiment. It is a functional block diagram of the system configuration in a 5th embodiment. It is the flowchart which showed the flow of the process of the system in 5th Embodiment. It is the functional block diagram which showed the example of the system configuration which performs the transmission control by the general radio field intensity measurement. It is the functional block diagram which showed the example of the system configuration which performs transmission control by the general position measurement using GPS.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[First Embodiment]
1st Embodiment which implement | achieves this invention is described according to figures. In the following description, a case where the radio communication system according to the embodiment of the present invention is applied to an MR (Mixed Reality) system will be described.

  MR is a video technology that presents an image by fusing real space (real image) and virtual space (virtual image) seamlessly in real time. The MR system provides an MR space through an HMD (Head Mounted Display) having an imaging unit and a display unit. Here, the imaging unit of the HMD acquires images of the left and right eyes from the viewpoint of the wearer, and the display unit displays an image of the eyes of the wearer. More specifically, an image of the real space that the wearer of the HMD is observing is acquired by the imaging unit of the HMD, a CG image of the virtual space is superimposed on the captured real space image, and the generated composite image is displayed. By displaying on the display unit of the HMD, the MR space is provided to the wearer of the HMD.

  FIG. 3 is a diagram illustrating a system configuration example according to the first embodiment.

  In FIG. 3, an HMD 301 is an image for obtaining images of the left eye and right eye that the wearer is observing, and an image for providing the wearer with stereo images for the left eye and right eye that constitute the MR space. It has a display part. The HMD 301 wirelessly transmits the captured image to the controller 303 via a wiredly connected repeater 302. Similar to the HMD 301, the repeater 302 is used by being attached to a part of the user's body. The HMD 301 and the repeater 302 are driven by a battery. The PC 304 wired to the controller 303 has an image processing unit that superimposes CG on an image in the real space captured by the HMD 301. The PC 304 wirelessly transmits the composite image on which the CG is superimposed to the repeater 302 via the controller 303. The composite image received by the repeater 302 is displayed on the image display unit of the HMD 301 and provided to the wearer. In the present embodiment, the HMD 301 and the repeater 302 are individual hardware, but all the functions of the repeater 302 can be mounted in the HMD 301 to form an integrated apparatus. Similarly, with respect to the PC 304 and the controller 303, all the functions of the controller 303 are mounted and integrated in the PC 304, or the functions possessed by the PC 304 and the controller 303 are collected to constitute a dedicated processing device. Is possible.

  In the following description, from a functional viewpoint, a combination of functions of the HMD 301 and the repeater 302 is classified as a client, and a combination of functions of the PC 304 and the controller 303 is classified as a server.

  FIG. 1 is a functional block diagram in the first embodiment for explaining the features of the present invention. The client and the server are communicably connected to each other by a transmission unit and a reception unit.

  The client as the first device acquires the real space image captured by the image input unit 101, and transmits it from the transmission unit 102 to the server as the second device with the transmission output given by the initial setting. In the server, using the image information of the real space image received by the reception unit 103, the position information generation unit 104 generates relative three-dimensional position information of the server and the client. The position information generation unit 104 functions as a position / orientation detection unit that generates a three-dimensional position / orientation of a client (imaging device) for performing MR processing. Position. The generated three-dimensional position information is used by the image processing unit 105 to determine the position, size, and orientation for drawing a CG (virtual image) on the real space image (real image). The three-dimensional position information is used in the distance calculation unit 106 to calculate the distance between the server and the client (inter-device distance). The composite image generated by the image processing unit 105 and the distance information between the server and the client generated by the distance calculation unit 106 are sent to the transmission control unit 107. The transmission control unit 107 controls the transmission output of the transmission unit 108 based on the distance information, and transmits the data including the composite image and the distance information via the transmission unit 108. In this respect, the transmission unit 108 functions as a distance transmission unit that transmits the inter-device distance between the client and the server.

  The reception unit 109 of the client transmits the composite image data to the image output unit 110 and the distance information to the transmission control unit 111 from the reception data received from the server (transmission unit 108). The image output unit 110 displays the composite image sent from the receiving unit 109 so as to provide it to the HMD wearer. The transmission control unit 111 performs transmission control when the transmission unit 102 transmits the captured image acquired by the image input unit 101 based on the transmitted distance information. Note that, for example, a wireless communication method included in the WPAN standard can be used for communication in the transmission units 102 and 108 and the reception units 103 and 109, that is, wireless communication between the server and the client.

  FIG. 4 is a flowchart for explaining the flow of processing of the MR system in the first embodiment.

  When communication is started, first, in step S401, the image input unit 101 on the client side acquires a physical space image captured from the viewpoint of the HMD wearer. In subsequent step S402, the transmission unit 102 on the client side transmits the real space image acquired in step S401 to the server with the transmission output given by the initial setting. Note that the default value is arbitrary. In step S403, the server-side receiving unit 103 receives the real space image. In step S404, the position information generation unit 104 generates the three-dimensional position information of the client from the received image information of the real space image. In the present embodiment, the position information generation unit 104 can calculate the relative positional relationship between the server and the client by being given the position information of the server in the system usage space at the initial setting stage before communication. In addition to the relative positional relationship, each piece of positional information can be matched to absolute coordinates.

  In step S405, the image processing unit 105 refers to the position information generated in step S404, superimposes the CG image on the real space image in step S406, and generates a composite image. In step S407, the distance calculation unit 106 calculates the distance between the server and the client based on the referenced position information. The transmission controller 107 refers to the distance information calculated by the distance calculator 106 in step S408. In step S409, the transmission control unit 107 controls the transmission output of the transmission unit 108 when transmitting the composite image and distance information data from the server based on the referenced distance information, and transmits the data in step S410. To do. On the client side, the reception unit 109 receives the composite image and the distance information in step S411. In step S412, the client-side transmission control unit 111 refers to the distance information received by the reception unit 109 together with the composite image. In step S413, the transmission control unit 111 controls transmission output in the transmission unit 102 when transmitting a real space image from the client to the server based on the referenced distance information.

  In step S414, the client determines whether there is a next captured image to be transmitted. If it is determined that there is a captured image, the process returns to step S401, and the above-described process is repeated. The image acquired in step S401 is transmitted from the transmission unit 102 in step S402 based on the transmission output determined in step S413. If it is determined in step S414 that there is no next captured image to be transmitted, the communication is terminated and the process is exited.

  FIG. 5 is a diagram illustrating transmission output control of the transmission units 108 and 102 by the transmission control units 107 and 111 in the first embodiment. Hereinafter, the transmitters 102 and 108 are collectively referred to as a transmitter, and the receivers 103 and 109 are collectively referred to as a receiver.

  FIG. 5A is a graph showing the relationship between the radio wave intensity and the distance at time T. The broken line shows the relationship between the radio wave intensity and the distance when transmission is performed at the transmission output P1 necessary for maintaining a certain bit rate in the receiver whose distance from the transmitter is at the position D in the ideal environment. ing. The solid line shows the relationship between the radio wave intensity and the distance when the transmission output is P2 in a fading environment. FIG. 5B is a graph showing the time variation of the radio wave intensity at the receiver whose distance from the transmitter is at the position D. A broken line indicates a radio wave intensity necessary for maintaining a desired bit rate at the distance D, and a solid line indicates a time change of the radio wave intensity when the transmission output is P2D in a fading environment.

As shown in FIG. 5A, in an ideal environment, by setting the transmission output of the transmitter to P1, it is possible to realize the received radio wave intensity P1D that can maintain communication at the bit rate that is the position of the distance D. I understand. However, in the fading environment, the radio wave intensity fluctuates very violently, and in order to maintain a desired bit rate, the minimum value of the radio wave intensity indicated by the solid line in FIG. It is necessary to set the transmission output so as to be higher than the radio wave intensity P1D. Therefore, the transmission control in this embodiment is
1. At the point where the distance from the transmitter is D, even when the transmission output becomes the lowest radio wave intensity due to the influence of fading, the reception radio wave intensity P1D capable of maintaining a desired bit rate is realized, And,
2. The minimum value of the received radio wave intensity can have a sufficient margin with respect to P1D.
Such a transmission output P2 is selected.

  The set value of the transmission output P2 for each distance between the transmitter and the receiver is set by acquiring data in advance in an environment where the wireless communication system is actually used. In the present embodiment, the assumed maximum communication distance is about a few tens of meters, and the change in received radio wave intensity due to fading can be acquired in a very short time, so the prior setting can be easily performed. The transmission output P2 can be set for each arbitrary distance range. By setting the transmission output P2 in a fine distance range, for example, in centimeter units, it is possible to control transmission output with extremely high accuracy. Conversely, if the distance range is large, for example, the transmission output P2 is set in units of meters, the memory capacity for storing control information in the transmission control unit can be reduced. As described above, in the first embodiment, control information indicating the relationship between the transmission / reception distance and the transmission output for obtaining the required radio wave intensity according to the transmission / reception distance is held in the form of a table, for example. Then, by referring to this table, an appropriate transmission output is determined with respect to the inter-device distance calculated by the distance calculation unit 106.

  FIG. 6 is a diagram for describing position information in the first embodiment.

  It is assumed that the marker 603 is associated with a relative positional relationship with the server in advance. When the marker 603 is displayed on the real space image 601, the position information generation unit 104 detects the marker 603 from the image data. Then, the position information generation unit 104 determines the relative position relationship between the marker 603 and the HMD body and the three-dimensional position related to the direction in which the HMD wearer is observing the marker from information such as the size and shape of the marker 603 and the fill pattern. Information can be calculated. Here, since the relative positional relationship between the marker 603 and the server is already associated, the relative positional relationship between the server and the client is obtained from the positional relationship between the marker 603 and the client. Thereby, the distance between the server and the client can be calculated.

  In FIG. 6, as an example, a three-dimensional coordinate system having the origin at the center of the marker 603 is assumed. However, the origin of the coordinate system does not need to be set on the marker 603, and the origin of the coordinate system can be set to an arbitrary position by associating the relative positional relationship between the origin of the coordinate system and the marker 603.

  Moreover, the marker used for position information generation is not single, but a plurality of markers can be used simultaneously. When using a plurality of markers at the same time, it is possible to calculate the direction of the HMD (HMD wearer) observing the marker from the relative positional relationship by defining the positional relationship between the markers in advance. Become. In that case, a marker that is not identifiable to the direction by the internal filling pattern as shown in FIG. 6 is used, for example, a color marker using a specific color or a non-directional mark such as a light emitting element such as an LED. It can also be used.

  Further, instead of the prepared marker, a feature point in the real space image 601 such as the outline 604 of the table or an arbitrary color in the image can be extracted, and position information can be generated using them. . By using a plurality of the same type of markers, using several types of markers at the same time, or using a combination of marker information and feature point information in the image, it is possible to generate position information with higher accuracy. In addition, since the positional relationship between multiple markers and feature points is associated, it is possible to estimate the position of each marker or feature point even if not all markers or feature points are displayed in the image. It is.

  In this embodiment, transmission control is performed based on the distance between the server and the client calculated using the position information. When the client side is composed of separate devices of the HMD 301 and the repeater 302, the image pickup unit in the HMD that picks up the real space image used for position information generation and the transmission / reception antenna of the repeater that performs wireless transmission are spatially separated. It exists in a distant position. Therefore, a slight error occurs in the distance calculated using the position information. In that case, by correcting the relative positional relationship between the imaging unit in the HMD 301 and the transmission / reception antenna of the repeater 302, the relative positional relationship between the server and the transmission / reception antenna can be grasped, and an error in distance accuracy can be reduced. Is possible. However, in order to perform control with higher accuracy, the client-side HMD 301 and the repeater 302 are integrated so that the relative positional relationship between the imaging unit in the HMD 301 and the transmission / reception antenna is always constant. preferable.

  As described above, by using the system configuration described above, it becomes possible to accurately grasp the distance between transmission and reception from the three-dimensional position information of the server and the client, and highly accurate transmission output control based on the distance information. Can be realized. Further, since the communication quality is not monitored on the client side, the power consumption is reduced and the battery can be driven for a long time. Further, by measuring before the system is used, a transmission output capable of maintaining a desired bit rate even under the fading influence is grasped, and stable communication can be realized by giving this as an initial setting.

[Second Embodiment]
In the second embodiment, in addition to the information on the distance between the server and the client described in the first embodiment, transmission level control using the measurement result of the communication quality on the client side is implemented in an auxiliary manner. As a result, the radio wave environment deteriorates due to the influence of obstacles and moving objects in use of the system, interference by other wireless devices, etc., and the desired bit rate cannot be maintained with a preset transmission output. Even when it falls, stable communication can be performed. Hereinafter, a second embodiment using BER as a measurement of communication quality will be described with reference to the drawings.

  FIG. 7 is a diagram illustrating transmission level control according to the second embodiment.

  In FIG. 7, a broken line represents a transmission output P1 that can obtain a radio wave intensity P1D necessary for maintaining a desired bit rate in a receiver having a distance D from the transmitter in an ideal environment. The relationship between the radio wave intensity and the distance when transmitting with. The dashed curve shows the relationship between the radio wave intensity and distance when the transmission output is P2 in a fading environment, and the solid curve shows the relationship between the radio wave intensity and distance when the transmission output is P3 in a fading environment. Show. P1D, P2D, and P3D indicate the received radio wave intensities of the three types of transmission outputs at the position where the distance from the transmitter is D.

  Normally, P2 has a sufficient margin for the radio field intensity P1D necessary to maintain a desired bit rate in a receiver installed at a distance D from the transmitter by an initial setting before using the system. It is set to achieve the desired radio field strength. However, the radio wave environment deteriorates due to an increase in the number of obstacles and moving objects in the surrounding environment during use of the system, and the use of other wireless devices. May decrease. In the present embodiment, such a decrease in radio wave intensity is detected by measuring the BER and radio wave intensity on the client side (transmission control unit 111). Then, control is performed to raise the transmission level to the transmission output P3 that realizes the received radio wave intensity P3D having a sufficient margin with respect to P1D at the position of the distance D. On the contrary, when the radio wave environment becomes better during use of the system than at the initial setting, an excessive transmission output is detected by measuring the BER and the radio wave intensity, and control is performed to lower the transmission level.

  The transmission level control using BER measurement will be described below.

  FIG. 8 is a functional block diagram illustrating transmission level control using BER measurement in the second embodiment.

  The client acquires a real space image captured by the image input unit 801 and transmits it to the server via the transmission unit 802. The transmission unit 802 also has a function as a control information transmission unit that transmits transmission level control information described later to the server. Since there is no distance information and transmission level control information between the server and the client in the initial state, transmission is performed with the transmission output given by the initial setting.

  In the server, using the image information received by the reception unit 803, the position information generation unit 804 generates relative three-dimensional position information of the server and the client. The generated three-dimensional position information is used by the image processing unit 805 to determine the position, size, and orientation for drawing the CG on the real space image. The three-dimensional position information is used in the distance calculation unit 806 to calculate the distance between the server and the client. The composite image generated by the image processing unit 805, the distance information between the server and the client generated by the distance calculation unit 806, and the transmission level control information transmitted from the client are sent to the transmission control unit 807. Based on the distance information and the transmission level control information, the transmission control unit 807 controls the transmission output when the transmission unit 808 performs data transmission. The error control unit 812 performs error control on transmission data including the composite image and distance information. Transmission data (composite image and distance information) subjected to error control is transmitted from the transmission unit 808 to the client with the controlled transmission output.

  In the client, the reception unit 809 receives data transmitted from the transmission unit 808. The BER measurement unit 813 performs BER measurement on the data received by the reception unit 809, generates transmission level control information according to the measured BER, and sends the transmission level control information to the transmission control unit 811. Further, the BER measurement unit 813 sends the composite image data to the image output unit 810 and the distance information from the received data to the transmission control unit 811. The image output unit 810 displays the sent composite image so as to provide it to the HMD wearer. The transmission control unit 811 performs transmission control when transmitting the captured image acquired by the image input unit 801 based on the distance information that is transmitted from the BER measurement unit 813 and the transmission level control information.

  FIG. 9 is a flowchart illustrating a process flow in transmission level control using BER measurement in the second embodiment.

  When communication is started, first, on the client side, in step S901, the image input unit 801 acquires a real space image from the viewpoint of the HMD wearer. In subsequent step S902, the transmission unit 802 transmits the real space image acquired in step S901 and the transmission level control information given by the initial setting to the server with the transmission output given by the initial setting. Note that the default value is arbitrary.

  On the server side, when the receiving unit 803 receives data in step S903, in step S904, the position information generating unit 804 generates the three-dimensional position information of the client from the image information. In this embodiment, the relative positional relationship between the server and the client can be calculated by providing the server position information in the system usage space at the initial setting stage before communication. In addition to the relative positional relationship, each piece of positional information can be matched to absolute coordinates. In step S905, the image processing unit 805 refers to the position information, and in step S906, superimposes the CG image on the real space image based on the position information to generate a composite image. In step S907, the distance calculation unit 806 calculates the distance between the server and the client based on the position information referenced in step S904. The transmission control unit 807 refers to the distance information calculated in step S908, and refers to the transmission level control information sent from the client in step S909. In step S910, the transmission control unit 807 controls the transmission output when transmitting the composite image and the distance information from the transmission unit 808 of the server based on the referenced distance information and transmission level control information. In step S911, the error control unit 812 performs error control for adding a general error detection code and error correction code to the data including the image information, the distance information, and the transmission level control information generated in step S910. Do. In step S912, the transmission unit 808 transmits the data to which the error correction code is added.

  On the client side, the receiving unit 809 receives data in step S913. In step S914, the BER measuring unit 813 measures the BER. In step S915, the BER measurement unit 813 determines whether or not the BER measured in step S914 is equal to or greater than the BER range determined by the current transmission level. If the measured BER is greater than or equal to the predetermined range, an instruction to increase the transmission level is sent in step S916. If it is determined in step S915 that the BER is not greater than or equal to the predetermined range, it is determined in step 917 whether or not the BER is less than or equal to the predetermined range. If the measured BER is below the predetermined range, an instruction to decrease the transmission level is sent in step S918. If it is determined in step S917 that the BER is not less than or equal to the predetermined range, the process proceeds to step S919. In step S919, the BER measurement unit 813 generates transmission level control information based on the transmission level instruction, and sends the transmission level control information to the transmission control unit 811. In step S919, the transmission output is increased or decreased by a predetermined amount in response to an instruction to increase or decrease the transmission level. As a result, for example, when the transmission output is instructed to increase the transmission level in the state of P2 in FIG. 7, the transmission output of P3 in FIG. 7 is selected. The transmission control unit 811 refers to the distance information in step S920 and the transmission level control information in step 921. In step 922, the transmission control unit 811 controls the transmission output of the transmission unit 802 when transmitting the next captured image and transmission level control information from the client based on the referenced information.

  In step S923, it is determined whether there is a next image to be transmitted. If it is determined that there is an image, the process returns to step S901 to repeat the above processing. The image acquired in step S901 is transmitted from the transmission unit 802 in step S902 based on the transmission output determined in step S922. That is, in step S902, the transmission unit 802 transmits the real space image acquired in step S901 and the transmission level control information set in step S921 to the server with the transmission output controlled in step S922. If it is determined in step S923 that there is no next image to be transmitted, the communication is terminated and the process is terminated.

[Third Embodiment]
In the third embodiment, a configuration in which radio wave intensity measurement is performed instead of BER measurement as communication quality measurement, and a transmission output (transmission level) is controlled based on the measurement result will be described. The transmission level control using the received radio field intensity measurement will be described below.

  FIG. 10 is a functional block diagram showing the configuration of a system that realizes transmission level control using radio wave intensity measurement in the third embodiment.

  The client acquires a real space image captured by the image input unit 1001 and transmits the image via the transmission unit 1002. Since there is no distance information and transmission level control information between the server and the client in the initial state, the transmission unit 1002 performs transmission with the transmission output given by the initial setting.

  In the server, using the image information received by the reception unit 1003, the position information generation unit 1004 generates relative three-dimensional position information of the server and the client. The generated three-dimensional position information is used for determining the position, size, and orientation when the CG is drawn on the real space image in the image processing unit 1005. In the distance calculation unit 1006, the three-dimensional position information is used to calculate the distance between the server and the client. The composite image processed by the image processing unit 1005, the distance information between the server and the client generated by the distance calculation unit 1006, and the transmission level control information transmitted from the client are sent to the transmission control unit 1007. The transmission control unit 1007 controls transmission output when performing data transmission including the composite image and the distance information based on the distance information and the transmission level control information, and transmits data via the transmission unit 1008. Data transmitted from the transmission unit 1008 is received by the reception unit 1009 of the client. The radio wave intensity measuring unit 1012 measures the radio wave intensity at the time of reception of the received data, and generates transmission level control information according to the measured radio wave intensity. Also, the radio wave intensity measuring unit 1012 sends the composite image data from the received data to the image output unit 1010 and the distance information and the generated transmission level control information to the transmission control unit 1011. The image output unit 1010 displays the sent composite image so as to provide it to the HMD wearer. The transmission control unit 1011 controls the transmission output of the transmission unit 1002 when transmitting the captured image acquired by the image input unit 1001 based on the distance information and the transmission level control information transmitted from the radio wave intensity measurement unit 1012. .

  FIG. 11 is a flowchart for explaining the processing flow of transmission level control using radio field intensity measurement according to the third embodiment.

  When communication is started, first, in step S1101, the image input unit 1001 on the client side acquires a real space image from the viewpoint of the HMD wearer. In subsequent step S1102, the transmission unit 1002 transmits the real space image acquired in step S1101 and the transmission level control information given by the initial setting to the server with the transmission output given by the initial setting.

  On the server side, when the receiving unit 1003 receives data in step S1103, in step 1104, the three-dimensional position information of the client is generated from the real space image information received by the position information generating unit 1004. In this embodiment, the relative positional relationship between the server and the client can be calculated by providing the server position information in the system usage space at the initial setting stage before communication. In addition to the relative positional relationship, each piece of positional information can be matched to absolute coordinates. The image processing unit 1005 refers to the position information in step S1105, superimposes the CG image based on the position information referred to the real space image in step S1106, and generates a composite image. In step 1107, the distance calculation unit 1006 calculates the distance between the server and the client based on the referenced position information. The transmission control unit 1007 refers to the distance information calculated by the distance calculation unit 1006 in step 1108 and the transmission level control information sent from the client in step 1109. In step 1110, the transmission control unit 1007 controls the transmission output of the transmission unit 1008 when transmitting the composite image and the distance information from the server based on the referenced information. In step 1111, the transmission unit 1008 transmits data to the client.

  On the client side, the receiving unit 1009 receives data in step 1112. In step 1113, the radio wave intensity measuring unit 1012 measures the received radio wave intensity. In step 1114, the radio wave intensity measurement unit 1012 determines whether or not the radio wave intensity measured in step 1113 is equal to or greater than the range determined by the current transmission level. If the measured radio field intensity is greater than or equal to the predetermined range, an instruction to reduce the transmission level is sent in step S1115. If it is determined in step S1114 that the radio field intensity is not greater than or equal to the predetermined range, it is determined in step S1116 whether the radio field intensity is less than or equal to the predetermined range. If the measured radio field intensity is below a predetermined range, an instruction to increase the transmission level is sent in step S1117. If it is determined in step 1116 that the radio wave intensity is not below the predetermined range, the process proceeds to step S1118.

  In step 1118, the radio wave intensity measurement unit 1012 generates transmission level control information based on the transmission level instruction and sends the transmission level control information to the transmission control unit 1011. In step S1118, the transmission output is increased or decreased by a predetermined amount in response to an instruction to increase or decrease the transmission level. As a result, for example, when an instruction to increase the transmission level is received in the state of P2 in FIG. 7, the transmission output of P3 is selected. The transmission control unit 1011 refers to the distance information in step S1119 and the transmission level control information in step S1120. In step 1121, the transmission control unit 1011 controls the transmission output in the transmission unit 1002 when transmitting the next captured image and transmission level control information from the client based on the referenced distance information and transmission level control information.

  In step S1122, the client determines whether there is a next image to be transmitted. If it is determined that there is a next image, the process returns to step S1101 to acquire the image. The acquired image is transmitted in step 1102 based on the transmission output determined in step 1121. If it is determined in step 1122 that there is no next image to be transmitted, the communication is terminated and the process is terminated.

  In the second and third embodiments, as shown in the flowcharts of FIGS. 9 and 11, communication quality (BER or radio wave intensity) is measured for each transmission / reception of one frame image, and transmission level control is performed. . However, in reality, it is considered that the radio wave environment does not change greatly every time one frame image is transmitted / received during use of the system. Therefore, in the second and third embodiments, it is realistic to configure the BER or the radio wave intensity measurement frequency to be executed every arbitrary time or every arbitrary transmission / reception frequency. In addition, when the user feels that the image quality has deteriorated, it is possible to provide an external input that can execute transmission level control at an arbitrary timing, and a user interface for the user to issue a transmission level control execution instruction. is there.

  In the system configurations and flowcharts shown in FIGS. 8 to 11, BER or radio wave intensity is measured on the client side and transmission level control is performed. However, these measurement functions and transmission level control functions can also be implemented on the server side. When these functions are implemented on the server side, the processing load on the client side can be reduced and the battery consumption can be reduced, so that the wireless terminal on the client side can be driven for a long time.

  As described above, according to the second and third embodiments, in addition to the configuration of the first embodiment, transmission level control is carried out supplementarily using the measurement result of BER or radio wave intensity. As a result, the radio wave environment deteriorates due to the influence of obstacles, moving objects, interference from other wireless devices, etc. during use of the system, and the desired bit rate cannot be maintained with the preset transmission output. Even when it falls, stable communication can be performed.

  In the second and third embodiments, the transmission control information (transmission level control information) derived from the communication quality obtained by the BER measurement unit 813 or the radio wave intensity measurement unit 1012 as the communication quality detection unit is used for the other. Sending to the device. However, the present invention is not limited to this, and the communication quality obtained by the communication quality detection unit (measurement results of the BER measurement unit 813 and the radio wave intensity measurement unit 1012) is transmitted to the other device, and each device separately transmits the communication quality. The transmission level control information may be generated based on the above.

[Fourth Embodiment]
Next, a fourth embodiment will be described with reference to the drawings.

  In the first to third embodiments described above, the three-dimensional position information of the server and the client is generated from the image information captured on the client side. In contrast, in the fourth embodiment, the server and the client 3 are detected from sensing information acquired by a three-dimensional position or a three-dimensional position and orientation sensor that can detect a three-dimensional position or a three-dimensional position and orientation installed on the client side or outside. Generate dimension position information. Hereinafter, the fourth embodiment will be described focusing on this point.

  The generation of the three-dimensional position information of the MR system includes a method of using sensing information from various sensing devices in addition to a method of using image information captured by a subjective camera (internal image sensor) built in the HMD. As an example of a sensing device as a three-dimensional position and orientation sensor, a device of a type that is attached to the HMD itself such as a magnetic sensor, a gyro sensor, or an HMD such as an objective camera (external image sensor) is used. Type of device. These sensing devices can be used alone, or a plurality of types of devices can be used in combination. Further, by generating three-dimensional position information by combining image information captured by a subjective camera built in the HMD used in the first embodiment and sensing information acquired by a sensing device, three-dimensional position information with higher accuracy can be obtained. Position information can be obtained. Below, the case where 3D position information is produced | generated using only the sensing information acquired with the sensing device is demonstrated.

  FIG. 12 is a block diagram showing a functional configuration of the MR system in the fourth embodiment.

  In the client, the transmission unit 1202 transmits the real space image acquired by the image input unit 1201 and the sensing information acquired by the sensing unit 1212 in synchronization with the imaging timing to the server with the transmission output given by the initial setting. . Note that the type of sensing device in the sensing unit 1212 is not limited to one type, and a plurality of types of sensing devices can be used simultaneously.

  In the server, the reception unit 1203 receives the data transmitted from the transmission unit 1202. The position information generation unit 1204 uses the various sensing information acquired by the sensing unit 1212 to generate relative three-dimensional position information of the server and the client. The generated position information is used for determining the position, size, and orientation when the CG is drawn on the real space image in the image processing unit 1205. Further, the three-dimensional position information generated by the position information generation unit 1204 is used by the distance calculation unit 1206 to calculate the distance between the server and the client.

  The composite image generated by the image processing unit 1205 and the distance information between the server and the client generated by the distance calculation unit 1206 are sent to the transmission control unit 1207. The transmission control unit 1207 controls the transmission output of the transmission unit 1208 when performing data transmission including the composite image and the distance information based on the distance information. The transmission unit 1208 transmits data with the transmission output controlled by the transmission control unit 1207.

  The reception unit 1209 of the client transmits the composite image data to the image output unit 1210 and the distance information to the transmission control unit 1211 from the reception data transmitted from the transmission unit 1208. The image output unit 1210 displays the sent composite image to be provided to the HMD wearer. The transmission control unit 1211 controls the transmission output in the transmission unit 1202 when transmitting the captured image acquired by the image input unit 1201 based on the transmitted distance information.

  FIG. 13 is a flowchart for explaining the flow of processing in the fourth embodiment.

  When communication is started, first, in step S1301, on the client side, the sensing unit 1212 acquires sensing information from various sensing devices, and the image input unit 1201 acquires real space image information from the viewpoint of the HMD wearer. In step S1302, the transmission unit 1202 transmits the sensing information and image information acquired in step S1301 to the server with the transmission output given by the initial setting.

  On the server side, in step 1303, the receiving unit 1203 receives data. In step S1304, the position information generation unit 1204 refers to the various sensing information received in step S1303. In step S1305, the position information generation unit 1204 generates three-dimensional position information of the client from the sensing information. In this embodiment, the relative positional relationship between the server and the client can be calculated by providing the server position information in the system usage space at the initial setting stage before communication. In addition to the relative positional relationship, each piece of positional information can be matched to absolute coordinates. The image processing unit 1205 refers to the position information generated in step S1306, and in step 1307, superimposes the CG image on the real space image using the position information to generate a composite image.

  In step 1308, the distance calculation unit 1206 calculates the distance between the server and the client based on the position information generated by the position information generation unit 1204. The transmission control unit 1207 refers to the calculated distance information in step S1309, and controls the transmission output of the transmission unit 1208 when transmitting the composite image and the distance information from the server based on the distance information in step S1310. . In step 1311, the transmission unit 1208 transmits data with the transmission output controlled by the transmission control unit 1207.

  On the client side, in step S1312, the receiving unit 1209 receives data, and the image output unit 1210 displays the received image data. In step S1313, the transmission control unit 1211 refers to the distance information received together with the composite image. In step S1314, the transmission control unit 1211 controls the transmission output of the transmission unit 1202 when transmitting the captured image from the client to the server based on the referenced distance information.

  In step S1315, it is determined whether or not there is a next captured image to be transmitted. If it is determined that there is a captured image, the process returns to step S1301 to acquire the next captured image. Then, the above process is repeated. The acquired image is transmitted from the transmission unit 1202 in step 1302 with the transmission output determined in step 1314. On the other hand, if it is determined in step S1315 that there is no next image to be transmitted, the communication is terminated and the process is exited.

  In the configuration and flowchart illustrated in FIGS. 12 and 13, the system includes the sensing unit 1212 on the client side, but may be configured on the server side. For example, when sensing such as an objective camera is used, the amount of data transmitted from the client to the server can be reduced by directly inputting the sensing information to the server side, and further power saving can be realized.

  Furthermore, as in the second and third embodiments, in the fourth embodiment, transmission level control is performed using BER and radio wave intensity measurement results on the server side or client side in addition to the distance information between the server and client. You may make it do. According to this configuration, the radio wave environment is deteriorated due to the influence of obstacles and moving objects in use of the system, interference by other wireless devices, and the desired bit rate can be maintained at a preset transmission output. Stable communication can be performed even in a situation where it is impossible. The system that implements transmission level control using BER and radio field intensity measurement results is different from the second and third embodiments except that sensing information is used to generate three-dimensional position information. The explanation is omitted here.

  As described above, even when using the described system configuration that generates the three-dimensional position information of the server and the client using the sensing information, as in the first to third embodiments, it is possible to maintain stable communication quality. Power saving can be realized. It is also possible to perform transmission level control using measurement results of BER and radio wave intensity. Furthermore, it is possible to generate three-dimensional position information in combination with the captured image information in the HMD used in the first embodiment. According to such a configuration, distance information with higher accuracy can be obtained, so that the accuracy of transmission control can also be improved.

[Fifth Embodiment]
Next, a fifth embodiment will be described.

  In the first to fourth embodiments, the configuration for generating three-dimensional position information on the server side has been described. In the fifth embodiment, a configuration in which a configuration for generating three-dimensional position information is provided on the client side will be described.

  FIG. 14 is a diagram showing a system configuration in the third embodiment for explaining the features of the present invention.

  The client acquires a physical space image captured by the image input unit 1401 and stores the image data in the frame memory 1421. The position information generation unit 1404 generates the relative three-dimensional position information of the server and the client by using either the image information in the frame memory 1421 and the various sensing information acquired by the sensing unit 1412 or the information. To do. The distance calculation unit 1406 calculates the distance between the server and the client from the position information generated by the position information generation unit 1404. The transmission control unit 1411 controls the transmission output of the transmission unit 1402 when transmitting data including the three-dimensional position information and the distance information from the client to the server based on the calculated distance information. The transmission unit 1402 transmits the data including the three-dimensional position information and the distance information to the server with the transmission output controlled by the transmission control unit 1411. Therefore, in the fifth embodiment, the transmission unit 1402 functions as a distance transmission unit that transmits the inter-device distance between the client and the server.

  The server receives data transmitted from the client by the receiving unit 1403. The position information included in the received data is used to determine the position, size, and orientation when drawing a CG image in the CG drawing unit 1422. The transmission control unit 1407 controls the transmission output of the transmission unit 1408 when the CG image is transmitted from the server to the client with reference to the distance information included in the received data. The transmission unit 1408 transmits the CG image with the transmission output controlled by the transmission control unit 1407.

  The CG image received by the reception unit 1409 of the client is sent to the image composition unit 1423. The image synthesis unit 1423 synthesizes the CG image with the real space image stored in the frame memory 1421. The image output unit 1410 displays the composite image generated by the image composition unit 1423 so as to provide it to the HMD wearer.

  FIG. 15 is a flowchart for explaining the flow of processing according to the fifth embodiment.

  When communication is started, first, in step S1501, the image input unit 1401 on the client side acquires a real space image captured from the viewpoint of the HMD wearer. In step 1502, the client stores the image data acquired by the image input unit 1401 in the frame memory 1421. The position information generation unit 1404 refers to the image information in step S1503, and acquires sensing information from the sensing unit 1412 in step 1504. In step 1505, the position information generation unit 1404 generates the three-dimensional position information of the client based on the image information and the sensing information. In this embodiment, the relative positional relationship between the server and the client can be calculated by providing the server position information in the system usage space at the initial setting stage before communication. In addition to the relative positional relationship, each piece of positional information can be matched to absolute coordinates.

  In step 1506, the distance calculation unit 1406 calculates the distance between the server and the client based on the position information generated by the position information generation unit 1404. In step 1507, the transmission control unit 1411 refers to the distance information calculated by the distance calculation unit 1406. In step 1508, the transmission control unit 1411 outputs a transmission output when transmitting the three-dimensional position information and the distance information from the client based on the distance information. Control. In step S1509, the transmission unit 1402 transmits data including the three-dimensional position information and the distance information with the transmission output controlled by the transmission control unit 1411 in step S1508.

  In step S1510, the server-side receiving unit 1403 receives the data transmitted by the transmitting unit 1402 in step S1509. The CG rendering unit 1422 refers to the three-dimensional position information received in step S1510 in step 1511, and renders a CG image based on the three-dimensional position information in step S1512. The transmission control unit 1407 refers to the distance information received by the reception unit 1403 in step S1513, and in step 1514, based on the distance information, the transmission output of the transmission unit 1408 when transmitting a CG image from the server to the client. To control. In step S1515, the transmission unit 1408 transmits the CG image generated by the CG drawing unit 1422 with the transmission output controlled by the transmission control unit 1407.

  In step 1516, the client-side receiving unit 1409 receives the CG image transmitted by the server-side transmitting unit 1408. In step S1517, the image composition unit 1423 reads a real space image corresponding to the CG image included in the received data from the frame memory 1421, synthesizes the real space image and the CG image, and generates an MR image. Then, the image output unit 1410 displays this MR image.

  In step S1519, the client determines whether there is a next captured image. If it is determined that there is a next image, the client returns the process to step S1501 and repeats the above processing. On the other hand, if it is determined in step S1519 that there is no next image, the communication is terminated and the process is exited.

  As described above, according to the fifth embodiment, data transmitted from the client is position information and distance information, and does not include image data. Therefore, the amount of information transmitted from the client to the server becomes very small. Therefore, power consumption required for transmission can be greatly reduced, and long-term driving of the client-side wireless terminal by the battery can be realized.

  Further, similarly to the second to fourth embodiments, in the fifth embodiment, in addition to the distance information between the server and the client, the transmission level control using the BER and the radio wave intensity measurement result on the server side or the client side is performed. can do. With this configuration, the radio wave environment deteriorates due to the influence of obstacles, moving objects, interference from other wireless devices, etc. during use of the system, and the desired bit rate is maintained at the preset transmission output. Stable communication can be performed even in a situation where it cannot be performed. Note that a system that implements transmission level control using BER and radio field intensity measurement results has the above-described configuration according to the second and third embodiments, in addition to having a three-dimensional position information generation function on the client side. Since there is no big difference, explanation is omitted here.

  As described above, according to the fifth embodiment, even when a system configuration having a three-dimensional position information generation function on the client side is used, as in the first to fourth embodiments, stable communication quality is maintained. Power saving can be realized. It is also possible to perform transmission level control using measurement results of BER and radio wave intensity. Further, similarly to the fourth embodiment, it is possible to generate three-dimensional position information by combining captured image information in the HMD and sensing information in the sensing device, and more accurate distance information can be obtained. Therefore, the accuracy of transmission control can be improved. Furthermore, since the amount of data transmitted from the client to the server is greatly reduced, the battery consumption required for transmission can be suppressed and long-time driving can be achieved.

  As described above, according to the first to fifth embodiments, the distance between transmission and reception can be grasped with high accuracy using the three-dimensional position information, so that power saving by transmission control and stable communication quality can be maintained. A wireless communication system can be realized. In addition, since transmission control can be performed without constantly monitoring the communication quality at the receiving wireless terminal, it is possible to reduce the processing load and power consumption of the wireless terminal. Even in a fading environment, stable communication can be performed while maintaining a constant bit rate. Further, it is possible to provide a wireless communication system that realizes power saving and data communication with a stable bit rate even when the short-range wireless communication system is used indoors.

  As described above, in the first to fifth embodiments, in the system for presenting MR images, the result of the three-dimensional position / orientation detection of the observer necessary for generating the MR images is used to control the wireless transmission output. We are using. That is, the three-dimensional position detection result can be used effectively.

  Although the embodiment has been described in detail above, the present invention can take an embodiment as a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

  In the present invention, the functions of the above-described embodiments are achieved by supplying a software program directly or remotely to a system or apparatus, and the computer of the system or apparatus reads and executes the supplied program code. Including the case. In this case, the supplied program is a computer program corresponding to the flowchart shown in the drawings in the embodiment.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, or the like.

  Examples of the computer-readable storage medium for supplying the computer program include the following. For example, floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD- R).

  As another program supply method, a client computer browser is used to connect to a homepage on the Internet, and the computer program of the present invention is downloaded from the homepage to a recording medium such as a hard disk. In this case, the downloaded program may be a compressed file including an automatic installation function. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  Further, the program of the present invention may be encrypted, stored in a storage medium such as a CD-ROM, and distributed to users. In this case, a user who has cleared a predetermined condition is allowed to download key information for decryption from a homepage via the Internet, execute an encrypted program using the key information, and install the program on the computer. You can also.

  In addition to the functions of the above-described embodiment being realized by the computer executing the read program, the embodiment of the embodiment is implemented in cooperation with an OS or the like running on the computer based on an instruction of the program. A function may be realized. In this case, the OS or the like performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

  Furthermore, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, so that part or all of the functions of the above-described embodiments are realized. May be. In this case, after a program is written in the function expansion board or function expansion unit, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program.

Claims (13)

A wireless communication system in which a first device and a second device are connected by wireless communication,
In any one of the first and second devices, an index whose relative positional relationship with the second device is included in an image photographed by an imaging device included in the first device and the first device is known. Position detecting means for detecting a three-dimensional position of the first device based on a relative positional relationship with an imaging device included in the device;
Distance calculation for calculating an inter-device distance between the first device and the second device based on the three-dimensional position detected by the position detection unit in any of the first and second devices. Means,
Wherein the other device from a device having the distance calculating unit of the first and second devices, the calculated inter-device distance by the distance calculation means, a distance transmitting means for transmitting via the wireless communication,
Each of said 1st and 2nd apparatus is provided with the output control means which controls the transmission output for the said radio | wireless communication based on the said distance between apparatuses, The radio | wireless communications system characterized by the above-mentioned. The index is a marker or feature point included in the image,
The position detecting means extracts a marker or a feature point from the image, and detects a three-dimensional position of the first device based on its size, shape, pattern, and positional relationship. Item 2. The wireless communication system according to Item 1.   In any one of the first and second apparatuses, the apparatus further includes a generating unit that generates a CG image to be displayed on the first apparatus based on the three-dimensional position detected by the position detecting unit. The wireless communication system according to claim 1, wherein the wireless communication system is characterized. A wireless communication system in which a first device and a second device are connected by wireless communication,
In any one of the first and second devices, position detection means for detecting a three-dimensional position of the first device based on an output from a three-dimensional position and orientation sensor provided in the first device;
Distance calculation for calculating an inter-device distance between the first device and the second device based on the three-dimensional position detected by the position detection unit in any of the first and second devices. Means,
Generating means for generating a CG image to be displayed on the first apparatus based on the three-dimensional position detected by the position detecting means in any of the first and second apparatuses;
Distance transmitting means for transmitting the distance between the devices from the device having the distance calculating means of the first and second devices to the other device via the wireless communication;
Each of said 1st and 2nd apparatus is provided with the output control means which controls the transmission output for the said radio | wireless communication based on the said distance between apparatuses, The radio | wireless communications system characterized by the above-mentioned.   In any one of the first and second devices, further comprising communication quality detection means for detecting communication quality of the wireless communication,
  The wireless communication system according to claim 1, wherein the output control unit controls the transmission output based on the detected communication quality.   6. The wireless communication system according to claim 5, wherein the communication quality detection means detects a ratio of the number of error bits in wireless communication or a radio wave intensity.   The output control means controls the transmission output based on the communication quality when the communication quality detected by the communication quality detection means satisfies a predetermined condition. A wireless communication system according to claim 1.   Further, the communication quality detected by the communication quality detection means or the transmission control information derived from the communication quality is transmitted from the apparatus having the communication quality detection means of the first and second apparatuses to the other apparatus. , Comprising control information transmitting means for transmitting via the wireless communication,
  The output control unit further controls the transmission output based on the communication quality received via the control information transmission unit or the transmission control information. The wireless communication system according to 1. A transmission output control method in a wireless communication system in which a first device and a second device are connected by wireless communication,
Any of the first device and the second device is included in an image photographed by an imaging device included in the first device, and an index having a known relative positional relationship with the second device and the first device A position detection step of detecting a three-dimensional position of the first device based on a relative positional relationship with an imaging device included in the device;
Distance calculation in which either the first device or the second device calculates an inter-device distance between the first device and the second device based on the three-dimensional position detected in the position detection step. Process,
From an apparatus for performing the distance calculation process of the first and second device to the other, the distance transmission step of transmitting an inter-device distance calculated by said distance calculation step via the wireless communication,
Each of said 1st and 2nd apparatus is provided with the output control process which controls the transmission output for the said radio | wireless communication based on the said distance between apparatuses, The transmission output control method characterized by the above-mentioned. A transmission output control method in a wireless communication system in which a first device and a second device are connected by wireless communication,
A position detection step in which one of the first device and the second device detects a three-dimensional position of the first device based on an output from a three-dimensional position and orientation sensor included in the first device;
Distance calculation in which either the first device or the second device calculates an inter-device distance between the first device and the second device based on the three-dimensional position detected in the position detection step. Process,
A generation step in which one of the first and second devices generates a CG image to be displayed on the first device based on the three-dimensional position detected in the position detection step;
A distance transmission step of transmitting the inter-device distance via the wireless communication from a device that executes the distance calculation step of the first and second devices to the other device;
Each of said 1st and 2nd apparatus is provided with the output control process which controls the transmission output for the said radio | wireless communication based on the said distance between apparatuses, The transmission output control method characterized by the above-mentioned.   An information processing apparatus that performs wireless communication with a display device including an imaging unit,
  Receiving means for receiving an image captured by the imaging means included in the display device via the wireless communication;
  Detection means for detecting a three-dimensional position of the imaging means based on a relative positional relation between an index included in the received image and a known relative positional relationship with the information processing apparatus and an imaging means included in the display device When,
  Distance calculating means for calculating a distance between the display device and the information processing device based on the three-dimensional position detected by the detecting means;
  Distance transmitting means for transmitting the distance calculated by the distance calculating means to the display device via the wireless communication;
  An information processing apparatus comprising: output control means for controlling transmission output for the wireless communication based on the distance calculated by the distance calculation means.   The information processing apparatus according to claim 11, further comprising a generation unit that generates a CG image to be displayed on the display device based on the three-dimensional position detected by the detection unit.   A method of controlling an information processing apparatus that performs wireless communication with a display device including an imaging unit,
  A receiving step in which a receiving unit receives an image captured by the imaging unit included in the display device via the wireless communication;
  A detection unit determines a three-dimensional position of the imaging unit based on a relative positional relationship between an index included in the received image and a known relative positional relationship with the information processing device and an imaging unit included in the display device. A detection process to detect;
  A distance calculating unit that calculates a distance between the display device and the information processing device based on the three-dimensional position detected in the detecting step;
  A distance transmitting step, wherein the distance transmitting means transmits the distance calculated in the distance calculating step to the display device via the wireless communication;
  An output control means comprising: an output control step of controlling a transmission output for the wireless communication based on the distance calculated in the distance calculation step.

Images