US20230035304A1 - Frequency band determination based on image of communication environment for head-mounted display - Google Patents
Frequency band determination based on image of communication environment for head-mounted display Download PDFInfo
- Publication number
- US20230035304A1 US20230035304A1 US17/965,097 US202217965097A US2023035304A1 US 20230035304 A1 US20230035304 A1 US 20230035304A1 US 202217965097 A US202217965097 A US 202217965097A US 2023035304 A1 US2023035304 A1 US 2023035304A1
- Authority
- US
- United States
- Prior art keywords
- communication
- frequency band
- communication device
- camera
- section
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004891 communication Methods 0.000 title claims abstract description 327
- 238000000034 method Methods 0.000 claims abstract description 19
- 230000005236 sound signal Effects 0.000 claims abstract description 8
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 6
- 238000005401 electroluminescence Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/005—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission adapting radio receivers, transmitters andtransceivers for operation on two or more bands, i.e. frequency ranges
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
- H04B1/385—Transceivers carried on the body, e.g. in helmets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W72/00—Local resource management
- H04W72/02—Selection of wireless resources by user or terminal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W72/00—Local resource management
- H04W72/04—Wireless resource allocation
- H04W72/044—Wireless resource allocation based on the type of the allocated resource
- H04W72/0453—Resources in frequency domain, e.g. a carrier in FDMA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
- H04B1/385—Transceivers carried on the body, e.g. in helmets
- H04B2001/3866—Transceivers carried on the body, e.g. in helmets carried on the head
Definitions
- the present invention relates to a frequency band determination device, a head-mounted display, a frequency band determination method, and a program.
- Millimeter waves for example, in a 60 GHz band are highly linear.
- the communication quality of such millimeter waves significantly varies depending on an environment in which a communication device and a communication partner are placed, namely, for example, depending on whether an obstacle exists in a communication path or the communication device and the communication partner are in the same room. It is therefore preferable that the frequency band used for communication be changed as soon as possible in accordance with a change in the environment in which the communication device and the communication partner are placed.
- the radio waves used for communication by the communication device are changed to 5 GHz band or other microwaves in a situation where the communication quality degrades while the communication device uses millimeter waves for communication, the communication quality may improve because the microwaves are more diffractive than the millimeter waves. Therefore, if the communication quality is lowered while millimeter waves are used for communication, it is preferable that the radio waves used for communication by the communication device be changed to microwaves as soon as possible.
- An object of the present invention is to provide a frequency band determination device, a head-mounted display, a frequency band determination method, and a program that are capable of unprecedentedly quickly changing the frequency band used for communication in accordance with a change in the environment in which the communication device and the communication partner are placed.
- a frequency band determination device includes an image acquisition section and a frequency band determination section.
- the image acquisition section acquires an image of an environment in which at least either a communication device or a communication partner for the communication device is placed.
- the frequency band determination section determines, based on the acquired image, the frequency band of radio waves used for communication between the communication device and the communication partner.
- the frequency band determination section determines the frequency band depending on whether or not the communication device and the communication partner are in the same room.
- the frequency band determination section may determine the frequency band depending on whether the acquired image includes an image of the communication device or an image of the communication partner.
- the frequency band determination section determines the frequency band in accordance with the distance between the communication device and the communication partner, which is identifiable from the acquired image.
- the frequency band determination section may change the frequency band from a first frequency band to a second frequency band; if the distance is smaller than a second threshold value, the frequency band determination section may change the frequency band from the second frequency band to the first frequency band; the first threshold value may be greater than the second threshold value; the first frequency band may be higher than the second frequency band; and the difference between the second threshold value and the first threshold value may be based on the distance.
- a head-mounted display includes an image acquisition section and a frequency band determination section.
- the image acquisition section acquires an image of an environment in which at least either the head-mounted display or a communication partner for the head-mounted display is placed.
- the frequency band determination section determines, based on the acquired image, the frequency band of radio waves used for communication between the head-mounted display and the communication partner.
- a frequency band determination method includes the steps of: acquiring an image of an environment in which at least either a communication device or a communication partner for the communication device is placed; and determining, based on the acquired image, the frequency band of radio waves used for communication between the communication device and the communication partner.
- a program according to the present invention causes a computer to execute procedures for: acquiring an image of an environment in which at least either a communication device or a communication partner for the communication device is placed; and determining, based on the acquired image, the frequency band of radio waves used for communication between the communication device and the communication partner.
- FIG. 1 is a diagram illustrating an exemplary overall configuration of a video display system according to an embodiment of the present invention.
- FIG. 2 A is a diagram illustrating an exemplary configuration of a head-mounted display according to an embodiment of the present invention.
- FIG. 2 B is a diagram illustrating an exemplary configuration of a relay device according to an embodiment of the present invention.
- FIG. 3 A is a schematic diagram illustrating an example in which the video display system according to the present embodiment is disposed in a room.
- FIG. 3 B is a schematic diagram illustrating an example in which the video display system according to the present embodiment is disposed in a room.
- FIG. 4 is a functional block diagram illustrating examples of functions implemented in the head-mounted display according to an embodiment of the present invention.
- FIG. 5 is a flowchart illustrating exemplary processing steps performed by the head-mounted display according to an embodiment of the present invention.
- FIG. 6 is a flowchart illustrating exemplary processing steps performed by the head-mounted display according to an embodiment of the present invention.
- FIG. 1 is a diagram illustrating an exemplary overall configuration of a video display system 10 according to an embodiment of the present invention.
- FIG. 2 A is a diagram illustrating an exemplary configuration of a head-mounted display (HMD) 12 according to the present embodiment.
- FIG. 2 B is a diagram illustrating an exemplary configuration of a relay device 16 according to the present embodiment.
- HMD head-mounted display
- the video display system 10 includes the HMD 12 , an entertainment device 14 , the relay device 16 , a display 18 , a camera/microphone unit 20 , and a controller 22 .
- the HMD 12 includes a control section 30 , a storage section 32 , two communication sections 34 (first communication section 34 a and second communication section 34 b ), an input/output section 36 , a display section 38 , a sensor section 40 , an audio output section 42 , and a camera section 44 .
- the control section 30 is formed of a microprocessor or other program control device that operates in accordance, for example, with a program installed on the HMD 12 .
- the storage section 32 is formed of a storage element such as a read-only memory (ROM) or a random access memory (RAM).
- the storage section 32 stores, for example, a program that is to be executed by the control section 30 .
- the first communication section 34 a and the second communication section 34 b are each formed of a wireless local area network (LAN) module or other communication interface having a built-in array antenna. As illustrated in FIG. 1 , the present embodiment is configured so that the first communication section 34 a and the second communication section 34 b are disposed on the upper front of the HMD 12 .
- LAN wireless local area network
- the communication standard for communication established by the first communication section 34 a is different from the communication standard for communication established by the second communication section 34 b .
- the first communication section 34 a establishes 60 GHz band communication
- the second communication section 34 b establishes 5 GHz band communication.
- the 60 GHz band communication provides communication at a higher maximum rate than the 5 GHz band communication. Further, the 60 GHz band communication provides higher linearity and a shorter communication range than the 5 GHz band communication.
- either the first communication section 34 a or the second communication section 34 b can be selectively used to communicate with the relay device 16 in accordance with radio wave conditions for wireless communication.
- a well-known adaptive modulation/coding technology can be used in the present embodiment to adaptively change the modulation method and coding method of the first and second communication sections 34 a and 34 b in accordance with the radio wave conditions for wireless communication.
- the input/output section 36 is formed of an input/output port such as an HDMI (registered trademark) (High-Definition Multimedia Interface) port, a universal serial bus (USB) port, or an auxiliary (AUX) port.
- HDMI registered trademark
- USB universal serial bus
- AUX auxiliary
- the display section 38 is formed of a liquid-crystal display, an organic electroluminescence (EL) display, or other display disposed on the front of the HMD 12 , and used to display, for example, video generated by the entertainment device 14 .
- the display section 38 is accommodated in a housing of the HMD 12 .
- the display section 38 may receive, for example, a video signal outputted from the entertainment device 14 and relayed by the relay device 16 , and output video represented by the received video signal.
- the display section 38 according to the present embodiment is capable of displaying a three-dimensional image, for example, by displaying a left-eye image and a right-eye image.
- the display section 38 may be capable of displaying only a two-dimensional image and incapable of displaying a three-dimensional image.
- the sensor section 40 is formed of a sensor such as an acceleration sensor or a motion sensor.
- the sensor section 40 outputs the results of measurements, such as a rotation amount and movement amount of the HMD 12 , to the control section 30 at a predetermined frame rate.
- the audio output section 42 is formed, for example, of a headphone or a speaker, and used to output, for example, a sound that is represented by audio data generated by the entertainment device 14 .
- the audio output section 42 receives, for example, an audio signal outputted from the entertainment device 14 and relayed by the relay device 16 , and outputs a sound represented by the received audio signal.
- the camera section 44 is formed of a digital camera or other camera and used to capture, at a predetermined frame rate, an image of surroundings of a user wearing the HMD 12 .
- the camera section according to the present embodiment includes, for example, four cameras. As depicted, for example, in FIG. 1 , the four cameras are individually disposed on the upper left of the display section 38 , the upper right of the display section 38 , the left side surface of the housing for the HMD 12 , and the right side surface of the housing for the HMD 12 .
- the cameras may incorporate, for example, a fisheye lens to capture an omnidirectional image of the surroundings of the HMD 12 or may be capable of capturing only a directional image.
- the camera section 44 may include an infrared camera that is disposed inside the housing for the HMD 12 to detect the line-of-sight direction of the user wearing the HMD 12 .
- the camera section 44 may be capable of identifying the distance between the HMD 12 and the relay device 16 .
- the cameras disposed on the upper left and upper right of the display section 38 may be configured as a stereo camera.
- the distance between the HMD 12 and the relay device 16 may be identifiable based on an image captured by the stereo camera.
- the camera section 44 may include an infrared camera or other device (distance measuring device) capable of measuring the distance between the HMD 12 and the relay device 16 , which is disposed forward of the HMD 12 .
- the entertainment device 14 is formed of a computer such as a game console, a digital versatile disc (DVD) player, or a Blu-ray (registered trademark) player.
- the entertainment device 14 according to the present embodiment generates video and audio, for example, by executing a stored game program or reproducing content recorded on an optical disk.
- the entertainment device 14 according to the present embodiment outputs a video signal representative of the generated video and an audio signal representative of the generated audio to the HMD 12 and the display 18 through the relay device 16 .
- the relay device 16 is formed of a computer that relays the video and audio signals outputted from the entertainment device 14 and outputs them to the HMD 12 and the display 18 .
- the relay device 16 includes a control section 50 , a storage section 52 , two communication sections 54 (first communication section 54 a and second communication section 54 b ), and an input/output section 56 .
- the control section 50 is formed, for example, of a control circuit or a central processing unit (CPU) or other program control device that operates in accordance with a program installed on the relay device 16 .
- CPU central processing unit
- the storage section 52 is formed, for example, a ROM, a RAM, or other storage element.
- the storage section 52 stores, for example, a program to be executed by the control section 50 .
- the first communication section 54 a and the second communication section 54 b are each formed of a wireless LAN module or other communication interface having a built-in array antenna. As illustrated in FIG. 1 , the present embodiment is configured so that the first communication section 54 a and the second communication section 54 b are included in the front of the relay device 16 .
- the communication standard for communication established by the first communication section 54 a is different from the communication standard for communication established by the second communication section 54 b .
- the first communication section 54 a establishes 60 GHz band communication
- the second communication section 54 b establishes 5 GHz band communication.
- the 60 GHz band communication provides communication at a higher maximum rate than the 5 GHz band communication. Further, the 60 GHz band communication provides higher linearity and a shorter communication range than the 5 GHz band communication.
- either the first communication section 34 a or the second communication section 34 b can be selectively used to communicate with the HMD 12 in accordance with the radio wave conditions for wireless communication.
- the input/output section 56 is formed of an input/output port such as an HDMI (registered trademark) (High-Definition Multimedia Interface) port or a USB port.
- HDMI registered trademark
- High-Definition Multimedia Interface High-Definition Multimedia Interface
- the display 18 according to the present embodiment is formed, for example, of a liquid-crystal display, and used to display, for example, video represented by a video signal outputted from the entertainment device 14 .
- the cameralmicrophone unit 20 includes a camera 20 a and a microphone 20 b .
- the camera 20 a captures an image, for example, of a subject and outputs the captured image to the entertainment device 14 .
- the microphone 20 b captures an ambient sound, converts the captured sound to audio data, and outputs the audio data to the entertainment device 14 .
- the camera 20 a according to the present embodiment is a stereo camera.
- the HMD 12 and the relay device 16 are capable of establishing, for example, wireless communication to send and receive data to and from each other.
- 60 GHz band communication is established between the first communication section 34 a and the first communication section 54 a
- 5 GHz band communication is established between the second communication section 34 b and the second communication section 54 b .
- the entertainment device 14 is connected to the relay device 16 , for example, with an HDMI cable or a USB cable.
- the relay device 16 is connected to the display 18 , for example, with an HDMI cable.
- the entertainment device 14 is connected to the cameralmicrophone unit 20 , for example, with an AUX cable.
- the controller 22 is an operation input device that is used to make an operation input to the entertainment device 14 .
- the user can use the controller 22 to perform various operation input procedures by pressing a direction key or a button on the controller 22 or tilting an operating stick on the controller 22 .
- the controller 22 outputs to the entertainment device 14 input data associated with the operation input.
- the controller 22 according to the present embodiment includes a USB port. When connected to the entertainment device 14 with a USB cable, the controller 22 is capable of outputting input data to the entertainment device 14 in a wired manner.
- the controller 22 according to the present embodiment additionally includes, for example, a wireless communication module, and is thus capable of wirelessly outputting input data to the entertainment device 14 .
- FIGS. 3 A and 3 B are schematic diagrams illustrating examples in which the video display system 10 according to the present embodiment is disposed in a room.
- the first communication section 34 a of the HMD 12 establishes 60 GHz band communication with the first communication section 54 a of the relay device 16 when the HMD 12 and the relay device 16 are in the same room as illustrated in FIG. 3 A .
- the second communication section 34 b of the HMD 12 establishes 5 GHz band communication with the second communication section 54 b of the relay device 16 .
- the present embodiment determines whether the HMD 12 and the relay device 16 are in the same room or in different rooms. If, for example, an image of the relay device 16 is included in the image captured by the camera section 44 , it is determined that the HMD 12 and the relay device 16 are in the same room. If, by contrast, the image of the relay device 16 is not included in the image captured by the camera section 44 , it is determined that the HMD 12 and the relay device 16 are in different rooms.
- the present embodiment exercises control so as to establish 60 GHz band communication between the HMD 12 and the relay device 16 . If, by contrast, it is determined that the HMD 12 and the relay device 16 are in different rooms, the present embodiment exercises control so as to establish 5 GHz band communication between the HMD 12 and the relay device 16 .
- the present embodiment determines the frequency band of radio waves used for communication.
- the present embodiment exercises control so as to establish 5 GHz or other low-frequency band communication between the HMD 12 and the relay device 16 . Let us assume, for example, that the user wearing the HMD 12 moves from a room in which the relay device 16 is disposed to another room while 60 GHz band communication is established between the HMD 12 and the relay device 16 .
- the communication between the HMD 12 and the relay device 16 switches to 5 GHz band communication.
- the present embodiment changes the frequency band of radio waves used for communication in accordance with a change in the environment in which the HMD 12 and the relay device 16 are placed, and this change occurs earlier than a frequency band change after communication quality confirmation.
- millimeter waves are advantageous in that, for example, the maximum rate available for communication is high. Therefore, if the communication quality provided by the millimeter waves is achievable during microwave communication, it is preferable that microwave communication be replaced by millimeter-wave communication.
- a user wearing the HMD 12 moves from a room to another room in which the relay device 16 is disposed.
- the communication between the HMD 12 and the relay device 16 switches to 60 GHz band communication.
- the present embodiment switches to high-frequency band communication in accordance with an environmental change that improves the quality of high-frequency band communication.
- whether an obstacle exists between the HMD 12 and the relay device 16 to block radio waves may be determined based on an image captured by the camera section 44 . If it is determined that an obstacle exists between the HMD 12 and the relay device 16 to block radio waves, control may be exercised so as to establish 5 GHz band communication between the HMD 12 and the relay device 16 . If, by contrast, it is determined that no obstacle exists between the HMD 12 and the relay device 16 to block radio waves, control may be exercised so as to establish 60 GHz band communication between the HMD 12 and the relay device 16 .
- the frequency band of radio waves used for communication may be determined depending on whether an image of the relay device 16 is included in an image captured by the camera section 44 . If, for example, the image of the relay device 16 is included in the image captured by the camera section 44 , control may be exercised so as to establish 60 GHz band communication between the HMD 12 and the relay device 16 . Meanwhile, if, for example, the image of the relay device 16 is not included in the image captured by the camera section 44 , control may be exercised so as to establish 5 GHz band communication between the HMD 12 and the relay device 16 .
- whether 5 GHz or 60 GHz band communication is to be established between the HMD 12 and the relay device 16 may be determined in accordance, for example, with the distance between the HMD 12 and the relay device 16 .
- the distance between the HMD 12 and the relay device 16 may be identified by the stereo camera included in the camera section 44 . If the HMD 12 includes a distance measuring device, the distance measuring device may identify the distance between the HMD 12 and the relay device 16 .
- the HMD 12 functions as a frequency band determination device that determines the frequency band of radio waves used for communication between the HMD 12 and the relay device 16 in accordance with an environment in which at least either the HMD 12 or the relay device 16 is placed.
- FIG. 4 is a functional block diagram illustrating examples of functions implemented in the HMD 12 according to the present embodiment.
- the HMD 12 according to the present embodiment need not incorporate all the functions illustrated in FIG. 4 , and may incorporate functions other than those illustrated in FIG. 4 .
- the HMD 12 functionally includes an image acquisition section 60 , a frequency band determination section 62 , and a communication control section 64 .
- the image acquisition section 60 is mainly implemented by the control section 30 and the camera section 44 .
- the frequency band determination section 62 is mainly implemented by the control section 30 .
- the communication control section 64 is mainly implemented by the control section 30 , the first communication section 34 a , and the second communication section 34 b .
- the above functions may be implemented by allowing the control section 30 to execute a program that is installed on the HMD 12 formed of a computer and includes commands for the above functions.
- the program is supplied to the HMD 12 , for example, through an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, a flash memory, or other computer-readable information storage medium or through the Internet or the like.
- the image acquisition section 60 acquires an image of an environment in which, for example, at least either a communication device (the HMD 12 in the current example) or a communication partner for the communication device (the relay device 16 in the current example) is placed.
- the image acquisition section 60 acquires an image captured by the camera section 44 .
- the frequency band determination section 62 determines the frequency band of radio waves used for communication between the communication device (the HMD 12 in the current example) and the communication partner (the relay device 16 in the current example).
- the frequency band determination section 62 may determine the frequency band of radio waves used for communication between the communication device the HMD 12 and the relay device 16 . Further, based on the distance between the HMD 12 and the relay device 16 , the frequency band determination section 62 may determine the frequency band of radio waves used for communication between the communication device the HMD 12 and the relay device 16 .
- the frequency band determination section 62 may determine the frequency band of radio waves used for communication between the communication device the HMD 12 and the relay device 16 .
- the frequency band determination section 62 may determine the frequency band of radio waves used for the communication depending on whether the image of the relay device 16 is included in the image captured by the image acquisition section 60 .
- the frequency band determination section 62 may determine the frequency band of radio waves used for the communication depending on whether the image of the HMD 12 is included, for example, in the image captured by the image acquisition section 60 .
- the communication control section 64 exercises control so as to establish communication by using the frequency band determined, for example, by the frequency band determination section 62 . If, for example, it is determined that 60 GHz band communication is to be established, the communication control section 64 exercises control so as to let the first communication section 34 a establish communication. If, for example, it is determined that 5 GHz band communication is to be established, the communication control section 64 exercises control so as to let the second communication section 34 b establish communication.
- the communication control section 64 retains communication section identification data.
- the communication section identification data is used to manage whether established communication is provided by the first communication section 34 a or the second communication section 34 b . If, for example, the established communication is provided by the first communication section 34 a , the value of the communication section identification data is set to "1.” If, by contrast, the established communication is provided by the second communication section 34 b , the value of the communication section identification data is set to "2.” When the value of the communication section identification data is set to "1,” the communication control section 64 may exercise control so as to stop the second communication section 34 b . Meanwhile, when the value of the communication section identification data is set to "2,” the communication control section 64 may exercise control so as to stop the first communication section 34 a .
- the image acquisition section 60 acquires an image captured by the camera section 44 (step S 101 ).
- the camera section 44 is capturing an image at a predetermined frame rate, for example, the latest image captured by the camera section 44 may be acquired in step S 101 .
- the frequency band determination section 62 determines the frequency band of radio waves used for communication (step S 102 ).
- the frequency band determination section 62 based, for example, on the image captured by the camera section 44 , the frequency band determination section 62 identifies whether the HMD 12 and the relay device 16 are in the same room. If it is identified that the HMD 12 and the relay device 16 are in the same room, the frequency band determination section 62 determines that the frequency band of radio waves used for communication is the 60 GHz band. If, by contrast, it is identified that the HMD 12 and the relay device 16 are in different rooms, the frequency band determination section 62 determines that the frequency band of radio waves used for communication is the 5 GHz band.
- the frequency band determination section 62 may determine that the HMD 12 and the relay device 16 are in the same room. Meanwhile, if an image of the relay device 16 is not included in the image captured by the camera section 44 , the frequency band determination section 62 may determine that the HMD 12 and the relay device 16 are in different rooms.
- the communication control section 64 verifies the frequency band determined in step S 102 and the value of the retained communication section identification data (step S 103 ).
- step S 102 If the frequency band determined in step S 102 is the 60 GHz band, and the value of the communication section identification data verified in step S 103 is "2," the communication control section 64 changes the value of the communication section identification data to "1" (step S 104 ). The communication control section 64 then exercises control so as to let the first communication section 34 a establish communication (step S 105 ). The process illustrated in the current example then terminates. In step S 105 , the communication control section 64 may start the first communication section 34 a and stop the second communication section 34 b .
- step S 102 If the frequency band determined in step S 102 is the 5 GHz band, and the value of the communication section identification data verified in step S 103 is "1," the communication control section 64 changes the value of the communication section identification data to "2" (step S 106 ). The communication control section 64 then exercises control so as to let the second communication section 34 b establish communication (step S 107 ). The process illustrated in the current example then terminates. In step S 107 , the communication control section 64 may start the second communication section 34 b and stop the first communication section 34 a .
- the process illustrated in the current example terminates. More specifically, if the frequency band determined in step S 102 is the 60 GHz band, and the value of the communication section identification data verified in step S 103 is "1," the process illustrated in the current example terminates. Further, if the frequency band determined in step S 102 is the 5 GHz band, and the value of the communication section identification data verified in step S 103 is "2," the process illustrated in the current example also terminates.
- Step S 101 Processing then returns to step S 101 . Subsequently, steps S 101 to S 105 are repeated. Steps S 101 to S 105 may be performed at predetermined time intervals.
- the frequency band determination section 62 may identify, based on the image captured by the camera section 44 , whether an obstacle exists between the HMD 12 and the relay device 16 to block radio waves. If it is identified that an obstacle exists to block radio waves, the frequency band determination section 62 may determine that the frequency band of radio waves used for communication is the 5 GHz band. Meanwhile, if it is identified that no obstacle exists to block radio waves, the frequency band determination section 62 may determine that the frequency band of radio waves used for communication is the 60 GHz band.
- the frequency band determination section 62 may determine the frequency band of radio waves used for communication in accordance with the distance between the HMD 12 and the relay device 16 .
- the frequency band determination section 62 based on the image acquired in step S 101 , the frequency band determination section 62 identifies the distance L between the HMD 12 and the relay device 16 (step S 201 ). Next, the frequency band determination section 62 verifies the value of the communication section identification data retained by the communication control section 64 (step S 202 ).
- the frequency band determination section 62 verifies whether the distance L identified in step S 201 is greater than a first threshold value (L1 + ⁇ ) which is obtained by adding the value ⁇ to a reference distance L1 (step S 203 ).
- the reference distance L1 is, for example, 8 m
- the value ⁇ is a value based on the distance L identified in step S 201 , for example, 0.1 x L.
- the value ⁇ may be a value according to image-based recognition accuracy at distance L.
- step S 203 If it is verified in step S 203 that the distance L identified in step S 201 is greater than the first threshold value (L1 + ⁇ ) ("Y" at step S 203 ), the frequency band determination section 62 determines that the frequency band of radio waves used for communication is the 5 GHz band (step S 204 ). Subsequently, steps S 103 and beyond are performed. Meanwhile, if it is verified that the distance L identified in step S 201 is not greater than the first threshold value (L1 + ⁇ ) ("N" at step S 203 ), the frequency band determination section 62 determines that the frequency band of radio waves used for communication is the 60 GHz band (step S 205 ). Subsequently, steps S 103 and beyond are performed.
- step S 202 If it is verified in step S 202 that the value of the communication section identification data is "2," the frequency band determination section 62 verifies whether the distance L identified in step S 201 is smaller than a second threshold value (L1 - ⁇ ) which is obtained by subtracting the value ⁇ from the reference distance L1 (step S 206 ).
- a second threshold value L1 - ⁇
- step S 206 If it is verified in step S 206 that the distance L identified in step S 201 is smaller than the second threshold value (L1 - ⁇ ), the frequency band determination section 62 determines that the frequency band of radio waves used for communication is the 60 GHz band (step S 207 ). Subsequently, steps S 103 and beyond are performed. Meanwhile, if it is verified that the distance L identified in step S 201 is not smaller than the second threshold value (L1 - ⁇ ), the frequency band determination section 62 determines that the frequency band of radio waves used for communication is the 5 GHz band (step S 208 ). Subsequently, steps S 103 and beyond are performed.
- the frequency band determination section 62 changes the frequency band of radio waves used for communication between the HMD 12 and the relay device 16 from a first frequency band (e.g., 60 GHz band) to a second frequency band (5 GHz band). Meanwhile, if the distance L is smaller than the second threshold value (L1 - ⁇ ), the frequency band determination section 62 changes the frequency band of radio waves used for communication between the HMD 12 and the relay device 16 from the second frequency band (e.g., 5 GHz band) to the first frequency band (60 GHz band).
- the second threshold value e.g., 5 GHz band
- the threshold value of the distance between the HMD 12 and the relay device 16 may vary depending on whether the frequency band of radio waves used for communication changes from the first frequency band (high-frequency band) to the second frequency band (low-frequency band) or changes from the low-frequency band to the high-frequency band. Further, the difference (2 x ⁇ ) between the first threshold value (L1 + ⁇ ) and the second threshold value (L1 - ⁇ ) may be based on the distance L identified in step S 201 .
- the present invention is not limited to the above-described embodiment.
- all or some of the functions illustrated in FIG. 4 may be implemented by the relay device 16 or the entertainment device 14 .
- control is exercised to determine whether the relay device 16 uses the first communication section 54 a or the second communication section 54 b to communicate with the HMD 12 .
- the frequency band of radio waves used for communication between the HMD 12 and the relay device 16 may be determined based on an image that is captured by the camera 20 a to depict an environment in which at least either the HMD 12 or the relay device 16 is placed.
- the frequency band of radio waves for communication between the HMD 12 and the relay device 16 may be determined depending, for example, on whether an image of the HMD 12 is included in the image captured by the camera 20 a . If, for example, the image of the HMD 12 is included in the image captured by the camera section 20 a , control may be exercised to establish 60 GHz band communication between the HMD 12 and the relay device 16 . Meanwhile, if, for example, the image of the HMD 12 is not included in the image captured by the camera section 20 a , control may be exercised to establish 5 GHz band communication between the HMD 12 and the relay device 16 .
- the present invention is not only applicable to switching between 60 GHz band communication and 5 GHz band communication, but is generally applicable to switching between high-frequency band communication and low-frequency band communication.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Optics & Photonics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Mobile Radio Communication Systems (AREA)
- Transceivers (AREA)
- Circuits Of Receivers In General (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
- This is a continuation application of U.S. Pat. Application No. 17/224,470, accorded a filing date of Apr. 7, 2021, allowed; which is a continuation application of U.S. Pat. Application No. 16/903,682, accorded a filing date of Jun. 17, 2020 (U.S. Pat. 10,999,847 issued on May 4, 2021); which is a continuation application of U.S. Pat. Application No. 15/776,242, accorded a filing date of May 15, 2018 (U.S. Pat. 10,721,735 issued on Jul. 21, 2020); which is a national stage application of International Application No. PCT/JP2016/087749, filed Dec. 19, 2016; which claims priority to JP Application No. 2015-251360, filed Dec. 24, 2015, the entire disclosures of which are hereby incorporated by reference.
- The present invention relates to a frequency band determination device, a head-mounted display, a frequency band determination method, and a program.
- There is a known technology for monitoring radio wave conditions for wireless communication and changing a frequency band used for communication in accordance with the monitored radio wave conditions.
- Millimeter waves, for example, in a 60 GHz band are highly linear. Thus, the communication quality of such millimeter waves significantly varies depending on an environment in which a communication device and a communication partner are placed, namely, for example, depending on whether an obstacle exists in a communication path or the communication device and the communication partner are in the same room. It is therefore preferable that the frequency band used for communication be changed as soon as possible in accordance with a change in the environment in which the communication device and the communication partner are placed.
- If, for example, the radio waves used for communication by the communication device are changed to 5 GHz band or other microwaves in a situation where the communication quality degrades while the communication device uses millimeter waves for communication, the communication quality may improve because the microwaves are more diffractive than the millimeter waves. Therefore, if the communication quality is lowered while millimeter waves are used for communication, it is preferable that the radio waves used for communication by the communication device be changed to microwaves as soon as possible.
- Consequently, when the communication quality of millimeter-wave communication is monitored and found to be degraded, it is conceivable that an attempt is made to change the radio waves for communication by the communication device to microwaves. However, if such an approach is used, a certain period of time elapses between the instant at which an environmental change occurs to degrade the communication quality and the instant at which the radio waves used for communication by the communication device are changed to microwaves.
- The present invention has been made in view of the above circumstances. An object of the present invention is to provide a frequency band determination device, a head-mounted display, a frequency band determination method, and a program that are capable of unprecedentedly quickly changing the frequency band used for communication in accordance with a change in the environment in which the communication device and the communication partner are placed.
- In order to solve the above problem, a frequency band determination device according to the present invention includes an image acquisition section and a frequency band determination section. The image acquisition section acquires an image of an environment in which at least either a communication device or a communication partner for the communication device is placed. The frequency band determination section determines, based on the acquired image, the frequency band of radio waves used for communication between the communication device and the communication partner.
- According to an aspect of the present invention, the frequency band determination section determines the frequency band depending on whether or not the communication device and the communication partner are in the same room.
- Alternatively, the frequency band determination section may determine the frequency band depending on whether the acquired image includes an image of the communication device or an image of the communication partner.
- Still alternatively, the frequency band determination section determines the frequency band in accordance with the distance between the communication device and the communication partner, which is identifiable from the acquired image.
- In this aspect, if the distance is greater than a first threshold value, the frequency band determination section may change the frequency band from a first frequency band to a second frequency band; if the distance is smaller than a second threshold value, the frequency band determination section may change the frequency band from the second frequency band to the first frequency band; the first threshold value may be greater than the second threshold value; the first frequency band may be higher than the second frequency band; and the difference between the second threshold value and the first threshold value may be based on the distance.
- A head-mounted display according to the present invention includes an image acquisition section and a frequency band determination section. The image acquisition section acquires an image of an environment in which at least either the head-mounted display or a communication partner for the head-mounted display is placed. The frequency band determination section determines, based on the acquired image, the frequency band of radio waves used for communication between the head-mounted display and the communication partner.
- A frequency band determination method according to the present invention includes the steps of: acquiring an image of an environment in which at least either a communication device or a communication partner for the communication device is placed; and determining, based on the acquired image, the frequency band of radio waves used for communication between the communication device and the communication partner.
- A program according to the present invention causes a computer to execute procedures for: acquiring an image of an environment in which at least either a communication device or a communication partner for the communication device is placed; and determining, based on the acquired image, the frequency band of radio waves used for communication between the communication device and the communication partner.
-
FIG. 1 is a diagram illustrating an exemplary overall configuration of a video display system according to an embodiment of the present invention. -
FIG. 2A is a diagram illustrating an exemplary configuration of a head-mounted display according to an embodiment of the present invention. -
FIG. 2B is a diagram illustrating an exemplary configuration of a relay device according to an embodiment of the present invention. -
FIG. 3A is a schematic diagram illustrating an example in which the video display system according to the present embodiment is disposed in a room. -
FIG. 3B is a schematic diagram illustrating an example in which the video display system according to the present embodiment is disposed in a room. -
FIG. 4 is a functional block diagram illustrating examples of functions implemented in the head-mounted display according to an embodiment of the present invention. -
FIG. 5 is a flowchart illustrating exemplary processing steps performed by the head-mounted display according to an embodiment of the present invention. -
FIG. 6 is a flowchart illustrating exemplary processing steps performed by the head-mounted display according to an embodiment of the present invention. - An embodiment of the present invention will now be described with reference to the accompanying drawings.
-
FIG. 1 is a diagram illustrating an exemplary overall configuration of avideo display system 10 according to an embodiment of the present invention.FIG. 2A is a diagram illustrating an exemplary configuration of a head-mounted display (HMD) 12 according to the present embodiment.FIG. 2B is a diagram illustrating an exemplary configuration of arelay device 16 according to the present embodiment. - As illustrated in
FIG. 1 , thevideo display system 10 according to the present invention includes the HMD 12, anentertainment device 14, therelay device 16, adisplay 18, a camera/microphone unit 20, and acontroller 22. - As illustrated, for example, in
FIG. 2A , theHMD 12 according to the present embodiment includes acontrol section 30, astorage section 32, two communication sections 34 (first communication section 34 a andsecond communication section 34 b), an input/output section 36, adisplay section 38, asensor section 40, anaudio output section 42, and acamera section 44. - The
control section 30 is formed of a microprocessor or other program control device that operates in accordance, for example, with a program installed on the HMD 12. - The
storage section 32 is formed of a storage element such as a read-only memory (ROM) or a random access memory (RAM). Thestorage section 32 stores, for example, a program that is to be executed by thecontrol section 30. - The
first communication section 34 a and thesecond communication section 34 b are each formed of a wireless local area network (LAN) module or other communication interface having a built-in array antenna. As illustrated inFIG. 1 , the present embodiment is configured so that thefirst communication section 34 a and thesecond communication section 34 b are disposed on the upper front of theHMD 12. - In the present embodiment, the communication standard for communication established by the
first communication section 34 a is different from the communication standard for communication established by thesecond communication section 34 b. For example, thefirst communication section 34 a establishes 60 GHz band communication, whereas thesecond communication section 34 b establishes 5 GHz band communication. - The 60 GHz band communication provides communication at a higher maximum rate than the 5 GHz band communication. Further, the 60 GHz band communication provides higher linearity and a shorter communication range than the 5 GHz band communication. In the present embodiment, either the
first communication section 34 a or thesecond communication section 34 b can be selectively used to communicate with therelay device 16 in accordance with radio wave conditions for wireless communication. Further, a well-known adaptive modulation/coding technology can be used in the present embodiment to adaptively change the modulation method and coding method of the first andsecond communication sections - The input/
output section 36 is formed of an input/output port such as an HDMI (registered trademark) (High-Definition Multimedia Interface) port, a universal serial bus (USB) port, or an auxiliary (AUX) port. - The
display section 38 is formed of a liquid-crystal display, an organic electroluminescence (EL) display, or other display disposed on the front of theHMD 12, and used to display, for example, video generated by theentertainment device 14. Thedisplay section 38 is accommodated in a housing of theHMD 12. Thedisplay section 38 may receive, for example, a video signal outputted from theentertainment device 14 and relayed by therelay device 16, and output video represented by the received video signal. Thedisplay section 38 according to the present embodiment is capable of displaying a three-dimensional image, for example, by displaying a left-eye image and a right-eye image. Thedisplay section 38 may be capable of displaying only a two-dimensional image and incapable of displaying a three-dimensional image. - The
sensor section 40 is formed of a sensor such as an acceleration sensor or a motion sensor. Thesensor section 40 outputs the results of measurements, such as a rotation amount and movement amount of theHMD 12, to thecontrol section 30 at a predetermined frame rate. - The
audio output section 42 is formed, for example, of a headphone or a speaker, and used to output, for example, a sound that is represented by audio data generated by theentertainment device 14. Theaudio output section 42 receives, for example, an audio signal outputted from theentertainment device 14 and relayed by therelay device 16, and outputs a sound represented by the received audio signal. - The
camera section 44 is formed of a digital camera or other camera and used to capture, at a predetermined frame rate, an image of surroundings of a user wearing theHMD 12. As illustrated inFIG. 1 , the camera section according to the present embodiment includes, for example, four cameras. As depicted, for example, inFIG. 1 , the four cameras are individually disposed on the upper left of thedisplay section 38, the upper right of thedisplay section 38, the left side surface of the housing for theHMD 12, and the right side surface of the housing for theHMD 12. The cameras may incorporate, for example, a fisheye lens to capture an omnidirectional image of the surroundings of theHMD 12 or may be capable of capturing only a directional image. Further, thecamera section 44 may include an infrared camera that is disposed inside the housing for theHMD 12 to detect the line-of-sight direction of the user wearing theHMD 12. - Furthermore, the
camera section 44 may be capable of identifying the distance between theHMD 12 and therelay device 16. For example, the cameras disposed on the upper left and upper right of thedisplay section 38 may be configured as a stereo camera. Moreover, the distance between theHMD 12 and therelay device 16 may be identifiable based on an image captured by the stereo camera. In addition, thecamera section 44 may include an infrared camera or other device (distance measuring device) capable of measuring the distance between theHMD 12 and therelay device 16, which is disposed forward of theHMD 12. - The
entertainment device 14 according to the present embodiment is formed of a computer such as a game console, a digital versatile disc (DVD) player, or a Blu-ray (registered trademark) player. Theentertainment device 14 according to the present embodiment generates video and audio, for example, by executing a stored game program or reproducing content recorded on an optical disk. Theentertainment device 14 according to the present embodiment outputs a video signal representative of the generated video and an audio signal representative of the generated audio to the HMD12 and thedisplay 18 through therelay device 16. - The
relay device 16 according to the present embodiment is formed of a computer that relays the video and audio signals outputted from theentertainment device 14 and outputs them to theHMD 12 and thedisplay 18. - As illustrated, for example, in
FIG. 2B , therelay device 16 according to the present embodiment includes acontrol section 50, astorage section 52, two communication sections 54 (first communication section 54 a andsecond communication section 54 b), and an input/output section 56. - The
control section 50 is formed, for example, of a control circuit or a central processing unit (CPU) or other program control device that operates in accordance with a program installed on therelay device 16. - The
storage section 52 is formed, for example, a ROM, a RAM, or other storage element. Thestorage section 52 stores, for example, a program to be executed by thecontrol section 50. - The
first communication section 54 a and thesecond communication section 54 b are each formed of a wireless LAN module or other communication interface having a built-in array antenna. As illustrated inFIG. 1 , the present embodiment is configured so that thefirst communication section 54 a and thesecond communication section 54 b are included in the front of therelay device 16. - In the present embodiment, the communication standard for communication established by the
first communication section 54 a is different from the communication standard for communication established by thesecond communication section 54 b. For example, thefirst communication section 54 a establishes 60 GHz band communication, whereas thesecond communication section 54 b establishes 5 GHz band communication. - As mentioned earlier, the 60 GHz band communication provides communication at a higher maximum rate than the 5 GHz band communication. Further, the 60 GHz band communication provides higher linearity and a shorter communication range than the 5 GHz band communication. In the present embodiment, either the
first communication section 34 a or thesecond communication section 34 b can be selectively used to communicate with theHMD 12 in accordance with the radio wave conditions for wireless communication. - The input/
output section 56 is formed of an input/output port such as an HDMI (registered trademark) (High-Definition Multimedia Interface) port or a USB port. - The
display 18 according to the present embodiment is formed, for example, of a liquid-crystal display, and used to display, for example, video represented by a video signal outputted from theentertainment device 14. - The
cameralmicrophone unit 20 according to the present embodiment includes acamera 20 a and amicrophone 20 b. Thecamera 20 a captures an image, for example, of a subject and outputs the captured image to theentertainment device 14. Themicrophone 20 b captures an ambient sound, converts the captured sound to audio data, and outputs the audio data to theentertainment device 14. Further, thecamera 20 a according to the present embodiment is a stereo camera. - The
HMD 12 and therelay device 16 are capable of establishing, for example, wireless communication to send and receive data to and from each other. When theHMD 12 and therelay device 16 communicate with each other in the present embodiment, 60 GHz band communication is established between thefirst communication section 34 a and thefirst communication section second communication section 34 b and thesecond communication section 54 b. - The
entertainment device 14 is connected to therelay device 16, for example, with an HDMI cable or a USB cable. Therelay device 16 is connected to thedisplay 18, for example, with an HDMI cable. Theentertainment device 14 is connected to thecameralmicrophone unit 20, for example, with an AUX cable. - The
controller 22 according to the present embodiment is an operation input device that is used to make an operation input to theentertainment device 14. The user can use thecontroller 22 to perform various operation input procedures by pressing a direction key or a button on thecontroller 22 or tilting an operating stick on thecontroller 22. Then, in the present embodiment, thecontroller 22 outputs to theentertainment device 14 input data associated with the operation input. Further, thecontroller 22 according to the present embodiment includes a USB port. When connected to theentertainment device 14 with a USB cable, thecontroller 22 is capable of outputting input data to theentertainment device 14 in a wired manner. Thecontroller 22 according to the present embodiment additionally includes, for example, a wireless communication module, and is thus capable of wirelessly outputting input data to theentertainment device 14. -
FIGS. 3A and 3B are schematic diagrams illustrating examples in which thevideo display system 10 according to the present embodiment is disposed in a room. In the present embodiment, thefirst communication section 34 a of theHMD 12 establishes 60 GHz band communication with thefirst communication section 54 a of therelay device 16 when theHMD 12 and therelay device 16 are in the same room as illustrated inFIG. 3A . Meanwhile, when theHMD 12 and therelay device 16 are in different rooms as illustrated inFIG. 3B , thesecond communication section 34 b of theHMD 12 establishes 5 GHz band communication with thesecond communication section 54 b of therelay device 16. - Based on an image that is captured by the
camera section 44 to depict an environment in which at least either theHMD 12 or therelay device 16 is placed, the present embodiment determines whether theHMD 12 and therelay device 16 are in the same room or in different rooms. If, for example, an image of therelay device 16 is included in the image captured by thecamera section 44, it is determined that theHMD 12 and therelay device 16 are in the same room. If, by contrast, the image of therelay device 16 is not included in the image captured by thecamera section 44, it is determined that theHMD 12 and therelay device 16 are in different rooms. - If it is determined that the
HMD 12 and therelay device 16 are in the same room, the present embodiment exercises control so as to establish 60 GHz band communication between theHMD 12 and therelay device 16. If, by contrast, it is determined that theHMD 12 and therelay device 16 are in different rooms, the present embodiment exercises control so as to establish 5 GHz band communication between theHMD 12 and therelay device 16. - As described above, based on the positional relationship between the
HMD 12 and therelay device 16, which is identified from an image captured by thecamera section 44, the present embodiment determines the frequency band of radio waves used for communication. - When the
HMD 12 and therelay device 16 are in different rooms, there is a wall, a door, or other obstacle between theHMD 12 and therelay device 16. Therefore, it is highly probable that 60 GHz or other high-frequency band communication is low in quality. Consequently, when it is determined based on an image captured by thecamera section 44 that theHMD 12 and therelay device 16 are in different rooms, the present embodiment exercises control so as to establish 5 GHz or other low-frequency band communication between theHMD 12 and therelay device 16. Let us assume, for example, that the user wearing theHMD 12 moves from a room in which therelay device 16 is disposed to another room while 60 GHz band communication is established between theHMD 12 and therelay device 16. In this instance, the communication between theHMD 12 and therelay device 16 switches to 5 GHz band communication. In this manner, the present embodiment changes the frequency band of radio waves used for communication in accordance with a change in the environment in which theHMD 12 and therelay device 16 are placed, and this change occurs earlier than a frequency band change after communication quality confirmation. - Further, millimeter waves are advantageous in that, for example, the maximum rate available for communication is high. Therefore, if the communication quality provided by the millimeter waves is achievable during microwave communication, it is preferable that microwave communication be replaced by millimeter-wave communication. Let us assume here that while 5 GHz band communication is established between the
HMD 12 and therelay device 16, a user wearing theHMD 12 moves from a room to another room in which therelay device 16 is disposed. In this instance, the communication between theHMD 12 and therelay device 16 switches to 60 GHz band communication. In this manner, the present embodiment switches to high-frequency band communication in accordance with an environmental change that improves the quality of high-frequency band communication. - Meanwhile, whether an obstacle exists between the
HMD 12 and therelay device 16 to block radio waves may be determined based on an image captured by thecamera section 44. If it is determined that an obstacle exists between theHMD 12 and therelay device 16 to block radio waves, control may be exercised so as to establish 5 GHz band communication between theHMD 12 and therelay device 16. If, by contrast, it is determined that no obstacle exists between theHMD 12 and therelay device 16 to block radio waves, control may be exercised so as to establish 60 GHz band communication between theHMD 12 and therelay device 16. - Further, even if the
HMD 12 and therelay device 16 are in the same room, the frequency band of radio waves used for communication may be determined depending on whether an image of therelay device 16 is included in an image captured by thecamera section 44. If, for example, the image of therelay device 16 is included in the image captured by thecamera section 44, control may be exercised so as to establish 60 GHz band communication between theHMD 12 and therelay device 16. Meanwhile, if, for example, the image of therelay device 16 is not included in the image captured by thecamera section 44, control may be exercised so as to establish 5 GHz band communication between theHMD 12 and therelay device 16. - Moreover, whether 5 GHz or 60 GHz band communication is to be established between the
HMD 12 and therelay device 16 may be determined in accordance, for example, with the distance between theHMD 12 and therelay device 16. In such an instance, the distance between theHMD 12 and therelay device 16 may be identified by the stereo camera included in thecamera section 44. If theHMD 12 includes a distance measuring device, the distance measuring device may identify the distance between theHMD 12 and therelay device 16. - Functions of the
HMD 12 according to the present embodiment and a process performed by theHMD 12 will be further described below. TheHMD 12 according to the present embodiment functions as a frequency band determination device that determines the frequency band of radio waves used for communication between theHMD 12 and therelay device 16 in accordance with an environment in which at least either theHMD 12 or therelay device 16 is placed. -
FIG. 4 is a functional block diagram illustrating examples of functions implemented in theHMD 12 according to the present embodiment. TheHMD 12 according to the present embodiment need not incorporate all the functions illustrated inFIG. 4 , and may incorporate functions other than those illustrated inFIG. 4 . - As illustrated in
FIG. 4 , theHMD 12 according to the present embodiment functionally includes animage acquisition section 60, a frequencyband determination section 62, and acommunication control section 64. Theimage acquisition section 60 is mainly implemented by thecontrol section 30 and thecamera section 44. The frequencyband determination section 62 is mainly implemented by thecontrol section 30. Thecommunication control section 64 is mainly implemented by thecontrol section 30, thefirst communication section 34 a, and thesecond communication section 34 b. - The above functions may be implemented by allowing the
control section 30 to execute a program that is installed on theHMD 12 formed of a computer and includes commands for the above functions. The program is supplied to theHMD 12, for example, through an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, a flash memory, or other computer-readable information storage medium or through the Internet or the like. - In the present embodiment, the
image acquisition section 60 acquires an image of an environment in which, for example, at least either a communication device (theHMD 12 in the current example) or a communication partner for the communication device (therelay device 16 in the current example) is placed. Theimage acquisition section 60 acquires an image captured by thecamera section 44. - In the present embodiment, based, for example, on an image acquired by the
image acquisition section 60, the frequencyband determination section 62 determines the frequency band of radio waves used for communication between the communication device (theHMD 12 in the current example) and the communication partner (therelay device 16 in the current example). Here, as described earlier, depending on whether theHMD 12 and therelay device 16 are in the same room, the frequencyband determination section 62 may determine the frequency band of radio waves used for communication between the communication device theHMD 12 and therelay device 16. Further, based on the distance between theHMD 12 and therelay device 16, the frequencyband determination section 62 may determine the frequency band of radio waves used for communication between the communication device theHMD 12 and therelay device 16. Furthermore, depending on whether an image of theHMD 12 or an image of therelay device 16 is included in the image captured by theimage acquisition section 60, the frequencyband determination section 62 may determine the frequency band of radio waves used for communication between the communication device theHMD 12 and therelay device 16. Here, even when theHMD 12 and therelay device 16 are in the same room, the frequencyband determination section 62 may determine the frequency band of radio waves used for the communication depending on whether the image of therelay device 16 is included in the image captured by theimage acquisition section 60. Moreover, the frequencyband determination section 62 may determine the frequency band of radio waves used for the communication depending on whether the image of theHMD 12 is included, for example, in the image captured by theimage acquisition section 60. - In the present embodiment, the
communication control section 64 exercises control so as to establish communication by using the frequency band determined, for example, by the frequencyband determination section 62. If, for example, it is determined that 60 GHz band communication is to be established, thecommunication control section 64 exercises control so as to let thefirst communication section 34 a establish communication. If, for example, it is determined that 5 GHz band communication is to be established, thecommunication control section 64 exercises control so as to let thesecond communication section 34 b establish communication. - Further, in the present embodiment, the
communication control section 64 retains communication section identification data. The communication section identification data is used to manage whether established communication is provided by thefirst communication section 34 a or thesecond communication section 34 b. If, for example, the established communication is provided by thefirst communication section 34 a, the value of the communication section identification data is set to "1." If, by contrast, the established communication is provided by thesecond communication section 34 b, the value of the communication section identification data is set to "2." When the value of the communication section identification data is set to "1," thecommunication control section 64 may exercise control so as to stop thesecond communication section 34 b. Meanwhile, when the value of the communication section identification data is set to "2," thecommunication control section 64 may exercise control so as to stop thefirst communication section 34 a. - The following describes, with reference to the flowchart of
FIG. 5 , exemplary processing steps that are performed by theHMD 12 according to the present embodiment when the frequency band is to be determined depending on whether theHMD 12 and therelay device 16 are in the same room. - First of all, the
image acquisition section 60 acquires an image captured by the camera section 44 (step S101). When thecamera section 44 is capturing an image at a predetermined frame rate, for example, the latest image captured by thecamera section 44 may be acquired in step S101. - Then, based on the image acquired in step S101, the frequency
band determination section 62 determines the frequency band of radio waves used for communication (step S102). Here, based, for example, on the image captured by thecamera section 44, the frequencyband determination section 62 identifies whether theHMD 12 and therelay device 16 are in the same room. If it is identified that theHMD 12 and therelay device 16 are in the same room, the frequencyband determination section 62 determines that the frequency band of radio waves used for communication is the 60 GHz band. If, by contrast, it is identified that theHMD 12 and therelay device 16 are in different rooms, the frequencyband determination section 62 determines that the frequency band of radio waves used for communication is the 5 GHz band. If an image of therelay device 16 is included in the image captured by thecamera section 44, the frequencyband determination section 62 may determine that theHMD 12 and therelay device 16 are in the same room. Meanwhile, if an image of therelay device 16 is not included in the image captured by thecamera section 44, the frequencyband determination section 62 may determine that theHMD 12 and therelay device 16 are in different rooms. - Next, the
communication control section 64 verifies the frequency band determined in step S102 and the value of the retained communication section identification data (step S103). - If the frequency band determined in step S102 is the 60 GHz band, and the value of the communication section identification data verified in step S103 is "2," the
communication control section 64 changes the value of the communication section identification data to "1" (step S104). Thecommunication control section 64 then exercises control so as to let thefirst communication section 34 a establish communication (step S105). The process illustrated in the current example then terminates. In step S105, thecommunication control section 64 may start thefirst communication section 34 a and stop thesecond communication section 34 b. - If the frequency band determined in step S102 is the 5 GHz band, and the value of the communication section identification data verified in step S103 is "1," the
communication control section 64 changes the value of the communication section identification data to "2" (step S106). Thecommunication control section 64 then exercises control so as to let thesecond communication section 34 b establish communication (step S107). The process illustrated in the current example then terminates. In step S107, thecommunication control section 64 may start thesecond communication section 34 b and stop thefirst communication section 34 a. - In the other cases, the process illustrated in the current example terminates. More specifically, if the frequency band determined in step S102 is the 60 GHz band, and the value of the communication section identification data verified in step S103 is "1," the process illustrated in the current example terminates. Further, if the frequency band determined in step S102 is the 5 GHz band, and the value of the communication section identification data verified in step S103 is "2," the process illustrated in the current example also terminates.
- Processing then returns to step S101. Subsequently, steps S101 to S105 are repeated. Steps S101 to S105 may be performed at predetermined time intervals.
- Further, as described earlier, in step S102, the frequency
band determination section 62 may identify, based on the image captured by thecamera section 44, whether an obstacle exists between theHMD 12 and therelay device 16 to block radio waves. If it is identified that an obstacle exists to block radio waves, the frequencyband determination section 62 may determine that the frequency band of radio waves used for communication is the 5 GHz band. Meanwhile, if it is identified that no obstacle exists to block radio waves, the frequencyband determination section 62 may determine that the frequency band of radio waves used for communication is the 60 GHz band. - Moreover, in step S102, the frequency
band determination section 62 may determine the frequency band of radio waves used for communication in accordance with the distance between theHMD 12 and therelay device 16. - The following describes, with reference to the flowchart of
FIG. 6 , exemplary processing steps that correspond to the above-described step S102 and are performed by the frequencyband determination section 62 when the frequency band of radio waves used for communication is to be determined based on the distance between theHMD 12 and therelay device 16. - First of all, based on the image acquired in step S101, the frequency
band determination section 62 identifies the distance L between theHMD 12 and the relay device 16 (step S201). Next, the frequencyband determination section 62 verifies the value of the communication section identification data retained by the communication control section 64 (step S202). - If it is verified in step S202 that the value of the communication section identification data is "1," the frequency
band determination section 62 verifies whether the distance L identified in step S201 is greater than a first threshold value (L1 + Δ) which is obtained by adding the value Δ to a reference distance L1 (step S203). Here, the reference distance L1 is, for example, 8 m, and the value Δ is a value based on the distance L identified in step S201, for example, 0.1 x L. The value Δ may be a value according to image-based recognition accuracy at distance L. - If it is verified in step S203 that the distance L identified in step S201 is greater than the first threshold value (L1 + Δ) ("Y" at step S203), the frequency
band determination section 62 determines that the frequency band of radio waves used for communication is the 5 GHz band (step S204). Subsequently, steps S103 and beyond are performed. Meanwhile, if it is verified that the distance L identified in step S201 is not greater than the first threshold value (L1 + Δ) ("N" at step S203), the frequencyband determination section 62 determines that the frequency band of radio waves used for communication is the 60 GHz band (step S205). Subsequently, steps S103 and beyond are performed. - If it is verified in step S202 that the value of the communication section identification data is "2," the frequency
band determination section 62 verifies whether the distance L identified in step S201 is smaller than a second threshold value (L1 - Δ) which is obtained by subtracting the value Δ from the reference distance L1 (step S206). - If it is verified in step S206 that the distance L identified in step S201 is smaller than the second threshold value (L1 - Δ), the frequency
band determination section 62 determines that the frequency band of radio waves used for communication is the 60 GHz band (step S207). Subsequently, steps S103 and beyond are performed. Meanwhile, if it is verified that the distance L identified in step S201 is not smaller than the second threshold value (L1 - Δ), the frequencyband determination section 62 determines that the frequency band of radio waves used for communication is the 5 GHz band (step S208). Subsequently, steps S103 and beyond are performed. - In a situation where the above-described scheme is applied, if the distance L is greater than the first threshold value (L1 + Δ), the frequency
band determination section 62 changes the frequency band of radio waves used for communication between theHMD 12 and therelay device 16 from a first frequency band (e.g., 60 GHz band) to a second frequency band (5 GHz band). Meanwhile, if the distance L is smaller than the second threshold value (L1 - Δ), the frequencyband determination section 62 changes the frequency band of radio waves used for communication between theHMD 12 and therelay device 16 from the second frequency band (e.g., 5 GHz band) to the first frequency band (60 GHz band). - As described above, the threshold value of the distance between the
HMD 12 and therelay device 16 may vary depending on whether the frequency band of radio waves used for communication changes from the first frequency band (high-frequency band) to the second frequency band (low-frequency band) or changes from the low-frequency band to the high-frequency band. Further, the difference (2 x Δ) between the first threshold value (L1 + Δ) and the second threshold value (L1 - Δ) may be based on the distance L identified in step S201. - The present invention is not limited to the above-described embodiment.
- For example, all or some of the functions illustrated in
FIG. 4 may be implemented by therelay device 16 or theentertainment device 14. In such an instance, control is exercised to determine whether therelay device 16 uses thefirst communication section 54 a or thesecond communication section 54 b to communicate with theHMD 12. - Further, the frequency band of radio waves used for communication between the
HMD 12 and therelay device 16 may be determined based on an image that is captured by thecamera 20 a to depict an environment in which at least either theHMD 12 or therelay device 16 is placed. Here, the frequency band of radio waves for communication between theHMD 12 and therelay device 16 may be determined depending, for example, on whether an image of theHMD 12 is included in the image captured by thecamera 20 a. If, for example, the image of theHMD 12 is included in the image captured by thecamera section 20 a, control may be exercised to establish 60 GHz band communication between theHMD 12 and therelay device 16. Meanwhile, if, for example, the image of theHMD 12 is not included in the image captured by thecamera section 20 a, control may be exercised to establish 5 GHz band communication between theHMD 12 and therelay device 16. - Furthermore, the present invention is not only applicable to switching between 60 GHz band communication and 5 GHz band communication, but is generally applicable to switching between high-frequency band communication and low-frequency band communication.
- Moreover, the foregoing specific character strings and numerical values and the character strings and numerical values in the accompanying drawings are illustrated and not restrictive.
Claims (18)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/965,097 US11881886B2 (en) | 2015-12-24 | 2022-10-13 | Frequency band determination based on image of communication environment for head-mounted display |
US18/535,284 US20240106479A1 (en) | 2015-12-24 | 2023-12-11 | Frequency band determination based on image of communication environment for head-mounted display |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015-251360 | 2015-12-24 | ||
JP2015251360 | 2015-12-24 | ||
PCT/JP2016/087749 WO2017110731A1 (en) | 2015-12-24 | 2016-12-19 | Frequency band determination device, head-mounted display, method for determining frequency band, and program |
US201815776242A | 2018-05-15 | 2018-05-15 | |
US16/903,682 US10999847B2 (en) | 2015-12-24 | 2020-06-17 | Frequency band determination based on image of communication environment for head-mounted display |
US17/224,470 US11528706B2 (en) | 2015-12-24 | 2021-04-07 | Frequency band determination based on image of communication environment for head-mounted display |
US17/965,097 US11881886B2 (en) | 2015-12-24 | 2022-10-13 | Frequency band determination based on image of communication environment for head-mounted display |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/224,470 Continuation US11528706B2 (en) | 2015-12-24 | 2021-04-07 | Frequency band determination based on image of communication environment for head-mounted display |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/535,284 Continuation US20240106479A1 (en) | 2015-12-24 | 2023-12-11 | Frequency band determination based on image of communication environment for head-mounted display |
Publications (2)
Publication Number | Publication Date |
---|---|
US20230035304A1 true US20230035304A1 (en) | 2023-02-02 |
US11881886B2 US11881886B2 (en) | 2024-01-23 |
Family
ID=59090325
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/776,242 Active 2037-03-02 US10721735B2 (en) | 2015-12-24 | 2016-12-19 | Frequency band determination based on image of communication environment for head-mounted display |
US16/903,682 Active US10999847B2 (en) | 2015-12-24 | 2020-06-17 | Frequency band determination based on image of communication environment for head-mounted display |
US17/224,470 Active US11528706B2 (en) | 2015-12-24 | 2021-04-07 | Frequency band determination based on image of communication environment for head-mounted display |
US17/965,097 Active US11881886B2 (en) | 2015-12-24 | 2022-10-13 | Frequency band determination based on image of communication environment for head-mounted display |
US18/535,284 Pending US20240106479A1 (en) | 2015-12-24 | 2023-12-11 | Frequency band determination based on image of communication environment for head-mounted display |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/776,242 Active 2037-03-02 US10721735B2 (en) | 2015-12-24 | 2016-12-19 | Frequency band determination based on image of communication environment for head-mounted display |
US16/903,682 Active US10999847B2 (en) | 2015-12-24 | 2020-06-17 | Frequency band determination based on image of communication environment for head-mounted display |
US17/224,470 Active US11528706B2 (en) | 2015-12-24 | 2021-04-07 | Frequency band determination based on image of communication environment for head-mounted display |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/535,284 Pending US20240106479A1 (en) | 2015-12-24 | 2023-12-11 | Frequency band determination based on image of communication environment for head-mounted display |
Country Status (6)
Country | Link |
---|---|
US (5) | US10721735B2 (en) |
EP (2) | EP4254819A3 (en) |
JP (2) | JP6420500B2 (en) |
KR (1) | KR102053334B1 (en) |
CN (2) | CN111934704B (en) |
WO (1) | WO2017110731A1 (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3379736B1 (en) * | 2015-11-19 | 2022-01-19 | Sony Interactive Entertainment Inc. | Antenna control device, head-mounted display, antenna control method, and program |
CN111934704B (en) | 2015-12-24 | 2023-02-24 | 索尼互动娱乐股份有限公司 | Frequency band determination device, head-mounted display, and frequency band determination method |
CN109643456A (en) | 2016-06-17 | 2019-04-16 | 因默希弗机器人私人有限公司 | Method for compressing image and equipment |
CN110494193A (en) | 2017-02-08 | 2019-11-22 | 因默希弗机器人私人有限公司 | User into multiplayer place shows content |
US11153604B2 (en) | 2017-11-21 | 2021-10-19 | Immersive Robotics Pty Ltd | Image compression for digital reality |
AU2018373495B2 (en) | 2017-11-21 | 2023-01-05 | Immersive Robotics Pty Ltd | Frequency component selection for image compression |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040110531A1 (en) * | 2002-07-25 | 2004-06-10 | Nec Corporation | Method and device for selecting between telecommunication networks |
US20140064199A1 (en) * | 2012-08-30 | 2014-03-06 | Lite-On Technology Corp. | Method and channel selector for selecting an operation channel, and wireless network connecting apparatus including the channel selector |
US20140125575A1 (en) * | 2012-11-07 | 2014-05-08 | Qualcomm Incorporated | Techniques for utilizing a computer input device with multiple computers |
US8818273B2 (en) * | 2008-10-31 | 2014-08-26 | Samsung Electronics Co., Ltd | Method and apparatus for wireless communication using an acoustic signal |
US20140349577A1 (en) * | 2013-03-28 | 2014-11-27 | Brother Kogyo Kabushiki Kaisha | Communication Device and Non-Transitory Computer-Readable Recording Medium |
US8982799B2 (en) * | 2013-06-07 | 2015-03-17 | Samsung Sds Co., Ltd. | Configuring frequency bands to be scanned in a multiple-frequency-band wireless LAN |
US20150080043A1 (en) * | 2013-09-18 | 2015-03-19 | Samsung Electronics Co., Ltd. | Communication system with cell selection mechanism and method of operation thereof |
US20160227535A1 (en) * | 2015-02-02 | 2016-08-04 | Qualcomm Incorporated | Systems and methods for dynamic band switching |
US20180288672A1 (en) * | 2017-03-30 | 2018-10-04 | Toyota Jidosha Kabushiki Kaisha | Vehicle-mounted millimeter-wave communication device and communication method |
US20190021090A1 (en) * | 2016-01-08 | 2019-01-17 | Samsung Electronics Co., Ltd. | Electronic device and operation method for electronic device |
Family Cites Families (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2662894B1 (en) | 1990-06-01 | 1995-11-17 | Thomson Csf | DEVICE FOR VIEWING SIMULATED IMAGES FOR A HELMET. |
US7295960B2 (en) * | 2003-01-22 | 2007-11-13 | Wireless Valley Communications, Inc. | System and method for automated placement or configuration of equipment for obtaining desired network performance objectives |
JP2004328319A (en) * | 2003-04-24 | 2004-11-18 | Sharp Corp | Communication apparatus, program and storage medium thereof |
JP2006332970A (en) * | 2005-05-25 | 2006-12-07 | Fujifilm Holdings Corp | Vision auxiliary unit |
JP5021948B2 (en) * | 2006-03-30 | 2012-09-12 | 三菱重工業株式会社 | Obstacle detection device, energy supply device, and energy supply system |
CN200962647Y (en) * | 2006-08-21 | 2007-10-17 | 袁德伟 | Long distance computer video camera device |
JP5156211B2 (en) * | 2006-09-15 | 2013-03-06 | 公益財団法人鉄道総合技術研究所 | Distance measurement method from vehicle to traffic light |
KR100790368B1 (en) | 2006-11-20 | 2008-01-03 | 한국전자통신연구원 | Dmb receiving portable apparatus and method for human body communication, and hmd apparatus and method for receiving dmb using human body communication |
JP5053731B2 (en) | 2007-07-03 | 2012-10-17 | キヤノン株式会社 | Image display control device, image display control method, program, and recording medium |
JP5067850B2 (en) * | 2007-08-02 | 2012-11-07 | キヤノン株式会社 | System, head-mounted display device, and control method thereof |
EP2266227A1 (en) * | 2008-04-17 | 2010-12-29 | KT Corporation | Method and device for calculating quality-value of in-building mobile communication service |
JP5090302B2 (en) * | 2008-09-19 | 2012-12-05 | 富士フイルム株式会社 | Imaging apparatus and method |
JP5117352B2 (en) * | 2008-11-07 | 2013-01-16 | 株式会社東芝 | Wireless communication apparatus and wireless communication method |
JP5109952B2 (en) | 2008-12-08 | 2012-12-26 | ブラザー工業株式会社 | Head mounted display |
JP5308945B2 (en) | 2009-07-21 | 2013-10-09 | 株式会社日立製作所 | Wireless communication system and operation method thereof. |
JP5874178B2 (en) * | 2010-04-09 | 2016-03-02 | ソニー株式会社 | Camera system, camera device, camera control device, and relay device |
JP2011239223A (en) | 2010-05-11 | 2011-11-24 | Hitachi Consumer Electronics Co Ltd | Radio transmission control system and radio transmission system using the same |
WO2012103221A1 (en) * | 2011-01-25 | 2012-08-02 | Pairasight, Inc. | Apparatus and method for streaming live images, audio and meta-data |
JP5874176B2 (en) * | 2011-03-06 | 2016-03-02 | ソニー株式会社 | Display device and relay device |
JP2012186701A (en) | 2011-03-07 | 2012-09-27 | Ricoh Co Ltd | Radio communication terminal |
CN202002978U (en) * | 2011-03-18 | 2011-10-05 | 中国气象科学研究院 | Automatic shooting equipment for full view lightning channel images |
KR20130136566A (en) * | 2011-03-29 | 2013-12-12 | 퀄컴 인코포레이티드 | Modular mobile connected pico projectors for a local multi-user collaboration |
AT511191B1 (en) * | 2011-07-01 | 2012-10-15 | Thomas Dr Neubauer | METHOD AND DEVICE FOR DETERMINING AND STORING THE POSITION AND ORIENTATION OF ANTENNA STRUCTURES |
JP2013051570A (en) | 2011-08-31 | 2013-03-14 | Ricoh Co Ltd | Wireless communication device |
JP2013093664A (en) * | 2011-10-24 | 2013-05-16 | Sony Corp | Display system and repeating device |
JP5880115B2 (en) * | 2012-02-17 | 2016-03-08 | ソニー株式会社 | Head mounted display, head mounted display control program, and head mounted display control method |
JP6066037B2 (en) * | 2012-03-27 | 2017-01-25 | セイコーエプソン株式会社 | Head-mounted display device |
JP2013236213A (en) | 2012-05-08 | 2013-11-21 | Nikon Corp | Electronic apparatus, information communication system, and program |
JP5580855B2 (en) * | 2012-06-12 | 2014-08-27 | 株式会社ソニー・コンピュータエンタテインメント | Obstacle avoidance device and obstacle avoidance method |
US20140022793A1 (en) | 2012-07-17 | 2014-01-23 | Procter And Gamble, Inc. | Home network of connected consumer devices |
CN104781873B (en) * | 2012-11-13 | 2017-06-06 | 索尼公司 | Image display device, method for displaying image, mobile device, image display system |
JP5964737B2 (en) * | 2012-12-14 | 2016-08-03 | パナソニック株式会社 | Communication terminal |
KR102004265B1 (en) * | 2012-12-28 | 2019-07-26 | 엘지전자 주식회사 | Head mounted display and the method of video communication |
JP6140485B2 (en) | 2013-03-13 | 2017-05-31 | パナソニック株式会社 | Transmitting apparatus and transmitting method |
GB201310376D0 (en) * | 2013-06-11 | 2013-07-24 | Sony Comp Entertainment Europe | Head-mountable apparatus and systems |
WO2015036691A1 (en) * | 2013-09-12 | 2015-03-19 | Overline Systems | Device for wireless sound communication in a frequency-dense environment |
US9630105B2 (en) * | 2013-09-30 | 2017-04-25 | Sony Interactive Entertainment Inc. | Camera based safety mechanisms for users of head mounted displays |
US20150116316A1 (en) * | 2013-10-28 | 2015-04-30 | Brown University | Virtual reality methods and systems |
JP2015149654A (en) * | 2014-02-07 | 2015-08-20 | 船井電機株式会社 | Head mount display, viewing system |
EP3057301A4 (en) * | 2014-02-10 | 2017-09-27 | Olympus Corporation | Wireless image transmission system and wireless image transmission method |
JP6427942B2 (en) | 2014-05-01 | 2018-11-28 | セイコーエプソン株式会社 | Head-mounted display device, control system, and head-mounted display device control method |
US9766715B2 (en) * | 2014-05-01 | 2017-09-19 | Seiko Epson Corporation | Head-mount type display device, control system, method of controlling head-mount type display device, and computer program |
WO2015180039A1 (en) * | 2014-05-27 | 2015-12-03 | 华为技术有限公司 | Method, device and system for acquiring antenna engineering parameters |
JP2015228097A (en) | 2014-05-30 | 2015-12-17 | 株式会社ニコン | Electronic device, electronic device system and program |
AU2016301319A1 (en) * | 2015-08-03 | 2018-03-08 | Nextivity, Inc. | Determining the optimum coverage position in a building for externally provided RF signals |
CN111934704B (en) * | 2015-12-24 | 2023-02-24 | 索尼互动娱乐股份有限公司 | Frequency band determination device, head-mounted display, and frequency band determination method |
-
2016
- 2016-12-19 CN CN202010728036.7A patent/CN111934704B/en active Active
- 2016-12-19 US US15/776,242 patent/US10721735B2/en active Active
- 2016-12-19 EP EP23190542.3A patent/EP4254819A3/en active Pending
- 2016-12-19 WO PCT/JP2016/087749 patent/WO2017110731A1/en unknown
- 2016-12-19 EP EP16878620.0A patent/EP3376674B1/en active Active
- 2016-12-19 KR KR1020187017961A patent/KR102053334B1/en active IP Right Grant
- 2016-12-19 JP JP2017558114A patent/JP6420500B2/en active Active
- 2016-12-19 CN CN201680074014.5A patent/CN108476033B/en active Active
-
2018
- 2018-10-11 JP JP2018192501A patent/JP2019041394A/en active Pending
-
2020
- 2020-06-17 US US16/903,682 patent/US10999847B2/en active Active
-
2021
- 2021-04-07 US US17/224,470 patent/US11528706B2/en active Active
-
2022
- 2022-10-13 US US17/965,097 patent/US11881886B2/en active Active
-
2023
- 2023-12-11 US US18/535,284 patent/US20240106479A1/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040110531A1 (en) * | 2002-07-25 | 2004-06-10 | Nec Corporation | Method and device for selecting between telecommunication networks |
US8818273B2 (en) * | 2008-10-31 | 2014-08-26 | Samsung Electronics Co., Ltd | Method and apparatus for wireless communication using an acoustic signal |
US20140064199A1 (en) * | 2012-08-30 | 2014-03-06 | Lite-On Technology Corp. | Method and channel selector for selecting an operation channel, and wireless network connecting apparatus including the channel selector |
US20140125575A1 (en) * | 2012-11-07 | 2014-05-08 | Qualcomm Incorporated | Techniques for utilizing a computer input device with multiple computers |
US20140349577A1 (en) * | 2013-03-28 | 2014-11-27 | Brother Kogyo Kabushiki Kaisha | Communication Device and Non-Transitory Computer-Readable Recording Medium |
US8982799B2 (en) * | 2013-06-07 | 2015-03-17 | Samsung Sds Co., Ltd. | Configuring frequency bands to be scanned in a multiple-frequency-band wireless LAN |
US20150080043A1 (en) * | 2013-09-18 | 2015-03-19 | Samsung Electronics Co., Ltd. | Communication system with cell selection mechanism and method of operation thereof |
US20160227535A1 (en) * | 2015-02-02 | 2016-08-04 | Qualcomm Incorporated | Systems and methods for dynamic band switching |
US20190021090A1 (en) * | 2016-01-08 | 2019-01-17 | Samsung Electronics Co., Ltd. | Electronic device and operation method for electronic device |
US20180288672A1 (en) * | 2017-03-30 | 2018-10-04 | Toyota Jidosha Kabushiki Kaisha | Vehicle-mounted millimeter-wave communication device and communication method |
Also Published As
Publication number | Publication date |
---|---|
JP6420500B2 (en) | 2018-11-07 |
EP3376674A1 (en) | 2018-09-19 |
US11881886B2 (en) | 2024-01-23 |
KR20180088849A (en) | 2018-08-07 |
EP3376674B1 (en) | 2023-09-06 |
US11528706B2 (en) | 2022-12-13 |
US20240106479A1 (en) | 2024-03-28 |
WO2017110731A1 (en) | 2017-06-29 |
US10999847B2 (en) | 2021-05-04 |
EP4254819A2 (en) | 2023-10-04 |
KR102053334B1 (en) | 2019-12-06 |
CN111934704A (en) | 2020-11-13 |
US10721735B2 (en) | 2020-07-21 |
CN108476033B (en) | 2020-08-21 |
US20190364564A1 (en) | 2019-11-28 |
EP3376674A4 (en) | 2018-11-14 |
CN108476033A (en) | 2018-08-31 |
US20200314850A1 (en) | 2020-10-01 |
EP4254819A3 (en) | 2023-12-27 |
US20210227545A1 (en) | 2021-07-22 |
JPWO2017110731A1 (en) | 2018-04-19 |
CN111934704B (en) | 2023-02-24 |
JP2019041394A (en) | 2019-03-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11881886B2 (en) | Frequency band determination based on image of communication environment for head-mounted display | |
CN109413563B (en) | Video sound effect processing method and related product | |
US10546556B2 (en) | Communication path specifying device, head mounted display, communication path specifying method, and program | |
CN107801045A (en) | The method, apparatus and system of autozoom when playing augmented reality scene | |
EP2523464A2 (en) | Apparatus and method for processing 3-dimensional image | |
US20210152750A1 (en) | Information processing apparatus and method for controlling the same | |
US10691405B2 (en) | Sound control apparatus, sound control method, and program | |
US11171700B2 (en) | Main beam direction determining device, main beam direction determining method, and program | |
US11843846B2 (en) | Information processing apparatus and control method therefor | |
CN109286841B (en) | Movie sound effect processing method and related product | |
KR101783608B1 (en) | Electronic device and method for dynamically controlling depth in stereo-view or multiview sequence image | |
CN110169007B (en) | Communication device, generated data size control method, and program | |
CN104717516A (en) | Method and device for transmitting multimedia data | |
KR102661177B1 (en) | A display device and operating method thereof | |
EP3667460A1 (en) | Methods and apparatus for user -device interaction | |
KR20240026000A (en) | An electronic apparatus and a method thereof | |
KR20240017599A (en) | A display device and method for optimizing game video quality thereof | |
KR20220018665A (en) | Electronic apparatus and method of controlling the same | |
KR20240014964A (en) | A display device and operating method thereof | |
KR20130020209A (en) | Apparatus for processing a 3-dimensional image and method for changing an image mode of the same | |
EP3226210A1 (en) | Method and device for generating a cinemagraph from light field images |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |