JP6428071B2 - Video display system, connection method according to video wireless transmission standard between video transmission device and head-mounted display device constituting video display system, computer program, head-mounted display device - Google Patents

Description

  The present invention relates to a video display system, a connection method according to the video wireless transmission standard between a video transmission device and a video reception display device constituting the video display system, a video transmission device, and a video reception display device.

  As a video wireless transmission standard for transmitting video and audio by one-to-one direct wireless communication, for example, there is “Miracast” formulated by the Wi-Fi Alliance. Various devices such as smartphones, tablet terminals, televisions (hereinafter simply referred to as “TVs”), displays, game consoles, adapters, etc. as devices compatible with Miracast (also referred to as “Wi-Fi Display (WFD)”) Development is underway. For example, a device (also referred to as a “source device”) having a video output function such as a smartphone or a tablet terminal may be connected to a device (also referred to as a “display device” or a “sink device”) such as a television or a display. Can be directly transmitted wirelessly without a wireless network such as a Wi-Fi network, and an image can be displayed. In addition, the source device transmits video information to a display device that is not compatible with Miracast (also referred to as “a Miracast non-compatible sink device”) using an adapter functioning as a sink device compatible with Miracast as an intermediary device, Video can also be displayed.

Special table 2013-511235 gazette JP 2012-44429 A

  Here, even when a video played back by a video playback device that is not compatible with Miracast (also referred to as “Miracast non-compatible source device”) is displayed on the sink device, it is not possible between the source device and the sink device not compatible with Miracast. As an intermediary device, it may be possible to use an adapter that functions as a source device corresponding to Miracast. Examples of the video playback device include various devices such as a DVD (Digital Versatile Disk) recorder, a DVD player, a Blu-ray Disc (BD) recorder, a BD player, an HDD (Hard Disk Drive) recorder, and a video camera. Is mentioned. The sink device includes a display unit such as a smartphone, a tablet terminal (personal computer), a notebook PC, a portable information terminal, a projector, a head-mounted display device (head mounted display (HMD)), and the like. Various devices having an operation unit may be mentioned.

  An adapter that functions as a source device compatible with Miracast only needs to have a function of mediating between a Miracast-incompatible source device and a sink device, so that the conventional source device such as a smartphone or a tablet terminal can be used. The display unit and the operation unit for realizing a high-level user interface that is usually provided (for example, a graphical user interface. Hereinafter, the user interface is also simply referred to as “UI”) will be omitted, and miniaturization and simplification will be achieved. It is desirable.

  However, since a source device that does not have a display unit and an operation unit for realizing a UI cannot select a sink device to be connected, a connection according to the Miracast procedure between the source device and the sink device is not allowed. There is a problem that it cannot be established. Even if the sink device is equipped with a display unit and an operation unit for realizing a UI, conventionally, the source device and the sink device are connected by selecting the sink device on the source device side and performing the Miracast procedure. However, there is no configuration in which the source device is selected and connected on the sink device side.

  Note that Patent Literature 1 only discloses a search method and apparatus for the first WFD device corresponding to the source device of the Wi-Fi Display service supported by the second WFD device corresponding to the sink device. Therefore, Patent Document 1 describes any problem relating to the problem that a connection according to the Miracast procedure cannot be performed between a source device and a sink device that are not equipped with a display unit and an operation unit for realizing a UI. There is no suggestion.

  Patent Document 2 discloses a video display system in which a portable information processing apparatus and an HMD are connected by wireless communication. As wireless communication, Bluetooth (registered trademark) or wireless LAN (Local Area) is disclosed. Network) is only illustrated. Accordingly, in Patent Document 2, as in Patent Document 1, a connection according to the Miracast procedure cannot be performed between a source device and a sink device that are not equipped with a display unit and an operation unit for realizing a UI. There is no description or suggestion regarding the problem.

  In the above, the problem has been described by taking Miracast as an example, but the video transmission device and the video reception display device are connected in accordance with the video wireless transmission standard for transmitting video and audio by direct one-to-one wireless communication, This is a common problem in systems that transmit audio.

SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms.
According to an aspect of the invention, an image is transmitted from a video transmission device that does not have a display unit and an operation unit for realizing a user interface to a head-mounted display device by direct one-to-one wireless communication. A video display system that transmits and displays video according to a video wireless transmission standard for transmission is provided. In this video display system, the video transmission device is a connection control unit that controls establishment of a connection between the video transmission device and the head-mounted display device, and the video transmission device and the head-mounted device. A first connection for connecting a type display device according to the video wireless transmission standard, and a second connection for peer-to-peer connection between the video transmission device and the head-mounted display device prior to establishment of the first connection. A connection control unit that controls establishment of the connection, and the connection control unit starts the process of establishing the second connection in response to acquisition of a request from the head-mounted display device, When the second connection is established, the head-mounted display device transmits connection identification information indicating that the connection target conforms to the video wireless transmission standard to the video transmission device, and The connection control unit has the connection identification information. Is established with the connection identification information stored in the video transmission device, the first connection is established, and the connection identification information is unique information provided by the video transmission device, and the head The wearable display device includes a unique information acquisition device for acquiring the unique information, and the video transmission device is connected to the head by the unique information acquisition device before starting the process of establishing the second connection. When the see-through display is performed on the wearable display device, the unique information displayed to be superimposed on the video transmission device is acquired, and after the establishment of the second connection, the acquired unique information is used as the connection identification information. Transmit to the video transmission device.
According to the video display system of this aspect, in the video transmission device, when the connection identification information transmitted from the head-mounted display device matches the connection identification information stored in the video transmission device, the head The wearable display device is selected as a head-mounted display device to be connected according to the video wireless transmission standard, and the first connection according to the video wireless transmission standard with the head-mounted display device is selected. Can be executed. Therefore, a video transmission device that is not equipped with a display unit and an operation unit for realizing a UI cannot select a head-mounted display device to be connected. The problem that the connection according to the video wireless communication standard cannot be performed can be solved. In addition, after the establishment of the second peer-to-peer connection between the video transmission device and the head-mounted display device, the video transmission device provides the uniqueness provided by the video transmission device acquired in advance in the head-mounted display device. Information is received from the head-mounted display device as connection identification information. Then, in the video transmission device, the head-mounted display device that has transmitted the unique information based on the received unique information as the connection identification information can be easily used as a connection target video reception display device in accordance with the video wireless transmission standard. The first connection processing according to the video wireless transmission standard between the video transmission device and the head-mounted display device can be executed. In addition, it is possible to easily confirm the video transmission device provided with the unique information as the connection identification information with the head-mounted display device. The video transmission may be transmission including not only a video signal representing video but also an audio signal representing audio.
According to another aspect of the invention, a one-to-one direct wireless communication from a video transmission device that does not include a display unit and an operation unit for realizing a user interface to a head-mounted display device. A video display system is provided that transmits and displays video according to a video wireless transmission standard for transmitting video. In this video display system, the video transmission device is a connection control unit that controls establishment of a connection between the video transmission device and the head-mounted display device, and the video transmission device and the head-mounted device. A first connection for connecting a type display device according to the video wireless transmission standard, and a second connection for peer-to-peer connection between the video transmission device and the head-mounted display device prior to establishment of the first connection. A connection control unit that controls establishment of the connection, and the head-mounted display device overlaps the video transmission device when the video transmission device is see-through displayed on the head-mounted display device. Specific information acquisition device for acquiring the specific information provided by the video transmission device displayed, and the connection control unit requests the head-mounted display device to transmit the specific information, and Partial mounting type The reception of the specific information transmitted from the display device is triggered by the occurrence of an opportunity in the head-mounted display device, and the process for establishing the second connection is started and transmitted from the head-mounted display device. The first connection is established when the unique information matches information stored in the video transmission device.
According to the video display system of this aspect, the video transmission device requests the head-mounted display device to transmit unique information, and the unique information transmitted from the head-mounted display device is stored in the video transmission device. The head-mounted display device is selected as the head-mounted display device to be connected in accordance with the video wireless transmission standard, and video between the head-mounted display device is displayed. The first connection process according to the wireless transmission standard can be executed. Therefore, a video transmission device that is not equipped with a display unit and an operation unit for realizing a UI cannot select a head-mounted display device to be connected. The problem that the connection according to the video wireless communication standard cannot be performed can be solved. In addition, it is possible to easily confirm the video transmission device provided with the unique information as the connection identification information with the head-mounted display device.
In addition, the present invention can be realized as the following forms.

(1) According to the form of the invention, a video is transmitted from a video transmission device that does not have a display unit and an operation unit for realizing a user interface to a video reception display device by direct one-to-one wireless communication. A video display system that transmits and displays video according to a video wireless transmission standard for transmission is provided. In this video display system, the video transmission device is a connection control unit that controls establishment of a connection between the video transmission device and the video reception display device, and the video transmission device, the video reception display device, And a second connection for peer-to-peer connection between the video transmission device and the video reception display device prior to establishment of the first connection. A connection control unit for controlling the connection, the connection control unit according to any one of acquisition of a request from the video reception display device and occurrence of an opportunity in the video transmission device. 2 connection establishment processing is started. According to the video display system of this aspect, the connection control unit of the video transmission device, according to any one of acquisition of a request from the video reception display device and occurrence of an opportunity in the video transmission device, A process for establishing a second connection between the video transmission device and the video reception display device is started. Here, the second connection is a peer-to-peer connection performed prior to the establishment of the first connection in accordance with the video wireless transmission standard. When starting the process of establishing the second connection in response to the acquisition of the request from the video reception display device, the connection control unit of the video transmission device sets the video reception display device of the request transmission source as the second and first The other party of the connection, that is, the other party of the connection according to the video wireless transmission standard. When starting the process of establishing the second connection in response to the occurrence of an opportunity in the video transmission device, the connection control unit of the video transmission device, for example, uses a video reception display device defined by an arbitrary method in the video transmission device. The other party of the second and first connections, that is, the other party of the connection according to the video wireless transmission standard. As a result, according to the video display system of this embodiment, even if the video transmission device is not equipped with a display unit and an operation unit for realizing the UI, the other party of the video wireless communication can be specified. Connection according to the video wireless communication standard between the transmission device and the video reception display device can be made possible.

(2) In the video display system according to the above aspect, the connection control unit of the video transmission device starts processing of establishing the second connection in response to acquisition of the request from the video reception display device, When the second connection is established, the video reception display device transmits, to the video transmission device, connection identification information indicating that the connection target conforms to the video wireless transmission standard, and the video transmission The connection control unit of the apparatus establishes the first connection when the connection identification information matches the connection identification information stored in the video transmission apparatus. According to the video display system of this aspect, in the video transmission apparatus, when the connection identification information transmitted from the video reception display apparatus matches the connection identification information stored in the video transmission apparatus, the video reception display apparatus Can be selected as a video reception display device to be connected according to the video wireless transmission standard, and the first connection processing according to the video wireless transmission standard can be executed with the video reception display device. . Accordingly, since a video transmission device that does not have a display unit and an operation unit for realizing a UI cannot select a video reception display device to be connected, video wireless communication between the video transmission device and the video reception display device is not possible. The problem that the connection according to the communication standard cannot be performed can be solved. The video transmission may be transmission including not only a video signal representing video but also an audio signal representing audio.

(3) In the video display system of the above aspect, the connection identification information is unique to the video reception display device transmitted from the video reception display device to the video transmission device in the process of establishing the second connection. It can be identification information. According to the video display system of this aspect, the identification information unique to the video reception display device is used as the connection identification information, so that the video transmission device inevitably includes the process of establishing the peer-to-peer second connection. Easily select a video reception display device that has transmitted unique identification information as a video reception display device to be connected in accordance with the video wireless transmission standard based on identification information unique to the received video reception display device The first connection process according to the video wireless transmission standard between the video transmission device and the video reception display device can be executed.

(4) In the video display system according to the above aspect, the connection identification information is unique information provided by the video transmission device, and the video reception display device acquires the unique information. Specific information acquisition apparatus, and before starting the process of establishing the second connection, acquires the specific information by the specific information acquisition apparatus, and after the establishment of the second connection, the acquired specific information The connection identification information can be transmitted to the video transmission device. According to the video display system of this aspect, after establishing the second peer-to-peer connection between the video transmission device and the video reception display device, the video transmission device previously acquired in the video reception display device in the video transmission device Is received from the video reception display device as connection identification information. Then, the video transmission device easily selects the video reception display device that has transmitted the specific information as the connection target video reception display device according to the video wireless transmission standard based on the received specific information as the connection identification information. And the first connection process according to the video wireless transmission standard between the video transmission device and the video reception display device can be executed.

(5) In the video display system according to the above aspect, the unique information is acquired by reading information of a QR code (registered trademark) provided in the video transmission device by the unique information acquisition device, and the unique information acquisition device. Reads information of a specific display pattern provided in the video transmission device, the unique information acquisition device reads information of an RF tag provided in the video transmission device, and the unique information acquisition device detects the video. You may make it perform by either reading the information which the specific light emission pattern which the light emission part provided in the transmitter emits emits. According to the video display system of this aspect, the unique information provided by the video transmission device can be easily acquired.

(6) In the video display system of the above aspect, the video reception display device is a head-mounted display device, and the unique information is displayed when the video transmission device is displayed through the head-mounted display device. In addition, it may be displayed on the video transmission device. According to the video display system of this aspect, it is possible to easily confirm the video transmission device provided with the unique information as the connection identification information with the head-mounted display device.

(7) In the video display system of the above aspect, the video reception display device includes a specific information acquisition device for acquiring specific information provided by the video transmission device, and the connection control unit of the video transmission device includes: The video reception display device is requested to transmit the unique information, and the reception of the unique information transmitted from the video reception display device is used as the trigger to start the process of establishing the second connection, and the video reception The first connection may be established when the unique information transmitted from the display device matches information stored in the video transmission device. According to the video display system of this aspect, the video transmission device requests the video reception display device to transmit unique information, and the unique information transmitted from the video reception display device matches the information stored in the video transmission device. In this case, the video reception display device is selected as a video reception display device to be connected according to the video wireless transmission standard, and the first video video transmission display device according to the video wireless transmission standard with the video reception display device is selected. Connection processing can be executed. Accordingly, since a video transmission device that does not have a display unit and an operation unit for realizing a UI cannot select a video reception display device to be connected, video wireless communication between the video transmission device and the video reception display device is not possible. The problem that the connection according to the communication standard cannot be performed can be solved.

(8) In the video display system of the above aspect, the connection control unit of the video transmission device determines the video reception display device to be the connection target, and is determined with the determination of the connection target as the trigger. The second connection is established with the video reception display device, and the first connection is established with the determined video reception display device after the establishment of the second connection. Good. According to the video display system of this aspect, the video transmission device can determine the video reception display device to be connected. For this reason, a video transmission device that is not equipped with a display unit and an operation unit for realizing a UI cannot select a video reception display device to be connected, so that a video between the video transmission device and the video reception display device can be selected. The problem that the connection according to the wireless communication standard cannot be performed can be solved.

(9) In the video display system of the above aspect, the determination of the connection target is based on the priority order stored in advance in the video transmission device, and the radio wave of the video reception display device received by the video transmission device. Based on information relating to, on the basis of past information on the connection, on the basis of a combination of two or more of the priority, information on the radio wave, and past information, May be executed by either of the following. According to the video display system of this aspect, the video transmission device automatically obtains information stored in the video transmission device (that is, the priority order stored in advance in the video transmission device) and the video transmission device. The connection target can be determined using possible information (that is, information related to radio waves of the video reception display device received by the video transmission device and past information related to connection). For this reason, a video transmission device that does not require input from the user to determine a connection target and is not equipped with a display unit or an operation unit for realizing a UI may select a video reception display device to be connected. Therefore, the problem that the connection according to the video wireless communication standard between the video transmission device and the video reception display device cannot be performed can be solved.

Note that the present invention can be realized in various modes as described below.
(A) Video display system and video display method.
(B) A connection method according to a video wireless communication standard between a video transmission device and a video reception display device in a video display system.
(C) A video transmission device corresponding to the video display system and a video reception display device corresponding to the video display system.

It is explanatory drawing which shows schematic structure of the video display system in 1st Embodiment of this invention. It is a block diagram which shows the composition of a head mount display functionally. It is explanatory drawing which shows an example of the virtual image visually recognized by the user. It is a block diagram which shows the structure of a Miracast adapter functionally. It is explanatory drawing which shows the procedure of the connection according to Miracast between Miracast adapter and HMD in case a Miracast adapter is in source mode. It is explanatory drawing which shows an example of the menu screen for Miracast connection. It is explanatory drawing which shows an example of the display screen of the connectable source device detected by the source device detection in a sink device. It is explanatory drawing which shows an example of the connectable device list | wrist previously stored in Miracast setting information. It is explanatory drawing which shows the video reproduction screen displayed by HMD. FIG. 10 is an explanatory diagram illustrating a confirmation screen displayed when the end icon illustrated in FIG. 9 is tapped. It is a block diagram which shows functionally the structure of the Miracast adapter in pass-through mode. It is explanatory drawing which shows the procedure of the connection according to Miracast between the Miracast adapter and HMD in the case of the Miracast adapter being a source mode in 2nd Embodiment. It is a block diagram which shows functionally the structure of the Miracast adapter in 3rd Embodiment. It is explanatory drawing which shows an example of priority information. It is explanatory drawing which shows an example of the determination method information. It is explanatory drawing which shows the procedure of the connection according to Miracast between the Miracast adapter and HMD in case 3rd Embodiment is a Miracast adapter in source mode. It is a figure for demonstrating the determination method of a sink device in case the determination method of a sink device is "general".

A. First embodiment:
A1. Video display system configuration:
FIG. 1 is an explanatory diagram showing a schematic configuration of a video display system 1000 according to the first embodiment of the present invention. The video display system 1000 includes a head-mounted display device 100, a Miracast adapter 300, a video device 400, a display device 500, and a computer 600. The head-mounted display device 100 and the display device 500 are also called “video display device” or “image display device”. As will be described below, the video display system 1000 wirelessly transmits video played on the video device 400 that does not support Miracast from the Miracast adapter 300 that supports Miracast to the head mounted display device 100 that supports Miracast. This is a system for displaying on the head-mounted display device 100. In addition, the video display system 1000 wirelessly transmits a video displayed on the head-mounted display device 100 or a video to be reproduced from the head-mounted display device 100 to the Miracast adapter 300, and the TV 500 that does not support Miracast. It is also a system to display in. Miracast is a standard established by the Wi-Fi Alliance as one of the wireless video transmission standards for transmitting video and audio (hereinafter simply referred to as “video etc.”) by direct one-to-one wireless communication. It is. Transmission by Miracast is only for video transmission (specifically transmission of video information), for video and audio transmission (specifically transmission including video information and audio information), and for audio transmission only. This applies to both cases. The Miracast adapter 300 corresponds to the video transmission device of the present invention, and the HMD 100 corresponds to the video reception display device of the present invention.

  In the Miracast adapter 300 of the present embodiment, a display unit and an operation unit for realizing an advanced user interface (hereinafter referred to simply as “UI”) that is normally provided in a conventional source device is omitted. Has been. The advanced UI means all interfaces that allow a user to operate while looking at a character string or an image, such as a graphical user interface, a text user interface, and a character user interface. That is, the Miracast adapter 300 of this embodiment is not provided with a display using, for example, a liquid crystal or an organic EL, or a touch panel using, for example, various methods.

  The Miracast adapter 300 includes a power button 301, a pass through button 303, a Miracast changeover switch 305, a lighting unit 307, an HDMI (High-Definition Multimedia Interface (registered trademark)) input terminal and an output terminal (not shown), Two MicroUSB (Universal Serial Bus) terminals (not shown) are provided.

  An AC adapter 332 is connected to one MicroUSB (hereinafter simply referred to as “USB”) terminal via a USB cable 334, and DC power is supplied to the Miracast adapter 300. The other USB terminal is connected to the USB terminal of the computer 600 via the USB cable 602, and wired communication can be performed between the Miracast adapter 300 and the computer 600. For example, the operation of the Miracast adapter 300 is performed by the computer 600. It is possible to set conditions. The computer 600 is an information communication terminal. In the present embodiment, a notebook computer is exemplified as the computer 600. However, the computer 600 is configured by other information communication terminals such as a desktop personal computer, a tablet terminal, a smart phone, a mobile phone, and a PDA (personal digital assistant). Also good.

  The HDMI input terminal is connected to the HDMI output terminal (not shown) of the video device 400 via the HDMI cable 402, and the video reproduced by the video device 400 is transmitted to the Miracast adapter 300 via the HDMI cable 402. Is possible. Also, the HDMI output terminal of the Miracast adapter 300 is connected to the HDMI input terminal (not shown) of the display device 500 via the HDMI cable 502. In the display device 500, the Miracast adapter 300 via the HDMI cable 502 is connected. It is possible to display transmitted video and output audio (hereinafter also referred to as “playback of video etc.”).

  The Miracast changeover switch 305 is a switch for selecting one of the two modes of the source mode MTx and the sink mode MRx. When the source mode MTx is selected by the Miracast selector switch 305, the Miracast adapter 300 has a function of wirelessly transmitting an image input from an external device according to HDMI according to Miracast (hereinafter also referred to as “source function” or “source mode”). ) Is ready for execution. On the other hand, when the sync mode MRx is selected by the Miracast changeover switch 305, the Miracast adapter 300 has a function to wire-transmit the video received wirelessly according to Miracast to an external device according to HDMI (hereinafter referred to as “sink function” or “sink mode”). Also called). In this embodiment, the Miracast adapter 300 is wirelessly connected to the head-mounted display device 100 in the source mode or the sink mode according to Miracast, as will be described later.

  The lighting unit 307 includes two LEDs (Light Emitting Diodes) 307A and 307B, and the operation state of the Miracast adapter 300, for example, ON / OFF of the power supply, mode state, etc., is determined depending on the light emission mode of the two LEDs 307A and 307B. Notice. The power button 301 switches the operation state (operation / stop) of the Miracast adapter 300 according to ON / OFF of the button. The pass-through button 303 switches between selection / non-selection of the pass-through mode in accordance with ON / OFF of the button. As will be described later, when the pass-through mode is selected, the video input to the HDMI input terminal is output as it is from the HDMI output terminal.

  The video device 400 includes various video playback devices compatible with HDMI (High-Definition Multimedia Interface, registered trademark) such as a DVD recorder, a DVD player, a BD recorder, a BD player, an HDD recorder, a video camera, and an information communication terminal. Is done. As will be described later, video or the like reproduced by the video equipment 400 is transmitted to the Miracast adapter 300 via the HDMI cable 402, wirelessly transmitted to the head-mounted display device 100 according to Miracast, and the head-mounted display device 100. It is played with. In the present embodiment, the video device 400 is configured by a BD recorder, and the video device 400 is also referred to as a “BD recorder 400”.

  The display device 500 includes various video display devices (image display devices) that support HDMI, such as a television (hereinafter also referred to as “TV”), a display, and a projector. In the display device 500, as will be described later, video or the like that is wirelessly transmitted from the head-mounted display device 100 to the Miracast adapter 300 according to Miracast and wired to the display device 500 via the HDMI cable 502 is reproduced. Further, in the display device 500, as described later, video and the like that are wired from the video device 400 to the Miracast adapter 300 via the HDMI cable 402 and further to the display device 500 via the HDMI cable 502 are reproduced. Is done. In the present embodiment, the display device 500 is configured by a TV, and the display device 500 is also referred to as “TV 500”.

  The head-mounted display device 100 is an image display device (video display device) that is mounted on the head and is also called a head mounted display (HMD). The head mounted display (HMD) 100 according to this embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time also visually recognize an outside scene. The HMD 100 includes an image display unit 20 that allows a virtual image to be visually recognized for use in a state of being mounted on the user's head, and a control unit (controller) 10 that controls the image display unit 20.

  The image display unit 20 is a mounting body that is mounted on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left display driving unit 24, a left holding unit 23, a right optical image display unit 26, and a left optical image display unit 28. It is out. The right optical image display unit 26 and the left optical image display unit 28 are arranged so as to be positioned in front of the right and left eyes of the user when the user wears the image display unit 20, respectively. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user when the user wears the image display unit 20. A camera 67 is arranged in the section.

  The right holding unit 21 and the left holding unit 23 are members that hold the image display unit 20 on the user's head like a temple of glasses. The right display drive unit 22 is disposed inside the right holding unit 21, in other words, on the side facing the user's head when the user wears the image display unit 20. Further, the left display driving unit 24 is disposed inside the left holding unit 23. Hereinafter, the right holding unit 21 and the left holding unit 23 may be described as “holding units” without being distinguished from each other. Similarly, the right display drive unit 22 and the left display drive unit 24 are described as “display drive units” without being distinguished from each other, and the right optical image display unit 26 and the left optical image display unit 28 are not distinguished from each other as “optical image display units”. It may be described as.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control unit 10. The connection unit 40 includes a main body cord 48 connected to the control unit 10, a right cord 42 and a left cord 44 in which the main body cord 48 branches into two, and a connecting member 46 provided at the branch point. . The connecting member 46 is provided with a jack for connecting the earphone plug 30. A right earphone 32 and a left earphone 34 extend from the earphone plug 30.

  The image display unit 20 and the control unit 10 transmit various signals via the connection unit 40. Each end of the main body cord 48 opposite to the connecting member 46 and the control unit 10 are provided with connectors (not shown) that are fitted to each other. The connector of the main body cord 48 and the control unit 10 The control unit 10 and the image display unit 20 are connected to or disconnected from each other by the fitting / releasing of the connector. A metal cable or an optical fiber can be used for the connection part 40.

  The control unit 10 is a device for controlling the HMD 100. The control unit 10 includes a lighting unit 12, a touch pad 14, a cross key 16, and a power switch 18. The lighting unit 12 notifies the operation state of the HMD 100 (for example, ON / OFF of the power supply) by its light emission mode. As the lighting part 12, for example, an LED can be used. The touch pad 14 detects a contact operation on the operation surface of the touch pad 14 and outputs a signal corresponding to the detected content. As the touch pad 14, various touch pads such as an electrostatic type, a pressure detection type, and an optical type can be adopted. The cross key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power state of the HMD 100 by detecting a slide operation of the switch.

  As described above, when the Miracast adapter 300 operates in the source mode, the control unit 10 receives video or the like wirelessly transmitted from the Miracast adapter 300 according to Miracast, and displays the video through the connection unit 40. The sound is transmitted to the unit 20 and the sound is output from the earphones 32 and 34. Further, as described above, when the Miracast adapter 300 operates in the sink mode, the control unit 10 wirelessly transmits a video or the like transmitted from the image display unit 20 via the connection unit 40 to the Miracast adapter 300 according to Miracast. To transmit. The establishment of the connection according to Miracast between the Miracast adapter 300 and the control unit 10 of the HMD 100 will be described in detail later.

A2. Configuration of head mounted display device:
FIG. 2 is a block diagram functionally showing the configuration of the head mounted display (HMD) 100. The control unit 10 includes an input information acquisition unit 110, a storage unit 120, a power supply 130, a wireless communication unit 132, a GPS module 134, a CPU 140, an interface 180, and transmission units (Tx) 51 and 52. The components are connected to each other by a bus (not shown).

  The input information acquisition unit 110 acquires a signal corresponding to an operation input to the touch pad 14, the cross key 16, the power switch 18, and the like. Although not shown, the input information acquisition unit 110 can also acquire a signal corresponding to an operation input to an input device such as line-of-sight detection, touch detection, or a microphone. Specifically, in line-of-sight detection, the line of sight of the user is detected using an infrared sensor or the like. In this case, the movement of the line of sight and the command are associated in advance. In the touch detection, a user's touch operation is detected with respect to a contact sensor provided at an arbitrary location on the housing of the HMD 100 (for example, outside the right holding unit 21 and the left holding unit 23 (FIG. 1) of the image display unit 20). To do.

  The storage unit 120 includes a ROM, a RAM, a DRAM, a hard disk, and the like, and stores computer programs that are read and executed by the CPU 140 and various data information. The power supply 130 supplies power to each part of the HMD 100. As the power supply 130, for example, a secondary battery can be used.

  The wireless communication unit 132 is an external device according to a predetermined wireless communication standard (for example, infrared, short-range wireless communication exemplified by Bluetooth (registered trademark), wireless LAN exemplified by Wi-Fi (IEEE802.11)). Wireless communication with In the present embodiment, the wireless communication unit 132 corresponds to at least “Wi-Fi”, “Wi-Fi Direct”, and “Miracast” formulated by the Wi-Fi Alliance. The GPS module 134 detects the current position of the user of the HMD 100 by receiving a signal from a GPS satellite, and generates current position information representing the current position information of the user. The current position information can be realized by coordinates representing latitude and longitude, for example.

  The CPU 140 reads and executes a computer program stored in the storage unit 120, thereby executing an operating system (OS) 150, an image processing unit 160, an audio processing unit 170, a camera control unit 175, a display control unit 190, and Miracast control. It functions as the unit 195.

  The image processing unit 160 generates a signal based on a video signal input from the interface 180, the wireless communication unit 132, or the camera 67. The image processing unit 160 controls the display on the image display unit 20 by supplying the generated signal to the image display unit 20 via the connection unit 40. The signal supplied to the image display unit 20 differs between the analog format and the digital format.

  For example, in the case of a digital format, a video signal in a state where a digital R signal, a digital G signal, a digital B signal, and a clock signal PCLK are synchronized is input. The image processing unit 160 performs various color tone correction processes such as a known resolution conversion process and luminance saturation adjustment on image data Data composed of a digital R signal, a digital G signal, and a digital B signal, as necessary, and a key. Image processing such as stone correction processing is executed. Thereafter, the image processing unit 160 transmits the clock signal PCLK and the image data Data via the transmission units 51 and 52.

  In the case of an analog format, a video signal including an analog R signal, an analog G signal, an analog B signal, a vertical synchronization signal VSync, and a horizontal synchronization signal HSync is input. The image processing unit 160 separates the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the input signal, and generates a clock signal PCLK using a PLL circuit (not shown) or the like according to their periods. The image processing unit 160 converts the analog R signal, the analog G signal, and the analog B signal into digital signals using an A / D conversion circuit or the like. The image processing unit 160 performs well-known image processing on the image data Data composed of the converted digital R signal, digital G signal, and digital B signal as necessary, and then outputs the clock signal PCLK and the image data Data. The vertical synchronization signal VSync and the horizontal synchronization signal HSync are transmitted via the transmission units 51 and 52. Hereinafter, the image data Data transmitted through the transmission unit 51 is also referred to as “right-eye image data Data1”, and the image data Data transmitted through the transmission unit 52 is “left-eye image data Data2”. Also called.

  The display control unit 190 generates control signals for controlling the right display drive unit 22 and the left display drive unit 24. The control signals include driving ON / OFF of the right LCD 241 by the right LCD control unit 211, driving ON / OFF of the right backlight 221 by the right backlight control unit 201, driving ON / OFF of the left LCD 242 by the left LCD control unit 212, This is a signal for individually switching driving ON / OFF of the left backlight 222 by the left backlight control unit 202. The display control unit 190 controls the generation and emission of image light in the right display drive unit 22 and the left display drive unit 24 based on these control signals. The display control unit 190 transmits the generated control signal via the transmission units 51 and 52.

  The audio processing unit 170 acquires an audio signal included in the content, amplifies the acquired audio signal, and supplies the acquired audio signal to a speaker (not shown) of the right earphone 32 and a speaker (not shown) of the left earphone 34. In addition, although illustration is abbreviate | omitted, the sound detected by the microphone with which at least one of the control part 10 and the image display part 20 is detected can also be sampled, and an audio | voice signal can also be acquired.

  The camera control unit 175 controls the operation of the camera 67 and shoots an image that is visually recognized by the user. The captured video can be stored in the storage unit 120.

  The interface 180 is exemplified by a predetermined wired communication standard (for example, MicroUSB, USB, HDMI, DVI (Digital Visual Interface), VGA (Video Graphics Array), composite, RS-232C (Recommended Standard 232), and IEEE 802.3. Wired communication is performed with the external device OA according to a wired LAN or the like. Examples of the external device OA include a PC, a mobile phone (including a smartphone), a game terminal, and the like.

  The Miracast control unit 195 establishes a connection according to Miracast with the HMD 100 via the wireless communication unit 132, as will be described later. In the sync mode, the Miracast control unit 195 receives video or the like wirelessly transmitted from the Miracast adapter 300 according to Miracast by the wireless communication unit 132, and receives an image via the image processing unit 160 and the display control unit 190. A video is displayed on the display unit 20, and audio is output to the earphones 32 and 34 via the audio processing unit 170. In the source mode, the Miracast control unit 195 wirelessly transmits video or the like from the wireless communication unit 132 to the Miracast adapter 300 according to Miracast. Note that the video and the like wirelessly transmitted to the Miracast adapter 300 include video captured by the camera 67, voice collected by a microphone, and various contents supplied from the external device OA via the interface 180. .

  The image display unit 20 includes a right display drive unit 22, a left display drive unit 24, a right light guide plate 261 as a right optical image display unit 26 (FIG. 1), and a left optical image display unit 28 (FIG. 1). A left light guide plate 262 and a nine-axis sensor 66 are provided. The 9-axis sensor 66 is a motion sensor that detects acceleration (3 axes), angular velocity (3 axes), and geomagnetism (3 axes).

  The right display driving unit 22 and the left display driving unit 24 generate and emit image light representing an image using a liquid crystal display (hereinafter referred to as “LCD”) or a projection optical system. The right display driving unit 22 includes a receiving unit (Rx) 53, a right backlight (BL) control unit 201 and a right backlight (BL) 221 that function as a light source, a right LCD control unit 211 that functions as a display element, and a right An LCD 241 and a right projection optical system 251 are included.

  The receiving unit 53 receives data transmitted from the transmitting unit 51. The right backlight control unit 201 drives the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 drives the right LCD 241 based on the input clock signal PCLK, right-eye image data Data1, the vertical synchronization signal VSync, and the horizontal synchronization signal HSync. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix. The right LCD 241 changes the transmittance of the light transmitted through the right LCD 241 by driving the liquid crystal at each pixel position arranged in a matrix, thereby converting the illumination light emitted from the right backlight 221 into an image. Modulate into effective image light to represent. The right projection optical system 251 is configured by a collimator lens that converts the image light emitted from the right LCD 241 to light beams in a parallel state.

  The left display drive unit 24 has substantially the same configuration as the right display drive unit 22 and operates in the same manner as the right display drive unit 22. That is, the left display driving unit 24 includes a receiving unit (Rx) 54, a left backlight (BL) control unit 202 and a left backlight (BL) 222 that function as a light source, and a left LCD control unit 212 that functions as a display element. And a left LCD 242 and a left projection optical system 252. Detailed description is omitted. In this embodiment, the backlight method is adopted, but image light may be emitted using a front light method or a reflection method.

  The right optical image display unit 26 and the left optical image display unit 28 are disposed so as to be positioned in front of the left and right eyes of the user when the user wears the image display unit 20 (see FIG. 1). The right optical image display unit 26 includes a right light guide plate 261 and a light control plate (not shown). The right light guide plate 261 is formed of a light transmissive resin material or the like. The right light guide plate 261 guides the image light output from the right display driving unit 22 to the right eye RE of the user while reflecting the image light along a predetermined optical path. For the right light guide plate 261, a diffraction grating or a transflective film may be used. The light control plate is a thin plate-like optical element and is disposed so as to cover the front side of the image display unit 20 (not shown). The light control plate protects the right light guide plate 261 and suppresses damage to the right light guide plate 261 and adhesion of dirt. Further, by adjusting the light transmittance of the light control plate, it is possible to adjust the external light quantity entering the user's eyes and adjust the ease of visual recognition of the virtual image. The light control plate can be omitted.

  The left optical image display unit 28 has substantially the same configuration as the right optical image display unit 26 and operates in the same manner as the right optical image display unit 26. That is, the left optical image display unit 28 includes a left light guide plate 262 and a light control plate (not shown), and guides the image light output from the left display drive unit 24 to the left eye LE of the user. Detailed description is omitted.

  FIG. 3 is an explanatory diagram illustrating an example of a virtual image visually recognized by the user. FIG. 3 illustrates the visual field VR of the user. As described above, the image light guided to both eyes of the user of the HMD 100 forms an image on the retina of the user, so that the user can visually recognize the virtual image VI. In the example of FIG. 3, the virtual image VI is a standby screen of the OS of the HMD 100. Further, the user views the outside scene SC through the right optical image display unit 26 and the left optical image display unit 28. As described above, the user of the HMD 100 of the present embodiment can see the virtual image VI and the outside scene SC behind the virtual image VI for the portion of the visual field VR where the virtual image VI is displayed. Further, the user can directly see the outside scene SC through the right optical image display unit 26 and the left optical image display unit 28 for the portion of the visual field VR where the virtual image VI is not displayed. In addition, the user can view only the virtual image VI by blocking the outside scene SC, and can view the image wirelessly transmitted from the Miracast adapter 300 according to Miracast as the virtual image VI. In this specification, “the HMD 100 displays a video (image)” includes making the user of the HMD 100 visually recognize a virtual image.

A3. Configuration of Miracast adapter:
FIG. 4 is a block diagram functionally showing the configuration of the Miracast adapter 300. The Miracast adapter 300 includes a CPU 310, a storage unit 320, a power supply, in addition to the power button 301, the pass-through button 303, the Miracast changeover switch 305, and the lighting unit 307 (LEDs 307A and 307B) illustrated in FIG. 330, a USB interface 340, an HDMI transmission / reception unit 350, and a Wi-Fi transmission / reception unit 360. Each part is mutually connected by a bus (not shown).

  The storage unit 320 includes a ROM, a RAM, and the like, and stores computer programs that are read and executed by the CPU 310 and various data information. Note that FIG. 4 shows a state in which the Miracast setting information 322 is stored in the storage unit 320. The Miracast setting information 322 includes information used for the display, audio, and video format in addition to information used as described later when establishing a connection according to Miracast executed by the Miracast control unit 316.

  The power source 330 supplies power to each part of the Miracast adapter 300 when the power button 301 is ON. As the power source 330, for example, a secondary battery can be used. The power source 330 can be charged by being supplied with DC power supplied from the AC adapter 332 via the USB interface 340.

  The CPU 310 reads out and executes a computer program stored in the storage unit 320, whereby an operating system (OS) 311, a USB control unit 312, an HDMI control unit 313, a Wi-Fi control unit 314, a pass-through control unit 315, It functions as various control units such as the Miracast control unit 316 and the LED control unit 317.

  The USB control unit 312 controls the operation of the USB interface 340 according to USB. As a result, the USB interface 340 executes communication with the computer 600 according to USB. In addition, the USB interface 340 executes supply of the DC power supplied from the AC adapter 332 to the power supply 330.

  The HDMI control unit 313 controls the operation of the HDMI transmission / reception unit 350. As a result, the HDMI transmission / reception unit 350 receives video or the like transmitted from the BD recorder 400 according to HDMI. Further, as described later, the HDMI transmission / reception unit 350 transmits video received from the BD recorder 400 or video received wirelessly from the HMD 100 according to Miracast according to HDMI.

  When the pass-through button 303 is ON, the pass-through control unit 315 controls the operation of the HDMI transmission / reception unit 350 and outputs the video input from the HDMI input terminal as it is to the HDMI output terminal. In the present embodiment, a video or the like according to HDMI received from the BD recorder 400 is transmitted to the TV 500 according to HDMI and displayed on the TV 500.

  The Miracast control unit 316 controls the Wi-Fi transmission / reception unit 360 via the Wi-Fi control unit 314 and establishes a connection according to Miracast with the HMD 100, as will be described later. In the source mode, the Miracast control unit 316 wirelessly transmits the video input from the BD recorder 400 connected to the HDMI input terminal of the HDMI transmission / reception unit 350 to the HMD 100 from the Wi-Fi transmission / reception unit 360 according to Miracast. To transmit. In the HMD 100, display of video and output of audio transmitted wirelessly from the BD recorder 400 via the Miracast adapter 300 are executed. In the sync mode, the Miracast control unit 316 receives video or the like wirelessly transmitted from the HMD 100 according to Miracast by the Wi-Fi transmission / reception unit 360 and is connected to the HDMI output terminal of the HDMI transmission / reception unit 350. Output to. In the TV 500, display of video and output of audio transmitted from the HMD 100 to the Miracast adapter 300 are executed.

  The Miracast adapter 300 is characterized by a procedure for establishing a connection according to Miracast executed with the HMD 100, particularly, a procedure for establishing a connection in the source mode, as will be described below.

A4. Connection according to Miracast:
(1) When the Miracast adapter is in the source mode When the Miracast adapter is in the source mode, that is, when the Miracast adapter 300 is the source device on the video transmission side and the HMD 100 is the sink device on the video reception side, A procedure for connection with a device according to Miracast (hereinafter also referred to as “Miracast connection”) will be described.

  FIG. 5 is an explanatory diagram illustrating a connection procedure according to Miracast between the Miracast adapter 300 and the HMD 100 when the Miracast adapter 300 is in the source mode. The Miracast adapter 300 is activated when the user turns on the power button 301. At this time, by setting the Miracast changeover switch 305 to the source mode MTx, the Miracast control unit 316 starts the operation in the source mode (step S302), and it is possible to detect the sink device on the video receiving side and to perform the Miracast of the sink device. Is detected (also called “service”) (step S304). These detections are executed in accordance with the provisions of Wi-Fi Peer-to-Peer (hereinafter also referred to as “peer-to-peer”, “P2P”) specifications formulated by the Wi-Fi Alliance.

  On the other hand, in the HMD 100 as a sink device, the user selects and executes the Miracast execution icon (the icon labeled “Miracast” in FIG. 3), and executes the application for Miracast connection, thereby performing Miracast control. The unit 195 starts operation, and the Miracast connection menu screen is displayed on the image display unit 20.

  FIG. 6 is an explanatory diagram showing an example of a menu screen MV for Miracast connection. When the user sets the mode selector switch MS of the menu screen MV to the sink mode (Sink) side and taps (selects) the start button ST, the Miracast control unit 195 starts operating in the sink mode (step S102), and transmits video. Next, detection of the source device and the capability (also referred to as “service”) that can be performed by Miracast of the source device are performed (step S104). Note that these detections are executed in accordance with the definition of the P2P specification, similarly to the source device side.

  The Miracast control unit 316 of the Miracast adapter 300 (hereinafter, also simply referred to as “source device” for convenience of explanation) detects the sink device (step S304), and then the connection setting in Miracast is started from the sink device. (Step S308). On the other hand, the Miracast control unit 195 of the HMD 100 (hereinafter also simply referred to as “sink device” for convenience of description) detects the source device (step S104), and then connects the user from the detected source devices. By selecting the target source device (step S106), Miracast connection setting (connection setup) is started for the source device (step S108). The start of connection setup is triggered by the start of a P2P connection between a source device and a sink device according to Wi-Fi Direct or TDLS (Tunneled Direct Link Setup) specifications established by the Wi-Fi Alliance. .

  FIG. 7 is an explanatory diagram illustrating an example of a display screen SD of connectable source devices detected by source device detection in the sink device. As shown in FIG. 7A, the display screen SD displays a device name (“** −” in the example of the figure) in the display column of the connectable source device (AVAILABLE DEVICES) based on the detection result of the source device. WFD _ *** ”) and a notation indicating whether or not the device is connectable (in the example of FIG. 7A,“ Available ”indicating the connectable state) is displayed. The The source device can be selected by tapping the device name of the source device to be connected from among the source devices that can be connected by the user.

  When the Miracast connection setting is started, the source device and the sink device negotiate with each other for establishing a P2P connection by Wi-Fi Direct (steps S310 and S110), and establish a P2P connection by Wi-Fi Direct ( Steps S312 and S112). When the P2P connection by Wi-Fi Direct is established, as shown in FIG. 7B, the state of the source device to be connected becomes a connection state (“Connected”). In the negotiation, the device name (see FIG. 7A) and the MAC address (Media Access Control address) of the sink device are transmitted from the sink device to the source device.

  Next, the source device uses the device name received from the sink device at the time of the negotiation as a list of connectable sink devices stored in advance in the Miracast setting information 322 (hereinafter referred to as “connectable device list”). (Step S316). FIG. 8 is an explanatory diagram showing an example of the connectable device list DL stored in advance in the Miracast setting information 322. This connectable device list DL is stored in advance in the Miracast setting information 322 at the time of product shipment. It is also possible to perform update setting from the computer 600 via USB.

  If a device name that matches the connectable device list DL does not exist (step S316: No), the source device determines that the sink device cannot be connected, and ends the Miracast connection processing. On the other hand, if there is a device name that matches the connectable device list DL (step S316: Yes), the source device continues to set the Miracast connection with the sink device (step S318). In response, the sink device also continues to set the Miracast connection with the source device (step S118). As a result, the source device and the sink device establish a Miracast connection (steps S320 and S120).

  When the Miracast connection is established between the source device and the sink device, the Miracast adapter 300 that is the sink device wirelessly transmits the video and the like reproduced by the BD recorder 400 as the video device to the HMD 100 that is the source device according to Miracast. It is possible to transmit (steps S322 and S122). FIG. 9 is an explanatory diagram showing a video playback screen SP displayed on the HMD 100. As shown in FIG. 9, the HMD 100 reproduces and displays the received video on the video playback screen SP, and outputs the received audio to the earphones 32 and 34.

  Wireless transmission of video or the like according to Miracast is continued until the procedure for terminating the session in Miracast is performed at the source device or the sink device (steps SS324 and S124). In the Miracast adapter 300 that is the source device, for example, the termination procedure is executed by turning off the power button 301. In the HMD 100, the end procedure is executed by tapping (selecting) the end icon EA in the upper left of FIG. FIG. 10 is an explanatory diagram showing a confirmation screen CP displayed when the end icon EA shown in FIG. 9 is tapped. As shown in FIG. 10, when the end icon EA is tapped, the confirmation screen CP displays a confirmation message “Are you sure to exit?”, A cancel button, and OK. Button is displayed. When the user selects the OK button, the Miracast session termination procedure is executed. If the user selects the Cancel button, the Miracast session is continued.

  Note that the connection permission identification information indicating that the device name of the HMD 100 is identification information unique to the video reception display device of the present invention and is a connection permission target (also referred to as “connection target”) according to the video wireless transmission standard. (Also referred to as “connection identification information”). In the above description, the Miracast control unit 316 of the Miracast adapter 300 functions as a “video transmission device connection control unit”, and the Miracast control unit 195 of the HMD 100 functions as a “video reception display device reception side connection control unit”. In the above description, the Miracast connection corresponds to a “first connection”, and the P2P connection by Wi-Fi Direct corresponds to a “second connection”. Miracast is a protocol that operates based on the P2P protocol based on Wi-Fi Direct, that is, Wi-Fi Direct is a lower protocol and Miracast is an upper protocol.

(2) When the Miracast adapter is in the pass-through mode When the Miracast adapter is in the pass-through mode, that is, when the Miracast selector switch 305 is in the source mode MTx and the pass-through button 303 is turned on and the pass-through mode is selected. The operation of the Miracast adapter 300 will be described.

  FIG. 11 is a block diagram functionally showing the configuration of the Miracast adapter 300 in the pass-through mode. FIG. 11 shows only the configuration necessary for the description of the pass-through mode, and other configurations are omitted. When the Miracast changeover switch 305 is in the source mode MTx (see FIGS. 1 and 4) and the pass-through button 303 is turned on and the pass-through mode is selected, the pass-through control unit 315 operates the HDMI transmitting / receiving unit 350. By controlling, a signal such as video input from the HDMI input terminal is output as it is from the HDMI output terminal. Thereby, the video output from the BD recorder 400 can be directly output to the TV 500 via the Miracast adapter 300 and reproduced on the TV 500.

(3) When the Miracast adapter is in the sink mode When the Miracast adapter 300 is in the sink mode, that is, when the Miracast adapter 300 is the sink device on the video reception side and the HMD 100 is the source device on the video transmission side, A procedure for connection with the sink device according to Miracast will be described. The Miracast connection procedure between the Miracast adapter 300 as the sink device and the Miracast compatible HDM 100 is performed between the adapter as the sink device compatible with the conventional Miracast and the source device compatible with the conventional Miracast. This is the same as the Miracast connection procedure. Therefore, an outline of the Miracast connection procedure between the Miracast adapter 300 as a sink device and the HDM 100 corresponding to Miracast will be described below.

  The Miracast adapter 300 starts operation as a sink device by setting the Miracast changeover switch 305 (see FIGS. 1 and 4) to the sync mode MRx. On the other hand, in the HMD 100, the user selects and executes the Miracast execution icon (FIG. 3), sets the mode switch MS on the Miracast connection menu screen (see FIG. 6) to the source mode (Source) side, and sets the start button ST. By tapping, it starts operating as a source device.

  The source device and the sink device perform device detection and service detection in accordance with the Miracast connection procedure. In the HDM 100 that is the source device, the result of the sink device detection is displayed in the connectable sink device display field of the display screen SD (see FIG. 7), as in the case of the sink mode. By tapping the device name of the Miracast adapter 300 as the connection target sink device from among the sink devices connectable by the user, the Miracast adapter 300 is selected as the connection target sink device, and the sink device is selected from the source device. The setting of Miracast connection is started with respect to and the Miracast connection is established. As a result, wireless transmission of video and audio is possible according to Miracast from the HMD 100 that is the source device to the Miracast adapter 300 that is the sink device, and video and audio can be displayed on the TV 500 via the Miracast adapter 300. Become. In addition, when transmitting an image or the like from the HMD 100 to the TV 500 via the Miracast adapter 300, the HMD 100 may transmit the image or the like (also referred to as “streaming”) without reproducing the image or the like. May be transmitted to the TV 500 via the Miracast adapter 300 and the video or the like may be reproduced on the TV 500 (also referred to as “mirror link”).

A5. effect:
In the first embodiment described above, the Miracast adapter 300 includes a display unit (for example, a display using liquid crystal or organic EL) and an operation unit (for example, a display using a liquid crystal or an organic EL) for realizing an advanced user interface normally provided in a conventional source device. For example, it does not have a touch panel using various methods. Therefore, when the Miracast adapter 300 is the source device on the video transmission side and the HMD 100 is the sink device on the video reception side, the user selects the sink device on the source device side and establishes the Miracast connection as in the past. I can't plan. However, as described above, it is transmitted from the sink device to the source device during the process for establishing the P2P connection (second connection) by Wi-Fi Direct between the source device and the sink device. The source device identifies the sink device to be connected by collating the device name of the sink device with the connectable device list DL registered in advance after establishing the P2P connection by Wi-Fi Direct. be able to. Accordingly, the source device can select the identified sink device and continuously execute the procedure for establishing the Miracast connection (first connection), thereby establishing the Miracast connection. That is, it is possible to establish a Miracast connection without changing the procedure exchanged between the source device and the sink device as compared with the case where the sink device is selected on the source device side and the Miracast connection is established. It is. As a result, a source device that does not have a display unit and an operation unit for realizing a high-level UI like the Miracast adapter 300 cannot select a sink device to be connected. The problem that the connection according to the Miracast (Video Wireless Communication Standard) procedure cannot be performed can be solved.

B. Second embodiment:
In the second embodiment of the present invention, unlike the procedure for establishing the Miracast connection exemplified in the first embodiment, a case where a new procedure is provided for selecting a sink device to be connected in the source device is provided. explain. The video display system in the present embodiment is the same as the video display system 1000 in the first embodiment, and illustration and description thereof are omitted.

  FIG. 12 is an explanatory diagram illustrating a connection procedure according to Miracast between the Miracast adapter 300 and the HMD 100 when the Miracast adapter 300 is in the source mode in the second embodiment. FIG. 12 shows that the steps S101 and S103 in the sink device are added to the connection procedure in the first embodiment of FIG. 5, the step S313 is added in the source device, and the steps S314 and S314 are added. The difference is that S316 is changed to steps S314b and S316b.

  In the HMD 100 as the sink device, the user selects and executes the Miracast execution icon (see FIG. 3) and executes the application for the Miracast connection, so that the Miracast control unit 195 starts operation. The device specific information acquisition operation is executed (step S101). Specifically, for example, the camera 67 (see FIGS. 1 and 2) and the camera control unit 175 are operated as the unique information acquisition device, and a QR code or a bar code (hereinafter referred to as a barcode) attached to the surface of the casing of the Miracast adapter 300 , Called “QR code etc.”). As the unique information, for example, various data determined in advance as information indicating connection permission can be used. Note that the acquired unique information may be displayed so as to be superimposed on the Miracast adapter 300 included in the outside scene SC (see FIG. 3) displayed in a see-through manner in the field of view VR of the HMD 100. This display can be executed by various image recognitions such as recognizing a device that provides the acquired unique information, for example, by continuing the operation of the unique information acquisition unit.

  In the Miracast adapter 300 as the source device and the HMD 100 as the sink device, the same procedure as in the first embodiment is executed (steps S302 to S312 and steps S102 to S112), and between the source device and the sink device. A P2P connection is established by Wi-Fi Direct.

  When the P2P connection by Wi-Fi Direct is established, the source device requests the sink device to transmit the unique information acquired by the sink device (step S313). At this time, the sink device transmits the unique information acquired in step S101 to the source device as a response to the request from the source device (step S113), and the source device receives the unique information acquired by the sink device. This acquisition request and response can be executed by using a newly provided procedure (protocol) in the established P2P by Wi-Fi Direct.

  The source device that has received the unique information transmitted from the sink device has its own unique information stored in advance in the Miracast setting information 322 (the same information as the unique information included in the QR code) and the received unique information. Information is collated (step S314b). If the unique information does not match (step S316b: No), the source device determines that there is no sink device capable of Miracast connection, and ends the process of Miracast connection. On the other hand, if the unique information matches (step S316b: Yes), the source device determines that the sink device that transmitted the unique information is a sink device that can be connected to Miracast, and selects it as a connection target device. To do. Then, the source device continues to set the Miracast connection with the sink device (step S318), and accordingly, the sink device also continues to set the Miracast connection with the source device ( Step S118). As a result, the source device and the sink device can establish a Miracast connection (steps S320 and S120), and execute wireless transmission of video from the source device to the sink device (steps S322 and S122).

  In the second embodiment described above, as described above, the sink device acquires information indicating connection permission provided by the source device as specific information in advance. After establishing the P2P connection by Wi-Fi Direct between the source device and the sink device, the source device has been transmitted from the sink device as a response requested to the sink device according to a newly established procedure. By comparing the unique information with the unique information provided by itself, the sink device to be connected can be identified and selected. As a result, the source device can continuously execute a procedure for establishing a connection with Miracast with the selected sink device, and can establish a connection with Miracast. Therefore, in this embodiment, after establishing the P2P connection by Wi-Fi Direct, a new procedure is required for the sink device to transmit and receive the unique information acquired from the source device between the source device and the sink device. It is possible to establish a Miracast connection by selecting a sink device to be connected in the source device. As a result, a source device that does not have a display unit and an operation unit for realizing a UI like the Miracast adapter 300 cannot select a sink device to be connected. Therefore, the Miracast between the source device and the sink device is not possible. It is possible to solve the problem that the connection according to the procedure cannot be performed.

  The unique information provided by the Miracast adapter 300 is unique information provided by the video transmission apparatus of the present invention, and corresponds to connection identification information indicating that the connection target conforms to the video wireless transmission standard.

C. Third embodiment:
In the third embodiment of the present invention, a configuration capable of automatically determining a sink device to be connected in a source device will be described. Below, only the part which has a different structure and operation | movement from 1st Embodiment is demonstrated. In the figure, the same components as those of the first embodiment are denoted by the same reference numerals as those of the first embodiment described above, and detailed description thereof is omitted.

  FIG. 13 is a block diagram functionally showing the configuration of the Miracast adapter 300 in the third embodiment. The difference from the first embodiment shown in FIG. 4 is that the storage unit 320 stores priority information 324 and determination method information 326 in place of the Miracast setting information 322. In addition, the Miracast control unit 316 of the third embodiment is different from the first embodiment in the connection procedure according to Miracast. Details of the connection procedure will be described later.

  FIG. 14 is an explanatory diagram illustrating an example of the priority information 324. The priority information 324 is information used by the Miracast adapter 300 operating as a source device to determine a connection partner (sink device) according to Miracast. The priority information 324 stores information on each device for a plurality of devices included in the video display system 1000. Specifically, the priority information 324 includes fields for a device identifier, a device name, a predetermined priority, a radio wave intensity, the number of connections, and a recently connected device.

  The “device identifier” stores an identifier for uniquely identifying each device included in the video display system 1000. As the identifier, any form such as a character string or alphanumeric characters can be used. The “device name” stores the name of the device represented by the device identifier.

  In the “predetermined priority”, a character string (a number in the example in the figure) representing a predetermined priority is stored.

  In the “radio wave intensity”, a character string (number in the example in the figure) representing the radio wave intensity in the wireless communication between each device included in the video display system 1000 and the Miracast adapter 300 is stored. . The Miracast control unit 316 may periodically acquire the strength of the radio wave received by the antenna of the Wi-Fi transmission / reception unit 360 and update the radio wave strength. The field of radio field intensity may be omitted. The radio wave intensity functions as “information about radio waves”.

  The “number of connections” stores an integrated value of the number of Miracast connections made in the past between each device included in the video display system 1000 and the Miracast adapter 300. The Miracast control unit 316 may increment the number of connections each time a connection according to Miracast is performed. The number of connections functions as “past information about connections”.

  “Nearest connection device” stores a character string indicating whether or not each device included in the video display system 1000 was the target of the previous Miracast connection. In the example in the figure, “Y” represents that the previous Miracast connection was targeted, and “N” represents that the previous Miracast connection was not targeted. The Miracast control unit 316 may update the latest connection device every time the connection according to Miracast is performed. The latest connection device functions as “past information regarding connection”.

  Each information in the priority information 324 may be configured to be changeable by the user of the video display system 1000. For example, a value stored in the device name or a value stored in a predetermined priority order may be changeable by the user of the video display system 1000. For example, the priority information 324 may be displayed on the image display unit 20 of the HMD 100 and can be edited using the control unit 10 of the HMD 100. The priority information 324 is displayed on the TV 500, and the TV 500 is illustrated. Editing may be possible using a remote controller that does not.

  FIG. 15 is an explanatory diagram illustrating an example of the determination method information 326. In the determination method information 326, the Miracast control unit 316 of the Miracast adapter 300 that operates as the source device determines the connection partner (sink device) according to Miracast in the connection processing according to Miracast of the third embodiment. The method used for this is stored. In the present embodiment, the determination method information 326 stores any one of “predetermined priority”, “radio field strength”, “number of connections”, “most recently connected device”, and “total”. The

  FIG. 16 is an explanatory diagram illustrating a connection procedure according to Miracast between the Miracast adapter 300 and the HMD 100 when the Miracast adapter 300 is in the source mode in the third embodiment. The difference from the first embodiment described with reference to FIG. 5 is that the source device includes steps S400 and S402, the step S308a instead of step S308, and the steps S314 and S316 are not included. Also, the sink device does not include step S106, and includes a step S108a instead of step S108.

  The Miracast adapter 300 that operates as a source device executes steps S400 and S402 to determine a partner to be connected according to Miracast, that is, a sink device, from the devices detected in step S304. Specifically, in step S400, the Miracast control unit 316 of the Miracast adapter 300 refers to the value stored in the determination method information 326 to identify the sink device determination method.

  In step S402, the Miracast control unit 316 of the Miracast adapter 300 determines a sink device. Specifically, when the method for determining the sink device specified in step S400 is “predetermined priority”, the Miracast control unit 316 refers to the “predetermined priority” in the priority information 324 and gives the highest priority. An entry (row) in which a value indicating a high rank (for example, “1” or “A” when the priority is determined in ascending order of the character string) is stored is extracted. The Miracast control unit 316 determines that the device specified by the device identifier or the device name of the extracted entry is a sink device. In the example of FIG. 14, it is determined that the HMD 100 is a sink device.

  When the determination method of the sink device is “radio wave intensity”, the Miracast control unit 316 refers to the “radio wave intensity” of the priority information 324 and sets an entry storing a value indicating that the radio wave intensity is strongest. Extract. The Miracast control unit 316 determines that the device specified by the device identifier or the device name of the extracted entry is a sink device. In the example of FIG. 14, it is determined that the HMD 100 is a sink device. If the field of radio field strength is omitted in the priority information 324, the Miracast control unit 316 acquires the strength of the radio wave received by the antenna of the Wi-Fi transmission / reception unit 360, and selects the device with the strongest strength. You may determine that it is a sink device.

  When the determination method of the sink device is “number of connections”, the Miracast control unit 316 refers to the “number of connections” in the priority information 324 and selects an entry storing a value indicating that the number of connections is the largest. Extract. The Miracast control unit 316 determines that the device specified by the device identifier or the device name of the extracted entry is a sink device. In the example of FIG. 14, it is determined that the HMD 100 is a sink device.

  When the sink device determination method is “nearest connection device”, the Miracast control unit 316 refers to the “most recent connection device” in the priority information 324 and represents a value indicating that it was the target of the previous Miracast connection, That is, an entry storing “Y” is extracted. The Miracast control unit 316 determines that the device specified by the device identifier or the device name of the extracted entry is a sink device. In the example of FIG. 14, it is determined that the TV 500 is a sink device.

  FIG. 17 is a diagram for describing a sink device determination method when the sink device determination method is “total”. When the sink device determination method identified in step S400 of FIG. 16 is “total”, the Miracast control unit 316 uses the predetermined priority order, the radio wave intensity, the number of connections, and the like as the sink device determination method. , The priority order derived when each of the latest connection devices is employed (FIG. 17). The Miracast control unit 316 adds up the numbers representing the obtained priorities for each entry (in other words, for each device) to obtain the overall priority for each device. In this embodiment, the priority order is determined in ascending order of the character string. For this reason, the Miracast control unit 316 determines that the device having the smallest value of the obtained overall priority is the sink device. In the example of FIG. 17, it is determined that the HMD 100 is a sink device. The Miracast control unit 316 may use another statistical method (for example, an average value or a mode value) instead of the total priority value.

  In step S108a of FIG. 16, the Miracast control unit 195 of the HMD 100 waits until the setting of connection with Miracast is started from the source device.

  On the other hand, with the determination of the sink device (step S402), the Miracast control unit 316 of the Miracast adapter 300 starts setting the Miracast connection (connection setup) for the sink device determined in step S402 (step S308a). The details of the Miracast connection setting are the same as in the first embodiment. Note that the example of FIG. 16 is an example when the HMD 100 is determined as the sink device in step S402. If another device (for example, TV 500) is determined as the sink device in step S402, the processing after step S108a that is executed by the HMD 100 is executed in the determined other device.

  Note that the trigger at which the Miracast control unit 316 of the Miracast adapter 300 starts to set the Miracast connection can be arbitrarily changed. For example, when the Miracast adapter 300 is set to the sync mode ON, that is, when the sync mode MRx is selected by the Miracast changeover switch 305, the setting of the Miracast connection may be started. Alternatively, the Miracast adapter 300 may be powered on.

  In the third embodiment described above, as described above, the Miracast adapter 300 (video transmission device) that functions as the source device can determine the sink device (video reception display device) that is the target of the Miracast connection. For this reason, since a source device that does not have a display unit and an operation unit for realizing a UI cannot select a sink device to be connected, Miracast (video wireless communication standard) between the source device and the sink device is not possible. It is possible to solve the problem that it is not possible to make a connection according to the above.

  Further, in the third embodiment, the Miracast adapter 300 (video transmission device) functioning as the source device includes information stored in the source device (that is, the priority order stored in advance in the source device), the source The target of connection is determined using information that can be automatically acquired by the device (that is, information on the radio wave of the sink device (video reception display device) received by the source device and past information on connection). can do. For this reason, the Miracast adapter 300 functioning as a source device does not require input from the user of the video display system 1000 in determining the connection target. As a result, since a source device that does not have a display unit and an operation unit for realizing a UI cannot select a sink device to be connected, Miracast (video wireless communication standard) between the source device and the sink device is not possible. It is possible to solve the problem that it is not possible to make a connection according to the above.

  As described above, according to the video display system 1000 of the present invention, the Miracast control unit 316 (connection control unit) of the Miracast adapter 300 (video transmission device, source device) is connected to the HMD 100 (video reception display device, sink device). The second connection establishment process between the Miracast adapter 300 and the HMD 100 is started according to any one of the acquisition of the request and the occurrence of the trigger in the Miracast adapter 300. Here, the second connection is a peer-to-peer connection performed prior to the establishment of the first connection according to Miracast (Video Wireless Transmission Standard). When starting the process of establishing the second connection in response to acquisition of a request from the HMD 100 as in the first embodiment or the second embodiment, the Miracast control unit 316 of the Miracast adapter 300 The HMD 100 can be the counterpart of the second and first connections, that is, the counterpart of the Miracast connection. As in the third embodiment, when starting the process of establishing the second connection in response to the occurrence of an opportunity in the Miracast adapter 300 (that is, determination of the sink device), the Miracast control unit 316 of the Miracast adapter 300 For example, the sink device defined by an arbitrary method in the Miracast adapter 300 can be the counterpart of the second and first connections, that is, the counterpart of the Miracast connection. As a result, according to the video display system 1000 of this embodiment, even when the Miracast adapter 300 (video transmission device, source device) is equipped with neither a display unit nor an operation unit for realizing a UI, the other party of Miracast communication is used. Since it can be specified, the connection according to Miracast between the Miracast adapter 300 and the sink device can be enabled.

D. Variation:
D1. Modification 1:
In the first embodiment, the device name, which is unique identification information of the HMD 100, is used as connection permission identification information indicating that it is a connection permission target according to Miracast. In the Miracast adapter 300 as the source device, the device name transmitted from the HMD 100 as the sink device during the process for establishing the P2P connection by Wi-Fi Direct is checked against the connectable device list DL. Thus, it is determined whether or not connection is possible. However, the present invention is not limited to this, and other unique identification information transmitted from the sink device during the process of establishing the P2P connection by Wi-Fi Direct is used as the connection permission identification information to the source device. Whether or not connection is possible may be determined based on whether or not the identification information is registered in advance. For example, the MAC address is used as identification information unique to the HMD 100, and whether to pass a filter based on a MAC address registered in advance as identification information of a connectable sink device, that is, matches with a MAC address registered in advance. Whether or not connection is possible can be determined depending on whether or not.

D2. Modification 2:
In the second embodiment, in the HMD 100 as the sink device, the unique information indicating the connection permission provided by the Miracast adapter 300 as the source device is read from the QR code or the like attached to the surface of the case of the Miracast adapter 300. However, the present invention is not limited to this. For example, a specific display pattern attached to the surface of the casing of the Miracast adapter 300, for example, a Miracast certification display, a device logo, a device serial number, and the like may be read by the camera 67 as specific information indicating connection permission. Good. Alternatively, the lighting unit 307 of the Miracast adapter 300 may emit a specific light emission pattern corresponding to unique information indicating connection permission, and the HMD 100 may read this specific light emission pattern. Further, the Miracast adapter 300 is provided with an infrared light emitting unit, and a specific light emission pattern corresponding to the unique information indicating connection permission in the infrared light emitting unit is emitted according to, for example, IrDA (Infrared Data Association). May be read. Alternatively, the Miracast adapter 300 may be provided with an RFID (Radio Frequency Identification) tag or an iBeacon, and the HMD 100 may read unique information indicating connection permission included in the RFID tag or the beacon from the iBeacon. Further, a speaker may be provided in the Miracast adapter 300 so that unique information emitted from the speaker is collected by a microphone of the HMD 100 and read. In other words, any unique information indicating connection permission provided by the Miracast adapter 300 as the source device may be acquired by the HMD 100 as the sink device. In the second embodiment, the camera is used as an example of the unique information acquisition device. However, the specific information acquisition device is not limited to the camera, and can be arbitrarily changed according to the information transmission / reception method. For example, as the unique information acquisition device, a light receiving device such as infrared light, a communication device capable of wireless communication or short-range wireless communication, a microphone, and the like can be employed.

D3. Modification 3:
In the second embodiment, the operation for acquiring the unique information of the source device is executed after executing the application for Miracast connection (step S101 in FIG. 12). However, first, the application for acquiring the unique information of the source device, in the second embodiment, the application for reading the QR code is operated, and the acquisition of the unique information of the source device is used as a trigger (trigger). An application for this purpose may be executed. According to the third modification, the Miracast adapter 300 that functions as the source device requests the sink device to transmit the unique information, and the unique information transmitted from the sink device matches the information stored in the source device. Then, the sink device can be selected as a sink device to be connected according to Miracast (Video Wireless Transmission Standard), and the first connection process according to Miracast can be executed with the sink device. Therefore, since a source device that does not have a display unit and an operation unit for realizing a UI cannot select a sink device to be connected, a connection according to Miracast is performed between the source device and the sink device. Can solve the problem of not being able to.

D4. Modification 4:
In the first embodiment, as in the second embodiment, a source device specific information acquisition operation may be added. In this case, the unique information may be the device name or MAC address of the source device. In this case, in the sink device, the user does not need to select the target source device (step S106), and the target source device can be automatically selected based on the acquired unique information. Similarly to the third modification example, an application for Miracast connection may be executed by using acquisition of unique information of the source device as a trigger.

D5. Modification 5:
In the third embodiment, the Miracast adapter 300 functioning as a source device has been described with an example of a method for determining a sink device (a partner to be connected according to Miracast). However, the source device may determine the sink device using a method other than the method described in the above embodiment. For example, the Miracast adapter 300 may determine the sink device using information related to various radio waves other than the “radio wave intensity” exemplified in the third embodiment. As information about radio waves, for example, a frequency band used in wireless communication between the source device and the sink device, presence / absence of encryption of communication contents in the wireless communication between the source device and the sink device, and the like are used. May be. For example, the Miracast adapter 300 may determine a sink device by using past information regarding various connections other than the “number of connections” and “most recent connection device” illustrated in the third embodiment. As the past information regarding the connection, for example, the total value of the time that the Miracast connection was maintained in the past (connection was maintained) between the source device and the sink device may be used. The Miracast adapter 300 may determine a sink device by combining two or more of a predetermined priority order, information on radio waves, and past information on connections.

D6. Modification 6:
In the above-described embodiment, the HMD 100 has been described by taking an example of a separate structure in which the control unit 10 and the image display unit 20 are connected via the connection unit 40. However, the present invention is not limited to this, and various modifications are possible. Is possible. For example, an integrated structure in which the entire control unit 10 is included in the image display unit 20 or a part of the control unit 10 may be included. Alternatively, the power supply 130 provided in the control unit 10 may be formed independently and have a replaceable structure. The configuration formed in the control unit may be overlapped in the image display unit. For example, the CPU may be formed in both the control unit and the image display unit, and the functions performed by the CPU of the control unit and the CPU of the HMD may be distinguished from each other. Further, the control unit may be built in a personal computer (PC), and the image display unit may be used instead of the monitor of the PC, or the control unit and the image display unit may be integrated to provide a user. It may be an aspect of a wearable computer attached to the clothes.

D7. Modification 7:
In the embodiment described above, the Miracast adapter 300 is connected to the video device 400 and the display device 500 that are not compatible with Miracast via an HMDI cable. However, the present invention is not limited to this. A plug-in type adapter that is plugged into an HDMI input / output terminal of a device or a display device may be used.

D8. Modification 8:
In the above embodiment, the HMD 100 corresponding to Miracast and the Miracast adapter 300 have been described as examples. However, the present invention is not limited to this. For example, instead of the HMD, a projector, a smartphone, or a personal computer (PC) is used. It can be applied to various devices that can function as a sink device in correspondence with various Miracasts such as tablet terminals and portable electronic devices (media players, mobile phones, etc.).

D9. Modification 9:
In the above embodiment, Miracast, which is one of the video wireless transmission standards established by the Wi-Fi Alliance, has been described as an example. However, the present invention is not limited to this, and the video is transmitted by direct one-to-one wireless communication. The present invention can be applied to various video wireless transmission standards for transmitting, etc.

  The present invention is not limited to the above-described embodiments and modifications, and can be realized with various configurations without departing from the spirit thereof. For example, the technical features in the embodiments and the modifications corresponding to the technical features in each embodiment described in the summary section of the invention are to solve some or all of the above-described problems, or In order to achieve part or all of the effects, replacement or combination can be performed as appropriate. Further, if the technical feature is not described as essential in the present specification, it can be deleted as appropriate.

DESCRIPTION OF SYMBOLS 10 ... Control part 12 ... Lighting part 14 ... Touch pad 16 ... Cross key 18 ... Power switch 20 ... Image display part 21 ... Right holding part 22 ... Right display drive part 23 ... Left holding part 24 ... Left display drive part 26 ... Right Optical image display unit 28 ... Left optical image display unit 30 ... Earphone plug 32 ... Right earphone 34 ... Left earphone 40 ... Connection unit 42 ... Right cord 44 ... Left cord 46 ... Connecting member 48 ... Body code 51 ... Transmission unit 52 ... Transmission 53: Reception unit 67 ... Camera 100 ... Head-mounted display device (video reception display device, head-mounted display, HMD)
110: Input information acquisition unit (operation acquisition unit)
DESCRIPTION OF SYMBOLS 120 ... Memory | storage part 130 ... Power supply 132 ... Wireless communication part 140 ... CPU
160 ... Image processing unit 170 ... Audio processing unit 175 ... Camera control unit 180 ... Interface 190 ... Display control unit 195 ... Miracast control unit (reception side connection control unit)
201 ... Right backlight control unit (display drive unit)
202 ... Left backlight control unit (display drive unit)
221 ... Right backlight (display drive unit)
222: Left backlight (display drive unit)
251 ... Right projection optical system (display drive unit)
252 ... Left projection optical system (display drive unit)
261 ... Right light guide plate 262 ... Left light guide plate 300 ... Miracast adapter (video transmission device)
301 ... Power button 303 ... Pass-through button 305 ... Miracast changeover switch 307 ... Lighting section 307A, 307B ... LED
310 ... CPU
311 ... OS
312 ... USB control unit 313 ... HDMI control unit 314 ... Wi-Fi control unit 315 ... Pass-through control unit 316 ... Miracast control unit (connection control unit)
320 ... Storage unit 322 ... Miracast setting information 324 ... Priority information 326 ... Determination method information 330 ... Power supply 332 ... AC adapter 340 ... USB interface 350 ... HDMI transmission / reception unit 360 ... Wi-Fi transmission / reception unit 400 ... Video equipment (BD recorder)
500 ... Display device (TV)
600 ... Computer 1000 ... Video display system DL ... Connectable device list PCLK ... Clock signal Data ... Image data VSync ... Vertical synchronization signal HSync ... Horizontal synchronization signal Data1 ... Right eye image data Data2 ... Left eye image data EA ... End icon OA ... external device SC ... outside view SD ... display screen RE ... right eye LE ... left eye VI ... virtual image CP ... confirmation screen SP ... video playback screen VR ... field of view ST ... start button MV ... menu screen

Claims (9)

Video wireless transmission standard for transmitting video by direct one-to-one wireless communication from a video transmission device that does not have a display unit and an operation unit for realizing a user interface to a head-mounted display device A video display system for transmitting and displaying video according to
The video transmission device includes:
A connection control unit for controlling establishment of a connection between the video transmission device and the head-mounted display device ,
A first connection for connecting the video transmission device and the head-mounted display device in accordance with the video wireless transmission standard;
A connection control unit for controlling the establishment of the second connection for peer-to-peer connection between the video transmission device and the head-mounted display device prior to the establishment of the first connection;
The connection control unit starts processing for establishing the second connection in response to acquisition of a request from the head-mounted display device ,
The head-mounted display device transmits connection identification information indicating that it is a connection target in accordance with the video wireless transmission standard to the video transmission device when establishing the second connection,
The connection control unit establishes the first connection when the connection identification information matches the connection identification information stored in the video transmission device;
The connection identification information is unique information provided by the video transmission device,
The head-mounted display device is
A unique information acquisition device for acquiring the specific information;
Before the start of the process of establishing the second connection, when the video transmission device is displayed on the head-mounted display device by the unique information acquisition device, it is displayed over the video transmission device. Obtaining the specific information
A video display system that transmits the acquired unique information as the connection identification information to the video transmission device after the establishment of the second connection . The video display system according to claim 1 ,
The acquisition of the unique information is
The unique information acquisition device reads information of a QR code provided in the video transmission device;
The specific information acquisition device reads information of a specific display pattern provided in the video transmission device;
The unique information acquisition device reads information of an RF tag provided in the video transmission device;
The unique information acquisition device reads information representing a specific light emission pattern emitted by a light emitting unit provided in the video transmission device;
A video display system that is executed by any one of the above. Video wireless transmission standard for transmitting video by direct one-to-one wireless communication from a video transmission device that does not have a display unit and an operation unit for realizing a user interface to a head-mounted display device A video display system for transmitting and displaying video according to
The video transmission device includes:
A connection control unit for controlling establishment of a connection between the video transmission device and the head-mounted display device ,
A first connection for connecting the video transmission device and the head-mounted display device in accordance with the video wireless transmission standard;
A connection control unit for controlling the establishment of the second connection for peer-to-peer connection between the video transmission device and the head-mounted display device prior to the establishment of the first connection;
The head-mounted display device is
A unique information acquisition device for acquiring unique information provided by the video transmission device displayed on the video transmission device when the video transmission device is displayed on the head-mounted display device; ,
The connection control unit,
Requesting the head-mounted display device to transmit the unique information;
Receiving the unique information transmitted from the head-mounted display device as an opportunity in the head-mounted display device, and starting the process of establishing the second connection,
A video display system that establishes the first connection when the unique information transmitted from the head-mounted display device matches information stored in the video transmission device . The video display system according to claim 3 ,
The acquisition of the unique information is
The unique information acquisition device reads information of a QR code provided in the video transmission device;
The specific information acquisition device reads information of a specific display pattern provided in the video transmission device;
The unique information acquisition device reads information of an RF tag provided in the video transmission device;
The unique information acquisition device reads information representing a specific light emission pattern emitted by a light emitting unit provided in the video transmission device;
A video display system that is executed by any one of the above. A head-mounted display device ,
A unique information acquisition device for acquiring the unique information provided by the video transmission device;
A reception-side connection control unit that controls establishment of a connection between the video transmission device and the head-mounted display device, wherein the video transmission device and the head-mounted display device are directly connected in a one-to-one relationship. First connection for connecting video according to a video wireless transmission standard for transmitting video by typical wireless communication, and peer-to-peer connection between the video transmission device and the head-mounted display device prior to establishment of the first connection A second connection to receive, a receiving side connection control unit for controlling establishment of the connection,
With
The receiving side connection control unit
Before the start of the process of establishing the second connection, when the video transmission device is displayed on the head-mounted display device by the unique information acquisition device , it is displayed over the video transmission device. the specific information to get that,
After the establishment of the second connection, the obtained said specific information, head-mounted, characterized by transmitting to the video transmitter apparatus as connection identification information indicating that the a connection object in accordance with the wireless video transmission standard Type display device . Video wireless transmission standard for transmitting video by direct one-to-one wireless communication from a video transmission device that does not have a display unit and an operation unit for realizing a user interface to a head-mounted display device In a video display system that transmits and displays video according to the above, a method of connection according to the video wireless transmission standard between the video transmission device and the head-mounted display device ,
(A) the video transmitting device connecting the video transmitting device and the head-mounted display device according to the video wireless transmission standard to establish a first connection;
(B) the video transmission device establishes a second connection by peer-to-peer connection between the video transmission device and the head-mounted display device prior to establishment of the first connection;
With
The step (b) is started in response to acquisition of a request from the head-mounted display device ,
In the step (a), connection identification information transmitted from the head-mounted display device at the time of establishing the second connection and indicating that the connection target is in accordance with the video wireless transmission standard is It is executed when matching with the connection identification information stored in the video transmission device,
The connection identification information is unique information provided by the video transmission device.
The unique information is displayed over the video transmission device when the video transmission device is displayed on the head-mounted display device in a see-through manner before the start of the process of establishing the second connection. Acquired after the second connection is established and transmitted to the video transmission device as the connection identification information.
A connection method characterized by that. Video wireless transmission standard for transmitting video by direct one-to-one wireless communication from a video transmission device that does not have a display unit and an operation unit for realizing a user interface to a head-mounted display device In a video display system that transmits and displays video according to the above, a method of connection according to the video wireless transmission standard between the video transmission device and the head-mounted display device ,
(A) the video transmitting device connecting the video transmitting device and the head-mounted display device according to the video wireless transmission standard to establish a first connection;
(B) the video transmission device establishes a second connection by peer-to-peer connection between the video transmission device and the head-mounted display device prior to establishment of the first connection;
(C) The head-mounted display device is provided by the video transmission device displayed on the video transmission device when the video transmission device is see-through displayed on the head-mounted display device. A process of obtaining information;
With
The step (b)
Requesting the head-mounted display device to transmit the unique information;
With the reception of the unique information transmitted from the head-mounted display device as an opportunity, the process of establishing the second connection is started,
The step (a)
Establishing the first connection when the unique information transmitted from the head-mounted display device matches information stored in the video transmission device;
A connection method characterized by that. Video wireless transmission standard for transmitting video by direct one-to-one wireless communication from a video transmission device that does not have a display unit and an operation unit for realizing a user interface to a head-mounted display device In a video display system that transmits and displays video according to the computer program for connecting the video transmission device and the head-mounted display device according to the video wireless transmission standard,
A function of establishing a first connection by connecting the video transmission device and the head-mounted display device according to the video wireless transmission standard;
A function of establishing a second connection by peer-to-peer connection between the video transmission device and the head-mounted display device prior to establishment of the first connection;
Is a computer program for realizing the above on a computer,
The function of establishing the second connection is started in response to acquisition of a request from the head-mounted display device ,
The function of establishing the first connection is a connection identification that is transmitted from the head-mounted display device at the time of establishing the second connection and indicates that the connection target is in accordance with the video wireless transmission standard. Executed when the information matches the connection identification information stored in the video transmission device;
The connection identification information is unique information provided by the video transmission device.
The unique information is displayed over the video transmission device when the video transmission device is displayed on the head-mounted display device in a see-through manner before the start of the process of establishing the second connection. Acquired after the second connection is established and transmitted to the video transmission device as the connection identification information.
A computer program characterized by that. Video wireless transmission standard for transmitting video by direct one-to-one wireless communication from a video transmission device that does not have a display unit and an operation unit for realizing a user interface to a head-mounted display device In a video display system that transmits and displays video according to the computer program for connecting the video transmission device and the head-mounted display device according to the video wireless transmission standard,
A function of establishing a first connection by connecting the video transmission device and the head-mounted display device according to the video wireless transmission standard;
A function of establishing a second connection by peer-to-peer connection between the video transmission device and the head-mounted display device prior to establishment of the first connection;
The head-mounted display device acquires unique information provided by the video transmission device displayed on the video transmission device when the video transmission device is displayed on the head-mounted display device. Function to
Is a computer program for realizing the above on a computer,
The function of establishing the second connection is :
Requesting the head-mounted display device to transmit the unique information;
With the reception of the unique information transmitted from the head-mounted display device as an opportunity, the process of establishing the second connection is started,
The function of each picture of the first connection is as follows:
Establishing the first connection when the unique information transmitted from the head-mounted display device matches information stored in the video transmission device;
A computer program characterized by that.

Images