KR20200056893A - Media server that control hmd wirelessly and hmd control method using it - Google Patents

Abstract

The present invention relates to a media server wirelessly controlling a head mounted display (HMD) and an HMD control method using the same. Specifically, the media server checks synchronization when the plurality of HMDs receive setting value data to transmit a control command to each HMD when the synchronization is completed, checks whether content of each HMD is played at the same speed by receiving content frame information of each HMD to play the content of each HMD at the same speed, and pauses the corresponding HMD when the HMD receives pause request data to transfer an alarm signal.

Description

Media server for wirelessly controlling HMD and HMD control method using the same {MEDIA SERVER THAT CONTROL HMD WIRELESSLY AND HMD CONTROL METHOD USING IT}

The present invention relates to a media server for wirelessly controlling an HMD and an HMD control method using the same, and in particular, when a media server receives set value data from a plurality of head mounted displays (HMDs), checks whether it is synchronized, and when synchronization is completed, a control command Is transmitted to each HMD, and the content frame information of each HMD is received to check whether the content of each HMD is played at the same speed to be played at the same speed, and when the pause request data is received from the HMD, the corresponding HMD is transmitted. The present invention relates to a media server for wirelessly controlling an HMD and a HMD control method using the same, which temporarily stops and transmits an alarm signal.

The HMD is a display device worn on the head, and is a portable device that allows a user to enlarge and view various scenes such as virtual reality and augmented reality through a small display placed in front of his eyes.

The representative field where the HMD concept was used in earnest was military equipment. For fighter pilots, it is a device where various flight information is projected to the pilot's field of view through the HMD attached to the helmet. Infantry equipment that adds various functions, including night vision, to the HMD is also being put into practical use.

The game where HMD for the general user was commercialized was game. 'Virtual Boy', released by Nintendo in 1995, was able to realize stereoscopic images through red LEDs, but users were limited due to the monotonous color and weight of over 2kg. Since the development of wireless communication technology with display devices, various HMD models began to be developed.

Google Glass, released by Google, is equipped with a prism that acts as a monitor on one side of the eyeglass frame. Google Glass, which corresponds to the HMD for augmented reality, introduced a prototype in 2012, and since 2013, a prototype has been sold for developers. Infringement of privacy has been pointed out as a problem because of the camera function that follows the gaze.

Oculus VR's Oculus Rift and Sony's Morpheus, which were announced in 2015, the first year of full-scale virtual reality, include a function that reflects the user's movement on the screen through a motion sensor. Showed excellent utilization. Gear VR of Samsung Electronics, which was commercialized in 2015, was developed in partnership with Oculus and increased convenience with high resolution and wireless function. Meanwhile, Microsoft's Holo Lens is an HMD product using augmented reality. Users can do information search, image editing, 3D design, etc. based on the graphic that floats on the real thing.

The advantage of HMD is that the user's privacy is guaranteed. The advantages of being able to do your own computing activities without causing inconvenience to others, and being able to see the effects of a large screen on a small screen, are also good. It is also an important feature that it can enhance the immersion feeling with the high-level 3D effect centered on the user's field of view. Despite these advantages, there is also concern that if you are too immersed in HMD, it will be used as a way to escape.

Korean Patent Publication No. 2017-0058671 discloses a separate controlled video system in which a mobile terminal and an HMD device are independently separated, and a method of operating the same. In the separated control type imaging system and its operation method, the HMD device senses a spatial recognition value through a spatial sensor, transmits an image control value calculated based on the spatial recognition value to the mobile terminal, and the mobile terminal transmits the image control value to the mobile terminal. It is characterized in that the corresponding control image is extracted from the original image and the control image is transmitted to the HMD device.

Such a conventional HMD control system has an advantage in that the overall weight of the HMD device is reduced by reducing the overall weight of the HMD device by monitoring and controlling the space state through the space sensor installed in the HMD device. The configuration to analyze and control is complicated, and there is a problem that only one mobile terminal controls one HMD.

Therefore, the present invention was made in view of the above points, and the object of the present invention is to have a simple hardware configuration and to wirelessly control a single server for a plurality of HMDs, a media server that wirelessly controls the HMD and an HMD using the same. It is to provide a control method.

In order to achieve the above object, a media server that wirelessly controls an HMD according to an embodiment of the present invention includes a data receiving unit for receiving setting value data for synchronization from the HMD; A synchronization unit for synchronizing with the HMD when synchronization is possible by analyzing whether the set value data is analyzed and whether synchronization is possible including a data collision or a malfunction; A control command transmitter for transmitting a control command to the HMD; And a content synchronization unit of the HMD that receives the content frame information of the HMD from each of the HMDs, checks whether the content is played at the same speed, and adjusts the playback speed of each of the HMDs equally.

The media server for wirelessly controlling the HMD according to the above embodiment includes: a confirmation request for receiving the temporary request data of the HMD to determine whether to receive the temporary request data from the HMD; And a pause and an alarm signal generator that pauses the corresponding HMD and transmits an alarm signal to the HMD per row when receiving the pause request data from the HMD.

In the media server that wirelessly controls the HMD according to the above embodiment, the setting value data may include IP address, port, sensor speed, and charging status information.

In the media server that wirelessly controls the HMD according to the above embodiment, the control command may include a play, stop, pause and charge request.

To achieve the above object, an HMD control method according to another embodiment of the present invention includes: (a) a media server receiving setting value data for synchronization from an HMD; (b) synchronizing with the HMD when the media server analyzes the set value data and checks whether there is a data collision or not including a possibility of malfunction, and if it is possible to synchronize; (c) the media server transmitting a control command to the HMD; And (d) the media server receiving the content frame information of the HMD from each of the HMDs to check whether the content is played at the same speed and adjusting the playback speed of each of the HMDs equally.

The HMD control method according to the other embodiment may include determining whether the media server receives temporary request data from the HMD; And when the media server determines that the temporary request data is received from the HMD, temporarily stopping the corresponding HMD and transmitting an alarm signal to the corresponding HMD.

According to the media server for wirelessly controlling the HMD according to the embodiments of the present invention and the HMD control method using the same, the media server receives setting value data for synchronization from the HMD and analyzes the setting value data to determine whether there is data collision Or check whether or not the synchronization including the possibility of malfunction is synchronized with the HMD when it is possible to synchronize, transmit a control command to the HMD, receive the content frame information of the HMD from each of the HMDs, and check whether the content is played at the same speed It is configured to adjust the reproduction speed of each of the HMDs equally, so it has a simple hardware configuration and has an excellent effect that wireless control is possible with a single server for a plurality of HMDs.

1 is an overall system configuration diagram including a media server that wirelessly controls an HMD according to an embodiment of the present invention.
FIG. 2 is a detailed configuration diagram of the media server of FIG. 1.
3 is a flowchart illustrating a HMD control method using a media server according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

1 is an overall system configuration diagram including a media server that wirelessly controls an HMD according to an embodiment of the present invention, and FIG. 2 is a detailed configuration diagram of the media server of FIG. 1.

The entire system including the media server for wirelessly controlling the HMD according to an embodiment of the present invention, as shown in Figures 1 and 2, the media server 100 connected to a plurality of HMD 200 through a wireless network It includes.

The media server 100, as shown in FIG. 1, the data receiving unit 110, the synchronization unit 120, the control command transmission unit 130, the content synchronization unit 140 of the HMD, the temporary request data of the HMD It includes a reception confirmation unit 150, and a pause and alarm signal generation unit 160.

The data receiving unit 110 serves to receive setting value data (that is, IP address, port, sensor speed, charging status information, etc.) for synchronization from a plurality of HMDs 200.

A client program is built in the HMD 200 to input setting value data including IP address, port, sensor speed, and charging status information.

The synchronization unit 120 serves to synchronize with the HMD 200 when it is possible to synchronize by analyzing whether the data has been collided or not by analyzing the set value data.

The control command transmission unit 130 serves to transmit a control command including a request to play, stop, pause, and charge to the HMD 200.

The content synchronization unit 140 of the HMD receives the content frame information of the HMD from each of the plurality of HMDs 200, checks whether the content is played at the same speed, and finds and controls the HMD 200 that is not played at the same speed. It plays a role of adjusting the reproduction speed of all HMDs 200 equally.

The HMD temporary request request data reception confirmation unit 150 serves to determine whether temporary request data is received from the HMD 200.

The pause and alarm signal generator 160 sends a control command to the corresponding HMD 200 when the temporary request data from the HMD 200 is determined (YES), and temporarily stops and sends an alarm signal to the corresponding HMD 200. It serves to convey.

Hereinafter, a radio control method of an HMD using a media server according to an embodiment of the present invention configured as described above will be described.

3 is a flowchart showing an HMD control method using a media server according to an embodiment of the present invention, where S denotes a step.

First, when the media server 100 receives setting value data for synchronization (including IP address, port, sensor speed, and charging status information) from the HMD 200 (S10), the media server 100 sets data By analyzing whether it is possible to synchronize or not, including data collision or malfunction, it is synchronized with the HMD 200 (S20).

Subsequently, the media server 100 transmits control commands (including play, stop, pause, and charge requests) to the HMD 200 (S30).

Thereafter, the media server 100 receives the content frame information of the HMD 200 from each of the HMD 200, checks whether the content is played at the same speed, and finds and controls the HMD 200 that is not played at the same speed. The reproduction speeds of all HMDs 200 are adjusted equally (S40). For this reason, it is possible to control a plurality of HMDs per media server (for example, 100 HMDs).

In step S50, it is determined whether or not the media server 100 receives temporary request data from the HMD 200.

If, in step S50, the media server 100 determines that the temporary request data is received from the HMD 200 (YES), the corresponding HMD 200 is temporarily suspended under the control of the media server 100. The alarm signal is transmitted to the corresponding HMD 200 (S60).

On the other hand, in step S50, if the media server 100 does not receive temporary request data from the HMD 200 (NO), the process ends.

On the other hand, in step S20, when the media server 100 analyzes the charging state information among the set value data and the charge amount of the HMD 200 becomes below the set value, the media server 100 charges the corresponding HMD 200 Send a request control command to notify the HMD charging.

According to a media server for wirelessly controlling an HMD according to an embodiment of the present invention and an HMD control method using the same, the media server receives setting value data for synchronization from the HMD and analyzes the setting value data to determine whether data collision occurs or Check whether or not the synchronization including the possibility of malfunction is synchronized, and if possible, synchronize with the HMD, transmit a control command to the HMD, receive content frame information of the HMD from each of the HMDs, and check whether the content is played at the same speed. It is configured to adjust the reproduction speed of each HMD equally, and thus has a simple hardware configuration, and it is possible to wirelessly control a plurality of HMDs with one server.

In the drawings and the specification, an optimal embodiment has been disclosed, and specific terms have been used, but this is only for the purpose of explaining an embodiment of the present invention and is used to limit the meaning or to limit the scope of the present invention described in the claims. It is not done. Therefore, those skilled in the art will appreciate that various modifications and other equivalent embodiments are possible. Therefore, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

100: media server
200: HMD

Claims (8)

A media server that wirelessly controls a plurality of HMDs,
A data receiving unit receiving setting value data for synchronization from the HMD;
A synchronization unit for synchronizing with the HMD when synchronization is possible by analyzing whether the set value data is analyzed and checking whether synchronization includes data collision or not or a malfunction;
A control command transmitter for transmitting a control command to the HMD; And
A content synchronization unit of the HMD that receives the content frame information of the HMD from each of the HMDs and checks whether the content is played at the same speed and adjusts the playback speed of each of the HMDs equally. . According to claim 1,
A confirmation unit for receiving temporary request data of the HMD to determine whether to receive temporary request data from the HMD; And
A media server for wirelessly controlling the HMD, further comprising: a pause and an alarm signal generating unit that pauses the corresponding HMD and transmits an alarm signal to the HMD per row when it is determined to receive the pause request data from the HMD. According to claim 1,
The set value data
A media server that wirelessly controls the HMD, including IP address, port, sensor speed and charging status information. According to claim 1,
The control command includes a play, stop, pause and charge request, the media server to control the HMD wirelessly. A HMD control method using a media server that wirelessly controls the HMD according to claim 1,
(a) the media server receiving setting value data for synchronization from the HMD;
(b) synchronizing with the HMD, if the media server is capable of synchronizing by analyzing the set value data and checking whether there is a data collision or not including a possibility of malfunction;
(c) the media server transmitting a control command to the HMD; And
(d) the media server receiving the content frame information of the HMD from each of the HMDs, checking whether the content is played at the same speed, and adjusting the playback speed of each of the HMDs equally. The method of claim 5,
Determining whether the media server receives temporary request data from the HMD; And
And when the media server determines that the temporary request data is received from the HMD, temporarily stopping the corresponding HMD and transmitting an alarm signal to the corresponding HMD. The method of claim 5,
The set value data
HMD control method including IP address, port, sensor speed and charging status information. The method of claim 5,
The control command is a HMD control method including a play, stop, pause and charge request.

Images