WO2019168363A1 - Method for providing virtual reality cinema service and apparatus therefor - Google Patents

Abstract

Proposed are a method and apparatus for providing at least two social network service (SNS) users with a virtual reality (VR) cinema service in a virtual space in a VR cinema system. To this end, a first user device of a first SNS user sends an invitation message to a second user device of a second SNS user who is to watch a movie together through a network, and when the second user device accepts the invitation message, a virtual space screen of the first user device is displayed in the first user device and the second user device in a state where a control function, which enables the first user device and the second user device to pause or play a movie, is synchronized. The virtual space screen provides a virtual screen for showing a movie as a part of a VR image.

Description

Method for providing virtual reality cinema service and apparatus therefor

The present invention relates to a virtual reality (VR) cinema service, and more particularly, to a method for providing a synchronized VR cinema service to at least two social network service (SNS) users in a virtual reality (VR) cinema system. It relates to a device for.

Recently, virtual reality using a head mount display (HMD) has been applied in various fields such as the game, medical, education, and film industries. The HMD is a display device that the user wears on the head. Since the display and the magnification lens are mounted inside the HMD, the user can experience a huge screen when the user wears the HMD. HMD can thus overcome the space constraints required to install large screens.

According to the virtual reality experience method using the HMD, the light / sound of the outside of the HMD device is shielded, and thus, the immersive feeling is higher than that of the conventional 3D video viewing method. On the other hand, due to the shielding of the HMD device, it is difficult to interact in real time between users wearing the HMD, it is difficult to share the virtual reality experience with others.

An object of the present invention is to provide a VR cinema service in which a control function such as pause or reproduction of a movie is synchronized to a plurality of users based on a social network system (SNS).

In addition, a technique for making a user's operation such as playing / stopping an image of a user wearing the HMD more convenient is proposed.

In addition, we propose a technology that allows users to more conveniently use online experiences that are more similar to real theater visits and difficult experiences in real theaters.

The technical problem to be solved by the present invention is not limited thereto, and other technical problems may be inferred from the embodiments.

A method for providing a VR cinema service to at least two social network service (SNS) users in a virtual reality (VR) cinema system according to an aspect of the present invention for achieving the above object, the first user of the first SNS user The device sends an invitation message to the second user device of the second SNS user who will watch the movie together via the network, and upon receiving the invitation message from the second user device, displays the virtual space screen of the first user device. And displaying the first user device and the second user device on the first user device and the second user device in a state where a control function including pausing or playing a movie is synchronized between the first user device and the second user device. Provides a virtual screen displaying the movie as part of the VR image.

The control function may be controlled by the first user device with host authority, and the control function may be activated by agreement by the second user device.

The control function may be controlled by the second user device with host authority according to a request of the first user device. In this case, the second user device may activate the control function with the consent of another user device (which may exclude the first user device).

The control function may be controlled by the second user device with host authority according to a network connection state of the first user device or when there is no response from the first user device for more than a predetermined time. For example, when an error occurs in the first user device or a network connection failure occurs, the system may transfer the host authority to the second user device. In addition, when there is no response for a predetermined time such as going out after the first user device presses the pause, the system may transfer the host authority to the second user device.

Meanwhile, the second user device may include a plurality of user devices, and any one of the plurality of user devices may host the control function in response to a request from a user device having a predetermined ratio or more among the plurality of user devices. It can also be set to go and control permissions.

The virtual space screen may include a virtual control panel for inputting the control function, and the pause and playback function on the virtual control panel may be performed by the first SNS user according to a means that the first SNS user can operate by hand. The pointer moving within the position may be selected by placing the pause function icon or the play function icon on the virtual control panel.

The first user device may display an SNS user list to which the invitation message is sent to the first SNS user, and the SNS user list may include the first user device in consideration of whether each SNS user is online or is watching a movie. May be displayed. For example, the SNS user list may directly display whether or not each SNS user is connected online and while watching a movie as a user list, and may display whether or not an invite or a chat is possible in consideration of such a state.

The invitation message may include information on a VR cinema and a movie selected by the first SNS user.

The information on the VR cinema may include information to which the first SNS user applies the VR cinema theme.

In addition, the movie may include a broadcast image of the broadcast medium and an internet video (e.g. YouTube image).

Meanwhile, in another aspect of the present invention, in a first user device of a first SNS user who provides a virtual reality (VR) cinema service to at least two social network service (SNS) users, a movie may be watched together through a network. A network connection unit for sending an invitation message to a second user device of a second SNS user and receiving an acceptance signal for the invitation message from the second user device; And the first user device and the second user device displaying a virtual space screen of the first user device in a state where a control function including pausing or playing a movie is synchronized between the first user device and the second user device according to the reception of an acceptance signal of the network connection unit. And a display unit for displaying, wherein the virtual space screen provides a virtual screen displaying a movie as part of a VR image.

The network connection unit and the display unit may configure the first user device as a combination of independent devices.

The network connection unit may be included in a mobile phone, and the display unit may be included in a head mount display (HMD) to configure the first user device.

In addition, the network connection unit and the display unit may configure the first user device as an integrated device.

The virtual space screen may include a virtual control panel for inputting the control function, and the first user device may include a pointer for moving the pointer within the virtual space screen by the first SNS user by hand. The remote controller may further include a remote controller configured to be positioned at the pause function icon or the play function icon on the control panel of the control panel.

According to an embodiment of the present invention, since the connection to the VR cinema system, the movie playback control, etc. are synchronized through the SNS, it is possible to solve the problem of isolation and disconnection of the user due to wearing the HMD device.

In addition, according to an embodiment of the present invention, by enabling the corresponding function to be activated by the consent of the guest users with respect to the control operation of the user having the host authority, it is possible to prevent inconvenience of the guest user due to malfunction or absence of the host.

In addition, according to an embodiment of the present invention, a user wearing a display such as an HMD can easily control movie screening through a control panel including a control function such as play / stop of a movie.

In addition, in one preferred embodiment, users may select their own splendid theater that is virtually difficult to implement, watch a movie in an ideally seated position and provide a virtual theater experience that is superior to that in a real theater.

The technical effects of the present invention are not limited thereto, and other technical effects may be inferred from the embodiments.

1 illustrates a VR cinema system according to an embodiment of the present invention.

2 and 3 are diagrams for explaining a mechanism for transmitting an invitation message by an SNS user according to an embodiment of the present invention.

4 is a view for explaining the configuration of a virtual space screen displayed on each user device in a preferred embodiment of the present invention.

5 and 6 are flowcharts illustrating a method of providing a VR cinema service in which a control function is synchronized to at least two SNS users in a VR cinema system according to an embodiment of the present invention.

7 is a view for explaining an example of configuring a VR cinema theme according to an embodiment of the present invention.

8 is a diagram illustrating a virtual space screen according to an embodiment of the present invention.

9 is a conceptual diagram of a user device for providing a VR cinema service according to an embodiment of the present invention.

10 is a diagram illustrating a structure of a specific user device according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. The detailed description, which will be given below with reference to the accompanying drawings, is intended to explain exemplary embodiments of the present invention and is not intended to represent the only embodiments in which the present invention may be practiced.

The following detailed description includes specific details in order to provide a thorough understanding of the present invention. However, one of ordinary skill in the art appreciates that the present invention may be practiced without these specific details. In some cases, well-known structures and devices may be omitted in order to avoid obscuring the concepts of the present invention.

1 illustrates a VR cinema system using SNS according to an embodiment of the present invention.

Referring to FIG. 1, the VR cinema system 10 includes a VR cinema server 105, a content server 110. 125, an SNS server 130, a playback device 115a and 115b and a user device 120a, 120b and 120c. ) May be included.

In more detail, the content server may include a storage server 110 storing its own VR content and a content provider server 125 using content of an external content provider. For example, the VR cinema system of the present embodiment may be provided with VR content directly from an external content provider server 125 such as Netflix.

Meanwhile, although the playback devices 115a and 115b and the HMD devices 120a and 120b are separated from each other in FIG. 1 as a user device, this is only an example, and the playback devices 115a and 115b are embedded in the HMD devices 120a and 120b. (Ie, Player embedded HMD), or a variety of other ways to operate as a user device.

As an example of the Player embedded HMD, the HMD devices 120a and 120b may include their own operating systems (e.g., Android OS, etc.) and audio / video playback software / hardware. In this case, the HMD devices 120a and 120b may directly receive and play VR cinema content online through the VR cinema server 105. In addition, the HMD devices 120a and 120b may be connected to an external storage device such as USB to play VR cinema content through offline.

In the following example, it is assumed that there are a total of three users (User A, B, and C), but this is for convenience of description and the number of users may be variously changed. Assume that one of the three users is designated as the host and the other two users are designated as guests. The host user has full control over the VR cinema system 10. The host user can invite other users to the guest via the network (e.g., VR cinema server). Details of the host and the guest will be described later.

Each user can access the VR cinema server 105 via the playback devices 115a and 115b. The playback devices 115a and 115b may be connected to the VR cinema server 105 via a wired / wireless network. The playback devices 115a and 115b may be, for example, playback devices dedicated to a PC, a mobile phone / smart phone, or a VR cinema, but are not limited thereto.

The playback devices 115a and 115b may render other users' audio signals and / or video images / audio signals of the VR cinema received from the VR cinema server 105 and output them to the HMD devices 120a, 120b and 120c. . The playback device may be connected to at least one HMD device by wire / wireless. For example, it is assumed that the playback device 115a is connected to one HMD device 120a and the playback device 115b is connected to two HMD devices 120b and 120c.

The HMD devices 120a, 120b, and 120c may include sensors (eg, 9-axis sensors, acceleration sensors, gyroscope sensors, geomagnetic sensors, etc.) for detecting a user's movement. For example, the HMD devices 120a, 120b, and 120c may change the viewpoint and the field of view of an image displayed along the line of sight of the user by detecting the movement and rotation of the user's head.

The VR cinema server 105 may be connected to the SNS server 130 as shown in FIG. 1 to provide an SNS service. The VR cinema server 105 may create, maintain / manage each user's individual SNS account. Each SNS account may be provided with a user's own web page that can upload or link content such as video, text, voice and / or URL. In addition, the user can search / add another user's SNS account as a friend. The VR cinema server 105 provides a messaging function to users registered as friends so that users can exchange voice, video and / or text.

The VR cinema server 105 may provide a VR cinema service. The VR cinema server 105 may receive movie content from the content servers 110 and 125. Although the VR cinema server 105 and the content servers 110 and 125 are illustrated as separate entities in FIG. 1, the present invention is not limited thereto, and the storage server 110 among the VR cinema server 105 and the content server 110 may be described. May be implemented as one server. In addition, the description will be given on the assumption that the content server 110 provides movie contents for convenience of description, but the present invention is not limited thereto, and as described above, a broadcast medium, a YouTube, and / or Internet videos may be provided. That is, the user may watch a broadcast medium, YouTube, and / or internet video through a VR cinema service.

In the example of FIG. 1, the first user devices 120a and 115a of the first SNS user A to start the VR cinema service are connected to the second SNS users B and C who will watch a movie together via the network. The invitation message may be sent to the second user device 120b, 120c, or 115b. An invitation message transmission procedure of the first user device will be described in detail with reference to FIGS. 2 and 3 below.

2 and 3 are diagrams for explaining a mechanism for transmitting an invitation message by an SNS user according to an embodiment of the present invention.

The SNS pages shown in FIGS. 2 and 3 are exemplary and the present invention is not limited thereto. For convenience, it is assumed that user A accesses his SNS account and selects the currently owned VR cinema 201.

As illustrated in FIG. 2, user A's user device may display an SNS user list (eg, BuddyList) to which an invitation message is sent. FIG. 2 illustrates an example in which users B to Z registered as SNS friends of user A are displayed.

The SNS user list according to an embodiment of the present invention may indicate whether each SNS user is online connected 203 and whether to watch a movie 204. That is, in general SNS, the user of the friend list only informs whether or not the user is online. The SNS user list according to the present embodiment may indicate whether each user is watching a different movie. Based on this, the SNS user A may select a user who will watch a movie together and transmit an invitation message.

In the example of FIG. 2, the user list directly indicates whether each user is online and whether to watch a movie. However, the present invention is not limited thereto. As shown in FIG. In consideration of whether or not to view the movie, it may be set to indicate whether it is possible to invite 205 or whether to chat 206.

On the other hand, in an embodiment of the present invention, when receiving the acceptance message for the above-mentioned invitation message from the other party, such as user B, C, the user watching the movie along with the user B, C, etc. virtual space screen of the user device of the user A It is proposed that a control function including pause or playback of the user device and the movie of is set to display on the connected user device in a synchronized state.

4 is a view for explaining the configuration of a virtual space screen displayed on each user device in a preferred embodiment of the present invention.

4 illustrates an example in which the virtual space screen 50 is displayed through the HMD, but is not limited thereto. In the present embodiment, the virtual space screen 50 is characterized by providing a virtual screen 52 for displaying a movie as part of a VR image. That is, the virtual space screen 50 may have a form in which the display of the virtual screen 52 and the configuration of the virtual theater (for example, the seat 53, etc.) is displayed differently as the user's gaze direction moves. .

Meanwhile, as described above, the virtual space screen according to the present embodiment is preferably displayed in a state where two or more user devices connected by SNS are synchronized with a control function including pausing or playing a movie. Here, the 'synchronized state' does not mean that images displayed on two or more user devices display exactly the same image in the time domain, but a state in which a control function including pausing or playing of a movie is equally applied. it means. Accordingly, there may be a case where there is a time difference in a movie image displayed between users connected by SNS according to a network state, and the movement of the gaze of a specific user does not need to be reflected in the display image of another user's user device.

Meanwhile, in the example of FIGS. 1 to 3, the control function of the above-described movie is controlled by user A with host authority, but is activated according to agreement by another user device. For example, if user A is a host and invites several users to watch a movie and then user A randomly activates the pause of the movie and goes out, it may cause inconvenience to other users watching the movie. When providing a movie screening event between a plurality of SNS users who do not know each other, the above problem may be more serious.

Therefore, in the preferred embodiment of the present invention, the user A's movie pause or play function is controlled by the user A as a host, but preferably has a form of activating each function according to the consent of other users.

On the other hand, in a situation where the user A having the first host authority needs to leave the office for another purpose, a procedure of transferring the host authority to another user (eg, user B) may be performed. In this case, user B can also activate the control function according to the consent of other users, but in some cases, the user B can perform a procedure for obtaining the consent except for user A, which was an existing host. 4 shows a virtual space screen 50 including a virtual control panel 501 for inputting a control function. The virtual control panel 501 may be displayed at a position not overlapping with the virtual screen 52 as shown in FIG. 3, or may be activated / deactivated according to a user's pointer manipulation.

In the example of FIG. 4, the virtual control panel 501 exemplarily shows a function icon 508 such as pause, stop, playback, and the like. In some cases, operations such as fast forwarding and rewinding may be omitted.

In this relationship, the pause and playback function on the virtual control panel 501 moves a pointer on the virtual control panel 501 on the virtual control panel 501 according to a means that an SNS user can manipulate by hand. It can be selected by placing it on the pause function icon or the play function icon.

5 is a flowchart illustrating a method of providing a VR cinema service in which a control function is synchronized to at least two SNS users in a VR cinema system according to an embodiment of the present invention.

First, a first user device of a first SNS user may send an invitation message to a second user device of a second SNS user who will watch a movie together via a network (1305). Here, the first user device may be the playback device / HMD of user A in the example of FIG. 1, and the second user device may be the playback device / HMD of user B and / or C.

Accordingly, the first user device may receive an accept message from the second user device (1310), and accordingly, the first user device may watch a movie with host authority (1315).

According to an embodiment of the present invention, the first user device and the second user device are synchronized with a control function including pausing or playing of a movie on the virtual space screen of the first user device. It is preferable to display on the second user equipment.

Here, the synchronization of the control function means that when the first user device requests the activation of a control function such as a pause as shown in FIG. 4 (S1320), only when the second user device watching the movie agrees with it. It refers to a form in which the control functions are activated together with the user devices connected to each other, such as operation 1325 to activate the pause function for both the first user device and the second user device. If the second user device rejects the control operation requested by the first user device, the first user device may continue to watch the movie while maintaining the host authority (1315).

However, in certain cases, such as when a user having a host authority needs to go out due to a special situation, a procedure for transferring host authority to another user who watches a movie together may be necessary.

6 is a diagram illustrating a procedure of transferring host authority to another user according to an embodiment of the present invention.

First, in the present embodiment, it is assumed that a plurality of user devices are watching a movie while connected via SNS. It is assumed that a first user device of such a plurality of user devices watches a movie with host authority (1405).

As described above, in a specific situation such as a situation in which the SNS user of the first user device needs to go out, the host authority may be requested to be transferred to the second user device of the plurality of user devices (1410). At the same time, the SNS user of the first user device may exit, but need not be limited thereto. The second user device that has transferred host authority from the first user device may have a specific control function such as a pause as described above. Activation may be requested to another user device (1415). In the state where the first user device leaves the request for activation of the control function, the corresponding control function may be activated according to agreement from the remaining user devices except for the first user device (1420). In addition, in certain cases, even if the first user device has not exited, the consent of the first user device may be omitted for the request for activating the control function of the second user device.

If the other user device disagrees with the request of the second user device, the second user device may continue watching the movie while maintaining host authority (1425).

In the example of FIG. 5, the host authority is transferred to the second user device according to the request of the first user device. For example, the transfer of the host authority may be performed by the first user device as well as the first user device. If the network connection has a problem for a predetermined time due to an error in the device or the like, the system may be configured to automatically transfer the host authority to the second user device.

In addition, the host authority may be set to be transferred when there is a request from a guest user of a predetermined level or more in preparation for a long delay after activating the temporary user.

7 is a view for explaining an example of configuring a VR cinema theme according to an embodiment of the present invention.

In the example of FIG. 7, an example in which the first user device selects Cinema A in the form of a car theater, Cinema B in the form of a large screen, or Cinema C in the form of a concert hall is illustrated. In addition, the user may decorate his own VR cinema theme, and may have a form of inviting SNS friends to the VR cinema. In other words, the user can decorate his or her virtual theater theme and interior through My Theater Decorating Function, or visit a friend's theater by riding a cart in the virtual theater lobby.

8 is a diagram illustrating a virtual space screen according to an embodiment of the present invention.

In the example of FIG. 8, the SNS user may enter a virtual theater space located in a virtual subsea space by riding a cart in a virtual space as shown in (A). These subsea spaces may be their own virtual theaters or SNS friends' virtual theaters.

In the virtual theater space, as shown in (B), a selectable movie image or the like can be displayed through the virtual screen, and a specific movie can be selected in a form similar to the above-described operation of the control function or in another manner.

Next, a device configuration for providing a service as described above in another aspect of the present invention will be described.

9 is a conceptual diagram of a user device for providing a VR cinema service according to an embodiment of the present invention.

The user device according to the present embodiment operates as a first user device 800 of a first SNS user that provides a VR cinema service to at least two SNS users. The user device 800 for this purpose sends an invitation message to a second user device of a second SNS user who will watch a movie together via a network, and a network connection unit for receiving an acceptance signal for the invitation message from the second user device. 810 and the first user, in response to receiving a signal of acceptance from the network connection unit 810, in a state in which the first user device and the second user device are synchronized with a control function including pausing or playing a movie. It is proposed to include a display unit 820 for displaying a virtual space screen of the device.

The network connection unit 810 and the display unit 820 may configure the first user device as a combination of independent devices. For example, the network connection unit 810 may be included in a mobile phone such as a smart phone, and the display unit 820 may be included in an HMD to configure the first user device.

The network connection unit 810 and the display unit 820 may configure the first user device as an integrated device.

10 is a diagram illustrating a structure of a specific user device according to an embodiment of the present invention.

10 shows that such a device takes the form of an integrated headset device 60. The integrated headset device 60 of FIG. 10 may include an adjustable headband 601, a body 602, a cover 604, and a remote controller 603. The remote controller 603 is connected to the body 602 via a cable, which can be separated from the body 602 and / or the remote controller 603.

In the above description, the manipulation of the virtual control panel 501 of the user may be performed by the remote controller 603 of FIG. 9.

In this integrated headset device 50, the network connection 810 may be included in the remote controller 603 or the body 602. In addition, the display unit 820 may be included in the body 602.

The detailed description of the preferred embodiments of the invention disclosed as described above is provided to enable any person skilled in the art to make and practice the invention. Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art will understand that the present invention can be variously modified and changed from the above description.

Claims (15)

1. A method for providing a VR cinema service in a virtual space to at least two social network service (SNS) users in a virtual reality (VR) cinema system,

   The first user device of the first SNS user sends an invitation message to the second user device of the second SNS user who will watch the movie together over the network,

   In response to the acceptance of the invitation message from the second user device, a control function of synchronizing a virtual space screen of the first user device with the first user device and the second user device includes pausing or playing a movie. Including displaying on the first user device and the second user device in a connected state.

   And the virtual space screen provides a virtual screen for displaying a movie as part of a VR image.
2. The method of claim 1,

   The control function is controlled by the first user device with host authority,

   And the control function is activated in accordance with the agreement by the second user device.
3. The method of claim 1,

   And the control function is controlled by the second user device with host authority in response to a request of the first user device.
4. The method of claim 1,

   And the control function is controlled by the second user device with host authority according to a network connection state of the first user device or when there is no response from the first user device for more than a predetermined time.
5. The method of claim 1,

   The second user device includes a plurality of user devices,

   The VR cinema service providing method, wherein any one of the plurality of user devices goes and controls the host authority of the control function in response to a request from a user device having a predetermined ratio or more among the plurality of user devices.
6. The method of claim 2,

   The virtual space screen includes a virtual control panel for inputting the control function,

   The pause and play function on the virtual control panel may include a pointer moving within the virtual space screen according to a means that the first SNS user can manipulate by hand to a pause function icon or a play function icon on the virtual control panel. VR cinema service providing method, selected by location.
7. The method of claim 1,

   The first user device displays an SNS user list to which the invitation message is sent to the first SNS user;

   The SNS user list is displayed on the first user device in consideration of whether each SNS user is connected online and while watching a movie.
8. The method of claim 1,

   The invitation message,

   The VR cinema service providing method comprising information on the VR cinema and movie selected by the first SNS user.
9. The method of claim 8,

   The information on the VR cinema includes information on which the first SNS user applies the VR cinema theme.
10. The method of claim 1,

    The movie includes a broadcast image of the broadcast medium and the Internet video, VR cinema service providing method.
11. A first user device of a first SNS user that provides a virtual reality (VR) cinema service to at least two social network service (SNS) users,

    A network connection unit for sending an invitation message to a second user device of a second SNS user who will watch a movie together through a network, and receiving an acceptance signal for the invitation message from the second user device; And

    In response to receiving the acceptance signal of the network connection unit, the first user device and the second user device display a virtual space screen of the first user device while the control function including pausing or playing a movie is synchronized. It includes a display unit to

    The virtual space screen provides a virtual screen displaying a movie as part of a VR image.
12. The method of claim 11,

    And the network connection unit and the display unit configure the first user device as a combination of independent devices.
13. The method of claim 11,

    The network connection is included in the mobile phone,

    The display unit is included in a head mount display (HMD) to configure the first user device.
14. The method of claim 11,

    And the network connection unit and the display unit constitute the first user device as an integrated device.
15. The method of claim 11,

    The virtual space screen includes a virtual control panel for inputting the control function,

    The first user device,

    And a remote controller configured to position a pointer moving by the first SNS user by hand in the virtual space screen on a pause function icon or a play function icon on the virtual control panel.

Images