KR102278342B1 - System and method for editing virtual reality image and video - Google Patents

Abstract

The present invention relates to a virtual reality image editing system and a virtual reality image editing method using the same.
A virtual reality image editing system implemented as a web, comprising: a panoramic image acquisition unit for acquiring a panoramic image; a panoramic image conversion unit converting the panoramic image into a spherical virtual reality image; an image object insertion unit for inserting an image object into the virtual reality image; a playback content designation unit for designating playback content connected to the inserted image object; and a playback content setting unit for setting playback properties of the playback content. includes

Description

SYSTEM AND METHOD FOR EDITING VIRTUAL REALITY IMAGE AND VIDEO

The present invention relates to a virtual reality image editing system and a virtual reality image editing method.

As 360-degree VR cameras and production applications spread to the public, the demand for realizing and producing virtual reality images is increasing.

Based on such a virtual reality image, a producer can create a virtual space and share it with each other to produce a more realistic image of the space captured.

As a conventional service, a virtual reality image is produced and uploaded on Google Street View, Naver Street View, and various real estate sites and provided to users.

However, since these virtual reality images are produced by a separate dedicated application, uploaded, and shared, it is difficult to participate in production between users, and there is a cumbersome problem in that production and uploading are performed separately.

Accordingly, it is proposed to implement a virtual reality image editing platform on the Internet Web, so that users can more easily share and produce virtual reality images, and users can easily add content reproduced in virtual reality images.

An object of the present invention is to provide a virtual reality image editing system that allows users to more easily share and produce virtual reality images, and a virtual reality image editing method using the same.

A virtual reality image editing system according to an aspect of an embodiment of the present invention, a virtual reality image editing system implemented as a web, comprising: a panoramic image acquisition unit for acquiring a panoramic image; a panoramic image conversion unit converting the panoramic image into a spherical virtual reality image; an image object insertion unit for inserting an image object into the virtual reality image; a playback content designation unit for designating playback content connected to the inserted image object; and a playback content setting unit for setting playback properties of the playback content. includes

Also, the playback content setting unit may set a playback range of the playback content in the virtual reality image based on the inserted image object.

Also, the playback content setting unit may set a playback range of the playback content using a spherical coordinate system.

In addition, the playback range is a range in which the playback content is played and a user can recognize the playback of the playback content, and when the user's viewpoint is out of the playback range, the playback of the playback content is stopped or the playback The content reproduction volume may be in a muted state.

In addition, while the user's viewpoint is moved from the center of the reproduction range to the boundary area of the reproduction range, the reproduction volume of the reproduction content may be linearly or non-linearly reduced.

In addition, when a plurality of the video objects are inserted, the reproduction volume of each of the reproduction contents connected to the video objects is compared, and at least one reproduction of the reproduction contents except for reproduction contents having a high reproduction volume among the reproduction contents is reproduced. The reproduction of the content may be stopped, or the reproduction volume of the reproduced content may be in a muted state.

In addition, the playback content setting unit may set the operation of the image object according to the playback operation of the playback content.

In addition, the playback content setting unit sets a frame gradient of the image object connected to the playback content when the playback operation of the playback content is being played, and when the playback operation of the playback content is stopped, the image It is possible to set one frame among objects to be output and to output a preset image object when the playback operation of the playback content is a pause and mute operation.

Also, the image object inserting unit may insert an image object into the virtual reality image by using a Euler angle parameter.

In addition, the panoramic image obtaining unit determines whether the obtained panoramic image is a panoramic image and a panoramic video, and based on the determined result, a panoramic image editing mode and a panoramic view Any one of the video editing modes can be performed.

In addition, when the determined result is the panoramic image editing mode, the panoramic image conversion unit converts the panoramic image into a spherical virtual reality image, and the image object inserter converts the panoramic image into a still virtual reality image. When an image object is inserted, and the determined result is the panoramic video editing mode, the panoramic video conversion unit converts the panoramic video into a spherical virtual reality video, and the video object inserter converts the time By designating a plurality of landmark objects on the panoramic image that is changed according to the , an image object may be inserted based on the plurality of designated landmark objects.

Also, the panoramic image conversion unit may convert the panoramic image into the spherical virtual reality image based on a responsive web-based application.

A virtual reality image editing method according to an aspect of an embodiment of the present invention is a method for editing a virtual reality image by a virtual reality image editing system implemented as a web, comprising: a panoramic image acquisition step of acquiring a panoramic image; a panoramic image conversion step of converting the panoramic image into a spherical virtual reality image; an image object insertion step of inserting an image object into the virtual reality image from a user; a playback content designation step of inserting playback content connected to the inserted image object; and a playback content setting step of setting playback properties of the playback content. includes

In addition, the setting of the playback content may include setting a playback content area for setting a playback range of the playback content in the virtual reality image based on the inserted image object.

Also, in the setting of the reproduction content area, a reproduction range of the reproduction content may be set using a spherical coordinate system.

In addition, the playback range is a range in which the playback content is played and a user can recognize the playback of the playback content, and when the user's viewpoint is out of the playback range, the playback of the playback content is stopped or the playback The content reproduction volume may be in a muted state.

In addition, while the user's viewpoint is moved from the center of the reproduction range to the boundary area of the reproduction range, the reproduction volume of the reproduction content may be linearly or non-linearly reduced.

In addition, when a plurality of the video objects are inserted, the reproduction volume of each of the reproduction contents connected to the video objects is compared, and at least one reproduction of the reproduction contents except for reproduction contents having a high reproduction volume among the reproduction contents is reproduced. The reproduction of the content may be stopped, or the reproduction volume of the reproduced content may be in a muted state.

In addition, the step of setting the playback content may include setting an object change in which the operation of the image object is set according to the playback operation of the playback content.

Further, in the object change setting step, a frame gradient of the video object connected to the playback content is set when the playback operation of the playback content is being played, and when the playback operation of the playback content is stopped, the Any one of the image objects may be set to be output, and when the reproduction operation of the reproduction content is a pause operation and a mute operation, a preset image object may be set to be output.

In addition, the inserting of the image object may include inserting the image object into the virtual reality image using a Euler angle parameter.

In addition, the panoramic image acquisition step includes determining whether the acquired panoramic image is a panoramic image and a panoramic video, and based on the determined result, a panoramic image editing mode and a panoramic view You can do any of the Mick video editing modes.

In addition, when the determined result is the panoramic image editing mode, the panoramic image conversion step converts the panoramic image into a spherical virtual reality image, and the image object insertion step is a stopped virtual When a video object is inserted into a real image, and the determined result is the panoramic video editing mode, the panoramic video conversion step converts the panoramic video into a spherical virtual reality video, and the image In the object insertion step, a plurality of landmark objects on the panoramic image that change over time may be designated, and an image object may be inserted based on the designated plurality of landmark objects.

In addition, in the panoramic image conversion step, the panoramic image may be converted into the spherical virtual reality image based on a responsive web-based application.

According to the proposed embodiment, it is possible to easily edit and produce a virtual reality image on an Internet web shared between users.

1 is a diagram schematically showing the configuration of a virtual reality image editing system according to an embodiment of the present invention.
FIG. 2 is a block diagram schematically illustrating the configuration of the virtual reality image editing system of FIG. 1 .
3 is a flowchart illustrating a virtual reality image editing method by the virtual reality image editing system of FIG. 2 .
FIG. 4 is a flowchart illustrating a method of setting playback content by the virtual reality image editing method of FIG. 3 .
FIG. 5 is an exemplary diagram illustrating a method of setting a reproduction content of the virtual reality image editing method of FIG. 3 .
FIG. 6 is an exemplary view showing a process of editing a virtual reality image by the virtual reality image editing system of FIG. 2 .

Hereinafter, with reference to the accompanying drawings, the embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. The present invention may be embodied in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and the same reference numerals are assigned to the same or similar components throughout the specification. In addition, since the size and thickness of each component shown in the drawings are arbitrarily indicated for convenience of description, the present invention is not necessarily limited to the illustrated bar.

In the present invention, "on" means to be located above or below the target member, and does not necessarily mean to be located above the target member based on the direction of gravity. In addition, throughout the specification, when a part "includes" a certain component, this means that other components may be further included, rather than excluding other components, unless otherwise stated. Also, in this specification, the term "part" includes a unit realized by hardware, a unit realized by software, or a unit realized using both. Also, one unit may be realized by using two or more hardware, and two or more units may be realized by one hardware.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, referring to FIG. 1 , in a virtual reality image editing system 100 according to an embodiment of the present invention, a panoramic image P is connected to external devices 200 , 300 , 400 through a communication network 700 . can be provided.

In detail, the virtual reality image system 100 records the virtual reality edited image input from the external device 200, 300, 400 on the web, and the 360-degree camera 200 through the communication network 700, It may be provided to other users in the form of a mobile terminal 300 or desktop 400 such as a mobile phone or PDA.

For example, the virtual reality image (V) is implemented by uploading a panoramic image (P) or a plurality of images captured by the external devices (200, 300, 400) to the web server (100), and a plurality of users The virtual reality image V can be edited in a freely shared manner by accessing the website through the external devices 200 , 300 , and 400 .

In this case, the virtual reality image system 100 may be implemented in the form of a server or may be in the form of an application of the external devices 200 , 300 , and 400 .

FIG. 2 is a block diagram schematically illustrating the configuration of the virtual reality image editing system of FIG. 1 .

The virtual reality image editing system 100 includes a panoramic image acquisition unit 110 for acquiring a panoramic image, a panoramic image conversion unit for converting a panoramic image into a spherical virtual reality image (V) ( 120), an image object inserter 130 for inserting an image object into the virtual reality image V, a play content designator 140 for designating play content C connected to the inserted image object O, and playback and a playback content setting unit 150 for setting playback properties of the content (C).

First, the panoramic image acquisition unit 110 acquires a panoramic image P. The panoramic image may be image data transmitted by the external devices 200 , 300 , and 400 to the virtual reality image editing system 100 or images captured by the external devices 200 , 300 , 400 .

In this case, the panoramic image is one or more images taken 360 degrees or omnidirectional, and the form of the panoramic image P _{may be a panoramic image P I} or a panoramic video Pv form. .

The panoramic image acquisition unit 110 may acquire synchronization information or location information linked to the panoramic image P.

In this case, the panoramic image acquisition unit 100 may generate a panoramic image P, which is one image, including the image stitching module 105 when acquiring a plurality of images.

In this case, the panoramic image P includes a still panoramic image P _I or a panoramic moving image P _{V in} which the frame is changed.

In addition, the panoramic image acquisition unit 110 determines whether the obtained panoramic image P is a panoramic image P _I and a panoramic video P _V , and the determined result Any one of a panoramic image editing mode (M _I ) and a panoramic video editing mode (M _V ) may be performed based on .

Here, the panoramic image (P _I ) is a panoramic image (P) having a still frame, such as a photo, and the panoramic video (P _V ) is a panoramic image (P) whose frame is dynamically changed. )to be.

At this time, when the determined result one panoramic image editing modes (M _I), Nora wave, which will be described later dynamic image converting unit 120 is a panoramic image (P _I), a virtual reality image of a spherical (V _I ), and the image object insertion unit 130 may insert the image object O into the _{still virtual reality image V I .}

In addition, when the determined result is the panoramic video editing mode (M _V ), the panoramic video conversion unit 120 converts the panoramic video (P _V ) into a spherical virtual reality video (V _V ) based on the conversion, the video object insertion unit 130 by specifying a plurality of landmark objects (O _L) in a virtual reality video (V _V) that varies with time, a plurality of landmark objects specified (O _L) An image object (O) can be inserted.

The panoramic image acquisition unit 110 automatically determines the acquired panoramic image (P) as a panoramic image (P _I ) and a panoramic video (P _V ), so that the panoramic image editing mode ( M _I ) and the panoramic video editing mode ( _MV ) by dividing, there is an advantage that the user can perform the editing of the image or video more conveniently.

The panoramic image conversion unit 120 may convert the panoramic image P into a spherical virtual reality image V based on a responsive web-based application.

In detail, the panoramic image conversion unit 120 may convert the panoramic image P acquired by the panoramic image acquisition unit 110 into a spherical virtual reality image V.

The panoramic image P may be provided more realistically by converting it into a spherical virtual reality image V and providing it to the user.

In addition, the panoramic image conversion unit 120 converts a spherical virtual reality image (V) based on a responsive web-based application, thereby converting the virtual reality image (V) without installing an external plug-in or a separate application program. ) has the advantage of being able to convert it and provide it to the user.

In this case, as the responsive web-based application, an application supporting a markup language such as HTML5 may be used.

The image object inserter 130 may insert an image object into the virtual reality image V by using a Euler angle parameter.

In detail, the user may insert the image object O by designating the position of the insertion point of the image object O on the screen through a user input such as a mouse and a touch.

Here, the image object O provides the user with an operation status according to whether the playback content C is connected or not in the form of an image.

The image object insertion unit 130 reads the Euler angle parameter (Yaw, Pitch, Roll) value of the specified insertion point in the virtual reality image V, and reads the Euler angle parameter value. An image object O may be inserted as a basis for using it. By implementing the coordinate system using the Euler angle parameter, the position at which the image object O is inserted in the rotatable virtual reality image V can be more effectively expressed.

The video object insertion unit 130 by specifying a plurality of landmark objects (O _L) in a virtual reality video (V _V) that varies with time, the image based on the plurality of landmark objects specified (O _L) You can insert objects.

In this case, the plurality of landmark objects O _L may be one or more of an object recognized as a building and a main object recognized in the video, or a plurality of objects designated by a user.

By inserting the image object (O) by specifying a plurality of landmark objects (O _L ), the image object position according to the position between _{the landmark objects (O L} ) that changes with time in the _{virtual reality video (V V ) is also simultaneously} can change

Also, when the image object O is a moving picture, the image object inserting unit 150 may perform encoding by dividing frames according to a moving picture playback time to convert the image object O into an image including a plurality of frames. By converting a video into an image of a plurality of frames, it is possible to reduce the load for providing the virtual reality image (V) by reducing the capacity of the image object (O) inserted in the virtual reality.

The playback content designation unit 140 may designate the playback content C connected to the inserted image object O.

In detail, the playback content designation unit 140 connects one of a sound source and a video uploaded by a user through the web to an image object O, or connects one of a sound source and a video that is URL input and linked to the image object O The playback content (C), which is a sound source or a video, can be designated by the method.

The playback content setting unit 150 may set playback properties of the playback content (C).

Here, the reproduction property may be a reproduction setting element related to reproduction of the reproduction content C, such as a reproduction operation of the reproduction content C, a reproduction range, and an image object according to the reproduction operation.

Specifically, the content reproduction setting unit 150 may set the virtual reality image (V) reproduction range (R _S) in the playback content based on the video object specified (O).

At this time, the content reproduction setting unit 150 may use a spherical coordinate system to specify the playback range (R _S) of the reproduced content (C).

The playback content setting unit 150 sets the playback content (C) on the connected image object (O), and sets a horizontal position and a vertical position, which are spherical coordinate systems, based on this, so that the horizontal position and vertical position of the playback content (C) you can specify the playback range (R _S) based on the location.

At this time, in the spherical coordinate system, the horizontal and vertical positions of the center of the virtual reality image (V) are 0 degrees, respectively, the horizontal coordinate (Ath) is set to 180 degrees to -180 degrees, and the vertical coordinate (Atv) is set to 90 degrees to -90 degrees. It is a coordinate system that becomes

Illustratively, the playback content (C) the horizontal position of 20 degrees, the vertical position is -20 degrees VR is set on the image, if the designated reproduction range 10 degrees (R _S) of the reproduced content (C), the reproduction of range (R _S) may be set in the range 20 degrees to a horizontal position relative to the horizontal coordinate of 10 degrees to 30 degrees, relative to the vertical position, vertical position -20 -10 degrees to -30 degrees of the reproduced content (C) .

The reproduction range (R _S) is set to the user's point of view (Field of View) The reproduction range of the virtual reality image (V), if it is located in the (R _S), the user may be provided with a sound of the reproduced content (C) .

Here, the user's field of view is one area observed at a time among the virtual reality images V when the user observes the virtual reality image V.

In addition, the reproduction range (R _S) are reproduced is reproduced content (C) in the range where the reproduction of reproduced content (C) that the user can recognize, if the user at the time out of the play range (R _S), reproduced content The playback of (C) may be stopped, or the playback volume of the playback content (C) may be muted.

When the user's viewpoint is out of the playback range R _S , the playback of the playback content C is stopped or the playback volume is muted, so that the user can recognize that the playback content C has moved away from the user.

In addition, the playback volume of the playback range (R _S) in the border area of the reproduction range (R _S) at the center of the in the course of the user of the mobile time of reproducing the content (C) of the can be reduced linearly or non-linearly.

By providing the playback volume of the playback content (C) reduced linearly or non-linearly, it is possible to enjoy the virtual reality image (V) more three-dimensionally by providing a perspective of sound between the user's point of view and the designated playback content (C). .

In addition, a plurality of video objects (O) are inserted, and by comparing the playback volume of each playback content (C) connected to the image objects (O), the playback content having a high playback volume among the playback contents (C) Except for (C), the reproduction of at least one or more reproduction contents C may be stopped, or the reproduction volume of the reproduction contents C may be muted.

By comparing the reproduction volumes of the reproduction contents C with each other, reproduction of at least one reproduction content C except for the reproduction contents C having a high reproduction volume is stopped, or the reproduction volume of the reproduction contents C is muted By becoming , it is possible to implement a masking effect in the virtual reality image V by removing noise generated by overlapping from a plurality of reproduced content C and masking effect between the reproduced content C.

The playback content setting unit 150 may set the operation of the image object O according to the playback operation of the playback content C.

The playback content setting unit 150 sets the frame gradient of the video object O connected to the playback content C when the playback operation of the playback content C is being played, and performs the playback operation of the playback content C is stopped, any one frame of the image object O is set to be output, and when the playback operation of the playback content C is a pause and mute operation, a preset image object O can be set to be output. have.

By setting the frame gradient of the image object O during the playback operation, the user can set the operation of the image object O when the playback content C is playing, and the playback operation of the playback content C In this pause and mute operation, by outputting a preset image object (O), it is possible to express a blinking effect, a hiding effect, and whether to play the image object (O), so that users can use the virtual reality image (V) ) has the advantage of being able to express the image object (O) in various ways.

Illustratively, if the video object O is the 'speaker's image' and the playback content C connected to the video object O is the 'speaker's voice', the user adjusts the frame rate of the 'speaker' to ' By synchronizing the behavior of the speaker, the 'speaker in speech' can be provided more realistically on the virtual reality image (V).

In this embodiment, the case where the video object O is an 'speaker's image' is taken as an example, but the video object O is an image notifying the existence or playback state of the playback content C such as a pin or button. can be

Here, the frame gradient of the image object O may include at least one of transparency and a frame playback speed, and the preset image object O is an image uploaded by the user or a frame of the image object O. may contain one.

3 is a flowchart illustrating a virtual reality image editing method by the virtual reality image editing system of FIG. 2 .

FIG. 4 is a flowchart illustrating a method of setting playback content by the virtual reality image editing method of FIG. 3 .

Accordingly, even if omitted below, the contents described above with respect to the components illustrated in FIGS. 1 to 2 may also be applied to the flowcharts illustrated in FIGS. 3 and 4 .

3 and 4 , first, a panoramic image acquisition step S100 in which the virtual reality image editing system 100 acquires a panoramic image P is performed.

In the panoramic image acquisition step (S100), the virtual reality image editing system 100 determines whether the acquired panoramic image P is a panoramic image P _I and a panoramic video P _V It is determined, and based on the determined result, any one of the _{panoramic image editing mode M I} and the panoramic video editing mode M _{V may be performed.}

Next, the virtual reality image editing system 100 performs a panoramic image conversion step (S200) of converting the panoramic image P into a spherical virtual reality image.

At this time, in the panoramic image conversion step (S200), the virtual reality image editing system 100 may convert the panoramic image P into a spherical virtual reality image based on a responsive web-based application. .

At this time, in the panoramic image acquisition step (S100), the virtual reality image editing system 100 _{determines whether a panoramic image (P I} ) and a panoramic video (P _V ), and the determined result is panoramic image editing modes (M _I), one case, the panorama in the dynamic image conversion step (S200), the virtual reality video editing system 100 is a panoramic image (P _I), a virtual reality image of a spherical (V converted to _I), and wherein when the determined result one panoramic video editing mode (M _V), a panoramic image conversion step (S200), the virtual reality video editing system 100 includes a panoramic video (P _V ) can be converted into a spherical virtual reality video (V _{V ).}

Next, in the virtual reality image editing system 100, the image object insertion step (S300) of inserting the image object O into the virtual reality image from the user is performed.

In the image object insertion step S300 , the virtual reality image editing system 100 may insert the image object O into the virtual reality image using a Euler angle parameter.

At this time, in the panoramic image acquisition step (S100), the virtual reality image editing system 100 _{determines whether a panoramic image (P I} ) and a panoramic video (P _V ), and the determined result is when the panoramic image editing modes (M _I), from the image object insertion step (S300), the virtual reality video editing system 100, and insert a video object (O) in a stationary virtual reality image (V _I), If the above determined result panoramic video editing mode (M _V), in the image object insertion step (S300), the virtual reality video editing system 100 is on the Nora wave which changes according to time dynamic image (P _I) by specifying a plurality of landmark objects (O _L), it can be inserted into a video object (O), based on a plurality of landmark objects specified (O _L).

Next, the virtual reality image editing system 100 performs a playback content designation step ( S400 ) of designating a playback content (C) connected to the inserted image object (O).

Next, the virtual reality image editing system 100 performs a playback content setting step (S500) of setting the playback properties of the playback content (C).

In this case, the reproduction content setting step ( S500 ) includes a reproduction content area setting step ( S510 ), a reproduction content reproduction setting step ( S520 ), and an object change setting step ( S530 ).

First, the virtual reality video editing system 100 may perform to set the playback ranges (R _S) of the VR image in reproducing the content (C) based on the embedded image object (O) reproducing the content area setting step (S510) do.

At this time, in the content reproduction area setting step (S510), the virtual reality video editing system 100 may use a spherical coordinate system, set the reproduction range (R _S) of the reproduced content (C).

In the case where out of the play range (R _S) is, the reproduction content is a range in which (C) is able to play the user is aware of the reproduction of the reproduced content (C), the user at the time of the playback range (R _S), reproduced content The playback of (C) may be stopped, or the playback volume of the playback content (C) may be in a muted state.

At this time, the playback volume of the playback range (R _S) play range at the center of the reproducing content in the process of the user at the time of moving the boundary region (R _S) (C) can be reduced linearly or non-linearly.

Next, the virtual reality image editing system 100 performs a playback content playback setting step ( S520 ) for setting playback settings for the playback content C . At this time, when a plurality of image objects (O) are inserted, the user compares the playback volume of each playback content (C) connected to the image objects (O), and has a high playback volume among the playback contents (C). Any one of a state in which the reproduction of at least one or more reproduction contents C other than the reproduction contents C is stopped or the reproduction volume of the reproduction contents C is muted may be set.

Further, in reproducing content reproduction setting step (S520), user virtual reality video editing when the user at the time out of the play range (R _S) through the system 100, or the reproduction of the reproduced content (C) stop, play Any one of the mute states of the reproduction volume of the content C may be set.

Next, in the virtual reality image editing system 100 , the object change setting step S530 in which the operation of the image object O is set according to the reproduction operation of the reproduced content is performed.

In the object change setting step (S530), the virtual reality image editing system 100 sets the frame gradient of the image object O connected to the playback content C when the playback operation of the playback content C is being played, and , when the playback operation of the playback content C is stopped, any one frame of the image object O is set to be output, and when the playback operation of the playback content C is paused and muted, the preset image Object (O) can be set to be output.

FIG. 5 is an exemplary diagram illustrating a method of setting a reproduction content of the virtual reality image editing method of FIG. 3 .

Referring to FIG. 5 , a user may insert an image object 510 into a virtual reality image. The playback content (C) connected to the image object 510 inserted by the user is located on the spherical coordinate system, and the playback range 500 of the playback content (C) connected to the image object 510 by the user is the playback content (C) on the spherical coordinate system. The reproduction range 500 may be set as a reference of C).

In this case, the Euler angle parameters (Yaw, Pitch, and Roll) values of the image object 510 and the coordinates of the playback content C, which is a spherical coordinate system, may be linked to each other.

5 shows that the playback content C connected to the exemplarily inserted image object 510 is positioned (horizontal position -45 degrees, vertical position -45 degrees), and the playback range 500 is set at 45 degrees from the horizontal position is showing

In this case, the reproduction range 500 may be set to a horizontal position or a vertical position set by a user, or the horizontal position and the vertical position may be set to the same range so that the reproduction range 500 is the same.

FIG. 6 is an exemplary view showing a process of editing a virtual reality image by the virtual reality image editing system of FIG. 2 .

(Step (A)) The panoramic image acquisition unit 110 acquires the panoramic image 601 .

(Step (B)) The panoramic image converter 120 converts the panoramic image 601 of (Step (A)) into a spherical virtual reality image 602 .

((C) step) The virtual reality image 602 converted into a spherical shape in ((B) step) is provided to the user so that the image can be rotated 360 degrees on the responsive web, and the user can An image object 610 may be inserted by checking an image 603 from a user's point of view, which is a field of view of the user.

In this case, the image object 610 may be inserted into the virtual reality image 602 by various input methods such as touch, drag and drop, and the like.

The image object insertion unit 130 reads the Euler angle parameters (Yaw, Pitch, and Roll) of the insertion point designated by the user, and then inserts the image object 610 at the corresponding point.

At this time, the playback content designation input area 620 for connecting the image object 610 and the playback content C is output to the user, and the playback content designator 140 uploads the sound source and the image to the inserted image. The playback content C connected to the object 610 may be designated.

(Step (D)) The playback content (C) connected to the image object 610 in (Step (C)) receives the user-set range from the playback range setting area 630, and the playback content setting unit 150 may set the playback range 640 of the playback content C on the virtual reality image 602 based on the designated image object 610 . In this case, the reproduction range setting area 630 is implemented in the form of a number, bar, or the like, so that the user can appropriately set the area on the virtual reality image 602 .

Through this embodiment, the user can conveniently insert the reproduced content (C) on the virtual reality image (V), and by listening to the realistically edited sound according to the movement of the user's point of view of the inserted content (C). , there is an effect that the user can enjoy the virtual reality image (V) more.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible from the above description by those skilled in the art. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result. Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

The system described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, the systems, devices and components described in the embodiments may include, for example, a processor, a controller, an Arithmetic Logic Unit (ALU), a digital signal processor, a microcomputer, a Field Programmable Array (FPA). , a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, may be implemented using one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other Processing Configurations are also possible, such as a Parallel Processor.

The software may include a computer program, code, instructions, or a combination of one or more thereof, and configure the processing device to operate as desired or process it independently or in combination (collectively) You can command the device. The software and/or data may be any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or provide instructions or data to the processing device. , or may be permanently or temporarily embodied in a transmitted signal wave (Signal Wave). The software may be distributed over networked computer systems, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiments may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. -Includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

100: virtual reality image editing system 110: panoramic image acquisition unit
120: panoramic image conversion unit 130: image object insertion unit
140: playback content designation unit 150: playback content setting unit
200, 300, 400: external device 700: communication network
510, 610: Image object 500, 640: Play range
630: play range setting area 620: play content designation input area
601: panoramic image 602: virtual reality image
603: user point of view video

Claims (24)

In the virtual reality video editing system implemented by the web,
a panoramic image acquisition unit for acquiring a panoramic image;
a panoramic image conversion unit converting the panoramic image into a spherical virtual reality image;
an image object insertion unit for inserting an image object into the virtual reality image;
a playback content designation unit for designating playback content connected to the inserted image object; and
a playback content setting unit for setting playback properties of the playback content; including,
The playback content setting unit,
setting a playback range of the playback content in the virtual reality image based on the inserted image object,
setting the operation of the video object according to the playback operation of the playback content,
setting a frame gradient of the video object connected to the playback content when the playback operation of the playback content is being played,
When the playback operation of the playback content is stopped, any one frame of the video object is set to be output,
The virtual reality image editing system according to claim 1, wherein a preset image object is set to be output when the playback operation of the playback content is a pause operation and a mute operation. delete According to claim 1,
The playback content setting unit,
A virtual reality video editing system, characterized in that setting a playback range of the playback content using a spherical coordinate system. 4. The method of claim 3,
The play range is
It is a range in which the playback content is played and the user can recognize the playback of the playback content,
When the user's viewpoint is out of the playback range, the playback of the playback content is stopped or the playback volume of the playback content is in a muted state. 5. The method of claim 4,
The virtual reality video editing system, characterized in that the reproduction volume of the reproduction content is linearly or non-linearly reduced while the user's viewpoint is moved from the center of the reproduction range to the boundary area of the reproduction range. 6. The method of claim 5,
When a plurality of the video objects are inserted, the reproduction volume of each of the reproduction contents connected to the video objects is compared, and of at least one reproduction content except for reproduction contents having a high reproduction volume among the reproduction contents. A virtual reality video editing system, characterized in that playback is stopped or the playback volume of the playback content is in a muted state. delete delete According to claim 1,
The video object insertion unit,
A virtual reality image editing system, characterized in that inserting an image object into the virtual reality image by using a Euler angle parameter. According to claim 1,
The panoramic image acquisition unit,
determining whether the obtained panoramic image is a panoramic image or a panoramic video, and performing any one of a panoramic image editing mode and a panoramic video editing mode based on the determined result A virtual reality video editing system. 11. The method of claim 10,
When the determined result is the panoramic image editing mode,
The panoramic image conversion unit converts the panoramic image into a spherical virtual reality image, and the image object insertion unit inserts a video object into the still virtual reality image,
When the determined result is the panoramic video editing mode,
The panoramic image conversion unit converts the panoramic video into a spherical virtual reality video, and the video object inserter designates a plurality of landmark objects on the panoramic image that change over time, Virtual reality video editing system, characterized in that inserting a video object based on the landmark object of. According to claim 1,
The panoramic image conversion unit,
A virtual reality image editing system, characterized in that the panoramic image is converted into the spherical virtual reality image based on a responsive web-based application. delete delete delete delete delete delete delete delete delete delete delete delete

Images