KR20200035696A - System and method for editing virtual reality image and video - Google Patents

Abstract

The present invention relates to a virtual reality image editing system which allows a user to more easily share and produce virtual reality images and a virtual reality image editing method using the same. The virtual reality image editing system implemented in the web comprises: a panoramic image acquisition part which acquires a panoramic image; a panoramic image conversion part converting the panoramic image into a spherical virtual reality image; an image object insertion part inserting an image object into the virtual reality image; a playback content designation part designating playback content connected to the inserted image object; and a playback content setting part setting playback properties of the playback content.

Description

Virtual Reality Video Editing System and Method {SYSTEM AND METHOD FOR EDITING VIRTUAL REALITY IMAGE AND VIDEO}

The present invention relates to a virtual reality image editing system and a virtual reality image editing method.

As 360-degree VR cameras and production applications become popular, the demand for realizing and producing virtual reality images is increasing.

Based on the virtual reality image, the producer can create a virtual space, share it with each other, and produce a more realistic image of the photographed space.

As a conventional service, Google Street View, Naver Street View, and various real estate sites produce and upload virtual reality images to users.

However, since these virtual reality images are produced and uploaded as a separate dedicated application and shared, it is difficult to participate in production among users, and also has a problem in that production and upload are performed separately.

Accordingly, it is proposed that a user can more easily share and produce a virtual reality image by implementing a virtual reality image editing platform on the Internet Web, and that the user can easily add playback content in the virtual reality image.

The present invention is to provide a virtual reality video editing system and a virtual reality video editing method using the virtual reality video editing system that can be easily shared and produced by the user.

A virtual reality image editing system according to an aspect of an embodiment of the present invention includes: a virtual reality image editing system implemented as a web, comprising: a panoramic image obtaining unit for obtaining a panoramic image; A panoramic image converter converting the panoramic image into a spherical virtual reality image; An image object inserting unit for inserting an image object into the virtual reality image; A playback content designation unit for designating playback content connected to the inserted video object; And a playback content setting unit for setting playback attributes of the playback content. It includes.

Also, the playback content setting unit may set a playback range of the playback content in the virtual reality image based on the inserted video object.

Also, the reproduction content setting unit may set a reproduction range of the reproduction content using a spherical coordinate system.

Further, the playback range is a range in which the playback content is played and the user can recognize playback of the playback content, and when the user's viewpoint is outside the playback range, playback of the playback content is stopped or the playback The playback volume of the content may be muted.

Also, in the process of moving the user's viewpoint from the center of the play range to the boundary area of the play range, the play volume of the play content may be reduced linearly or nonlinearly.

In addition, when a plurality of the video objects are inserted, at least one or more reproductions are excluded by comparing the playback volumes of the respective playback contents connected to the video objects, excluding playback contents having a higher playback volume among the playback contents The playback of the content may be stopped, or the playback volume of the played content may be muted.

Also, the playback content setting unit may set an operation of the video object according to a playback operation of the playback content.

Further, the playback content setting unit sets a frame change degree of the video object connected to the playback content when the playback operation of the playback content is being played, and when the playback operation of the playback content is stopped, the video It is possible to set one frame of an object to be output, and to set a preset video object to be output when the playback operation of the playback content is a pause and mute operation.

In addition, the image object inserting unit may insert an image object into the virtual reality image using an Euler Angle parameter.

In addition, the panoramic image acquisition unit determines whether the obtained panoramic image is a panoramic image and a panoramic video, and a panoramic image editing mode and a panoramic image based on the determined result. Either of the video editing modes can be performed.

In addition, when the determined result is the panoramic image editing mode, the panoramic image conversion unit converts the panoramic image into a spherical virtual reality image, and the image object insertion unit converts the frozen virtual reality image into a static image. When an image object is inserted, and the determined result is the panoramic video editing mode, the panoramic video conversion unit converts the panoramic video into a spherical virtual reality video, and the video object insertion unit time By designating a plurality of landmark objects on the panoramic image that changes according to the image object, an image object may be inserted based on the specified plurality of landmark objects.

In addition, the panoramic image conversion unit may convert the panoramic image to the spherical virtual reality image based on a responsive web-based application.

A virtual reality image editing method according to an aspect of an embodiment of the present invention includes a method of editing a virtual reality image by a virtual reality image editing system implemented in the web, comprising: a panoramic image acquisition step of acquiring a panoramic image; A panoramic image conversion step of converting the panoramic image into a spherical virtual reality image; An image object insertion step of inserting an image object into the virtual reality image from a user; A playback content designation step of inserting playback content connected to the inserted video object; And a play content setting step of setting a play attribute of the play content. It includes.

In addition, the setting of the playing content may include setting a playing content area for setting a playing range of the playing content in the virtual reality image based on the inserted video object.

Also, in the step of setting the play content area, a play range of the play content may be set using a spherical coordinate system.

Further, the playback range is a range in which the playback content is played and the user can recognize playback of the playback content, and when the user's viewpoint is outside the playback range, playback of the playback content is stopped or the playback The playback volume of the content may be muted.

Also, in the process of moving the user's viewpoint from the center of the play range to the boundary area of the play range, the play volume of the play content may be reduced linearly or nonlinearly.

In addition, when a plurality of the video objects are inserted, at least one or more reproductions are excluded by comparing the playback volumes of the respective playback contents connected to the video objects, excluding playback contents having a higher playback volume among the playback contents The playback of the content may be stopped, or the playback volume of the played content may be muted.

In addition, the setting of the playing content may include setting of an object change set by the operation of the video object according to the playing operation of the playing content.

Further, in the object change setting step, when a frame change degree of the video object connected to the play content when the play operation of the play content is being played is set, and the play operation of the play content is stopped, the It can be set so that any one frame of the video object is output, and when the playback operation of the playback content is a pause and mute operation, a preset video object may be output.

In addition, in the step of inserting the image object, an image object may be inserted into the virtual reality image using the Euler Angle parameter.

In addition, in the step of acquiring the panoramic image, it is determined whether the obtained panoramic image is a panoramic image and a panoramic video, and based on the determined result, a panoramic image editing mode and a panoramic image Either of the Mick video editing modes can be performed.

In addition, when the determined result is the panoramic image editing mode, the panoramic image conversion step converts the panoramic image into a spherical virtual reality image, and the image object insertion step is stopped virtual When a video object is inserted into a real image, and the determined result is the panoramic video editing mode, the panoramic video conversion step converts the panoramic video into a spherical virtual reality video, and the video The step of inserting an object may designate a plurality of landmark objects on a panoramic image that changes over time, and insert an image object based on the specified plurality of landmark objects.

In addition, in the step of converting the panoramic image, the panoramic image may be converted into the spherical virtual reality image based on a responsive web-based application.

According to the proposed embodiment, it is possible to easily edit and produce virtual reality images on the Internet web shared between users.

1 is a diagram schematically showing the configuration of a virtual reality video editing system according to an embodiment of the present invention.
FIG. 2 is a block diagram schematically showing the configuration of the virtual reality image editing system of FIG. 1.
FIG. 3 is a flowchart illustrating a virtual reality image editing method using the virtual reality image editing system of FIG. 2.
4 is a flowchart illustrating a method for setting playback content by the virtual reality image editing method of FIG. 3.
FIG. 5 is an exemplary diagram showing a method for setting playback content of the virtual reality image editing method of FIG. 3.
FIG. 6 is an exemplary diagram showing a process of editing a virtual reality image by the virtual reality image editing system of FIG. 2.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains may easily practice. The present invention can be implemented in many different forms and is not limited to the embodiments described herein. In the drawings, parts not related to the description are omitted in order to clearly describe the present invention, and the same reference numerals are attached to the same or similar elements throughout the specification. In addition, since the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of description, the present invention is not necessarily limited to what is illustrated.

In the present invention, "~ on" means that it is located above or below the target member, and does not necessarily mean that it is located above the gravity direction. In addition, throughout the specification, when a part “includes” a certain component, it means that the component may further include other components, not to exclude other components, unless otherwise stated. In addition, in this specification, a "unit" includes a unit realized by hardware, a unit realized by software, or a unit realized by using both. Further, one unit can be realized using two or more hardware, and two or more units can be realized by one hardware.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, referring to FIG. 1, in the virtual reality image editing system 100 according to an embodiment of the present invention, a panoramic image P is connected to external devices 200, 300, and 400 through a communication network 700. Can be provided.

Specifically, the virtual reality image system 100 records the virtual reality edited image input from the external devices 200, 300, and 400 on the web, and through the communication network 700, the 360 degree camera 200, It can be provided to other users in the form of a mobile terminal 300 or a desktop 400 such as a mobile phone or PDA.

For example, a virtual reality image (V) is implemented by uploading a panoramic image (P) or a plurality of images taken by external devices (200, 300, 400) to the web server (100), and multiple users By accessing the website through external devices 200, 300, and 400, the virtual reality image V can be edited in a freely shared manner.

At this time, the virtual reality image system 100 may be implemented in the form of a server, or may be an application form of external devices 200, 300, 400.

FIG. 2 is a block diagram schematically showing the configuration of the virtual reality image editing system of FIG. 1.

The virtual reality image editing system 100 includes a panoramic image acquisition unit 110 that acquires a panoramic image, and a panoramic image conversion unit that converts the panoramic image into a spherical virtual reality image V. 120), a video object inserting unit 130 for inserting a video object in the virtual reality image V, a playback content designating unit 140 for designating playback content C connected to the inserted video object O, and playback It includes a playback content setting unit 150 for setting the playback properties of the content (C).

First, the panoramic image acquisition unit 110 acquires a panoramic image P. The panoramic image may be image data transmitted from the external device 200, 300, or 400 to the virtual reality image editing system 100 or image captured by the external device 200, 300 or 400.

At this time, the panoramic image is one or more images photographed 360 degrees or omnidirectional, and the shape of the panoramic image P may be a panoramic image P _I or a panoramic video Pv. .

The panoramic image acquisition unit 110 may acquire synchronization information or location information linked with the panoramic image P.

At this time, the panoramic image acquisition unit 100 may generate a single panoramic image P including the image stitching module 105 when acquiring a plurality of images.

At this time, the panoramic image P includes a still panoramic image P _I or a panoramic video P _V in which a frame changes.

In addition, the panoramic image acquisition unit 110 determines whether the obtained panoramic image P is a panoramic image P _I and a panoramic video P _V , and the determined result Based on the, it is possible to perform any one of the panoramic image editing mode (M _I ) and the panoramic video editing mode (M _V ).

Here, the panoramic image P _I is a panoramic image P having a still frame, such as a photograph, and the panoramic movie P _V is a panoramic image P in which frames are dynamically changed. )to be.

At this time, when the determined result is the panoramic image editing mode (M _I ), the panoramic image converter 120 to be described later uses the panoramic image P _I as a spherical virtual reality image V _I ), And the image object inserting unit 130 may insert the image object O into the still virtual reality image V _I.

In addition, when the determined result is the panoramic video editing mode (M _V ), the panoramic video converter 120 converts the panoramic video (P _V ) into a spherical virtual reality video (V _V ). based on the conversion, the video object insertion unit 130 by specifying a plurality of landmark objects (O _L) in a virtual reality video (V _V) that varies with time, a plurality of landmark objects specified (O _L) The image object O can be inserted.

The panoramic image acquisition unit 110 automatically determines the panoramic image (P) and the panoramic image (P _I ) and the panoramic video (P _V ) by automatically obtaining the panoramic image editing mode ( By separating into M _I ) and panoramic video editing mode (M _V ), the user has the advantage of being able to conveniently edit the image or video.

The panoramic image conversion unit 120 may convert the panoramic image P into a spherical virtual reality image V based on a responsive web-based application.

Specifically, the panoramic image conversion unit 120 may convert the panoramic image P acquired by the panoramic image acquisition unit 110 into a spherical virtual reality image V.

By converting it into a spherical virtual reality image (V) and providing it to a user, the panoramic image (P) can be provided more realistically.

In addition, the panoramic image conversion unit 120 converts the virtual virtual image V in the form of a sphere based on a responsive web-based application, thereby installing a virtual reality image V without installing an external plug-in or a separate application program. ).

At this time, the responsive web-based application may be an application that supports markup languages such as HTML5.

The image object inserting unit 130 may insert an image object into the virtual reality image V using the Euler Angle parameter.

Specifically, the user can insert the image object O by specifying the location of the image object O on the screen through a user input such as a mouse and a touch.

Here, the video object O provides a user with an operation status according to whether or not the playback content C is connected in the form of an image or a playback operation.

The image object inserting unit 130 reads Euler angle parameters (Yaw, Pitch, Roll) values of the designated insertion point in the virtual reality image V, and reads the Euler angle parameter values read. Based on the image object (O) can be inserted. By implementing the coordinate system using the Euler angle parameter, the position where the image object O is inserted in the rotatable virtual reality image V can be more effectively represented.

The video object insertion unit 130 by specifying a plurality of landmark objects (O _L) in a virtual reality video (V _V) that varies with time, the image based on the plurality of landmark objects specified (O _L) You can insert an object.

At this time, the plurality of landmark objects O _L may be one or more of a plurality of objects designated by a user or a building recognized as a main object or a building recognized in a video.

By designating a plurality of landmark objects (O _L ) and inserting an image object (O), the position of the image object also changes according to the position between the landmark objects (O _L ) that change over time in the virtual reality video (V _V ). Can change.

Also, when the video object O is a video, the video object inserting unit 150 may perform encoding to divide a frame according to a video playback time, and convert it into an image including a plurality of low-capacity frames. By converting a video into an image of a plurality of frames, it is possible to reduce the load of providing the virtual reality image V by reducing the capacity of the image object O inserted in the virtual reality.

The playback content designation unit 140 may designate the playback content C connected to the inserted video object O.

Specifically, the playback content designation unit 140 connects one of the sound sources and videos uploaded by the user to the video object O through the web, or connects one of the sound sources and videos that are URL input and linked to the video object O. In a way, the playback content C, which is a sound source or a video, can be designated.

The playback content setting unit 150 may set playback properties of the playback content C.

Here, the reproduction attribute may be a reproduction setting element related to reproduction of the reproduction content C, such as a reproduction operation of the reproduction content C, a reproduction range, and a video object according to the reproduction operation.

In detail, the playback content setting unit 150 may set a playback range R _S of the playback content in the virtual reality video V based on the designated video object O.

At this time, the reproduction content setting unit 150 may designate a reproduction range R _S of the reproduction content C using a spherical coordinate system.

In the playback content setting unit 150, the playback content (C) is designated on the connected video object (O), and based on this, the horizontal and vertical positions of the spherical coordinate system are set, so that the horizontal and vertical positions of the playback content (C) are set. The playback range R _S can be specified based on the position.

At this time, in the spherical coordinate system, the horizontal and vertical positions of the center of the virtual reality image V are 0 degrees, and the horizontal coordinate (Ath) is set to 180 degrees to -180 degrees, and the vertical coordinate (Atv) is set to 90 degrees to -90 degrees. It is a coordinate system.

For example, if the horizontal position of the playback content C is set to 20 degrees, the vertical position is set to -20 degrees to the virtual reality image, and the playback range R _S of the playback content C is set to 10 degrees, playback is performed. The range R _S may be set in a range of 10 to 30 degrees of horizontal coordinates based on 20 degrees of horizontal position of the playback content C, and -10 to -30 degrees of vertical coordinates based on -20 degrees of vertical position. .

When the playback range R _S is set so that the user's field of view is located within the playback range R _S of the virtual reality image V, the user may be provided with sound of the playback content C .

Here, the user's field of view is one area observed at a time of the virtual reality image V when the user observes the virtual reality image V.

In addition, the playback range R _S is a range in which the playback content C is played and the user can recognize playback of the playback content C, and when the user's viewpoint is outside the playback range R _S , the playback content The playback of (C) may be stopped, or the playback volume of the playback content (C) may be muted.

When the user's point of view is out of the reproduction range R _S , the user can recognize that the reproduction of the reproduction content C is stopped or the reproduction volume is muted, thereby moving away from the designated reproduction content C.

In addition, the playback volume of the playback range (R _S) in the border area of the reproduction range (R _S) at the center of the in the course of the user of the mobile time of reproducing the content (C) of the can be reduced linearly or non-linearly.

By providing the reproduction volume of the reproduction content C linearly or nonlinearly, the perspective of the sound between the user's viewpoint and the designated reproduction content C is provided to enjoy the virtual reality image V in three dimensions. .

In addition, a plurality of video objects (O) are inserted, and the playback volume of each playback content (C) connected to the video objects (O) is compared, and the playback content having a higher playback volume among the playback contents (C) Excluding (C), playback of at least one playback content (C) may be stopped, or the playback volume of the playback content (C) may be muted.

By comparing the playback volumes of the playback contents (C) with each other, playback of at least one playback contents (C) is stopped except for playback contents (C) having a higher playback volume, or the playback volume of the playback contents (C) is muted. By being, it is possible to implement a masking effect between the noise removal and playback content C generated by overlapping from a plurality of playback content C in the virtual reality image V.

The playback content setting unit 150 may set the operation of the video object O according to the playback operation of the playback content C.

The playback content setting unit 150 sets a frame change degree of the video object O connected to the playback content C when the playback operation of the playback content C is being played, and the playback operation of the playback content C When it is stopped, one frame of the video object O is set to be output, and when the playback operation of the playback content C is a pause and mute operation, a preset video object O can be set to be output. have.

By setting the frame gradient of the video object O in the playback operation, the user can set the operation of the video object O when the playback content C is playback, and the playback operation in the playback content C In the case of the pause and mute operation, by outputting a preset image object O, it is possible to express a blinking effect, a hidden effect, and whether or not a playback is performed on the image object O, so that users can view the virtual reality image (V ) Has the advantage of variously representing the image object (O).

For example, when the video object O is the 'speaker's image' and the playback content C connected to the video object O is the 'speaker's voice', the user adjusts the frame rate of the 'speaker' to ' By tailoring the speaker's behavior and synchronization, it is possible to provide a 'real speaker' on the virtual reality image V more realistically.

In this embodiment, the case where the video object O is an 'image of the speaker' is exemplified, but the video object O is an image informing the existence or playback state of the playback content C such as a pin or button. Can be

Here, the frame change degree of the image object O may include at least one of transparency and a playback speed of the frame, and the preset image object O is one of a frame uploaded by the user or a frame of the image object O. It can contain one.

FIG. 3 is a flowchart illustrating a virtual reality image editing method using the virtual reality image editing system of FIG. 2.

4 is a flowchart illustrating a method for setting playback content by the virtual reality image editing method of FIG. 3.

Accordingly, even if omitted below, the contents described above with respect to the components illustrated in FIGS. 1 to 2 may also be applied to the flowcharts illustrated in FIGS. 3 and 4.

3 and 4, first, a virtual image acquisition step S100 in which the virtual reality image editing system 100 acquires a panoramic image P is performed.

In the panoramic image acquisition step (S100), the virtual reality image editing system 100 determines whether the acquired panoramic image (P) is a panoramic image (P _I ) and a panoramic video (P _V ). Based on the determined result, one of the panoramic image editing mode M _I and the panoramic video editing mode M _V may be performed.

Then, the virtual reality image editing system 100 performs a panoramic image conversion step (S200) of converting the panoramic image P into a spherical virtual reality image.

At this time, in the panoramic image conversion step (S200), the virtual reality image editing system 100 may convert the panoramic image P into a spherical virtual reality image based on a responsive web-based application. .

At this time, in the panoramic image acquisition step (S100), the virtual reality image editing system 100 determines whether the panoramic image (P _I ) and the panoramic video (P _V ), and the determined result is In the case of the panoramic image editing mode (M _I ), in the panoramic image conversion step (S200), the virtual reality image editing system 100 converts the panoramic image P _I into a spherical virtual reality image (V). _I ), and when the determined result is the panoramic video editing mode (M _V ), in the step of converting the panoramic video (S200), the virtual reality video editing system 100 displays the panoramic video (P _V ) can be converted into a spherical virtual reality video (V _V ).

Next, the virtual reality image editing system 100 performs a video object insertion step (S300) of inserting a video object O into a virtual reality image from a user.

In the step S300 of inserting an image object, the virtual reality image editing system 100 may insert an image object O into the virtual reality image using the Euler Angle parameter.

At this time, in the panoramic image acquisition step (S100), the virtual reality image editing system 100 determines whether the panoramic image (P _I ) and the panoramic video (P _V ), and the determined result is In the case of the panoramic image editing mode (M _I ), in the image object insertion step (S300), the virtual reality image editing system 100 inserts the image object O into the still virtual reality image V _I , When the determined result is the panoramic video editing mode (M _V ), in the image object insertion step (S300), the virtual reality video editing system 100 is on the panoramic image P _I which changes over time. by specifying a plurality of landmark objects (O _L), it can be inserted into a video object (O), based on a plurality of landmark objects specified (O _L).

Then, the virtual reality image editing system 100 is performed with a playback content designation step (S400) for designating the playback content C connected to the inserted video object O.

Next, the virtual reality video editing system 100 is performed with a playback content setting step (S500) for setting playback properties of the playback content C.

At this time, the playback content setting step (S500) includes a playback content area setting step (S510), a playback content playback setting step (S520), and an object change setting step (S530).

First, the virtual reality video editing system 100 may perform to set the playback ranges (R _S) of the VR image in reproducing the content (C) based on the embedded image object (O) reproducing the content area setting step (S510) do.

At this time, in the step of setting the playback content area (S510), the virtual reality image editing system 100 may set the playback range R _S of the playback content C using a spherical coordinate system.

Here, the playback range R _S is a range in which the playback content C is reproduced so that the user can recognize playback of the playback content C, and when the user's viewpoint is out of the playback range R _S , the playback content The playback of (C) may be stopped, or the playback volume of the playback content (C) may be muted.

At this time, the playback volume of the playback range (R _S) play range at the center of the reproducing content in the process of the user at the time of moving the boundary region (R _S) (C) can be reduced linearly or non-linearly.

Then, the virtual reality video editing system 100 is performed with a playback content playback setting step (S520) for setting playback settings of the playback content (C). At this time, when a plurality of video objects (O) are inserted, the user compares the playback volume of each playback content (C) connected to the video objects (O), and has a higher playback volume among the playback content (C). The reproduction of at least one reproduction content C, except for the reproduction content C, may be stopped, or the reproduction volume of the reproduction content C may be set to one of the muted states.

In addition, in the playback content playback setting step (S520), when the user's point of view is out of the playback range R _S through the virtual reality video editing system 100, playback of the playback content C is stopped or played The playback volume of the content C can be set to any one of the muted states.

Next, the virtual reality image editing system 100 performs an object change setting step (S530) set by the operation of the image object O according to the reproduction operation of the reproduced content.

In the object change setting step (S530), the virtual reality image editing system 100 sets a frame change degree of the video object O connected to the playback content C when the playback operation of the playback content C is being played, , When the playback operation of the playback content (C) is stopped, a frame of any one of the video object (O) is set to be output, and when the playback operation of the playback content (C) is a pause and mute operation, the preset video Object O can be set to be output.

FIG. 5 is an exemplary diagram showing a method for setting playback content of the virtual reality image editing method of FIG. 3.

Referring to FIG. 5, a user may insert an image object 510 in a virtual reality image. The playback content (C) connected to the image object 510 inserted by the user is located on the spherical coordinate system, and the playback range 500 of the playback content (C) connected to the video object 510 is the playback content (500) on the spherical coordinate system. The reproduction range 500 may be set based on C).

At this time, the Euler angle parameters (Yaw, Pitch, Roll) of the image object 510 and the coordinates of the playback content C, which is a spherical coordinate system, may be linked to each other.

5 illustrates that the playback content C connected to the inserted image object 510 is positioned (horizontal position -45 degrees, vertical position -45 degrees), and the playback range 500 is set to 45 degrees from the horizontal position. City.

At this time, the playback range 500 may be set to a horizontal or vertical position set by the user, or the horizontal and vertical positions may be set to the same range so that the playback range 500 is the same.

FIG. 6 is an exemplary diagram showing a process of editing a virtual reality image by the virtual reality image editing system of FIG. 2.

(Step (A)) The panoramic image acquisition unit 110 acquires the panoramic image 601.

(Step (B)) The panoramic image conversion unit 120 converts the panoramic image 601 of (Step (A)) into a spherical virtual reality image 602.

(Step (C)) The virtual reality image 602 converted to a sphere in step ((B)) is provided to the user so that the image can be rotated 360 degrees on the responsive web, and the user is within the virtual reality image 602. The image object 610 may be inserted by checking the user's point of view image 603 that is the user's point of view (Field of View).

In this case, the insertion of the image object 610 may insert the image object 610 on the virtual reality image 602 by various input methods such as touch, drag and drop.

The image object inserting unit 130 reads the Euler angle parameters (Yaw, Pitch, Roll) of the insertion point specified by the user, and then inserts the image object 610 at the corresponding point.

At this time, the playback content designation input area 620 for connecting the video object 610 and the playback content (C) is output to the user, and the playback content designation unit 140 is inserted through the sound source and video upload. The playback content C connected to the object 610 may be designated.

((D) step) In ((C) step), the playback content C connected to the video object 610 receives the range set by the user from the playback range setting area 630, and the playback content setting unit 150 Can set the playback range 640 of the playback content C on the virtual reality image 602 based on the designated video object 610. At this time, the playback range setting area 630 is implemented in the form of numbers, bars, etc., so that the user can appropriately set the area on the virtual reality image 602.

Through this embodiment, the user can conveniently insert the playback content (C) on the virtual reality image (V), and by listening to the edited sound realistically reproduced as the user moves the viewpoint of the playback content (C) , The user can enjoy the virtual reality image (V) more.

As described above, although the embodiments have been described by a limited embodiment and drawings, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques are performed in a different order than the described method, and / or the components of the described system, structure, device, circuit, etc. are combined or combined in a different form from the described method, or other components Alternatively, even if replaced or substituted by equivalents, appropriate results can be achieved. Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

The system described above may be implemented with hardware components, software components, and / or combinations of hardware components and software components. For example, the systems, devices, and components described in the embodiments include, for example, processors, controllers, Arithmetic Logic Units (ALUs), Digital Signal Processors, microcomputers, and Field Programmable Arrays (FPAs). , A Programmable Logic Unit (PLU), microprocessor, or any other device capable of executing and responding to instructions (Instruction), may be implemented using one or more general purpose computers or special purpose computers. The processing device may run an operating system (OS) and one or more software applications running on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For convenience of understanding, a processing device may be described as one being used, but a person having ordinary skill in the art, the processing device may include a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that may include. For example, the processing device may include a plurality of processors or a processor and a controller. In addition, other processing configurations, such as parallel processors, are possible.

The software may include a computer program, code, instruction, or a combination of one or more of these, and configure the processing device to operate as desired, or process independently or collectively You can command the device. Software and / or data may be interpreted by a processing device, or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodied in the transmitted signal wave. The software may be distributed on networked computer systems, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiments may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer-readable medium may include program instructions, data, data structures, or the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiments or may be known and usable by those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, magnetic media such as optical media such as CD-ROMs and DVDs, and floppy disks. Includes hardware devices specifically configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language code that can be executed by a computer using an interpreter, etc., as well as machine language codes produced by a compiler. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

100: virtual reality image editing system 110: Panoramic image acquisition unit
120: panoramic image conversion unit 130: image object insertion unit
140: playback content designation unit 150: playback content setting unit
200, 300, 400: External device 700: Communication network
510, 610: image object 500, 640: playback range
630: Playback range setting area 620: Playback content designation input area
601: Panoramic image 602: Virtual reality image
603: user's point of view video

Claims (24)

In the virtual reality video editing system implemented in the web,
A panoramic image acquisition unit that acquires a panoramic image;
A panoramic image converter converting the panoramic image into a spherical virtual reality image;
An image object inserting unit for inserting an image object into the virtual reality image;
A playback content designation unit for designating playback content connected to the inserted video object; And
A playback content setting unit for setting playback properties of the playback content; Virtual reality video editing system comprising a. According to claim 1,
The playback content setting unit,
A virtual reality video editing system, characterized in that a playing range of the played content in the virtual reality video is set based on the inserted video object. According to claim 2,
The playback content setting unit,
A virtual reality video editing system characterized by setting a playback range of the reproduced content using a spherical coordinate system. According to claim 3,
The playback range,
The range in which the playback content is played and the user can recognize playback of the playback content,
If the user's point of view is out of the playback range, the playback of the playback content is stopped, or the virtual reality video editing system, characterized in that the playback volume of the playback content is muted. According to claim 4,
A virtual reality video editing system, characterized in that the playback volume of the playback content is reduced linearly or nonlinearly while the user's viewpoint is moved from the center of the playback range to a boundary area of the playback range. The method of claim 5,
When a plurality of the video objects are inserted, at least one playback content is excluded by comparing the playback volumes of the respective playback contents connected to the video objects, except for playback contents having a higher playback volume among the playback contents. Virtual reality video editing system, characterized in that playback is stopped, or the playback volume of the playback content is muted. According to claim 2,
The playback content setting unit,
Virtual reality video editing system, characterized in that the operation of the video object is set according to the playback operation of the playback content. The method of claim 7,
The playback content setting unit,
Set a frame change degree of the video object connected to the playback content when the playback operation of the playback content is being played,
When the playback operation of the playback content is stopped, one of the video objects is set to be output,
And the preset video object is output when the playback operation of the playback content is a pause and mute operation. According to claim 1,
The video object insertion unit,
A virtual reality image editing system, characterized in that an image object is inserted into the virtual reality image using an Euler Angle parameter. According to claim 1,
The panoramic image acquisition unit,
It is determined whether the obtained panoramic image is a panoramic image and a panoramic video, and performing one of a panoramic image editing mode and a panoramic video editing mode based on the determined result. Features a virtual reality video editing system. The method of claim 10,
When the determined result is the panoramic image editing mode,
The panoramic image conversion unit converts the panoramic image into a spherical virtual reality image, and the image object insertion unit inserts an image object into a stationary virtual reality image,
When the determined result is the panoramic video editing mode,
The panoramic image converting unit converts the panoramic video into a spherical virtual reality video, and the video object inserting unit designates the plurality of landmark objects on a panoramic image that changes over time. Virtual reality video editing system, characterized by inserting an image object based on the landmark object. According to claim 1,
The panoramic image conversion unit,
A virtual reality image editing system characterized by converting the panoramic image into a spherical virtual reality image based on a responsive web-based application. In the method of editing a virtual reality image by a virtual reality image editing system implemented in the web,
A panoramic image acquisition step of obtaining a panoramic image;
A panoramic image conversion step of converting the panoramic image into a spherical virtual reality image;
An image object insertion step of inserting an image object into the virtual reality image from a user;
A playback content designation step of inserting playback content connected to the inserted video object; And
A play content setting step of setting a play attribute of the play content; Virtual reality video editing method comprising a. The method of claim 13,
The playback content setting step,
And setting a playback content area to set a playback range of the playback content in the virtual reality video based on the inserted video object. The method of claim 14,
The playing content area setting step,
A virtual reality video editing method comprising setting a playback range of the reproduced content using a spherical coordinate system. The method of claim 15,
The playback range,
The range in which the playback content is played and the user can recognize playback of the playback content,
When the user's point of view is out of the playback range, the playback of the playback content is stopped, or the playback volume of the playback content is muted. The method of claim 16,
A method of editing a virtual reality image, wherein the volume of reproduction of the reproduced content is linearly or nonlinearly reduced while the user's viewpoint is moved from the center of the reproduction range to a boundary area of the reproduction range. The method of claim 17,
When a plurality of the video objects are inserted, at least one playback content is excluded by comparing the playback volumes of the respective playback contents connected to the video objects, except for playback contents having a higher playback volume among the playback contents. A method of editing a virtual reality image, wherein playback is stopped or the playback volume of the playback content is muted. The method of claim 14,
The playback content setting step,
And an object change setting step set by an operation of the image object according to a reproduction operation of the reproduced content. The method of claim 19,
In the object change setting step,
Set a frame change degree of the video object connected to the playback content when the playback operation of the playback content is being played,
When the playback operation of the playback content is stopped, one of the video objects is set to be output,
And when the playback operation of the playback content is a pause and mute operation, a preset video object is set to be output. The method of claim 13,
The step of inserting the image object,
A virtual reality image editing method characterized by inserting an image object into the virtual reality image using an Euler Angle parameter. The method of claim 13,
The panoramic image acquisition step,
It is determined whether the obtained panoramic image is a panoramic image and a panoramic video, and performing one of a panoramic image editing mode and a panoramic video editing mode based on the determined result. Characteristic virtual image editing method. The method of claim 22,
When the determined result is the panoramic image editing mode,
The step of converting the panoramic image converts the panoramic image into a spherical virtual reality image, and the step of inserting the image object inserts an image object into a stationary virtual reality image,
When the determined result is the panoramic video editing mode,
The panoramic image conversion step converts the panoramic video into a spherical virtual reality video, and the video object insertion step designates a plurality of landmark objects on a panoramic image that changes over time and is designated. A virtual reality image editing method, characterized by inserting an image object based on the plurality of landmark objects. The method of claim 13,
In the panoramic image conversion step,
A virtual reality image editing method characterized by converting the panoramic image into a spherical virtual reality image based on a responsive web-based application.

Images