KR101830786B1 - Apparatus for generating script, apparatus for playing video, and method for controlling screen relating to video based on 360 degree - Google Patents

Abstract

A method of controlling a 360-degree moving picture according to an exemplary embodiment of the present invention includes the steps of: determining whether a script matching a video data photographed by a 360-degree camera exists; if there is a script matching the video data, And controlling the camera view according to the control information when the control information of the script corresponding to the frame exists while the video data is being reproduced.

Description

TECHNICAL FIELD [0001] The present invention relates to a script generating apparatus, a moving picture reproducing apparatus, and a screen control method for a 360-degree moving picture. BACKGROUND OF THE INVENTION 1. Field of the Invention [0002]

The present invention relates to a script generating apparatus, a moving picture reproducing apparatus, and a screen control method for a 360 degree moving picture, and more particularly, to a script generating apparatus, a moving picture reproducing apparatus, and a screen control ≪ / RTI >

In recent years, with the widespread use of mobile devices, especially smartphones, a variety of functions to be mounted on mobile devices are being developed in accordance with the increasing demands of users. Conventionally, cameras are generally photographed at a viewing angle of about 180 degrees or less. Recently, a camera capable of photographing at a viewing angle of 360 degrees has been developed, and contents photographed with such cameras have been circulated.

Particularly, an image photographed at a viewing angle of 360 degrees can be reproduced through a VR (Virtual Reality) device of the latest mobile devices. Since a viewing angle of a person is limited to about 160 or less, Special operations are required to view images of other fields of view.

VR devices currently commercially available are mounted on the head of a user and adopt a method of sensing a direction of a head of a user (head tracking) and reproducing an image corresponding to the direction in a user's field of view. Therefore, the user must directly rotate the head to view the image of the desired field of view, so that dizziness and vomiting may occur when the screen is switched due to excessive hair movement.

In addition, since the three-dimensionally provided image does not show a necessary or important scene, it may be difficult to follow the story or flow of the image.

The present invention provides a script generating apparatus, a moving picture reproducing apparatus, and a screen control method for a 360-degree moving picture, which provide viewing according to a story or a flow of a picture without inconveniencing a user when viewing a 360-degree moving picture.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not intended to limit the invention to the precise forms disclosed. It will be possible.

According to an aspect of the present invention, there is provided a method of controlling a screen for a 360-degree moving image, the method comprising: determining whether a script matching the image data photographed by the 360-degree camera exists; Synchronizing the script and the image data when a script matching the image data exists; And controlling the camera view according to the control information when the control information of the script corresponding to the frame is present during the reproduction of the image data.

The determining whether the script exists may include determining whether the meta information included in the image data matches the meta information included in the script.

According to an embodiment, the control information includes at least one of a sync frame, which is a number of a target frame to be controlled, a view point that is a center point coordinate of a view, a viewing angle that is a width of the view field, .

According to an embodiment, the view action may be at least one of a start of screen movement, a screen movement end, a screen change, a zoom in, a zoom out, a fade in, and a fade out.

According to an embodiment of the present invention, the step of controlling the camera view according to the control information includes: when the view action is the start of the screen movement, searching for the control information that the view action is the first screen movement end after the control information; And calculating a view point for a frame between the frame corresponding to the retrieved control information and the frame corresponding to the control information based on the retrieved control information and the control information.

According to an embodiment of the present invention, the step of calculating the viewpoint may include calculating a value obtained by subtracting a viewpoint of the control information from a viewpoint of the searched control information, by subtracting a synchronization frame of the control information from a synchronization frame of the searched control information Calculating a screen moving speed by dividing the screen moving speed by a value; And calculating a view point for a frame between a frame corresponding to the retrieved control information and a frame corresponding to the control information based on the screen moving speed.

The moving picture reproducing apparatus according to an embodiment of the present invention includes: a script matching determining unit for determining whether a script matching the image data photographed by the 360-degree camera exists; And synchronizing the script and the image data when there is a script matching the image data, and when there is control information of the script corresponding to a frame during reproduction of the image data, controlling the camera view according to the control information And a moving picture reproducing unit.

The script generating apparatus according to an embodiment of the present invention provides a user interface for generating a script including control information for controlling a camera view of image data photographed by a 360 degree camera and meta information for matching the image data And can generate a script arbitrarily set by a user through the user interface.

According to the script generating apparatus, the moving picture reproducing apparatus, and the screen control method for the 360 degree video according to the embodiment of the present invention configured as described above, even if the user does not need to rotate the head directly, The screen control can be performed so as to experience a dramatic screen configuration without missing the screen display. In addition, a user may feel less tired of listening to content.

In addition, various scripts can be produced for each script producer for the same 360 degree video, and a completely different storytelling can be implemented for each script.

Also, in the viewpoint of a video producer, it is possible to implement a role of a master / slave cockpit which indicates the position of each camera angle by using a script for an image shot by a single 360-degree camera, thereby achieving cost reduction .

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram illustrating a 360-degree moving image providing system according to an embodiment of the present invention.
2 is a detailed block diagram of the moving picture reproducing apparatus shown in FIG.
3 is a diagram showing one frame of a 360-degree image.
4 is a diagram illustrating a script according to an exemplary embodiment of the present invention.
FIG. 5 is a detailed view of the meta information shown in FIG.
FIG. 6 shows the control information shown in FIG. 4 in more detail.
7 to 10 are exemplary diagrams for explaining a screen control method of a 360-degree moving picture according to an embodiment of the present invention.
11 is a flowchart illustrating a method of controlling a screen of a 360-degree image according to an embodiment of the present invention.

Hereinafter, at least one embodiment related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

1 is a block diagram illustrating a 360-degree moving image providing system according to an embodiment of the present invention. 2 is a detailed block diagram of the moving picture reproducing apparatus shown in FIG.

1 and 2, the 360-degree moving image providing system 10 may include a moving image photographing device 50, a script generating device 70, and a moving image reproducing device 100.

The moving picture photographing apparatus 50 is capable of photographing a 360-degree moving picture. The moving picture photographing apparatus 50 can photograph a moving picture at an angle of 360 degrees around the moving picture photographing apparatus 50. For example, the moving picture photographing apparatus 50 can photograph a moving picture at 360 degrees by photographing three moving pictures with 120 degrees of view angle at the same time, but the scope of the present invention is not limited thereto.

The moving picture photographing apparatus 50 can generate moving image data by capturing a moving image, and the moving image data may include meta information, image information, and voice information. The moving picture photographing apparatus 50 can transmit the picture data to the moving picture reproducing apparatus 100. [

Here, the meta information is information for identifying image data, the image information is information including pixel values constituting an image in a frame unit, and the audio information is audio information synchronized with the image. Here, the image information may be encoded in a specific format.

The script generating apparatus 70 can generate a script for controlling the screen of the image data in synchronization with the image data when the moving image photographing apparatus 50 reproduces the image data. The screen control by the script may include screen movement, screen switching, zoom out and zoom in, fade out and fade in, etc. However, The present invention is not limited thereto.

The script may include meta information for identifying image data to be synchronized and control information for frame-by-frame screen control.

The script generating apparatus 70 may provide a user interface for generating a script, and the script creator may generate a script capable of arbitrarily controlling the screen by reflecting his / her intention through the user interface .

That is, a plurality of scripts can be generated for one image data, and a completely different screen control can be performed depending on which script is synchronized with the image data.

The script generating device 70 can transmit the script to the moving picture reproducing apparatus 100. [

The moving picture reproducing apparatus 100 receives the image data and the script and reproduces the 360-degree image. The moving picture reproducing apparatus 100 may be implemented as a wearable device that is a VR device, but the scope of the present invention is not limited thereto. The detailed structure of the moving picture reproducing apparatus 100 will be described later with reference to FIG.

The moving picture reproducing apparatus 100 may include a moving picture storing unit 110, a script storing unit 120, a script matching determining unit 130, a moving picture reproducing unit 140, and an output unit 150.

The moving image storage unit 110 may store the image data received from the moving image photographing apparatus 50 and may transmit the image data to the moving image reproducing unit 140 at the request of the moving image reproducing unit 140. [

The script storage unit 120 may store a script received from the script generation apparatus 70 and may transmit the script to the script matching determination unit 130 at the request of the script matching determination unit 130. [

The moving picture storage unit 110 and the script storage unit 120 may be implemented as independent non-volatile memories, but they may be implemented in one memory.

When the script matching determination unit 130 receives the image data transmitted to the moving image playback unit 140, the script matching determination unit 130 may determine whether a script matching the image data among the scripts stored in the script storage unit 120 exists.

At this time, the script matching determination unit 130 may compare the meta information of the image data and the meta information of the script to determine whether or not to match the meta information.

According to an embodiment, when all the meta information of the image data matches the meta information of the script, the script matching determination unit 130 can determine that the image data and the script match.

According to another embodiment, when at least a part of the meta information of the script coincides with the image data, the script matching determination unit 130 may determine that the image data matches the script.

If there is one script to be matched with the image data, the script matching determination unit 130 may transmit the script to the moving image playback unit 140.

If there are a plurality of scripts matching the video data, the script matching determination unit 130 may transmit a script having high priority information among the information included in the meta information to the video playback unit 140 . Here, when a plurality of scripts having matching information of high priority are present, the script can be determined in such a manner as to search for a script whose information of the next order matches. The priority order can be arbitrarily set by the system administrator of the moving picture reproducing apparatus 100.

According to another embodiment, the script matching determination unit 130 displays a menu through the output unit 150 that allows a user to select which script among the plurality of scripts is appropriate, and displays the menu through a separate input interface A user input may be received and a script matched with the image data may be determined.

The script matching determination unit 130 may transmit the script that matches (or most appropriate) the image data to the moving image playback unit 140. [

The moving image playback unit 140 may convert the received image data into a format that can be played back through the output unit 150 to generate output data. The moving picture reproducing unit 140 may include a decoder for format conversion.

The video data received by the moving picture reproducing unit 140 corresponds to a 360 degree image and the display of the output unit 150 can display a reproduction screen having a constant resolution within a range that can be viewed by the user. Therefore, the output data transmitted to the output unit 150 is data that can be displayed as a playback screen, and corresponds to a part of one frame of the 360-degree video.

If the video reproducing unit 140 receives a script matching with the received video data from the script matching determining unit 130, the video reproducing unit 140 synchronizes the video data with the script, The determined screen can be determined as the output data.

In addition, when the moving picture reproducing unit 140 receives a signal for controlling the screen from the user, the screen determined in accordance with the signal for screen control may be determined as output data in preference to the script. According to another embodiment, even if the moving picture reproducing unit 140 receives a signal for controlling the screen from the user, the screen determined according to the script in preference to the signal for controlling the screen may be determined as the output data.

When the moving picture reproducing apparatus 100 is implemented as a wearable device, the signal for controlling the screen may be a head tracking signal that senses the head movement of the user.

The output unit 150 may include a display for providing a screen to the user and a speaker for providing sound to the user. Since the embodiment of the present invention is for screen control of a 360-degree image, a description of portions related to audio will be omitted herein.

1, the moving picture photographing apparatus 50, the script generating apparatus 70, and the moving picture reproducing apparatus 100 may be implemented in separate independent configurations, but the scope of the present invention is not limited thereto, The devices can be integrated into one device.

3 is a diagram showing one frame of a 360-degree image.

Referring to FIG. 3, a frame indicates a frame representing a scene captured at the same time in a 360-degree image.

The horizontal axis of the frame has coordinates of 0 DEG to 360 DEG, and the vertical axis of the frame has coordinates of 0 DEG to 180 DEG. This is because the 360-degree image is an image captured by a camera having an angle of view of 360 degrees to the left and right and an angle of view of 180 degrees upward and downward.

In terms of sphere, the coordinates of the horizontal axis correspond to the longitude, and the coordinates of the vertical axis correspond to the latitude. That is, a point on the surface of a unit sphere with a radius of 1 is represented by θ (between 0 and 360 degrees) corresponding to hardness and φ corresponding to latitude (between -90 degrees and 90 degrees Quot; value "). UV mapping is a process of converting the coordinates on the surface of such a three-dimensional sphere into two dimensions, where u is the coordinate of the abscissa axis and v is the coordinate of the ordinate axis and has a value between 0 and 1, .

[Equation 1]

(u, v) = (? / 360, (sin? + 1) / 2)

The coordinates of the horizontal axis and the coordinates of the vertical axis in the frame may be calculated by UV mapping, but for convenience of description, the abscissa of the frame has coordinates of 0 ° to 360 ° for convenience of description, Will have a coordinate of 0 DEG to 180 DEG.

As described above, the output data transmitted to the output unit 150 corresponds to a portion of one frame of a 360-degree image, which can be displayed as a playback screen.

Assuming that the 360-degree image is a frame, the output data corresponds to a field of view (FOV) shown in FIG. Assuming that the ratio of the horizontal to vertical length of the field of view FOV is fixed (for example, 4: 3), the field of view FOV can be defined as a view point VP and a view angle AG .

The view point VP means the center point coordinate of the field of view FOV and the viewing angle AG means the width of the field of view FOV. That is, as the view point VP moves up and down and / or horizontally, the field of view FOV also moves. In addition, as the viewing angle AG increases, the field of view (FOV) increases. Since the size of the playback screen is constant, the effect of reducing the screen (or zooming out of the camera) appears. On the contrary, the smaller the viewing angle AG is, the smaller the field of view FOV becomes. Since the size of the reproduction screen is constant, the effect of enlarging the screen (or the effect of zooming the camera) appears.

For example, the field of view (FOV) shown in FIG. 3 may be a field of view defined by a view point of (180, 90) and a viewing angle of 90.

4 is a diagram illustrating a script according to an exemplary embodiment of the present invention. FIG. 5 is a detailed view of the meta information shown in FIG. FIG. 6 shows the control information shown in FIG. 4 in more detail.

4 to 6, the script 400 may include meta information 410 and at least one control information 420-1 to 420-n (n is an integer of 1 or more). Here, n is a number that can be arbitrarily determined by the maker of the script, and n can have a value equal to or less than the total number of frames. Each piece of control information corresponds to one frame, and the number of frames corresponding to each piece of control information can be increased from 1 to n.

The meta information 410 includes a total frame (TF), a bit rate (BR), a view distance (VD), a video title (VN) .

The total frame TF means the total number of frames included in the image data or the total reproduction time and the bit rate BR means the number of processed bits per second (unit: Mbps), which is a value indicating the quality of the image data.

The view distance VD means the diagonal length of the entire frame and can be expressed in pixel units.

The video title VN means the title of the video data (for example, 'daily life of my family members'), and the encoding standard EN means a standard (for example, H.264) in which video data is encoded.

At least one piece of control information 420-1 to 420-n has the same format, and representative control information 420 having this format is shown in FIG.

The control information 420 may include a sync frame (SF), a view point (VP), a view angle (AG), and a view action (VA). The type, data size, and order of each item included in the control information 420 can be defined by a predefined protocol, and can be modified at any time without being limited to the control information 420 shown in FIG.

The synchronous frame (SF) means a number of a target frame to which the control information 420 is to be controlled. For example, the frame number can be any one of 1 to 10000 when the total frame number is 10,000. The frames included in the image data may have a frame number sequentially incremented by one.

The view point VP and the viewing angle AG are the same as those shown in FIG. 3, and a duplicate description thereof will be omitted.

The view action VA is information indicating the type of the screen control and includes, for example, Start (Start of Screen Movement), End (End of Screen Movement), Change (Change of Screen), Zoom-in, Zoom- Out), Fade-in (fade-in), and Fade-out (fade-out). It is to be understood that the values listed above are exemplary only, and values for other kinds of screen control can be included in the view action VA. In addition, each piece of information (e.g., Start) can be identified by a corresponding scalar value (e.g., 0, 1, etc.).

Start (start of screen movement) means that the screen movement starts from the corresponding synchronous frame, and End (end of screen movement) means that the screen movement ends in the corresponding synchronous frame.

Change (change of screen) means that the screen is switched (the current frame is switched to a completely different view from the previous frame) in the corresponding sync frame.

Zoom-in and Zoom-out mean that the viewing angle AG becomes smaller or larger, respectively.

The Fade-in (Fade-in) and Fade-out (Fade-out) mean that the field of view FOV gradually increases and the screen is switched or gradually darkened and the screen is switched. It is possible to perform screen control by adjusting the contrast of a plurality of pixels. The fade-in and fade-out may further include information indicating the start or end of each of the fade-in (fade-in) and fade-out (fade-out) . Or Fade-in (fade-in) and Fade-out (fade-out) may further include values for adjusting the contrast (for example, + 2% or -2%).

7 to 10 are exemplary diagrams for explaining a screen control method of a 360-degree moving picture according to an embodiment of the present invention.

7 to 10, a description will be made of a process in which screen control of a 360-degree moving picture is performed by a script.

In the first frame F1 of FIG. 7, the shape of the room, the cat C and the dog 1 (D1) are included. Assuming that the frame number of the first frame F1 is 600, the first control information CI1 for controlling the first frame F1 is as shown in Fig.

That is, the first control information CI1 includes 600 synchronous frames (SF), a view point VP of 50 and 100, a viewing angle AG of 85, and a view action VA of Start, respectively.

Therefore, the moving picture reproducing unit 140 has the view point of the first frame F1 having the frame number 600 of (50,100), the viewing angle AG of 85, Lt; / RTI >

In the second frame F2 of FIG. 8, the shape of the room, the cat C and the dog 1 (D1) moved in comparison with FIG. 7 are included. Assuming that the frame number of the second frame F2 is 700, the second control information CI2 for controlling the second frame F2 is as shown in Fig.

That is, the second control information CI2 includes 700 synchronous frames (SF), a view point VP of 150 and 100, a viewing angle AG of 85, and a view action VA of End, respectively.

Therefore, the moving picture reproducing unit 140 has the view point of the second frame F2 having the frame number 700 of (150,100), the viewing angle AG of 85, Lt; / RTI >

That is, the script can instruct the screen control to start screen movement in the first frame F1 and end screen movement in the second frame F2.

At this time, the control information may be included in the script so that the abscissa of the viewpoint is gradually increased for each of the frames having the frame numbers 601 to 699.

However, in this case, since the file capacity of the script itself greatly increases, it may inconvenience the script maker. Therefore, the script may include the first control information CI1 for the first frame F1 and the second control information CI2 for the second frame F2 2 < / RTI > control information CI2 may be included. The moving picture playback unit 140 can calculate the screen moving speed of the view point VP according to the flow of the frame based on the first control information CI1 and the second control information CI2, The viewpoint VP of each of the frames existing between the first frame F1 and the second frame F2 can be calculated.

For example, in the example of FIGS. 7 and 8, the moving picture playback unit 140 determines that the view action (VA) of the first control information (CI) is Start and that the screen movement starts in the first frame (F1) Able to know. The moving picture reproducing unit 140 searches the control information having the end view action VA for the first time after the first control information CI1 and the first control information CI2 from the view point The value obtained by subtracting the viewpoint (abscissa) of the information CI1 from the synchronous frame of the second control information CI2 by the value obtained by subtracting the synchronous frame of the first control information CI1, Moving coordinates) can be calculated. The moving picture reproducing unit 140 may calculate the view point VP of each of the frames existing between the first frame F1 and the second frame F2 based on the screen moving speed. That is, since the screen moving speed is constant, the screen can be moved at a constant speed according to the progress of the frame from the view point of the first frame F1 to the view point of the second frame F2.

According to another embodiment, the first control information CI1 includes the screen moving speed, and the moving picture reproducing unit 140 can calculate the view point of each frame on the basis of it.

According to yet another embodiment, the moving picture playback unit 140 may calculate the viewpoint of each frame based on the first control information CI1 including the screen moving speed at which the first control information CI1 varies as the frame progresses. For example, various effects can be produced by setting the screen moving speed at 600 to 700 frames and the screen moving speed at 700 to 800 frames differently.

7 and 8 illustrate only the screen movement in the horizontal direction. However, even when the screen is moved in the diagonal direction, the horizontal axis direction calculation and the vertical axis direction calculation are performed to realize the screen movement in the diagonal direction .

In the third frame F3 of Fig. 9, the shape of the room and the puppy 2 (D2) are included in addition to the cat (C) and the puppy 1 (D1). Assuming that the frame number of the third frame F3 is 800, the third control information CI3 for controlling the third frame F3 is as shown in Fig.

That is, the third control information CI3 includes 800 synchronous frames (SF), a view point VP of 270 and 100, a viewing angle AG of 85, and a view action VA of Change, respectively.

Accordingly, the moving picture reproducing unit 140 has the viewpoint of the third frame F3 having the frame number 800 of (270, 100), the viewing angle AG of 85, and the output data Can be generated.

That is, the screen is controlled so that the puppy 2 (D2) suddenly appears on the screen in the third frame F3.

In the fourth frame F4 in Fig. 10, the dog 2 (D2) is included in addition to the shape of the room, the cat C and the dog 1 (D1). Assuming that the frame number of the fourth frame F4 is 900, the fourth control information CI4 for controlling the fourth frame F4 is as shown in Fig.

That is, the fourth control information CI4 includes 900 synchronous frames (SF), a view point VP of 270 and 100, a viewing angle AG of 65, and a view action VA of Zoom-in, respectively.

Therefore, the moving picture reproducing unit 140 has the view point of the fourth frame F4 with the frame number 900 having the coordinates of (270,100), the viewing angle AG having the angle of 65, and the output data Can be generated.

That is, the screen control is performed so that the puppy 2 (D2) is enlarged in the fourth frame F4.

Therefore, by the script including the first to fourth control information CI1 to CI4, the screen control illuminates the puppy 1 (D1) and moves to the right as the puppy 1 (D1) moves to the right, The pupil 2 (D2) may be switched so as to illuminate the puppy 2 (D2) in accordance with the appearance of the puppy 2 (D2) and enlargedly puppy 2 (D2).

If a script other than the script shown in FIGS. 7 to 10 (for example, a script produced with the cat (C) as the protagonist), a screen of a completely different story can be provided to the user.

11 is a flowchart illustrating a method of controlling a screen of a 360-degree image according to an embodiment of the present invention.

Referring to FIG. 11, in response to a user's request, the moving image playback unit 140 starts playback of a 360-degree moving image and can read the corresponding image data from the moving image storage unit 110 (S10).

When the image data is transmitted from the moving image storage unit 110 to the script matching determination unit 130, the script matching determination unit 130 determines whether a script matching the image data among the scripts stored in the script storage unit 120 exists (S20).

The script matching determination unit 130 compares the meta information of the image data and the meta information of the script with each other, and determines whether the meta information matches or not according to whether the meta information matches the meta information of the script (S30).

If there is no script that matches the image data among the scripts (NO in S30), the moving image playback unit 140 can generate output data regardless of the script and play it through the output device 150 (S40 ).

If there is a script matching the image data among the scripts (NO in S30), the moving image playback unit 140 receives the script from the script matching determination unit 130 and can synchronize the image data with the script ( S50).

Here, the synchronization refers to an operation of matching the frame number between the image data and the script, and matching the field of view (VP) included in the script and the field of view (FOV) according to the viewing angle AG with the image data.

When the synchronization is completed, the moving picture playback unit 140 starts playback of the video data and can determine whether the control information of the corresponding frame exists in the script synchronized with the frame of the video data being played (S60).

If there is control information of the corresponding frame, the camera view, that is, the field of view (FOV) may be controlled according to the control information (S70).

If the control information of the corresponding frame does not exist or the camera view control according to the control information is completed, the moving picture reproducing unit 140 may generate output data based on the script and reproduce it through the output device 150 (S80 ).

The moving picture reproduction in step S80 is performed on a frame-by-frame basis, and step S60 may be performed again for the next frame.

According to the screen control method according to an embodiment of the present invention, screen control can be performed so that a dramatic screen configuration can be experienced without missing a story or an important scene of a 360-degree image without the need for the user to directly rotate the head. In addition, a user may feel less tired of listening to content.

In addition, various scripts can be produced for each script producer for the same 360 degree video, and a completely different storytelling can be implemented for each script.

Also, in the viewpoint of a video producer, it is possible to implement a role of a master / slave cockpit which indicates the position of each camera angle by using a script for an image shot by a single 360-degree camera, thereby achieving cost reduction .

The method described above can be implemented as computer-readable code on a computer-readable recording medium. The computer-readable recording medium includes all kinds of recording media storing data that can be decoded by a computer system. For example, it may be a ROM (Read Only Memory), a RAM (Random Access Memory), a magnetic tape, a magnetic disk, a flash memory, an optical data storage device, or the like. In addition, the computer-readable recording medium may be distributed and executed in a computer system connected to a computer network, and may be stored and executed as a code readable in a distributed manner.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the appended claims. It will be understood that various modifications and changes may be made.

Claims (15)

Determining whether a script matching the image data photographed by the 360-degree camera exists;
Synchronizing the script and the image data when a script matching the image data exists; And
Controlling the camera view according to the control information when the control information of the script corresponding to the frame is present during playback of the video data,
Wherein the script includes meta information for identifying image data to be synchronized and control information for frame-by-frame screen control,
Wherein the synchronization is performed by matching a frame number between the image data and the script, and matching the control information included in the script with the image data. The method according to claim 1,
Wherein the step of determining whether the script exists,
And determining whether the meta information included in the image data and the meta information included in the script coincide with each other. The method according to claim 1,
Wherein the control information includes at least one of a sync frame, which is a number of a target frame to be controlled, a view point that is a center point coordinate of a view, a viewing angle that is a width of the view field, Screen control method. The method of claim 3,
Wherein the view action is at least one of starting a screen movement, ending a screen movement, switching screens, zooming in, zooming out, fading in, and fading out. 5. The method of claim 4,
Wherein the step of controlling the camera view according to the control information comprises:
If the view action is the start of the screen movement, searching the control information that the view action is the end of the screen movement first after the control information; And
And calculating a view point for a frame between a frame corresponding to the searched control information and a frame corresponding to the control information based on the searched control information and the control information. 6. The method of claim 5,
Wherein the step of calculating the viewpoint comprises:
Calculating a screen movement speed by dividing a value obtained by subtracting a view point of the control information from a view point of the searched control information, by dividing a value obtained by subtracting a synchronization frame of the control information from a synchronization frame of the searched control information; And
And calculating a view point of a frame between a frame corresponding to the searched control information and a frame corresponding to the control information based on the screen moving speed. A script matching determination unit that determines whether a script matching the image data photographed by the 360 degree camera exists; And
And synchronizing the script and the image data when there is a script matching the image data and controlling the camera view according to the control information when the control information of the script corresponding to the frame during the reproduction of the image data exists A moving picture reproducing unit,
Wherein the script includes meta information for identifying image data to be synchronized and control information for frame-by-frame screen control,
Wherein the synchronization is an operation of matching the frame number between the video data and the script and matching the control information included in the script with the video data. 8. The method of claim 7,
Wherein the script matching determination unit
And judges whether the meta information included in the video data matches meta information included in the script. 8. The method of claim 7,
Wherein the control information includes at least one of a sync frame which is a number of a target frame to be controlled, a view point which is a center point coordinate of a view, a viewing angle which is a width of the view field, and a view action which is a kind of a screen control. 10. The method of claim 9,
Wherein the view action is at least one of starting a screen movement, ending a screen movement, switching screens, zooming in, zooming out, fading in, and fading out. 11. The method of claim 10,
Wherein the moving picture playback unit comprises:
When the view action is the start of the screen movement, the control information in which the view action is the first screen movement end after the control information,
And calculates a view point for a frame between a frame corresponding to the searched control information and a frame corresponding to the control information based on the searched control information and the control information. 12. The method of claim 11,
Wherein the moving picture playback unit comprises:
Calculating a scrolling speed by dividing a value obtained by subtracting a view point of the control information from a view point of the searched control information by a value obtained by subtracting a synchronous frame of the control information from a slave frame of the searched control information,
And calculates a view point for a frame between a frame corresponding to the searched control information and a frame corresponding to the control information based on the screen moving speed. There is provided a user interface for generating a script including control information for controlling a camera view of image data photographed by a 360-degree camera and meta information for matching the image data, and the user interface is arbitrarily set by a user through the user interface Generate scripts,
Wherein the script is synchronized with the image data to control a camera view of the image data,
Wherein the synchronization is an operation of matching the frame number between the image data and the script, and matching the control information included in the script with the image data. 14. The method of claim 13,
Wherein the control information includes at least one of a sync frame, which is a number of a target frame to be controlled, a view point that is a center point coordinate of a view, a viewing angle that is a width of the view field, and a view action that is a type of screen control. 15. The method of claim 14,
Wherein the view action is at least one of starting a screen movement, ending a screen movement, switching screens, zooming in, zooming out, fading in, and fading out.

Images