KR20130077246A - Method and system for reducing excessive process of panorama moving picture by cpu on smart-tv - Google Patents

Abstract

PURPOSE: An excessive processing reduction method by a central processing unit (CPU) in replaying a panorama moving picture on a smart device and an excessive processing reduction system are provided to prevent load due to excessive processing of the CPU generated in replaying a dedicated replaying program. CONSTITUTION: A photographing device records a 360 degree moving picture file for a subject, and adds each image data generated according to the recording into one image (S1). The photographing device performs real-time encoding for the moving picture file (S2). The photographing device divides and transmits a generated source moving picture (S3). A broadcast transmission system receives panorama moving picture request from a set top box (STB), and assembles the divided source moving picture and then transmits the assembled image to the set top box (S4,S5). [Reference numerals] (AA) Start; (BB) End; (S1) Record and blend a 360 degree video clip on a real time basis; (S2) Generate a source video clip by incoding the blended 360 degree video clip on a real time basis; (S3) Divide the source video clip and transmit it to a broadcast system; (S4) Transmit a set top box's request for a panorama video clip to the broadcast system; (S5) Combine the source video clips and transmit the result to the set top box

Description

Method for reducing excessive process by transient and reducing processing by CPU during playback of panoramic video on smart device {Method and system for reducing excessive process of panorama moving picture by CPU on smart-TV}

The present invention relates to a transient processing alleviation method and a transient processing alleviation system by a CPU when playing a panoramic video on a smart device, and more particularly, to a smart TV connected to a set-top box using a 360-degree video file provided from a photographing apparatus. The present invention relates to a transient processing alleviation method and a transient processing alleviation system by the CPU during panorama video playback on a smart device for preventing a load caused by excessive processing of the set-top box CPU when playing back the panoramic video.

In the way of realizing the panoramic video, it is evolving into the social trend of seeing the 360-degree panoramic video in the future through the way of viewing the three-dimensional video screen from the conventional two-dimensional video screen. This 360-degree panoramic video will contribute to the development of the media industry.

On the other hand, since the 360-degree panoramic video processing method on a conventional mobile terminal and smart devices, such as about 30 frames per second, the CPU occupies excessively when the panoramic video is viewed. That is, in the player stage processing the panorama video, due to the overload due to the overload processing of the CPU and other processes in progress, there is a problem that the user is difficult to see other tasks.

Accordingly, in the technical field, hardware technology for processing 360-degree panoramic video is also important, but technology development for software for displaying panoramic images is required in view of cost reduction in place of hardware technology. As a result, the present invention is intended to improve the efficiency of the 360-degree panoramic video processing in accordance with the technical trend as well as solving the above problems.

[Related Technical Literature]

1. Method of generating and playing panoramic sound image, and apparatus for playing such image (Patent Application No. 10-2009-7024315)

2. Panorama image reproducing apparatus and panorama image reproducing method reflecting user's movement (Patent Application No. 10-2010-0022874)

The present invention is to solve the above problems, to prevent the load caused by excessive processing of the CPU occurs when playing a panorama video stored on a smart device in a dedicated playback program installed in the set-top box, the gap according to the performance of each smart device The present invention is to provide a transient processing alleviation method and a transient processing alleviation system by the CPU when playing a panoramic video on a smart device to reduce the number of videos.

In addition, the present invention, by notifying the CPU in advance in a fixed frame unit rather than real time during the playback of the panorama video, the transient by the CPU during panorama video playback on the smart device to eliminate the bottleneck threading phenomenon to the CPU register It is to provide a treatment mitigation method and a transient treatment mitigation system.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a transient processing alleviation method by the CPU when reproducing a panoramic video on a smart device according to an embodiment of the present invention comprises: a first apparatus which allows a photographing apparatus to divide a source video and transmit it to a broadcasting transmission system for storage; step; A second step of receiving, by the broadcast transmission system, the panoramic video request from the set-top box receiving the panoramic video request requested by the user with a remote controller, combining the divided and transmitted source videos to the set-top box through a communication network; And a third step of, by the set-top box, executing a playback program for playing the panoramic video on the smart TV for the source video, informing the CPU of the set-top box that the playback is in a fixed frame unit to replace real-time playback. Characterized in that it comprises a.

In the method for reducing transient processing by a CPU when playing back a panoramic video on a smart device according to another embodiment of the present invention, the first step is one in which the photographing apparatus records 360-degree video files through photographing a subject. Performing a blending operation to combine the image of the (a); (B) generating, by the photographing apparatus, the source video by performing real-time encoding on the blended 360 degree video file; And (c) the photographing apparatus dividing the source video and transmitting the divided source video to the broadcast transmitting system through the communication network so as to be separately stored in a database of the broadcasting transmitting system. Characterized in that it comprises a.

In the method of reducing transient processing by a CPU when playing a panoramic video on a smart device according to another embodiment of the present invention, in the third step, the CPU of the set-top box controls the network interface to transmit the broadcast through the communication network. Requesting a panorama video request from a system to receive the source video and storing the source video in a mass storage device (d); The CPU requesting execution on a system memory of a playback program for playing a panoramic video of a source video in which a first scene image or an nth scene image (n is a natural number of 2 or more) merged in the mass storage device is merged; Step (e); (F) calling a sphere function inside the playback program as the playback program is executed; And (g) in response to the spehre function call, informing the CPU that the delay function is immediately called by the own process of the playback program to replace the real time playback with the fixed frame unit. Characterized in that it comprises a.

In the method for reducing transient processing by a CPU when playing a panoramic video on a smart device according to another embodiment of the present invention, after the step (g), the CPU threading a bottleneck to a CPU register according to a forced call of the delay function. Initiating work to mitigate the phenomenon; And further comprising:

In the method for reducing excessive processing by a CPU when playing back a panoramic video on a smart device according to another embodiment of the present invention, after the step (h), the CPU outputs the panoramic video to a smart TV connected to an I / O interface. (I) setting a frame processing cycle per second for the source video stored in the mass storage device at a predetermined output frame value; And further comprising:

According to another embodiment of the present invention, a method for reducing excessive processing by a CPU when a panoramic video is played on a smart device includes: a first step of allowing a photographing apparatus to divide a source video and transmit the divided video to a swap server; In response to receiving the panoramic video request from the mobile terminal, the swap server combines the divided source video and transmits the combined source video to the mobile terminal through a mobile communication network; And a third step of executing, by the mobile terminal, a reproduction program for reproducing the panorama video for the source video, informing the CPU of the mobile terminal that the reproduction is in a fixed frame unit to replace real-time playback. Characterized in that it comprises a.

In the method for reducing transient processing by a CPU when playing back a panoramic video on a smart device according to another embodiment of the present invention, the first step is one in which the photographing apparatus records 360-degree video files through photographing a subject. Performing a blending operation to combine the image of the (a); (B) generating, by the photographing apparatus, the source video by performing real-time encoding on the blended 360 degree video file; And (c) dividing the source video by the photographing apparatus and transmitting the divided video to the swap server through a wired communication network so as to be separately stored in a database of the swap server. Characterized in that it comprises a.

In the method of reducing transient processing by a CPU when playing a panoramic video on a smart device according to another embodiment of the present invention, the third step may include: controlling, by the CPU of the mobile terminal, a wireless transmitting / receiving apparatus to control the wireless transmission / receiving device through the mobile communication network. Requesting a panoramic video request from a swap server to receive the source video and storing the source video in a mass storage device (d); The CPU requesting execution on a system memory of a playback program for playing a panoramic video of a source video in which a first scene image or an nth scene image (n is a natural number of 2 or more) merged in the mass storage device is merged; Step (e); (F) calling a sphere function inside the playback program as the playback program is executed; And (g) in response to the spehre function call, informing the CPU that the delay function is immediately called by the own process of the playback program to replace the real time playback with the fixed frame unit. Characterized in that it comprises a.

According to an embodiment of the present invention, a system for reducing excessive processing by a CPU when a panoramic video is played on a smart device includes: a photographing apparatus for dividing and transmitting a source video generated by photographing a subject; A broadcast transmission system for receiving and storing the divided and transmitted source video; And physically connected to a smart TV, and transmits the panoramic video request requested by the user to the broadcast transmission system through the remote control, and receives the source video in the divided state through the communication network in a combined state by the broadcast transmission system. And a set-top box configured to internally perform notification of reproduction of a fixed frame unit in which a real-time reproduction is replaced by a CPU when executing a reproduction program for reproducing a panorama video for the source video. Characterized in that it comprises a.

In the system for reducing the transient processing by the CPU when playing back a panoramic video on a smart device according to another embodiment of the present invention, the photographing apparatus is configured to combine one image according to 360-degree video file recording through photographing the subject. After performing a blending operation, the source video is generated by performing real-time encoding on the blended 360 degree video file.

According to another embodiment of the present invention, a system for reducing transient processing by a CPU when a panoramic video is played on a smart device, the set top box comprising: a network interface unit configured to transmit and receive signals and data to and from the broadcast transmission system through the communication network; A short range communication unit configured to receive a control signal for a panoramic video request from the remote controller through a short range wireless communication method so that the panoramic video request is transmitted to the broadcast transmission system through the network interface unit; An I / O interface that is physically connected to the smart TV and is responsible for outputting each pixel of the smart TV to play a panoramic video of the source video; A mass storage device storing the source video received from the network interface unit; A system memory in which a playback program for playing the panoramic video resides; And the CPU requesting execution of the playback program for the source video in which the first to nth scene images (n is two or more natural numbers) stored in the mass storage device are merged. And a fixed frame for which a delay function is immediately called by a process of the playback program's own process and replaces real-time playback to the CPU when the sphere function inside the playback program is called as the playback program is executed. And notifying that the unit is playing.

In a system for reducing excessive processing by a CPU when playing a panoramic video on a smart device according to another embodiment of the present invention, the CPU is a bottleneck threading phenomenon for an internal high-speed memory CPU register according to a forced call of the delay function. It is characterized by initiating work for mitigation.

In the system for reducing the transient processing by the CPU during playback of the panoramic video on the smart device according to another embodiment of the present invention, the CPU, when outputting the panoramic video to the smart TV for the source video stored in the mass storage device The frame processing cycle per second is set to a preset output frame value.

In the system for reducing the transient processing by the CPU when playing a panoramic video on a smart device according to another embodiment of the present invention, the CPU outputs a preset output sample rate of the source video when the panoramic video is output to the smart TV. It is characterized by setting the sample rate value.

In the system for reducing transient processing by a CPU when playing a panoramic video on a smart device according to another embodiment of the present invention, the short range communication unit may be based on any one of ZigBee, Bluetooth, infrared, and WiFi in a short range wireless communication method. It is done.

According to another embodiment of the present invention, a system for reducing excessive processing by a CPU when a panoramic video is played on a smart device includes: a photographing apparatus for dividing and transmitting a source video generated by photographing a subject; A swap server for receiving and storing the divided and transmitted source video; And transmitting a panoramic video request to the swap server to receive a source video including the divided and transmitted source videos through a mobile communication network, and executing a playback program for playing the panoramic video for the source video in real time to the CPU. A mobile terminal for internally performing notification of reproduction of a fixed frame unit to replace reproduction; And a control unit.

According to another embodiment of the present invention, a system for reducing transient processing by a CPU when playing a panoramic video on a smart device, the mobile terminal comprising: a wireless transmission and reception device for transmitting and receiving signals and data with the swap server through the mobile communication network; A mass storage device for storing the source video received from the wireless transmission / reception device; A system memory in which a playback program for playing the panoramic video resides; And the CPU requesting execution of the playback program for the source video in which the first to nth scene images (n is two or more natural numbers) stored in the mass storage device are merged. And a fixed frame for which a delay function is immediately called by a process of the playback program's own process and replaces real-time playback to the CPU when the sphere function inside the playback program is called as the playback program is executed. And notifying that the unit is playing.

The transient processing alleviation method and the transient processing alleviation system by the CPU during playback of a panoramic video on a smart device according to an embodiment of the present invention provide an effect of preventing the load caused by excessive processing of the CPU generated during playback in a dedicated playback program. .

In addition, the transient processing alleviation method and the transient processing alleviation system by the CPU when the panorama video playback on the smart device according to an embodiment of the present invention, the effect of reducing the gap according to the performance of the smart device to allow the user to enjoy smooth panoramic video. to provide.

In addition, the transient processing alleviation method and the transient processing alleviation system by the CPU during the playback of the panoramic video on the smart device according to another embodiment of the present invention, by using a method of calling a delay function for the sphere function that occurs during playback of the panoramic video By notifying the CPU of a fixed frame unit rather than real time, the bottleneck threading of the CPU register can be effectively eliminated.

1 is a diagram illustrating a transient processing alleviation system by a CPU when playing a panoramic video on a smart TV among smart devices according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a configuration of the set top box of FIG. 1.
FIG. 3 is a diagram for describing a process of providing a source video for playing a panoramic video on the smart device of FIG. 1 and switching a spherical shape for playing the panoramic video.
4 is a flowchart illustrating a transient processing alleviation method by a CPU when a panoramic video is played on a smart TV according to an exemplary embodiment of the present invention.
5 is a flowchart illustrating a process performed in a set-top box of a transient processing alleviation method by a CPU when playing a panoramic video on a smart TV according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating a transient processing alleviation system by a CPU when playing a panoramic video on a mobile terminal among smart devices according to an embodiment of the present invention.
FIG. 7 is a diagram illustrating a configuration of a mobile terminal of FIG. 6.
8 is a flowchart illustrating a transient processing alleviation method by a CPU during panorama video playback on a mobile terminal according to an embodiment of the present invention.

Hereinafter, a transient processing alleviation method and a transient processing alleviation system by a CPU when a panoramic video is played on a smart TV according to embodiments of the present invention will be described with reference to the accompanying drawings.

The following embodiments are detailed description to help understand the present invention, and it should be understood that the present invention is not intended to limit the scope of the present invention. Therefore, equivalent inventions that perform the same functions as the present invention will also fall within the scope of the present invention.

In addition, in adding reference numerals to the constituent elements of the drawings, it is to be noted that the same constituent elements are denoted by the same reference numerals even though they are shown in different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In addition, in describing the component of this invention, terms, such as 1st, 2nd, A, B, (a), (b), can be used. These terms are intended to distinguish the constituent elements from other constituent elements, and the terms do not limit the nature, order or order of the constituent elements. When a component is described as being "connected", "coupled", or "connected" to another component, the component may be directly connected to or connected to the other component, It should be understood that an element may be "connected," "coupled," or "connected."

In the embodiment of the present invention, "communication", "communication network", "internet network" and "network" may be used as the same meaning. The three terms refer to wired and wireless local area and wide area data transmission and reception networks capable of transmitting and receiving a file between a user terminal, a terminal of another user, and a download server.

In the following description, the term "server or system" refers to a server computer to which users access to use contents. If the capacity is small or the number of users is small, a plurality of programs can be operated on one server. In addition, when the capacity is very large or the number of real-time access number is large, there may be more than one server for operating a system, depending on the function of the server.

1 is a diagram illustrating a transient processing alleviation system (1, first CPU transient processing alleviation system) by a CPU when a panoramic video is played on a smart TV among smart devices according to an embodiment of the present invention. Referring to FIG. 1, the first CPU processing alleviation system 1 includes a photographing apparatus 10, a broadcasting transmission system 20, a communication network 30, a remote controller 40, a set top box 50, and a smart TV 60. It includes. In the present invention, the smart TV 60 is described on the basis of the set-top box 50 and the separate type, it is possible to modify the set-top box 50 integrated.

The photographing apparatus 10 transmits the source video file generated by recording and encoding a 360 degree video file to the broadcast transmission system 20 directly or through a communication network 30 to the database 21 of the broadcast transmission system 20. To be split and stored.

Here, the reason for dividing and storing is to prevent leakage of the source video by illegal users such as hacking and macros.

The broadcast transmission system 20 is formed to provide broadcast transmission data to a plurality of terminals connected to the communication network 30 including the set-top box 50. In the present invention, the source video for panorama video playback is provided in a database. It is stored in 21.

The database 21 may refer to a functional structural combination of software and hardware for storing each piece of information. The database 21 may be implemented as at least one table, and may further include a separate database management system (DBMS) for searching, storing, and managing information stored in the database 21. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

Meanwhile, in the present invention, the broadcast transmission system 20 receives the divided video from the photographing apparatus 10 according to the panoramic video request from the set-top box 50 and combines the source video stored in the database 21 to communicate with the communication network 30. Provided through the set-top box 50 through.

The communication network 30 is a high-speed backbone network of a large communication network capable of large capacity, long distance voice and data service, and may be, for example, an Internet network. In addition, the communication network 20 may be a next-generation wired network for providing a high speed multimedia service based on ALL IP (Internet Protocol). The communication network 30 serves to transfer signals and data between the broadcast transmission system 20, the photographing apparatus 10, and other systems.

The remote controller 40 transmits and receives signals and data through the short-range wireless communication with the set-top box 50, and is used to input a panoramic video request by the user of the smart TV 60. On the other hand, the remote control 40 also performs the function of the input device, in this case may be provided with a plurality of input keys.

The set-top box 50 connects the data transmission session with the broadcast transmission system 20 through the communication network 30 according to the power-on of the smart TV 60 or execution of a pre-installed playback program, and then sends a panoramic video request to the broadcast transmission system. After receiving the source video for the playback of the panorama video by transmitting to 20, and outputs to the smart TV 60. Meanwhile, in one embodiment of the present invention, the playback program is performed based on the Flash equipped with the Adobe Flash engine Can be.

Accordingly, the set-top box 50 converts a plurality of scene images included in the source video into a spherical form by executing a playback program, and then outputs the structure and function of the set-top box 50. It will be described with reference to FIG.

2 is a diagram illustrating a configuration of the set-top box 50 of FIG. Referring to FIG. 2, the input / output bus 51, the transmission / reception module 52, the input device 53, the mass storage device 54, the CPU-memory bus 55 and the system memory 56, the CPU 57 and A CPU register 57a is included, and each component will be described in turn.

The input / output bus 51 physically connects the CPU 57 to the input device 53, the mass storage device 54, and the transmission / reception module 52 to enable transmission and reception of signals and data.

The transmission / reception module 52 includes a network interface unit 52a, a short range communication unit 52b, and an I / O interface 52c.

The network interface unit 52a transmits and receives signals and data with the broadcast transmission system 20 through the communication network 30.

The short range communication unit 52b receives a control signal from the remote controller 40 in a short range wireless communication method and transmits the control signal to the CPU 57 through the input / output bus 51.

As the short range wireless communication method used herein, Zigbee, Bluetooth, Infrared, and WiFi may be used.

The I / O interface 52c is physically connected to the smart TV 60 and is responsible for outputting each pixel of the smart TV 60 under the control of the CPU 55.

The input device 53 is formed to execute a conversation with the application program when executing one or more application programs existing in the system memory 56. As used herein, the term "application program" refers to the main part of functionality for processing information associated with a user in a wide range and presenting the information in a manner involving graphic or image generation or manipulation operations. These can be used interchangeably for simplicity of discussion.

On the other hand, the above-described function of the input device 53 can be replaced by the remote control 40 having a plurality of input keys.

The mass storage device 54 typically includes a read-only memory (ROM) and a hard drive for permanently storing the configuration information of the set-top box 50 and the smart TV 60 and additional portions of the basic operating system. It is formed as a disk and / or a CD-ROM drive.

The CPU-memory bus 55 performs the function of connecting the CPU 57 to the system memory 56.

System memory 56 typically includes the basic operating system and graphical user interface (GUI) portions of set-top box 50, so that volatile or random access memory (RAM) for temporary storage of information. It includes.

In the present invention, when a playback program for panoramic video playback is executed on the system memory 56, the sphere function inside the playback program is called. Here, as shown in FIG. 3, the sphere function has a spherical shape of 360 degrees in which the y1 axis of the first scene image and the y2 axis of the nth scene image constituting the source video stored in the mass storage device 54 are in contact with the y axis. Means the command to switch.

When the sphere function inside the playing program is called, the delay function is immediately called by the process of the playing program itself. More specifically, by forcibly calling the delay function in the reproduction program executed in the system memory 56 in accordance with the call of the sphere function, the CPU 57 is notified of the reproduction to the fixed computation system (frame unit) rather than real time.

The CPU 57 performs computation with the system memory 56 through coral action. The CPU 57 is a network interface unit 52a through access to the broadcast transmission system 20 through the communication network 30 in accordance with the power-on of the smart TV 60 or the execution of a playback program executed on the system memory 56. After the data session between the broadcast transmission system 20 and the broadcast transmission system 20 is connected, the broadcast transmission information is received and output to the smart TV 60f through the I / O interface 52c. Here, broadcast transmission information is a broad concept including a broadcast channel, a broadcast program, broadcast content, and the like.

Thereafter, the CPU 57 checks the panorama video included in the outputted broadcast transmission information, and then, upon request of the user through the remote controller 40 of the user or input to the input device 53, the communication network 30. The network interface unit 52a is controlled to make a panoramic video request to the broadcast transmission system 20 through the "

In addition, the CPU 57 controls the network interface unit 52a to receive the source video stored in the broadcast transmission system 20 through the communication network 30 as a return from the broadcast transmission system 20 for the panorama video request. do. Thereafter, the CPU 57 transfers the received source video to the mass storage device 54 through the input / output bus 51 to be stored. Here, as shown in FIG. 3, the source video is a form in which a first scene image to an nth scene image (n is a natural number of two or more) included in a 360 degree video file acquired by the panoramic image acquisition apparatus. Meanwhile, in FIG. 3, n is set to 6 for convenience of description, but is not limited thereto. In the next process by this process, the CPU 57 requests execution of a playback program for playback of the panoramic video stored on the system memory 56.

The CPU register 57a is a high-speed memory formed inside the CPU 57 to perform instruction interpretation and instruction execution by the CPU 57 which fetches an instruction from the system memory 56 via the CPU-memory bus 55. Provide a place for it.

On the other hand, in the present invention, the CPU register 57a needs to alleviate the bottleneck threading phenomenon caused by the overload of the conventional panoramic video playback by the CPU 57 in accordance with the forced call of the delay function in the playback program executed on the system memory 56. Shall be.

More specifically, the frame processing cycles per second for the source video stored in the mass storage device 54 for outputting the panoramic video to the smart TV 60 by the CPU 57 to reduce the bottleneck threading phenomenon as a preset output frame value. By setting. Here, when the frame processing cycle of the CPU 57 in the normal state is 30, it is preferable that the preset output frame value is set to 15. In addition, the output sample rate of the source video stored in the mass storage device 54 for outputting the panoramic video to the smart TV 60 by the CPU 57 is set to a preset output sample rate value as a continuous process of frame value setting. This can be done by. In one embodiment of the present invention, when the frame processing cycle per second is performed to set the frame value to a quantitative value of 15, it is preferable to set the value to 2 Mbps.

Here, the sample rate may refer to the number of samples of the entire frame per second that can be transmitted from the CPU register 57a to the smart TV 60.

4 is a process of transmitting to a photographing apparatus 10, a broadcasting transmission system 20, and a set-top box 50 for a source video in a transient processing alleviation method by a CPU when playing a panoramic video on a smart TV according to an embodiment of the present invention. It is a flow chart showing. 1 to 4, the photographing apparatus 10 performs 360-degree video file recording through photographing a subject, and blends each image data generated according to the recording into one image. (S1).

After the step S1, the photographing apparatus 10 generates a source video by performing real-time encoding on the blended 360 degree video file (S2). More specifically, the encoding is preferably encoded as a video of the H.264 codec. As another example, video encoding may be performed by HTML5 VIDEO (VP8), and voice encoding may be encoded by MP3.

After the step S2, the photographing apparatus 10 divides the source video and transmits and stores the source video to the broadcast transmission system 20 through the direct cable or the communication network 30 (S3). In this case, it is preferable to use the UDP method when transmitting the source video to the broadcast delivery system 20. In this case, it is preferable that the source video file is transmitted after being divided into token units and stored in the divided area on the database 21 on the broadcast transmission system 20.

After step S3, the broadcast transmission system 20 requests a panoramic video through the communication network 30 from the set-top box 50 when a panoramic video request to the set-top box 50 using the user's remote control 40 is input. After receiving (S4), and returns to this to combine the source video divided in step S3 and transmits to the set-top box (50) (S5).

5 is a flowchart illustrating a process performed in the set-top box 50 of the transient processing alleviation method by the CPU during playback of the panorama video on the smart TV according to an embodiment of the present invention. With reference to FIGS. 1 to 5 will be described with respect to each component of the set-top box 50.

First, the network interface unit 52a allows the CPU 57 of the set-top box 50 to receive a source video from the broadcast delivery system 20 through the communication network 30 in response to a panoramic video request to the broadcast delivery system 20. After controlling, the received source video is stored in the mass storage device 54 through the input / output bus 51 (S11).

More specifically, the CPU 57 controls the network interface unit 52a to receive the source video stored in the broadcast transmission system 20, and then stores the received source video in the mass storage device 54. Here, the source video is a form in which the first to nth scene images (n is a natural number of 2 or more) are merged.

After step S11, the CPU 57 requests execution of a playback program for playing the panoramic video stored on the system memory 56 (S12).

According to step S12, when a playback program for panorama video playback is executed, the sphere function inside the playback program is called (S13). Here, the sphere function converts the y1 axis of the first scene image and the y2 axis of the nth scene image constituting the source video stored in the mass storage device 54 into a spherical shape of 360 degrees in contact with the y axis. (See FIG. 3).

When the sphere function according to step S13 is called, the delay function is immediately forcibly called by the own process of the reproduction program (S14). More specifically, by forcibly calling the delay function in the reproduction program executed in the system memory 56 in accordance with the call of the sphere function, the CPU 57 is notified of the reproduction to the fixed computation system (frame unit) rather than real time.

In response to a forced call of the delay function in step S14, the CPU 57 starts to reduce the bottleneck threading phenomenon for the CPU register 57a (S15).

As the work for alleviating the bottleneck threading phenomenon in step S15 proceeds, the CPU 57 is stored in the mass storage device 54 for outputting the panoramic video to the smart TV 60 through the I / O interface 52c. A frame processing cycle per second for the source video is set to a preset output frame value (S16). Here, when the frame processing cycle of the CPU 57 in the normal state is 30, it is preferable that the preset output frame value is set to 15.

After step S16, the CPU 57 sets the output sample rate of the source video stored in the mass storage device 54 for outputting the panoramic video to the smart TV 60 to a preset output sample rate value (S17). In one embodiment of the present invention, when the frame processing cycle per second is set to a quantitative value of 15 in step S16, it is preferable to set it to a value of 2 Mbps.

FIG. 6 is a diagram showing a transient processing alleviation system (second CPU processing alleviation system 2) by a CPU when playing a panoramic video on a mobile terminal among smart devices according to an embodiment of the present invention. Referring to FIG. 6, the CPU processing alleviation system 2 includes a photographing apparatus 10, a wired communication network 20, a WAP server 30, a mobile communication network 40, a control station 50, and a base station 60. ), And a mobile terminal 70.

The photographing apparatus 10 transmits the source video file generated by recording and encoding the 360 degree video file to the swap server 30 through the wired communication network 20, and divides and stores the source video file in the database 31 of the swap server 30. Be sure to Here, the reason for dividing and storing is to prevent leakage of the source video by illegal users such as hacking and macros.

The wired communication network 20 is a high-speed network of a large communication network capable of large capacity, long distance voice and data service, and may be, for example, the Internet. In addition, the IP network may be a next-generation wired network for providing high-speed multimedia services based on ALL IP (Internet Protocol). The wired communication network 20 serves to transfer signals and data between the swap server 30, the photographing apparatus 10, and other systems.

The swap server 30 is formed to provide the swap page information to a terminal connected to the mobile communication network 40 including the mobile terminal 70. )

The database 31 may refer to a functional structural combination of software and hardware for storing each piece of information. The database 31 may be implemented with at least one table, and may further include a separate database management system (DBMS) for searching, storing, and managing information stored in the database 31. Also, it can be implemented in various ways such as a linked-list, a tree, and a relational database, and includes all data storage media and data structures capable of storing information corresponding to a database.

Meanwhile, in the present invention, the swap server 30 combines the source video stored in the database 31 in the divided state received from the photographing apparatus 10 in response to the panoramic video request from the mobile terminal 70, thereby providing a mobile communication network 40. Provided to the mobile terminal 70 through).

The mobile communication network 40 may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network is exemplified. In this case, the mobile communication network 40 may include a control station 50 formed of a radio network controller (RNC), an asynchronous mobile switching center (MSC), or the like. Meanwhile, although the WCDMA network is taken as an example, it is well known that it may be changed to a next-generation mobile communication network such as 3G LTE network and 4G network. The mobile communication network 40 serves to transfer signals and data between the swap server 30 and the mobile terminal 70 and other systems through the control station 50 and the base station 60.

The control station 50 controls the operation of the base station 60 and functions related to the management of radio resources (RR) and the mobility management (MM) for the mobile terminal 70 within the communication area of the base station 60. It manages the functions and the overall functions of the wireless network. In the present invention, the control station 50 controls the base station controller (BSC) of the GSM or CDMA network, the Radio Network Controller (RNC) of the WCDMA network, the access control router (ACR) of the WiBro network, etc. according to the type of the mobile communication network. Means one of the devices.

The base station 60 includes a wireless transceiver that provides a wireless interface with the mobile terminal 70. For example, a base transceiver station (BTS) of a global system for mobile communication (GSM) or a CDMA network, a node of a WCDMA network. -B means a radio station opened on the land and not moving to communicate with land mobile stations such as RAS (Radio Access Station) of WiBro network or by relay of mobile relay station.

The mobile terminal 70 connects the data session with the swap server 30 through the mobile communication network 40 according to the execution of the swap browser, and then transmits a panoramic video request to the swap server 30 to play the source video for panorama video playback. Receive

Accordingly, the mobile terminal 70 executes a playback program to convert a plurality of scene images included in the source video into a spherical form and outputs the same. Hereinafter, a detailed structure and function of the mobile terminal 70 will be described below. It will be described with reference to FIG.

FIG. 7 is a diagram illustrating a configuration of the mobile terminal 70 of FIG. 6. Referring to FIG. 7, the mobile terminal 70 includes an input / output bus 71, a wireless transmission / reception device 72, an input / output touch screen 73, a mass storage device 74, a CPU-memory bus 75, and a system memory. 76, the CPU 77, and the CPU register 77a, and each component will be described in turn below.

The input / output bus 71 physically connects the CPU 77 to the mass storage device 74, the touch screen 73 for input / output, and the wireless transmission / reception device 72 to enable signal and data transmission and reception therebetween.

The wireless transmitting and receiving device 72 includes an RF antenna, transmits and receives signals and data to and from the swap server 30 through the mobile communication network 40, and transmits and receives signals or data received from the swap server 30 to the input / output bus 71. The CPU 30 may be provided to or transferred to the mass storage device 74.

The input / output touch screen 73 is formed of an input unit and an output unit as one module, and is basically responsible for outputting each pixel under the control of the CPU 77.

In addition, the input / output touch screen 73 may execute a dialog with the application program when executing one or more application programs existing in the system memory 76. As used herein, the term "application program" refers to the main part of functionality for processing information associated with a user in a wide range and presenting the information in a manner involving graphic or image generation or manipulation operations. These can be used interchangeably for simplicity of discussion.

The mass storage device 74 typically has a read-only memory (ROM) and a hard disk and / or CD- for permanently storing the configuration information portion of the mobile terminal 70 and additional portions of the basic operating system. It is formed as a ROM drive.

The CPU-memory bus 75 performs the function of connecting the CPU 77 to the system memory 76.

The system memory 76 generally includes a basic operating system and graphical user interface (GUI) portion of the mobile terminal 70, so that volatile or random access memory (RAM) for temporary storage of information. It includes.

In the present invention, when a playback program for panoramic video playback is executed on the system memory 76, the sphere function inside the playback program is called. Here, the sphere function is a 360-degree spherical shape in which the y1 axis of the first scene image constituting the source video stored in the mass storage device 74 and the y2 axis of the nth scene image are in contact with each other on the y axis as in FIG. 3. spherical) command.

When the sphere function inside the playing program is called, the delay function is immediately called by the process of the playing program itself. More specifically, by forcibly calling the delay function in the reproduction program executed in the system memory 76 in accordance with the call of the sphere function, the CPU 77 is notified of the reproduction to the fixed computation system (frame unit) rather than real time.

The CPU 77 performs computation through the coral action with the system memory 76. The CPU 77 is a data session between the wireless transmitting and receiving device 72 and the swap server 30 through access to the swap server 30 through the mobile communication network 40 according to the execution of the web browser running on the system memory 76. After the connection is made, it receives the swap page information and outputs the input / output touch screen 73 through the input / output bus 71.

Thereafter, the CPU 77 checks the panorama video included on the output web page, and then, upon the request of the user input to the input / output touch screen 73, the swap server through the mobile communication network 40. The wireless transmission / reception apparatus 72 is controlled to make a panoramic video request to the 30.

In addition, the CPU 77 controls the wireless transmission and reception device 72 to receive the source video stored in the swap server 30 through the mobile communication network 40 as a return from the swap server 30 for the panorama video request. . Thereafter, the CPU 77 transmits the received source video to the mass storage device 74 through the input / output bus 71 to be stored. Here, as shown in FIG. 3, the source video is a form in which a first scene image to an nth scene image (n is a natural number of two or more) included in a 360 degree video file acquired by the panoramic image acquisition apparatus. In the next process by this process, the CPU 77 requests execution of a playback program for playback of the panoramic video stored on the system memory 76.

The CPU register 77a is a high-speed memory formed inside the CPU 77 so as to perform instruction interpretation and instruction execution by the CPU 77 which fetches an instruction from the system memory 76 via the CPU-memory bus 75. Provide a place for it.

On the other hand, in the present invention, the CPU register 77a needs to alleviate the bottleneck threading phenomenon caused by the overload during the conventional panorama video playback by the CPU 77 in accordance with the forced call of the delay function in the playback program executed on the system memory 76. Shall be.

More specifically, in order to alleviate bottleneck threading, a frame processing cycle per second for a source video stored in the mass storage device 74 for outputting a panoramic video to the input / output touch screen 73 by the CPU 77 is preset. By setting it to a value. Here, if the frame processing cycle of the CPU 77 in the normal state is 30, it is preferable that the preset output frame value is set to 15. In addition, the output sample rate value of the output sample rate of the source video stored in the mass storage device 74 for outputting the panoramic video to the input / output touch screen 73 by the CPU 77 as a continuous process of frame value setting is set. It can be made by setting. In one embodiment of the present invention, when the frame processing cycle per second is performed to set the frame value to a quantitative value of 15, it is preferable to set the value to 2 Mbps.

Here, the sample rate may refer to the number of samples of the entire frame that can be transmitted per second from the CPU register 77a to the input / output touch screen 73.

8 is a process for transmitting to the photographing apparatus 10, the swap server 30 and the mobile terminal 70 for the source video in the transient processing alleviation method by the CPU when playing the panoramic video on the mobile terminal according to an embodiment of the present invention It is a flow chart showing. 6 to 8, the photographing apparatus 10 performs 360-degree video file recording by capturing a subject and blends each image data generated according to the recording into one image. (S21).

After the step S21, the photographing apparatus 10 generates a source video by performing real-time encoding on the blended 360 degree video file (S22). More specifically, the encoding is preferably encoded as a video of the H.264 codec. As another example, video encoding may be performed by HTML5 VIDEO (VP8), and voice encoding may be encoded by MP3.

After the step S22, the photographing apparatus 10 divides the source video and transmits it to the swap server 30 through the wired communication network 20 to store it (S23). In this case, it is preferable to use the UDP method when transferring the source video to the swap server 30. In this case, it is preferable that the source video file is transmitted after being divided into token units and stored in the divided area on the database 31 on the swap server 30.

After step S23, the swap server 30 receives the panoramic video request by the mobile terminal 70 (S24), and then returns the combination to the mobile terminal 70 by combining the source video divided in step S23. (S25).

Meanwhile, the process performed by the mobile terminal 70 in the transient processing alleviation method by the CPU when the panoramic video is reproduced on the mobile terminal according to the embodiment of the present invention is performed in the same process as in FIG. This will be described with reference to FIG. 8.

First, the CPU 77 of the mobile terminal 70 controls the wireless transmission / reception apparatus 72 to receive a source video from the swap server 30 through the mobile communication network 40 in response to the panoramic video request to the swap server 30. After that, the received source video is stored in the mass storage device 74 through the input / output bus 71 (S11).

More specifically, the CPU 77 controls the wireless transmission and reception device 72 to receive the source video stored in the swap server 30, and then stores the received source video in the mass storage device 74. Here, the source video is a form in which the first to nth scene images (n is a natural number of 2 or more) are merged.

Thereafter, the CPU 77 requests execution of a reproduction program for reproducing the panoramic moving image stored on the system memory 76 (S12).

Accordingly, when a playback program for panorama video playback is executed, the sphere function inside the playback program is called (S13). Here, the sphere function converts the y1 axis of the first scene image and the y2 axis of the nth scene image constituting the source video stored in the mass storage device 74 into a spherical shape of 360 degrees in contact with the y axis. (See FIG. 3).

When the sphere function according to step S13 is called, the delay function is immediately forcibly called by the own process of the reproduction program (S14). More specifically, by forcibly calling the delay function in the reproduction program executed in the system memory 76 in accordance with the call of the sphere function, the CPU 77 is notified of the reproduction to the fixed computation system (frame unit) rather than real time.

In response to a forced call of the delay function in step S14, the CPU 77 starts to reduce the bottleneck threading phenomenon for the CPU register 77a (S15).

As the operation for reducing the bottleneck threading phenomenon in step S15 proceeds, the CPU 77 processes frames per second for the source video stored in the mass storage device 74 for outputting the panoramic video to the input / output touch screen 73. The cycle is set to a preset output frame value (S16). Here, if the frame processing cycle of the CPU 77 in the normal state is 30, it is preferable that the preset output frame value is set to 15.

After the step S16, the CPU 77 sets the output sample rate of the source video stored in the mass storage device 74 for outputting the panoramic video to the input / output touchscreen 73 to a preset output sample rate value (S17). ). In one embodiment of the present invention, when the frame processing cycle per second is set to a quantitative value of 15 in step S16, it is preferable to set it to a value of 2 Mbps.

In the above-described method of reducing transient processing by a CPU when playing a panoramic video on a smart device according to an embodiment of the present invention, an application basically installed in a set-top box or a mobile terminal (that is, a platform or an operating system basically installed in a mobile terminal) May be included in an application (ie, a program) that is directly installed on a user terminal through an application providing server such as an application store server, an application, or a web server associated with the service. May be executed by In this sense, the method for reducing excessive processing by the CPU when playing a panoramic video on a smart device according to the embodiment of the present invention described above is basically an application (ie, a program) installed in a set-top box or a mobile terminal or directly installed by a user. Computer-readable recording medium, such as implemented.

Such a program may be recorded on a recording medium that can be read by a computer and executed by a computer so that the above-described functions can be executed.

As described above, in order to execute the transient processing alleviation method by the CPU at the time of playing the panoramic video on the smart device according to the embodiment of the present invention, the above-described program can be read by C, C ++, JAVA, machine language, etc. Code may be coded in the computer language of.

The code may include a function code related to a function or the like that defines the functions described above and may include an execution procedure related control code necessary for the processor of the computer to execute the functions described above according to a predetermined procedure.

In addition, such code may further include memory reference related code as to what additional information or media needed to cause the processor of the computer to execute the aforementioned functions should be referenced at any location (address) of the internal or external memory of the computer .

In addition, when a processor of a computer needs to communicate with any other computer or server, etc., to perform the above-described functions, the code may be stored in a computer's communication module (e.g., a wired and / ) May be used to further include communication related codes such as how to communicate with any other computer or server in the remote, and what information or media should be transmitted or received during communication.

The functional program for implementing the present invention and the related code and code segment may be implemented by programmers of the technical field of the present invention in consideration of the system environment of the computer that reads the recording medium and executes the program, Or may be easily modified or modified by the user.

Examples of recording media that can be read by a computer recording a program as described above include, for example, a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical media storage device, and the like.

Also, the computer-readable recording medium on which the above-described program is recorded may be distributed to a computer system connected via a network so that computer-readable codes can be stored and executed in a distributed manner. In this case, one or more of the plurality of distributed computers may execute some of the functions presented above and send the results of the execution to one or more of the other distributed computers, The computer may also perform some of the functions described above and provide the results to other distributed computers as well.

In particular, the method for reducing transient processing by the CPU when playing a panoramic video on a smart device according to an embodiment of the present invention, an application providing server such as an application store server, an application or a web server associated with a corresponding service (Application Provider) Server) may be a storage medium (eg, hard disk, etc.) or the application providing server itself.

In the present invention, a method for reducing transient processing by a CPU when a panoramic video is played on a smart device is not only a general PC such as a desktop or a notebook computer, but also a smart phone, a tablet PC, personal digital assistants (PDAs), and mobile communication. It may include a mobile terminal such as a terminal, as well as to be interpreted as all computing devices (Computing).

In addition, a computer capable of reading a transient processing alleviation method by a CPU when playing a panoramic video on a smart device according to an embodiment of the present invention may be a mobile terminal such as a smart phone, a tablet PC, a personal digital assistant (PDA) and a mobile communication terminal. In this case, the application may be downloaded from the application providing server to a general PC and installed on the mobile terminal through a synchronization program.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. In other words, within the scope of the present invention, all of the components may be selectively operated in combination with one or more. In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. Codes and code segments constituting the computer program may be easily inferred by those skilled in the art. Such a computer program may be stored in a computer readable storage medium and read and executed by a computer, thereby implementing embodiments of the present invention. As a storage medium of the computer program, a magnetic recording medium, an optical recording medium, or the like can be included.

It is also to be understood that the terms such as " comprises, "" comprising," or "having ", as used herein, mean that a component can be implanted unless specifically stated to the contrary. But should be construed as including other elements. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

Claims (15)

A first step in which the photographing apparatus divides the source moving image to be transmitted to the broadcasting transmission system and stored;
A second step of receiving, by the broadcast transmission system, the panoramic video request from the set-top box receiving the panoramic video request requested by the user with a remote controller, combining the divided and transmitted source videos to the set-top box through a communication network; And
A third step of, by the set-top box, executing a playback program for playing the panoramic video on the smart TV for the source video, informing the CPU of the set-top box that the playback is in a fixed frame unit to replace real-time playback; How to reduce the transient processing by the CPU during playback of the panorama video on a smart device comprising a. 2. The method according to claim 1,
(A) performing, by the photographing apparatus, a blending operation of combining a single image according to a 360-degree video file recording through photographing a subject;
(B) generating, by the photographing apparatus, the source video by performing real-time encoding on the blended 360 degree video file; And
(C) the photographing apparatus, dividing the source video and transmitting the divided source video to the broadcast transmitting system through the communication network so as to be separately stored in a database of the broadcasting transmitting system; How to reduce the transient processing by the CPU during playback of the panorama video on a smart device comprising a. 2. The method of claim 1,
(C) controlling, by the CPU of the set top box, a network interface unit to request a panoramic video request to the broadcasting transmission system through the communication network to receive the source video and to store the source video in a mass storage device;
The CPU requesting execution on a system memory of a playback program for playing a panoramic video of a source video in which a first scene image or an nth scene image (n is a natural number of 2 or more) merged in the mass storage device is merged; Step (e);
(F) calling a sphere function inside the playback program as the playback program is executed; And
(G) in response to the spehre function call, informing the CPU that the delay function is immediately called by the own process of the playback program to replace the real time playback with the fixed frame unit; How to reduce the transient processing by the CPU during playback of the panorama video on a smart device comprising a. The method of claim 3, wherein after step (g),
(H) initiating a task for mitigating a bottleneck threading phenomenon on a CPU register by the CPU in response to a forced call of the delay function;
Setting, by the CPU, a frame processing cycle per second for the source video stored in the mass storage device to a preset output frame value when outputting the panoramic video to a smart TV connected to an I / O interface; And
(J) setting, by the CPU, an output sample rate of the source video to a preset output sample rate value when outputting the panoramic video to the smart TV; How to reduce the transient processing by the CPU during playback of the panorama video on a smart device characterized in that it further comprises. A first step in which the photographing apparatus divides the source video and transmits the same to the swap server for storage;
In response to receiving the panoramic video request from the mobile terminal, the swap server combines the divided source video and transmits the combined source video to the mobile terminal through a mobile communication network; And
A third step of executing, by the mobile terminal, a reproduction program for reproducing the panorama video of the source video, informing the CPU of the mobile terminal that the reproduction is a fixed frame unit to replace real-time playback; How to reduce the transient processing by the CPU during playback of the panorama video on a smart device comprising a. 6. The method of claim 5,
(A) performing, by the photographing apparatus, a blending operation of combining a single image according to a 360-degree video file recording through photographing a subject;
(B) generating, by the photographing apparatus, the source video by performing real-time encoding on the blended 360 degree video file; And
(C) the photographing apparatus dividing the source video and transmitting the divided video to the swap server through a wired communication network so as to be separately stored in a database of the swap server; How to reduce the transient processing by the CPU during playback of the panorama video on a smart device comprising a. The method of claim 6, wherein the third step,
(C) controlling, by the CPU of the mobile terminal, a wireless video receiver to request a panoramic video request to the swap server through the mobile communication network to receive and store the source video in a mass storage device;
The CPU requesting execution on a system memory of a playback program for playing a panoramic video of a source video in which a first scene image or an nth scene image (n is a natural number of 2 or more) merged in the mass storage device is merged; Step (e);
(F) calling a sphere function inside the playback program as the playback program is executed; And
(G) in response to the spehre function call, informing the CPU that the delay function is immediately called by the own process of the playback program to replace the real time playback with the fixed frame unit; How to reduce the transient processing by the CPU during playback of the panorama video on a smart device comprising a. A photographing apparatus for dividing and transmitting a source video generated by photographing a subject;
A broadcast transmission system for receiving and storing the divided and transmitted source video; And
Physically connected to a smart TV, and transmits the panoramic video request requested by the user to the broadcast transmission system by a remote controller, and receives the source video in the divided state through the communication network in a combined state by the broadcast transmission system; A set-top box configured to internally perform notification of reproduction of a fixed frame unit to replace real-time reproduction with a CPU when executing a reproduction program for reproducing a panorama video for the source video; System for reducing the excessive processing by the CPU during playback of the panorama video on a smart device comprising a. The method according to claim 8, wherein the photographing apparatus,
After performing a blending operation of combining the 360-degree video file by recording a 360-degree video file through the recording of the subject, and performing the real-time encoding of the blended 360-degree video file to generate the source video A transient processing alleviation system by the CPU during panorama video playback on a smart device. The method of claim 8, wherein the set top box,
A network interface unit for transmitting and receiving signals and data to and from the broadcast transmitting system through the communication network;
A short range communication unit configured to receive a control signal for a panoramic video request from the remote controller through a short range wireless communication method so that the panoramic video request is transmitted to the broadcast transmission system through the network interface unit;
An I / O interface that is physically connected to the smart TV and is responsible for outputting each pixel of the smart TV to play a panoramic video of the source video;
A mass storage device storing the source video received from the network interface unit;
A system memory in which a playback program for playing the panoramic video resides; And
The CPU requesting execution of the playback program for the source video in which the first to nth scene images (n is a natural number of 2 or more) merged in the mass storage device are executed on the system memory; Including;
When the sphere function inside the play program is called according to the execution of the play program, the delay function is immediately called by the process of the play program itself, and the play of the fixed frame unit replaces real time play to the CPU. And a transient processing alleviation system by the CPU during panorama video playback on a smart device. The method according to claim 10, wherein the CPU,
And a process for alleviating a bottleneck threading phenomenon for a CPU register, which is an internal high-speed memory, in response to a forced invocation of the delay function. The method according to claim 11, wherein the CPU,
Transient processing by the CPU when playing back the panoramic video on the smart TV, characterized in that the frame processing cycle per second for the source video stored in the mass storage device is set to a preset output frame value when the panoramic video is output to the smart TV. Mitigation system. The method according to claim 12, wherein the CPU,
And the output sample rate of the source video is set to a preset output sample rate value when the panoramic video is output to the smart TV. A photographing apparatus for dividing and transmitting a source video generated by photographing a subject;
A swap server for receiving and storing the divided and transmitted source video; And
Sends the panoramic video request to the swap server, receives the source video combined with the divided source video through the mobile communication network, and then plays the CPU in real time by executing a playback program for playing the panoramic video of the source video. A mobile terminal in which notification of reproduction of a fixed frame unit is replaced internally; System for reducing the transient processing by the CPU during playback of the panorama video on a smart device comprising a. The method according to claim 14, The mobile terminal,
A wireless transmission / reception device for transmitting and receiving signals and data with the swap server through the mobile communication network;
A mass storage device for storing the source video received from the wireless transmission / reception device;
A system memory in which a playback program for playing the panoramic video resides; And
The CPU requesting execution of the playback program for the source video in which the first to nth scene images (n is a natural number of 2 or more) merged in the mass storage device are executed on the system memory; Including;
When the sphere function inside the play program is called according to the execution of the play program, the delay function is immediately called by the process of the play program itself, and the play of the fixed frame unit replaces real time play to the CPU. And a transient processing alleviation system by the CPU during panorama video playback on a smart device.

Images