JP6454742B2 - Movie output device, movie output method, and movie output program - Google Patents

Description

  The present invention relates to a moving image output apparatus.

  In recent years, as a method of displaying a moving image between a server and a client on a client terminal, there is a method of using a JavaScript function of JavaScript (registered trademark) (for example, Patent Document 1). In Canvas, a line segment, arc, circle, curve, etc. are designated by a predetermined drawing command, and a moving image is displayed by displaying drawing data at a predetermined frame rate on the client terminal.

  FIG. 7 and FIG. 8 show each moving image frame of a moving image in which the drawing data of “angry face” (FIG. 7) drawn by the conventional method changes to the drawing data of “laughing face” (FIG. 8). Conventionally, the drawing data shown in FIG. 7 is drawn by a code using the Canvas function shown in FIG. That is, the point P1 in FIG. 7 is designated by “ctx.moveTo (20, 20)” in the 21st line of FIG. Subsequently, “ctx.quadraticCurveTo (120, 20, 70, −20)” in the 22nd line in FIG. 9 designates a curve having the point P1 in FIG. 7 as the start point and the point P2 as the end point. Also, a curve having a start point P2 and an end point P3 in FIG. 7 is designated by “ctx.quadraticCurveTo (120, 120, 160, 70)” on the 23rd line. Further, a curve having the point P3 as the start point and the point P4 as the end point is designated by “ctx.quadricCurveTo (20, 120, 70, 160)” on the 24th line. Further, a “ctx.quadratic CurveTo (20, 20, -20, 70)” on the 25th line designates a curve having the point P4 in FIG. 7 as the start point and the point P1 as the end point. In this way, the face contour of FIG. 7 is designated by the 21st to 25th lines of FIG.

  Further, a circle with a radius of 5 having the center as the point P5 in FIG. 7 is designated by “ctx.arc (30, 110, 5, 0, Math.PI * 2, false)” in the 31st line of FIG. Also, a circle with a radius of 5 having the center at the point P6 in FIG. 7 is designated by “ctx.arc (110, 110, 5, 0, Math.PI * 2, false)” on the 32nd line. Subsequently, the point P7 in FIG. 7 is designated by “ctx.moveTo (30, 30)” in the 33rd line. Subsequently, “ctx.quadraticCurveTo (30,110,70,70)” on the 34th line designates a curve having the point P7 in FIG. 7 as the start point and the point P8 as the end point. Thus, the eyes and the angry mouth are designated by the 31st to 34th lines. The above processing is performed to generate the drawing data shown in FIG.

  The drawing data in FIG. 8 is generated based on the code in FIG. That is, the point P1 in FIG. 8 is designated by “ctx.moveTo (20, 20)” in the 21st line of FIG. Subsequently, by “ctx.quadraticCurveTo (120, 20, 70, −20)” on the 22nd line, a curve starting from the point P1 and ending at the point P2 in FIG. 8 is designated. In addition, a curve starting from the point P2 and ending at the point P3 in FIG. 8 is designated by “ctx.quadraticCurveTo (120, 120, 160, 70)” on the 23rd line. In addition, a curve having the point P3 in FIG. 8 as the start point and the point P4 as the end point is designated by “ctx.quadraticCurveTo (20, 120, 70, 160)” on the 24th line. Further, a “ctx.quadraticCurveTo (20, 20, -20, 70)” on the 25th line designates a curve having the point P4 in FIG. 8 as the start point and the point P1 as the end point. In this way, the face contour of FIG. 8 is designated by the 21st to 25th lines of FIG.

  Further, a circle having a radius of 5 having the center at the point P5 in FIG. 8 is designated by “ctx.arc (30, 110, 5, 0, Math.PI * 2, false)” in the 31st line of FIG. Further, a circle with a radius of 5 having the center as the point P6 in FIG. 8 is designated by “ctx.arc (110, 110, 5, 0, Math.PI * 2, false)” on the 32nd line. Subsequently, the point P7 in FIG. 8 is designated by “ctx.moveTo (30, 30)” in the 33rd line. Subsequently, “ctx.quadraticCurveTo (30,110,70, −10)” on the 34th line designates a curve having the point P7 in FIG. 8 as the start point and the point P8 as the end point. In this way, the eyes and the laughing mouth in FIG. 8 are designated and drawn from the 31st line to the 34th line. The above processing is performed to generate the drawing data shown in FIG. 7 and 8 are displayed at a predetermined time interval (frame rate) to display a moving image.

JP 2013-37447 A

  In the conventional video output method, drawing instruction data corresponding to each video frame is calculated step by step to create drawing data corresponding to each video frame and output the video. However, it is desirable to speed up video output. It is rare.

  Accordingly, an object of the present invention made in view of the above problems is to provide a moving image output apparatus capable of increasing the speed of moving image output.

In order to solve the above problems, a moving image output apparatus according to the present invention provides:
A storage unit for storing image data in which drawing portions common to at least two moving image frames among the moving image frames are generated in advance ;
A controller that generates drawing data of a drawing portion other than the image data among the moving image frames, and generates the moving image frames by combining the image data and the drawing data;
An output unit for outputting a video based on each video frame;
It is characterized by having.

  According to the moving image output apparatus of the present invention, it is possible to increase the speed of moving image output.

1 is a block diagram of a moving image output system according to an embodiment of the present invention. It is a figure which shows the outline | summary of the drawing data of each moving image frame in the moving image output device which concerns on one Embodiment of this invention. It is a figure which shows an example of 1st drawing instruction | indication data. It is a figure which shows an example of 2nd drawing instruction | indication data. It is a figure which shows an example of a UniformFunction table. It is a flowchart which shows operation | movement of the moving image output device which concerns on one Embodiment of this invention. It is a figure which shows the drawing data of a certain moving image frame in a prior art. It is a figure which shows the drawing data of the moving image frame different from FIG. 7 in a prior art. FIG. 8 is a code for generating the drawing data of FIG. 7 in the prior art. FIG. 9 is a code for generating the drawing data of FIG. 8 in the prior art.

  Embodiments of the present invention will be described below.

(Embodiment)
FIG. 1 is a block diagram of a moving image output system including a moving image output apparatus 1 according to an embodiment of the present invention. The moving image output system shown in FIG. 1 includes a moving image output device (server) 1 and a client terminal 2. The moving image output apparatus 1 includes a communication unit 11, a storage unit 12, a control unit 13, and an output unit 14. The client terminal 2 is a communication terminal such as a mobile phone, a smartphone, or a PC. Although three are illustrated in FIG. 1, the number is not limited to this and may be two or less, or four or more.

  The communication unit 11 of the video output device 1 communicates with the client terminal 2 by at least one of wireless or wired via a network. Specifically, the communication unit 11 receives a moving image transmission request from the client terminal 2. Further, the communication unit 11 transmits the moving image data output from the output unit 14 to the client terminal 2.

  The storage unit 12 stores various information necessary for the moving image output system. The control unit 13 performs various controls related to the moving image output apparatus 1.

  As a rough outline, the control unit 13 generates in advance image data (hereinafter referred to as first drawing data) related to a drawing portion common to at least two moving image frames of each moving image frame, and stores the image data in the storage unit 12. And the control part 13 produces | generates the data (henceforth 2nd drawing data) concerning the drawing part which is not common with another moving image frame among each moving image frame, ie, a different drawing part, and is referred to as 1st drawing data and 2nd drawing data. Drawing data associated with each moving image frame is generated by combining the drawing data.

  FIG. 2 is a schematic diagram relating to generation of each moving image frame in the moving image output apparatus 1 according to an embodiment of the present invention. FIG. 2 shows a procedure for generating a moving image frame relating to the drawing data of “angry face” (FIG. 2D) and the drawing data of “laughing face” (FIG. 2E). FIG. 2A shows the first drawing data. The face outline and the eye part common to the “laughing face” and “angry face” are the first drawing data. 2B and 2C show the second drawing data. As shown in FIGS. 2B and 2C, the mouth portion that differs between the “angry face” and the “laughing face” becomes the second drawing data.

  Then, the first drawing data shown in FIG. 2A and the second drawing data shown in FIG. 2B are combined to generate drawing data (FIG. 2D) of “angry face”. ) And the second drawing data of FIG. 2C are combined to generate the drawing data of the “smiling face” (FIG. 2E).

  Hereinafter, information stored in the storage unit 12 and control by the control unit 13 will be described in detail.

  The storage unit 12 stores first drawing instruction data 121, second drawing instruction data (drawing instruction data) 122, and a uniform function table 123.

  The first drawing instruction data 121 is data for drawing the first drawing data. Specifically, the first drawing instruction data 121 is data including various parameters for drawing a line segment, arc, curve, or the like. Preferably, the first drawing data is data based on the specifications of Canvas. Hereinafter, in the present embodiment, the first drawing data is data based on the Canvas specification, and the moving image output apparatus 1 is an environment that can use the Canvas function, such as a Web server (such as Apache), a JavaScript (registered trademark) library ( Jquery) and the like. FIG. 3 shows an example of the first drawing instruction data 121. The first drawing instruction data 121 stores an identifier, time, type, X, Y, CPX, CPY, and r in association with each drawing command. Here, the identifier is an identification number for uniquely specifying each drawing command. The time indicates the time when the drawing command is stored. The type indicates the type of drawing instruction, and specifically, Moveto (starting point of line segment or curve), Lineto (end point of line segment), arc (arc), quadratic CurveTo (curve), and the like. X, Y, CPX, CPY, r are parameters in each drawing command. X and Y indicate the coordinates of the start point and end point in Moveto, Lineto, and quadraticCurveTo, or the coordinates of the center point in arc. CPX and CPY indicate the coordinates of control points in quadratureCurveTo. r represents the radius at arc.

  For example, the first drawing instruction data 121 includes identifier “1”, time “2013: 04: 10 11:00”, type “Moveto”, X “20”, Y “20”, CPX “−”, CPY “−”. , R "-", thereby specifying the point P1 in FIG. The first drawing instruction data 121 includes an identifier “2”, a time “2013: 04: 10 11:01”, a type “quadratic Curve”, X “120”, Y “20”, CPX “70”, and CPY “−20”. "," And "r"-, thereby specifying a curve having the point P1 in FIG. 2A as the start point and the point P2 as the end point. Similarly, based on the data of identifiers 3 to 7, a curve with point P2 as the start point and point P3 as the end point, a curve with point P3 as the start point and point P4 as the end point, and a curve with point P4 as the start point and point P1 as the end point, respectively. , A circle with a radius of 5 centered on the point P5 and a circle with a radius of 5 centered on the point P6 are designated. As described above, the first drawing data shown in FIG. 2A is generated by the first drawing instruction data 121 shown in FIG.

  Specifically, when receiving a moving image transmission request from the client terminal 2 via the communication unit 11, the control unit 13 first reads the first drawing instruction data 121 in the storage unit 12 and generates first drawing data. Then, the control unit 13 stores the first drawing data in the storage unit 12. Preferably, the control unit 13 stores the first drawing data in the storage unit 12 in a general-purpose image format such as a bitmap format, JPEG format, PNG format, TiFF format or the like.

  The second drawing instruction data 122 is data for drawing the second drawing data, and is specifically data including parameters for drawing line segments, arcs, circles, curves, and the like. The second drawing data is preferably data based on the specifications of Canvas. In the following description of the present embodiment, the first drawing data is assumed to be data based on the Canvas specification. FIG. 4 shows an example of the second drawing instruction data 122. The first drawing instruction data 121 stores an identifier, time, type, X, Y, CPX, CPY, and r in association with each drawing command.

  For example, the second drawing instruction data 122 includes an identifier “8”, a time “2013: 04: 10 11:06”, a type “Moveto”, X “30”, Y “30”, CPX “−”, and CPY “−”. , R "-", thereby specifying the point P7 in FIGS. 2B and 2C. The second drawing instruction data 122 includes an identifier “9”, a time “2013: 04: 10 11:07”, a type “quadric CurveTo”, X “30”, Y “110”, CPX “70”, and CPY “$ uniform”. "," R "-" are included, thereby designating a curve having the point P7 in FIGS. 2B and 2C as the start point and the point P8 as the end point.

  Here, “$ uniform” in the second drawing instruction data 122 is a variable for storing a value that differs for each moving image frame. The UniformFunction table 123 stores the value of “$ uniform” corresponding to each moving image frame.

  FIG. 5 shows an example of the UniformFunction table 123. The UniformFunction table 123 includes a moving picture frame number and a value of $ uniform corresponding to each moving picture frame number. The moving image frame number is a number for uniquely specifying a moving image frame in the present system. For example, a moving image is generated by combining moving image frames in ascending order of the moving image frame number. Therefore, in this system, the second drawing data shown in FIGS. 2B and 2C is generated by the second drawing instruction data 122 shown in FIG. 4 and the Uniform Function table 123 shown in FIG.

  Specifically, the control unit 13 reads the second drawing instruction data 122 in the storage unit 12. Subsequently, the control unit 13 reads the uniform function table 123 of the storage unit 12. Subsequently, the control unit 13 determines the value of “$ uniform” in the second drawing instruction data 122 based on the uniform function table 123 for each frame number of each moving image frame. For example, the control unit 13 determines that the value of “$ uniform” is “70” based on the uniform function table 123 for the moving image frame number “1”. In this case, the control unit 13 generates second drawing data shown in FIG. 2B based on the second drawing instruction data 122. For example, the control unit 13 determines that the value of “$ uniform” is “−10” based on the uniform function table 123 for the moving image frame number “2”. In this case, the control unit 13 generates second drawing data shown in FIG. 2C based on the second drawing instruction data 122.

  The control unit 13 combines the first drawing data stored in the storage unit 12 and the generated second drawing data to generate drawing data related to each moving image frame. Specifically, the control unit 13 combines the first drawing data (FIG. 2A) and the second drawing data shown in FIG. 2B to generate the drawing data shown in FIG. Further, the control unit 13 synthesizes the first drawing data (FIG. 2A) and the second drawing data shown in FIG. 2C to generate the drawing data shown in FIG.

  And the output part 14 outputs a moving image based on the drawing data concerning each moving image frame. Specifically, the output unit 14 generates moving image data having a predetermined frame rate based on drawing data related to each moving image frame, and transmits the moving image data to the client terminal 2 via the communication unit 11.

  Next, the operation of the moving picture output apparatus 1 according to the embodiment of the present invention will be described with reference to the flowchart shown in FIG.

  First, the communication unit 11 of the video output device 1 receives a video transmission request from the client terminal 2 (step S1).

  Subsequently, the control unit 13 of the video output device 1 reads the first drawing instruction data 121 of the storage unit 12 and generates first drawing data (step S2). And the control part 13 memorize | stores 1st drawing data in the memory | storage part 12 (step S3).

  Subsequently, the control unit 13 reads the second drawing instruction data 122 in the storage unit 12 (step S4). Subsequently, the control unit 13 determines the value of “$ uniform” in the second drawing instruction data 122 for each frame number of each moving image frame based on the UniformFunction table 123 (step S5). And the control part 13 produces | generates 2nd drawing data (step S6).

  Subsequently, the control unit 13 combines the first drawing data stored in the storage unit 12 and the generated second drawing data to generate drawing data related to each moving image frame (step S7).

  Subsequently, the output unit 14 outputs a moving image based on the drawing data related to each moving image frame. Specifically, the output unit 14 generates moving image data of a predetermined frame rate based on the drawing data related to each moving image frame, and transmits the moving image data to the client terminal 2 via the communication unit 11 (step S8). . Then, the process ends.

  As described above, according to the present invention, the control unit 13 previously generates the first drawing data related to the drawing portion common to at least two moving image frames among the moving image frames and stores the first drawing data in the storage unit 12. Since only different drawing portions in the moving image frame are generated and combined, the speed of moving image output can be increased by increasing the drawing processing speed of each moving image frame.

  In this embodiment, an example in which there are two moving image frames has been described. However, the present invention is not limited to this, and three or more moving image frames may be provided. In this case, a drawing portion common to at least two moving image frames is set as the first drawing data.

  Here, in order to function as the moving image output apparatus 1, a computer can be preferably used. Such a computer stores a program describing processing contents for realizing each function of the moving image output apparatus 1 in the storage of the computer. This program can be realized by reading out and executing this program by a central processing unit (CPU) of the computer.

  Moreover, in this Embodiment, it has changed to step S2 and step 3 by receiving a moving image transmission request from the client terminal 2 in step S1, but even if a moving image transmission request is not received from the client terminal 2, You may change to step S2 and step 3.

  For example, before receiving the moving image transmission request from the client terminal 2, Step S <b> 2 and Step 3 may be processed in advance, and a moving image transmission request may be made from the client terminal 2, and the process may transit to Step S <b> 4. That is, in the present embodiment, since the first drawing data is generated in advance in the moving image output apparatus 1, the time for processing the first drawing data is saved, so that the drawing process can be performed at a higher speed.

Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, the functions included in each means, each step, etc. can be rearranged so that there is no logical contradiction, and a plurality of means, steps, etc. can be combined or divided into one. .
The invention described in the scope of claims at the beginning of application of the original application of the present application will be appended below.
[1]
A storage unit for storing image data in which drawing portions common to at least two moving image frames among the moving image frames are generated in advance;
A moving picture frame generating device comprising: a control unit that generates drawing data for drawing a portion other than the image data in each moving picture frame, and generates the moving picture frames by combining the image data and the drawing data .
[2]
[1], wherein the image data is generated in advance in a moving image frame including three or more moving image frames, and a drawing portion common to moving image frames equal to or less than the total number of frames is generated. Video frame generator.
[3]
The moving image frame generating apparatus according to [1] or [2], wherein the control unit generates the drawing data based on drawing instruction data.
[4]
The moving picture frame generation device according to [3], wherein the drawing instruction data is data based on a Canvas specification.
[5]
The moving image frame generating device according to [4], wherein the moving image frame generating device processes the data based on the specification of the Canvas via a JavaScript (registered trademark) library on the moving image frame generating device. .
[6]
Storing image data in which drawing portions common to at least two moving image frames of each moving image frame are generated in advance;
Generating a drawing data for drawing a portion of each moving image frame other than the image data, and generating the moving image frame by combining the image data and the drawing data.
[7]
In a computer functioning as a video frame generation device that generates video frames,
Storing image data in which drawing portions common to at least two moving image frames of each moving image frame are generated in advance;
Generating drawing data for drawing a portion of each moving image frame other than the image data, and generating the drawing data for each moving image frame by combining the image data and the drawing data. Movie frame generation program.

1 Video output device (server)
2 Client terminal 11 Communication unit 12 Storage unit 13 Control unit 14 Output unit 121 First drawing instruction data 122 Second drawing instruction data 123 UniformFunction table

Claims (8)

A storage unit for storing image data in which drawing portions common to at least two moving image frames among the moving image frames are generated in advance;
A controller that generates drawing data of a drawing portion that is not common among the moving image frames, and generates the moving image frames by combining the image data and the drawing data;
An output unit that outputs a video based on each video frame when a video transmission request is received from a client terminal;
The moving image output device, wherein the control unit generates the drawing data based on drawing instruction data including a variable representing a difference between moving image frames.   2. The image data according to claim 1, wherein a drawing portion common to moving image frames of less than the total number of moving image frames including three or more moving image frames is generated in advance. Video output device.   The moving image output apparatus according to claim 1, wherein the control unit generates the image data in advance and stores the image data in the storage unit before receiving the moving image transmission request.   The image data is stored in the storage unit according to a predetermined general-purpose image format, and the predetermined general-purpose image format includes at least one of a JPG format, a PNG format, and a TiFF format. The moving image output device according to any one of?   The moving image output apparatus according to claim 1, wherein the drawing instruction data is data based on a Canvas specification.   The moving image output apparatus according to claim 5, wherein the moving image output apparatus processes the data based on the specification of Canvas via a JavaScript (registered trademark) library. Storing image data in which drawing portions common to at least two moving image frames of each moving image frame are generated in advance;
Generating drawing data of a drawing portion that is not common among the moving image frames, and generating the moving image frames by combining the image data and the drawing data;
Outputting a video based on each video frame when receiving a video transmission request from a client terminal,
The step of generating each moving image frame generates the drawing data based on drawing instruction data including a variable representing a difference between the moving image frames. In a computer functioning as a video frame generation device that generates video frames,
Storing image data in which drawing portions common to at least two moving image frames of each moving image frame are generated in advance;
Generating drawing data of a drawing portion that is not common among the moving image frames, and generating the moving image frames by combining the image data and the drawing data;
Outputting a video based on each video frame when a video transmission request from a client terminal is received, and
The step of generating each moving image frame is a moving image output program for generating the drawing data based on drawing instruction data including a variable representing a difference between the moving image frames.

Images