JP5207489B2 - Movie display device, computer network system, broadcast network system, mobile network system - Google Patents

Abstract

A moving image display and so forth in which a viewer of a moving image can steer the progress of the moving image during the display of the moving image are provided. The moving image display for displaying a moving image by drawing a provided frame is characterized by comprising a steering instruction receiving means for receiving a steering instruction during the display of the moving image and a drawing instruction generating means for, when the steering instruction receiving means receives the steering instruction, generating a drawing instruction for instructing to draw a frame other than the provided frame from data on the provided frame according to the received steering instruction.

Description

  The present invention relates to a technique for moving images.

Conventionally, there has been proposed an apparatus capable of activating some action by performing a predetermined operation while displaying a moving image (see Patent Document 1).
JP 2003-32658 A

  However, the activation of such an action is a so-called device (see paragraph 0003 of Patent Document 1), and is only performed in advance by a moving image provider.

  Therefore, even if the person watching the moving image activates the action, the moving image can be advanced only in the direction in accordance with the expectation of the moving image provider.

  Therefore, the present invention provides a moving image display device, a computer network system, a broadcast network system, and a mobile network system that enable a person watching a moving image to steer the progress of the moving image while the moving image is being displayed. For the purpose.

  According to the present invention, the above problem is solved by the following means.

The present invention is a moving image display device for moving a moving image by drawing a plurality of frames one after another , extracting an object from a frame constituting the moving image, and drawing the extracted object to draw the frame. first means for rendering, by comparing the object extracted by the first means between two or more frames, receiving a second means for assigning the same object ID in the corresponding object, an interrupt request, the reception A third means for identifying the object ID from the interrupt request and storing it as a steering control command, and among the objects extracted from each frame, the object ID assigned by the second means is steered by the third means. the object that is not stored as instructions, which is directly drawn, the second hand By the objects that are stored as the steering switching instruction by the object ID is the third means assigned, and a fourth means for drawing interchanged with other objects, this the object ID, all frames This is a moving image display device characterized in that the value uniquely identifies an object through.

  Moreover, this invention is a computer network system provided with the said moving image display apparatus.

  Moreover, this invention is a broadcast network system provided with the said moving image display apparatus.

  Moreover, this invention is a portable network system provided with the said moving image display apparatus.

  According to the present invention, when a steering turn command is received, a drawing command for ordering drawing of a frame other than the provided frame is generated from data regarding the provided frame in accordance with the steering turn command.

  Therefore, according to the present invention, a person watching a moving image can steer about the progress of the moving image by inputting or transmitting a steering turn command while the moving image is displayed.

It is a figure explaining schematic operation | movement of the moving image display apparatus which concerns on embodiment of this invention. It is a figure which shows schematic structure of the moving image display apparatus which concerns on embodiment of this invention. It is a figure explaining the outline of the data structure which concerns on embodiment of this invention. It is a schematic flowchart of a moving image display process. It is a schematic flowchart of an object data acquisition process. It is a schematic flowchart of tracking data generation processing. It is a schematic flowchart of a drawing command generation output process. It is a schematic flowchart of a drawing command generation process. It is a schematic flowchart of a rudder turning-off command reception process. It is a figure which shows the moving image display apparatus which concerns on the Example of this invention.

Explanation of symbols

11 CPU
12 Main memory 13 Video controller 14 Video memory 15 Display 16 Mouse controller 17 Keyboard controller 18 Sound controller 19 Speaker 20 Media drive 21 Network controller 22 Hard disk drive

  The best mode for carrying out the present invention will be described below in detail with reference to the accompanying drawings.

[Operation of video display device]
First, the schematic operation of the moving image display apparatus according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is a diagram for explaining the schematic operation of a moving image display apparatus according to an embodiment of the present invention.

  In FIG. 1, frames 1 to 9 are frames constituting a moving image provided by a moving image provider. It is assumed that the moving image provider expects the moving image to proceed in the order of frames 1 to 9.

  Here, in the moving image display apparatus according to the embodiment, such a moving image can be advanced in accordance with the expectations of the moving image provider, that is, in the order of frames 1 to 9.

  However, in the moving image display apparatus according to the embodiment, it is possible to turn the steering of the moving image by the turn-off command.

  Hereinafter, the operation when the moving image display apparatus according to the embodiment turns the rudder with respect to the progress of the moving image will be described in cases 1 to 3.

(Case 1)
In case 1, the moving image display apparatus according to the embodiment advances the moving image to meet the expectations of the moving image provider until the frame 2 is drawn.

  However, the moving image display apparatus according to the embodiment receives a rudder turning command after the frame 2 is drawn, and turns the rudder about the progress of the moving image.

  Therefore, after the frame 2, the moving image is not a frame 3, 4, 5, 6 but a frame 3-1, 4-1, 5-1, 6-1 that the moving image provider did not plan. Proceed to.

  These frames 3-1, 4-1, 5-1, and 6-1 are not present in the moving image display device according to the embodiment until the drawing of the frame 2 is completed.

  The moving image display apparatus according to the embodiment generates drawing commands for these frames 3-1, 4-1, 5-1 and 6-1 from the frames 3, 4, 5 and 6 in accordance with the steering command.

  Then, the moving image display apparatus according to the embodiment draws the frames 7, 8, and 9 after accepting the cancellation of the steering instruction after the frame 6-1 is drawn. For this reason, after the frame 6-1 is drawn, the progress of the moving image returns to the direction planned by the moving image provider.

(Case 2)
In case 2, the video display device according to the embodiment draws the frame 3-1 in case 1 and then receives the second steering-off command, and further steers the progress of the video.

  For this reason, the moving image display apparatus according to the embodiment does not draw the frames 4-1 and 5-1, but draws the frames 4-2 and 5-2 that are different from the frames 4 and 5. The moving image will progress in a direction that was not planned at all by the moving image provider.

  These frames 4-2 and 5-2 were not present in the moving image display apparatus according to the embodiment until the drawing of the frame 3-1 was completed.

  The moving image display apparatus according to the embodiment generates drawing commands for the frames 4-2 and 5-2 from the frames 4 and 5 according to the second steering-off command.

  The moving image display apparatus according to the embodiment draws the frame 6-1 by accepting cancellation of the second steering turn command after the frame 5-2 is drawn. For this reason, after the drawing of the frame 5-2, the progress of the moving image returns to the direction in accordance with the steering turn command received first.

  Then, the moving image display apparatus according to the embodiment draws the frames 7, 8 and 9 in response to the cancellation of the steering turn command received first after the frame 6-1 is drawn. For this reason, after the frame 6-1 is drawn, the progress of the moving image returns to the direction planned by the moving image provider.

(Case 3)
In Case 3, the moving image display apparatus according to the embodiment advances the moving image to meet the expectations of the moving image provider until the frame 1 is drawn.

  However, the moving image display apparatus according to the embodiment accepts a steering turn command after the frame 1 is drawn, and turns the steering of the moving image.

  Therefore, after the frame 1, the moving image is not a frame 2, 3, 4, 5, 6, 7, 8, 9 but a frame 2-3, 3-3, 4-3, 5-3, 6-3. , 7-3, 8-3, 9-3, proceed in the direction that the video provider did not plan.

  These frames 2-3 to 9-3 did not exist in the moving image display apparatus according to the embodiment until the drawing of the frame 1 was completed.

  The moving image display apparatus according to the embodiment also generates drawing commands for the frames 2-3 to 9-3 from the frames 2 to 9 according to the steering command.

  In case 3, since the accepted rudder turn-off command is not canceled, the moving image display apparatus according to the embodiment is provided with (or continues to provide) frames 2 to 9, but these frames 2 to 2 are provided. There is no opportunity to draw 9, and the progress of the moving image does not return in the direction planned by the moving image provider.

  Thus, according to the moving image display device according to the embodiment, when a rudder turn command is received, according to the rudder turn command, from the data regarding the frame provided by the moving image provider, a frame that is not a provided frame is displayed. A drawing command for ordering drawing is generated.

  Therefore, according to the moving image display apparatus according to the embodiment, a person who is watching a moving image turns the rudder by inputting or transmitting a rudder turning command while displaying the moving image, It is possible to proceed in a direction different from the direction expected by the video provider.

  As described above, according to the moving image display device according to the embodiment, a person watching a moving image can control the progress of the moving image by turning the rudder while the moving image is displayed.

  For this reason, according to the moving image display apparatus according to the embodiment, the initiative regarding the moving image can be transferred from the moving image provider to the person watching the moving image.

[Configuration of video display device]
Next, a schematic configuration of the moving image display apparatus according to the embodiment of the present invention will be described with reference to FIG. FIG. 2 is a diagram showing a schematic configuration of the moving image display apparatus according to the embodiment of the present invention.

  As shown in FIG. 2, the moving image display apparatus according to the embodiment of the present invention includes a CPU 11, a main memory 12, a video controller 13, a video memory 14, a display 15, a mouse controller 16, and a keyboard controller 17. , A sound controller 18, a speaker 19, a media drive 20 such as a CD drive or a DVD drive, a network controller 21, and a hard disk drive 22.

  In the moving image display apparatus according to the embodiment of the present invention, the CPU 11 reads out a program stored in the hard disk drive 22 to the main memory 12 and then executes a moving image display process.

  In the embodiment of the present invention, a moving image provided by a moving image provider is composed of a plurality of frames, and the frame data for each frame is inserted into the media drive 20 as a DVD-ROM, CD-ROM, USB. It is stored in a memory or the hard disk drive 22 or the like.

  In the moving image display apparatus according to the embodiment of the present invention, the CPU 11 reads all or part of each frame data stored in these devices to the main memory 12, and then reads all or all of the read frame data. A drawing command is generated from a part.

  The drawing command generated in this way is data for instructing drawing of each frame, and is output from the CPU 11 to the video controller 13.

  When receiving a drawing command from the CPU 11, the video controller 13 generates a video signal according to the drawing command and stores it in the video memory 14.

  Thereafter, the video controller 13 reads a video signal from the video memory 14 and outputs it to the display 15.

  Then, the display 15 draws a frame on the screen by scanning the screen based on the video signal input from the video controller 13.

  The mouse controller 16, keyboard controller 17, or network controller 21 is a steering command when a steering command is input from a mouse (not shown) or a keyboard (not shown) or from a network (not shown) such as the Internet. Is output to the CPU 11.

  When an interrupt request is input from the mouse controller 16, the keyboard controller 17, or the network controller 21, the CPU 11 reads out the steering-turn command requested to be interrupted and stores it in the main memory 12.

  Then, in accordance with the steering-off instruction stored in the main memory 12, the CPU 11 determines from the data relating to the frame stored in the DVD-ROM, CD-ROM, USB memory, etc., the hard disk drive 22, etc. A drawing command for instructing drawing of a frame other than the stored frame is generated and output to the video controller 13.

  Sound data is also stored in the DVD-ROM, CD-ROM, USB memory or the hard disk drive 22 inserted in the media drive 20.

  The CPU 11 sends sound data to be output from the speaker 19 to the main memory 12 in synchronization with the drawing of each frame from a DVD-ROM, CD-ROM, USB memory, or the hard disk drive 22 inserted into the media drive 20. After reading, the read sound data is output to the sound controller 18.

[data structure]
Next, the data structure of data processed by the CPU 11 in the moving image display process will be described with reference to FIG. FIG. 3 is a diagram for explaining the outline of the data structure according to the embodiment of the present invention.

  In the moving image display process, the CPU 11 processes object data, tracking data, a steering command, and a drawing command. The data structure of these data is as shown in FIG.

(A: Data structure of object data)
The object data is data about an object included in each frame, and is obtained from the frame data.

  In the embodiment, as the object data, a reference point X coordinate of raster data constituting the object, a reference point Y coordinate of raster data constituting the object, raster data, and an edge coordinate sequence of the object are used.

  As shown in FIG. 3A, this object data is stored in each area of obj [n, m, 0] to obj [n, m, 3].

  Here, n indicates a frame number for identifying a frame, and m indicates an object identifier for distinguishing objects within one frame.

  For example, assuming that the frame 3 in FIG. 1 includes three objects, the reference point X coordinate, reference point Y coordinate, raster data, and edge coordinate sequence for the first object are respectively obj. The reference point X coordinate, reference point Y coordinate, raster data, and edge coordinate sequence for the second object stored in [2, 0, 0] to obj [2, 0, 3] are respectively obj [2 , 1, 0] to obj [2, 1, 3], the reference point X coordinate, reference point Y coordinate, raster data, and edge coordinate sequence for the third object are obj [2, 2 respectively. , 0] to obj [2, 2, 3].

<Reference point X coordinate>
The reference point X coordinate is an X coordinate at which the reference point on the raster data is located in the frame.

<Reference point Y coordinate>
The reference point Y coordinate is the Y coordinate at which the reference point on the raster data is located in the frame.

<Raster data>
Raster data is an image that constitutes an object.

<Edge coordinate sequence>
An edge coordinate sequence is a set of coordinates representing the outline of an object.

(B: Data structure of tracking data)
The tracking data is data indicating the relationship of objects between frames. This tracking data is used, for example, in order to make the CPU 11 know that these objects correspond when an object called person A is included in frame 1 and frame 2 in FIG.

  As shown in FIG. 3B, this tracking data is stored in each area of track [i, 0] to track [i, N + 1].

  Here, i is an object ID. This object ID is a value that uniquely identifies an object through all frames.

For example, in FIG.
-1 is assigned as the object ID,
3 is assigned as the object identifier in frame 1 (frame number 0),
2 is assigned as the object identifier in frame 2 (frame number 1),
When 8 is assigned as the object identifier in frame 3 (frame number 2),
In track [1, 0], meta information (for example, “A”) of the object about person A is stored, in track [1, 1], 3 is stored, and in track [1, 2], 2 is stored. 8 is stored in track [1, 3].

  N is the number of frames constituting the moving image, and is calculated, for example, by the CPU 11 dividing the moving image display time by the frame rate.

(C: Data structure of rudder turning command)
The rudder turn-off command is data for instructing to turn the rudder about the progress of the moving image. More specifically, how the moving image display device issues a drawing command for a frame that is not a frame provided by the moving image provider. It is an instruction that defines whether to generate.

  The steering-off command is steering [j, 0], steering [j, 1], steering [j, 2], steering [j, 3], steering [j, 4], steering [j, 5], steering [j, 5] j, 6] and steering [j, 7].

  In the present embodiment, the type, object ID, emphasis type, reference point X coordinate, reference point Y coordinate, replacement object ID, start frame number, and end frame number are used as the steering-off command.

  Note that j is a steering-off command ID for identifying a steering-off command.

<Type>
The type is a value indicating another operation for the object. In the embodiment, 0 indicates that the edge of the object should be highlighted, 1 indicates that the object should be moved, 2 indicates that the two objects in the same frame should be interchanged, and 3 indicates the object Indicates that should be deleted.

<Object ID>
The object ID here is the object ID of the object to be operated.

<Emphasis type>
The emphasis type is a value indicating another emphasis display for the edge of the object. For example, if 0, the edge blinks, and if 1, the edge is blue.

<Reference point X coordinate>
The reference point X coordinate here is the reference point X coordinate of the movement destination when the object to be operated is moved.

<Reference point Y coordinate>
The reference point Y coordinate here is the reference point Y coordinate of the movement destination when the object to be operated is moved.

<Replacement object ID>
The replacement object ID is data indicating which object ID the object is replaced with when the object is replaced.

<Start frame number>
The start frame number is a frame number of a frame at which generation of a drawing command according to the steering command is started.

<End frame number>
The end frame number is a frame number of a frame that finishes generating the drawing command according to the steering command.

(D: Data structure of drawing command)
The drawing command is data output from the CPU 11 to the video controller 13.

  In the embodiment, the rendering command uses the reference point X coordinate of the raster data constituting the object, the reference point Y coordinate of the raster data constituting the object, the raster data, the edge coordinate sequence of the object, and the enhancement type. To do.

  As shown in FIG. 3D, these drawing commands are stored in each area of cmd [0] to cmd [4].

[Movie display processing]
Next, the moving image display process executed by the CPU 11 of the moving image display apparatus according to the embodiment will be described with reference to FIG. FIG. 4 is a schematic flowchart of the moving image display process.

(Step S1: Initialization process)
In step S1, the CPU 11 secures areas for variables and constants on the main memory 12, performs initialization processing for storing initial values in the variables and constants in which these areas are secured, and proceeds to step S2.

  More specifically, the moving image display apparatus according to the embodiment performs the initialization process using variables n, m, M, pm, PM, i, I, j, J, k, object_id, a, b, Areas of constants N, C1, and C2 are secured on the main memory 12.

  The moving image display apparatus according to the embodiment stores 0 in variables n, m, M, pm, PM, i, I, j, J, k, object_id, a, and b, and stores the number of frames in N. Then, a predetermined threshold value is stored in C1 and C2.

  In addition, the moving image display apparatus according to the embodiment also secures areas for obj [], track [], steering [], and cmd [] on the main memory 12.

(Step S2: Start of frame loop)
In step S2, the CPU 11 determines whether n is not less than 0 and not more than N. If it is not less than 0 and not more than N, the process proceeds to step S3.

(Step S3: Object data acquisition process)
In step S3, the CPU 11 executes an object data acquisition process and proceeds to step S4. In the object data acquisition process, object data for an object included in the frame is acquired from the frame data for the frame with frame number n, and stored in obj [n, m, 0] to obj [n, m, 3]. It is processing to do.

(Step S4: Tracking data generation process)
In step S4, the CPU 11 executes a tracking data generation process and proceeds to step S5. The tracking data generation process is a process of acquiring the object identifier m of the object included in the frame with the frame number n and storing it in the track [i, n + 1].

(Step S5: Start of current object loop)
In step S5, the CPU 11 determines whether m is not less than 0 and not more than M. If it is not less than 0 and not more than M, the process proceeds to step S6, and if not not less than 0 to M, the process proceeds to step S8.

(Step S6: Drawing command generation output processing)
In step S6, the CPU 11 executes a drawing command generation output process, and proceeds to step S7. The drawing command generation output process generates a drawing command for instructing drawing of an object that is not an object included in the frame of frame number n from the object data for the object included in the frame of frame number n in accordance with the accepted steering-off command. It is a process to output.

(Step S7: End of current object loop)
In step S7, the CPU 11 determines whether m is not less than 0 and not more than M. If it is not less than 0 and not more than M, the process returns to step S6.

(Step S8: Steering-off command reception process)
In step S <b> 8, the CPU 11 executes a rudder turning command reception process and proceeds to step S <b> 9. The rudder turning command receiving process is a process of accepting a rudder turning command and storing the received rudder turning command in steering [j, 0] to steering [j, 7].

(Step S9: End of frame loop)
In step S9, the CPU 11 determines whether n is 0 or more and N or less. If n is 0 or more and N or less, the process returns to step S3, and if it is not 0 or more and N or less, the moving image display process is terminated.

[Object data acquisition processing]
Next, object data acquisition processing executed by the CPU 11 of the moving image display apparatus according to the embodiment will be described with reference to FIG. FIG. 5 is a schematic flowchart of the object data acquisition process.

(Step S3-1)
In step S3-1, the CPU 11 determines whether m is equal to or greater than 0. If m is equal to or greater than 0, the process proceeds to step S3-2, and if not equal to 0, the process proceeds to step S3-10.

(Step S3-2)
In step S <b> 3-2, the CPU 11 performs processing for extracting an object from the frame of frame number n, and proceeds to step S <b> 3-3.

  As processing for extracting an object from a frame, an intra-frame extraction method such as using a sudden change in adjacent pixel values or an inter-frame extraction method such as extracting a portion having a large difference between frames can be used. .

(Step S3-3)
In step S3-3, the CPU 11 determines whether or not the object has been extracted from the frame with the frame number n. If the object has been extracted, the process proceeds to step S3-4. If not, the process proceeds to step S3-10. .

(Step S3-4)
In step S3-4, the CPU 11 acquires a reference point X coordinate of raster data constituting the extracted object, and stores the acquired reference point X coordinate in obj [n, m, 0]. Proceed to -5.

(Step S3-5)
In step S3-5, the CPU 11 acquires the reference point Y coordinate of the raster data constituting the extracted object, and stores the acquired reference point Y coordinate in obj [n, m, 1]. Proceed to -6.

(Step S3-6)
In step S3-6, the CPU 11 acquires the raster data of the extracted object, stores the acquired raster data in obj [n, m, 2], and proceeds to step S3-7.

(Step S3-7)
In step S3-7, the CPU 11 calculates an edge coordinate sequence of the extracted object, and proceeds to step S3-8.

(Step S3-8)
In step S3-8, the CPU 11 stores the calculated edge coordinate sequence in obj [n, m, 3], and proceeds to step S3-9.

(Step S3-9)
In step S3-9, the CPU 11 determines whether m is 0 or more. If m is 0 or more, the process returns to step S3-2, and if not 0, the process proceeds to step S3-10.

(Step S3-10)
In step S3-10, the CPU 11 stores the value stored in the variable M in the variable PM, and proceeds to step S3-11.

(Step S3-11)
In step S3-11, the CPU 11 stores the value stored in the variable m in the variable M, and ends the object data acquisition process.

[Tracking data generation processing]
Next, the tracking data generation process executed by the CPU 11 of the video display device according to the embodiment will be described with reference to FIG. FIG. 6 is a schematic flowchart of the tracking data generation process.

(Step S4-1)
In step S4-1, the CPU 11 determines whether n is not equal to 0. If not equal, the process proceeds to step S4-7, and if equal, the process proceeds to step S4-2.

(Step S4-2)
In step S4-2, the CPU 11 determines whether m is not less than 0 and not more than M. If m is not less than 0 and not more than M, the process proceeds to step S4-3. Proceed to S4-6.

(Step S4-3)
In step S4-3, the CPU 11 stores the value stored in the variable m in track [i, 1], and proceeds to step S4-4.

(Step S4-4)
In step S4-4, the CPU 11 adds 1 to the value stored in i and stores it in i, and proceeds to step S4-5.

(Step S4-5)
In step S4-5, the CPU 11 determines whether m is not less than 0 and not more than M. If m is not less than 0 and not more than M, the process returns to step S4-3. Proceed to S4-6.

(Step S4-6)
In step S4-6, the CPU 11 stores a value obtained by subtracting 1 from the value stored in i in the variable I, and ends the tracking data generation process.

(Step S4-7)
In step S4-7, the CPU 11 determines whether m is greater than or equal to 0 and less than or equal to M. If m is greater than or equal to 0 and less than or equal to M, the process proceeds to step S4-8. The data generation process ends.

(Step S4-8)
In step S4-8, the CPU 11 determines whether pm is greater than or equal to 0 and less than or equal to PM, and proceeds to step S4-9 if it is greater than or equal to 0 and less than PM, and proceeds to step S4-14 if not greater than 0 and less than PM. move on.

(Step S4-9)
In step S4-9, the CPU 11 calculates a first comparison value from obj [n, m, 3] and obj [n-1, pm, 3], and proceeds to step S4-10.

  Here, the first comparison value is calculated by the CPU 11 as a value for determining whether or not the shape of the edge is similar between the frame with the frame number n and the frame with the frame number n−1. .

  As the first comparison value, the ratio or difference of the corresponding side length or corner can be used. Such ratios and differences are calculated using the edge coordinate sequence stored in obj [n, m, 3] and the value stored in obj [n-1, pm, 3].

  As described above, the first comparison value is preferably calculated from between two adjacent frames. However, in the present invention, the first comparison value can also be calculated between two non-adjacent frames or between three or more frames.

(Step S4-10)
In step S4-10, the CPU 11 determines whether or not the calculated first comparison value is smaller than the value stored in the constant C1, the process proceeds to step S4-11 if it is smaller, and step S4-13 if not smaller. Proceed to

  Here, the constant C1 stores a threshold value serving as a reference for determining the correspondence / non-correspondence between two objects to be compared.

(Step S4-11)
In step S4-11, the CPU 11 calculates a second comparison value from obj [n, m, 2] and obj [n-1, pm, 2], and proceeds to step S4-12.

  Here, the second comparison value is calculated by the CPU 11 as a value for determining whether or not the raster data has a similar relationship between the frame with the frame number n and the frame with the frame number n−1.

  The second comparison value corresponds to a case where raster data stored in obj [n, m, 2] and raster data stored in obj [n−1, pm, 2] are expanded. An equivalent ratio of pixels to be used can be used.

  As described above, the second comparison value is preferably calculated from between two adjacent frames. However, in the present invention, the second comparison value can be calculated between two non-adjacent frames or between three or more frames.

(Step S4-12)
In step S4-12, the CPU 11 determines whether or not the calculated second comparison value is smaller than the constant C2, the process proceeds to step S4-14 if it is smaller, or proceeds to step S4-13 if not smaller.

  Here, the constant C2 stores a threshold value serving as a reference for determining the correspondence / non-correspondence between the two objects to be compared.

(Step S4-13)
In step S4-13, the CPU 11 determines whether pm is greater than or equal to 0 and less than or equal to PM. If it is greater than or equal to 0 and less than PM, the process returns to step S4-9. move on.

(Step S4-14)
In step S4-14, the CPU 11 determines whether i is 0 or more and I or less. If i is 0 or more and I or less, the process proceeds to step S4-15. If i is not 0 or more and I or less, the process proceeds to step S4-18. move on.

(Step S4-15)
In step S4-15, the CPU 11 determines whether or not the value stored in track [i, n] is equal to the value stored in pm. If they are equal, the process proceeds to step S4-17 and must be equal. Step S4-16 follows.

(Step S4-16)
In step S4-16, the CPU 11 determines whether or not the variable i is 0 or more and I or less. If the variable i is 0 or more and I or less, the process returns to step S4-15. Proceed to

(Step S4-17)
In step S4-17, the CPU 11 stores the value stored in m in track [i, n + 1], and proceeds to step S4-20.

(Step S4-18)
In step S4-18, the CPU 11 adds 1 to the value stored in the variable I and stores it in the variable I, and proceeds to step S4-19.

(Step S4-19)
In step S4-19, the CPU 11 stores the value stored in m in track [I, n + 1], and proceeds to step S4-20.

(Step S4-20)
In step S4-20, the CPU 11 determines whether or not m is 0 or more and M or less. If m is 0 or more and M or less, the process returns to step S4-8. finish.

[Drawing command generation output processing]
Next, a drawing command generation / output process executed by the CPU 11 of the moving image display apparatus according to the embodiment will be described with reference to FIG. FIG. 7 is a schematic flowchart of the drawing command generation / output process.

(Step S6-1)
In step S6-1, the CPU 11 determines whether i is 0 or more and I or less. If i is 0 or more and I or less, the process proceeds to step S6-2. If i is not 0 or more and I or less, the process proceeds to step S6-5. move on.

(Step S6-2)
In step S6-2, the CPU 11 determines whether or not the value stored in track [i, n + 1] is equal to the value stored in m. If they are equal, the process proceeds to step S6-3 and must be equal. Step S6-4 follows.

(Step S6-3)
In step S6-3, the CPU 11 stores the value stored in the variable i in the variable object_id, and proceeds to step S6-5.

(Step S6-4)
In step S6-4, the CPU 11 determines whether i is 0 or more and I or less. If i is 0 or more and I or less, the process returns to step S6-2, and if it is not 0 or more and I or less, the process proceeds to step S6-5. move on.

(Step S6-5)
In step S6-5, the CPU 11 executes a drawing command generation process, and proceeds to step S6-6.

(Step S6-6)
In step S6-6, the CPU 11 outputs the generated drawing command to the video controller 13, and ends the drawing command generation output process.

(Drawing command generation process)
Next, a drawing command generation process executed by the CPU 11 of the moving image display apparatus according to the embodiment will be described with reference to FIG. FIG. 8 is a schematic flowchart of the drawing command generation process.

(Step S6-5-1)
In step S6-5-1, the CPU 11 determines whether k is 0 or more and 3 or less. If it is 0 or more and 3 or less, the process proceeds to step S6-5-2. Proceed to S6-5-4.

(Step S6-5-2)
In step S6-5-2, the CPU 11 stores the value stored in obj [n, m, k] in cmd [k], and proceeds to step S6-5-3.

(Step S6-5-3)
In step S6-5-3, the CPU 11 determines whether or not k is 0 or more and 3 or less. If k is 0 or more and 3 or less, the process returns to step S6-5-2, and if it is not 0 or more and 3 or less, step 11-6 is performed. Proceed to S6-5-4.

(Step S6-5-4)
In step S6-5-4, the CPU 11 stores 0 in cmd [4] and proceeds to step S6-5-5.

(Step S6-5-5)
In step S6-5-5, the CPU 11 determines whether j is 0 or more and J or less. If it is 0 or more and J or less, the process proceeds to step S6-5-6. The instruction generation process is terminated.

(Step S6-5-6)
In step S6-5-6, the CPU 11 determines whether or not the value stored in steering [j, 1] is equal to the value stored in object_id. If they are equal, the process proceeds to step S6-5-7. If not equal, the process proceeds to step S6-5-19.

(Step S6-5-7)
In step S6-5-7, the CPU 11 determines whether or not the value stored in the variable n is larger than the value stored in steering [j, 7], and if so, step S6-5-19. If not, the process proceeds to step S6-5-8.

(Step S6-5-8)
In step S6-5-8, the CPU 11 determines whether or not the value stored in steering [j, 0] is equal to 0, the process proceeds to step S6-5-9 if equal, and if not equal to step S6-5-9. Proceed to -5-10.

(Step S6-5-9)
In step S6-5-9, the CPU 11 stores the value stored in steering [j, 2] in cmd [4], and proceeds to step S6-5-19.

(Step S6-5-10)
In step S6-5-10, the CPU 11 determines whether or not the value stored in steering [j, 0] is equal to 1, the process proceeds to step S6-5-11 if they are equal, otherwise the process proceeds to step S6. Proceed to -5-13.

(Step S6-5-11)
In step S6-5-11, the CPU 11 stores the value stored in steering [j, 3] in cmd [0], and proceeds to step S6-5-12.

(Step S6-5-12)
In step S6-5-12, the CPU 11 stores the value stored in steering [j, 4] in cmd [1], and proceeds to step S6-5-19.

(Step S6-5-13)
In step S6-5-13, the CPU 11 determines whether or not the value stored in steering [j, 0] is equal to 2, the process proceeds to step S6-5-14 if they are equal, otherwise the process proceeds to step S6-5. Proceed to -5-17.

(Step S6-5-14)
In step S6-5-14, the CPU 11 stores the value stored in steering [j, 5] in the variable a, and proceeds to step S6-5-15.

(Step S6-5-15)
In step S6-5-15, the CPU 11 stores the value stored in track [a, n + 1] in the variable b, and proceeds to step S6-5-16.

(Step S6-5-16)
In step S6-5-16, the CPU 11 stores the value stored in obj [n, b, 2] in cmd [2], and proceeds to step S6-5-19.

(Step S6-5-17)
In step S6-5-17, the CPU 11 determines whether or not the value stored in steering [j, 0] is equal to 3, the process proceeds to step S6-5-18 if they are equal, otherwise the process proceeds to step S6. Proceed to -5-19.

(Step S6-5-18)
In step S6-5-18, the CPU 11 stores 0 in cmd [2], and proceeds to step S6-5-19.

(Step S6-5-19)
In step S6-5-19, the CPU 11 determines whether or not the variable j is 0 or more and J or less. If the variable j is 0 or more and J or less, the process returns to step S6-5-6. The drawing command generation process ends.

[Steering-off command acceptance processing]
Next, a steering instruction receiving process executed by the CPU 11 of the video display device according to the embodiment will be described with reference to FIG. FIG. 9 is a schematic flowchart of the steering-off command reception process.

(Step S8-1)
In step S8-1, the CPU 11 determines whether or not an interrupt request is output from the mouse controller 16, keyboard controller 17, or network controller 21, and proceeds to step S8-2 if output. If not, the rudder turn command acceptance process is terminated.

(Step S8-2)
In step S8-2, the CPU 11 reads out the data requested to be interrupted from the mouse controller 16, keyboard controller 17, or network controller 21, and proceeds to step S8-3. In the moving image display device according to the embodiment, the data requested to be interrupted is a coordinate or a steering command.

(Step S8-3)
In step S8-3, the CPU 11 determines whether or not the read data is a coordinate. If the data is a coordinate, the process proceeds to step S8-4. If not, the process proceeds to step S8-15.

(Step S8-4)
In step S8-4, the CPU 11 determines whether m is 0 or more and M or less. If it is 0 or more and M or less, the process proceeds to step S8-5, and if it is not 0 or more and M or less, the process proceeds to step S8-7. move on.

(Step S8-5)
In step S8-5, the CPU 11 determines whether or not the received coordinates fall within the edge indicated by obj [n, m, 3]. If so, the process proceeds to step S8-7. Proceed to step S8-6.

(Step S8-6)
In step S8-6, the CPU 11 determines whether m is 0 or more and M or less. If it is 0 or more and M or less, the process returns to step S8-5, and if it is not 0 or more and M or less, the process proceeds to step S8-7. move on.

(Step S8-7)
In step S8-7, the CPU 11 determines whether i is 0 or more and I or less. If i is 0 or more and I or less, the process proceeds to step S8-8. If i is not 0 or more and I or less, the process proceeds to step S8-11. move on.

(Step S8-8)
In step S8-8, the CPU 11 determines whether or not the value stored in the track [i, n + 1] is equal to the value stored in the variable m, the process proceeds to step S8-10 if equal. If not, the process proceeds to step S8-9.

(Step S8-9)
In step S8-9, the CPU 11 determines whether i is 0 or more and I or less. If i is 0 or more and I or less, the process returns to step S8-8, and if it is not 0 or more and I or less, the process proceeds to step S8-11. move on.

(Step S8-10)
In step S8-10, the CPU 11 stores the value stored in the variable i in object_id, and proceeds to step S8-11.

(Step S8-11)
In step S8-11, the CPU 11 determines whether or not the variable j is 0 or more and J or less. If the variable j is 0 or more and J or less, the process proceeds to step S8-12. End the process.

(Step S8-12)
In step S8-12, the CPU 11 determines whether or not the value stored in steering [j, 1] is equal to the value stored in object_id. If they are equal, the process proceeds to step S8-14 and must be equal. Step S8-13 follows.

(Step S8-13)
In step S8-13, the CPU 11 outputs a drawing command for instructing drawing of the steering command ID, steering [j, 0] and steering [j, 1], and proceeds to step S8-14.

(Step S8-14)
In step S8-14, the CPU 11 determines whether or not the variable j is 0 or more and J or less. If the variable j is 0 or more and J or less, the CPU 11 returns to step S8-12. End the process.

(Step S8-15)
In step S8-15, the CPU 11 stores the steering instruction ID in the variable j, and proceeds to step S8-16.

(Step S8-16)
In step S8-16, the CPU 11 determines whether or not the value stored in the variable j is NULL. If NULL, the process proceeds to step S8-17, and if not NULL, the process proceeds to step S8-19.

(Step S8-17)
In step S8-17, the CPU 11 adds 1 to the value stored in the variable J and stores it in the variable J, and proceeds to step S8-18.

(Step S8-18)
In step S8-18, the CPU 11 stores the value stored in the variable J in the variable j, and proceeds to step S8-19.

(Step S8-19)
In step S8-19, the CPU 11 executes storage processing for all or part of steering [j, 0] to steering [j, 7], and ends the steering control command reception processing.

  As described above, the moving image display device according to the embodiment has been described. However, when an object is moved or deleted in the moving image display device according to the embodiment, the background of the movement source portion or the deleted portion is predicted and complemented. It is preferable to keep it. Such background prediction can be performed, for example, by comparing a plurality of frames.

  In addition, the moving image display apparatus according to the above-described embodiment can accept meta information of each object during display of the moving image. The accepted meta information is stored in track [i, 0].

  Next, a moving image display apparatus according to an embodiment of the present invention will be described with reference to FIG. FIG. 10 is a diagram illustrating a moving image display apparatus according to an embodiment of the present invention.

  In the embodiment, it is assumed that the moving image provider expects the moving image to proceed in the normal direction.

  However, in the moving image display apparatus according to the embodiment, the moving image proceeds in a direction that the moving image provider did not expect by the steering command such as erasure, movement, and replacement.

  As shown in FIG. 10, when an erasure steering command is accepted, the video proceeds in the direction of Erase, and when a movement steering command is accepted, the video proceeds in the Move direction. When the turn-off instruction for replacement is accepted, the moving image proceeds in the direction of Switch.

  In FIG. 10, as is clear from the comparison of the fifth frame, the progress of the moving image in the Erase direction, the Move direction, and the Switch direction is for the video provider who expected the moving image in the Normal direction. It was something that was not supposed or prepared.

  As mentioned above, although embodiment and the Example of this invention were described, these description is related to an example of this invention, and this invention is not limited at all by these description.

[Provided frame]
In the present invention, “provided frame” means a frame taken into the moving image display device via an input means, a receiving means, or the like.

  Here, the input means means all means capable of inputting a frame, and the media drive described above is an example of this input means.

  The receiving means means all means capable of receiving a frame, and the network controller described above is an example of the receiving means.

"Frame", "Frame data"
A “frame” is an image constituting one screen (one frame), and “frame data” includes this image (eg, raster data) and data related to this image.

"Object", "Object data"
An “object” is an image constituting a part of a frame, that is, an image constituting a part of one screen (one frame), and “object data” includes this image (eg, raster data) and this Data about the image.

  One frame is composed of two or more objects.

[Steering-off command acceptance means]
In the present invention, the “steering-off instruction receiving means” means all means that can receive a steering-off instruction during the display of a moving image. For example, the above-described mouse controller, keyboard controller, network controller, etc. It is an example of a cut command reception means.

[Reception of rudder turning order]
In the present invention, “accepting” a rudder turning command means that the rudder turning command is input or received.

[Drawing command generation means]
In the present invention, the “drawing command generation means” means all means capable of generating a drawing command. In the above-described embodiment, the CPU has been described as an example of the drawing command generation unit. However, in the present invention, for example, a video controller or the like can also be used as the drawing command generation unit.

[Frame data]
As “data relating to a frame”, frame data and / or object data can be used.

[Drawing command to draw frame]
The “drawing command for ordering drawing of a frame” includes a “drawing command for ordering drawing of all of one frame” and / or a “drawing command for ordering drawing of a part of one frame (ie,“ object ”)”. It is.

[Not the provided frame]
“It is not a provided frame” means that “one frame” is “provided” when “drawing command for drawing a frame” is set as “drawing command for drawing all of one frame”. This means that it does not completely match one of the “framed frames”, and the “drawing command for drawing a frame” is set as “a drawing command for drawing a part of one frame (ie,“ object ”)” In this case, this “part of one frame (ie,“ object ”)” does not completely match one of “part of provided frame (ie,“ object ”)”.

[Movie display device]
In the above-described embodiment, the description has been made assuming that the personal computer is an example of the “moving image display device”, but the “moving image display device” in the present invention is not limited to the personal computer. The “moving image display device” in the present invention includes all devices capable of displaying a moving image, and includes, for example, a television (television) (TV), a portable terminal, and a projector with a built-in drawing command generation means. .

[Video]
In the present invention, “moving image” means all data in which images move on the screen, and in addition to movies and animations, broadcast programs and live images also correspond to “moving images” in the present invention.

[network]
The network in the present invention is not limited to the Internet, and includes all networks in which data is transmitted, received, or transmitted / received.

  The present invention includes a mode in which the units included in the moving image display apparatus according to the embodiment are distributed on the network. In such a case, the network includes the moving image display apparatus.

  The present invention includes not only a moving image display device used as a stand-alone but also a network including the moving image display device. This network includes, in addition to a computer network, a broadcast network for broadcasting programs and CMs, and a mobile network in which data is transmitted, received, or transmitted / received between mobile terminals or between a mobile terminal and a fixed terminal. .

Claims (4)

A video display device that advances a video by drawing a plurality of frames one after another ,
A first means for drawing the frame by extracting an object from a frame constituting the moving image and drawing the extracted object;
The object extracted by the first means and compared between two or more frames, and a second means for assigning the same object ID in the corresponding object,
A third means for receiving an interrupt request, specifying an object ID from the received interrupt request and storing it as a steering command;
Among the objects extracted from each frame, for an object whose object ID assigned by the second means is not stored as a steering command by the third means, it is drawn as it is and assigned by the second means. For an object whose object ID is stored as a steering command by the third means, a fourth means for drawing by replacing this with another object;
With
The object ID is a value that uniquely identifies an object through all frames.
A moving image display device characterized by that .   A computer network system comprising the moving image display device according to claim 1.   A broadcast network system comprising the moving image display device according to claim 1.   A mobile network system comprising the moving image display device according to claim 1.

Images