JP2009054009A - Structured document drawing apparatus, structured document drawing method, program, and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a structured document drawing apparatus, a structured document drawing method and a program to draw a structured document after describing a frame position or a frame range of a moving image or an animation in the structured document including the moving image or the animation and applying processing to a frame at the frame position or in the frame range. <P>SOLUTION: The structured document drawing apparatus is provided with a frame position description means for describing in a structured document positions of one or more frames of a moving image or an animation included in the structured document, a frame processing description means for describing processing to be applied to the frame described by the frame position description means, a frame position acquisition means for acquiring the frame position from the structured document, a frame processing acquisition means for acquiring the frame processing from the structured document, and a frame processing means for applying the acquired frame processing to the frame corresponding to the acquired frame position. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a structured document drawing apparatus, and more particularly to a structured document drawing apparatus including one or more moving images or animations, a control method thereof, a program for causing a computer to execute the control method, and a computer program reading the program. The present invention relates to a storage medium that can be stored.

Conventionally, a Web that expresses video by embedding a video program for displaying video in HTML, which is a structured document that describes the contents of a Web page, and displaying video image files on the Web server continuously. There are Web browsers that select arbitrary still images constituting a moving image and use them for printing and display. (See Patent Document 1)
JP2000-181924

  However, the above-mentioned conventional technology has the following: Web server content data composed of an HTML file included in a Web page on the Web server, a moving image program included in the HTML file, and a moving image file group on the Web server. A printing device that uses a structured document as a PDL has not been assumed. In addition, when it is desired to perform some processing on a specific frame in a moving image or animation, the frame position to be processed and the processing content cannot be described in the structured document.

  The present invention has been made in view of such problems, and describes a frame position or a frame range of the moving image or animation in a structured document including the moving image or animation, and the frame of the frame position or frame range. It is an object of the present invention to provide a structured document drawing apparatus, a structured document drawing method, and a program for drawing a structured document after processing is performed.

To achieve the above object, according to the first aspect of the present invention, in a structured document drawing apparatus capable of drawing a structured document including a moving image or an animation,
Describes the frame position description means for describing the position of one or more frames of a moving image or animation contained in the structured document in the structured document, and the processing to be performed on the frame described by the frame position description means. Frame processing description means, frame position acquisition means for acquiring the frame position from the structured document, frame processing acquisition means for acquiring the frame processing from the structured document, and a frame corresponding to the acquired frame position. Thus, there is provided a structured document drawing apparatus comprising a frame processing means for performing the acquired frame processing.

  According to the fourth aspect of the invention, the frame range description means for describing the range of the frame of the moving image or animation contained in the structured document in the structured document, and the frame range is acquired from the structured document. There is provided a structured document drawing apparatus characterized by performing frame processing acquired by the frame processing acquisition unit on a frame range acquisition unit and a frame corresponding to the acquired frame range.

  According to a seventh aspect of the invention, the still image generating means for generating a still image based on the frame processed by the frame processing means and the frame position description means or the frame range description means There is provided a structured document drawing apparatus comprising: a frame selection unit that selects a frame to be converted from a plurality of frames into a still image.

  According to the twelfth aspect of the present invention, in the structured document drawing method capable of drawing a structured document including a moving image or animation, the position of one or more frames of the moving image or animation included in the structured document. Frame position description step for describing the frame position in the structured document, a frame processing description step for describing processing to be performed on the frame described by the frame position description means, and a frame position for acquiring the frame position from the structured document An acquisition step; a frame processing acquisition step for acquiring the frame processing from a structured document; and a frame processing step for applying the acquired frame processing to a frame corresponding to the acquired frame position. A featured structured document rendering method is provided.

  According to a thirteenth aspect of the present invention, a frame range description step for describing a frame range of a moving image or animation contained in a structured document in the structured document, and acquiring the frame range from the structured document. There is provided a structured document drawing method characterized by performing a frame range acquisition step and the frame processing acquired in the frame processing acquisition step on a frame corresponding to the acquired frame range.

  According to a fourteenth aspect of the present invention, the still image generating step for generating a still image based on the frame processed by the frame processing step and the frame position description step or the frame range description step are used. There is provided a structured document drawing method comprising a frame selection step of selecting a frame to be converted from a plurality of frames to a still image.

  Furthermore, a program for causing a computer to execute the structured document drawing method is provided.

  According to the present invention, in a structured document drawing apparatus capable of drawing a structured document including a moving image or an animation, processing is performed on the frame specified by the moving image or animation in the structured document. After the description and the specified processing are performed on the frame specified based on the information, the structured document can be rendered.

  In the structured document drawing apparatus, after a designated process is performed on a designated frame, the frame can be selected and converted into a still image, and a structured document can be drawn.

  Next, details of the present invention will be described in accordance with the description of the embodiments.

  Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.

  FIG. 1 is a system configuration diagram of a structured document printing apparatus according to a preferred embodiment of the present invention.

  In FIG. 1, reference numeral 101 denotes a content site, which has a structured document database 105 and a moving image database 106, and stores structured documents as contents.

  Reference numeral 102 denotes a print site, on which the structured document drawing apparatus 107 according to an embodiment of the present invention operates. The print site 102 is connected to the content server 101 via the network 104.

  Reference numeral 103 denotes a display device that performs a frame process on the structured document sent to the print site 102 based on the description, and displays a drawing result.

  An output device 104 actually prints the structured document sent to the print site 102.

  Reference numeral 105 denotes a network such as the Internet, which connects the content site 101 and the print site 102 to transmit / receive structured documents and various data.

  A structured document database 106 stores various documents described in a structured language, color profile information necessary for rendering the structured document, and the like.

  Reference numeral 107 denotes a moving image database, which stores moving image data and animation data referred to by the structured document stored in the structured document database.

  Reference numeral 108 denotes a structured document drawing apparatus, which represents an embodiment of the present embodiment.

  When a structured document print request from the content site is sent to the print site via the network 105, the print site receives the sent structured document and information necessary for printing, and the structured document rendering device 108 to start. The structured document rendering apparatus 108 acquires various types of information related to the moving image frame described in the structured document, performs processing on the specified frame of the moving image in the structured document according to the information, and then executes the structured document. Draw.

  FIG. 2 is a block diagram showing a schematic configuration of a structured document drawing apparatus according to a preferred embodiment of the present invention.

  In FIG. 2, reference numeral 201 denotes a display device. On the display screen, for example, a document being edited, a figure, an image, and other editing information, a window, an icon, a message, a menu, and other user interface information are displayed. Reference numeral 202 denotes a VRAM on which an image to be displayed on the display device 201 is drawn. The image data generated in the VRAM 202 is transferred to the display device 201 according to a predetermined rule, whereby an image is displayed on the display device 201. Reference numeral 203 denotes an external storage device drive represented by a CD or DVD, which is responsible for control when various control programs and data are exchanged between this device and the external storage device. A keyboard 204 has various keys for inputting characters and performing various operations. Reference numeral 205 denotes a pointing device, which is used, for example, to indicate an icon, menu, or other object displayed on the display screen of the display unit 201. Reference numeral 206 denotes a CPU that controls each device connected to the CPU 206 based on control programs stored in the ROM 207, the storage device 209, the flexible disk 210, and the external storage device 203. A ROM 207 holds various control programs and data. A RAM 208 has a work area for the CPU 206, a data save area during error processing, a control program load area, and the like. A storage device 209 stores various control programs and various data. A network interface 211 can communicate with other information processing apparatuses, printers, and the like via the network 213. A CPU bus 212 includes an address bus, a data bus, and a control bus. The provision of the control program to the CPU 206 can be performed from the ROM 207, the storage device, the flexible disk, or the external storage device, or can be performed from another information processing device or the like via the network 213.

  FIG. 3 is a block diagram showing a schematic configuration of the structured document drawing apparatus according to the preferred embodiment of the present invention.

  In FIG. 3, reference numeral 301 denotes a structured document drawing apparatus which operates on a print site and is used by a user to display and print a structured document.

  A document analysis unit 302 includes a structured document analysis device 305 that analyzes a structured document, a frame position acquisition device 306 that acquires a frame position of a moving image or animation described in the structured document, The frame range acquisition device 307 for acquiring the frame range of the moving image or animation described in the above, and the frame processing acquisition device 308 for acquiring the frame processing for the frame of the moving image or animation described in the structured document.

  A frame processing unit 303 includes a frame processing execution device 309 that performs processing on a moving image or animation described in a structured document.

  A moving image / animation processing unit 304 is a moving image / animation playback device 310 that reproduces a moving image or animation in a structured document, and various frames in which a moving image or animation frame in the structured document is described in the structured document. The frame selection device 311 selects based on the information, and the still image generation device 312 generates a still image from the frame selected by the frame selection device 311.

  A drawing unit 305 includes a structured document drawing device 313 that performs drawing processing of a structured document.

  FIG. 4 is a diagram showing an example of the description of various frame information embedded in the structured document in the structured document drawing apparatus according to the preferred embodiment of the present invention.

  Reference numeral 401 denotes moving image information, in which a moving image is arranged at a corresponding position in the structured document based on the position, size, moving image data format, and the like described in the moving image information.

  A metadata start tag 402 is used when embedding unique information in a standard structured document. In this embodiment, a unique name space is defined by the description of “xmlns: aa =" http://example.org/myfoo "”, and the name space character string “aa” in the subsequent metadata information Each tag name / attribute name is named with. Metadata starting from 402 immediately after the moving image information 401 stores frame information corresponding to the moving image described in 401.

  Reference numeral 403 denotes a color conversion processing information start tag, and “aa: count” describes the total number of frame positions and frame range descriptions included in the subsequent color conversion processing information. In this embodiment, the total number of frame positions and frame ranges is “3”. Also, “aa: profile_in” describes information indicating the location of the input profile required for the color conversion process. In this embodiment, the location “http://example.org/profile_in.icc” Means there is an input profile. Similarly, in “aa: profile_out”, information indicating the location of the output profile necessary for the color conversion process is described, and in this embodiment, “http://example.org/profile_out.icc”. This means that an output profile exists at the location.

  Reference numeral 404 denotes frame position information, and “aa: intent” describes intent information when color conversion processing is performed on the frame at this frame position, and a start tag (“<aa: pos...”). ) And the end tag (“</ aa: pos>”), the frame position is described. Therefore, the frame position of 404 is “15”, which means the 15th frame from the top, and the intent is “perceptual”.

  Reference numeral 405 denotes second frame position information, which indicates that the intent when the color conversion process is performed on the frame at this frame position is “perceptual”. Further, the frame position between the start tag and the end tag is “19 sec”, indicating a frame at a position where the elapsed time from the head is 19 seconds.

  Reference numeral 406 denotes third frame position information, which is described as frame range information. The intent is “saturation”, and two values are described between the start tag and the end tag, which are “30” and “42”, respectively. This means a range from the 30th frame to the 42nd frame from the top.

  FIG. 5 is a frame selection dialog of the structured document drawing apparatus according to the preferred embodiment of the present invention.

  In FIG. 5, reference numeral 501 denotes a frame selection dialog, on which a list display 502 of frame position and frame range candidates is displayed. Reference numeral 503 denotes a frame position or frame range reduced display displayed on the frame list 502. If the candidate is a frame position, the frame is reduced and displayed. If the candidate is a frame range, the first frame in the frame range is reduced and displayed. Reference numeral 504 denotes a scroll bar linked to the frame list 502, and reference numeral 505 denotes a slider on the scroll bar 504. By operating the scroll bar 504 or the slider 505, the frame position and frame range candidate display displayed on the frame list 502 can be switched. Reference numeral 506 denotes a frame position / range selection button, and the operator designates the frame position with this button.

  507 is a frame number input area, 508 is a frame elapsed time input area, 509 is a frame range playback / pause button, and 510 is a frame range playback stop button. 507 to 510 are effective when the frame position / range selected by the operator using the 506 button is the frame range. Reference numeral 507 is used to input a frame number in the frame range. When the operator inputs a frame number, the corresponding frame range reduction display 503 is switched to the input frame number display. Reference numeral 508 is used to input the frame elapsed time. When the operator inputs the frame elapsed time, the reduced display 503 of the corresponding frame range is switched to the display of the input frame elapsed time. Reference numeral 509 denotes a frame range reproduction / pause button. When this button is pressed, the frame range is reproduced on the reduced display 503 of the selected frame range. If this button is pressed during playback, playback of the frame range is paused. Thus, an arbitrary frame within the frame range can be selected while viewing the display. Reference numeral 510 denotes a frame range reproduction stop button, which stops reproduction of the frame range being reproduced or paused.

  Reference numeral 511 denotes an OK button. By pressing this button, frame selection can be confirmed. If the frame position / range selected by the 506 button is a frame position, the frame position is fixed. If the frame position is a frame range, the frame displayed in the reduced display 503 is fixed at that time. Reference numeral 512 denotes a cancel button, which cancels all operations on the frame selection dialog.

  Next, the processing procedure of the present invention will be described with reference to flowcharts of FIGS.

  FIG. 6 is a flowchart of the structured document drawing apparatus according to this embodiment.

  First, in step S601, a structured document to be drawn is analyzed. Next, in step S602, it is determined whether a moving image or animation exists in the analyzed structured document.

  If there is no moving image or animation, the process proceeds to step S609. If there is a moving image or animation, it is checked in step S603 if there is a frame processing description. If there is no frame processing description, the process proceeds to step S607. If there is a frame processing description, a frame processing parameter is acquired in step S604, and a frame position or frame range is acquired in step S605. In step S606, frame processing specified in the structured document is performed. The frame processing in step S606 will be described later with reference to FIG. Next, in step S607, the original frame is replaced with the processing result in step S606. Next, in step S608, it is determined whether frame selection processing and still image generation processing have been performed for all moving images or animations. If not all processing is performed, the process proceeds to step S602. If all the processes have been performed, the process advances to step S609 to perform a structured document drawing process using the frame processing result, and the process ends.

  FIG. 7 is a flowchart of frame processing in the structured document drawing apparatus of the present embodiment.

  This flowchart shows the detailed processing of step S606 in FIG.

  First, in step S701, the frame position or frame range to be processed is stored in the memory buffer. In step S702, it is checked whether the designated frame processing is color conversion. If it is not color conversion, the process advances to step S705. In the case of color conversion, in step S703, input and output profiles described in the frame processing parameters are acquired. Subsequently, in step S704, a color conversion process is performed on the frame in the memory buffer, and the process proceeds to step S707.

  In step S705, it is checked whether the designated frame process is a mosaic process. If it is not mosaic processing, the process proceeds to step S707. In the case of the mosaic process, the process proceeds to step S706, where the mosaic process is performed on the frame in the memory buffer, and the process proceeds to step S707.

  In step S707, it is checked whether all the frames have been processed. If not, the process returns to step S702, and if processed, the process ends.

  FIG. 8 is a flowchart of the structured document drawing apparatus according to this embodiment.

  First, in step S801, a structured document to be drawn is analyzed. In step S802, it is determined whether a moving image or animation exists in the analyzed structured document.

  If there is no moving image or animation, the process proceeds to step S811. If there is a moving image or animation, it is checked in step S803 whether there is a frame processing description. If there is no frame processing description, the process proceeds to step S808. If there is a frame processing description, a frame processing parameter is acquired in step S804, and a frame position or frame range is acquired in step S805. In step S806, the frame processing specified in the structured document is performed. The frame processing in step S806 is the same as that shown in FIG. In step S807, the original frame is replaced with the processing result in step S806. Subsequently, in step S808, frame selection processing is performed for selecting a frame to be converted into a still image from the frame position or frame range described in the structured document. Next, in step S809, a still image is generated based on the selected frame, and the process proceeds to step S810. In step S810, it is determined whether frame processing, frame selection processing, and still image generation processing have been performed for all moving images or animations. If not all processing is performed, the process proceeds to step S803. If all the processes have been performed, the process proceeds to step S811, where the generated still image is used to perform the structured document drawing process, and the process ends.

  FIG. 9 is a flowchart of the frame selection process in the structured document drawing apparatus of this embodiment.

  This flowchart shows the detailed processing of step S808 in FIG.

  First, in step S901, all frame positions and frame ranges are added to the display frame list. In step S902, a frame selection dialog is displayed, and a frame position / range reduction display 503 is displayed on the frame list 502 based on the display frame list. In step S903, when the operator selects an arbitrary frame on the frame selection dialog and presses the OK button 511, the frame selection process ends.

  In the present embodiment, the frame processing is shown as color conversion processing and mosaic processing, but it goes without saying that other processing may be used.

  It goes without saying that the computer to which the present invention is applied may be of any form, such as a personal computer, a portable terminal including a mobile phone, and an image forming apparatus.

  Another object of the present invention is to supply a recording medium that records software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus records the recording medium. Needless to say, this can also be achieved by reading and executing the program code stored in. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, a DVD, or the like is used. it can.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operation system) operating on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Furthermore, after the program code read from the storage medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function is based on the instruction of the program code. It goes without saying that the CPU of the expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

The system block diagram of the structured document drawing apparatus by one Example of this invention 1 is a block diagram of a structured document drawing apparatus according to an embodiment of the present invention. 1 is a block diagram of a structured document drawing apparatus according to an embodiment of the present invention. The figure which shows the example of description of the frame information in the structured document by one Example of this invention Frame selection dialog of structured document drawing apparatus according to one embodiment of the present invention 1 is a flowchart of a structured document drawing apparatus according to an embodiment of the present invention. 1 is a flowchart of a structured document drawing apparatus according to an embodiment of the present invention. 1 is a flowchart of a structured document drawing apparatus according to an embodiment of the present invention. 1 is a flowchart of a structured document drawing apparatus according to an embodiment of the present invention.

Explanation of symbols

101 Content Site 102 Print Site 103 Output Device 104 Network 105 Structured Document DB
106 Movie DB
107 Structured Document Rendering Device 201 Display Device 202 VRAM
203 CDD
204 Keyboard 205 Pointing device 206 CPU
207 ROM
208 RAM
209 HDD
210 FDD
211 Network Interface 212 CPU Bus 213 Network 301 Structured Document Rendering Device 302 Document Analysis Unit 303 Frame Processing Unit 304 Movie / Animation Processing Unit 305 Drawing Unit 306 Structured Document Analysis Device 307 Frame Position Acquisition Device 308 Frame Range Acquisition Device 309 Frame Processing execution device 310 Movie / animation playback device 311 Frame selection device 312 Still image generation device 313 Structured document drawing device

Claims (18)

In a structured document drawing apparatus capable of drawing a structured document including a moving image or animation,
Frame position description means for describing the position of one or more frames of a moving image or animation included in the structured document in the structured document;
Frame processing description means for describing processing to be performed on the frame described by the frame position description means;
Frame position acquisition means for acquiring the frame position from a structured document;
Frame processing acquisition means for acquiring the frame processing from a structured document;
Frame processing means for applying the acquired frame processing to a frame corresponding to the acquired frame position;
A structured document drawing apparatus comprising:   2. The structured document drawing apparatus according to claim 1, wherein the frame position description unit describes one or a plurality of frame numbers of a moving image or animation.   3. The structured document drawing apparatus according to claim 1, wherein the frame position description unit describes one or a plurality of elapsed times from the beginning of a moving image or animation. A frame range description means for describing a range of a moving image or animation frame included in the structured document in the structured document;
Frame range acquisition means for acquiring the frame range from a structured document;
4. The structured document drawing apparatus according to claim 1, wherein the frame processing acquired by the frame processing acquisition unit is performed on a frame corresponding to the acquired frame range.   5. The structured document drawing apparatus according to claim 1, wherein the frame processing described by the frame processing description means performs mosaic processing on the corresponding frame.   6. The structured document drawing apparatus according to claim 1, wherein the frame processing described by the frame processing description means performs color conversion processing on a corresponding frame. A still image generating means for generating a still image based on the frame processed by the frame processing means;
Frame selection means for selecting a frame to be converted from a plurality of frames described by the frame position description means or the frame range description means to a still image;
The structured document drawing apparatus according to claim 1, further comprising:   8. The structured document drawing apparatus according to claim 1, wherein the structured document is described in a markup language defined according to a grammar of an XML standard.   9. The structured document drawing apparatus according to claim 1, wherein the structured document is described according to a grammar of an SVG standard.   The structured document drawing apparatus according to claim 1, wherein the moving image or animation included in the structured document is moving image or animation data embedded in the structured document.   11. The structured document according to claim 1, wherein the moving image or animation included in the structured document refers to moving image or animation data existing outside the structured document. Drawing device. In a structured document drawing method capable of drawing a structured document including animation or animation,
A frame position description step for describing the position of one or more frames of a moving image or animation included in the structured document in the structured document;
A frame process description step describing a process to be performed on the frame described by the frame position description unit;
A frame position acquisition step of acquiring the frame position from a structured document;
A frame processing acquisition step of acquiring the frame processing from a structured document;
A frame processing step for applying the acquired frame processing to a frame corresponding to the acquired frame position;
A structured document drawing method comprising: A frame range description step for describing a frame range of a moving image or animation included in the structured document in the structured document;
A frame range acquisition step of acquiring the frame range from a structured document;
13. The structured document drawing method according to claim 12, wherein the frame processing acquired by the frame processing acquisition step is performed on a frame corresponding to the acquired frame range. A still image generating step for generating a still image based on the frame processed by the frame processing step;
A frame selection step for selecting a frame to be converted from a plurality of frames described in the frame position description step or the frame range description step into a still image;
14. The structured document drawing method according to claim 12 or 13, characterized by comprising: In a program for causing a computer to execute a structured document drawing method capable of drawing a structured document including a moving image or animation,
A frame position description step for describing the position of one or more frames of a moving image or animation included in the structured document in the structured document;
A frame process description step describing a process to be performed on the frame described by the frame position description unit;
A frame position acquisition step of acquiring the frame position from a structured document;
A frame processing acquisition step of acquiring the frame processing from a structured document;
A frame processing step for applying the acquired frame processing to a frame corresponding to the acquired frame position;
A program characterized by comprising: A frame range description step for describing a frame range of a moving image or animation included in the structured document in the structured document;
A frame range acquisition step of acquiring the frame range from a structured document;
The program according to claim 15, wherein the frame processing acquired by the frame processing acquisition step is performed on a frame corresponding to the acquired frame range. A still image generating step for generating a still image based on the frame processed by the frame processing step;
A frame selection step for selecting a frame to be converted from a plurality of frames described in the frame position description step or the frame range description step into a still image;
The program according to claim 15 or 16, further comprising:   A storage medium storing the program according to any one of claims 15 to 17 so as to be readable by a computer device.

Images