JP2015035687A - Data processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To dynamically represent a part of a still image so as to deepen understanding about a scene.SOLUTION: A data processor includes: an image display data generation unit which generates image display data for displaying an image in which a prescribed area changes with time, on an image of one frame out of images of a plurality of frames photographed in time series; a character reproduction data generation unit which generates character reproduction data for displaying prescribed character information besides the image changing with time; and an area determination unit which determines a prescribed area on the basis of contents included in the character information. The image display data generation unit acquires time-series images in the area determined by the area determination unit, in respective images of the plurality of frames and generates image display data by sequentially combining the acquired time-series images with a still image generated on the basis of the image of one frame out of the images of the plurality of frames.

Description

  The present invention relates to a data processing apparatus.

  A technique for dynamically expressing a part of a still image is known (see Patent Document 1). This technology expresses a heterogeneous world where time is progressing only in some areas in a still-timed world of still images in which noise does not change over time or things that should move originally do not move It is attracting attention.

JP 2010-212781 A

  It is desirable to deepen the understanding of the scene for some dynamic expressions in still images.

The data processing device according to claim 1 generates image display data for displaying an image in which a predetermined region changes with time on one frame image of a plurality of frames taken in time series. In addition to the image display data generation unit that performs the change, the character reproduction data generation unit that generates the character reproduction data for displaying the predetermined character information in addition to the image that changes with time, and the predetermined content based on the content included in the character information And an image display data generation unit acquires a time-series image of the region determined by the region determination unit in each of the plurality of frame images, The image display data is generated by sequentially synthesizing the acquired time-series images with the still image generated based on the one frame image.
A data processing device according to a third aspect of the present invention generates image display data for displaying an image in which a predetermined region changes with time on one frame image of a plurality of frames taken in time series. An image display data generating unit for generating, character reproduction data generating unit for generating character reproduction data for displaying predetermined character information in addition to an image changing with time, and a change in a predetermined region based on the image display data A character information determination unit for determining character information including the specified object name from among a plurality of character information each including the name of the object. Character reproduction data for displaying the character information determined by the information determination unit is generated.

  According to the present invention, it is possible to deepen understanding of a scene when a part of a still image is dynamically expressed.

FIGS. 1A and 1B are diagrams illustrating still images having dynamically expressing areas and character information superimposed on the still images. It is a block diagram which illustrates the composition of a digital camera. It is a figure explaining the acquisition timing of the image in "pre-shooting photography mode". It is the figure which displayed the thumbnail image side by side on the screen of a liquid crystal monitor. It is the figure which displayed the image of the flame | frame S on the screen of the liquid crystal monitor. It is a figure which illustrates the image which imaged the ripple which spreads on the water surface of this "pond" by making "pond" into a target object. It is a figure which illustrates the moving body area | region and non-moving body area | region in the flame | frame S. FIG. It is a figure which illustrates the image after an embedding composition. It is a flowchart explaining the flow of the process which CPU performs for "motion expression". It is a flowchart explaining the flow of the process which CPU performs for "motion expression". It is a figure explaining the modification 8. FIG. It is a figure which illustrates a computer.

  A digital camera according to an embodiment of the present invention performs “motion expression” that dynamically expresses a partial region of a still image based on a plurality of frames of still images, and combines character information with the still images. Thus, the display mode of the character information is changed over time.

  FIG. 1A is a diagram illustrating a still image having an area m to be dynamically expressed and character information T displayed to be superimposed on the still image. The “motion expression” expresses a heterogeneous world as if time has progressed by a part of the area m in a still image-stopped world. The change in the display mode of the character information T is to change, for example, the display color, display brightness, character thickness, character size, or typeface of the character over time. In this embodiment, the display mode is gradually changed from the beginning of the characters constituting the character information T, and the display modes of all the characters constituting the character information T are changed as illustrated in FIG. When a predetermined time elapses later, “motion expression” is started in the still image area m.

  FIG. 2 is a block diagram illustrating the configuration of the digital camera 1. In FIG. 2, the photographic lens 11 forms a subject image on the imaging surface of the imaging element 12. 2 illustrates the digital camera 1 in which the photographing lens 11 is formed integrally with the camera (the photographing lens cannot be attached / detached). However, the camera includes a camera body and an interchangeable lens that can be attached to and detached from the camera body. You may comprise by a system. In this case, a configuration including the photographing lens 11 of FIG. 2 and a lens driving unit 21 described later is included on the interchangeable lens side, and a configuration including other reference numerals is included on the camera body side.

  When the half-press switch 20a is turned on in conjunction with a half-press operation of a shutter button (not shown), the CPU 16 performs an AE (automatic exposure) calculation and an autofocus (AF) process to form a focusing lens (a focusing lens constituting the photographing lens 11). (Not shown) is moved forward and backward in the optical axis direction (arrow direction in FIG. 2). Thereby, the focal position of the photographic lens 11 is automatically adjusted. The driving of the focusing lens (not shown) is performed by the lens driving unit 21 that receives an instruction from the CPU 16.

  The image sensor 12 is configured by a CMOS image sensor or the like. The image sensor 12 captures a subject image formed on the imaging surface. The image signal output from the image sensor 12 is converted from an analog signal to a digital signal by the A / D converter 13. The image processing unit 14 performs predetermined image processing on the digital image signal.

  The liquid crystal monitor 15 displays an image captured by the image sensor 12 and an image stored in a buffer memory 18 or a memory card 50 described later, and displays an image, an icon, an operation menu, and the like according to an instruction from the CPU 16. indicate. A touch operation member 15 a is laminated on the display surface of the liquid crystal monitor 15. The touch operation member 15a sends a signal indicating the touch position on the display screen to the CPU 16. The sound processing circuit 23 amplifies the sound signal collected by the stereo microphone 22 and converts the amplified signal into digital sound data by an A / D conversion circuit (not shown). Further, the sound processing circuit 23 generates a speaker drive signal by a D / A conversion circuit (not shown) based on the digital sound data and reproduces sound from the speaker 24.

  The flash memory 17 includes a program executed by the CPU 16, data necessary for execution processing, an image database (hereinafter referred to as an image DB 17A), a character information database (hereinafter referred to as a character information DB 17B), an acoustic database (hereinafter referred to as an acoustic DB 17C). ), An object database (hereinafter referred to as an object DB 17D) and the like are stored. Programs, data, and the contents of DB17A to DB17D can be added or changed by instructions from the CPU 16.

  The CPU 16 executes a control program using the buffer memory 18 as a work area, for example, and performs various controls on each part of the camera. The buffer memory 18 is also used for temporarily storing image data before or after the processing when performing various processing on the image data. In the digital camera 1 according to the present embodiment, images of a plurality of frames (referred to as pre-taken images) acquired at a predetermined frame rate by the image sensor 12 before a shooting instruction (full pressing operation of the shutter button), or after a shooting instruction is taken. It is also used for temporarily storing a plurality of frames of images (referred to as post-taken images) acquired by the element 12 at a predetermined frame rate.

  In addition to the image processing on the digital image signal, the image processing unit 14 generates an image file (for example, an Exif file) in a predetermined format storing the image signal. The recording / reproducing unit 19 records (saves) the image file on the memory card 50 based on an instruction from the CPU 16 and reads out the image file recorded (saved) on the memory card 50. The recording / playback unit 19 further records (saves) the sound file storing the sound data in the memory card 50 and reads out the sound file recorded (saved) in the memory card 50.

  The memory card 50 is a recording medium that is detachably attached to a card slot (not shown). The CPU 16 reproduces and displays the captured image on the liquid crystal monitor 15 based on the image file read from the memory card 50 by the recording / reproducing unit 19 or the image data stored in the post-capture buffer memory 18.

  The operation member 20 includes the half-press switch 20a, a full-press switch 20b that is turned on in response to a full-press operation of the shutter button, a mode switching switch, and the like, and sends an operation signal associated with the operation of each member to the CPU 16.

  The ON signal (half-press operation signal) from the half-press switch 20a is output when the shutter button is pressed down to about half of the normal stroke, and the output is canceled when the half-stroke press operation is canceled. The ON signal (full push operation signal) from the full push switch 20b is output when the shutter button is pushed down to the normal stroke, and the output is released when the normal stroke push down operation is released.

<Shooting mode>
The digital camera 1 has a “normal shooting mode” and a “first shooting mode”. The “normal shooting mode” is a shooting mode in which a shot image is acquired frame by frame in response to the full-press operation signal and recorded in the memory card 50. In the “pre-shooting shooting mode”, a still image is acquired at a predetermined frame rate (for example, 120 frames per second), and when the full-press operation signal is received, a plurality of frames acquired before and after the time when the full-press operation signal is received. This is a shooting mode in which a predetermined image is recorded in the memory card 50 among the images (the above-mentioned pre-taken image and post-taken image). Each photographing mode is configured to be switchable according to an operation signal from the operation member 20 or the touch operation member 15a.

<Playback mode>
The digital camera 1 in the reproduction mode reproduces and displays the image recorded in the “normal photographing mode” or the “pre-shooting photographing mode” on the liquid crystal monitor 15 for each frame or every predetermined number of frames. In addition, in the case of “motion expression”, the liquid crystal monitor 15 is configured to dynamically express an object that changes in a still image based on a plurality of frames of images acquired in the “first shooting mode”. Perform playback display.

<Combination of motion expression and character information>
Since the digital camera 1 according to the present embodiment is characterized in the process of combining character information with “motion expression” as shown in FIG. 1, the following description will be focused on this point. On / off of the process of combining character information with “motion expression” can be switched according to an operation signal from the operation member 20 or the touch operation member 15a.

  The digital camera 1 that is in the playback mode and has the process of combining character information with “motion expression” turned on is based on images of a plurality of frames instructed by an operation signal from the operation member 20 or the touch operation member 15a. Then, a frame suitable for “motion expression” is selected and reproduced and displayed on the liquid crystal monitor 15 using the image of the selected frame. Further, the character information selected based on the operation from the operation member 20 or the touch operation member 15a is displayed on the liquid crystal monitor 15 so as to be superimposed on the reproduction display image (FIGS. 1A and 1B). Hereinafter, determination of character information to be combined, determination of image contents to be “motion expressed”, description of a set of images stored in the image DB 17A, selection of a frame suitable for “motion expression”, and movement in “motion expression” A description will be given of the determination of an object to be expressed and image generation for “motion expression”.

-Determination of character information combined with "motion expression"-
The character information DB 17B stores a plurality of contents such as haiku, poetry, and sentences in advance. The CPU 16 determines the character information to be combined with the “motion expression” from the contents stored in the character information DB 17B. The CPU 16 reads a predetermined number of characters (for example, a maximum of 20 characters) from the top for each of the plurality of contents stored in the character information DB 17B, and displays the read contents in a list on the screen of the liquid crystal monitor 15. The CPU 16 accepts a content selection operation using the touch operation member 15a in a list display state.

  The user touches the display position of an arbitrary character string on the screen of the liquid crystal monitor 15. When receiving an operation signal from the touch operation member 15a, the CPU 16 reads out the entire text of the content corresponding to the touch position from the character information DB 17B and displays it on the screen of the liquid crystal monitor 15 instead of the list display. The user touches the display position of a “determine” icon (not shown) on the screen of the liquid crystal monitor 15. When the CPU 16 receives the determination operation signal from the touch operation member 15a, the CPU 16 determines the content displayed in the full text as character information to be combined with “motion expression”. When the display position of the “return” icon (not shown) is touched on the screen of the liquid crystal monitor 15, the CPU 16 displays the list again on the screen of the liquid crystal monitor 15.

-Determining the image for "motion expression"-
In the image DB 17A, a plurality of sets of images each having a plurality of frame images are stored in advance. The CPU 16 determines one image set from among a plurality of image sets stored in the image DB 17A as a content image to be “moved”. How the set of images stored in the image DB 17A is a captured image group will be described later.

  The CPU 16 reads one thumbnail image as a representative from each set of images stored in the image DB 17 </ b> A, and displays the read thumbnail images side by side on the screen of the liquid crystal monitor 15. The CPU 16 accepts a content image selection operation using the touch operation member 15a in a state where thumbnail images are displayed side by side.

  The user touches the display position of an arbitrary thumbnail image on the screen of the liquid crystal monitor 15. When the CPU 16 receives the operation signal from the touch operation member 15a, the CPU 16 reads all the frame images included in the set of images represented by the thumbnail image at the touch position from the image DB 17A, and these thumbnail images are displayed on the screen of the liquid crystal monitor 15. Display them side by side. The user touches the display position of a “determine” icon (not shown) on the screen of the liquid crystal monitor 15. When receiving the determination operation signal from the touch operation member 15a, the CPU 16 determines a set of images displayed side by side as a content image to be “moved”. When the display position of a “return” icon (not shown) is touch-operated on the screen of the liquid crystal monitor 15, the CPU 16 displays thumbnail images representative of each set of images again on the screen of the liquid crystal monitor 15. Let

-About the set of images stored in the image DB 17A-
How the set of images stored in the image DB 17A is a captured image group will be described. The user obtains a plurality of frames of images, for example, by holding the digital camera 1 or fixing the digital camera 1 to a tripod. FIG. 3 is a diagram for explaining the image acquisition timing in the “pre-shooting shooting mode”. In FIG. 3, when the “pre-shooting shooting mode” is activated at time t0, the CPU 16 starts shooting standby processing. In the shooting standby process, the subject image is captured at the predetermined frame rate, exposure calculation and focus adjustment are performed, and the acquired image data is sequentially stored in the buffer memory 18.

  In the “pre-shooting shooting mode”, a sufficient memory capacity of the buffer memory 18 used for storing the pre-shooting image and the post-shooting image is secured in advance. When the number of frame images stored in the buffer memory 18 after time t0 reaches a predetermined number (for example, C), the CPU 16 overwrites and erases the oldest frame images in order. Thereby, the memory capacity of the buffer memory 18 used for storing the pre-taken image and the post-taken image in the “pre-photographing shooting mode” can be limited.

  When a full-press operation signal is input at time t1, the CPU 16 starts shooting processing. In the photographing process, (A + B) frame images obtained by combining A frame images pre-taken before time t1 and B frame images taken after time t1 are recorded on the memory card 50. An image. A black band in FIG. 3 represents a section in which (A + B) frame images that are recording candidate images are acquired. The hatched band represents a section in which a frame image that has been temporarily stored in the buffer memory 18 but has been overwritten and erased is acquired.

  The CPU 16 records a predetermined frame image among the recording candidate images on the memory card 50 based on the set recording method. In the digital camera 1 according to the present embodiment, it is assumed that all (A + B) frame images are recorded on the memory card 50 as one set. Since the set of frame images is arranged in order on the time axis, it is called a time-series image.

  The CPU 16 further determines a set of time series images to be stored in the image DB 17A from among a plurality of sets of time series images recorded on the memory card 50. The CPU 16 “duplicates” a set of time-series images instructed by an operation signal from the operation member 20 or the touch operation member 15a in the image DB 17A. Note that “move” may be performed to delete the time-series images of the copy source set from the memory card 50.

―Selecting frames suitable for motion expression―
The CPU 16 selects a frame suitable for “motion expression” based on the set of time-series images determined as described above as the content image to be “motion expression”. Specifically, a frame S used as a still region (background), a frame P acquired before the frame S, and a frame Q acquired after the frame S are (A + B) frames. Select from the frame images.

-Frame S-
The CPU 16 of the digital camera 1 according to the present embodiment uses the frame image designated by the user operation as the frame S. Specifically, based on (A + B) frame images, thumbnail images of each frame are displayed side by side on the screen of the liquid crystal monitor 15 as illustrated in FIG. When (A + B) thumbnail images do not fit on one screen, the CPU 16 causes the liquid crystal monitor 15 to display a thumbnail image intended by the user by scrolling the screen in accordance with a user operation.

  On the screen of the liquid crystal monitor 15 illustrated in FIG. 4, the user selects a frame to be used as a still area (background) by “touch operation” in “motion expression”. When the CPU 16 receives the operation signal from the touch operation member 15a, the CPU 16 sets the frame image corresponding to the thumbnail image X at the touch position as the frame S. When determining the frame S, the CPU 16 reads out the image of the frame S from the image DB 17A and displays it on the screen of the liquid crystal monitor 15 as illustrated in FIG.

  Note that an image captured at the timing closest to the time t1 when the full-press operation signal is input may be automatically set as the frame S. In this case, information indicating which of the A + B frame images stored in the buffer memory 18 is an image captured at the timing closest to the full-press operation timing is also stored in the buffer memory 18. Keep it.

-Determination of objects to be dynamically expressed in "motion expression"-
The CPU 16 determines an object to be dynamically expressed in a still image in “motion expression” as follows. CPU16 detects a predetermined part of speech (for example, noun) from the whole sentence of the character information determined as mentioned above. The CPU 16 dynamically expresses the object represented by the detected noun in the “motion expression” in the still image. For this purpose, the CPU 16 specifies a target object by performing a known object recognition process on a still image. Here, information necessary for part-of-speech detection and information necessary for object detection (for example, an image feature amount used for object detection) are recorded in advance in the object database 17D.

  For example, the case of the character information T illustrated in FIG. 1A and FIG. 1B will be described as an example. The CPU 16 determines the nouns “pond” and “蛙” in “the sound of water from old ponds and frogs”. , “Water” and “Sound” are detected. The CPU 16 further detects an object corresponding to the noun from the still image (frame S) by object recognition processing. In general, it is difficult to detect an object having no outline, but “water” or “sound” itself does not have an outline, and therefore it is difficult to detect them. In the case of this example, the CPU 16 detects, from the frame S illustrated in FIG. 5, for example, “pond” having a larger proportion of the image than “蛙”. Then, the CPU 16 displays the mark m in the rectangular area surrounding the detected “pond” on the image of the frame S, and sets the range surrounded by the mark m as the moving object area.

-Frame P, Frame Q-
The CPU 16 selects the frame P from the frame image acquired before the frame S in time. Further, the CPU 16 selects the frame Q from the frame image acquired after the frame S in terms of time. 6 shows a frame f1, a frame f2,... Frame f (A-1), a frame fA, a frame f (A + 1),. It is a figure which illustrates the image of f (A + 5), ... frame f (A + 10), ... frame f (A + B). This is a scene in which “Rin” jumps into the pond from the top of the grass and ripples spread on the surface of the “pond”. In this description, the frame f (A + 1) is made to correspond to the frame S. Therefore, the frame f1 to the frame fA correspond to the frame P candidates, and the frame f (A + 2) to the frame f (A + B) correspond to the frame Q candidates.

  The moving object region m (A + 1) in the frame f (A + 1) (that is, the frame S) in FIG. 6 corresponds to the moving object region determined in FIG. For example, the CPU 16 extracts the moving body region from the frame image other than the frame f (A + 1) (that is, the frame S) in FIG. 6 by using the template matching method with the moving body region m (A + 1) as a template. 6, m (A-1), m (A), m (A + 1), ... m (A + 5), ... m (A + 10), ... m (A + B) are moving object regions in each frame. Represent. In addition, the extraction of the moving object region in each frame image described above is performed by using the calculation of the difference between the frames or the image feature amount such as the texture instead of (or in addition to) the template matching method described above. It does not matter. Since the moving object region is accompanied by a change in time, it may be assumed that the moving object region cannot be extracted by simple template matching. In such a case, a method using a calculation such as a difference between frames or an image feature amount such as a texture is effective.

  FIG. 7 is a diagram illustrating a moving object area m (A + 1) and a non-moving object area (that is, a stationary area) in the frame f (A + 1) (that is, the frame S). A hatched area represents a non-moving object area. The CPU 16 extracts two or more feature points in each moving object region from each frame image in FIG.

  In FIG. 6, a plurality of black dots represent feature points. For example, Lowe, David G. (1999). "Object recognition from local scale-invariant features". Proceedings of the International Conference on Computer Vision. 2. pp.1150 Known techniques disclosed in -1157. And the like can be used.

  The CPU 16 is characterized by a frame f1, a frame f2,... Frame f (A-1), a frame fA, a frame f (A + 1), a frame f (A + 5), a frame (A + 10), a frame f (A + B). Points are associated and images are aligned between frames. The CPU 16 represents the position of the moving object area in each frame with reference to the frame f (A + 1) (that is, the frame S).

  In the case of FIG. 6, in the frames that are candidates for the frame P, no difference is generated between adjacent frames in the moving object region. In this case, the CPU 16 selects, for example, the frame fA that is temporally adjacent to the frame S as the frame P. A plurality of frames P may be selected.

  In the case of FIG. 6, in the frame that is a candidate for the frame Q, a difference is generated between each adjacent frame in the moving object region. The shape of the contour of the “pond” that is the object is the same between the frames, and the size of the contour of the “pond” does not change, but the shape of the ripples on the water surface of the “pond” varies from frame to frame. The CPU 16 selects a frame f (A + 5), a frame f (A + 10), and f (A + B) whose relative distances between the ripples are within a predetermined range from the frame S as the frame Q. When the number of frames constituting the frame Q is increased, the “motion expression” can be smoothed.

  The CPU 16 combines the frame S, the frame P (frame fA), and the frame Q (frame f (A + 5), frame f (A + 10), and frame f (A + B)) selected as described above to generate a still image (frame S). ) Dynamically represent the moving object region above. Specifically, instead of the moving object region m (A + 1) constituting a part of the frame S, the moving object regions of other frames are sequentially fitted and synthesized at corresponding positions in the frame S every predetermined time. For this purpose, the CPU 16 first extracts a moving object region from the image of the frame S and the selected plurality of frame images by a template matching method. In FIG. 7, m (A), m (A + 5), m (A + 10), and m (A + B) are diagrams illustrating extracted moving body regions. In this way, the CPU 16 generates a time-series image for the object. Since the moving object region in FIG. 7 has already been extracted when performing frame selection suitable for the “motion expression” described above, this information can be used.

-Image generation for "motion expression"-
The CPU 16 replaces the moving object area m (A + 1) in the frame S (f (A + 1)) illustrated in FIG. 7 with respect to the time series image of the object, that is, the moving object area m (A) of the frame P, the frame S The moving object area m (A + 1), the moving object area m (A + 5), the moving object area m (A + 10), and the moving object area m (A + B) of the frame Q are sequentially inserted into the corresponding positions in the frame S at predetermined time intervals. To do. The corresponding position in the frame S is the position of the moving object region obtained when selecting a frame suitable for “motion expression”, and is a position represented with reference to the frame S.

  For example, when shooting without changing the shooting direction with a tripod, the coordinate position of the pond does not change in each frame. On the other hand, when shooting a wrinkle whose position on the screen changes in each frame, or when shooting by hand (by camera shake), the position of the moving object region on the frame S to be sequentially fitted and synthesized differs depending on the frame. . In this way, when the position of the moving object region is different for each frame, the position of the inset composition is obtained by aligning each frame with reference to the background region of the frame S, and then setting the coordinates of the moving object region of each frame as the frame S. After converting to the upper coordinates, the moving object region of each frame is sequentially embedded and synthesized on the converted coordinates on the frame S.

  In addition, after aligning each frame image with reference to the feature point of the background region of the frame S, the “range including the moving range” of the object (for example, 蛙) is set as the moving object region (in this case, Since the range (shooting range) of the subject including the moving object region is the same in each frame, the moving object region includes the object and the stationary region), and the moving object region in each frame image is converted to the converted coordinates on the frame S. It is also possible to employ a configuration in which the fitting is sequentially performed.

  FIG. 8 is a diagram illustrating the frame cA, the frame c (A + 1), the frame c (A + 5), c (A + 10), and the frame c (A + B) after the inset synthesis. The “moving body region image” of each frame is the “moving body region image” at the time when the frames fA, f (A + 1), f (A + 5), f (A + 10), and f (A + B) of FIG. ". Note that the frame c (A + 1) is equal to the frame f (A + 1).

  When the images illustrated in FIG. 8 are sequentially reproduced and displayed on the liquid crystal monitor 15, the time of the moving object region (the ripples of the “pond”) is reduced in the still image (frame S = f (A + 1)). It can express a heterogeneous world as if is progressing.

  It should be noted that the time interval for switching the position of the moving object region on the still image (frame S) from m (A) → m (A + 1) → m (A + 5) → m (A + 10) → m (A + B) → m (A). If the is shortened, it becomes a fast “motion expression”, and if the switching interval is lengthened, it becomes a slow “motion expression”.

<"Motion expression" and the timing of changes in the display mode of character information>
The CPU 16 associates (synchronizes) the timing of dynamically moving the moving object region (object) in the still image with the timing of changing the display mode of the character information as follows, for example, in “motion expression”. First, the character information T is displayed in a superimposed manner in a state where the frame cA after the inset composition is displayed on the liquid crystal monitor 15.

  Next, as illustrated in FIG. 1A, the CPU 16 changes the display mode of the character information T over time. Further, as illustrated in FIG. 1B, the CPU 16 further performs “motion expression” when a predetermined time (for example, 0.5 seconds) elapses after the change of the display mode of all the characters constituting the character information T is completed. To start. In the above description, the frame image used for motion expression is selected from f (A) to f (A + B). For example, all the frame images f (A) to f (A + B) are used. An image used for motion expression may be generated.

<Recording of data necessary for "motion expression">
The CPU 16 sends an instruction to the recording / playback unit 19 to cause the memory card 50 to record data necessary for “motion expression” and data necessary for changing the display mode of the character information. The data to be recorded includes, for example, each image of frame S, frame P, and frame Q, the range of the moving object region in these images, the coordinate position, and the control (shift) value for aligning from frame P and frame Q to frame S , Information such as necessity of loop reproduction, character information T, display position of character information, display mode change start timing, display mode change speed, and the like.

―Explanation of flowchart―
FIG. 9 is a flowchart for explaining the flow of processing executed by the CPU 16 for the above-described “motion expression”. When the CPU 16 is set to the “pre-shooting shooting mode”, the CPU 16 activates the process shown in FIG. In step S1 of FIG. 9, the CPU 16 starts acquiring a pre-taken image (that is, shooting standby processing) and proceeds to step S2. As a result, the pre-taken frame image is accumulated in the buffer memory 18 and is sequentially displayed on the liquid crystal monitor 15.

  In step S2, the CPU 16 performs AE (automatic exposure) calculation and AF (automatic focus adjustment) processing based on the pre-captured image data, and proceeds to step S3. In step S3, the CPU 16 determines whether or not the release button has been fully pressed. The CPU 16 makes an affirmative decision in step S3 when an on signal from the full push switch 20b is input, and proceeds to step S4. If an on signal from the full push switch 20b is not inputted, the CPU 16 makes a negative decision in step S3. To return to step S2. When returning to step S2, the above-described processing is repeated.

  In step S4, the CPU 16 starts acquisition of a later shot image and proceeds to step S5. The post-taken images are one sheet acquired in response to the full press operation and (B-1) sheets acquired thereafter. In step S5, the CPU 16 records (A + B) frame images stored in the buffer memory 18 on the memory card 50, and then proceeds to step S6.

  In step S6, the CPU 16 determines whether or not an end instruction has been issued. When an operation signal for switching to the “normal photographing mode” is input from the operation member 20 or the touch operation member 15a, the CPU 16 makes a positive determination in step S6 and ends the process of FIG. If the switching operation signal for switching to the “normal shooting mode” is not input from the operation member 20 or the touch operation member 15a, the CPU 16 makes a negative determination in step S6 and returns to step S1. When returning to step S1, the above-described processing is repeated.

  A flow of processing executed by the CPU 16 that combines character information with “motion expression” will be described with reference to a flowchart illustrated in FIG. 10. Here, the “motion expression” image is an image determined by the user operation described above, and the character information combined with the “motion expression” is the character information determined by the user operation described above. When the CPU 16 is in the playback mode and the process of combining character information with “motion expression” is turned on, the CPU 16 starts the process of FIG.

  In step S51 of FIG. 10, the CPU 16 determines a still image frame (frame S) from the (A + B) frame images, and proceeds to step S52. In step S52, the CPU 16 determines a moving object region to be dynamically expressed on a still image (frame S) during reproduction, and proceeds to step S53.

  In step S53, the CPU 16 aligns the frame images in FIG. 6 and proceeds to step S54. The alignment is performed based on the positions of two or more feature points extracted from the frame image.

  In step S54, the CPU 16 extracts a moving object region from each frame image by the template matching method, and proceeds to step S55. In step S55, the CPU 16 obtains the position of the moving object region of each frame with reference to the still image (frame S), and proceeds to step S56.

  In step S56, the CPU 16 is a frame image that is acquired temporally before the still image (frame S), and in which the relative distance between the object in the frame and the object in the frame S is within a predetermined range. P is extracted and it progresses to step S57.

  In step S57, the CPU 16 is a frame image acquired temporally after the still image (frame S), the relative distance between the object in the frame and the object in the frame S is within a predetermined range, and The frame Q in which the similarity between the object in the frame and the object in the frame P is equal to or greater than a predetermined value is extracted, and the process proceeds to step S58.

  In step S58, the CPU 16 determines whether or not a condition is satisfied. For example, if the frame P and the frame Q are substantially the same as the frame S and there is no change, and the moving object area cannot be expressed dynamically even if reproduced and displayed, the CPU 16 makes a negative determination in step S58 and returns to step S56. The frame P and the frame Q are extracted again. The CPU 16 determines that the frame P and / or the frame Q is appropriately different from the frame S (for example, the object in the frame P and the frame Q has a predetermined relative distance between the object in the frame S). Advances from step S58 to step S59.

  In step S59, the CPU 16 inserts and synthesizes the moving object region illustrated in FIG. 7 instead of the moving object region in the frame S into the corresponding position in the frame S and proceeds to step S60 every predetermined time.

  In step S60, the CPU 16 displays the character information T in the background area of the still image frame, generates a frame image that changes the display mode of the character information T over time, and proceeds to step S61.

  In step S61, the CPU 16 determines whether an end instruction has been issued. When the end operation is performed, the CPU 16 makes an affirmative determination in step S60 and ends the process of FIG. If the end operation is not performed, the CPU 16 makes a negative determination in step S60 and returns to step S51.

According to the embodiment described above, the following effects can be obtained.
(1) The digital camera 1 displays an image in which a predetermined area m changes with time on an image of one frame f (A + 1) among the images f1 to f (A + B) of a plurality of frames taken in time series. CPU 16 that generates image display data to be used, CPU 16 that generates character reproduction data for displaying predetermined character information T in addition to an image that changes with time, and the content included in character information T A CPU 16 for determining a predetermined area m. The CPU 16 acquires position information of the area m determined by the CPU 16 in each of the images f1 to f (A + B) of a plurality of frames, and the acquired position information Based on the images f1 to f (A + B) of a plurality of frames, time series images m1 to m (A + B) for the area m determined by the CPU 16 are acquired, and images f1 to f of the plurality of frames are obtained. By sequentially synthesizing the acquired time-series images m1 to m (A + B) with a still image (shaded area in FIG. 7) generated based on one frame image f (A + 1) of f (A + B). Generate image display data. Since the area “m” representing “motion” in the still image can be associated with the character information T, a scene when dynamically expressing a part of the still image compared to the case where the character information T is not displayed. Deepen understanding.

(2) In the digital camera 1 of (1) above, the CPU 16 generates character reproduction data for displaying the display mode of the character information T with time, and the CPU 16 captures a plurality of frames of images f1 taken in time series. Image display data is generated so that the change in the predetermined area m is synchronized with the change in the display mode of the character information T on one frame of the image f (A + 1) of .about.f (A + B). As a result, the change in the area m to be “motion-represented” and the content of the character information T can be associated more finely, so that the understanding of the scene when dynamically expressing a part of a still image can be further deepened.

(Modification 1)
In the above-described embodiment, the example in which “motion expression” is started in the area m of the still image after a predetermined time has elapsed after changing the display mode of all the characters constituting the character information T has been described. Instead, the change of the character display mode is started after the “motion expression” is completed in the still image region m, or the start timing of the “motion expression” performed in the still image region m and the character display mode are changed. You may align with the start timing of a change, and may employ | adopt various methods suitably. As a result, the change in the area “m” for “motion expression” and the content of the character information T can be related more finely, so that understanding of the scene when dynamically expressing a part of a still image can be further deepened. .

(Modification 2)
In the above-described embodiment, the CPU 16 determines a set of images to be “moved” based on the touch operation of the touch operation member 15a by the user. Instead, based on a predetermined part of speech included in the character information T, the CPU 16 may determine a set of images to be “moved”. For example, the case of the character information T illustrated in FIG. 1A and FIG. 1B will be described as an example. The CPU 16 determines the nouns “pond” and “蛙” in “the sound of water from old ponds and frogs”. , “Water” and “Sound” are detected.

  The CPU 16 of the modification 2 further detects, for each set of images stored in the image DB 17A, an object corresponding to the noun from the frame images constituting each set by object recognition processing. The CPU 16 determines a set of images in which “pond” and “蛙” are detected most frequently by the object recognition process as a set of images to be “moved”.

According to the second modification, a set of images that are highly relevant to the character information T can be automatically found from the image DB 17A. The part of speech is not limited to a noun, but may be an adjective or another part of speech such as a verb. Even when parts of speech other than these nouns are used, a set of images having high relevance to the character information T including these parts of speech can be automatically found from the image DB 17A by image recognition processing.
Further, instead of determining the character information to be combined with “motion expression” based on the touch operation by the user, the CPU 16 determines the character information to be combined with “motion expression” based on the determined set of images. You may do it. For example, the CPU 16 performs image recognition processing on the determined image, selects character information including a noun indicating the recognized object from the character information DB 17B, and determines the character information to be combined with “motion expression”.

(Modification 3)
In the embodiment described above, the character information T is determined first, and based on a predetermined part of speech (noun in the above embodiment) included in the character information T, the “motion expression” is dynamically changed in the still image. The example which determines the target object "pond" to represent was demonstrated. Instead, when a time-series image of an object to be dynamically “moved” is generated in a still image, character information including a noun indicating the object is detected from the character information DB 17B. You may comprise.

  When the time series image about the “pond” that is dynamically expressed in the still image is generated in the “motion expression” in the “motion expression”, the CPU 16 of the modified example 3 searches the character information DB 17B and performs the dynamic expression. Character information including the noun “pond” indicating the object (“the sound of water that rushes into the old pond and pond”) is detected.

  According to the third modification, character information T that is highly relevant to a time-series image that dynamically represents a predetermined object in a still image in “motion expression” is automatically found from the character information DB 17B. Can do. A time-series image of an object may be extracted by automatic recognition processing (object extraction processing + association of the object region in each frame). And it is good also as a structure which extracts character information automatically from character information DB based on the name, shape, operation | movement, state, etc. of the extracted object.

(Modification 4)
In addition to the third modification, the sound data of the sound effect is stored in the sound DB 17C in advance, and the effect highly relevant to the time series image that dynamically “moves” in the still image from the sound DB 17C. Sound acoustic data may be detected.

  In the acoustic DB 17C of the fourth modification, for example, acoustic data such as a sound effect “pocharn” when an object falls on the water surface of “pond” and a cry “gekogeko” of “の” are stored in advance. The acoustic data representing “Pocharn” is associated with the noun “pond”, and the acoustic data representing “Gekogeko” is associated with the noun “蛙”.

  When the time series image about the “pond” that is dynamically expressed in the still image is generated in the “motion expression” in the “motion expression”, the CPU 16 of the modified example 4 generates the noun “pond” indicating the object of the dynamic expression. The sound data of the sound effect “POCHANN” associated with “” is detected. The CPU 16 searches the sound DB 17C and detects sound data representing “Pochurn”. Further, the CPU 16 reads the detected acoustic data from the acoustic DB 17C and reproduces the sound from the speaker 24 in synchronization with the “motion expression”.

  At this time, the CPU 16 synchronizes the timing of starting to dynamically move the object “pond” in the still image in “motion expression” with the timing of sound reproduction of “Pochurn” from the speaker 24. The CPU 16 of the modification 4 starts “motion expression” when a predetermined time (for example, 0.5 seconds) elapses after sound reproduction of “POCHEAN” from the speaker 24.

  In addition, when recording the data necessary for “motion expression” on the memory card 50, the CPU 16 of the fourth modification also records acoustic data representing “Pochurn” in association with each other. Then, in “motion expression”, information indicating the timing at which the object “pond” starts to move dynamically in the still image and the timing at which “Pochurn” is acoustically reproduced is also included.

  According to the modified example 4, in the “motion expression”, the acoustic data representing the sound effect “pocharn” having high relevance to the time-series image for dynamically expressing the predetermined object “pond” in the still image is obtained. It can be automatically found in the acoustic DB 17C. Also, sound effects can be played back at appropriate timing in accordance with “motion expression”.

(Modification 5)
An enhancement process may be performed on the sound data representing the sound effect “pocharn” used for sound reproduction in the modified example 4. The CPU 16 of the modified example 5 sends an instruction to the sound processing circuit 23, sets the amplification gain for the frequency component included in the sound data representing “pocharn” that is the sound of water splashing higher than the initial value, and sets the sound representing “pocharn”. By setting the amplification gain for frequency components not included in the data to be lower than the initial value, filter processing is performed to suppress sounds other than the water splashing sound. Thereby, the sound which water splashes can be emphasized. The CPU 16 sends an instruction to the recording / reproducing unit 19 to record the enhanced acoustic data in the memory card 50.

  The sound data is not limited to the data stored in the sound DB, and sound data acquired by a microphone at the time of shooting may be used. The timing of reproducing the sound data may be the timing at which an image is actually shot. The timing may be shifted from the timing at which the image was taken. When acoustic data actually collected by a microphone is used, there is a possibility that a disturbing sound is also recorded. In such a case, it is particularly effective to use the method of Modification 6 described later.

(Modification 6)
You may make it perform the emphasis process by another method with respect to the sound data showing the sound effect "pocharn" used for sound reproduction in the modification 4. The CPU 16 of the modified example 6 sends an instruction to the acoustic processing circuit 23 and controls the phase between the left and right acoustic signals constituting the acoustic data. When the acoustic data is collected through the stereo microphone 22 having anisotropic directivity, the water splashing sound can be emphasized by adjusting the phase so that the phase difference between the left and right acoustic signals is aligned. .

  For example, when the directivity of the right microphone of the stereo microphone 22 is directed to the point where “蛙” falls on the “pond”, the sound signal collected by the left microphone that does not direct the directivity to the point. The phase is delayed from the phase of the acoustic signal collected by the right microphone. Therefore, the sound effect “Pocharn” is emphasized by advancing the phase of the sound signal collected by the left microphone and aligning the left and right phases.

  Since the ripple on the water surface of the “pond”, which is the moving object area, is generated on the right side of the screen in the frame S described above, the CPU 16 receives the sound from the point where the “basket” fell on the “pond” (right direction of the screen). It is determined that the phase of the acoustic signal collected by the right microphone is advanced, and the phase of the acoustic signal collected by the left microphone is determined to be advanced for enhancement processing. Thereby, the sound which water splashes can be emphasized. The CPU 16 sends an instruction to the recording / reproducing unit 19 to record the enhanced acoustic data in the memory card 50.

(Modification 7)
In the embodiment described above, an example has been described in which one region (object) that is dynamically expressed in a still image for “motion expression” is provided. However, a region (object) that is dynamically expressed is described. A plurality of them may be provided. For example, a first object that changes in the screen is “pond”, and a second object that changes in the screen is “蛙”.

  The CPU 16 extracts the second moving object regions o1 to oA having the second object “蛙” from the frame images of FIG. 6 arranged in time series. In the case of the modification example 7, since the shape of “蛙” jumping into the pond changes between frames and the position in the screen, a difference detection method is used.

  The CPU 16 aligns the frame images in FIG. 6 arranged in time series in the background area (for example, “grass”) excluding the first moving object areas m1 to m (A + B) having the first object “pond”. Then, the difference between adjacent frames is taken to extract “蛙” in the frame image. Specifically, a region including “蛙” is extracted by performing a logical product between the temporally adjacent difference images binarized with a predetermined threshold. Then, the CPU 16 specifies “蛙” by performing a known object recognition process in the extracted area. The reason why the frame image is aligned in the background region is that alignment is performed in a large area portion where the inter-frame difference does not change, and not in “蛙”.

  Here, an area where a difference between frames exceeds a predetermined value corresponds to an area including “蛙”, and an area where the difference between frames is less than a predetermined value corresponds to an area not including “蛙”. Next, the CPU 16 removes the first moving object areas m1 to m (A + B) and the second moving object areas o1 to oA from the frame images of FIG. By extracting the above feature points and associating the feature points between the frames, the position of the non-moving object region in each frame is represented with reference to the non-moving object region in the frame f (A + 1) (ie, frame S). . The moving object region is sequentially inserted and synthesized at the position on the frame S represented by the reference.

  The CPU 16 further extracts two or more feature points in each of the first moving body areas m1 to m (A + B) and the second moving body areas o1 to oA. And based on the positional relationship between the feature points of the non-moving object region and the feature points of each moving object region in each frame, the positions of the first moving object regions m1 to m (A + B) and the second moving object regions o1 to oA in each frame are The non-moving object region in the frame f (A + 1) (that is, the frame S) is expressed as a reference.

  When the CPU 16 dynamically expresses “蛙” in the still image in the “motion expression”, for example, instead of the second moving object region in the frame S, for example, the frame f2, the frame f (A-1), and The second moving body region of the frame fA is inserted into each corresponding position in the frame S in order every predetermined time and synthesized.

  As described above, in the image generation for “motion expression”, even when two regions (objects) that are dynamically expressed on a still image (background) for “motion expression” are provided, The method of fitting the moving object region to each corresponding position in the frame S every predetermined time is the same as in the above-described embodiment. The recording of necessary data on the memory card 50 is the same as that described above.

  As described above, when the images obtained by inserting and synthesizing the time-series images of “蛙” are sequentially reproduced and displayed on the liquid crystal monitor 15, a still image (frame S = f (A + 1)) in a world where time has stopped, It is possible to express a heterogeneous world as if the time has progressed by the second moving object region “蛙”. In addition, it is good also as a single moving body area | region by integrating a pond and a pond.

(Modification 8)
The present invention can also be applied to electronic picture books. In the case of an electronic picture book, it is necessary to determine how much of the character information representing the story is to be displayed on the screen of the liquid crystal monitor 15. When a sentence is previously defined as character information as in an electronic picture book, the CPU 16 dynamically associates one still image with one sentence and dynamically expresses an object on the still image. . For this reason, the CPU 16 displays character information representing a story on the screen of the liquid crystal monitor 15 one sentence at a time.

  Here, even if there are two or more consecutive sentences, the object represented by each sentence may be included in one still image. In this case, the CPU 16 displays a plurality of sentences on one screen of the liquid crystal monitor 15 and dynamically expresses a plurality of objects on one still image.

  The CPU 16 dynamically expresses the object represented by each sentence in synchronization with the change in the display mode of the character information (a plurality of sentences) with the passage of time. For example, the following text is displayed over the still image illustrated in FIG. “Nao-chan winked. The crows flew through the sunset sky. It was a quiet summer evening.”

  For example, when the predetermined time (for example, 0.5 seconds) elapses after the change in the display mode of all the characters that constitute “Nano-chan has winked”, the CPU 16 determines whether the human eye in the still image has passed. Start "motion expression" for. Then, after a predetermined time (for example, 0.5 seconds) has elapsed after the change in the display mode of all the characters that make up “the crow flies through the sunset sky. It was a quiet summer evening.” Then, “motion expression” is started for a crow in a still image. By applying such a display form to all pages of the electronic picture book, an electronic picture book that can deepen the understanding of the scene can be configured.

(Modification 9)
In the above description, the character information is displayed on the liquid crystal monitor 15, and the display mode is changed with time. Instead of this, or in addition to this, sound may be reproduced from the speaker 24 so as to read out the contents of the character information. In this case, after reading aloud all the characters that make up “Nao-chan has winked”, when a predetermined time (for example, 0.5 seconds) elapses, the human eye is targeted in the still image. To start “motion expression”. Then, after a specified time (for example, 0.5 seconds) has elapsed after reading out all the characters that make up “The crow flies through the sunset sky. It was a quiet summer evening.” Start “motion expression” for crows in the image.

(Modification 10)
In the above description, an example in which the digital camera 1 is used as an electronic device has been described. However, a multi-function mobile phone or a tablet computer may be used.

(Modification 11)
In the above-described embodiment, the example in which the “motion expression” process is performed by the digital camera 1 based on the image group of a plurality of frames arranged in time series has been described. However, the posterior can be performed using a personal computer, a tablet computer, or the like. An image processing apparatus that performs “motion expression” processing may be configured. In this case, image data acquired by the digital camera 1 and a group of images of a plurality of frames arranged in time series are stored.

  Then, by causing the computer 200 shown in FIG. 12 to execute a program that performs the processing of the flowchart illustrated in FIG. 10, a data processing device that dynamically expresses a subject (object) that changes in a still image is configured. . When the program is used by being loaded into the personal computer 200, the program is loaded into the data storage device of the personal computer 200 and then used as a data processing device by executing the program.

  The loading of the program to the personal computer 200 may be performed by setting a storage medium 204 such as a CD-ROM storing the program in the personal computer 200, or to the personal computer 200 by a method via the communication line 201 such as a network. You may load. When passing through the communication line 201, the program is stored in the hard disk device 203 of the server (computer) 202 connected to the communication line 201. The program can be supplied as various forms of computer program products such as provision via the storage medium 204 or the communication line 201.

  The above description is merely an example, and is not limited to the configuration of the above embodiment. You may combine the said embodiment and each modification suitably.

DESCRIPTION OF SYMBOLS 1 ... Digital camera 12 ... Image pick-up element 14 ... Image processing part 15 ... Liquid crystal monitor 15a ... Touch operation member 16 ... CPU
17 ... Flash memory 17A ... Image DB
17B ... Character information DB
17C ... Acoustic DB
17D ... Object DB
18 ... Buffer memory 19 ... Recording / reproducing unit 20 ... Operation member 50 ... Memory card 200 ... Computer 204 ... Storage medium

Claims (9)

An image display data generating unit that generates image display data for displaying an image in which a predetermined region changes with time on an image of one frame among a plurality of frames taken in time series;
A character reproduction data generation unit for generating character reproduction data for displaying predetermined character information in addition to the image that changes with time;
An area determining unit that determines the predetermined area based on content included in the character information;
With
The image display data generation unit acquires a time-series image of the region determined by the region determination unit in each of the plurality of frame images, and generates based on one frame image of the plurality of frame images. A data processing apparatus, wherein the image display data is generated by sequentially synthesizing the acquired time-series images with the still image thus obtained. The data processing apparatus according to claim 1,
There are multiple sets of images of multiple frames taken in time series,
An image set determining unit that determines a predetermined set of images from the plurality of sets of images based on content included in the character information;
The image display data generation unit is a region determined by the region determination unit on one frame image of a plurality of frames taken in time series in the image group determined by the group determination unit. A data processing apparatus for generating image display data for displaying an image whose time changes with time. An image display data generating unit that generates image display data for displaying an image in which a predetermined region changes with time on an image of one frame among a plurality of frames taken in time series;
A character reproduction data generation unit for generating character reproduction data for displaying predetermined character information in addition to the image that changes with time;
Character information determination that identifies an object that changes in the predetermined area based on the image display data, and that determines character information that includes the specified object name from among a plurality of character information that each includes the name of the object And
With
The data processing device, wherein the character reproduction data generation unit generates character reproduction data for displaying the character information determined by the character information determination unit. In the data processing device according to any one of claims 1 to 3,
The character reproduction data generation unit generates character reproduction data for displaying the display mode of the character information together with the time,
The image display data generation unit is configured to synchronize the change of the predetermined area with the change of the display mode of the character information on one frame image of a plurality of frames taken in time series. A data processing apparatus for generating image display data. The data processing apparatus according to claim 4, wherein
An acoustic that identifies an object that changes in the predetermined area based on the image display data, and that determines acoustic data that includes sound from the identified object from among a plurality of acoustic data that includes sound from the object. A data decision unit;
An acoustic reproduction data generation unit that generates acoustic reproduction data for acoustic reproduction of the acoustic data determined by the acoustic data determination unit in synchronization with a change in the region that changes with time on the image of the one frame;
A data processing apparatus further comprising: The data processing apparatus according to claim 4, wherein
A sound reproduction data generation unit that generates sound reproduction data for reproducing sound of predetermined sound data in synchronization with a change in the region that changes with time on the image of the one frame;
An acoustic data processing unit that identifies an object that changes in the predetermined region based on the image display data, and that performs processing for enhancing the sound from the identified object on the acoustic data;
A data processing apparatus further comprising: The data processing apparatus according to claim 6, wherein
The acoustic data includes left and right acoustic signals,
The acoustic data processing unit performs the enhancement processing by controlling a phase between the left and right acoustic signals. The data processing apparatus according to claim 6, wherein
The acoustic data processing unit performs the enhancement processing by controlling an amplification gain for each frequency component of the acoustic signal. An image display data generating unit that generates image display data for displaying an image in which a predetermined region changes with time on an image of one frame among a plurality of frames taken in time series;
A character reproduction data generation unit for generating character reproduction data for displaying predetermined character information in addition to the image that changes with time;
A specifying unit that specifies an object that changes on the image of the one frame based on the image display data;
A determination unit that determines, for each sentence of the character information, whether or not the name of the object specified by the specifying unit is included based on the character reproduction data;
With
When the determination unit determines that the name of one object specified by the specifying unit is included in one sentence, the character reproduction data generation unit performs the one-frame image on the one frame image. When the determination unit determines that the names of the plurality of objects specified by the specifying unit are included in different sentences, the different sentences are respectively displayed for the one-frame image. A data processing apparatus for generating character reproduction data for display.

Images