JPH08125871A - Still picture encoding system and picture processor - Google Patents

Abstract

PURPOSE: To reproduce motion similar to the time of encoding at the time of decoding by letting additional data have time information in respect of picture data constituted of the code data of a still picture and its additional data. CONSTITUTION: This device is a picture processor which decodes and displays the code data 1 of the still picture and its additional data 2 having the time information 3 in it. Since time shown in the time information 3 in the additional data 2 is made display time, and a display picture is held during it, the length of the display time can be set at the time of displaying the still picture as a moving picture, and in the case that the motion of the picture at the time of photographing and the still picture are made the moving picture again, unnaturalness due to this is eliminated. Besides, during displaying the still picture, it can be switched automatically to moving picture display, or a special commercial can be displayed by a display program conforming to the intention of the producer of the commercial.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a still image encoding system for encoding an electric signal of a still image, that is, an image processing device using the still image encoding system.

[0002]

2. Description of the Related Art MPEG or the like is being studied as a moving image coding system. The MPEG includes intraframe compression for compressing one frame of a still image forming a moving image and interframe compression between frames at regular intervals.

On the other hand, a coding method such as JPEG has been considered for a still image. In the still image coding / decoding, the processing time required for one frame has been shortened due to the recent progress of hardware, so that a plurality of code data obtained by coding still image codes at high speed can be decoded at high speed. By displaying it, it became possible to reproduce the moving image.

[0004]

However, the time between frames when a still image is extracted from a moving image depends on the image acquisition time and the encoding time, and the frame display interval depends on the decoding time and the display time. It depends on the time it takes. Therefore, there is no guarantee that the time of one frame at the time of encoding will be the same as the time at the time of decoding. Therefore, there is a difference between the movement of the original image and the movement of the restored image, which is awkward when compared to the movement of a person, which is a practical problem.

To solve this problem, for example, as described in "Electronics" (October 1993 issue, p. 56), there is a solution to unify the compressed data amount of each frame. However, in order to unify the amount of data by compression, the compression rate must be fixed, and for this reason,
Problems such as inconsistent image quality between frames and difficulty in real-time processing emerge.

Therefore, the present invention has been made in view of the above problems, and when a moving picture is restored using a still picture coding system, the same motion as at the time of coding can be reproduced at the time of decoding. A still image encoding method and an image processing apparatus thereof are provided.

[0007]

A still image coding system according to claim 1 is a still image coding system for processing image data consisting of coded data of a still image and its ancillary data. It has information.

According to a second aspect of the present invention, in an image processing apparatus which decodes image data having time information in coded data of a still image and its ancillary data and displays it, the time in the ancillary data is decoded. The time indicated by the information is used as the display time, and the display screen is held during that time.

According to a third aspect of the present invention, there is provided an image processing apparatus which decodes image data having time information in coded data of a still image and its attached data, and displays the decoded image data. The display time of the still image is calculated using the time indicated in the information and the artificially designated parameter, and the display screen is held during the display time.

According to a fourth aspect of the present invention, there is provided an image processing apparatus which decodes image data having time information in coded data of a still image and its ancillary data, and displays the decoded image data. The display time of the still image is calculated using the time indicated in the information and the parameter artificially specified, the display screen is held during the display time, and the display time is within the attached data. When it is different from the time shown in the time information, it is notified.

As the time information in the attached data of the image processing apparatus according to claim 5, one frame is fetched,
This is time information until the next frame is fetched.

An image processing apparatus according to a sixth aspect of the present invention decodes code data in which code data obtained by coding a still image and auxiliary data including time information are stored, and code data read out from the code memory. A decoding processing unit, an output unit that outputs the signal from the decoding processing unit as an image, and an attached data interpretation unit that determines the timing at which the signal is output as an image from the output unit based on time information of the attached data. It is a thing.

According to a seventh aspect of the present invention, there is provided an image processing apparatus, wherein an input section for inputting an image, an encoding processing section for encoding the image input image data, and encoded data encoded by the encoding processing section. In contrast, the attached data creation unit that creates attached data including the elapsed time from the encoded data that was previously encoded and output to the encoded data that is output this time or artificially set time information, and the encoding processing unit that encodes And a code memory for recording the time information created by the attached data creation unit.

[0014]

According to the first aspect of the present invention, in image data composed of coded data of a still image and its ancillary data,
By having time information in the attached data, the interval of image input can be set in encoding, and can be used as display time in decoding, and still image can be used as moving image. It is also possible.

According to a second aspect of the present invention, when the image data is decoded and displayed, the time indicated by the time information in the attached data is set as the display time, and the display screen is held during that time, so that the time of encoding can be improved. It can be played with the same movement as.

In the third aspect, when the image data is decoded and displayed, the display time is calculated using the time indicated by the time information in the attached data and the artificially designated parameter. However, by holding the display screen during the display time, fast-forward reproduction, slow reproduction, or the like can be performed.

According to the present invention, when the display time differs from the time indicated by the time information in the attached data, the reproduction state can be notified by notifying it.

According to the present invention, by incorporating the time until one frame is captured and the next frame is captured into the time information in the attached data, the same motion as at the time of encoding can be reproduced at the time of reproduction. it can.

According to a sixth aspect of the present invention, image data in which code data obtained by encoding a still image and auxiliary data including time information are stored is read out from the code memory, and the code data read out from the code memory is decoded. Decrypt in the department,
The signal from the decoding processing unit is output as an image from the output unit. At this time, the timing of outputting the image from the output unit is determined based on the time information of the attached data.

According to a seventh aspect of the present invention, image input is performed by the input section, encoded by the encoding processing section, and the elapsed time from the previously encoded code data to the currently output code data or artificially set. The time information is added as attached data by the attached data creating unit and stored in the code memory.

[0021]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a still image coding system and an image processing apparatus of the present invention will be described below with reference to the drawings.

<Embodiment 1> FIG. 1 is a schematic diagram showing the structure of image data in the still image encoding system of the first embodiment of the present invention.

In FIG. 1, 1 is code data, and 1
This is data obtained by encoding a frame image. Reference numeral 2 is attached data, for example, information such as the original image size of the code data 1 is stored. 3 is time information. FIG. 1 shows the data structure of a single basic image data.

Next, based on the structure of the above-mentioned single basic image data (FIG. 1), the data structure when encoding a plurality of frames of images is as shown in FIG. 2 and FIG.
The one shown in (b) is considered.

FIG. 2 is an explanatory diagram showing an example of the structure of a plurality of frames in the still image coding system according to the first embodiment of the present invention. FIG. 3 is an explanatory diagram showing another two examples of the configuration of a plurality of frames in the still image coding system according to the first embodiment of the present invention.

FIG. 2 shows a form in which each pair of coded data of one frame includes attached data including time information and multiplied by N. In this case, the time of one frame can be independently set freely.

In FIG. 3A, the time information is set only in the first frame, and the other frames have attached data not including the time information. In this case, the time of each frame can be freely set by writing the time information of all the frames in the time information of the first frame.
Further, when the time of each frame is the same, one time information may be set only in the first frame.

In FIG. 3B, the attached data including the time information is included only in the first frame, and the attached data is omitted in the other frames. Naturally, the frame does not include the time information. Also in this case, as for time information, FIG.
It has the same characteristics as (a).

In the present embodiment, in the still image coding method for forming the image data shown in FIGS. 1 to 3 which is composed of the coded data of a still image and its attached data, the time information is brought into the attached data. Because it is a thing,
When a still image is displayed as a moving image or continuously changing, the length of the display time can be set, and the motion of the image at the time of shooting and the unnaturalness due to the moving image of the still image are eliminated. Also, while displaying a still image,
It can be automatically switched to a moving image display, or a specific commercial can be displayed by a display program intended by the creator of the commercial.

Next, the hardware showing the configuration of the image processing apparatus according to the embodiment of the present invention will be described with reference to FIGS. 4 and 6, and the flowchart showing the operation of the image processing apparatus according to the embodiment of the present invention will be described. , FIG. 5 and FIG. 7.

<Second Embodiment> FIG. 4 is a block diagram showing the arrangement of an image processing apparatus according to the second embodiment of the present invention, and FIG. 5 is a block diagram of the image processing apparatus according to the second embodiment of the present invention. It is a flow chart which shows operation.

In FIG. 4, reference numeral 41 is a code memory,
It is a memory for accumulating the image data of FIGS. 1 to 3. Four
A decoding processing unit 2 performs a still image decoding process such as JPEG. An image output unit 43 is a CRT.
Alternatively, the display means is a liquid crystal display or the like. An attached data interpretation unit 44 interprets the meaning of the attached data. Reference numeral 45 denotes a main control unit, which controls the program of the entire apparatus. Reference numeral 46 denotes a time measuring unit, which measures the time for display control according to the time information in the attached data.

Next, the decoding operation of this embodiment will be described with reference to the flowchart of FIG.

FIG. 5 is a flow chart showing an example of the decoding operation performed by the main control unit 45 in the image processing apparatus of the second embodiment of the present invention.

First, in step S501, the code memory 4
The image data having the structure shown in FIG. 2A or 2B in 1 is read only for one frame to be displayed next, and the attached data is read to the attached data interpretation unit 44.
The coded data is input to the decoding processing unit 42. Step S
At 502, the decoding processing unit 42 decodes one frame, and prepares for the next display. In step S503, the process waits until the display time of the currently displayed frame ends. When the display time is reached, using the time information obtained by the attached data interpretation unit 44 in step S504 and the parameters artificially input and designated by the operator,
The display time of the next frame is calculated. Here, the parameter defines the speed of reproduction display, for example,
This is for specifying the speed of fast-forward display, slow display, etc. Next, in step S505, the display time calculated in step S504 is set in the timer, and in step S506.
To start the timer. In step S507, the image obtained in step S502 is displayed. Step S5
At 08, the end detection of the image data of all images is performed. If it is finished, the operation is finished. If the code continues, the process moves to the next frame in step S509, and step S501.
Move to

Here, although not described in the flow chart, if the display time differs from the time information in the attached data in step S504, the main control unit 45 outputs to the output unit 43.
Notification that the original operation speed and the display speed are different, for example,
It is also effective to display such as "during slow playback" and "during fast forward playback". Alternatively, it may be displayed by an abnormality display or the like simply that the display is not performed at the regular speed.

In particular, in step S504, it is possible to perform only the operation of extracting the time information from the attached data and use the extracted time information as the display time.

Finally, if the display time obtained in step S504 is shorter than the total time of the decoding process and the display process defined by the hardware,
By omitting the decoding process and display of the frame to be displayed during the processing time and adding the display time of the omitted frame to the display time of the frame during display, a good reproduced image can be obtained.

The image processing apparatus of this embodiment functions as an image decoding apparatus, and is a code memory 4 storing coded data obtained by coding a still image and attached data including time information.
1, a decoding processing unit 42 for decoding the image data read from the code memory 41, and the decoding processing unit 4
The output unit 43 outputs the signal from the image No. 2 as an image, and the attached data interpretation unit 44 determines the timing of outputting the image from the output unit 43 as an image based on the time information of the attached data.

Accordingly, the code data read from the code memory 41 is read from the code memory 41 and the image data shown in FIGS. 1 to 3 in which the code data obtained by coding the still image and the attached data including the time information are stored. The data is decoded by the decoding processing unit 42, and the signal from the decoding processing unit 42 is output as an image from the output unit 43. At this time, the timing of outputting the image from the output unit 43 is determined based on the time information of the attached data.

As described above, the image processing apparatus of this embodiment is
In the image processing apparatus for decoding the image data having time information in the coded data of the still image and its attached data and displaying it, the time indicated in the time information in the attached data is set as the display time, during which, Since the display screen is held, the length of the display time can be set when a still image is displayed as a moving image, and the movement of the image at the time of shooting and the error caused when the still image is made a moving image again The nature disappears. Further, while a still image is being displayed, it can be automatically switched to a moving image display, or a specific commercial can be displayed by a display program intended by the creator of the commercial.

Further, the image processing apparatus of the present embodiment decodes the image data having time information in the coded data of the still image and its attached data, and displays the decoded image data in the attached data. The display time of the still image is calculated using the time indicated in the time information and the artificially specified parameter, and in the case where the display screen is held during the display time, the still image is a moving image or a continuous image. As a still image that changes dynamically, it can be moved at high speed such as 2 × speed, 3 × speed, and n × speed, and it is not always necessary to set it to an integer multiple speed.

The image processing apparatus of this embodiment decodes image data having time information in coded data of a still image and its ancillary data, and displays the decoded image data in the ancillary data. The display time of the still image is calculated using the time indicated in the time information and the artificially specified parameter, the display screen is held during the display time, and the display time is stored in the attached data. When it is different from the time indicated in the time information of, the one that notifies that, as a notification that the original operation speed and the display speed are different,
For example, "slow playback", "fast-forward playback", or the like can be displayed, or an abnormality display or the like can be displayed simply indicating that the normal speed is not displayed, which is processed as a moving image. The same processing as the processing of information becomes possible.

Further, the time information in the attached data of the image processing apparatus of this embodiment captures one frame,
Since it is the time information until the next frame is taken in, a still image can be processed as a moving image without requiring a buffer memory for special time adjustment.

The code memory 41 of this embodiment is an optical disk, a magneto-optical disk, or a
It may be a recording medium such as a hard disk or a magnetic tape, or a memory for temporarily storing image data transmitted from the outside.

<Third Embodiment> FIG. 6 is a block diagram showing the arrangement of an image processing apparatus according to the third embodiment of the present invention. FIG. 7 is a main controller 65 of the image processing apparatus according to the third embodiment of the present invention. 3 is a flowchart showing an encoding operation performed by the.

In FIG. 6, reference numeral 61 is an image input unit,
It consists of a CCD camera. 62 is an encoding processing unit,
For example, still image encoding processing such as JPEG is performed. 63
Is a code memory, which is a memory that stores image data having time information in code data of still images and its ancillary data, or an optical disk, a magneto-optical disk, a hard disk, a magnetic tape, or the like as a storage medium. Reference numeral 64 is an attached data creation unit that creates attached data using information attached to the image. A main control unit 65 controls the entire apparatus. 66 is a time measuring unit for measuring the display time and adding it as a part of the attached data.

Next, the encoding operation of this embodiment will be described with reference to the flowchart of FIG.

In step S701, the main control unit 65 starts the timer of the time measuring unit 66. This timer is a timer that defines the image input interval. In step S702, a still image is input from the image input unit 61,
The process proceeds to the encoding processing unit 62, and JPEG is performed in step S703.
Encoding is performed by a still image encoding process such as. Also,
In step S704, the attached data creation unit 64 creates attached data including time information such as the image size. In step S705, it is detected whether the code generation is completed. When the operation is finished, this coding operation is finished. If not, the process moves to step S706 and waits for the timer to reach the specified time. When the specified time has elapsed, the process returns to step S701.

In the image processing apparatus for image coding of this embodiment, an input unit 61 for inputting an image, an encoding processing unit 62 for encoding the image data input by the image,
An accessory that creates accessory data including the elapsed time from the code data that was previously encoded and output from the code data that was encoded by the encoding processing unit 62 to the code data that is output this time or artificially set time information Data creation unit 64
And a code memory 63 for recording the code data coded by the coding processing unit 62 and the time information created by the attached data creating unit 64.

In this embodiment, which functions as an image coding processing device, an image is input by the input unit 61, coded by the coding processing unit 62, and the coded data is coded as described above. The elapsed time from the code data encoded and output by the processing unit 62 to the code data to be output this time or artificially set time information is added as attached data by the attached data creating unit 64, and the added information is added to an optical disc, a magneto-optical disc, It is stored in the code memory 63 such as a hard disk or a magnetic tape. Therefore,
Since the time information is brought in the attached data,
When a still image is displayed as a moving image or continuously changing, the length of the display time can be set, and the motion of the image at the time of shooting and the unnaturalness due to the moving image of the still image are eliminated. Also, while displaying a still image,
It can be automatically switched to a moving image display, or a specific commercial can be displayed by a display program intended by the creator of the commercial.

The code memory 63 of the present embodiment is an optical disk, a magneto-optical disk, or a
It may be a recording medium such as a hard disk or a magnetic tape, or may be a memory that temporarily stores image data to be transmitted to the outside.

[0053]

As described above, in the still image coding system according to the first aspect, in the image data composed of the coded data of the still image and its attached data, the attached data has time information. Thus, the display time can be set for each frame, and the same motion can be reproduced at the time of encoding and at the time of decoding.

According to another aspect of the image processing device of the present invention, the image data composed of the coded data of the still image and its ancillary data is decoded and displayed in the image processing device. By setting the indicated time as the display time and holding the display screen during that time,
It can be played back with the same motion as when encoding.

In the image processing device of the third aspect, the image data composed of the coded data of the still image and its attached data is decoded, and the image processing device for displaying it decodes the time information in the attached data. The indicated time,
Using the parameters specified by the operator,
By calculating the display time and holding the display screen during the display time, fast-forward reproduction, slow reproduction, or the like can be performed.

In the image processing device of the fourth aspect, the image processing device which decodes the image data composed of the coded data of the still image and its attached data and displays it is displayed in the attached data. When the time is different from the time indicated by the time information, the operator can be informed of the reproduction state by notifying the fact.

In the image processing apparatus of the fifth aspect, the image data composed of the coded data of the still image and its ancillary data is decoded, and the image processing apparatus for displaying it decodes one frame and By creating a code capable of setting and determining the display time for each frame by incorporating the time until the frame is captured in the time information in the attached data according to claims 2 to 4. Therefore, the same movement as that at the time of encoding can be reproduced at the time of reproduction.

In the image processing device of the sixth aspect, the image data having time information in the coded data of the still image and its ancillary data is decoded and displayed in the image processing device. Since the display time is the time indicated in the information and the display screen is held during that time, the length of the display time can be set when displaying a still image as a moving image, and the movement of the image during shooting can be set. And when the still image is made into a moving image again, the unnaturalness due to it disappears. Further, while a still image is being displayed, it can be automatically switched to a moving image display, or a specific commercial can be displayed by a display program intended by the creator of the commercial.

According to another aspect of the image processing apparatus of the present invention, the image input is performed by the input unit and is encoded by the encoding processing unit,
The elapsed time from the previously encoded code data to the code data to be output this time or artificially set time information is added as attached data by the attached data creation unit and stored in the code memory. Therefore, when a still image is displayed as a moving image, the length of the display time can be set, and the motion of the image at the time of shooting and the unnaturalness caused by re-moving the still image are eliminated. Further, while displaying a still image, it is possible to automatically switch the display to a moving image display or display a specific commercial by a display program as intended by the creator of the commercial.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing a structure of image data in a still image coding system according to a first embodiment of the present invention.

FIG. 2 is an explanatory diagram showing an example of a configuration of a plurality of frames in the still image coding system according to the first embodiment of the present invention.

FIG. 3 is an explanatory diagram showing another two examples of the configuration of a plurality of frames in the still image encoding system according to the first embodiment of the present invention.

FIG. 4 is a block diagram showing the arrangement of an image processing apparatus according to the second embodiment of the present invention.

FIG. 5 is a flowchart showing a decoding operation of the image processing apparatus according to the second embodiment of the present invention.

FIG. 6 is a block diagram showing the arrangement of an image processing apparatus according to the third embodiment of the present invention.

FIG. 7 is a flowchart showing an encoding operation performed by the image processing apparatus according to the third embodiment of the present invention.

[Explanation of symbols]

 1 Coded Data 2 Attached Data 3 Time Information 41 Code Memory 42 Decoding Processor 43 Output Unit 44 Attached Data Interpreter 45 Main Control Unit 46 Clock Measuring Unit 61 Input Unit 62 Encoding Processor 63 Code Memory 64 Attached Data Creation Unit 65 Main control unit 66 time measurement unit

Claims (7)

[Claims] 1. A still image coding method for processing image data consisting of coded data of a still image and its attached data, wherein the attached data has time information. 2. An image processing apparatus for decoding image data having time information in coded data of a still image and its attached data, and displaying the decoded image data, displaying the time indicated by the time information in the attached data. An image processing apparatus, characterized in that the display screen is held for a period of time. 3. An image processing apparatus which decodes image data having time information in coded data of a still image and its ancillary data, and displays the decoded image data, wherein the time and the human being indicated by the time information in the ancillary data are used. An image processing apparatus, characterized in that the display time of a still image is calculated using a parameter that is specified in a static manner, and the display screen is held for the display time. 4. An image processing apparatus for decoding image data having time information in coded data of a still image and its ancillary data, and displaying the decoded image data, wherein the time and the artifact indicated in the time information in the ancillary data are used. The display time of the still image is calculated by using the parameter that is designated in a static manner, the display screen is held during the display time, and the display time is the time indicated by the time information in the attached data. An image processing device characterized by notifying when different. 5. The time information in the attached data is time information until one frame is captured and the next frame is captured.
The image processing device according to item 1. 6. A code memory in which code data obtained by coding a still image and auxiliary data including time information are stored, a decoding processing unit which decodes the code data read from the code memory, and the decoding An image processing apparatus comprising: an output unit that outputs a signal from the conversion processing unit as an image; and an attached data interpretation unit that determines the timing of outputting the image from the output unit as an image based on time information of the attached data. . 7. An input unit for inputting an image, an encoding processing unit for encoding the image-inputted data, and encoding data output by encoding the encoded data previously encoded by the encoding processing unit and outputting the encoded data. An adjunct data creation unit that creates adjunct data including elapsed time from the code data to the code data to be output this time or artificially set time information, and the code data and an adjunct data creation unit encoded by the encoding processing unit An image processing apparatus, comprising: a code memory for recording the time information created in Step 1.