JPH1070703A - Recording device and reproducing device for image information management, and recording and reproducing device for image information management - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it advantageous to browse many images by putting scattered still pictures into a moving picture bit stream which is arrayed along the time- base direction. SOLUTION: An image data storage means 104 stores pieces of still picture data. The still picture data are all read out in sequence and selected as constituent elements of the moving picture bit stream by an image selecting means 113, and an image order determining means 114 determines the array order of the selected still picture data along the time base. The still picture data read out in the array order are compressed and encoded by a moving picture encoding means 115 to generate image compressed encoded data, which are temporarily stored; and a moving picture bit stream recording means 116 reads the image compressed encoded data out in the array order along the time base and records them as the moving picture bit stream in an image data storage means 104.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a magnetic disk, a magneto-optical disk, a hard disk, a magnetic tape, and a CD-I.
・ Video CD ・ Photo CD ・ CD-ROM ・ Laser disk (LD) ・ DVD (Digital Video Disk or Di
gital Versatile Disk) ・ CD-R (write once type)
Multiple still images and moving images scattered on storage media such as digital broadcasting, CATV, etc., and communication media such as personal computer communication and the Internet, and scattered in a state where they are stored on a hard disk or semiconductor memory. And a moving image bit stream for recording a plurality of still images and moving images to be collectively recorded in one moving image bit stream for production of contents (contents and works having added value) and the like. And a playback device for managing image information. Note that a moving image is a sequence of a plurality of frames, and one frame is recorded for each frame. Therefore, it can be said that one frame constituting the moving image is also a still image.
In this sense, in this specification, an image of each frame that is a component of a moving image is also defined as a still image.

[0002]

2. Description of the Related Art In recent years, with the spread of electronic still cameras and digital video cameras, image data can be easily handled. Also, the distribution of multimedia contents has become popular, and computer file systems (such as hard disks and CD-
A large amount of image data (moving images and still images) is becoming scattered on ROMs, floppy disks, magneto-optical disks such as MOs and PDs.

When viewing or recording such an image for processing and editing, it is common to input each image data to a computer and perform processing there.

FIG. 68 shows a hierarchical directory structure for a still image existing in a file system of a conventional general computer. In FIG. 68, 11 is a root directory, 12a to 12i are subdirectories of each layer, and still image files 13a ₁ (still image 1) and 13b _{1 to} 13b ₃ (still images 2 4), 13c ₁ ~13c ₂ (still picture 5,6),
13d ₁ ~13d ₂ (still picture 7,8), there is 13e ₁ (still image 9). That is, a plurality of still images are filed in a state of being separated. When a plurality of necessary still images are read, as shown in FIG. 69, the still images 14a to 14i for one frame are simply read, and the time flow between the still images 14a to 14i There was no relevance within.

[0005]

If the files of the still images are managed in the hierarchical directory structure shown in FIG. 68, the management itself becomes troublesome. Each time a reading process is required, the operation is very troublesome, and it is necessary to determine in each subdirectory what to read is in each case.
There is a problem that the display speed is slow and the overhead becomes large as a whole.

Further, data of a plurality of read still images can be copied and collected at one place, but even in such a case, it is necessary to manage them by file names. In this case, there is an overhead that a file name must be searched and accessed in the file system.

As shown in FIGS. 70 (a) and 70 (b), a plurality of read-out still images may be displayed in a list on the display screen 15 as child screens. The number is limited to 3 = 9 or 5 × 5 = 25, and a large number of still images cannot be viewed. Also, the smaller the child screen becomes, the harder it is to see.
When searching for images, it depends on the display capabilities of the display, making high-speed searching difficult.

[0008] Further, current e-mails are simple text-only e-mails, but are expected to evolve into e-mails with rich expressiveness using image files in the future. In this case, if the number of image files to be transmitted is large, problems occur in both time and cost.

When a large number of scattered images are browsed or recorded for processing and editing, it becomes necessary to manage image data.

[0010] In particular, when constructing a home page of the Internet, an HTML (Hyper Text Markup Language) is used.
e: When an image is handled in a file of a sentence, an image, and a sound that is created in advance on a homepage, it is necessary to manage a plurality of image data (GIF files). In many cases, the design of a homepage is configured using small image data, and in some cases, a very large amount of image data is used. Therefore, it is absolutely necessary to manage the image data.

The present invention has been made in view of such circumstances, and a plurality of read still images are formed into a moving image bit stream arranged in the time axis direction, thereby enabling a large number of images to be read. (Browsing (reading: skimming through the contents)) is intended to be able to be performed advantageously.

[0012]

The following method is considered to be effective as a method for solving the problem. That is, a still image is not a BMP, JPG, or GIF format which is a graphic file format in the field of personal computers, but a plurality of still images are handled as if they were moving images. C
There is a case where the data is encoded and recorded as a bit stream (data sequence created by an encoder) of an oding Experts Group. By continuously playing back a group of images in a slide manner, it is possible to search for images while viewing them as a moving image (browsing is also possible. In this case, one frame of a moving image becomes one still image) Yes, it is.

[0013] A recording apparatus for managing image information according to the present invention comprises:
The still image data is sequentially read from the image data storage means and selected as a component of a moving image bit stream, and the arrangement order in the time axis direction is determined for each of the selected plurality of still image data, The still image data read out in accordance with the arrangement order in the axial direction is compression-encoded to generate image compression-encoded data, temporarily stored, and the stored image compression-encoded data is stored in the time axis direction. And recorded as a moving image bit stream. In the image data storage means, scattered still images (still images in a broad sense including each frame that is a component of a moving image) are sequentially read out and selected, and are arranged according to the order of arrangement in the time axis direction. One moving image bit stream can be combined and the combined moving image bit stream can be recorded. If a moving image bit stream generated by arranging a plurality of still images along the time axis direction is recorded as described above, browsing (viewing, browsing, Sinking) is possible.

Further, the image information management reproducing apparatus according to the present invention arranges image compression encoded data of a plurality of still image data in the time axis direction and classifies information for each image compression encoded data (for example, The video bit stream is input and analyzed from image data storage means storing a video bit stream to which a character string or a hue is added, and the video bit stream is decoded according to the analysis result. When playing back image data and displaying the image data, specify the information related to the classification to be searched, and enter it when the information for this classification matches the information determined as a result of the analysis. It is configured to decode the moving picture bit stream that is being executed. At the time of searching and reproducing still images, a plurality of still images are selected in advance and compared with the case of searching for still images scattered on a recording medium while searching each directory, as in the case of the conventional technology, in the time axis direction. Browsing (viewing, browsing,
It is possible to perform panning, and to efficiently search for images. When the operator sets information for a classification to be searched, image compression encoded data corresponding to the information is extracted from the moving image bit stream and automatically decoded. Is reproduced in the state of a moving image, and it is not necessary to reproduce all the still images. Therefore, it is possible to quickly find an image to be searched.

[0015]

According to the present invention, there is provided a recording apparatus for image information management according to the present invention, comprising: image data storage means for storing a plurality of still image data; Image reading means for sequentially reading out all the images and selecting them as components of a moving image bit stream, and an image for determining the arrangement order in the time axis direction for each of the selected plurality of still image image data in the reading order. Moving image encoding means for compressing and encoding still image data read out in accordance with the arrangement order in the time axis direction to generate and temporarily store image compression encoded data; Moving image bit stream recording means for reading data in the order of arrangement in the time axis direction and recording the data as a moving image bit stream It is characterized. All the scattered still images (still images in a broad sense including each frame that is a component of a moving image) are sequentially read and selected in the image data storage unit, and are arranged in the time axis direction. The moving image bit stream can be collected as one moving image bit stream, and the collected moving image bit stream can be recorded. Since all the still images are read out and automatically arranged as constituent elements of the moving image bit stream, no manual processing is required, and the moving image bit stream can be generated very quickly. The image data storage means can store still image data obtained from various storage media and still image data obtained from various broadcast media and communication media. Further, since the still image data is compression-encoded, the storage capacity for storing the moving image bit stream may be relatively small. If a moving image bit stream generated by arranging all still images along the time axis direction is recorded in this way, browsing (viewing, browsing, Sinking) is possible.

According to a second aspect of the present invention, there is provided a recording apparatus for managing image information, comprising: image data storage means for storing a plurality of still image data; and still image image data read from the image data storage means. A display means for displaying the still image data, an image selecting means for appropriately selecting the displayed still image data as a component of the moving image bit stream, and a time axis direction for each of the plurality of selected still image data. Image order determining means for determining the arrangement order of the images, and reading and compressing and encoding the corresponding still image data from the image data storage means in accordance with the arrangement order in the time axis direction to generate image compression encoded data and temporarily Moving image encoding means for temporarily storing, and reading out the image compression encoded data in the order of arrangement in the time axis direction and a moving image bit stream. It is characterized in that a moving picture bit stream recording unit to record Te. Arbitrarily selecting a plurality of scattered still images (still images in a broad sense including each frame that is a component of a moving image) scattered in the image data storage means, and arbitrarily determining the order of arrangement in the time axis direction As a single moving image bit stream arranged according to the above, and the collected moving image bit stream can be recorded. In particular, when a still image as a component of a moving image bit stream is selected, a still image as a candidate is displayed on a display means and the operator can select the still image while visually checking the image. It is possible to efficiently generate a moving image bit stream without error. By definition of a still image, the moving image bit stream may include a plurality of scenes in one moving image or a plurality of moving images. The image data storage means can store still image data obtained from various storage media and still image data obtained from various broadcast media and communication media. Also,
Since the still image data is compression-encoded, the storage capacity for storing the moving image bit stream may be relatively small. In this way, if the operator selects an arbitrary still image and records a moving image bit stream generated by appropriately arranging it along the time axis direction, even when searching by the image information management playback device, even if the speed is low, Browsing (viewing, panning) becomes possible even at high speed.

According to a third aspect of the present invention, there is provided the image information management recording apparatus according to the first or second aspect, wherein the image order determining means determines whether or not the still image data read from the image data storing means has a pixel-to-pixel relationship. It is characterized in that it is provided with a pixel thinning means for executing the thinning processing and then transferring it to the moving picture coding means. Since the moving picture coding means thereafter performs the compression coding on the still picture image data after the pixel thinning-out processing, the compression coding processing can be performed at high speed, and the compressed and coded still picture image data can be processed. Can reduce the storage capacity for storing the moving image bitstream generated from.

According to a fourth aspect of the present invention, there is provided a recording apparatus for managing image information according to any one of the first to third aspects, wherein the plurality of still image images read from the image data storage means by the image order determination means. A multi-screen image data generating means for combining data into still image data for one frame of a multi-screen and transferring the data to a moving picture coding means is provided. It is possible to generate a moving image bit stream that is compression-encoded in the form of multi-screen still image data in which a plurality of still image data are grouped into one frame. A moving image bit stream in which a plurality of still image data are combined into one frame as described above can be browsed at a time when browsing (viewing) at a high speed or a low speed by the image information management reproducing apparatus. Since the number of images is large, the improvement of image search efficiency can be made effective. When the pixel thinning process is used together, the storage capacity for storing a moving image bit stream can be reduced, and
Further high-speed search becomes possible.

According to a fifth aspect of the present invention, there is provided the image information management recording apparatus according to any one of the first to fourth aspects, wherein the selected still image data adjacent to each other read from the image data storage means. An inter-screen difference generating means for generating an inter-screen difference, an inter-screen difference evaluating means for comparing the generated inter-screen difference with a predetermined value, and an inter-screen difference when the inter-screen difference is less than or equal to a predetermined value. An intra-screen / inter-screen selecting means for selecting an encoding and selecting an intra-screen encoding when the inter-screen difference is larger than a predetermined value; and a selected still image which is activated when the inter-picture compression encoding is selected A moving picture inter-coding means for performing inter-picture compression coding of image data, and a moving picture screen which is activated when intra-picture compression coding is selected and performs intra-picture compression coding of selected still picture image data Having encoding means It is characterized. When the difference between two selected still image data adjacent to each other read in accordance with the order of the frame order number is equal to or smaller than a predetermined value, high data compression is performed by performing inter-image compression coding. The capacity for recording in the means is small.

According to a sixth aspect of the present invention, there is provided a recording apparatus for image information management according to any one of the first to fifth aspects, wherein the input audio data for search assistance is compression-encoded by audio compression encoding. Audio encoding means for generating data; and image / audio multiplexed data obtained by multiplexing the image compression encoded data from the moving image encoding means and the audio compression encoded data from the audio encoding means on a frame basis. In place of the video / audio multiplexing means for generating the video / audio multiplexing data and the video / audio multiplexing data recording means, the generated video / audio multiplexed data is read out in accordance with the arrangement order in a predetermined time axis direction, and is read out as a video / audio bit stream. A moving image / audio bit stream recording means for recording is provided. A moving image / audio bit stream in which audio data for search assistance is added to selected still image data for each frame can be recorded. And
If such a moving image / audio bit stream is recorded, the audio is reproduced at the same time as the image is searched by the image information management reproducing apparatus, so that the reproduced audio is used as a search assisting audio. It is possible to do.

According to a seventh aspect of the present invention, in the image information management recording apparatus according to any one of the first to sixth aspects, a classification identifier as a classification number is added to the selected still image data in accordance with a predetermined requirement. Image classification means for adding, wherein the image order determination means adds, to the selected still image data to which the classification identifier has been added, an in-class order number as an arrangement order in the time axis direction in the classification identifier. It is characterized by having such a configuration. A large number of still images are classified according to a predetermined requirement, and selected still image data with a classification identifier and an intra-class sequence number is generated. , And in the case of the same classification identifier, the one with the lower classification number within the classification is read out with priority, and compression-encoded, so that a moving image with a priority determined by the classification identifier and the classification number within the classification An image bit stream can be generated and recorded. If such a moving image bit stream is recorded, still images are reproduced as moving images in order for each classification when searching for images by the image information management reproducing apparatus. That is, the contents can be easily grasped even when a high-speed search is performed.

According to an eighth aspect of the present invention, in the image information management recording apparatus according to the seventh aspect, the image classifying means includes a classification identifier as a classification number based on a tint included in the still image data at the largest ratio. Is added. It is not necessary for the operator to classify each time, and the classification is performed automatically, so that the work efficiency is very good.

According to a ninth aspect of the present invention, in the image information management recording apparatus according to the seventh or eighth aspect, the inter-picture compression encoding is performed on the selected still image data having the same classification identifier as the classification number. It is characterized by comprising a moving picture inter-frame encoding means for performing the encoding. The capacity required for recording a moving image bit stream is small.

According to a tenth aspect of the present invention, there is provided the image information management recording apparatus according to any one of the seventh to ninth aspects, wherein the image compression encoding read out when the moving image bit stream is generated. Classification information adding means for adding classification information corresponding to a classification identifier as a classification number to the data, wherein the moving image bitstream recording means is configured to record a moving image bitstream with classification information. Features. It is possible to generate and record a video bitstream with classification information having a priority determined by the classification identifier and the sequence number within the classification and to which specific classification information composed of a character string is added. And
If such a moving image bit stream with classification information is recorded, still images are reproduced as moving images in order for each classification and the classification information is also reproduced when the image information management reproducing apparatus searches for images. Therefore, even if a coarse search, that is, a high-speed search is performed, it is easy to grasp the contents.

An image information management recording apparatus according to an eleventh aspect of the present invention is characterized in that, in the tenth aspect, the classification information is recorded in a user data area of a header of the image compression coded data. Features. Since the user data area of the header is known in advance to be a specific position for the operator in the case of MPEG or the like,
It becomes easy to search for the classification information added at the time of decoding by the image information management playback device.

According to a twelfth aspect of the present invention, there is provided the image information management recording apparatus according to any one of the seventh to ninth aspects, wherein the image compression coding read out when the moving image bit stream is generated. A classification partial image data generating means for generating classification partial image data corresponding to the classification identifier with respect to the data; And a classification partial image data adding means for adding in a pause manner, wherein a moving image bit stream with a classification partial image is recorded in the moving image bit stream recording means. It is possible to generate and record a moving image bit stream with a classification partial image having a priority determined by a classification identifier and a sequence number within a classification, and a classification partial image for search assistance added in a superimposed manner. it can. If such a moving image bit stream with a partial image for classification is recorded, still images can be sequentially searched as moving images for each classification when the image information management playback device searches for images. Since the auxiliary partial images for classification are also reproduced, the contents can be easily grasped even if a coarse search, that is, a high-speed search is performed.

According to a thirteenth aspect of the present invention, there is provided the image information management recording apparatus according to the twelfth aspect, wherein the classification partial image data is configured as colored rectangular frame image data. A colored rectangular frame image surrounding the periphery of the image of the image compression-encoded data can be added to the image compression-encoded data as a search assistance classification partial image. The colored rectangular frame is also conspicuous during search playback.

[0028] According to a fourteenth aspect of the present invention, there is provided the image information management recording apparatus according to any one of the seventh to ninth aspects, wherein the image compression encoding read out when the moving image bit stream is generated. Classification label color generation means for generating classification color label data of a hue corresponding to the classification identifier for data, and a classification label color bit stream for one macroblock corresponding to the generated classification label color data And a labeling bit stream adding means for adding the generated labeling bit stream for classification as the first macroblock of the first or last line in the image compression-encoded data. Video with a label color bitstream for classification in the video bitstream recording means. It is characterized in that is arranged to record as a bit stream. It is possible to generate and record a moving image bit stream having a priority determined by the classification identifier and the order number within the classification and to which a classification label color bit stream for search assistance is added.
Then, there is no need to generate colored rectangular frame image data as in the twelfth aspect, but simply generates a bit stream that specifies the label color for classification, and converts the bit stream for label color for classification into the first line or the last line. Since it is only necessary to add the first macroblock as the first macroblock, the processing amount can be reduced, the processing speed can be increased, and the memory capacity can be reduced as compared with the case of the twelfth aspect. Also,
If such a moving image bit stream with a label color bit stream for classification is recorded, still images can be sequentially searched as moving images for each classification when searching for images by the playback device for image information management. Since the auxiliary classification label color image is reproduced in a band along the upper side or the lower side of the screen, the contents can be easily grasped even if a coarse search, that is, a high-speed search is performed.

According to a fifteenth aspect of the present invention, in the image information management recording apparatus according to any one of the seventh to ninth aspects, the image classification means classifies the still images according to predetermined requirements, and In order to combine still image groups into the same GOP (group of pictures; a coding unit defined by MPEG), the still image data is configured to have a classification identifier, and the moving image bit stream is GOP corresponding to the classification identifier for the image compression encoded data read at the time of generation
Classification GOP start code generation means for generating a classification GOP start code for setting in a header, and classification GOP start code addition means for adding the generated classification GOP start code to a GOP header in image compression encoded data And recording in a moving image bit stream recording means as a moving image bit stream with a classification GOP start code. It is possible to generate and record a moving image bit stream having a priority determined by a classification identifier and a sequence number within a classification and to which a classification GOP start code for search assistance is added. The process of generating and adding the classification GOP start code can be performed relatively easily.
If such a moving picture bit stream with a GOP start code for classification is recorded, the moving picture bit stream of a GOP of a scene of a certain classification is reproduced when an image is searched by an image information management reproducing apparatus. If the user wants to jump to a scene of another arbitrary classification during the operation, the user can make a random access by setting the GOP start code for classification and jump quickly.

According to the present invention, there is provided a recording apparatus for image information management according to any one of claims 7 to 9, wherein the image compression coding read out at the time of generating the moving image bit stream. A classification voice data generating means for generating classification voice data corresponding to a classification identifier attached to the data; and a classification voice generating means for compressing and encoding the generated classification voice data to generate voice compression coded data for classification. Audio data encoding means, multiplexing the image compression encoded data from the moving image encoding means and the classification audio compression encoded data from the classification audio data encoding means,
In place of the video / audio multiplexing means for generating the multiplexed audio data for classification and the moving picture bit stream recording means, the generated multiplexed audio / video data for classification is read out according to a predetermined order in the time axis direction. Moving image / audio bit stream recording means for recording as a moving image bit stream with audio compression encoded data for classification. Generates a moving image bitstream with audio compression-encoded data for classification, such as search aid music, singing, and human voice, with a priority that is determined by the classification identifier and the sequence number within the classification, and that changes in time series. And can be recorded. If a moving image bit stream accompanied by such time-varying classification audio compression / encoding data is recorded, when the image information management reproducing apparatus searches for an image, the classified image The music, singing, human voice, etc., which change in time series, which are individually corresponding to each sound, are played back simultaneously, and the switching of the image classification can be determined by referring to the switching of the voice, so the operator can By listening to the music, singing, and voice of the person for the search aid, the image can be reproduced accurately.

According to a seventeenth aspect of the present invention, in the image information management recording apparatus according to any one of the first to sixteenth aspects, the moving image bit stream recording means is also used as the image data storage means. It is characterized by. Use of a recording medium is advantageous in terms of space and cost.

An image information management playback apparatus according to claim 18 of the present invention is characterized in that the image compression encoded data of a plurality of still image data is arranged in the time axis direction, and a search assist sound is provided for each image compression encoded data. A moving image / bit stream analyzing unit for inputting and analyzing the moving image / audio bit stream from the image data storage unit in which the moving image / audio bit stream in a state where the compression encoded data is multiplexed is stored; Moving image / audio separating means for separating a moving image / audio bit stream into a moving image bit stream and an audio bit stream, and moving image decoding for decoding the separated moving image bit stream according to an analysis result and reproducing image data Means, display means for displaying the reproduced image data, and decoding of the separated audio bit stream according to the analysis result Is the speech decoding means for reproducing audio data, characterized by comprising an audio output means for outputting the reproduced audio data to. At the time of searching and reproducing still images, a plurality of still images are selected in advance and compared with the case of searching for still images scattered on a recording medium while searching each directory, as in the case of the conventional technology, in the time axis direction. Since they are reproduced as a moving image / audio bit stream in which audio compression-encoded data are multiplexed and multiplexed, browsing (viewing and watching) can be performed, and images can be searched efficiently. In addition, since the multiplexed search assisted audio compression coded data is separated and output as search aid audio, still images can be efficiently searched using the audio as a clue.

According to a nineteenth aspect of the present invention, there is provided the image information managing / reproducing apparatus, wherein the image compression encoded data of a plurality of still image data are arranged in the time axis direction, and classification information is added for each image compression encoded data. Moving image bit stream analyzing means for inputting and analyzing the moving image bit stream from the image data storage means in which the moving image bit stream in the stored state is stored, and decoding the moving image bit stream according to the analysis result to obtain image data. And a display means for displaying the reproduced image data, the classification information specifying means for specifying classification information relating to a classification to be searched. And determining whether or not the classification information determined as a result of the analysis by the video bitstream analysis unit matches the specified classification information. Is characterized in that a classification information determining means for permitting the decoding of the moving picture bit stream that entered when matches. When searching and playing back still images, a plurality of still images are selected in advance and compared with the case of searching for still images scattered on a recording medium while searching the directory as in the case of the conventional technique. Since the moving image bit stream is reproduced along the moving image bit stream, browsing (viewing and panning) can be performed, and an image can be efficiently searched. Then, when the operator sets the classification information to be searched, the image compression encoded data of the moving image bit stream with the classification information is extracted and automatically decoded according to the set classification information. Is reproduced in the state of a moving image, so that it is not necessary to reproduce all still images, and an image to be searched can be quickly found.

According to a twentieth aspect of the present invention, there is provided an image information management reproducing apparatus, comprising: arranging image compression coded data of a plurality of still image data in a time axis direction; A video bit stream analyzing means for inputting and analyzing the video bit stream from an image data storage means storing a video bit stream in a multiplexed state, and decoding the video bit stream according to the analysis result And a display device for displaying the reproduced image data. The reproduction device for image information management, comprising: a display device for displaying classified image information; Classification color information designating means, and classification color information of colored rectangular frame image data determined as a result of the analysis by the moving image bit stream analysis means. It is characterized in that a classification color information determination means for permitting the decoding of the moving picture bit stream that entered when matching is determined whether or not matching the specified classification color information. When searching and playing back still images, a plurality of still images are selected in advance and compared with the case of searching for still images scattered on a recording medium while searching the directory as in the case of the conventional technique. Since the moving image bit stream is reproduced along the moving image bit stream, browsing (viewing and panning) can be performed, and an image can be efficiently searched. When the operator sets the classified color information to be searched, the image compression encoded data of the moving image bit stream with the colored rectangular frame image data is extracted and automatically decoded according to the set classified color information. Thus, the still images of the set specific classification are reproduced in a moving image state, so that it is not necessary to reproduce all the still images, and the image to be searched can be quickly found.

According to a twenty-first aspect of the present invention, there is provided an image information management reproducing apparatus, comprising: arranging image compression encoded data of a plurality of still image data in a time axis direction; A moving image bit stream analyzing means for inputting and analyzing the moving image bit stream from an image data storage means in which a moving image bit stream having a label color bit stream for classification added thereto is stored; An image information management reproducing apparatus comprising: a moving image decoding unit that decodes a stream according to an analysis result to reproduce image data; and a display unit that displays the reproduced image data. Classifying label color designating means for designating the label color information; It is determined whether or not the output label color information of the first line head macroblock matches the designated label color information, and decoding of the first line head macroblock of the moving picture bit stream that is input when the determination is made. A moving image 1 macroblock decoding unit that decodes only the first line first macroblock of the moving image bitstream separated when there is permission. Features. When searching and playing back still images, a plurality of still images are selected in advance and compared with the case of searching for still images scattered on a recording medium while searching the directory as in the case of the conventional technique. Since the moving image bit stream is reproduced along the moving image bit stream, browsing (viewing and panning) can be performed, and an image can be efficiently searched. When the operator sets the label color information to be searched, the first line of the moving image bit stream in a state where the classification label color bit stream is added to the first line head macroblock according to the set label color information. Since the first macroblock is extracted and automatically decoded, a band-shaped classification label color image is displayed when a still image of a specific classification that has been set comes at the playback timing, and all still images need to be reproduced. , So that you can quickly find the image you want to search.

According to a twenty-second aspect of the present invention, there is provided an image information managing / reproducing apparatus which stores a moving image bit stream in which image compression-encoded data of a plurality of still image data are arranged in a time axis direction. Moving image bit stream analyzing means for inputting and analyzing the moving image bit stream from the data storage means, moving image decoding means for decoding the moving image bit stream according to the analysis result and reproducing image data, What is claimed is: 1. A reproduction apparatus for managing image information, comprising: display means for displaying image data, comprising: a search mark writing position specifying means for specifying a time axis position of a frame in which search mark information is to be written; When set in the time axis direction position of the currently input frame and the search mark writing position specifying means according to the analysis result of the means A user data area extracting means for extracting a user data area of the image compression-encoded data of each frame when the axial position matches, a search mark writing means for writing search mark information in the extracted user data area, A search mark detecting means for detecting search mark information written in the user data area and permitting decoding of a moving image bit stream at the time of search and reproduction again. Since the search mark information when there is an image to be viewed again at the time of search and reproduction again is configured to be written in the user data area of the image compression-encoded data corresponding to the corresponding one frame,
The work of writing the search mark information can be performed much easier and in a shorter time as compared with the conventional technology in which the search mark information is added as a bit stream. It is possible to jump to the image that the user wants to see and play it back, thereby improving the workability of search playback.

According to a twenty-third aspect of the present invention, in the image information management / reproduction apparatus according to the twenty-second aspect, the search mark writing means selects arbitrary search mark information from a plurality of types of search mark information, and It is characterized in that it is configured to write in the data area. By specifying the type of search mark information for a moving image bit stream in which a plurality of search mark information is written,
It is possible to skip a frame in which other search mark information is written and jump to a frame in which the specified search mark information is written to start playback, thereby further improving the workability of search and playback. it can.

According to a twenty-fourth aspect of the present invention, there is provided an image information managing / reproducing apparatus which stores a moving image bit stream in a state in which image compression encoded data of a plurality of still image data are arranged in a time axis direction. A moving image bit stream analyzing means for inputting and analyzing the moving image bit stream from the data storage means, a moving image decoding means for decoding the moving image bit stream according to the analysis result and reproducing image data, What is claimed is: 1. A reproduction apparatus for managing image information, comprising: display means for displaying image data, comprising: a search mark writing position specifying means for specifying a position in a time axis direction of a frame for which search mark audio information is to be multiplexed; Data input means for inputting voice data for use, voice coding means for compression-coding the input voice data, and the image data storage Video / audio multiplexing means for multiplexing the audio compression coded data with the video compression coded data of the video bit stream read from the stage, wherein the video bit stream analysis means inputs the current input data based on the analysis result. When the time axis direction position of the current frame coincides with the time axis direction position set in the search mark writing position designating means, the image / audio multiplexing means is started to activate the image compression / encoding data of the frame. Multiplexed audio compression-encoded data, and store the moving image bit stream obtained by multiplexing the compression-encoded data of the audio information for the search mark in the image data storage means. I have. The search mark audio information when there is an image to be viewed again at the time of the search and reproduction again is multiplexed with the image compression-encoded data of the corresponding frame and stored again in the image data storage means as a moving image bit stream. Therefore, reproduction can be performed while listening to the search mark sound information at the time of retrieval and reproduction, and accurate image retrieval without oversight can be performed at high speed.

According to a twenty-fifth aspect of the present invention, there is provided a recording / reproducing apparatus for managing image information according to any one of the first to seventeenth aspects, wherein:
A feature of the present invention is that the function of any one of the image information management and playback devices described in claims 18 to 24 is integrated. The function of the recording device and the function of the reproducing device can be combined.

Hereinafter, specific embodiments of the recording apparatus for managing image information according to the present invention will be described in detail with reference to the drawings. An embodiment of the image information management playback device will be described later.

[Embodiment 1] Although the order is reversed, Embodiment 1 corresponds to Claim 2. Embodiment 2 corresponding to claim 1 will be described later. FIG. 1 shows Embodiment 1
1 is a block diagram showing the configuration of an image information management recording device according to the first embodiment. In FIG. 1, 101 is control means for controlling the entire apparatus, 102 is program storage means for storing a program for the control, 103 is working memory means functioning as a working memory, and 104 is image data. For example, image data storage means constituted by a hard disk or a semiconductor memory, 105 is an image data input means for inputting image data from outside,
106 is a video signal receiving means, 107 is a modem connected to a telephone line, 108 is a network connection means for inputting digital data including image data from a network such as the Internet, and 109 is one frame of image data for displaying image data. A frame buffer means for temporarily storing minutes; 110, a display means such as a CRT or LCD; 111, a display control means; 112, an input operation means comprising a keyboard or a mouse on which an operator performs an input operation; An image selecting unit, 114 is an image order determining unit, 115 is a moving image encoding unit, 116 is a moving image bit stream recording unit, and 117 is a bus for exchanging data by connecting each unit.

The image data input means 105 includes a magnetic disk, a magneto-optical disk, a hard disk, a magnetic tape,
The apparatus receives image data from a playback device (drive) for a storage medium such as a DI, a video CD, a photo CD, a CD-ROM, a laser disk, a DVD, and a CD-R. broadcast·
A modem 107 is for inputting image data from a broadcast medium such as a CATV, a modem 107 is for inputting / outputting image data or the like by personal computer communication via a telephone line, and a network connection means 108 is for inputting a communication medium such as the Internet. To input digital data including image data. In the case of the Internet, images are handled in a file in HTML (Hyper Text Markup Language) format. Image data input means 10
5. Image data input from the video signal receiving means 106, the modem 107 or the network connection means 106 is temporarily transferred to the image data storage means 104 and stored therein.
In some cases, the image data is read out from the image data storage means 104 and displayed on the display means 110 via the frame buffer means 109. Immediately after the image data is input, one frame is directly transmitted to the display means 110 via the frame buffer means 109. It may be displayed on 110.

The display control means 111 includes the input operation means 11
2 has a function of accessing the image data storage unit 104 based on the instruction from the server 2 and transferring necessary image data to the frame buffer unit 109. At the time of the transfer, it is also possible to perform pixel thinning and display a small screen.

The image selecting means 113 receives an instruction from the input operating means 112 when the operator looks at the image data of each frame displayed on the display means 110 and decides to use it as a component of the moving image bit stream. , The displayed image data is selected, and in the case of the image data stored in the image data storage means 104, the address (the still image file storage number variable N) of the selected still image data is stored. When image data not stored in the image data storage unit 104 is selected, the image data is stored in the image data storage unit 104 and the address of the selected still image data is stored.

The image order determining means 114 reads out still image data, which is to be a component of the moving image bit stream, stored in the image data storing means 104 frame by frame, and reads out the order (frame order) in the moving image bit stream. Number X, that is, the order of arrangement in the time axis direction) is added to determine the reading order as a component of a moving image bit stream when reading from the image data storage unit 104 for compression encoding. Alternatively, an arbitrary plurality of selected still image data among a plurality of selected still image data of a plurality of frames is read out from the image data storage unit 104 (for example, if the selected still image data is 2
(If there are 00 frames, 25 frames are read out) The display control unit 111 performs a thinning-out process, and displays a plurality of image data on the display unit 110 via the frame buffer unit 109 on, for example, 5 × 5 = 25 small screens. When deciding which image data is to be placed in which number, the frame order number X is added to the still image file storage number variable N of the corresponding image data based on an instruction from the input operation means 112. In this case, the reading order is determined as a component of the moving image bit stream when reading from the image data storage unit 104 for compression encoding.

Since the reading order is not accurately determined until the entire moving picture bit stream is finally completed, it is determined very roughly at first. The display of the plurality of image data on the 25 sub-screens is repeated, and the reading order is gradually and finely determined. In this process, the same image data may be repeatedly read out and displayed. When changing the frame sequence number, the change is performed according to an instruction from the input operation unit 112.

The moving picture encoding means 115 reads the still picture image data of the corresponding still picture file storage number variable N from the picture data storage means 104 in accordance with the frame sequence number X, compresses and encodes the same, and generates a moving picture bit stream. The moving image bit stream recording means 116 generates the image compression encoded data as a constituent element and temporarily stores the image compression encoded data in a buffer area. , And is recorded as a moving image bit stream. However, a moving image bit stream may be recorded in the image data storage unit 104 in some cases.

For example, as shown in FIG.
It is assumed that five pieces of selected still image data A _{1 to} A ₂₅ of the small screen are displayed. Then, the image order determining means 114
Each of the selected still image data A _{1 to} A ₂₅ having a different still image file storage number variable N is assigned a discrete frame sequence number X, and the selected still image data is stored in the buffer area of the moving image bit stream recording means 116. Store it temporarily. Next, as shown in FIG. 2B, the selected still image data A _{1 to} A ₁₈ and the selected still image data B _{1 to} B ₇ are displayed on the small screen again, and the image order determining means 11 is displayed.
By 4, selected still image data A ₁₃ and so insert the selected still image data B ₁ .about.B ₇ between the A _14, selected still image data B ₁ .about.B ₇ to select the still picture image data A ₁₃
A still larger frame sequence number X, which is larger than the selected still image data A _14, is also temporarily stored in the buffer area of the moving image bit stream recording means 116. Further, as shown in FIG. 2C, the selected still image data A
₆ to A ₁₃ and the selection still image data B ₁ .about.B ₇ and selects still image data C ₁ -C ₅ and the selected still image data D ₁ ~
And D ₅ to display the child screen, the image order determining unit 114, selecting still image data A ₉ and inserts the selected still image data C ₁ -C ₅ between A ₁₀ and selected still image data B ₄ and B so as to insert the selected still image data D ₁ to D ₅ between _5, selected still image data C ₁ -C large selection still image than selection still image data a ₉ to ₅ image data a ₁₀ together give a small frame sequence numbers X than, with a small frame sequence numbers X than large selection still image data B ₅ than selecting still image data B ₄ in the selected still image data D ₁ to D _5, they Moving image bit stream recording means 11
6 is temporarily stored in the buffer area. And
For example, if the moving image bit stream 1000 is completed as described above, the moving image bit stream recording unit 116
Performs the process of completing the generation of the moving image bit stream. As a result, the moving image bit stream 1000
That is, the image data with the frame sequence number, which is a component of the above, is recorded in the moving image bit stream recording means 116 as shown in FIG. That is, the moving picture bit stream 1
000 components are arranged in the time axis direction. FIG. 4 shows the situation more clearly. The image data (still images) constituting the moving image bit stream 1000 are arranged in ascending order based on the frame order number X (the order of arrangement in the time axis direction). Note that, after this, any selected still image data can be inserted into the time counter where the frame sequence number is vacant. Note that the moving image bit stream may be recorded in the image data storage unit 104.

Next, the operation of the image information management recording apparatus according to the first embodiment configured as described above will be described with reference to the flowcharts of FIGS.

When the moving image bit stream generation mode is activated by an instruction from the input operation means 112, the operation from step S11 is started. In step S11, the control means 101 initializes a still image file storage number variable N and sets it to "1" (N ← 1). The operator accesses the image data storage unit 104 to read and display the image files stored in the image data storage unit 104, or the image data input unit 105, the video signal reception unit 106, the modem 107, the network The input operation means 112 instructs whether the image data from the connection means 108 is directly displayed on the display means 110 or not. In step S12, the control means 101 determines whether or not the mode is the file access mode. If the mode is the file access mode, the process proceeds to step S21 described later. If the mode is not the file access mode, the process proceeds to step S13 to determine whether the mode is the direct display mode. If not, the process returns to step S12. If the mode is the direct display mode, the process proceeds to step S14 to set the display control unit 111 to the direct display mode. When the operator views an image (moving image or still image) displayed on the screen of the display unit 110 and an image considered necessary is displayed, the operator inputs an instruction to freeze the display screen at that time. 1
Given by 12. In step S15, the display control means 111 determines whether or not to freeze the display screen. If not, the display control means 111 returns to step S14 to continue the direct display, but if so, proceeds to step S16 to freeze the display screen. Frame buffer means 1
09 is controlled. The operator looks at the frozen screen and determines whether or not to select it as image data to be filed. When selecting, the operator gives a selection instruction from the input operation means 112, and when not selecting, gives an instruction to continue. In step S17, the control means 101 determines whether or not to select the frozen image data. If not, the process proceeds to step S18, where the control means 101 gives a command to the display control means 111, and the display control means 111 The buffer unit 109 is controlled to restart the direct display of the input image, and the process returns to step S15. When the selection is made, the process proceeds to step S19, where the control means 101 gives a command to the image selection means 113, and the image selection means 113 transmits the frozen image data from the frame buffer means 109 as a file of the still image data to the image data storage means 1.
04 and stored. The operator selects and takes in the necessary still image data one after another in the direct display mode. When the user wants to end the direct display mode, an end instruction is given from the input operation means 112. In step S20, the control unit 101 determines whether or not to end the direct display mode. If not, the process proceeds to step S18, and the display control unit 111 controls the frame buffer unit 109 to control the input image as described above. The direct display is restarted, and the process returns to step S15. If it is determined in step S20 that the direct display mode is to be ended, the process returns to step S12.

If it is determined in step S12 that the file access mode has been designated, the flow advances to step S21 to set the display control means 111 to the file access mode. Control means 101 in step S22 drives the display control unit 111, the display control unit 111 still image corresponding to the accessed image data storage means 104 a still image file stored number variable N (such as A _1, B ₁₎ The data N (initial N = 1: initialized in step S11) is read out, and the frame buffer
Is displayed on the display means 110 via the. The operator looks at the displayed screen and determines whether to select as still image data of a component of the moving image bit stream,
When selecting, a selection instruction is given from the input operation means 112, and when not selecting, a non-selection instruction is given. In step S23, the control means 101 determines whether or not to select an image file of the currently displayed still image data, and if not, proceeds to step S24 to increment the still image file storage number variable N (N ← N +
1) Then, the process returns to step S22. This time, N = 2 still image data is displayed. If it is determined in step S23 that an image file of the displayed still image data is to be selected, the process proceeds to step S25, and the image selecting unit 1
Reference numeral 13 stores a still image file storage number variable N of the selected image file. In step S26, it is determined whether all the image files stored in the image data storage unit 104 have been read and displayed, and
If not, the process proceeds to step S24 to increment the still image file storage number variable N and then returns to step S22 to repeat the same operation.

If it is determined in step S26 that all the image files stored in the image data storage means 104 have been read out and displayed, the process proceeds to step S27.
To display the file names of all the still image file storage number variables N selected as still image data of the constituent elements of the moving image bit stream stored in the image selecting unit 113 on the display unit 110. . Here, the operator can instruct the input operation unit 112 to display a plurality of frames of the image data of the image file selected as a component of the moving image bit stream on the display unit 110 in the small screen. In step S28, the control means 101 determines whether or not an instruction to display a small screen has been issued.
34, but if there is, the process proceeds to step S29, where the control means 101 drives the display control means 111 to access the image data storage means 104 and controls the frame buffer means 109 to select 5 × 5 = 25. The displayed image data is displayed in a small screen on the display unit 110. Note that the number of sub-screen divisions is arbitrary, and even if 4 × 4 = 16, 3
× 3 = 9 or other values. Further, it is preferable to switch as needed. When the operator no longer needs to display the sub-screen, the input operation means 11
2 releases the mode. The operator looks at the small screen display and considers which image file is to be arranged at which position in the moving image bit stream. Then, a frame sequence number is assigned to each image file by the input operation means 112. Those that are not required do not have a frame sequence number. In step S30, it is determined whether or not the sub-screen display mode has been stopped or ended. If not, the process proceeds to step S31, where the still image file storage number variable N of the image file selected as a component of the moving image bit stream is determined. It is determined whether to add the frame sequence number X. If not, the flow advances to step S33 to increment the selected 5 × 5 = 25 selected still image data to the small-screen display state, and then returns to step S29. In the increment of the small-screen display in step S33, the still image file storage number variable N of the 25 still image data currently displayed is deleted, and the next next still image file is replaced with the next one. It may be an increment that is added to. When the frame order number X is assigned to the still image file storage number variable N of the selected still image data, the process proceeds to step S32, where the control means 101 activates the image order determining means 114, and the image order determining means 114 A frame sequence number X is assigned to correspond to the still image file storage number variable N, and the corresponding relationship is stored. This is because when it is difficult to assign the frame sequence number X only with the file name of the selected still image data, the sub-screen display of the selected still image data is performed and the frame order number X is assigned while visually confirming the still image. This is the case.

Here, the correspondence with FIG. 2 will be described.
Still image file storage number variable N is A _{1 to} A ₂₅ , B _{1 to} B
₇ is a _{C 1 ~C 5, D 1 ~D} 5 etc., 1000 Toka 1100 frame sequence number X is assigned to each
It is the numerical value of. After step S32, step S3
Proceeding to 3, the small-screen display is incremented, and the process returns to step S29.

When the operator stops the small-screen display mode, and when the increment for the small-screen display is completed for all the selected still image data, step S3 is performed.
If the determination of 0 is YES, the process proceeds to step S27, and returns to a state in which the file names of all the selected still image file storage number variables N stored in the image selection unit 113 are displayed on the display unit 110. . If the determination in step S28 is NO, step S
Proceed to 34. The operator looks at the file name of the displayed selected still image data, considers which image file is to be allocated to which position in the moving image bit stream, and assigns a frame sequence number to each image file by the input operation means 112. Go. Those that are not required do not have a frame sequence number. That is, in step S34, the image order determination unit 114 assigns the frame order number X in correspondence with the still image file storage number variable N, and stores the correspondence (see FIG. 2). This is a case where the frame order number X is added by looking at only the file name without displaying the selected still image data in the small screen.

In step S35, it is determined whether or not the work of assigning frame sequence numbers has been completed. If not, the process returns to step S28. The operator can end the operation at any time by operating the input operation means 112. Then, the process proceeds to step S36. When the operation of assigning the frame sequence numbers to the image files of all the selected still image data is completed, the process automatically proceeds to step S36.

In step S36, the control means 101 activates the picture order determining means 114, the moving picture coding means 115, and the moving picture bit stream recording means 116, and in step S37, the picture order determining means 114 stores the still picture recorded therein. Image data storage means 104 according to the frame sequence number X corresponding to the image file storage number variable N
, The still image data of the corresponding still image file storage number variable N is read and transferred to the moving image encoding unit 115. In step S38, the moving image encoding unit 115 compresses the read image data in accordance with MPEG or the like. After encoding, the image compression encoded data is temporarily stored in a buffer area of the hard disk. In this case, a dedicated hard disk may be used, or the image data storage unit 104 may be used as the hard disk. Further, a semiconductor memory may be used instead of the hard disk.

In the next step S39, it is determined whether or not there is uncompressed encoded data of the next frame sequence number X. If there is, the flow advances to step S40 to set the next frame sequence number X, and step S37 is performed. Return to Hereinafter, in the same manner, the selected still image data of the still image file storage number variable N read out according to the order of the frame order number X corresponding to each still image file storage number variable N is compression-encoded, and the image compression encoding is performed. The temporary storage of data in the buffer area of the hard disk or semiconductor memory is repeated. If it is determined in step S39 that the next frame sequence number X is no longer present, the process proceeds to step S41, in which the moving image bit stream recording unit 116 transmits all the image compression codes temporarily stored in the buffer area of the hard disk or semiconductor memory. The encoded data is read out in the order of the frame order number X and stored in a hard disk or a semiconductor memory as a moving image bit stream with the frame order number X. When the storage is completed, all the operations are ended. As described above, the image file selected as a component of the moving image bit stream is generated as the moving image bit stream 1000 as shown in FIGS.
This means that the moving image bit stream recording means 116 has recorded. Note that the insertion of another selected still image data into the selected still image data shown in FIGS. 2A to 2C to FIG. 3 is performed from step S27 to step S35.
It is executed over.

As described above, the recording apparatus for managing image information according to the first embodiment has the following effects.
A plurality of still image data scattered in the image data storage means 104 (still image in a broad sense including each frame that is a component of a moving image: this definition shall be consistent throughout the present specification. ) Can be arbitrarily selected, collected as one moving image bit stream 1000 arranged in an arbitrary order on the basis of the time axis, and the collected moving image bit stream 1000 can be recorded. In particular, when a still image as a component of a moving image bit stream is selected, a candidate still image can be displayed on the display unit 110 and selected by the operator while visually confirming it. It is possible to efficiently generate a moving image bit stream without waste and error. By definition of a still image, the moving image bit stream may include a plurality of scenes in one moving image or a plurality of moving images. The still image data stored in the image data storage unit 104 includes data obtained from various storage media and data obtained from various broadcast media and communication media. It is also possible to collectively record, as a still image, a home page and a linked related page at the time of browsing the Internet as a still image. Alternatively, the image data storage unit 104 in which specific still image data is exclusively stored from the beginning may be used. Further, since the still image data is compression-encoded, the storage capacity for storing the moving image bit stream may be relatively small. Then, if the operator selects an arbitrary still image and records a moving image bit stream generated by appropriately arranging it along the time axis direction, the image information management reproduction device described later searches for the moving image bit stream. In this case, browsing (viewing and panning) becomes possible at both low and high speeds. The compression encoding method is not limited, but if an existing compression encoding method such as MPEG or DV is adopted, an existing hardware decoder or software decoder can be used for reproduction. A frame sequence number may be assigned in accordance with the order of image data appearing in an HTML file obtained via the network connection unit 108, and may be combined as an MPEG moving image bit stream. Combining a plurality of image data into one moving image bit stream facilitates exchange of image data on a network. Further, the current e-mail is a simple one consisting of only a text file. However, if an e-mail system is configured using image files, it becomes possible to exchange expressive e-mail. At this time, it is necessary to send the image data at the same time. However, by collecting the data as an MPEG moving image bit stream, the capacity of the file to be transmitted can be reduced.

In the image information management recording apparatus according to the first embodiment, the dedicated moving image bit stream recording means 116 is provided as a recording destination of the generated moving image bit stream 1000. The stream recording means 116 may also serve as the image data storage means 104.

[Embodiment 2] Embodiment 2 is the first embodiment.
It corresponds to. Embodiment 2 is Embodiment 1
The difference from this is that all the still image data stored in the image data storage unit is used as a component of the moving image bit stream without artificial selection of the still image data.

FIG. 9 is a block diagram showing a configuration of an image information management recording apparatus according to the second embodiment. In FIG. 9, reference numerals 101 to 105 and 112 to 117 are the same as those in FIG. 1 (Embodiment 1).
Briefly, 101 is control means, 102 is program storage means, 103 is working memory means, 104
Is image data storage means, 105 is image data input means,
112 is input operation means, 113 is image selection means, 114
Is an image order determining means, 115 is a moving picture coding means, 11
Reference numeral 6 denotes a moving image bit stream recording unit, and 117 denotes a bus. The image data input means 105 includes a magnetic disk, a magneto-optical disk, a hard disk, a magnetic tape, a CD-I
Image data is input from a playback device (drive) for storage media such as a video CD, a photo CD, a CD-ROM, a laser disk, a DVD, and a CD-R, and is transferred to the image data storage unit 104. The image data storage unit 104 stores the transferred image data. The image selection unit 113 is configured to read out all the still image data from the image data storage unit 104 in the order of the still image file storage number variable N and to assign a continuous frame sequence number X to each of them. Note that the image data input unit 105 may be omitted in some cases. that is,
The image data storage means 104 is of a detachable and replaceable type, and the image data storage means 10 to which specific image data is inputted externally.
4 is connected to the bus 117. In the case of the first embodiment (FIG. 1), the video signal receiving means 106, the PC communication modem 107, the network connecting means 108,
The frame buffer unit 109, the display unit 110, and the display control unit 111 are not necessarily required. However, the image signal receiving means 106, the modem 107 for personal computer communication, and the network connection means 108 may be added and the image data may be taken into the image data storage means 104.

Next, the operation of the recording apparatus for image information management according to the second embodiment configured as described above will be described with reference to the flowchart of FIG.

When the moving image bit stream generation mode is activated by an instruction from the input operation means 112, the operation from step S51 is started. In step S51, the control means 101 initializes a still image file storage number variable N and a frame sequence number X and sets them to "1" (N ← 1, X ← 1). In step S52, the control unit 101 activates the image selection unit 113, the image order determination unit 114, the moving image encoding unit 115, and the moving image bit stream recording unit 116, and in step S53, the control unit 101 stores the image data Access is made to read out still image data N (at first, N = 1: initialized in step S51) corresponding to the still image file storage number variable N. In step S54, the image selecting means 113 reads out the read still image data. Is selected as the still image data of the component of the moving image bit stream, and in step S55, the image order determining unit 114 associates the frame order number X (X = 1 at first, Is specifically 1001) and stores the correspondence That. In step S56, the image order determining unit 114 transfers the read still image data to the moving image encoding unit 115, and in step S57, the moving image encoding unit 11
Reference numeral 5 denotes compression encoding of the read image data in accordance with MPEG or the like, and temporarily stores the image compression encoded data in a buffer area of a hard disk. In this case, a dedicated hard disk may be used, or the image data storage unit 104 may be used as the hard disk. Further, a semiconductor memory may be used instead of the hard disk.

In the next step S58, it is determined whether or not the processing has been completed for all the image files stored in the image data storage means 104, and if not, the flow proceeds to step S59 where the control means 101 stops. The image file storage number variable N and the frame sequence number X are respectively incremented (N ← N + 1, X ← X + 1),
Returning to step S53, similarly, the selected still image data is compression-encoded while generating the still image file storage number variable N with the frame sequence number X in ascending order to generate image compression encoded data. The temporary storage of the image compression encoded data in the buffer area of the hard disk or semiconductor memory is repeated. When the processing for all the image files stored in the determination in step S58 is completed, the process proceeds to step S60, where the moving image bitstream recording unit 116 stores all the image files temporarily stored in the buffer area of the hard disk or semiconductor memory. Are read out in the order of the frame order number X and stored in a hard disk or a semiconductor memory as a moving image bit stream with the frame order number X. When the storage is completed, all the operations are ended. As described above, all the image files selected as the components of the moving image bit stream are generated as the moving image bit stream 1000 as shown in FIGS. 11 and 12, and are recorded in the moving image bit stream recording unit 116. .

All the still image data stored in the image data storage means 104 are stored in the order of the still image file storage number variable N (A ₁ , A ₂ ... A ₄₁ , A
₄₂ …), and the continuous frame sequence number X
(1001, 1002,..., 1042, 1043,.

As described above, the recording apparatus for managing image information according to the second embodiment has the following effects.
All the still images scattered in the image data storage unit 104 (still images in a broad sense including each frame that is a component of the moving image) are stored in the order of the frame order number X, and thus the still image file storage number variable N One moving image bit stream 1000 is selected in order and arranged as one moving image bit stream 1000 arranged in the order of the frame order number X (still image file storage number variable N) based on the time axis, and the collected moving image bit stream 1000 is recorded. Can be kept. By definition of a still image, the moving image bit stream may include a plurality of scenes in one moving image or a plurality of moving images. Further, since the still image data is compression-encoded, the storage capacity for storing the moving image bit stream may be relatively small. Then, if all the still images stored in the image data storage unit 104 are selected and a moving image bit stream generated by sequentially arranging them in the time axis direction is recorded, an image as described later can be obtained. Browsing can be performed at a low speed or a high speed when searching by the information management reproducing device. Although the compression encoding method is not limited, if an existing compression encoding method such as MPEG or DV is adopted, an existing decoder can be used for reproduction.

In the recording apparatus for image information management according to the second embodiment, the dedicated moving image bit stream recording means 116 is provided as a recording destination of the generated moving image bit stream 1000. The stream recording means 116 may also serve as the image data storage means 104.

The feature of the second embodiment is that the display means 110 is not necessarily required.

[Embodiment 3] Embodiment 3 is a third embodiment.
It corresponds to. The feature of the third embodiment is that the selected still image data is encoded after performing the pixel thinning process on the selected still image data.

FIG. 13 is a block diagram showing the configuration of an image information management recording apparatus according to the third embodiment. In FIG. 13, reference numerals 101 to 117 are the same as those in FIG. 1 (Embodiment 1).
1 is control means, 102 is program storage means, 103 is working memory means, 104 is image data storage means,
105 is an image data input unit, 106 is a video signal receiving unit, 107 is a modem, 108 is a network connection unit,
109 is a frame buffer means, 110 is a display means, 1
11 is a display control unit, 112 is an input operation unit, 113 is an image selection unit, 114 is an image order determination unit, 115 is a moving image encoding unit, 116 is a moving image bit stream recording unit, and 117 is a bus. Before the still image data of the still image file storage number variable N having the selected and assigned frame sequence number X is read out from the image data storage unit 104 and passed to the moving image encoding unit 115, the numeral 118 is This is a pixel thinning unit that performs a pixel thinning process on the read still image data.

The operation of the image information management recording apparatus according to the third embodiment is basically the same as the flow charts shown in FIGS. 5 to 8 in the first embodiment, but steps S36 to S38. Are different. The different parts will be described with reference to the partial flowchart of FIG.

At step S36a following step S35 shown in FIG. 8, the image order determining means 114, the moving picture coding means 115, and the moving picture bit stream recording means 116
Then, the pixel thinning means 118 is activated. Then, in the next step S37a, the image order determination means 114 reads out the corresponding still image data from the image data storage means 104 according to the frame order number X corresponding to the still image file storage number variable N recorded therein, and thins out the pixels. To the means 118. In step S37b, the pixel thinning means 118 performs pixel thinning processing on the read still image data, and transfers the data to the moving image encoding means 115. For example, 640 × 480 pixels are calculated as 1 /
4 to 320 × 240 pixels, which are transferred to the moving picture coding means 115. In the pixel thinning process, a filter for the thinning process is used. Next, in step S38a, the moving image encoding unit 115 compresses and encodes the read still image data after the pixel thinning processing in accordance with MPEG or the like, and temporarily stores the image compression encoded data in the buffer area of the hard disk. To be stored. In this case, a dedicated hard disk may be used, or the image data storage unit 104 may be used as the hard disk. Further, a semiconductor memory may be used instead of the hard disk. Next, step S3 is performed in the same manner as in the first embodiment (FIG. 8).
9 to step S40 or step S41.

The technique of the third embodiment may be applied to the second embodiment. Regarding the operation at that time, steps S56 and S57 in FIG. 10 are replaced with steps S37a and S37 in FIG.
37b and S38a.

According to the recording apparatus for image information management according to the third embodiment, in the compression encoding by the moving image encoding means 115, the target still image data is subjected to the pixel thinning process in advance. The encoding process can be performed at high speed. In addition, it is possible to reduce the capacity of storing the moving image bit stream with the frame sequence number X in the hard disk or the semiconductor memory in step S41 of FIG. 14 or step S60 of FIG.
Further, as other effects, the same effects as in the first embodiment are exhibited.

[Fourth Embodiment] The fourth embodiment is the fourth embodiment.
It corresponds to. A feature of the fourth embodiment is that a moving image bit stream is generated in a state where a plurality of selected still image data are combined as one frame of a multi-screen.

FIG. 15 is a block diagram showing the configuration of a recording device for image information management according to the fourth embodiment. In FIG. 15, reference numerals 101 to 118 are the same as those in FIG. 13 (Embodiment 3).
01 is control means, 102 is program storage means, 103
Is working memory means, 104 is image data storage means, 105 is image data input means, 106 is video signal receiving means, 107 is modem, 108 is network connection means, 109 is frame buffer means, 110 is display means, and 111 is display. Control means 112; input operation means 1;
13 is an image selecting means, 114 is an image order determining means, 11
Reference numeral 5 denotes a moving image encoding unit, 116 denotes a moving image bit stream recording unit, 117 denotes a bus, and 118 denotes a pixel thinning unit that performs a pixel thinning process on still image data read from the image data storage unit 104. Reference numeral 119 denotes a plurality of still image data obtained by performing pixel thinning processing on still image data having a size corresponding to a full screen of the display unit 110 or a plurality of still image data smaller than the full screen from the beginning. This is a multi-screen image data generating unit that combines still image data and combines them into one frame of a multi-screen.

The operation of the recording apparatus for managing image information according to the fourth embodiment is basically the same as the flow charts shown in FIGS. Are different. The different parts will be described with reference to the partial flowcharts of FIGS.

In step S36b following step S35 shown in FIG. 8, the control means 101
14, the moving picture encoding means 115, the moving picture bit stream recording means 116, the pixel thinning means 118, and the multi-screen image data generating means 119 are started. Then, in the next step S37c, the image order determining means 114 determines the number m in height and the width n in accordance with the order of the frame order number X corresponding to the still image file storage number variable N recorded therein.
The total m × n still image data is read from the image data storage unit 104. FIG. 18 shows the read mx
An example of n still image data is shown. In the illustrated example, m
= 2, n = 3, and 2 × 3. Even if the frame order numbers X are skipped, they are in ascending order, and the subsequent ones are always continuous in the sense that they are always larger than the previous one. In step S37d, it is determined whether or not there is still image data requiring pixel thinning processing. If the pixel thinning process is not required, the process proceeds to step S37g. If the pixel thinning process is required, the process proceeds to step S37e, and the still image data requiring the process is transferred to the pixel thinning unit 118. In step S37f, the pixel thinning means 118 executes the pixel thinning processing on the read still image data requiring the thinning processing, and returns to step S37d. yet,
If there is still image data requiring thinning processing, the same operation is repeated. However, if there is no still image data requiring thinning processing, the process proceeds to step S37g, and the image order determination unit 114 determines that m × n still images The image data is transferred to the multi-screen image data generator 119. Step S3
At 7h, the multi-screen image data generating unit 119 sets m
× n pieces of still image data are combined into one frame of still image data, and the combined multi-screen still image data is transferred to the moving image encoding unit 115. Next, in step S38b, the moving image encoding unit 115
Converts the read multi-screen still image data to MPEG
Compression encoding in accordance with the above, and temporarily stores the image compression encoded data in a buffer area of the hard disk. In this case, a dedicated hard disk may be used, or the image data storage unit 104 may be used as the hard disk. Further, a semiconductor memory may be used instead of the hard disk. In the next step S39, it is determined whether or not there is uncompressed coded data of the next frame sequence number X, and if so, the flow proceeds to step S40a to proceed to the next m
The frame order number X corresponding to the xn still image data is set, and the process returns to step S37c. Hereinafter, similarly, the process of synthesizing m × n pieces of still image data of one frame of multi-screen still image data is repeated. If the next frame sequence number X is no longer present in the determination in step S39, the process proceeds to step S41a, where the moving image bit stream recording unit 116 executes all image compression codes temporarily stored in the buffer area of the hard disk or semiconductor memory. The encoded data is read out in the order of the frame order number Y of the multi-screen and stored in a hard disk or a semiconductor memory as a moving image bit stream with the frame order number Y. When the storage is completed, all the operations are ended. As described above, the multi-screen image file selected as a component of the moving image bit stream is generated as the moving image bit stream 1000 as shown in FIGS. 19 and 20, and recorded in the moving image bit stream recording unit 116. Become. Where H ₁ , H
Reference numeral ₂ denotes a file storage number variable of still image data in which m × n pieces are combined into one frame, and each frame is newly assigned a frame order number Y of a multi-screen. Each still image file storage number variable H is m
It has × n original frame sequence numbers X. Note that the moving image bit stream may be recorded in the image data storage unit 104.

Incidentally, the values of m and n of m × n are arbitrary. Further, values of m and n may be set by the input operation means 112.

The technique of the fourth embodiment may be applied to the second embodiment. Regarding the operation at that time, steps S56 to S60 in FIG. 10 may be replaced with the flows in FIGS.

According to the recording device for image information management according to the fourth embodiment, the moving image bit stream 1000 is generated in the form of multi-screen still image data in which a plurality of still image data are combined into one frame. can do. Image data obtained from a communication medium such as personal computer communication or the Internet may not always be full screen image data for the screen of the display unit 110. In such a case, a plurality of still image data can be handled collectively for one frame.
The same applies to image data obtained by the image data input means 105. In the case of image data of a full screen with respect to the screen of the display means 110, since the image data itself is one frame, the image data is transferred to the pixel thinning means 118 to perform pixel thinning processing, and then a plurality of still images It will be combined with the image data.

A moving image bit stream generated in such a manner that a plurality of still image data are combined into one frame is browsed (viewed) at a high speed or a low speed by an image information managing / reproducing apparatus described later. Sometimes, the number of still images that can be browsed at a time increases, so that the image search efficiency improves. When the pixel thinning processing is performed, it is possible to contribute to a reduction in storage capacity.

Further, as other effects, the same effects as in the case of the first embodiment are exhibited.

[Fifth Embodiment] A fifth embodiment is a fifth embodiment.
It corresponds to. The feature of the fifth embodiment resides in that inter-moving image compression encoding is performed when the difference between the pixel values of adjacent selected still image data is equal to or smaller than a predetermined value.

FIG. 21 is a block diagram showing a configuration of a recording device for image information management according to the fifth embodiment. In FIG. 21, reference numerals 101 to 114 and 116 and 117 are the same as those in FIG. 1 (Embodiment 1). , 104 are image data storage means, 105 is image data input means, 106
Is a video signal receiving means, 107 is a modem, 108 is a network connection means, 109 is a frame buffer means, 11
0 is display means, 111 is display control means, 112 is input operation means, 113 is image selection means, 114 is image order determination means, 116 is moving image bit stream recording means, 11
7 is a bus. Reference numeral 115a denotes an intra-moving image encoding unit, 115b denotes an inter-moving image encoding unit, 12
0 is an inter-screen difference generation means for generating an inter-screen difference Δα between adjacent selected still image data read out from the image data storage means 104, and 121 is a difference between the generated inter-screen difference Δα and a predetermined value α _0. The screen difference evaluation means 122 to be compared selects the intra-moving picture compression coding when Δα> α ₀ as a result of the evaluation, and the screen selects the moving picture inter-picture compression coding when Δα ≦ α ₀ as a result of the evaluation. This is an inside / between-screen selection means. Note that, in the case of MPEG, intra-frame compression encoding and inter-frame compression encoding referred to in this specification are intra-frame compression encoding and inter-frame compression encoding referred to in the standard.

The operation of the recording apparatus for image information management according to the fifth embodiment is basically the same as the flow charts shown in FIGS.
S35 is the same, but differs from the step following step S35. The different parts will be described with reference to the partial flowchart of FIG.

In step S71 subsequent to step S35 shown in FIG. 8, the image order determining means 114 sends the adjacent Xs from the image data storage means 104 in accordance with the stored frame number X corresponding to the still image file storage number variable N. And X + 1 are read out and transferred to the inter-screen difference generating means 120. In step S72, the control means 101 sets the
20 and activates two adjacent cells according to the frame sequence number X.
An inter-screen difference Δα between the two selected still image data is generated. In step S73, the control means 101 activates the inter-screen difference evaluation means 121 and sets the inter-screen difference Δα to a predetermined value α.
Compare with ₀ . When the inter-screen difference Δα is equal to or smaller than the predetermined value α ₀ (Δα ≦ α ₀ ) in step S74, high data compression can be expected, so the flow advances to step S75, and the intra-screen / inter-screen selecting unit 122 selects inter-frame compression encoding. I do. Then, in step S76, the control means 101 activates the moving picture inter-picture coding means 115b, and the adjacent X
And X + 1 of the two selected still image data, the latter still image data is subjected to inter-screen compression encoding in accordance with MPEG or the like, and the image compression encoded data is temporarily stored in a buffer area of a hard disk or a semiconductor memory. , Step S
Go to 79. If the inter-screen difference Δα is larger than the predetermined value α ₀ (Δα> α ₀ ) in the determination in step S74, too high data compression cannot be expected. Select inner compression encoding. Then, in step S78, the control means 101 activates the intra-moving image encoding means 115a, and converts the latter still image data of the two selected still image data of adjacent X and X + 1 into a screen in accordance with MPEG or the like. Internal compression encoding and image compression encoded data are temporarily stored in a buffer area of a hard disk or a semiconductor memory, and the process proceeds to step S79. In the next step S79, it is determined whether or not there is uncompressed encoded data of the next frame sequence number X, and if there is, the process proceeds to step S80, where the next frame sequence number X is set, and step S71 is performed.
Return to Hereinafter, similarly, the inter-screen difference Δα between two adjacent selected still image data read out according to the order of the frame order number X corresponding to each still image file storage number variable N is calculated, and the inter-screen difference Δα is determined by a predetermined value. Depending on whether the value is equal to or less than α ₀ or greater than a predetermined value α ₀ , compression coding between screens or compression coding within screens is selected and compression coding is performed, and the image compression coding data is transferred to a buffer area of a hard disk or semiconductor memory. The temporary storage of is repeated. If it is determined in step S79 that the next frame sequence number X is no longer present, the process proceeds to step S81, where the moving image bit stream recording unit 116 transmits all the image compression codes temporarily stored in the buffer area of the hard disk or semiconductor memory. The encoded data is read out in the order of the frame sequence number X and stored in a hard disk or a semiconductor memory as a moving image bit stream with the frame sequence number X. When the storage is completed, all the operations are terminated.
As described above, a moving image bit stream composed of the image file selected as a component of the moving image bit stream and possibly having inter-picture compression encoding is generated and recorded in the moving image bit stream recording unit 116. It will be. Note that the moving image bit stream may be recorded in the image data storage unit 104.

The technique of the fifth embodiment may be applied to the second embodiment. Regarding the operation at that time, steps S56 to S60 in FIG. 10 may be replaced as in the flow in FIG.

As described above, according to the recording apparatus for image information management according to the fifth embodiment, the inter-screen difference Δα between two adjacent selected still image data read out in accordance with the order of the frame order number X. Is smaller than or equal to the predetermined value α ₀ , high data compression is performed by performing inter-picture compression encoding, so that the capacity for recording in the moving picture bit stream recording means 116 can be reduced.

Further, as other effects, the same effects as in the case of the first embodiment are exhibited.

[Embodiment 6] Embodiment 6 is the sixth embodiment.
It corresponds to. A feature of the sixth embodiment is that a moving image / audio bit stream in which audio data for search assistance is added to selected still image data for each frame is recorded.

FIG. 23 is a block diagram showing a configuration of a recording device for image information management according to the sixth embodiment. 23, reference numerals 101 to 115 and 117 refer to FIG.
The configuration is the same as that of the first embodiment. Briefly, 101 is a control unit, 102 is a program storage unit,
103 is working memory means, 104 is image data storage means, 105 is image data input means, 106 is video signal receiving means, 107 is modem, 108 is network connection means, 109 is frame buffer means, 110 is display means, 111 is display means Display control means, 112 is input operation means,
113 is an image selecting means, 114 is an image order determining means, 1
Reference numeral 15 denotes a moving image encoding unit, and 117 denotes a bus. Reference numeral 123 denotes audio data input means, 124 denotes audio encoding means, 125 denotes image / audio multiplexing means, and 116a
Denotes moving image / audio bit stream recording means. The voice data input means 123 is, for example, a human voice or any sound or voice data input from a microphone, or C
Audio data such as music when a D player or the like is reproduced is input, and at the stage of output, it is digital audio data. The audio encoding unit 124 samples the audio data read from the audio data input unit 123, adds the same frame sequence number X in accordance with the frame sequence number X of the selected still image data, and complies with MPEG or the like. Compression encoding is performed to generate audio compression encoded data, which is stored in a buffer area. The image / audio multiplexing unit 125 reads out the image compression / encoding data of the frame order number X and the audio compression / encoding data of the same frame order number X from the buffer area, and multiplexes both the compression / encoding data to obtain an image / audio This is to generate multiplexed data and temporarily store it in a buffer area. Moving image / audio bit stream recording means 1
16a reads out the image / audio multiplexed data temporarily stored in the buffer area in the order of the frame order number X and stores it on a hard disk or a semiconductor memory as a moving image / audio bit stream with the frame order number X. is there. The audio data input from the audio data input unit 123 is, for example, music that is associated with “mountain” reproduced by a CD player when the selected still image data represents “mountain scenery”. It may be a song that matches the mood, a song of a genre appropriately determined by the operator, or a message such as “Mountain” in the voice of the operator.

The operation of the recording apparatus for managing image information according to the sixth embodiment is basically the same as the flow charts shown in FIGS.
S35 is the same, but differs from the step following step S35. Further, a step of voice data processing to be performed in parallel is required. The different parts will be described with reference to the partial flowchart of FIG.

In step S91 subsequent to step S35 shown in FIG. 8, the image order determination means 114 selects the corresponding still image from the image data storage means 104 in accordance with the stored frame number X corresponding to the still image file storage number variable N. The image data is read out and the moving image encoding means 1 is read out.
Transfer to 15. In step S92, the moving picture coding unit 115 compresses and codes the read still picture image data of the frame sequence number X in accordance with MPEG or the like to generate compressed image data, and temporarily stores the compressed data in the buffer area. I do.

On the other hand, there is voice data processing as parallel processing. In step S100, the voice coding means 124
Samples the audio data for search assistance read from the audio data input means 123, and in step S101, the audio encoding means 124 adds the current frame sequence number X to the sampled audio data, and
In accordance with G or the like, compression encoding is performed to generate audio compression encoding data, and this is temporarily stored in a buffer area.

As a buffer area used for temporarily storing image compression encoded data and audio compression encoded data, a dedicated hard disk or a dedicated semiconductor memory may be used. Further, an empty area of the image data storage unit 104 may be used.

In step S93, the image / audio multiplexing means 125 synchronously reads out the image compression encoded data of the frame order number X and the audio compression encoded data for search assistance of the same frame order number X from the buffer area. Then, the two data are multiplexed to generate multiplexed image / audio data, and the multiplexed data is temporarily stored in the buffer area.

In the next step S94, it is determined whether or not there is uncompressed coded data of the next frame sequence number X. Set to move to the next audio data sampling for the data,
On the one hand, it returns to step S91, on the other hand, step S1
Return to 00.

Thereafter, similarly, while updating the frame sequence number X, generation of image compression coded data from the selected still image data and generation of audio compression coded data for search assistance from sampling voice data are performed. And multiplexing of the image compression encoded data and the audio compression encoded data of the same frame sequence number X to generate multiplexed image / audio data and transfer the multiplexed image / audio data to a buffer area of a hard disk or a semiconductor memory. The temporary storage of is repeated. If it is determined in step S94 that the next frame sequence number X is no longer present, the flow advances to step S110 to move to the moving image / audio bit stream recording unit 116a.
Reads all image / audio multiplexed data temporarily stored in the buffer area of the hard disk or the semiconductor memory in the order of the frame order number X, and reads the moving image / frame with the frame order number X on the hard disk or the semiconductor memory.
The data is stored as an audio bit stream, and when the storage is completed, all operations are completed. As described above, an image file with audio data selected as a component of the moving image / audio bit stream is generated as a moving image / audio bit stream 1000a as shown in FIG. 25, and recorded in the moving image / audio bit stream recording unit 116a. It was done. The moving image / audio bit stream may be recorded in the image data storage unit 104.

FIG. 25 corresponds to a case where the audio data for search assistance is added in units of one frame to the moving image bit stream 1000 of FIG. 4 in the first embodiment. For example, sound 1 is added corresponding to still image 1 of one frame, sound 2 is added corresponding to still image 2 of one frame, and sound 20 is added corresponding to still image 20 of one frame. Is added.

The technique of the sixth embodiment may be applied to the second embodiment. Regarding the operation at that time, steps S56 to S60 in FIG. 10 may be replaced as in the flow in FIG. In this case, step S95 may be a simple increment of the frame sequence number X (X ← X +
1).

From the above, according to the recording apparatus for image information management according to the sixth embodiment, the moving image / moving image in which the audio data for search assistance is added to the selected still image data for each frame. The audio bit stream 1000a can be recorded. If such a moving image / sound bit stream is recorded, the sound is played back at the same time when an image is searched for by an image information management playback device as described later. It can be used as auxiliary voice. For example, when a music reminiscent of "mountain" is heard during a high-speed search, or a message sounding "mountain" is heard, the operator hears the search aid sound and slows down the image playback speed. It can be conveniently used for down and stop.

As other effects, the same effects as in the first embodiment can be obtained.

[Embodiment 7] Embodiment 7 is the seventh embodiment.
To claim 9. A feature of the seventh embodiment is that a large number of still images are classified according to predetermined requirements and then compression-encoded.

FIG. 26 is a block diagram showing a configuration of a recording device for image information management according to the seventh embodiment. 26, reference numerals 101 to 117 are the same as those in FIG. 1 (Embodiment 1).
1 is control means, 102 is program storage means, 103 is working memory means, 104 is image data storage means,
105 is an image data input unit, 106 is a video signal receiving unit, 107 is a modem, 108 is a network connection unit,
109 is a frame buffer means, 110 is a display means, 1
11 is a display control unit, 112 is an input operation unit, 113 is an image selection unit, 114 is an image order determination unit, 115 is a moving image encoding unit, 116 is a moving image bit stream recording unit, and 117 is a bus. Reference numeral 126 denotes an image classification unit. The image classification unit 126 assigns the frame order number X to the still image data
Still images are classified according to predetermined requirements (for example, image type and operator preference), a classification number is assigned to the still image data, and the classification of each classification number is performed in cooperation with the image order determination unit 114. Is used to assign an in-class order number.

For example, as shown in FIG. 27, A ₁ , A _{2
..., B 1, B 2 ...} , C 1, C 2 ..., D 1, D 2 ..., E
_1, E ₂ ..., be plural kinds series of image files as F _1, F ₂ ......, these image data storage means 10
4 is stored. Then, individual still image data of these image files are classified according to predetermined requirements. For example, scenery, drama scenes, music performance or singing scenes, images of actors and singers,
Classify as painting or other. And, as the classification numbers 900a, respectively, the classification identifiers γ1, γ2, γ3, γ4,
Add γ5 ... Further, for each still image data, each classification identifier γ1, γ2, γ3, γ4, γ5.
The order number 900b in the classification is assigned to each of them.
The classification identifier γ1 has a higher priority than the classification identifier γ2, the classification identifier γ2 has a higher priority than the classification identifier γ3, and so on, in the same manner, the priority is γ1>γ2> γ3
>Γ4>γ5>. More specifically, the selected still image data A ₁ , A ₂ , A _3, ... Are each assigned a classification identifier γ2 as a classification number 900a, and then 400, 4 as an in-class sequence number 900b.
10, 420... The order numbers in the classification are assigned to the selected still image data A ₁ , A ₂ , A ₃ .
This is because it is predicted in advance that there is selected still image data to be brought before the selected still image data C.
_The same classification identifier γ2 is assigned to ₁ , C ₂ , C ₃ .
.. Are assigned the same classification identifier γ2 to the selected still image data D ₅₁ , D ₅₂ , D ₅₃ .
. Are assigned the same classification identifier γ2 to the selected still image data F ₁ , F ₂ , F ₃ ..., But are assigned 300, 310, and 320 as the sequence numbers within the classification. As the following, the same classification identifier γ2 is assigned to the selected still image data E ₁₀ , E ₁₁ , E ₁₂ ..., But 500, 510, 520. When the classification identifier 900a is assigned a classification identifier γ1, the selected still image data A ₁₁ , A ₁₂ , A ₁₃ ... Are assigned the same classification identifier γ for the selected still image data E ₄₄ , E ₄₅ , E ₄₆ .
1, but 100, 110,
120, the selected still image data B ₃₃ ,
B _34, the B ₃₅ ... given the same classification identifier γ1 but has with the 300, 310, 320 as a classification in order number, selected still image data _{B 1, B 2, B 3} ... same classification identifier to γ1, but 40
0, 410, 420 are attached.

As described above, for each still picture file of each still picture file storage number variable N (A ₁ , B _1, etc.), classification identifiers γ1, γ2, γ3, γ4 as classification numbers 900a are set as frame order numbers X. , Γ5... And the in-class order number 900b, but the addresses in the image data storage unit 104 remain unchanged.

When reading out the selected still image data to which the classification identifier γi (i = 1, 2,...) And the intra-class sequence number are attached for compression encoding, the one with the smaller classification identifier γi has priority, and In the case of the same classification identifier, the one with the smaller order number within the classification is given priority. In this manner, the moving image bit stream 1000 in which the selected still image data is arranged for each classification type as shown in FIGS. Will be.

The operation of the image information management recording apparatus according to the seventh embodiment is basically the same as the flow charts shown in FIGS. 5 to 8 in the case of the first embodiment. different. The different parts are shown in FIGS.
A description will be given according to the partial flowchart of FIG. For convenience of explanation, step S27 is shown, and the next step after step S27 is referred to as step S201.

At step S27, the image selecting means 11
The display means 110 displays the file names of all the still image file storage number variables N selected as still image data of the constituent elements of the moving image bit stream stored in 3. Here, the operator can instruct the input operation unit 112 to display a plurality of frames of the image data of the image file selected as a component of the moving image bit stream on the display unit 110 in the small screen. In step S201, the control unit 101 determines whether or not an instruction to display a small screen has been issued. If not, the process proceeds to step S208. If yes, the process proceeds to step S202, where the control unit 101 drives the display control unit 111. Then, the image data storage unit 104 is accessed and the frame buffer unit 109 is controlled, and the display unit 110 displays, for example, 5 × 5 = 25 selected image data on the small screen. When the operator no longer needs to display the sub-screen, the input operation means 11
2 releases the mode. The operator looks at the sub-screen display and considers which image file is to be allocated to which position in the moving image bit stream. At this time, the operator assigns a classification identifier γi to the image file and changes the order number within the classification. Give. These assignments are provided by the input operation means 11
2 is performed. For those that cannot be classified, γ100 is assigned as the classification identifier γi. Those not required are not provided with the classification identifier γi. In step S203, it is determined whether or not the small screen display mode has been stopped or ended. If not, the process proceeds to step S204, where the still image file storage number variable N (A) of the image file selected as a component of the moving image bit stream ₁ , B _1, etc.) for the classification identifier γi as the classification number 900a
(I = 1, 2,...) Is determined. If not, the flow advances to step S207 to increment the state of the next 5 × 5 = 25 selected still image data to the small-screen display state, and returns to step S202. Step S2
In the increment of the child screen display at 07, the still image file storage number variable N of the 25 still image data currently displayed is deleted, and the next next still image data is added to the still image file storage number variable N. May be a small increment.

When the classification identifier γi is assigned to the still image file storage number variable N of the selected still image data, the process proceeds to step S205, where the control means 101 activates the image classification means 126, and the image classification means 126 The classification identifier γi (i =
1, 2,...) And the corresponding relationship is stored. In the next step S206, the control means 101 activates the image order determining means 114, and the image order determining means 114 assigns the order number within the classification in the previously assigned classification identifier γi, and stores the correspondence. This is because when it is difficult to assign the classification identifier γi only with the file name of the selected still image data and it is difficult to assign the sequence number within the classification, the selected still image data is displayed in a sub-screen to view the still image. This is a case where the classification identifier γi and the intra-class order number are added while checking.

After step S206, step S207
Then, the sub-screen display is incremented, and the process returns to step S202.

When the operator stops the small-screen display mode, and when the increment of the small-screen display is completed for all the selected still image data, step S2 is performed.
03 is YES, the process proceeds to step S27, and returns to a state where the file names of all the selected still image file storage number variables N stored in the image selection unit 113 are displayed on the display unit 110. . And
When the determination in step S201 is NO, the process proceeds to step S208. The operator looks at the file name of the displayed selected still image data, determines which classification identifier γi is given to which image file, and at which position in the moving image bit stream, the input operation means for each image file is considered. At 112, a classification identifier γi and a sequence number within classification are added. In step S208, the control unit 101 activates the image classification unit 126, and the image classification unit 1
Reference numeral 26 designates a classification identifier γi (i = 1, 2,...) Corresponding to the still image file storage number variable N, and stores the correspondence. Those not required are not provided with the classification identifier γi. In the next step S209, the control means 101 activates the image order determining means 114, and the image order determining means 11
Numeral 4 assigns an in-class order number in the previously assigned class identifier γi and stores the correspondence. This is the case where the classification identifier γi and the sequence number within classification are added by looking at only the file name without displaying the selected still image data in the small screen.

In step S210, the classification identifier γi
It is determined whether or not the work of assigning the and the sequence number within the classification is completed. If not, the process returns to step S201. The operator can end the operation at any time by operating the input operation means 112. Then, the process proceeds to step S211. Further, the classification identifier γ is used for the image files of all the selected still image data.
When the operation of assigning i and the in-class sequence number is completed, the process automatically proceeds to step S211.

In step S211, the control means 101
Activates the image order determining means 114, the moving image encoding means 115, and the moving image bit stream recording means 116, and in step S212, the image order determining means 114 According to the priority determined by the classification identifier and the sequence number within the classification, that is, in accordance with the order shown in FIG. The moving image encoding unit 115 compresses and encodes the read image data in accordance with MPEG or the like in step S213, and temporarily stores the image compression encoded data in the buffer area of the hard disk. In this case, a dedicated hard disk may be used, or the image data storage unit 104 may be used as the hard disk. Further, a semiconductor memory may be used instead of the hard disk.

In the next step S214, it is determined whether or not there is uncompressed encoded data having the priority determined by the next classification identifier and the in-class sequence number.
Proceeding to 215, the priority determined by the next classification identifier and the sequence number within classification is set, and the flow returns to step S212. Hereinafter, similarly, the selected still image data of the still image file storage number variable N read out according to the priority determined by the classification identifier corresponding to each still image file storage number variable N and the order number within the classification is compression-encoded. The temporary storage of the image compression encoded data in a buffer area of a hard disk or a semiconductor memory is repeated. Step S2
If the priority determined by the next classification identifier and the sequence number within the classification is no longer determined in the judgment of 14, the flow proceeds to step S21.
In step 6, the moving image bit stream recording unit 116 stores all the image compression encoded data temporarily stored in the buffer area of the hard disk or semiconductor memory in FIG.
Are read out in the order of priority determined by the classification identifier and the in-class order number, and stored as a moving image bit stream with priority on a hard disk or semiconductor memory,
When the storing is completed, all the operations are completed. As described above, the image file selected as a component of the moving image bit stream is generated as the moving image bit stream 1000 with the priority determined by the classification identifier and the classification order number as shown in FIGS. This means that the image has been recorded in the image bit stream recording means 116. Note that the moving image bit stream may be recorded in the image data storage unit 104.

As described above, according to the recording apparatus for image information management according to the seventh embodiment, a large number of still images are required to satisfy a predetermined requirement (for example, image type, operator preference, etc.).
, And selected still image data to which a classification identifier γi (i = 1, 2,...) And an in-class sequence number are attached, and when the data is read out for compression encoding, Priority is given to the younger one, and in the case of the same classification identifier, the one with the lower classification number within the classification is read out in a state of priority, and compression-coded, so that the priority is determined by the classification identifier and the classification order number. The moving image bit stream 1000 can be generated and recorded.

If such a moving image bit stream 1000 is recorded, still images can be sequentially reproduced for each classification when an image is retrieved by an image information management reproducing apparatus as described later. And, for example,
Scenes of landscapes, drama scenes, music or singing scenes, talents, actors and singers' images, paintings, and other categories are continuously played back in a unified form, enabling coarse search, that is, high-speed search . When a desired portion is reproduced, the speed of image reproduction can be slowed down or stopped.

As other effects, the same effects as those of the first embodiment are exhibited.

The technology of the seventh embodiment may be applied to the second embodiment. In the case of the above-described seventh embodiment, the operator has performed the classification work on the selected still image data. However, the image classification unit 126 may be configured to have a function of automatically performing a classification process. . This corresponds to claim 8. That is, the image classification means 126
For each still image data read out from the image data storage unit 104 in accordance with the order of the still image file storage number variable N, a function is provided for identifying the color of the image and automatically performing rough classification according to the color. ing. In the hue identification, the hue having the largest occupation ratio among the various hues included in the still image data is set as the hue of the still image data. For example, in the case of image data in which a person's face is largely projected, a skin color classification identifier is added, and in the case of image data in which a green area, such as a forest, occupies a large area, a green classification identifier is added. For example, in the case of image data in which the range occupied by blue is large, a blue classification identifier is added. In such an embodiment, the frame buffer unit 109, the display unit 110, and the display control unit 111 can be omitted. In addition, since the operator does not need to perform the classification every time, the classification is automatically performed, the work efficiency is very good.

As an embodiment of the application of the seventh embodiment,
For the same classification identifier as the classification number,
This is based on the fact that the difference between screens of adjacent selected still image data read from the image data storage means tends to be small. This corresponds to claim 9. That is, as shown by a two-dot chain line in FIG. 26, a moving picture inter-picture encoding means 115b and an intra / inter-picture selecting means 122 are added. In this case, it is needless to say that the moving picture coding unit 115 functions as the moving picture coding unit 115a.

The operation is described in step S21 in FIG.
2, the transfer destination of the selected still image data having the same classification identifier is set to the inter-moving image coding means 115.
b, and the selected still image data may be subjected to inter-screen compression encoding. That is, as shown in the partial flowchart of FIG. 32, in step S212a following step S211 in FIG. 31, the image order determination unit 114 determines the classification identifier corresponding to the still image file storage number variable N recorded therein and the classification order within classification. The still image data of the corresponding still image file storage number variable N is read from the image data storage unit 104 according to the priority determined by the number, that is, according to the order shown in FIG. Next step S
At 212b, it is determined whether or not the classification identifier, which is the classification number, is the same as the previous one. When the same classification identifier continues, high data compression can be expected because the classification of the still image is the same. The inter-screen selection means 122 selects inter-picture compression encoding. Then, in step S213a, the control means 101 activates the inter-moving picture coding means 115b, and converts the latter still picture image data of the two selected still picture data of the adjacent priority into the inter-picture based on MPEG or the like. Compression encoding,
The image compression encoded data is temporarily stored in a buffer area of a hard disk or a semiconductor memory, and step S214 is performed.
Proceed to. If the classification identifier is different from the previous one in the determination in step S212b, the classification of the still image is different, so that too high data compression cannot be expected. Therefore, the process proceeds to step S212d, and the in-screen / inter-screen selection means 122 selects the screen. Select inner compression encoding. Then, in step S213b, the control means 101 activates the moving picture intra-screen encoding means 115a, and converts the latter still picture image data of the two selected priority still picture image data within the picture in accordance with MPEG or the like. After compression encoding, the image compression encoded data is temporarily stored in a buffer area of a hard disk or semiconductor memory, and the process proceeds to step S214.
The operation after step S214 is described in the seventh embodiment (FIG. 31).
Is the same as

[Eighth Embodiment] An eighth embodiment is directed to the first embodiment.
0, which corresponds to claim 11. The feature of Embodiment 8 is that many still images are classified according to predetermined requirements,
The point is that a moving image bit stream to which classification information such as a character string corresponding to each classification item is added is recorded.

FIG. 33 is a block diagram showing a configuration of an image information management recording apparatus according to the eighth embodiment. 33, reference numerals 101 to 117 are the same as those in FIG. 1 (Embodiment 1).
1 is control means, 102 is program storage means, 103 is working memory means, 104 is image data storage means,
105 is an image data input unit, 106 is a video signal receiving unit, 107 is a modem, 108 is a network connection unit,
109 is a frame buffer means, 110 is a display means, 1
11 is a display control unit, 112 is an input operation unit, 113 is an image selection unit, 114 is an image order determination unit, 115 is a moving image encoding unit, 116 is a moving image bit stream recording unit, and 117 is a bus. Reference numeral 126 denotes an image classifying unit similar to that of the seventh embodiment (FIG. 26), which has a predetermined requirement (for example, image type or operator's The still images are classified according to preference, and the classification number (classification identifier γi (i = 1, 2,...)) Is assigned to the still image data.
And an intra-category order number within the type of each classification number in cooperation with the image order determination means 114. Reference numeral 127 denotes a classification information adding unit that adds classification information Mi corresponding to the classification identifier γi to the still image data compressed and encoded.

The classification information adding means 127 has a classification identifier / classification information correspondence table 127a for associating the classification identifier γi with the classification information Mi as shown in FIG. The classification identifier / classification information correspondence table 127a stores specific contents of the classification information Mi as character string data. For example, the classification information M1 relates to “landscape”, and the classification information M4 relates to “building”.

When assigning a frame sequence number X to the still image data, the image classifying means 126 classifies the still images according to predetermined requirements (eg, image type, operator preference, etc.). A classification identifier γi (i = 1, 2,...), Which is a classification number 900a, is attached to the data, and an individual classification number, that is, an in-class order number 900b within the type of the classification identifier γi is assigned in cooperation with the image order determination unit 114. . As described above, the priority of the classification identifier γi is γ1>γ2>γ3>γ4>γ5>
...

The image order determining means 114 determines whether the classification identifier γ
When reading out selected still image data with i (i = 1, 2,...) and an in-class sequence number for compression encoding,
The priority is given to the one with the smaller classification identifier γi, and in the case of the same classification identifier, the one with the lower order number within the classification is given priority. When the image compression-encoded data which has been compression-encoded in this way and temporarily stored in the buffer area is read, the classification information adding means 127 outputs the classification number 900
a, that is, searching the classification identifier / classification information correspondence table 127a based on the classification identifier γi, reads out the classification information Mi corresponding to the classification identifier γi, and adds it to the header of the image compression-encoded data. The image compression-encoded data to which the classification information Mi has been added is arranged along the time axis according to the classification identifier and the intra-class order number, and a moving image bit stream 1000b with classification information as shown in FIGS. 35 and 36 is generated. Are recorded in the moving image bit stream recording means 116.

The operation of the recording apparatus for managing image information according to the eighth embodiment will be described with reference to the flow charts shown in FIGS. 5 to 8 in the first embodiment and FIGS.
This is basically the same as the flowchart shown in FIG. 31, but differs in the process of step S216. The different parts will be described with reference to the partial flowchart of FIG. For convenience of explanation, the description starts from step S212.

In step S212, the image order determination means 114 determines the order of the classification identifier γi (i = 1, 2,...) Corresponding to the still image file storage number variable N recorded therein and the order within the classification according to the priority order. That is, according to the order shown in FIG.
4, the still image data of the corresponding still image file storage number variable N is read and transferred to the moving image encoding unit 115. In step S213, the moving image encoding unit 115
Compresses and encodes the read image data according to MPEG or the like, and temporarily stores the image compression-encoded data in a buffer area of a hard disk. In this case, a dedicated hard disk may be used, or the image data storage unit 104 may be used as the hard disk. Further, a semiconductor memory may be used instead of the hard disk.

In the next step S214, it is determined whether or not there is uncompressed encoded data having the priority determined by the next classification identifier and the sequence number in the classification.
Proceeding to 215, the priority determined by the next classification identifier and the sequence number within classification is set, and the flow returns to step S212. Hereinafter, similarly, the selected still image data of the still image file storage number variable N read out according to the priority determined by the classification identifier corresponding to each still image file storage number variable N and the order number within the classification is compression-encoded. The temporary storage of the image compression encoded data in a buffer area of a hard disk or a semiconductor memory is repeated.

If it is determined in step S214 that the priority determined by the next classification identifier and the in-class sequence number is no longer present, the flow advances to step S301 to temporarily store the moving image bit stream recording means 116 in the buffer area of the hard disk or semiconductor memory. All the image compression-encoded data that are stored in a hierarchical manner are read out in the order of priority determined by the classification identifier and the sequence number within classification shown in FIG. Step S
In 302, the classification information adding means 127 refers to the classification identifier / classification information correspondence table 127a according to the classification identifier γi attached to the read image compression-encoded data, and the classification information M corresponding to the classification identifier γi.
i, and in step S303, the classification information adding unit 127 adds the header of the image compression-encoded data for each frame that is read out from the buffer area of the hard disk or the semiconductor memory in accordance with the priority determined by the classification identifier and the order number within the classification. On the other hand, the determined classification information Mi is added. Then, in step S304, the moving image bit stream recording unit 116 stores the sequence of the image compression-encoded data with the classification information in the header sequentially read out as described above as the moving image bit stream 1000b with the classification information, and stores the sequence. Is completed,
End all operations.

As described above, the image file selected as a component of the moving picture bit stream is
6 has a priority determined by the classification identifier and the intra-class sequence number as shown in FIG.
0b, and is recorded in the moving picture bit stream recording means 116. Note that the image data storage unit 104 may also be used as a storage unit for the moving image bit stream 1000b with classification information.

As described above, according to the recording apparatus for managing image information according to the eighth embodiment, a large number of still images are required to satisfy a predetermined requirement (for example, image type, operator preference, etc.).
, And selected still image data to which a classification identifier γi (i = 1, 2,...) And an in-class sequence number are attached, and when the data is read out for compression encoding, The priority is given to the younger one, and in the case of the same classification identifier, the one with the lower order number within the classification is read out and compressed and coded, and when generating the moving picture bit stream, the classification identifier Since the moving picture bit stream is generated by adding the classification information Mi corresponding to γi, specific classification information having a priority determined by the classification identifier and the intra-class order number and consisting of a character string as shown in FIG. Can be generated and recorded.

If such a moving image bit stream 1000b with classification information is recorded, still images are sequentially sorted for each classification when an image is retrieved by an image information management reproducing apparatus as described later. In addition, the classification information is reproduced together. For example, since the character strings such as "landscape", "overseas travel", and "e-mail" are displayed continuously, a rough search is performed. That is, high-speed search can be performed. When a desired portion is reproduced, the speed of image reproduction can be slowed down or stopped.

When the classification information is added to the header of the image compression encoded data, in the case of MPEG or the like,
It is also possible to record the header in a user data area known to be a specific position for the operator. With this configuration, it becomes easy to search for the classification information added when decoding is performed by the image information management playback device.

As other effects, the same effects as in the first embodiment are exhibited.

In the eighth embodiment as well, in order to improve the work efficiency, as shown in another embodiment of the seventh embodiment, the classification processing is automatically performed based on the color. Is also good. Also, to reduce storage capacity,
As shown in another embodiment of the seventh embodiment, it is also possible to configure so as to perform inter-picture compression encoding for those having the same classification identifier as the classification number.

Note that the eighth embodiment may be applied to the second embodiment.

[Embodiment 9] Embodiment 9 is based on Claim 1
2 and claim 13. A feature of the ninth embodiment is that a large number of still images are classified according to predetermined requirements, and a moving image bit stream to which partial image data for classification such as a colored rectangular frame corresponding to each classification item is added is recorded. It is in.

FIG. 38 is a block diagram showing a configuration of a recording device for image information management according to the ninth embodiment. 38, reference numerals 101 to 117 are the same as those in FIG. 1 (Embodiment 1).
1 is control means, 102 is program storage means, 103 is working memory means, 104 is image data storage means,
105 is an image data input unit, 106 is a video signal receiving unit, 107 is a modem, 108 is a network connection unit,
109 is a frame buffer means, 110 is a display means, 1
11 is a display control unit, 112 is an input operation unit, 113 is an image selection unit, 114 is an image order determination unit, 115 is a moving image encoding unit, 116 is a moving image bit stream recording unit, and 117 is a bus. Reference numeral 126 denotes an image classifying unit similar to that of the seventh embodiment (FIG. 26), which has a predetermined requirement (for example, image type or operator's The still images are classified according to preference, and the classification number (classification identifier γi (i = 1, 2,...)) Is assigned to the still image data.
And an intra-category order number within the type of each classification number in cooperation with the image order determination means 114. Reference numeral 128 denotes a classification partial image data generation unit that generates classification partial image data Qi composed of, for example, a colored rectangular frame corresponding to the classification identifier γi with respect to the compression-encoded still image image data. Reference numeral 129 denotes a classification partial image data adding unit that superimposes the generated classification partial image data Qi to the image compression encoded data.

The classification partial image data generating means 128
A classification identifier / classification partial image data correspondence table 128a for associating the classification identifier γi as shown in FIG. 39 with the classification partial image data Qi formed of, for example, a colored rectangular frame.
have. In the classification identifier / classification partial image data correspondence table 128a, each classification identifier γi (i =
The classification partial image data Qi (i = 1, 2,...) Composed of colored rectangular frames having different hues for each of 1, 2,. Therefore, although the classification partial image data generating means 128 has a recording medium, any recording medium such as a hard disk, a CD-ROM, a video CD, and a video ROM can be used. The storage unit 104 may also be used. For the classification partial image data Qi, for example, the classification item corresponding to the classification identifier γ2 is “mountain scenery”, and green colored rectangular frame image data Q2 is generated. The classification item corresponding to the identifier γ3 is “shore scenery”, and blue colored rectangular frame image data Q3 is generated.

The image classifying means 126 classifies the still images according to predetermined requirements (eg, image type, operator preference, etc.) when assigning the frame sequence number X to the still image data. A classification identifier γi (i = 1, 2,...), Which is a classification number 900a, is attached to the data, and individual classification numbers, that is, classification identifiers are cooperated with the image order determination unit 114 in the same manner as in the seventh embodiment. A classification order number 900b is assigned within the type of γi. As described above, the priority order of the classification identifiers γi is γ1>γ2>γ3>γ4>γ5>.

The image order determining means 114 calculates the classification identifier γ
When reading out selected still image data with i (i = 1, 2,...) and an in-class sequence number for compression encoding,
The priority is given to the one with the smaller classification identifier γi, and in the case of the same classification identifier, the one with the lower order number within the classification is given priority. When the image compression-encoded data that has been compression-encoded in this way and temporarily stored in the buffer area is read, the classification partial image data generation unit 128 outputs the classification identifier / classification data based on the classification number 900a, that is, the classification identifier γi. The classification partial image data correspondence table 128a is searched to generate classification partial image data Qi (colored rectangular frame image data Qi) corresponding to the classification identifier γi, and the classification partial image data adding unit 129 generates the classification partial image data Qi. The color-coded rectangular frame image data Qi is superimposed on the image-compressed and encoded data, and the image-compressed data to which the colored rectangular frame image data Qi is added is a classification identifier and an intra-class sequence number. 40 and 41 are arranged along the time axis direction according to Image bitstream 10
00c is generated, and the moving image bit stream recording unit 1
16 will be recorded. In FIG. 41, the image of the classification colored rectangular frame is drawn thick for emphasis.

The operation of the recording apparatus for managing image information according to the ninth embodiment will be described with reference to the flowcharts shown in FIGS.
This is basically the same as the flowchart shown in FIG. 31, but differs in the process of step S216. The different parts will be described with reference to the partial flowchart of FIG. For convenience of explanation, the description starts from step S212.

The processing from step S212 to step S215 is the same as that in the above-described seventh and eighth embodiments, and therefore the description is omitted.

If it is determined in step S214 that the priority determined by the next classification identifier and the in-class sequence number is no longer present, the flow advances to step S401 to store the moving image bitstream recording means 116 temporarily in the buffer area of the hard disk or semiconductor memory. All the image compression-encoded data that are stored in a hierarchical manner are read out in the order of priority determined by the classification identifier and the sequence number within classification shown in FIG. Step S
In 402, the classification partial image data generating means 128 refers to the classification identifier / classification partial image data correspondence table 128a according to the classification identifier γi attached to the read image compression-encoded data, and the classification identifier γi.
Is calculated, and in step S403, the classification partial image data adding means 129 reads from the buffer area of the hard disk or semiconductor memory in accordance with the priority determined by the classification identifier and the sequence number within classification. The determined color-coded rectangular frame image data Qi is superimposed on the compressed image-encoded data for each frame. Then, in step S404, the moving image bit stream recording unit 116 converts the sequence of the image compression-encoded data to which the sequentially read color rectangular frame image data with classification is added, into the moving image bit with rectangular frame with classification. The stream is stored as the stream 1000c, and when the storage is completed, all the operations are completed.

As described above, the image file selected as a component of the moving image bit stream is
1, which is generated as a moving image bit stream 1000c with a colored rectangular frame for classification, which has a priority determined by the classification identifier and the sequence number in the classification as shown in FIG. Thus, it is recorded in the moving image bit stream recording means 116. Note that the image data storage unit 104 may also be used as a storage unit for the moving image bit stream 1000c with a rectangular frame with a classification color.

In the above description, colored rectangular frame image data is taken as an example of the partial image data for classification. Line, one line on the right side, one line on the left side,
Or a suitable combination of these lines, the center horizontal line,
Appropriate ones such as a vertical line at the center, a cross line, a rectangular frame and a round frame at the center can be adopted.

As described above, according to the recording apparatus for image information management according to the ninth embodiment, a large number of still images are required to satisfy a predetermined requirement (for example, image type, operator preference, etc.).
, And selected still image data to which a classification identifier γi (i = 1, 2,...) And an in-class sequence number are attached, and when the data is read out for compression encoding, The priority is given to the younger one, and in the case of the same classification identifier, the one with the lower order number within the classification is read out and compressed and coded, and when generating the moving picture bit stream, the classification identifier Since a moving image bit stream is generated by adding partial image data Qi for classification, such as a colored rectangular frame, corresponding to γi, it has a priority determined by a classification identifier and a sequence number within classification, and is used for classification for search assistance. A moving image bit stream 1000c to which a partial image has been added can be generated and recorded.

If such a moving picture bit stream 1000c with a rectangular frame with a color for classification is recorded, a still image is classified for each classification when an image is searched by an image information management reproducing apparatus as described later. Partial images for classification, such as colored rectangular frames, for search assistance, such as colored rectangular frames, will also be played back in order, for example, a green colored rectangular frame that means "mountain view" or a "shore view." Since the blue colored rectangular frames are continuously reproduced in a state of being simultaneously displayed, a coarse search, that is, a high-speed search can be performed. When the desired part starts playing,
This can be conveniently used, for example, to slow down or stop the image playback speed.

As other effects, the same effects as in the case of the first embodiment are exhibited.

Note that, as in the case of the above embodiment,
With a configuration including a moving picture inter-picture encoding unit that performs inter-picture compression encoding on selected still picture image data having the same classification identifier as a classification number, the capacity required for recording a moving picture bit stream is small. Yes.

[Embodiment 10] Embodiment 10 corresponds to claim 14. A feature of the tenth embodiment is that a large number of still images are classified according to predetermined requirements, and a moving image bit stream to which a label color bit stream for classification corresponding to each classification item is added is recorded.

FIG. 43 is a block diagram showing the configuration of the image information management recording apparatus according to the tenth embodiment. In FIG. 43, reference numerals 101 to 117 are the same as those in the configuration of FIG.
Reference numeral 126 denotes the seventh embodiment (FIG. 26) or the ninth embodiment.
(FIG. 38) This is an image classification means similar to that of FIG. 38, and classifies still images according to predetermined requirements (eg, image type, operator preference, etc.) when assigning a frame sequence number X to still image data. Then, a classification number (classification identifier γi (i = 1, 2,...)) Is assigned to the still image data, and an intra-class order number is assigned within the type of each classification number in cooperation with the image order determination means 114. Things.
Reference numeral 130 denotes a label color generating means for classification, which generates label color data Ri for the hue corresponding to the classification identifier γi with respect to the still image data compressed and encoded. This classification label color generating means 130 is provided in FIG.
Classification identifier γi and classification label color data R as shown in
It has a classification identifier / classification label color data correspondence table 130a for associating with i. This classification identifier / classification label color data correspondence table 130a stores classification label color data Ri (i = 1, 2,...) Having different hues for each classification identifier γi (i = 1, 2,...). Have been. For the classification label color data Ri, for example, the classification item corresponding to the classification identifier γ2 is “mountain landscape”, green label color data R2 is generated, and the classification identifier γ3 Is a "coastal scenery", and blue label color data R3 is generated.

Reference numeral 131 denotes a classification label color bit stream generation that generates a classification label color bit stream 1100 for one macroblock composed of 16 pixels × 16 lines corresponding to the generated classification label color data Ri. And 132, a classification label color bit stream adding means for adding the generated classification label color bit stream 1100 as the first line head macroblock 1050 in the image compression coded data as shown in FIG. It is.

MPEG, an international standard for image compression technology
(Moving Picture Coding Experts Group), macroblock address increment (MB
AI) is given as the difference between the address of the current macroblock and the address of the immediately preceding encoded macroblock.
When the macroblock address increment (MBAI) is larger than 1, the macroblock between the current macroblock and the immediately preceding coded macroblock becomes a skip macroblock, and a motion vector or a DCT coefficient is included in the macroblock. Indicates no information at all. Thus, unnecessary macroblock information is reduced. Therefore, when the same data continues over one macroblock line, if encoding is performed in only the first macroblock,
Subsequent macro blocks need not be coded. By specifying color information in a bit stream in the first macroblock of the first slice layer (one macroblock line) in the picture layer, decoding is performed as shown in FIG. In the reproduced image, the classification label color image 1110 having the color information designated in the slice layer covering one line from the first macroblock of the reproduction macroblock and the macroblock following the line to the last macroblock of the line is used as the first classification.
It can be displayed as a search aid label on the macro block line. Embodiment 10 utilizes this fact.

When reading out the selected still image data to which the classification identifier γi (i = 1, 2,...) And the in-class sequence number are attached for compression encoding, Based on the identifier γi, the classification identifier / classification label color data correspondence table 130a is searched to generate classification label color data Ri of a hue corresponding to the classification identifier γi. A classification label color bit stream 1100 for one macroblock corresponding to the generated classification label color data Ri is generated, and the classification label color bit stream adding unit 132 generates the generated classification label color bit stream 1100. Is added to the first line head macroblock 1050 in the image compression encoded data as search assistance information. The image compression coded data to which the classification label color bit stream 1100 is added is arranged along the time axis according to the classification identifier and the intra-class sequence number to generate a moving image bit stream, and the moving image bit stream is recorded. It will be recorded in the means 116.

The operation of the recording apparatus for managing image information according to the tenth embodiment is described with reference to the flowcharts shown in FIGS. 5 to 8 in the first embodiment and FIGS.
0, which is basically the same as the flowchart shown in FIG. 31, except that step S4 in FIG.
The processing after 01 is different. The different parts will be described with reference to the partial flowchart of FIG.

When the priority determined by the next classification identifier and the sequence number within the classification is lost in the determination in step S214 of FIG. 42 (when the determination is NO), step S5 is performed.
In step 01, the moving image bit stream recording unit 116 assigns all image compression encoded data temporarily stored in the buffer area of the hard disk or semiconductor memory to a priority determined by the classification identifier and the classification order number (FIG. 40). Read in order). In step S502, the classification label color generating means 130 corresponds to the classification identifier γi according to the classification identifier γi attached to the read image compression-encoded data, referring to the classification identifier / classification label color data correspondence table 130a. The classification label color data Ri of the selected hue is calculated, and in step S503, the classification label color bit stream generation unit 131 generates the classification color label bit stream 1100 of the corresponding hue based on the calculated classification label color data Ri. Then, in step S504, the classification label color bitstream adding means 132 converts the image compression encoded data for each frame read from the buffer area of the hard disk or semiconductor memory in accordance with the priority determined by the classification identifier and the order number within classification. 1st lie The generated label color bit stream for classification 1100 is added as a top macro block 1050 for the application. Then, in step S505, the moving image bit stream recording unit 1
16 stores, as a moving image bit stream, a sequence of image compression encoded data to which the classification label color bit stream 1100 thus sequentially read is added,
When the storing is completed, all the operations are completed.

As described above, the image file selected as a component of the moving image bit stream has the priority determined by the classification identifier and the intra-class order number, and the classification label color bit stream corresponding to the classification identifier is added. It is generated as a moving image bit stream and recorded in the moving image bit stream recording unit 116.
Note that the image data storage unit 104 may also be used as a storage unit for the moving image bit stream.

In the above case, the classification label color bit stream 1100 is added to the first line, ie, the top macroblock 1050 of the upper line, but the classification line is added to the last line, ie, the top macroblock of the lower line. It may be configured to add a color bit stream.

At the time of reproduction, a classification identifier corresponding to the desired classification is set in advance (for example, when searching for “mountain landscape”, the classification identifier γ2 is set), and during browsing (viewing). When the reproduction of the desired image is started, the reproduction operation is automatically frozen. In this case, if a classification label color bit stream is added to the top macroblock of the upper line, the still image for one frame is frozen from the first line. Therefore, it is more preferable to add the classification label color bit stream to the top macroblock of the top line when adding it to the top macroblock of the top line or to add it to the top macroblock of the bottom line.

As described above, according to the recording apparatus for image information management according to the tenth embodiment, a large number of still images are classified according to predetermined requirements (for example, image types and operator preferences). Classification identifier γi (i = 1, 2
…) And the selected still image data with the in-class order number generated beforehand and read out for compression encoding,
When the classification identifier γi is prioritized, and in the case of the same classification identifier, the one with the smaller intra-class sequence number is prioritized and read and compressed and encoded, and when a moving image bit stream is generated. In addition, classification label color data Ri corresponding to the classification identifier γi is generated, a classification label color bit stream 1100 is generated based on the classification label color data Ri, and added to the image compression-encoded data to generate a moving image. Since the bit stream is generated, it is possible to generate and record a moving image bit stream having a priority determined by the classification identifier and the order number within the classification and to which a classification label color bit stream for search assistance is added. Further, there is no need to generate colored rectangular frame image data as in the case of the ninth embodiment. Instead, a bit stream for simply specifying a label color for classification is generated, and the bit stream for label color for classification is converted to the first line top macro. Since it only needs to be added to the block, the processing amount can be reduced and the processing speed can be increased as compared with the case of the ninth embodiment.
Also, the memory capacity can be reduced.

If such a moving image bit stream with a label color bit stream for classification is recorded, a still image is classified according to the classification when an image is searched by an image information management reproducing apparatus as described later. In turn,
Moreover, as shown in FIG. 45 (b), a classification label color image 1110 for search assistance is also reproduced, and for example, a green band-like label color image meaning "mountain scenery" or "shore" Since the label color image in the form of a blue band meaning “landscape” is simultaneously displayed in the form of a band along the upper side or lower side of the screen, a coarse search, that is, a high-speed search is possible. When a desired portion is reproduced, the speed of image reproduction can be slowed down or stopped.

In addition, the same effects as in the first embodiment can be obtained as other effects.

Note that, as in the case of the above embodiment,
With a configuration including a moving picture inter-picture encoding unit that performs inter-picture compression encoding on selected still picture image data having the same classification identifier as a classification number, the capacity required for recording a moving picture bit stream is small. Yes.

[Eleventh Embodiment] The eleventh embodiment corresponds to claim 15. A feature of the eleventh embodiment is that a large number of still images are classified according to predetermined requirements, and selected still image data (pictures) for each classification are stored in MPEG.
GOP (Group of Pictures)
The point is that a moving image bit stream in a state where classification information (GOP start code) is added to the GOP header for each GOP is recorded.

[0168] A GOP is a group of a plurality of frames in a moving image sequence defined in MPEG, and is used as a random access at the time of decoding and reproduction or as an image editing unit.

FIG. 47 is a block diagram showing a configuration of an image information management recording apparatus according to the eleventh embodiment. In FIG. 47, reference numerals 101 to 117 are the same as those in the configuration of FIG.
Reference numeral 126 denotes the seventh embodiment (FIG. 26) or the ninth embodiment.
(FIG. 38) is an image classification means similar to that of FIG. 38, and classifies still images according to predetermined requirements (eg, image type, operator preference, etc.) when assigning a frame order number X to still image data. Then, in order to combine still image groups of the same classification as the same GOP (group of pictures), the still image data is assigned a classification number (classification identifier γi (i = 1, 2,...)) And the image order determination unit 114 In cooperation with the above, an intra-class order number is assigned within the type of each class number. Reference numeral 133 denotes a classification for generating a classification GOP start code Ti for setting in a GOP header for each GOP in association with a classification identifier γi of still image data which is a component of the GOP. GOP start code generation means.
Although not shown, the classification GOP start code generation means 133 generates a classification identifier / classification GOP for associating the classification identifier γi with the classification GOP start code Ti.
It has a start code correspondence table. GO for classification
For the P start code Ti, for example, a classification GOP start code T2 is generated for the classification item "mountain scenery" corresponding to the classification identifier γ2, and the P start code Ti corresponds to the classification identifier γ3. A classification GOP start code T3 is generated for the classification item “shore scenery”.

Reference numeral 134 denotes the generated G for classification.
Classification GOP start code adding means for adding the OP start code Ti to the GOP header in the image compression encoded data. In the eleventh embodiment,
It is assumed that the moving image encoding unit 115 also serves as the intra-moving image encoding unit and the inter-moving image encoding unit.
In generating a GOP (Group of Pictures)
This is for generating a P picture and a B picture in addition to the I picture.

The operation of the recording apparatus for managing image information according to the eleventh embodiment will be described with reference to the flowcharts shown in FIGS. 5 to 8 in the first embodiment and FIGS.
0, which is basically the same as the flowchart shown in FIG. 31, except that step S4 in FIG.
The processing after 01 is different. The different parts will be described with reference to the partial flowchart of FIG.

If the priority determined by the next classification identifier and the sequence number within the classification is lost in the determination in step S214 in FIG. 42 (when the determination is NO), step S6 is performed.
In step 01, the moving image bit stream recording unit 116 assigns all image compression encoded data temporarily stored in the buffer area of the hard disk or semiconductor memory to a priority determined by the classification identifier and the classification order number (FIG. 40). Read in order). In step S602, the classification GOP start code generation means 133 performs classification by referring to the classification identifier / classification GOP start code correspondence table (not shown) according to the classification identifier γi attached to the read image compression encoded data. The classification GOP start code Ti corresponding to the identifier γi is determined, and in step S603, the classification GOP start code adding means 134 classifies the determined classification GOP start code Ti from the buffer area of the hard disk or the semiconductor memory as a classification identifier. The GOP is added to the GOP header of one GOP (group of pictures) read out according to the priority determined by the internal order number. Then, in step S604, the moving image bit stream recording means 116 reads the G
A sequence of image compression-encoded data in which the GOP start code Ti for classification is added to the GOP header in OP units is stored as a moving image bit stream, and when the storage is completed, all operations are terminated.

As described above, the image file selected as a component of the moving image bit stream has the priority determined by the classification identifier and the intra-class sequence number, and the classification GOP start code corresponding to the classification identifier is provided in GOP units. This is generated as a moving image bit stream added to the GOP header, and is recorded in the moving image bit stream recording unit 116. Note that the image data storage unit 104 may also be used as a storage unit for the moving image bit stream.

In the course of playback of a moving picture bit stream of a GOP of a certain classification during playback, if it is desired to jump to the next classification scene, the jump can be performed quickly by incrementing the classification GOP start code. It is possible to randomly access any scene without being particular about the order.

As described above, according to the recording apparatus for image information management according to the eleventh embodiment, a large number of still images are classified according to predetermined requirements (for example, image types and operator preferences). Classification identifier γi (i = 1, 2
…) And the selected still image data with the in-class order number generated beforehand and read out for compression encoding,
If the classification identifier γi has the lowest priority, and if the classification identifiers are the same, the one having the lower classification sequence number is read with priority, and the compression code is formed in a state in which a GOP (group of pictures) is formed for each classification. And then
When generating a moving image bit stream, the classification identifier γ
Since a GOP start code Ti for classification corresponding to i is generated, and the GOP start code Ti for classification is added to the GOP header of each GOP to generate a moving image bit stream, it is determined by a classification identifier and a sequence number within classification. It is possible to generate and record a moving image bit stream to which a priority GOP start code for search assistance is added. The process of generating and adding the classification GOP start code Ti can be performed relatively easily.

If a moving image bit stream with such a GOP start code for classification is recorded, a GOP of a scene of a certain classification is searched when an image is searched for by an image information management reproducing apparatus as described later. If you want to jump to a scene of another arbitrary classification while playing back the moving image bit stream of
By setting the start code, you can jump quickly with random access.

In addition, the same effects as those of the first embodiment can be obtained as other effects.

[Twelfth Embodiment] A twelfth embodiment corresponds to a sixteenth embodiment. A feature of the twelfth embodiment is that a large number of still images are classified according to predetermined requirements, and a moving image bit stream to which audio data for classification according to each classification item is added is recorded. In the sixth embodiment as well, a moving image bitstream to which audio data for search assistance is added is recorded, but the audio data to be added is selected artificially.
On the other hand, in the case of the twelfth embodiment, first, a still image is classified according to a predetermined requirement, and classification audio data is automatically generated according to the classification item. different.

FIG. 49 is a block diagram showing a configuration of a recording device for image information management according to the twelfth embodiment. In FIG. 49, reference numerals 101 to 117 are the same as those in the configuration of FIG.
Reference numeral 126 denotes the seventh embodiment (FIG. 26) or the ninth embodiment.
(FIG. 38) This is an image classification means similar to that of FIG. 38, and classifies still images according to predetermined requirements (eg, image type, operator preference, etc.) when assigning a frame sequence number X to still image data. Then, a classification number (classification identifier γi (i = 1, 2,...)) Is assigned to the still image data, and an intra-class order number is assigned within the type of each classification number in cooperation with the image order determination means 114. Things.
Reference numeral 135 denotes classification audio data generation means for generating classification audio data Ui corresponding to the classification identifier γi for the compressed and encoded still image data.
As shown in FIG. 50, the classification voice data generating means 135 has a classification identifier / classification voice data correspondence table 135a for associating the classification identifier γi with the corresponding classification voice data Ui. Classification audio data U
Although i is preferably music, it may be singing by a person. For example, the classification item corresponding to the classification identifier γ2 is “mountain scenery”
And classification audio data U representing a mountain image
2 are generated, and the classification identifier γ
The classification item corresponding to No. 3 is "coastal scenery", and classification audio data U3 expressing a coastal image is generated.

[0180] 136 of the code generates a compression coding to classify speech compression encoded data Vi _j conform the generated classification voice data Ui in MPEG or the like of the, in the buffer area, such as a hard disk or a semiconductor memory This is a classification audio data encoding unit that is temporarily stored.

The operation of the recording apparatus for image information management according to the twelfth embodiment is basically the same as the flow charts shown in FIGS. 5 to 8 in the case of the first embodiment. Is basically the same as the flowcharts shown in FIGS. 30 and 31 in the case of the seventh embodiment. Therefore, step S205 and step S208 in FIG.
701 and step S206 and step S2 in FIG.
The operation of the twelfth embodiment will be described with reference to the flowcharts of FIGS.

When the operator assigns the classification identifier γi to the still image file storage number variable N of the selected still image data, the process proceeds to step S701, and the control means 10 proceeds to step S701.
1 activates the image classification means 126, and
Assigns a classification identifier γi (i = 1, 2,...) Corresponding to the still image file storage number variable N, and stores the correspondence. In the next step S702, the control means 101 activates the image order determining means 114, and the image order determining means 11
Numeral 4 assigns an in-class order number in the previously assigned class identifier γi and stores the correspondence. And step S
In 703, it is determined whether or not the work of assigning the classification identifier γi and the in-class sequence number has been completed. If the processing has not been completed, the flow advances to step S704 to increment the still image file storage number variable N (N ← N + 1), and the flow returns to step S701. The operator operates the input operation means 112
The operation can be terminated at any time by the operation of. Then, the process proceeds to step S705. When the operation of assigning the classification identifier γi and the order number within classification is completed for all the image files of the selected still image data, the process automatically proceeds to step S705.

In step S 705, the image order determining means 114 sends the corresponding still image file from the image data storing means 104 in accordance with the priority determined by the classification identifier corresponding to the still image file storage number variable N recorded therein and the order number within the classification. The still image data of the image file storage number variable N is read and transferred to the moving image encoding unit 115. In step S706, the moving image encoding unit 115 compresses and encodes the read image data in accordance with MPEG or the like. The image compression encoded data is temporarily stored in the buffer area.

On the other hand, the classification audio data U
There is a process of generating i and compression encoding. Step S801
, The classification audio data generating means 135 outputs the classification identifier γ attached to the still image data currently being read.
Based on i, a search is performed on the classification identifier / classification audio data correspondence table 135a to generate classification audio data Ui corresponding to the classification identifier γi, and transfer the classification audio data Ui to the classification audio data encoding unit 136. Classification generates audio data encoding means 136 conforms the classification audio data Ui read the MPEG or the like compression coding to classify speech compression encoded data Vi _j at step S802, the specific temporary it in the buffer area To be stored.

Note that a dedicated hard disk or a dedicated semiconductor memory may be used as a buffer area used for temporarily storing the image compression encoded data and the classification audio compression encoded data. Further, an empty area of the image data storage unit 104 may be used.

[0186] Image and sound multiplexing means 125 in step S707 is read out synchronously with the classification for speech encoded data Vi _j and classification in the sequence number and classification identifier from the buffer area is the same image compression coded data Then, the two data are multiplexed to generate audio multiplexed data for image / classification and temporarily stored in the buffer area.

In the next step S708, it is determined whether or not there is uncompressed encoded data having a priority determined by the next classification identifier and the in-class sequence number.
Proceeding to 709, a priority determined by the next classification identifier and the sequence number within classification is set, and on the one hand, the flow returns to step S705, and on the other hand, the flow returns to step S801. Hereinafter, similarly, while updating the priority determined by the classification identifier and the sequence number within the classification, the generation of the image compression-encoded data from the selected still image data, the generation of the classification audio data Ui, and the classification therefrom are performed. and generation of use the speech encoded data Vi _j, the generation of audio multiplexed data image and classification by multiplexing the image encoded data and classification for speech encoded data Vi _j of the same priority, the The temporary storage of the image / classification audio multiplexed data in the buffer area of the hard disk or semiconductor memory is repeated.

If it is determined in step S708 that the priority determined by the next classification identifier and the in-class sequence number is no longer present, the flow advances to step S710 to store the moving image / audio bit stream recording means 116a in the buffer area of the hard disk or semiconductor memory. All the image / classification audio multiplexed data temporarily stored in the hard disk and the semiconductor memory are read out in the order of priority determined by the classification identifier and the order number within the classification, and the audio compression for classification is read out. The image compression encoded data in which the encoded data is multiplexed is stored as a moving image bit stream 1000d, and when the storage is completed, all the operations are terminated. As described above, the image file selected as a component of the moving image bit stream has a priority determined by the classification identifier and the intra-class sequence number as shown in FIG. 53, and the moving image in which the audio compression encoded data for classification is multiplexed. This is generated as an image bit stream 1000d and recorded in the moving image bit stream recording unit 116. Note that FIG.
Suffix "j" of the classification for speech encoded data Vi _j is the content of the classification for speech encoded data is different for the image compression-encoded data of one each frame (such as E ₄₄₎ in And that the suffix “j” is a sequential number means that data such as music and singing, which are classification sounds for each classification item, are recorded in chronological order. Note that the moving image bit stream may be recorded in the image data storage unit 104.

As described above, according to the recording apparatus for image information management according to the twelfth embodiment, a large number of still images are classified according to predetermined requirements (for example, image types and operator preferences). Classification identifier γi (i = 1, 2
…) And the selected still image data with the in-class order number generated beforehand and read out for compression encoding,
When the classification identifier γi is prioritized, and in the case of the same classification identifier, the one with the smaller intra-class sequence number is prioritized and read and compressed and encoded. in the multiplexed moving image bit stream 1000d classification for speech encoded data Vi _j for searching auxiliary to the image compression-encoded data of the selected still image data of one frame minute corresponding to classification identifier γi Can be recorded. If a moving image bit stream obtained by multiplexing such audio compression-encoded data for classification is recorded, when an image is managed by an image information management reproducing apparatus as described later, each image is classified. The music, singing, human voice, etc., which changes in time series, which are separately corresponding to each other, are played back simultaneously, and the switching of the image classification can be determined by referring to the switching of the voice. It can be used conveniently, for example, by listening to search aid music, singing, human voice, etc., and slowing down or stopping the speed of image playback.

Further, as the other effects, the same effects as those of the first embodiment are exhibited.

It is to be noted that an image information management recording device in which an appropriate number of the first to twelfth embodiments are combined in an arbitrary number is also effective, and is included as an embodiment of the present invention.

The description of the image information management recording apparatus according to the embodiment of the present invention has been completed. Next, a specific embodiment of the playback device for image information management according to the present invention will be described.

[Thirteenth Embodiment] A thirteenth embodiment corresponds to claims 18 and 19. FIG.
FIG. 34 is a block diagram showing a configuration of an image information management playback device according to Embodiment 13. In FIG. 54, reference numeral 201 denotes control means for controlling the entire apparatus; 202, a program storage means for storing a program for the control;
Reference numeral 3 denotes a working memory unit functioning as a working memory; 204, an image data storage unit configured to store image data, for example, a hard disk or a semiconductor memory; and 205, a frame of image data temporarily for displaying image data. Frame buffer means for temporarily storing, 206 a display means such as a CRT or LCD, 207 a display control means, 208 a sound output means such as a speaker,
Reference numeral 209 denotes an input operation unit including a keyboard or a mouse on which an operator performs an input operation; 210, a moving image bit stream analyzing unit for analyzing a moving image bit stream that may include an audio bit stream; 211, an audio bit stream; A video / audio separation unit 212 for separating a video bitstream and an audio bitstream from a video bitstream including a video decoding unit 212 for decoding a video bitstream and reproducing image data; Reference numeral denotes an audio decoding means for decoding an audio bit stream to reproduce audio data, and a reference numeral 214 denotes a bus for connecting the respective means and exchanging data.

The image data storage means 204 stores the moving image bit stream generated by the image information management recording apparatus according to any one of the first to twelfth embodiments. In an image information management recording / playback apparatus in which an image information management recording apparatus and an image information management playback apparatus are integrated, the image data storage means 204 can be shared by the image data storage means 104. In the case where the image information management reproducing apparatus is solely used, the image data storage means 204 may be a copy of a moving image bit stream from the image data storage means 104 of a separate image information management recording apparatus, Image data storage means 104
May be removed and connected to the bus 214. As such image data storage means 204, in addition to a hard disk, a magnetic disk, a magneto-optical disk, a CD-I
・ Video CD ・ CD-ROM ・ Laser disk ・ DV
There are storage media such as D / CD-R. Alternatively, the image data storage means 20 of the separate image information management recording device
4 may be used. In this case, the separate image data storage means 204 is connected to the bus 214 by the transmission line 215.
What is necessary is just to connect via. Note that reference numerals 216 to 217
Will be described later.

The operation during normal reproduction of the image information management reproducing apparatus according to Embodiment 13 configured as described above is shown in FIG.
This will be described according to the flowchart shown in FIG. When the normal reproduction mode is instructed by the input operation unit 209, the processing from step S1001 is started. Step S10
In step 01, the control means 201
4 to input a moving picture bit stream including an audio bit stream and transfer it to the moving picture bit stream analyzing means 210. In step S1002, the moving image bit stream analysis unit 210 analyzes the transferred moving image bit stream. Then, in step S1003, it is determined whether or not an audio bit stream is included. If the audio bit stream is included, the process proceeds to step S1004 to set the parallel processing mode, and then to step S1005
The video / audio separation unit 211 separates the video bit stream including the audio bit stream into a video bit stream and an audio bit stream.
On the other hand, if the audio bit stream is not included, the flow advances to step S1006 to set the single processing mode, and the flow advances to step S1007. In step S1007, the moving picture decoding unit 212 decodes the moving picture bit stream according to the analysis result of the moving picture bit stream analyzing unit 210 to reproduce the image data. The image is displayed as an image by the display means 206 via the frame buffer means 205 under the following conditions. Thereafter, in the single processing mode, the process immediately proceeds to step S1011. In the case of the parallel processing mode, steps S1007 and S100
Steps S1009 and S1010 are executed in parallel with Step 8. That is, in step S1009, the audio decoding unit 213 decodes the audio bit stream in accordance with the above-described analysis result to reproduce audio data.
The audio data decoded in step 10
8 and output as audio. And step S
When both the processing in step 1008 and the processing in step S1010 are completed, the process proceeds to step S1011. In step S1011, it is determined whether or not an instruction to end the reproduction operation has been issued,
If not, the flow returns to step S1002 to repeat the same operation as described above. However, when an instruction to end the reproduction operation is issued, all operations are ended.

The image data management means 204 is generated by the image information management recording apparatus according to the first embodiment (FIG. 1: artificial selection of the order of arrangement of still images in the time axis direction).
Moving image bit stream 100 stored in (104)
0 is continuously reproduced along the time axis direction as shown in FIG.

Image Information Management Recording Apparatus According to Embodiment 2 (FIGS. 9 and 12: Automatic Selection of Still Image Arrangement Order in Time Axis), Embodiment 3 (FIG. 13: Pixel Decimation) Image Information Management Recording Apparatus According to Processing), Fourth Embodiment
(FIGS. 15 and 20: Multi-screen), an image information management recording apparatus according to the fifth embodiment (FIG. 21: Intra-screen compression encoding /
A moving image bit stream generated by the image information management recording apparatus according to the inter-screen compression encoding, according to the sixth embodiment (FIG. 2).
3, a video / audio bit stream generated by the image information management recording apparatus according to FIG. 25: image / audio multiplexing;
Embodiment 7 (FIGS. 26 and 29: Predetermined requirements (for example,
The same applies to a moving image bit stream in which selected still image data is arranged for each type of classification generated by the image information management recording apparatus according to (i.e., the type of image and the preference of the operator). . In the case of the moving image / audio bit stream generated in the sixth embodiment, the processing of steps S1009 and S1010 is performed.

At the time of retrieving and reproducing a still image, compared to the case of searching for still images scattered on a recording medium while searching each directory, as in the case of the prior art,
Since a plurality of still images are selected in advance and reproduced as a moving image bit stream arranged in the time axis direction, browsing (viewing, panning) can be performed, and images can be searched efficiently. The compression encoding method is not limited, but if an existing compression encoding method such as MPEG or DV is adopted, an existing hardware decoder or software decoder can be used for reproduction. In the case of the moving image bit stream according to the third embodiment in which the pixel thinning processing is performed, the processing speed of the reproduction is high. In the case of a multi-screen moving image bit stream generated by combining a plurality of still image data into one frame according to the fourth embodiment, the number of still images that can be viewed at one time increases when browsing. In addition, the image search efficiency is improved.

In particular, in the case of a moving image / audio bit stream according to the sixth embodiment in which audio is multiplexed, the audio is reproduced at the same time as the image is searched, so that the reproduced audio is used as a search aid. It can be used as voice. For example, when a music reminiscent of "mountain" is heard during a high-speed search, or a message sounding "mountain" is heard, the operator hears the search aid sound and slows down the image playback speed. It can be conveniently used for down and stop. This corresponds to claim 18.

In the case of the moving image bit stream according to the seventh embodiment, still images are reproduced in order for each classification. Images of actors and singers
Since the painting and other classifications are continuously reproduced in a united form, coarse retrieval, that is, high-speed retrieval is possible. When a desired portion is reproduced, the speed of image reproduction can be slowed down or stopped.

In the normal reproduction mode, the reproduction speed (frame rate) is usually 30 frames / sec, but by providing the reproduction speed variable means 216,
The playback speed can be set arbitrarily. Generally, a delay unit functionally located downstream of the decoding unit is used as the reproduction speed variable unit 216, and the reproduction speed is varied by adjusting the delay time. When a moving image bit stream is searched and played back, if 30 frames / sec is too fast, if the playing speed is appropriately reduced and played back, the image search can be performed easily and efficiently.

A moving image bit stream in which a classification GOP start code Ti corresponding to the classification identifier γi generated by the image information management recording apparatus according to the eleventh embodiment is added to the GOP header of each GOP (group of pictures). Is reproduced, the classification information designating means 217
If a GOP start code designating means for classification is provided instead of GOP and a GOP start code determining means for classification is provided instead of the classification information determining means 218, a moving image bit stream of a GOP of a scene of a certain classification is reproduced. If it is desired to jump to a scene of another arbitrary classification on the way, it is possible to make a random access by setting the GOP start code for classification and jump quickly.

In FIG. 54, reference numeral 217 denotes classification information specifying means for specifying classification information Mj relating to a classification to be searched. The designation is performed by operating the input operation unit 209. In the recording apparatus for managing image information according to the eighth embodiment (FIG. 33), the classification information Mi corresponds to the classification identifier γi of the selected still image data compressed and encoded by the classification information adding means 127. 34 is added to the header of the image compression-encoded data.
(See steps S302 and S303 in FIGS. 36 and 37). The image compression-encoded data to which the classification information Mi has been added is arranged along the time axis according to the classification identifier and the intra-class sequence number, and the moving image bit stream 1000b with classification information as shown in FIGS. Is generated and recorded in the image data storage unit 204 (104). The classification information Mi is, specifically, character string data such as “landscape” or “building” representing the classification type. Reference numeral 218 denotes a moving image bit stream analysis unit 2.
10. Classification information Mi analyzed by 10 and classification information designation means 216
Is determined whether or not the specified classification information Mj matches, and only when the classification information Mj matches, the decoding of the moving image bit stream / audio bit stream is permitted, and when they do not match, the decoding is not permitted. And a classification information judging means that functions to end the reproduction processing operation when a mismatch occurs after a match. An image information management playback device having such a configuration corresponds to claim 19.

Next, the operation of the playback apparatus for image information management configured as described above in the category designation search playback mode is shown in FIG.
This will be described with reference to the flowchart of FIG. Input operation means 2
When the user designates the category designation search / reproduction mode by 09, the processing from step S1101 is started. Step S
In step 1101, the process proceeds to step S1102 after the classification designation search / play mode is designated, and the input operation means 2
09 to the classification information specifying means 2
Set to 17. In step S1103, the control unit 201 accesses the image data storage unit 204, inputs a moving image bit stream generally including an audio bit stream, and transfers the moving image bit stream to the moving image bit stream analysis unit 210. In step S1104, the moving image bit stream analysis unit 210 analyzes the transferred moving image bit stream. Then, in step S1105, the classification information Mi added to the header of the image compression-encoded data is determined. In step S1106, the classification information determination unit 218 determines the classification information M
i and the classification information M set in the classification information designating means 217
j, and in step S1107, it is determined whether or not the classification information Mi calculated from the moving image bit stream matches the set classification information Mj (Mi = Mj?). If not, the bit stream is decoded. The process returns to step S1104 without permitting the conversion, and analyzes the moving image bit stream including the audio bit stream that is successively input. If it is determined in step S1107 that the classification information Mi determined from the moving image bit stream matches the set classification information Mj, the process advances to step S1108 to permit decoding, and the moving image / audio separation unit 211 A video bit stream including a bit stream is separated into a video bit stream and an audio bit stream. Step S1109
In parallel processing, the moving picture decoding means 212 decodes the separated moving picture bit stream in accordance with the analysis result, and the audio decoding means 213 decodes the audio bit stream in accordance with the analysis result in step S1110.
The image data decoded under the control of the display control means 207 is displayed as an image by the display means 206 via the frame buffer means 205, and the decoded audio data is output to the audio output means 208 and output as audio. I do. Then, in step S1111, the classification information determination unit 218 determines whether or not the classification information Mi calculated from the header of the image compression-encoded data of the moving image bit stream does not match the set classification information Mj. If continuing, step S11
Returning to step 04, the same processing as described above is repeated, but when the determined classification information Mi does not match the set classification information Mj, all processing ends. As described above, the classification information Mi that matches the classification information Mj set by the operator.
The decoding is automatically started from the time when the image compression coded data having the following is input, and only the matching image compression coded data is decoded and displayed on the display means 206. Then, the classification information M of the image compression encoded data
Decoding is automatically terminated when i no longer matches the set classification information Mj. In the case of a moving image bit stream without an audio bit stream, it goes without saying that the processing related to the audio bit stream is omitted.

When the determined classification information Mi matches the set classification information Mj, the reproduction speed varying means 21
6 may be controlled to slow down the playback speed.

As described above, according to the reproducing apparatus for managing image information according to the thirteenth embodiment, the moving image bit stream 1000b (with the classification information added with the classification information Mi) in the image data storage means 204 (104). (See FIG. 36)
Is stored, and classification information M that the operator wants to search for is stored.
j is set, and the image compression encoded data of the moving image bit stream with the classification information is extracted and automatically decoded according to the set classification information Mj. , And the image to be searched can be quickly found.

If the classification information designating means 217 and the classification information judging means 218 are not activated, still images of all classifications are reproduced in order for each classification, and the classification information is also reproduced. That is, for example, since the character strings such as "landscape", "overseas travel", and "e-mail" are continuously reproduced while a message is displayed, a coarse search, that is, a high-speed search can be performed. When a desired portion is reproduced, the speed of image reproduction can be slowed down or stopped.

When the classification information is added to the header of the image compression coded data, if it is recorded in the user data area of the header which is known to be a specific position for the operator in the case of MPEG or the like, the image information management Search of the classification information added at the time of decoding by the playback device is facilitated.

The twelfth embodiment (FIGS. 49 and 53:
In the case of the moving image bit stream 1000d of the multiplexed audio data for classification and multiplexing generated by the recording device for image information management relating to the addition of the audio for classification, Music, singing, human voice, etc. that change in time series are played simultaneously,
Since the switching of the image classification can be determined by referring to the switching of the sound, the operator listens to the music, singing, or the human voice for the search assistance, and slows down the speed of the image reproduction. It can be used conveniently such as stopping or stopping. This is also claim 18
Corresponding to

[Embodiment 14] Embodiment 14 corresponds to claim 20. FIG. 57 shows a fourteenth embodiment.
1 is a block diagram showing a configuration of an image information management playback device according to the first embodiment. In FIG. 57, reference numerals 201 to 216 are the same as those in FIG. 54 (the thirteenth embodiment), and a description thereof will be omitted. Reference numeral 219 denotes classified color information specifying means for specifying classified color information qj corresponding to the colored rectangular frame image data Qj relating to the classification to be searched. The designation is performed by operating the input operation unit 209.
In the recording apparatus for managing image information according to the ninth embodiment (FIG. 38), the colored rectangular frame image data Qi is generated by the classification partial image data adding means 129 for the selected still image data compressed and encoded. It is superimposed and added in correspondence with the classification identifier γi (FIG. 39).
To steps S402 and S403 in FIGS. 41 and 42). The image compression-encoded data to which the colored rectangular frame image data Qi is added is arranged along the time axis according to the classification identifier and the intra-class sequence number, and FIG.
A moving image bit stream 1000c with a rectangular frame for classification as shown in FIG. 41 is generated and recorded in the image data storage unit 204 (104). The code 2
Reference numeral 20 denotes classified color information q corresponding to the colored rectangular frame image data Qi analyzed by the moving image bit stream analysis means 210.
It is determined whether or not i and the classified color information qj specified by the classified color information specifying means 219 match. Only when the two match, the decoding of the moving image bit stream / audio bit stream is permitted. If it does not, it does not permit decoding, and if it does not match after matching, it is a classified color information determining means that functions to end the reproduction processing operation.

Next, the operation of the image information management reproducing apparatus according to the fourteenth embodiment configured as described above in the classification designated search reproducing mode will be described with reference to the flowchart of FIG. When the user designates the classified color designation search / playback mode by the input operation means 209, the processing from step S1201 is started. In step S1201, the process waits until the classified color designation search / playback mode is designated, and then proceeds to step S120.
The process proceeds to step S2, where the classified color information qj input from the input operation unit 209 is set in the classified color information designating unit 219. In step S1203, the control unit 201 accesses the image data storage unit 204, inputs a moving image bit stream generally including an audio bit stream, and transfers the moving image bit stream to the moving image bit stream analysis unit 210. Step S12
At 04, the moving picture bit stream analyzing means 210 analyzes the transferred moving picture bit stream. In step S1205, classification color information qi of the colored rectangular frame image data Qi added to the image compression-encoded data is determined. In step S1206, the classified color information determination unit 220 compares the calculated classified color information qi with the classified color information qj set in the classified color information designating unit 219, and in step S1207, determines from the moving image bit stream. Whether or not the classified color information qi matches the set classified color information qj (qi =
qj? ), And if they do not match, the flow returns to step S1204 to analyze a moving image bit stream including an audio bit stream input one after another without permitting decoding of the bit stream. Step S12
If it is determined in step 07 that the classified color information qi determined from the moving image bit stream matches the set classified color information qj, step S12 is performed to permit decoding.
In step 08, the moving image / audio separating unit 211 separates the moving image bit stream including the audio bit stream into a moving image bit stream and an audio bit stream. In step S1209, the moving image decoding unit 212 decodes the separated moving image bit stream according to the analysis result by parallel processing, and the audio decoding unit 213 decodes the audio bit stream according to the analysis result. In step S1210, the display control unit 207 Image data decoded under the control of
The image data is displayed as an image by the display unit 206 via the display unit 05, and the decoded audio data is output to the audio output unit 208 and output as audio. Then, step S12
At 11, the classified color information determination means 220 determines whether or not the classified color information qi determined from the image compression encoded data of the moving image bit stream does not match the set classified color information qj, and continues the matched state. If so, the process returns to step S1204 and repeats the same processing as described above. If the classified color information qi no longer matches the set classified color information qj, all the processing ends. As described above, the classified color information qj set by the operator
The decoding is automatically started when the image compression encoded data having the classified color information qi that matches
In addition, only the matching image compression encoded data is decoded and displayed on the display unit 206. Then, the classified color information q set by the classified color information qi of the image compression encoded data
Decoding automatically ends when it no longer matches j. In the case of a moving image bit stream without an audio bit stream, it goes without saying that the processing related to the audio bit stream is omitted.

When the determined classified color information qi matches the set classified color information qj, the reproducing speed may be controlled to slow down the reproducing speed.

As described above, according to the reproducing apparatus for managing image information according to the fourteenth embodiment, the colored rectangular frame for classification in which the colored rectangular frame image data Qi is multiplexed in the image data storage means 204 (104). An attached moving image bit stream 1000c (see FIG. 41) is stored, an operator sets classified color information qj to be searched, and an image of a moving image bit stream with a colored rectangular frame for classification according to the set classified color information qj. Since the compression-encoded data is extracted and automatically decoded, a still image of a specified specific classification is reproduced in a state of a moving image, and an image to be searched can be quickly found.

If the classified color information designating means 219 and the classified color information judging means 220 are not activated, the still images of all the classifications are arranged in order by the classification, and the colored rectangular frame image data Qi will also be reproduced at the same time. For example, a green colored rectangular frame meaning "mountain scenery" or a blue colored rectangular frame meaning "coastal scenery" is displayed simultaneously and continuously. Since the reproduction is performed, a coarse search, that is, a high-speed search can be performed.
When a desired portion is reproduced, the speed of image reproduction can be slowed down or stopped.

The twelfth embodiment (FIGS. 49 and 53:
In the case of the moving image bit stream 1000d of the multiplexed audio data for classification and multiplexing generated by the recording device for image information management relating to the addition of the audio for classification, Music, singing, human voice, etc. that change in time series are played simultaneously,
Since the switching of the image classification can be determined by referring to the switching of the sound, the operator listens to the music, singing, or the human voice for the search assistance, and slows down the speed of the image reproduction. It can be used conveniently such as stopping or stopping.

[Embodiment 15] Embodiment 15 corresponds to claim 21. FIG. 59 shows a fifteenth embodiment.
1 is a block diagram showing a configuration of an image information management playback device according to the first embodiment. In FIG. 59, reference numerals 201 to 216 are the same as those in FIG. 54 (the thirteenth embodiment), and a description thereof will not be repeated. A reference numeral 221 denotes a label color designation unit for designating label color information rj corresponding to the label color data Ri for the category to be searched. The designation is performed by operating the input operation unit 209. In the image information management recording apparatus according to the tenth embodiment (FIG. 43), the classification label color bitstream adding means 132 corresponds to the classification identifier γi for the compression-encoded selected still image data. Then, the bit stream 1100 of the label color data for classification Ri is added to the first line first macroblock 1050. The image compression-encoded data in which the bit stream of the label color data for classification Ri is added to the head macroblock of the first line is arranged along the time axis according to the classification identifier and the sequence number within the classification, and the moving image bit stream Is generated and recorded in the image data storage unit 204 (104). Reference numeral 222 denotes a moving image 1 macroblock decoding unit that decodes the first line top macroblock of the separated moving image bitstream, and 223 denotes classification label color data analyzed by the moving image bitstream analysis unit 210. The label color information ri corresponding to Ri and the label color information r specified by the labeling color specification means 221 for classification.
j is determined whether or not they match, and only when they match,
The decoding of the first macroblock of the first line and the decoding of the audio bit stream of the separated moving image bit stream by the moving image 1 macro block decoding unit 222 are permitted. When they do not match, the decoding is not permitted. ,
This is label color information determination means that functions so as to end the reproduction processing operation when a mismatch occurs after a match.

Next, the operation of the image information management / reproduction apparatus according to the fifteenth embodiment configured as described above in the classification label color designation search / reproduction mode will be described with reference to the flowcharts of FIGS. When the classification label color designation search / playback mode is designated by the input operation means 209,
Processing from step S1301 is started. In step S1301, the process proceeds to step S1302 after the classification label color designation search / play mode is designated, and the label color information rj input from the input operation means 209 is set in the classification label color designation means 221. Step S1
At 303, the control means 201 determines whether the image data
In general, a video bit stream including an audio bit stream is input by accessing the video data stream 04 and transferred to the video bit stream analysis unit 210. In step S1304, the moving image bit stream analysis unit 210 analyzes the transferred moving image bit stream. And
In step S1305, label color information ri of the classification label color data Ri of the classification label color bit stream added to the image compression encoded data is determined. In step S1306, the label color information determination unit 223
Compares the determined label color information ri with the label color information rj set in the classification label color specifying means 221 and sets the label color information ri calculated from the moving image bit stream in step S1307. It is determined whether or not it matches the label color information rj (ri = rj?). Analyzes a moving image bit stream including a stream. If it is determined in step S1307 that the label color information ri determined from the video bitstream matches the set label color information rj, the flow advances to step S1308 to permit decoding, and the video / audio separation unit 211 is executed. Separates a video bitstream including an audio bitstream into a video bitstream and an audio bitstream. In step S1309, the moving image 1 macroblock decoding unit 222 decodes the first line first macroblock of the separated moving image bitstream according to the analysis result, and the audio decoding unit 213 analyzes the audio bitstream by parallel processing. A band-shaped label color image for classification 1110 obtained by decoding the first line first macroblock under the control of the display control means 207 in step S1310 is displayed on the screen of the display means 206 as shown in FIG. And the decoded audio data is output to the audio output means 208 and output as audio. At this stage, only the band-shaped classification label color image 1110 is displayed on the screen of the display means 206 as shown in FIG. Therefore, the operator decides whether or not to reproduce and display one frame of the entire image compression-encoded data corresponding to the entire screen included in the separated moving image bit stream. 209 gives an instruction. In step S1311, the control unit 201 determines whether or not to play back the entire screen.
Proceeds to step S1312 to reproduce the entire screen.
Then, the moving image decoding unit 212 is activated, and the moving image decoding unit 212 decodes the entire image compression-encoded data for one frame, and displays the entire image for one frame decoded in step S1313 on the display unit 206. To be displayed.
Then, in step S1314, the label color information determination unit 223 determines whether or not the label color information ri determined from the image compression coded data of the moving image bit stream no longer matches the set label color information rj, and determines whether the label color information ri matches. Is continued, the process returns to step S1304 and the same processing as described above is repeated. However, when the determined label color information ri does not match the set label color information rj, all the processing ends. As described above, the decoding is automatically started when the image compression encoded data having the label color information ri that matches the label color information rj set by the operator is input, and the matching image compression encoding is performed. Only the first line head macroblock of the data is decoded and displayed on the display means 206. In addition, the entire screen can be displayed by an instruction. Then, when the label color information ri of the image compression encoded data does not match the set label color information rj, the decoding automatically ends. In the case of a moving image bit stream without an audio bit stream, it goes without saying that the processing related to the audio bit stream is omitted.

When the determined label color information ri matches the set label color information rj, the reproducing speed may be controlled to slow down the reproducing speed.

As described above, according to the reproducing apparatus for managing image information according to the fifteenth embodiment, the classification label color bit stream corresponding to the classification label color data Ri is stored in the image data storage means 204 (104). The added moving image bit stream is stored, and the operator sets the label color information rj to be searched, and the classification label color bit stream corresponding to the classification label color data Ri is set according to the set label color information rj. Since the image compression encoded data of the added moving image bit stream is extracted and only the first line first macroblock is automatically decoded, the processing speed is high, and the image portion to be searched can be quickly found. Further, in accordance with the instruction, the whole of the set still image of the specific classification can be displayed together with the band-shaped classification label color image.

[Embodiment 16] A moving image bit stream generated by the image information management recording apparatus of each of Embodiments 1 to 12 or a moving image bit stream generated by a conventional image information management recording apparatus When playing and browsing (viewing) a stream, an operator often adds a search mark as a bookmark (bookmark) when there is an image to be viewed again later. In such a case, conventionally, a search mark is added to a moving image bit stream in which a plurality of compression-encoded still image data (image compression-encoded data) are arranged along the time axis direction. In this method, a search mark bit stream is recorded by a dedicated recording unit in a portion before or after one frame of image compression encoded data at a desired location. However, the operation of recording the search mark in the original moving image bit stream in the form of a bit stream requires reading all the image compression encoded data of the entire frame corresponding to the search mark. Therefore, it is necessary to add a bit stream for search mark to, so that considerable work is required. The first embodiment is to solve this inconvenience.
6 is an image information management playback device according to the sixth embodiment. Embodiment 1
6 corresponds to claim 22.

FIG. 62 is a block diagram showing the structure of the playback device for managing image information according to the sixteenth embodiment. 62, reference numerals 201 to 216 correspond to FIG.
Since the configuration is the same as that of (Embodiment 13), the description is omitted. Reference numeral 224 denotes a predetermined requirement at the time of reproduction of a moving image bit stream, that is, a portion of an image where the operator wants to view again and writes search mark information (corresponding to the count value of the time counter of the frame).
Is specified by the search mark writing position specifying means 225 again when the moving image bit stream is reproduced, and the search mark information specified by the search mark writing position specifying means 224 is to be written. Search mark writing means for writing search mark information in a user data area following a header of a picture layer corresponding to one frame;
26 is a user data area extracting means for extracting a user data area of a picture layer, and 227 is a search mark detecting means for detecting search mark information written in a user data area of a moving image bit stream.

Next, the operation of the image information management reproducing apparatus according to the sixteenth embodiment configured as described above in the search mark writing position designation mode will be described with reference to the flowchart of FIG. When the search mark writing position designation mode is designated by the input operation unit 209, the processing from step S1401 is started. After waiting for the search mark writing position designation mode being instructed in step S1401, the flow advances to step S1402 to wait for the input operation means 209 to input the count value of the time counter of the frame in which search mark information is to be written. When the count value of the time counter of the frame is input, in step S1403 the search mark writing position designating means 22
4 sets the count value of the time counter. In step S1404, the control unit 201 determines whether or not the search mark writing position designation mode has ended. If not, the process returns to step S1402 to repeat the same processing. By this repetition processing, the count value of the time counter for specifying the search mark writing position can be set for each of the plurality of images. When the search mark writing position designation mode ends, all the processing ends.

Next, the operation in the search mark writing mode will be described with reference to the flowchart of FIG. When the search mark writing mode is instructed by the input operation unit 209, the processing from step S1501 is started. Step S
After waiting for the search mark writing mode being instructed in 1501, the process proceeds to step S1502, where the user data area extraction unit 226 accesses the image data storage unit 204 which generally stores a moving image bit stream including an audio bit stream. The start code of the header of the picture layer for the image compression-encoded data for each frame is read out, and the read start code is read in step S1503 by the time count value of the frame set in the search mark writing position specifying means 224. Compare with In step S1504, it is determined whether or not the read start code matches the set time count value.
5 and proceed to the next frame, and then go to step S150.
Return to 3. If they match, the flow advances to step S1506, and the user data area extraction unit 226 extracts a user data area following the picture layer header of the frame. In step S1507, search mark writing unit 2
Reference numeral 25 writes search mark information to be a bookmark (bookmark) at the time of search and reproduction again in the extracted user data area of the picture layer. In step S1508, it is determined whether the writing process of the search mark information has been completed for all the time count values set in the search mark writing position specifying means 224. Then, the process returns to step S1503, and the same processing is repeated thereafter. When the processing of writing the search mark information has been completed for all the time count values, all the processing ends.

Next, the operation in the search mark reproduction mode, which is reproduction using search mark information, will be described with reference to the flowchart in FIG. When a search mark reproduction mode is designated by the input operation unit 209, step S1601 is performed.
The processing from is started. In step S1601, the process proceeds to step S1602 after the search mark reproduction mode is instructed, and the control unit 201 accesses the image data storage unit 204 to input a moving image bit stream including an audio bit stream in general. The data is transferred to the stream analysis means 210. Step S160
In step 3, the moving image bit stream analysis unit 210 analyzes the transferred moving image bit stream, and determines in step S1604 whether the search mark detection unit 227 has detected the search mark information. If not detected, the flow advances to step S1605 to advance to the next frame, and then returns to step S1603. When the search mark information is detected, that is, when the search mark information is written in the user data area following the header of the picture layer of the image compression-encoded data of the currently input frame, the process proceeds to step S1606, and the process proceeds to step S1606. The audio separating unit 211 separates a moving image bit stream including an audio bit stream into a moving image bit stream and an audio bit stream. In step S1607, the moving image decoding unit 212 decodes the separated moving image bit stream in accordance with the analysis result by parallel processing, and the audio decoding unit 213 decodes the audio bit stream in accordance with the analysis result. The decoded image data is displayed as an image on the display means 206 through the frame buffer means 205 under the control of the above, and the decoded sound data is output to the sound output means 208 to be output as sound. Then, in step S1609, it is determined whether or not the next search mark information exists. If it exists, the process proceeds to step S1605, proceeds to the next frame, returns to step S1603, and thereafter repeats the same processing. When the next search mark information no longer exists, all the processing ends.

As described above, according to the reproduction apparatus for managing image information according to the sixteenth embodiment, the search mark information when there is an image to be viewed again at the time of another search and reproduction corresponds to the corresponding one frame. Since the configuration is such that writing is performed in the user data area following the header of the picture layer to be searched, the writing operation of the search mark information reads out the entire image compression encoded data of one frame in order to add the search mark information as a bit stream. It is much easier and can be processed in a shorter time than conventional techniques. Then, at the time of search and reproduction again, it is possible to jump to the image that the user wants to view and reproduce the image, thereby improving the workability of the search and reproduction.

The search mark writing means 225
If any search mark information is selected from a plurality of types of search mark information and is written in the user data area, a search can be performed for a moving image bit stream in which a plurality of search mark information is written. By specifying the type of mark information, it is possible to skip a frame in which another search mark information is written and jump to a frame in which the specified search mark information is written to start reproduction. This corresponds to claim 23.

[Embodiment 17] Embodiment 17 corresponds to claim 24. A feature of the seventeenth embodiment is that sound is added to image compression-encoded data as a search mark as a bookmark.

FIG. 66 is a block diagram showing the structure of the image information management reproducing apparatus according to the seventeenth embodiment. In FIG. 66, reference numerals 201 to 216 correspond to FIG.
Since the configuration is the same as that of (Embodiment 13), the description is omitted. Reference numeral 224 denotes a predetermined requirement at the time of reproduction of a moving image bit stream, that is, a portion of an image in which the operator wants to view again and writes audio information for a search mark (corresponding to a count value of a time counter of the frame). Is designated as a search mark writing position designating means 228 is a sound data input means connected to a CD player, an audio tape recorder or a microphone for inputting sound data for a search mark, and 229 is for inputting sound data for a search mark. An audio encoding unit 230 for compression encoding is an image / audio multiplexing unit.

The operation of the image information managing / reproducing apparatus of the seventeenth embodiment configured as described above in the search mark writing position designation mode is the same as that shown in the flowchart of FIG. Is the same. By this operation, the count value of the time counter of the frame in which the search mark audio information is to be written is set in the search mark writing position specifying means 224. A plurality of time count values can be set.

Next, the operation in the search mark audio information addition mode will be described with reference to the flowchart in FIG. When the search mark voice information addition mode is instructed by the input operation unit 209, the processing from step S1701 is started. In step S1701, the process waits until the search mark voice information addition mode is instructed in step S1701.
Proceeding to 702, the control means 201
In general, a video bit stream including an audio bit stream is input by accessing the video data stream 04 and transferred to the video bit stream analysis unit 210. In step S1703, the moving image bit stream analysis unit 210 analyzes the transferred moving image bit stream, and specifies the start code of the header of the picture layer of the image compression coded data of the currently input frame to specify the search mark writing position. The value is compared with the time count value of the frame set in the means 224, and it is determined in step S1704 whether or not they match. If they do not match, the process proceeds to step S1705, proceeds to the next frame, and then returns to step S1703. If they match, the flow advances to step S1706 to set the parallel processing mode.
Accesses the image data storage unit 204 and reads out a moving image bit stream that may include an audio bit stream of a frame having a start code that matches the time count value, while activating the audio data input unit 228 in step S1708 Then, audio data for a search mark is input, and in step S1709, the audio encoding unit 229 is activated to compress and encode the input audio data. Then, in step S1710, the image
The audio multiplexing means 230 multiplexes the audio compression coded data with the read video compression coded data of the moving image bit stream, and stores the image / audio multiplexed data in the original image data storage means 204 as a search mark. Audio information is multiplexed and stored as a multiplexed moving image bit stream. In step S1711, it is determined whether the multiplexing process of the search mark audio information has been completed for all the time count values set in the search mark writing position specifying unit 224, and if not completed, the process proceeds to step S1705. After proceeding to the next frame, the process returns to step S1703, and the same processing is repeated thereafter. When the multiplexing process of the search mark audio information is completed for all the time count values, all the processes are completed.
The search mark audio information to be multiplexed may be, for example, music suitable for the type of the image of the frame, or may be a human voice such as "Mountain landscape screen" or "Checkpoint 1".

At the time of the next reproduction, the same processing as that in the flowchart of FIG. 55 in the thirteenth embodiment is performed. That is, the control unit 201 accesses the image data storage unit 204 to input a moving image bit stream in which the search mark audio information is multiplexed, and transfers the moving image bit stream to the moving image bit stream analyzing unit 210. The moving image bit stream analyzing unit 210 analyzes the transferred moving image bit stream, and sets a parallel processing mode because the moving image bit stream includes a bit stream of search mark audio information. A video bit stream including a bit stream of audio information for use is separated into a video bit stream and a bit stream of audio information for search marks. The moving image decoding unit 212 decodes the moving image bit stream according to the analysis result by the moving image bit stream analysis unit 210 to reproduce image data,
Under the control of the display control means 207, the decoded image data is displayed on the display means 20 via the frame buffer means 205.
6 is displayed as an image. At the same time, the audio decoding unit 213 decodes the bit stream of the search mark audio information according to the analysis result to reproduce the search mark audio data, and outputs the decoded search mark audio data to the audio output unit 208. , And output as search mark audio.

As described above, according to the image information management reproducing apparatus of the seventeenth embodiment, the search mark audio information when there is an image to be viewed again at the time of retrieving and reproducing again, Since it is multiplexed with the image compression coded data and stored again as a moving image bit stream in the image data storage unit 204, it can be reproduced while listening to the search mark audio information at the time of retrieval and reproduction, and an accurate image retrieval without overlooking. Can be done at high speed.

The function of the image information management recording apparatus according to any one of the first to twelfth embodiments and the function of the thirteenth embodiment
It is also possible to configure a recording / reproducing apparatus for image information management in which the function of the reproducing apparatus for image information management is integrated with any of the functions of any one of (1) to (17). It can have both the function and the function.

[0234]

According to the image information management recording apparatus of the present invention, the still image data is sequentially read out from the image data storage means and selected as a component of the moving image bit stream. The order of arrangement in the time axis direction is determined for each of the still image data, and the still image data read out in accordance with the arrangement order in the time axis is compression-encoded to generate image compression-encoded data and temporarily stored. Since the stored image compression encoded data is read out in the order of arrangement in the time axis direction and recorded as a moving image bit stream, it is scattered in the image data storage means. Still images (still images in a broad sense including each frame that is a component of a moving image) are sequentially read and selected, and arranged in the time axis direction. Summary One of the moving picture bit stream lined I, can be recorded the moving image bit stream thereof combined. If a moving image bit stream generated by arranging a plurality of still images along the time axis direction is recorded in this manner, browsing (viewing) at a low speed or a high speed at the time of searching by the image information management reproducing apparatus is performed. Becomes possible.

According to the reproducing apparatus for managing image information according to the present invention, the image compression encoded data of a plurality of still image data are arranged in the time axis direction, and the information for classification is classified for each image compression encoded data. The video bit stream described above is input from a video data storage unit in which a video bit stream to which a character string or a hue is added is stored and analyzed, and the video bit stream is decoded according to the analysis result. When the image data is reproduced and the image data is displayed, information relating to the classification to be searched is specified, and when the information for this classification matches the information determined as a result of the analysis. Since it is configured to decode the input moving image bit stream, when searching and reproducing a still image, a recording medium as in the prior art is used. Compared to the case of searching for scattered still images while searching each directory, a plurality of still images are selected in advance and reproduced as a moving image bit stream arranged along the time axis, so that browsing (viewing, streaming) 2), and an image can be efficiently searched. When the operator sets information for a classification to be searched, image compression encoded data corresponding to the information is extracted from the moving image bit stream and automatically decoded. Will be played back as a moving image, eliminating the need to play back all still images.
You can quickly find the image you want to search.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a recording device for image information management according to Embodiment 1 of the present invention.

FIG. 2 is an explanatory diagram showing how frame order numbers are sequentially assigned in the first embodiment.

FIG. 3 is a diagram showing components of a moving image bit stream generated as a result of sequentially assigning frame order numbers in the first embodiment.

FIG. 4 is a schematic diagram of a moving image bit stream generated in the first embodiment.

FIG. 5 is a flowchart for explaining the operation of the first embodiment.

FIG. 6 is a flowchart for explaining the operation of the first embodiment (continuation of FIG. 5).

FIG. 7 is a flowchart for explaining the operation of the first embodiment (continuation of FIG. 6);

FIG. 8 is a flowchart for explaining the operation of the first embodiment (continuation of FIG. 7);

FIG. 9 is a block diagram showing a configuration of an image information management recording device according to Embodiment 2 of the present invention.

FIG. 10 is a flowchart for explaining the operation of the second embodiment.

FIG. 11 is a diagram showing components of a moving image bit stream generated in the second embodiment.

FIG. 12 is a schematic diagram of a moving image bit stream generated in the second embodiment.

FIG. 13 is a block diagram showing a configuration of a recording device for image information management according to Embodiment 3 of the present invention.

FIG. 14 is a flowchart for explaining the operation of the third embodiment.

FIG. 15 is a block diagram showing a configuration of an image information management recording device according to Embodiment 4 of the present invention.

FIG. 16 is a flowchart for explaining the operation of the fourth embodiment.

FIG. 17 is a flowchart illustrating the operation of the fourth embodiment (continuation of FIG. 16).

FIG. 18 is a diagram illustrating an example of m × n still image data read and displayed in the fourth embodiment.

FIG. 19 is a diagram illustrating components of a moving image bit stream having a multi-screen image file according to the fourth embodiment.

FIG. 20 is a schematic diagram of a moving image bit stream generated in Embodiment 4.

FIG. 21 is a block diagram showing a configuration of an image information management recording device according to Embodiment 5 of the present invention.

FIG. 22 is a flowchart for explaining the operation of the fifth embodiment.

FIG. 23 is a block diagram showing a configuration of an image information management recording device according to Embodiment 6 of the present invention.

FIG. 24 is a flowchart for explaining the operation of the sixth embodiment.

FIG. 25 is a schematic diagram of a moving image / audio bit stream generated in the sixth embodiment.

FIG. 26 is a block diagram showing a configuration of an image information management recording apparatus according to Embodiment 7 of the present invention.

FIG. 27 is a diagram illustrating classification of a plurality of image files according to the seventh embodiment.

FIG. 28 is a configuration diagram of a moving image bit stream in which components are arranged in the order of priority of the classification identifier and the intra-class sequence number generated in the seventh embodiment.

FIG. 29 is a schematic diagram of a moving image bit stream generated in the seventh embodiment.

FIG. 30 is a flowchart for explaining the operation of the seventh embodiment.

FIG. 31 is a flowchart for explaining the operation of the seventh embodiment (continuation of FIG. 30).

FIG. 32 is a flowchart for explaining an operation of an embodiment involving inter-picture compression encoding obtained by modifying the seventh embodiment.

FIG. 33 is a block diagram showing a configuration of an image information management recording device according to Embodiment 8 of the present invention.

FIG. 34 is a configuration diagram of a classification identifier / classification information correspondence table according to the eighth embodiment.

FIG. 35 is a configuration diagram of a video bitstream with classification information in which components are arranged in the order of priority of the classification identifier and the intra-class order number generated in the eighth embodiment.

FIG. 36 is a schematic diagram of a moving image bit stream with classification information generated in the eighth embodiment.

FIG. 37 is a flowchart for explaining the operation of the eighth embodiment.

FIG. 38 is a block diagram showing a configuration of an image information management recording device according to Embodiment 9 of the present invention.

FIG. 39 is a configuration diagram of a classification identifier / classification partial image data correspondence table according to the ninth embodiment.

FIG. 40 is a configuration diagram of a classification colored rectangular frame-equipped moving image bit stream in which components are arranged in the order of priority of the classification identifier and the intra-class sequence number generated in the ninth embodiment.

FIG. 41 is a schematic diagram of a moving image bitstream with a rectangular frame for classification generated in the ninth embodiment.

FIG. 42 is a flowchart illustrating the operation of the ninth embodiment.

FIG. 43 is a block diagram showing a configuration of an image information management recording apparatus according to Embodiment 10 of the present invention.

FIG. 44 is a configuration diagram of a classification identifier / classification label color data correspondence table according to the tenth embodiment.

FIG. 45 is an operation explanatory diagram of the tenth embodiment.

FIG. 46 is a flowchart for explaining the operation of the tenth embodiment.

FIG. 47 is a block diagram showing a configuration of an image information management recording device according to Embodiment 11 of the present invention.

FIG. 48 is a flowchart illustrating the operation of the eleventh embodiment.

FIG. 49 is a block diagram showing a configuration of a recording device for image information management according to Embodiment 12 of the present invention.

FIG. 50 is a configuration diagram of a classification identifier / classification audio data correspondence table according to the twelfth embodiment.

FIG. 51 is a flowchart for explaining the operation of the twelfth embodiment;

FIG. 52 is a flowchart for explaining the operation of the twelfth embodiment (continuation of FIG. 51);

FIG. 53 is a configuration diagram of a moving image bit stream in which classification audio compression encoded data in which components are arranged in the order of priority of the classification identifier and the intra-class sequence number generated in Embodiment 12 are multiplexed; .

FIG. 54 is a block diagram showing a configuration of an image information management playback device according to Embodiment 13 of the present invention.

FIG. 55 is a flowchart illustrating an operation during normal reproduction according to the thirteenth embodiment.

FIG. 56 is a flowchart for explaining an operation in a classification designation search / reproduction mode according to the thirteenth embodiment;

FIG. 57 is a block diagram showing a configuration of an image information management playback device according to Embodiment 14 of the present invention.

FIG. 58 is a flowchart for explaining an operation in a classification designation search / reproduction mode according to the fourteenth embodiment;

FIG. 59 is a block diagram showing a configuration of an image information management playback device according to Embodiment 15 of the present invention.

FIG. 60 is a flowchart for explaining an operation in a classification label color designation search / reproduction mode according to the fifteenth embodiment;

FIG. 61 is a flowchart for explaining the operation in the classification label color designation search / reproduction mode in the fifteenth embodiment (continuation from FIG. 60).

FIG. 62 is a block diagram showing a configuration of an image information management playback device according to Embodiment 16 of the present invention.

FIG. 63 is a flowchart for illustrating an operation in a search mark writing position designation mode according to the sixteenth embodiment.

FIG. 64 is a flowchart illustrating an operation in a search mark writing mode according to the sixteenth embodiment.

FIG. 65 is a flowchart for describing an operation in a search mark reproduction mode according to the sixteenth embodiment.

FIG. 66 is a block diagram showing a configuration of an image information management playback device according to Embodiment 17 of the present invention.

FIG. 67 is a flowchart illustrating an operation in a search mark voice information addition mode in the seventeenth embodiment.

FIG. 68 is a diagram showing the structure of a hierarchical directory for a still image existing in a file system of a conventional general computer.

FIG. 69 is a diagram schematically showing a state when still images of a plurality of frames are read out in the related art.

FIG. 70 is a diagram showing a state in which a plurality of still images are displayed as a list on a display screen as child screens in the related art.

[Explanation of symbols]

101 control means 102 program storage means 103 working memory means 104 image data storage means 105 image data input means 106 video signal receiving means 107 modem 108 network connection means 109 ... frame buffer means 110 ... display means 111 ... display control means 112 ... input operation means 113 ... image selection means 114 ... image order determination means 115 ... moving picture coding means 115a ... moving picture screen coding Means 115b Moving picture inter-picture coding means 116 Moving picture bit stream recording means 116a Moving picture / audio bit stream recording means 117 Bus 118 Pixel thinning means 119 Multi-screen image data generating means 120 ... screen difference generation means 121 ... screen difference evaluation means 122: within-screen / between-screen selection means 123 ... audio data input means 124 ... audio coding means 125 ... image / audio multiplexing means 126 ... image classification means 127 ... classification information addition means 127a ... classification identifier / Classification information correspondence table 128... Classification partial image data generation means 128a... Classification identifier / classification partial image data correspondence table 129... Classification partial image data addition means 130... Classification label color generation means 130a. / Classification label color data correspondence table 131... Classification label color bit stream generation means 132... Classification label color bit stream addition means 133... Classification GOP start code generation means 134... Classification GOP start code addition means 135... Voice data generating means for classification 135 a. Discriminator / classification audio data correspondence table 136: classification audio data encoding means 201: control means 202: program storage means 203: working memory means 204: image data storage means 205: frame buffer means 206 Display means 207 Display control means 208 Audio output means 209 Input operation means 210 Video bit stream analysis means 211 Video / audio separation means 212 Video decoding means 213 ... Audio decoding means 214... Bus 216... Reproduction speed variable means 217... Classification information specifying means 218... Classification information determining means 219. Label color designating means 222 for moving image 1 macroblock decoding means 223 Label color information Determination means 224 search mark writing position designating means 225 search mark writing means 226 user data area extracting means 227 search mark detecting means 228 voice data input means 229 voice coding means 230 ... Image / audio multiplexing means 900... Classification number / in-class sequence number 900a ... classification number 900b ... in-class sequence number 1000 ... video bit stream 1000a video / audio bit stream 1000b video with classification information Bit stream 1000c: Moving image bit stream with a colored rectangular frame for classification 1000d: Moving image bit stream with multiplexed audio compression-encoded data for classification 1050: First macroblock on first line 1100: Label bit stream for classification 1110 ... Classification label color image image

Claims (25)

[Claims] 1. An image data storage unit for storing a plurality of still image data, and an image selection unit for sequentially reading out all the still image data from the image data storage unit and selecting the still image data as a component of a moving image bit stream. Means,
Image order determining means for determining the arrangement order in the time axis direction for each of the selected plurality of still image image data, and compressing the read still image image data in accordance with the arrangement order in the time axis direction Moving image encoding means for encoding and generating and temporarily storing image compression encoded data; and reading out the image compression encoded data in the order of arrangement in the time axis direction and recording as a moving image bit stream. And a moving image bit stream recording unit. 2. An image data storage means for storing a plurality of still image data, a display means for displaying the still image data read from the image data storage means, and the displayed still image data Image selecting means for appropriately selecting as a component of a moving image bit stream, image order determining means for determining the order of arrangement in the time axis direction for each of the selected plurality of still image data, Moving image encoding means for reading the corresponding still image data from the image data storage means in accordance with the arrangement order in the time axis direction, compressing and encoding the same, generating image compression encoded data, and temporarily storing the image data; Moving image bit stream recording means for reading the compressed and encoded data in the order of arrangement in the time axis direction and recording the moving image bit stream; A recording device for image information management, comprising: 3. The apparatus according to claim 1, further comprising a pixel thinning unit that executes the pixel thinning process on the still image data read out from the image data storage unit, and then transfers the data to the moving image encoding unit. The recording device for image information management according to claim 1 or 2, wherein 4. A multi-picture system in which a plurality of still picture image data read out from the picture data storage means by the picture order determining means is combined into still picture image data for one frame of a multi-screen and transferred to the moving picture coding means. 4. The image information management recording device according to claim 1, further comprising a screen image data generating unit. 5. An inter-screen difference generating means for generating an inter-screen difference between adjacent selected still image data read from the image data storage means, and a screen for comparing the generated inter-screen difference with a predetermined value. An intra-screen / screen which selects inter-frame coding when the inter-screen difference is equal to or less than a predetermined value, and selects intra-screen coding when the inter-screen difference is larger than a predetermined value. The inter-screen selecting means, the moving picture inter-picture coding means which is activated when the inter-picture compression coding is selected and performs the inter-picture compression coding of the selected still picture image data, and the intra-picture compression coding are selected. The image information according to any one of claims 1 to 4, further comprising: a moving picture intra-screen encoding unit that is activated when the selected still picture image data is subjected to intra-picture compression encoding. Management recording device. 6. Speech coding means for compressing and coding input search aid speech data to generate speech compression coded data, image compression coded data from a moving picture coding means, and said speech coding means. Image / audio multiplexing means for multiplexing the audio compression / encoded data from the unit in units of one frame to generate image / audio multiplexed data, and the generated image / audio multiplexing in place of the moving image bit stream recording means. 6. A moving picture / audio bit stream recording means for reading encoded data in a predetermined time axis direction and recording it as a moving picture / audio bit stream. The recording device for image information management according to any one of the above. 7. An image classifying unit for adding a classification identifier as a classification number to selected still image data according to predetermined requirements, wherein the image order determining unit determines the selected still image data to which the classification identifier has been added. 2. The system according to claim 1, wherein an order number within the category is added as a sort order in the time axis direction in the category identifier.
The recording device for image information management according to any one of claims 1 to 6. 8. The image processing apparatus according to claim 7, wherein the image classifying means is configured to add a classification identifier as a classification number based on a hue included in the still image data at the highest ratio. Recording device for image information management. 9. A moving picture inter-picture encoding means for performing inter-picture compression encoding on selected still picture image data having the same classification identifier as the classification number. The recording device for image information management described in the above. 10. A moving picture bit stream, comprising: classification information adding means for adding classification information corresponding to a classification identifier as a classification number to image compression encoded data read when generating a moving image bit stream; 10. The video recording apparatus according to claim 7, wherein the stream recording unit is configured to record a moving image bit stream with classification information.
The recording device for image information management according to any one of the above. 11. The image information management recording apparatus according to claim 10, wherein the classification information is recorded in a user data area of a header of the image compression coded data. 12. A classification partial image data generating means for generating classification partial image data corresponding to a classification identifier for image compression-encoded data read when generating a moving image bit stream; A classification partial image data adding means for superimposing the classified partial image data to the read image compression-encoded data in a superimposed manner. 10. The image information management recording device according to claim 7, wherein the recording device is configured to record the moving image bit stream of (1). 13. The image information management recording apparatus according to claim 12, wherein the classification partial image data is configured as colored rectangular frame image data. 14. Classification label color generation means for generating hue classification label color data corresponding to a classification identifier for image compression encoded data read when generating a moving image bit stream; Classification label color bit stream generating means for generating a classification label color bit stream for one macroblock corresponding to the generated classification label color data, and image compression encoding data for the generated classification label color bit stream. Means for adding a label color bitstream for classification to be added as the first macroblock of the first line or the last line in
10. The image information management according to claim 7, wherein the moving image bit stream recording means is configured to record as a moving image bit stream with a classification label color bit stream. Recording device. 15. An image classification unit classifies still images according to predetermined requirements, and groups still images of the same classification into the same GOP.
(Group of pictures; an encoding unit defined by MPEG), the still image data is configured to include a classification identifier, and
Classification GOP start code generation means for generating a classification GOP start code for setting the GOP header corresponding to the classification identifier for the image compression encoded data read when generating the moving image bit stream; To add the generated classification GOP start code to the GOP header in the image compression encoded data.
10. An apparatus according to claim 7, further comprising an OP start code adding means, wherein the moving image bit stream recording means records the moving image bit stream with a classification GOP start code as a moving image bit stream. The recording device for image information management according to any one of the above. 16. Classification audio data generation means for generating classification audio data corresponding to a classification identifier attached to image compression encoded data read when generating a moving image bit stream; Classification audio data encoding means for compressing and encoding the classification audio data to generate classification audio compression encoded data, image compression encoded data from a moving image encoding means, and the classification audio data encoding means Image / audio multiplexing means for multiplexing the audio compression-encoded data for classification to generate image / classification audio multiplexed data, and the generated image / classification A moving image in which audio multiplexed data is read out according to a predetermined arrangement order in the time axis direction and recorded as a moving image bit stream with audio compression encoded data for classification. 10. The image information management recording device according to claim 7, further comprising an audio bit stream recording unit. 17. A moving picture bit stream recording means according to any one of claims 1 to 16, wherein said moving picture bit stream recording means is also used as an image data storage means. The image information management recording device according to any one of the above. 18. A moving image in which image compression encoded data of a plurality of still image data is arranged in the time axis direction and audio compression encoded data for search assistance is multiplexed for each image compression encoded data. A moving image / bit stream analyzing means for inputting and analyzing the moving image / audio bit stream from an image data storage means in which an audio bit stream is stored; and Moving image / audio separating means for separating the image data into a stream, moving image decoding means for decoding the separated moving image bit stream according to the analysis result to reproduce image data, and display means for displaying the reproduced image data; Audio decoding means for decoding the separated audio bit stream according to the analysis result and reproducing the audio data; And a sound output means for outputting the obtained sound data. 19. An image data storing a moving image bit stream in which image compression encoded data of a plurality of still image data are arranged in the time axis direction and classification information is added to each of the image compression encoded data. A moving image bit stream analyzing means for inputting and analyzing the moving image bit stream from a storage means, a moving image decoding means for decoding the moving image bit stream according to the analysis result and reproducing image data, and a reproduced image What is claimed is: 1. A reproduction apparatus for image information management, comprising: display means for displaying data, comprising: classification information specifying means for specifying classification information relating to a classification to be searched; Determining whether the output classification information matches the specified classification information, and inputting a moving image bit stream when the classification information matches; And a classification information determining means for permitting decoding of the image information. 20. A moving image bit stream in which image compression encoded data of a plurality of still image data are arranged in the time axis direction and colored rectangular frame image data is multiplexed for each image compression encoded data is stored. A moving image bit stream analyzing means for inputting and analyzing the moving image bit stream from the image data storing means, a moving image decoding means for decoding the moving image bit stream according to the analysis result and reproducing the image data, A reproduction apparatus for image information management, comprising: display means for displaying reproduced image data, a classification color information specification means for specifying classification color information relating to a classification to be searched; It is determined whether or not the classified color information of the colored rectangular frame image data determined as a result of the analysis of the means matches the specified classified color information. A reproduction device for managing image information, comprising: classified color information determination means for permitting decoding of a moving image bit stream input when the two match. 21. A moving image in which image compression-encoded data of a plurality of still image data are arranged in the time axis direction and a classification label color bit stream is added to a first line first macroblock in the image compression-encoded data. A moving image bit stream analyzing means for inputting and analyzing the moving image bit stream from the image data storing means in which the image bit stream is stored, and a moving image for reproducing the image data by decoding the moving image bit stream according to the analysis result An image information management reproducing apparatus comprising an image decoding unit and a display unit for displaying reproduced image data, wherein a classification label color designation unit for designating label color information related to a classification to be searched; And the label color of the first line first macroblock determined as a result of the analysis by the video bitstream analysis means. Label color information determining means for determining whether or not the information matches the designated label color information and permitting decoding of the first line first macroblock of the moving picture bit stream input when the information is matched; A video 1 macroblock decoding means for decoding only the first macroblock of the first line of the video bitstream separated when there is a video bitstream. 22. The moving image bit stream is input from image data storage means in which a moving image bit stream in which a plurality of image compression encoded data of still image data are arranged in a time axis direction is stored. Image information management comprising: a moving image bit stream analyzing means for analyzing; a moving image decoding means for decoding the moving image bit stream according to the analysis result to reproduce image data; and a display means for displaying the reproduced image data. Mark search position specifying means for specifying a time axis direction position of a frame in which search mark information is to be written, and a time axis of a frame currently input based on the analysis result of the moving image bit stream analyzing means. When the direction position and the time axis direction position set in the search mark writing position specifying means match, the image pressure of each frame is A user data area extracting means for extracting a user data area of the compression-encoded data, a search mark writing means for writing search mark information in the extracted user data area, A search mark detecting means for detecting the search mark information and permitting decoding of the moving image bit stream. 23. The apparatus according to claim 22, wherein the search mark writing means is configured to select arbitrary search mark information from a plurality of types of search mark information and write the selected search mark information in a user data area. Image information management playback device. 24. The moving image bit stream is inputted from an image data storage means in which a moving image bit stream in which a plurality of image compression encoded data of still image data are arranged in a time axis direction is stored. Image information management comprising: a moving image bit stream analyzing means for analyzing; a moving image decoding means for decoding the moving image bit stream according to the analysis result to reproduce image data; and a display means for displaying the reproduced image data. A search mark writing position specifying means for specifying a time axis position of a frame in which search mark sound information is to be multiplexed; a sound data input means for inputting search mark sound data;
Audio encoding means for compressing and encoding input audio data, and image / audio multiplexing for multiplexing the audio compression encoded data with image compression encoded data of a moving image bit stream read from the image data storage means Means for analyzing the moving image bit stream when the time axis direction position of the currently input frame coincides with the time axis direction position set in the search mark writing position designation means according to the analysis result. A video bit stream obtained by activating the image / audio multiplexing means, multiplexing the audio compression coded data with the image compression coded data of the frame, and multiplexing the compression coded data of the search mark audio information; Is stored in the image data storage means. 25. A function of the recording device for image information management according to claim 1, wherein
25. A recording / reproducing apparatus for image information management, wherein the function of any one of claims 8 to 24 is integrated.