JP2001243232A - Digital moving picture processor, digital moving picture processing method and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently execute retrieval and reproduction by purpose of sound, images with characters which are recorded for a long time. SOLUTION: A desired image is efficiently retrieved by making the retrieval about data in a range indicated by an index possible to be easily performed by adding indexes to digital image data, generating an index group by grouping the indexes and easily performing the retrieval for data in a range indicated by the indexes by performing image retrieval by selecting the generated index group.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital moving picture processing apparatus, a digital moving picture processing method, and a storage medium.
It is suitable for use in a digital image editing device.

[0002]

2. Description of the Related Art Recently, it has become possible to record digital images with sound over a long period of time due to the development of high-density recording media and the improvement of image information compression techniques. In order to search for a specific image from images recorded over such a long time, it takes an enormous amount of time to reproduce and search all the images. Therefore, a method of searching for a specific image while playing back a specific location step by step has been performed.

[0003]

As described above, when an image at a specific location is reproduced at intervals, the time required for reproduction is reduced as compared with the case of searching for an image recorded for a long time. be able to. However, even in the case of searching as described above, if there are a plurality of types of playback purposes, there is a disadvantage that the setting of the playback location must be reset for each purpose, and the search operation efficiency cannot be greatly rationalized. There was a case.

SUMMARY OF THE INVENTION [0004] In view of the above-described problems, it is a first object of the present invention to enable a search for an image recorded for a long time and a search for each purpose to be efficiently executed.
It is a second object of the present invention to be able to efficiently search for images recorded with sound and text recorded for a long time and search by purpose.

[0005]

According to the digital moving picture processing apparatus of the present invention, an index is added to digital image data, the index is grouped to generate an index group, and the generated index group is selected to select an image. It is characterized by performing a search. Another feature of the present invention is that: an index adding unit that adds an index to the digital image data; an index grouping unit that groups the index to generate an index group;
Selecting means for selecting the index group. Another feature of the present invention is that storage means for storing digital image data, character data, and audio data associated with each other, index adding means for adding an index to the digital image data, It is characterized by comprising index grouping means for generating an index group by grouping, and selecting means for selecting the index group. Another feature of the present invention is that storage means for storing digital image data, character data, and audio data associated with each other, and the digital image data and the character data are displayed on a screen of a display device. Display means; audio output means for outputting the audio data as audio; index adding means for adding an index to the digital image data; index grouping means for grouping the indexes to generate an index group; Selecting means for selecting a group. Another feature of the present invention is that some of the above-mentioned indexes extend over a plurality of index groups. Another feature of the present invention is that indexes in the same group have start and end meanings. Another feature of the present invention is that the addition of the index is performed for each frame of the image. Another feature of the present invention is that one of the index groups has a start and end index at a location where audio data is turned on or a location where audio data is turned off. . Another feature of the present invention is that one of the index groups has a start and end index at a position where character data is turned on or a position where character data is turned off. . Another feature of the present invention is that one of the index groups has a start index and an end index for each predetermined number of image frames. Another feature of the present invention is that one of the above-mentioned index groups has a start and end index at arbitrary positions by an operator. Another feature of the present invention is that digital image data between the start index and the end index, display of character data,
Alternatively, the audio data is output. Another feature of the present invention is that digital image data, character data, and audio data are searched between the start index and the end index.

A digital moving picture processing method according to the present invention is characterized in that an index is added to digital image data, an index group is generated by grouping the index, and an image search is performed by selecting the generated index group. The digital moving image processing method. Another feature of the present invention is that an index adding process for adding an index to digital image data, an index grouping process for grouping the indexes to generate an index group, and a selection for selecting the index group And processing is performed. Further, other features of the present invention include a storage process of storing digital image data, character data, and audio data associated with each other in a storage unit, an index adding process of adding an index to the digital image data, An index grouping process for generating an index group by grouping the indexes and a selection process for selecting the index group are performed. Another feature of the present invention is that a storage process for storing digital image data, character data, and audio data associated with each other in a storage unit, and that the digital image data and the character data are displayed on a screen of a display device. Display means for displaying the audio data as audio, audio output means for outputting the audio data as audio, index addition processing for adding an index to the digital image data, and index grouping processing for generating an index group by grouping the indexes. , And a selection process for selecting the index group. Another feature of the present invention is that some of the above-mentioned indexes extend over a plurality of index groups. Another feature of the present invention is that indexes in the same group have start and end meanings. Other features of the present invention include:
It is characterized in that the addition of the index is performed for each frame of the image. Another feature of the present invention is that one of the index groups has a start and end index at a location where audio data is turned on or a location where audio data is turned off. . Another feature of the present invention is that one of the index groups has a start and end index at a position where character data is turned on or a position where character data is turned off. . Another feature of the present invention is that one of the index groups has a start index and an end index for each predetermined number of image frames. Another feature of the present invention is that one of the index groups is
It is characterized in that the operator sets start and end indexes at arbitrary locations. Another feature of the present invention is that display of digital image data and character data between the start index and the end index or output of the audio data is performed. Another feature of the present invention is that digital image data, character data, and audio data are searched between the start index and the end index.

[0007] A storage medium according to the present invention is characterized in that a program constituting each means described in the above contract is stored so as to be readable from a computer. Another feature of the present invention is that a program for executing the above-described digital moving image processing method is stored so as to be readable from a computer.

[0008]

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of a digital moving image processing apparatus, a digital moving image processing method and a storage medium according to the present invention. (Explanation of Block Diagram) FIG. 1 is a block diagram showing a functional configuration of a digital moving image processing apparatus according to the present embodiment.

In FIG. 1, reference numeral 1 denotes a CPU (central processing unit), which is connected to the following various devices and a bus line BL6.
And controls various devices. Reference numeral 2 denotes a KB keyboard, which has keys for inputting characters in addition to keys for instructing and executing various controls. Reference numeral 3 denotes a color LCD constituting display means for displaying characters and images written in the VRAM 4 which is a write-only memory for display as a font pattern or image image to be described later.

Reference numeral 5 denotes a video disk V as an image storage device.
DISK. Reference numeral 7 denotes a ROM functioning as a read-only memory, a program (PRG 7a) for executing image / voice / character processing, and a font pattern (FONT 7b) for displaying characters / symbols for displaying characters.
I remember.

Reference numeral 8 denotes an RA functioning as a writable memory.
M is used to store characters, images, and sounds, and is used as a temporary work area and a save area when executing a program, and is internally divided into several storage areas.

Reference numeral 8a denotes a work area WORK for temporarily storing images, program variable data, and other information in order to operate the above-described program. 8b is an index INDX for storing the frame number of the image. 8c is a data area DATA for storing image / voice / character data.

Reference numeral 8d denotes a key area KEY for storing characters at the time of retrieval, and reference numeral 8e denotes a counter N used when counting digital images. Reference numeral 8f denotes an area TORK in which a frame number of the searched digital image is registered. 9 is a speaker SP for outputting sound.

(Explanation of Memory Contents) [Index] FIG. 2 shows the structure of the index area INDX. The index stores the frame number of an image. In the present embodiment, the start number and the end number are stored in pairs, and indicate the range of the number of image frames.

For example, 24 is an image frame "1",
“25” is the frame 100 of the image. When this pair is expressed as (1,100), the following (150, 30)
0), (400, 800). This group of indices is called a channel. That is, 21 is one channel, and 22 and 23 are different channels respectively. That is, when editing and displaying images, the indexes are grouped by channel according to the purpose.

For example, an index group indicated by channel 21 is a group having voice, a channel 22 is a group having character information, and a group 23 is formed by a fixed frame number.

That is, audio is attached to the images of the indexes “1” to “100” shown in the 21 channel. In other words, voices are also attached from “150” to “300” and further from “400” to “800”. Thus, in each channel, the index indicates the range of the image frame according to the purpose,
It consists of the end frame number.

[Data] FIG. 3 is a diagram showing the structure of data composed of images, characters, and sounds and the relationship between them.
In FIG. 3, reference numeral 31 denotes the first frame of the digital image. In FIG. 3, frame “1”, frame “2”,
Hereinafter, they are sequentially arranged below.

"32" is character data, which is composed of character codes. Here, the titles of the images are stored corresponding to the image frames “1” to “3”. The character data corresponding to the title may be superimposed on the image when the image is displayed as a font pattern, or may be used as independent data for another purpose. In the character data corresponding to the image frame "4", the performer is stored.

Next, "33" is audio data. This audio data “33” may be digital or analog. When the image data is reproduced sequentially from the frame “1”, the sound is also output from the speaker in synchronization with the frame.

[Key] FIG. 5 shows an example of the structure of the key KEY. In FIG. 5, "51" is an area for entering a character code serving as a key, and "FF" of "52" means the end of the key.

[Registration] FIG. 6 shows the structure of the registration area TORK, in which the image frame number of the search result is recorded.

[Explanation of Screen Example] FIG. 4 is a diagram showing a screen display example. In FIG. 4, reference numeral 41 denotes a digital image serving as a key at the time of search. FIG. 9 is a diagram illustrating an example in which an image and character information are displayed in a superimposed manner. In FIG. 9, reference numeral 91 denotes a digital image, and 92 denotes subtitles. The caption 92 is obtained by searching for a font from character data codes and displaying it as a font pattern.

[Basic Operation] Next, before describing a detailed operation of the digital moving image processing apparatus of the present embodiment, a basic operation which is a premise will be described. Although there are various methods of inputting images, characters, and sounds, digital broadcasting may be stored in a video disk VDISK via an antenna and a tuner, although not shown in the figure. Alternatively, a video disc having images from the beginning may be set.

Either method can be easily realized using existing technology. Here, the image is assumed to be a digital image. Generally, when storing an image, the image is compressed, and when displaying and editing, the compressed image is decompressed and stored in the RAM 8.
To memorize.

FIG. 7 conceptually shows the relationship between an image and an index. An image is a case of composing a moving image, and one image is required, for example, in 1/30 second. In FIG.
These digital images are arranged in order from the top.

The start index is indicated by S in the reference numeral 71. This indicates the image frame 73. Reference symbol E denotes an end index corresponding to the start index 71, which indicates an image frame 74.

That is, from the frame 73 to the frame 74
, The range is designated by these two indexes 71 and 72. Hereinafter, the same applies to reference numerals 75 and 76. These four indices 71, 72, 7
FIG. 8 shows the concept of the channel of the index group by forming an index of another group although the numbers 5 and 76 can be grouped into one group.

In FIG. 8, the images are arranged in order from the top. The index of channel 1 is shown on the left, and the index of channel 2 is shown on the right. This is a conceptual diagram of the channels 1 and 2 shown in FIG.

That is, the 21 channels in FIG. 2 are (1,100), (150,300), (400,80)
0) ... and the 22 channels are (20,5)
00), (600, 700), (800, 900)
It has become. Both channels are independent of each other and do not affect each other.

(Embodiments) In the following, an outline will be given first of showing two embodiments. In the first embodiment,
This is an embodiment in which data is searched for in a range specified by an index. In the second embodiment, data in the range specified by the index is reproduced repeatedly.

(First Embodiment) Next, the operation of the digital moving picture processing apparatus of the present embodiment will be described with reference to the flowchart of FIG. [Preparation processing] First, search data is stored in a key KEY. The stored search data may be an image, text, or sound (step S101). Next, the channel of the index is selected (step S102). In this case, the channel may be selected according to the type and content of the data to be searched. Next, the image frame counter N
Is set to "1" (step S103).

[Comparison Processing] The data sandwiched between the N-th start index and end index in the predetermined channel is compared with the key data (step S10).
4). As a result of the comparison, the process branches depending on whether they match (step S105).

[Registration Processing] That is, when the comparison results match, the frame number of the matched screen is registered.
It is stored in ROK (step S106). Next, it is instructed whether or not to continue the search (step S10).
7). If they do not match as a result of the comparison in step S105, the process jumps to counter addition.

[End Processing] As a result of the determination in step S107, when continuing, "1" is added to the counter N (step S108), and it is determined whether or not an index still exists (step S109). If the result of this determination is that there is still an index, that is, if the processing is not to be terminated, the process returns to the data comparison in step S104.

On the other hand, if the result of determination in step S109 is that processing is not to be continued or that the index is the last, the process ends.
By performing the above processing, it is possible to search only for the data sandwiched by the indexes.

(Second Embodiment) Although the search processing has been described in the first embodiment, the repeat reproduction processing will be described with reference to the flowchart of FIG. 11 in the second embodiment.

[Preparation Processing] First, a channel having an index corresponding to a reproduction position is selected (step S1).
101). Next, the counter N of the image frame is set to "1" (step S1102).

[Output Processing] Data sandwiched between the Nth start index and end index in a predetermined channel is output. That is, images and characters are displayed, and audio is output from the speaker (step S1103).

[Repeated Processing] Next, "1" is added to the counter N (step S1104), and it is determined whether or not the index is the last (step S1105). If the result of this determination is not the last, the process returns to the output process of step S1103.

[End Processing] If the result of determination in step S1105 indicates that there is no more index, it is determined whether or not there is an interruption instruction (step S1106). As a result of this determination, if there is no interruption instruction, the process returns to the process of setting the counter to “1”, and the reproduction is started from the beginning of the index.

On the other hand, as a result of the determination in step S1106,
If there is a stop instruction, the process ends. With the above processing, it is possible to repeatedly reproduce only the portion sandwiched by the indexes.

(Other Embodiments) In the above-described embodiment, search and reproduction are performed only at a portion between the two indexes as a pair of start and end of the index. , May be specified as odd-numbered and even-numbered indices.

Although an example has been described in which processing is limited to only one channel, processing may be performed simultaneously for a plurality of channels.

(Other Embodiments of the Present Invention) The present invention is applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), and is applied to an apparatus composed of one device. May be applied.

Also, the functions of the above-described embodiment are implemented in an apparatus connected to the above-described various devices or a computer in a system so that various devices are operated so as to realize the functions of the above-described embodiment. Supplies the software program code for performing the
The invention implemented by operating the various devices according to the program stored in U) is also included in the scope of the present invention.

In this case, the program code of the software implements the functions of the above-described embodiment, and the program code itself and means for supplying the program code to a computer, such as the program The storage medium storing the code constitutes the present invention. As a storage medium for storing such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-RO
M, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the supplied program code, not only the functions described in the above-described embodiments are realized, but also the OS (operating system) in which the program code runs on the computer. Alternatively, even when the functions described in the above-described embodiments are implemented in cooperation with other application software or the like, it goes without saying that such program codes are included in the embodiments of the present invention.

Further, after the supplied program code is stored in a memory provided in a function expansion board of a computer or a function expansion unit connected to the computer, the function expansion board or the function expansion unit is specified based on the instruction of the program code. The present invention also includes a case where a CPU or the like provided in the apparatus performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0050]

As described above, according to the present invention,
Since a search can be performed for data in the range specified by the index, a desired image can be efficiently reproduced. Further, according to another feature of the present invention, since data in the range indicated by the index can be repeatedly reproduced, only the portion sandwiched by the indexes can be repeatedly reproduced. Another feature of the present invention is that, since digital image data, character data, and audio data are associated with each other and indexed, image editing such as long-time audio or character-added image search or purpose-specific playback is performed. -Display processing can be performed efficiently.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of a digital moving image processing device according to an embodiment.

FIG. 2 is a diagram illustrating a structure example of an index area INDX of a memory;

FIG. 3 is a configuration diagram showing a structure of data composed of images, characters, and voices and a relationship between each other.

FIG. 4 is a diagram illustrating an example of a screen configuration.

FIG. 5 is a diagram showing an example of a memory configuration and showing an example of the structure of a key KEY.

FIG. 6 is a diagram showing an example of a memory configuration and showing a structure of a registration area TORK.

FIG. 7 is a conceptual diagram illustrating an example of a relationship between an image and an index;

FIG. 8 is a diagram illustrating a concept of a channel of an index group.

FIG. 9 is a diagram showing an example in which an image and character information are displayed in a superimposed manner.

FIG. 10 is a flowchart illustrating an operation procedure of the digital moving image processing device according to the embodiment.

FIG. 11 is a flowchart illustrating a procedure of a repeat reproduction process.

[Explanation of symbols]

 1 CPU (Central Processing Unit) 2 Keyboard 3 LCD 4 Display Write Only Memory (VRAM) 5 Image Storage 6 Bus Line 7 Read Only Memory (ROM) 8 Writable Memory (RAM) 9 Speaker

Claims (28)

[Claims] 1. A digital moving image processing apparatus, wherein an index is added to digital image data, an index group is generated by grouping the index, and an image search is performed by selecting the generated index group. 2. An image forming apparatus comprising: index adding means for adding an index to digital image data; index grouping means for grouping the indexes to generate an index group; and selecting means for selecting the index group. Digital video processing device. 3. A storage unit for storing digital image data, character data, and audio data associated with each other, an index adding unit for adding an index to the digital image data, and generating an index group by grouping the indexes. A digital moving image processing apparatus comprising: index grouping means; and selecting means for selecting the index group. 4. A storage unit for storing digital image data, character data, and audio data associated with each other, a display unit for displaying the digital image data and the character data on a screen of a display device, and Audio output means for outputting as audio; index adding means for adding an index to the digital image data; index grouping means for grouping the indexes to generate an index group; and selecting means for selecting the index group. A digital moving picture processing device comprising: 5. The digital moving image processing apparatus according to claim 4, wherein some of the indexes extend over a plurality of index groups. 6. The digital moving picture processing device according to claim 5, wherein the indexes in the same group have start and end meanings. 7. The digital moving picture processing device according to claim 6, wherein the addition of the index is performed on a frame basis of the image. 8. The digital moving picture according to claim 7, wherein one of the index groups has a start point and an end index at a point where audio data is turned on or a point where audio data is turned off. Processing equipment. 9. The digital moving image according to claim 8, wherein one of the index groups has a start point and an end index at a position where character data is turned on or a position where character data is turned off. Processing equipment. 10. One of the index groups is:
10. The digital moving image processing apparatus according to claim 9, wherein start and end indices are set for each fixed number of image frames. 11. One of the index groups is:
11. The digital moving image processing apparatus according to claim 10, wherein an operator sets start and end indexes at arbitrary locations. 12. Display of digital image data and character data between the start index and the end index,
12. The digital moving picture processing device according to claim 11, wherein the audio data is output. 13. The digital moving picture processing device according to claim 12, wherein a search for digital image data, character data, and audio data between the start index and the end index is performed. 14. A digital moving image processing method, wherein an index is added to digital image data, an index group is generated by grouping the index, and an image search is performed by selecting the generated index group. 15. An index adding process for adding an index to digital image data, an index grouping process for generating an index group by grouping the indexes, and a selecting process for selecting the index group. Digital video processing method. 16. A storage process for storing digital image data, character data, and audio data associated with each other in a storage means, an index addition process for adding an index to the digital image data, and an index group formed by grouping the indexes. And a selection process for selecting the index group. 17. A storage process for storing digital image data, character data and audio data associated with each other in a storage means, a display means for displaying the digital image data and the character data on a screen of a display device, and Audio output means for outputting audio data as audio; index addition processing for adding an index to the digital image data; index grouping processing for grouping the indexes to generate an index group; selection for selecting the index group And a digital moving image processing method. 18. The digital moving image processing method according to claim 17, wherein some of the indexes extend over a plurality of index groups. 19. The method according to claim 1, wherein the indexes in the same group have start and end meanings.
9. The digital moving image processing method according to 8. 20. The digital moving image processing method according to claim 19, wherein the addition of the index is performed for each frame of the image. 21. One of the index groups is:
21. The digital moving image processing method according to claim 20, wherein a location where the audio data is turned on or a location where the audio data is turned off is used as a start and end index, respectively. 22. One of said index groups is:
22. The digital moving image processing method according to claim 21, wherein a point where character data is turned on or a point where character data is turned off is used as a start and end index, respectively. 23. One of the index groups is:
23. The digital moving image processing method according to claim 22, wherein a start and end index are set for each fixed number of image frames. 24. One of said index groups is:
24. The digital moving image processing method according to claim 23, wherein the operator sets start and end indices at arbitrary locations. 25. Display of digital image data and character data between the start index and the end index,
25. The digital moving image processing method according to claim 24, further comprising outputting the audio data. 26. The digital moving image processing method according to claim 25, wherein digital image data, character data, and audio data are searched between the start index and the end index. 27. A storage medium storing a program constituting each means according to claim 1 so as to be readable from a computer. 28. A storage medium storing a program for executing the method according to any one of claims 14 to 26 so as to be readable from a computer.