JPH1185949A - Picture inputting and outputting device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain display or retrieval so that both a moving image and a static image on a recording medium can be intuitively recognized. SOLUTION: This device is a picture inputting and outputting device for reading and outputting a moving image and a static image inputted to a recording medium. In this case, the moving image and the static image are divided, and displayed in a configuration shown by (a), and when one of the displayed moving image and static image is designated, it is displayed by changing the display configuration of the divided screens to various kinds of configurations shown by (b) or (c) according to the kind of the designated picture.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image input / output device for displaying and retrieving a still image or a moving image input to a recording medium while distinguishing the still image or moving image.

[0002]

2. Description of the Related Art In recent years, digital images have been widely used, and a large amount of digital image data is stored on a recording medium such as a hard disk, MD, or MO, and the stored image data is read out and displayed. The need to come out.

For example, in an electronic file device, when a large amount of images are read by a scanner and image data is stored in a recording medium, a list of image data (reduced images) obtained by reducing the original image data (original images) is searched for. Is displayed, and the user operates a mouse or the like to select a reduced image corresponding to a desired original image, thereby obtaining desired image data.

[0004] As for the display of a moving image, a technique of dividing the screen and displaying the moving image is disclosed in Japanese Patent Application Laid-Open Nos. 8-70430 and 8-335387.

[0005]

By the way, when a moving image and a still image are managed by the same device, the search time increases when the number of still images increases or in the case of a moving image. The device is intended for any image management,
There is a problem that it is difficult to unify display and search of a still image and a moving image.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an image input / output device capable of intuitively displaying and retrieving moving images and still images on a recording medium.

[0007]

According to a first aspect of the present invention, there is provided an image input / output apparatus for reading and outputting a moving image and a still image input to a recording medium, wherein the moving image and the still image are read out. Display means for dividing the screen and displaying the screen, and when any of the displayed moving image or still image is designated, the display mode of the divided screen is changed and displayed according to the type of the designated image. It is characterized by.

According to a second aspect of the present invention, in the image input / output apparatus according to the first aspect, the display mode of the divided screen is such that a designated image is emphasized.
At least one of the number of divisions, a display area, and a display position is used.

According to a third aspect of the present invention, in the image input / output apparatus according to the first aspect, when a moving image is designated, the display means displays a series of moving images corresponding to the designated moving image. It is characterized by being reproduced and displayed.

According to a fourth aspect of the present invention, in the image input / output apparatus according to the first aspect, the display means responds to the presence or absence of audio data or character data recorded on the recording medium. The mark is displayed for each divided screen.

[0011]

FIG. 1 shows an embodiment in which the image input / output device of the present invention is applied to an electronic camera capable of taking moving images and still images. CPU 1 as control means for controlling the entire apparatus, RO for storing a program for executing various processes by CPU 1 and a dictionary for generating character data
M2, RAM for temporarily storing programs and data
3. an operation unit 4 as an operation means for inputting operation instructions and character data by operation buttons, a pen, a mouse, a trackball, a keyboard (including a keyboard displayed on the screen of the LCD display 7), etc .; An input unit 5 serving as an image pickup unit including a drive circuit; an LCD control circuit 6 driven by a display instruction; an LCD display 7 for outputting a desired display screen by the LCD control circuit 6; A disk drive 8 as a means or a reproducing means, a still image and a moving image captured by the input unit 5, a disk 9 as a recording medium for recording voice and character data as necessary, and data similar to the disk 9 can be recorded. I as a recording medium
It comprises a C card 10, a microphone 11 for recording sound when shooting or separately from shooting, and a speaker 12 for outputting sound reproduced when reproducing the disk 9. Note that the same applies to the disk 9 and the IC card 10 as the recording medium, so the case of the disk 9 will be described below.

The image capturing is started by an image capturing instruction from the operation unit 4 and, as shown in FIG. 2, at the time of image capturing, the CPU 1 reduces the number of pixels from the original image input from the input unit 5 by a predetermined procedure to reduce the reduced image. It is created and recorded on the disk 9 with the imaging time added to the reduced image and the original image. In the case of this device,
Both a still image and a moving image can be captured according to an instruction from the operation unit 4. When the original image is a still image, one reduced image corresponding to the original image is created. If the original image is a moving image, it is composed of a time series of still images, so a plurality of reduced images corresponding to each are created. At the time of imaging, L
The CD display 7 is used as an imaging monitor.

FIG. 3 shows the file structure of the disk 9 on which recording has been performed. From the inner peripheral side to the outer peripheral side of the disk 9, a T in which position information of each file is collectively recorded.
An OC (Table of Contents) 31, a time stamp DB (database) file 32 in which an identifier for distinguishing between a still image and a moving image is recorded, a reduced image data file 33 in which a reduced image created from an original image is recorded, It comprises an original image data file 34 in which an original image of a still image or a moving image is recorded, and an audio data file 35 in which audio data inputted from the microphone 11 is recorded.

FIG. 4 shows a time stamp DB file 32.
Is shown. This time stamp DB file 32
Is composed of a header and data, and the number of time stamps (N) and time stamp information are recorded in the data. The time stamp information includes a time stamp number assigned in the image capturing order, an image number indicating a number for each area, a time stamp indicating an image capturing time assigned by the CPU 1, and the presence or absence of character data input by the operation unit 4. It comprises a file name 41 as an identifier, an index number 42 as an identifier for distinguishing a still image or a moving image, and an audio data number 43 as an identifier indicating the presence or absence of audio data. The audio data number 43 is the address of the audio data added to the original image, and contains 00h as the audio data number when no audio data is added.

The index number 42 in the present embodiment uses the number of reduced images. Number of index 42
Is one for a still image, and two or more corresponding to the number of time-series reduced images for a moving image. The number of original images may be used as the number of indexes, but the optical head of the disk drive 8 accesses from the inner circumference side during image reproduction, and it is preferable to use a reduced image closer to the TOC 31 because high-speed access is possible. .

FIG. 5 schematically shows the correspondence between time stamp information and reduced images of moving images and still images. here,
There is a reduced image S (n) for each time stamp number, which is one image itself for a still image and the first reduced image for a moving image.

First, the overall operation of the LCD display 7-split display of the present invention will be described with reference to FIG. When the search mode is set by the instruction of the operation unit 4, the reduced image is reproduced by accessing the optical head of the disk drive 8, and the predetermined reduced image designated by the operation unit 4 is displayed from the recorded contents of the disk 9 on the LCD display 7. In the upper display areas 1 to 16, FIG.
It is displayed in the mode shown in FIG. In this display mode, one still image is kept displayed, and a moving image displays a series of time-series images by frame advance. Therefore, the user can distinguish between a still image and a moving image based on the presence / absence of image movement. Note that the image may be distinguished by displaying the image in a negative / positive inversion according to whether the image is a still image or a moving image, or displaying different marks such as a triangle and a square in a partial area of each image.

Next, in the display state of FIG. 6A, the user inputs a gazing point on the display screen by using the operation unit 4 (selects a still image or a moving image). Are detected by the CPU 1 and the display mode such as the number of screen divisions is changed according to the type of the corresponding image, and the input reduced image of the point of gaze is displayed so as to be emphasized.

That is, when the designated image is a still image, as shown in FIG.
The reduced images including the reduced image 7 having the size of
0, and when the designated image is a moving image, FIG.
As shown in (1), a series of reduced images which are successive on the time axis around the reduced image of the designated moving image are displayed frame by frame in the display areas 4 to 6. As described above, when a still image or a moving image is designated, the number of screen divisions and the like are changed and displayed, so that the search for the target image can be made more intuitive.
In the case of the present embodiment, for intuitive search, the position and area of the entire display area in FIG.
6 to (d) are displayed so as not to change even if the screen is divided.

Further, by inputting a gazing point into the display area 7 by the operation unit 4 in the display state shown in FIG. 6B, the original image of the still image is reproduced by accessing the optical head of the disk drive 8. Thus, the original image shown in FIG. 6D is displayed. Although not shown, in the same manner as in FIG. 6D, a point of interest is designated by inputting a gazing point to any of the display areas 4 to 6 using the operation unit 4 in the display state of FIG. A series of original images that are successive on the time axis around the moving image are displayed frame by frame.

By inputting the point of gaze into the display area 10 by the operation unit 4 in the display state of FIG. 6B, the display state of FIG. By inputting a gazing point into the display area 1 by the operation unit 4 with respect to the display state of, the display state of FIG.

Next, the divided display operation will be described with reference to FIGS. First, the operation of the 16-split display of FIG. 6A will be described in detail with reference to the flowchart of FIG.

First, in step S1, the CPU 1 executes
The time stamp number n and the frame advance variable f (m) are initialized. However, since the number of images to be divided and displayed is 16 at the maximum, m is set to 1 or more and 16 or less.

In step S2, a variable j for designating a display area in the y-axis direction and 0 for a display area number m are input.
Further, in step S3, 0 is input to a variable i that specifies a display area in the x-axis direction.

In step S4, 1 is added to each of the time stamp number n and the display area number m. In step S5, it is determined whether or not the time stamp number n is less than or equal to the total number N. If NO, the process jumps to step S19. If YES, in step S6
A point on the screen coordinates starting from the upper left (XM / 4 × i, YM
/ 4 × j) and points (XM / 4 × (i + 1), YM / 4 ×
(J + 1)) within a rectangle having a diagonal of S (n) +
f (m) is displayed.

In step S7, the CPU 1 subtracts one from the number of index images to determine whether or not there is a next reduced image to be displayed, and checks whether the number is 1 or less. If the value is 1 or less, the process proceeds to step S9. In the case of 1 or more, by adding 1 to f (m) in step S8, the next reduced image next to the currently displayed reduced image is displayed frame by frame.

Next, in step S9, the CPU 1 determines whether the variable i designating the display area in the x-axis direction of the screen is 3, that is, whether or not the predetermined display area has reached the right end. In step S10, i is set to 1
To the next display area, and again at step S4
Then, the above processing is repeated until i becomes 3. If YES in step S9, step S11
To 1 and set the variable j that specifies the display area in the screen y-axis direction to 1
Adds a line break to the display area. Further, if j is 4 in step S12, the page is 16
Since all the divided screens have been displayed, the input of the “next page key” from the operation unit 4 is checked. If j is not 4, the process returns to step S3, and the above processing is repeated.

Next, in step S13, step S
If the "next page key" is input between step 2 and step S13, the process proceeds to step S18. If the "next page key" has not been input, the input of the "previous page key" from the operation unit 4 is checked in step S14. If the "previous page key" is input, the time stamp number is returned to the top of the previous page in step S15. Further, when the time stamp number is 0 or more in step S16, the process proceeds to step S18. If the determination is NO, the CPU 1 determines that there is no reduced image to be displayed on the page before the page, and thus updates the time stamp number in step S17 and returns the time stamp number to the current page time stamp number again. In step S18, the variable f (m) is updated to 0, and the process returns to step S2 to repeat the above operation.

If the "previous page key" has not been input in step S14, the gazing point input is checked in step S19. If YES, the process proceeds to FIG. If NO, the time stamp number is updated to the upper left of the screen in step S20, and the process returns to step S2 again to repeat the above operation.

Next, the flow of determination from inputting the coordinates on the screen by inputting the gazing point from the operation unit 4 to displaying the reduced image corresponding to the gazing points coordinates will be described with reference to the flowchart shown in FIG. explain. First, in step S1,
The user inputs the gazing point coordinates (xx, yy) from the operation unit 4. In response to this, in step S2, the CPU 1 updates the time stamp number n to the time stamp number (nm) for the display area 1 on the divided screen in FIG. Further, the variable f (m) is initialized to 0 in step S3, j is initialized to 0, the display area number m is initialized to 0 in step S4, and i is initialized to 0 in step S5.

Step S6, Step S7, Step S
At 8, the CPU 1 determines that the input gazing point coordinates (x
(x, yy) is recognized in which display area, and if it is determined in step S9 that the (n + m) th reduced image has been designated, the process proceeds to step S10, where the time stamp number n is updated to n + m. Further, in step S11, whether or not the index number I (n) is 1 is compared. If YES, it is determined that the image is a still image, and the process proceeds to the flowchart of FIG. If NO, it is determined that the image is a moving image, and the process proceeds to the flowchart of FIG.

Step S6, Step S7, Step S
If it is determined in step 8 that a reduced image has not been designated, the process proceeds to step S14. In this step, the display area number m is updated to m + 1.
If i is 3, the process proceeds to step S17. If i is 3 in step S15, that is, if i has not reached the rightmost stage,
In step S16, 1 is added to i, and in step S6
Then, the above operation is repeated.

In step S17, 1 is added to j to start a new line in the check area. If j is 3 in step S18, that is, if j is the bottom row, the flow returns to step S3 to repeat the above operation. If j is not 3 in step S18, the process proceeds to step S19, where 1 is added to j, and the process returns to step S5 to repeat the above operation.

When the reduced image specified in step S12 in FIG. 8 is determined to be a still image, the 13-split display operation will be described with reference to the flowchart in FIG. First, in step S1, S (n-6)... S (n-1) are displayed in predetermined display areas 1 to 6 on the divided screen in FIG. Next, in step S2, the fixed coordinates (0, YM
/ 4) and (XM / 2, 3XM / 4) are displayed in a reduced rectangle S (n). Further, step S3
In FIG. 6, a predetermined display area 8 on the divided screen in FIG.
, S (n + 1)... S (n + 6) are displayed.

The nine-segment display operation when the reduced image specified in step S12 in FIG. 8 is determined to be a moving image will be described with reference to the flowchart in FIG. First, in step S1, successive reduced images before and after other than the reduced image specified by the user are displayed in predetermined display areas. That is, as shown in the divided screen of FIG. 6C, the reduced images S (n
-3), S (n-2) and S (n-1) are displayed in the display area 7,
8, 9 include S (n + 1), S (n + 2), S (n +
Display 3). Next, a variable im representing a scene of a moving image is initialized to 0 in step S2, and a variable ii designating a display area in the x-axis direction is initialized to 0 in step S3.

Next, in step S4, the CPU 1
Represents a point (XM / 3 × ii, YM / 3) and a point (XM / 3 × ii, YM / 3) in order to display a plurality of reduced image sequences obtained by equally dividing a reduced image sequence corresponding to a moving image scene in the time axis direction in separate display areas. (X
S (n) + im + (I (n) / 3) × ii is displayed in a rectangle having a diagonal of M / 3 × (ii + 1), 2YM / 3). In step S5, it is checked whether or not ii has reached 3, that is, whether or not the right end of the screen has been reached. If YES, the process proceeds to step S7;
And returns to step S4, and repeats the above processing again for the next display area.

In step S7, the scene im of the moving image of the designated reduced image and the index number I corresponding to the scene im
A comparison is made to see if it is equal to (n) / 3, and if YES, the process ends. If NO, proceed to step S8 i
After adding 1 to m, the process returns to step S3, and the above processing is repeated for the next scene.

Next, FIG. 11 shows another display form of FIG. 6C according to the presence or absence of voice data or character data.
Such a display form can be realized by the CPU 1 determining whether or not the contents of the file name 41 and the audio data number 43 of the time stamp DB file exist, and display and search for a large number of images can be performed intuitively. It can be done easily. In the list display screen of FIG. 6C, the time stamp information of the still image and the moving image is checked, and if there is corresponding character data, the contents of the file name 41 are displayed at a predetermined position in the display area, and If there is data, it is displayed at a predetermined position in the display area with a figure indicating the data (a rectangular figure of a waveform in the present embodiment). Here, if no voice data is added, no graphic display is performed, and if there is no file name of the time stamp information, no character display is performed. In addition, the display mark according to the presence or absence of voice data or character data is not limited to the above embodiment, and may be any mark that can distinguish the presence or absence of voice data or character data. 6A, 6B, and 6D, similarly, a mark for distinguishing the presence or absence of voice data or character data may be displayed.

In the above-described embodiment, a case has been described in which the present invention is applied to an electronic camera capable of performing recording and reproduction. However, the above-described display and search can be realized by a computer as a display device or a search device. Further, a program having a function of performing the above-described display and search may be recorded on a recording medium such as a floppy disk or a CDROM, and may be appropriately installed and used.

[0040]

As described above, according to the image input / output device of the present invention, the display mode such as the number of divided images is changed according to the type of image to be searched, so that the contents of the recording medium can be intuitively displayed. This allows the user to easily find the desired image.

[Brief description of the drawings]

FIG. 1 is a block diagram of an image input / output device according to an embodiment.

FIG. 2 is a diagram illustrating a relationship between an original image and a reduced image.

FIG. 3 is a diagram for explaining a data structure of a disk according to the embodiment.

FIG. 4 is a diagram showing details of a time stamp DB file according to the present embodiment.

FIG. 5 is a diagram showing a correspondence relationship between time stamp information and reduced images according to the present embodiment.

FIG. 6 is a diagram showing an operation example of various divided displays according to the present embodiment.

FIG. 7 is a flowchart for explaining 16-split display.

FIG. 8 is a flowchart for explaining display determination of a designated reduced image.

FIG. 9 is a flowchart for explaining 13-split display.

FIG. 10 is a flowchart illustrating 9-split display.

FIG. 11 is a diagram showing another display example according to the present embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 CPU 2 ROM 3 RAM 4 Operation part 5 Input part 6 LCD control circuit 7 LCD display 8 Disk drive 9 Disk 10 IC card

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI G11B 27/00 G11B 27/00 E H04N 5/93 H04N 5/93 Z

Claims (4)

[Claims] 1. An image input / output device for reading and outputting a moving image and a still image inputted to a recording medium, wherein the moving image and the still image are divided and displayed on a screen, and the displayed moving image or still image is displayed. An image input / output apparatus comprising: display means for changing a display mode of a divided screen according to a type of a designated image when any of the images is designated. 2. The method according to claim 1, wherein at least one of the number of divisions, a display area, and a display position is used as a display mode of the divided screen so that a designated image is emphasized. Image input / output device. 3. When a moving image is designated, the display means:
The image input / output device according to claim 1, wherein a series of moving images corresponding to the specified moving image is reproduced and displayed. 4. The image input / output according to claim 1, wherein said display means displays a mark corresponding to the presence or absence of audio data or character data recorded on said recording medium for each divided screen. apparatus.