JP2001218158A - Information processing unit and its method, and program storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing unit and its method, and a program storage medium by which a desired image can simply and quickly be retrieved. SOLUTION: The time indicated on a position time display section 181 is an elapsed time of a thumbnail picture indicated on a still picture display window 171 from a start time of a program including data of the thumbnail picture, and a time indicated on a differential time display section 182 is a relative time with respect to a picture reproduced at that point of time.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and method, and a program storage medium, and more particularly to an information processing apparatus and method for presenting time information of an image for reference.
And a program storage medium.

[0002]

2. Description of the Related Art A tuner is built in a personal computer, receives image and audio signals from a television broadcast station, converts the received images and audio into predetermined digital data, and records the digital data on a recording medium such as a hard disk. However, the technology of reproducing as needed is being used.

[0003]

When a program broadcasted from a television broadcasting station is recorded and reproduced by the above-mentioned personal computer, unlike the conventional reproduction using a video tape or the like, rewinding and forwarding are performed. This is characterized in that a desired scene can be viewed immediately without the need for the time associated with. However, there is a problem that it is difficult to search for a desired scene because information for searching for a desired scene, for example, information about time is not presented.

The present invention has been made in view of such a situation, and presents information such as an absolute time and a difference time corresponding to a scene being reproduced so that a user can easily search for a desired scene. The purpose is to.

[0005]

According to the first aspect of the present invention, there is provided an information processing apparatus comprising: first recording control means for controlling recording of a moving image; a still image corresponding to switching of a scene of the moving image;
Second recording control means for controlling the recording of the time;
First reproduction control means for controlling reproduction of a moving image recorded by the recording control means, second reproduction control means for controlling reproduction of a still image recorded by the second recording control means, Display control means for controlling display of time indicating a relationship between a moving image whose reproduction is controlled by the reproduction control means and a still image whose reproduction is controlled by the second reproduction control means. I do.

The time at which display is controlled by the display control means is the time at which recording is performed by the second recording control means, the time at which recording of a moving image is started by the first recording control means, and the second reproduction control. A time indicating a difference from a time when a still image whose reproduction is controlled by the means is recorded, or a time indicating a moving image whose reproduction is controlled by the first reproduction control means and the second reproduction control means. Of the time indicating the difference from the time indicated by the still image whose reproduction is being controlled,
There can be at least one.

According to a third aspect of the present invention, there is provided an information processing method comprising: a first recording control step of controlling recording of a moving image; a still image corresponding to switching of a scene of the moving image; Recording control step 2, a first reproduction control step for controlling reproduction of a moving image recorded in the processing of the first recording control step, and reproduction of a still image recorded in the processing of the second recording control step And the relationship between a moving image whose reproduction is controlled in the processing of the first reproduction control step and a still image whose reproduction is controlled in the processing of the second reproduction control step. And a display control step of controlling display of the indicated time.

According to a fourth aspect of the present invention, a program in a program storage medium controls a first recording control step for controlling recording of a moving image, a still image corresponding to switching of a scene of a moving image, and recording of the time. A second recording control step, a first reproduction control step for controlling reproduction of a moving image recorded in the processing of the first recording control step, and a still image recorded in the processing of the second recording control step. Of a moving image whose reproduction is controlled in the processing of the first reproduction control step and a still image whose reproduction is controlled in the processing of the second reproduction control step. A display control step of controlling display of a time indicating the relationship.

[0009] The information processing apparatus according to claim 1, claim 3,
In the information processing method according to the aspect of the invention and the program storage medium according to the aspect, a moving image and a still image corresponding to scene switching of the moving image are recorded, and a relationship between the moving image and the still image is recorded. The indicated time is displayed.

[0010]

FIG. 1 is a diagram showing an embodiment of an image recording / reproducing system according to the present invention. The personal computer 11 receives a signal supplied from the antenna 12 that has received radio waves transmitted from a predetermined television broadcasting station, reproduces predetermined images and sounds (so-called program images and sounds), and outputs the images and sounds. And record the audio. In addition, the personal computer 11 has a VCR (Vide
o Analog signals supplied from the Cassette Recorder (13) or IEEE (Institute of Electrical and Electr)
(Digital Video Cassette Recorder) via networks 16-1 and 16-2 such as onic engineers (1394).
rder) 14 or reproduces an image and a sound corresponding to the digital data supplied from the DVCR 15 having an imaging function,
Record the image and sound.

The personal computer 11 outputs analog signals (for example,
An NTSC (National Television System Committee) type analog signal, etc.) is supplied to the VCR 13 or digital data corresponding to the recorded audio and image is converted to a DV.
Supply to CR14. In addition, the personal computer 11
Can edit recorded audio and images.

FIG. 2 is a block diagram illustrating the configuration of the personal computer 11. CPU (Central Process
The ing unit 21 actually executes various application programs and a basic OS (Operating System). A ROM (Read-Only Memory) 22 generally includes a CPU
21 stores basically fixed data among the programs used and the parameters for calculation. RAM (Random-Acce
The ss memory 23 stores a program used in the execution of the CPU 21 and parameters that change as appropriate in the execution. These are interconnected by a host bus 24 composed of a CPU bus or a memory bus.

A host bus 24 is connected to a PCI (Peripheral Component Interconnect / Interfac
e) It is connected to an external bus 26 such as a bus. The keyboard 28 is operated by the user when inputting various commands to the CPU 21. Mouse 29 is a CRT (Cathode Ray
When the user designates or selects a point on the screen of the Tube 30, the user operates the point. The CRT 30 displays various information as text or images. HDD (Hard Disk Driv
e) 31-1 and 31-2 drive the hard disks, respectively, and cause them to record or reproduce programs and information executed by the CPU 21.

The HDDs 31-1 and 31-2 perform time-division processing of the recording and reproduction processing,
Can be run simultaneously. The speaker 32 reproduces a predetermined sound. The keyboard 28 to the speaker 32 are connected to an interface 27. The interface 27 is connected to the CPU 21 via an external bus 26, a bridge 25, and a host bus 24. Hereinafter, when there is no need to distinguish the HDDs 31-1 and 31-2 individually, they are simply referred to as the HDDs 31.

The drive 33 is connected to the interface 27, and controls the magnetic disk 111, the optical disk 112, the magneto-optical disk 113, or the
A program or information to be executed by U21 is recorded or reproduced. Under the control of the CPU 21, the image processing board 34 controls the signal supplied from the antenna 12, the analog signal of image or sound supplied from the VCR 13, or the DVCR 13 or DVCR 14 via the network 16-1.
A predetermined image or audio data is generated on the basis of the image or audio digital data supplied from the HDD 31 and the HDD 31-via the external bus 26 and the interface 27.
1 or to the HDD 31-2.

The image processing board 34 is connected to the external bus 2
6 and the interface 27, the HDD 31-1
Alternatively, image or audio data recorded on the HDD 31-2 is input, an analog signal corresponding to the input image or audio data is generated, and the analog signal is supplied to the VCR 13.
Alternatively, digital data corresponding to the input image or audio data is generated, and the CRT is generated via the DVCR 14 or the external bus 26 via the network 16-1.
30. Further, the image processing board 34 can execute these processes at the same time. The image processing board 34 is connected to the CPU 21 via the external bus 26, the bridge 25, and the host bus 24.

Next, the configuration of the image processing board 34 will be described. FIG. 3 is a diagram illustrating a configuration of the image processing board 34. The 1394 interface 51 has a configuration corresponding to the IEEE 1394 standard, is connected to the network 16-1, and is based on a protocol compliant with the IEEE 1394 standard.
Of images or sounds supplied from CR14 or DVCR15
DVCR format digital data is received and DV (Dig
ital Video) to the data interface 52.

The 1394 interface 51 is a DV
The digital data of the image or audio DVCR format supplied from the data interface 52 is
Is supplied to the DVCR 14 based on a protocol corresponding to the above-mentioned rules. The DV data interface 52 compresses image or audio digital data of the DVCR format supplied from the 1394 interface 51 or image or audio digital data supplied from the digital selector 57 (for example, compression of so-called 4: 1: 1 or the like). DV data compression / decompression circuit 53
And supplied from the DV data compression / decompression circuit 53.
Digital image or audio data in DVCR format
The data is output to the 1394 interface 51, and the image or audio digital data (uncompressed) supplied from the digital selector 57 supplied from the DV data compression / decompression circuit 53 is output to the digital selector 57.

The DV data compression / expansion circuit 53 expands the DVCR format image or audio digital data supplied from the DV data interface 52 into uncompressed image or audio digital data,
The uncompressed image or audio digital data output to the data interface 52 or supplied from the DV data interface 52 is compressed into DVCR format image or audio digital data,
Output to the data interface 52.

The tuner 54 receives an RF (Radio Frequency) signal supplied from the antenna 12 and outputs an analog image and sound signal of a predetermined channel to the analog selector 52. The analog selector 55 selects one of the image or audio analog signal supplied from the tuner 54, the VCR 13, or the D / A (Digital / Analog) conversion circuit 61, and performs an A / D (Analog / Digital) conversion circuit 56. Or it outputs to VCR13.

The A / D conversion circuit 56 converts the analog image and audio signals supplied from the analog selector 55
The data is converted into digital data (for example, so-called image data such as 4: 1: 1) and output to the digital selector 57. The digital selector 57 includes a DV data interface 52, an A / D conversion circuit 56, or an MPEG (Movin)
g Picture Experts Group) The digital data of the image and the sound output from the decoder 60 is input, and any one of the digital data of the image and the sound is selected, and the DV data interface 52, the MPEG encoder 58, the bridge 59, or the D / A The information is output to the conversion circuit 61, and the information of the position of the scene change is output to the bridge 59.

The MPEG encoder 58 compresses the image and audio digital data supplied from the digital selector 57 into MPEG digital data,
Output to Further, the MPEG encoder 58 converts the image at which the scene is switched to a still image, and outputs the still image to the bridge 59. The bridge 59 transfers the image and audio digital data (uncompressed) supplied from the digital selector 57 to the CRT 30 via the PCI bus 26 and the interface 27 of the personal computer 11 on which the image processing board 34 is mounted. Output.

The bridge 59 converts the MPEG image or audio digital data supplied from the MPEG encoder 58 into the HDD 31-1 or 31 via the PCI bus 26 of the personal computer 11 on which the image processing board 34 is mounted. -2 or to the CPU 21. Further, the bridge 59 transmits the MPEG data from the HDD 31-1 or 31-2 of the personal computer 11 via the PCI bus 26.
Digital video or audio digital data
Output to the decoder 60. Note that the bridge 59 can also execute these processes at the same time.

The MPEG decoder 60 expands the MPEG image or audio digital data supplied from the bridge 59 and outputs it as uncompressed image or audio digital data to the digital selector 57. D / A
The conversion circuit 61 converts the image and audio digital data supplied from the digital selector 57 into analog signals and outputs the analog signals to the analog selector 52. Note that the processing corresponding to the MPEG encoder 58 or the MPEG decoder 60 may be executed by the CPU 21 using a predetermined program.

FIG. 4 is a diagram for explaining an application program executed by the personal computer 11. The recording / playback program 81 is used to
The analog video and audio signals of a predetermined channel received by the tuner 54, the analog video and audio signals supplied from the VCR 13, or the network 16
-1 to select one of the image and audio digital data supplied from the DVCR 14, convert the selected analog signal or digital data to MPEG image or audio digital data, and As an AV (Audio Visual) content composed of files in the format of HDD 31-1 or 31-2 or HDD
Record on 31-1 and 31-2.

The recording / reproducing program 81 stores the HDD 31-1 or 3 as one or more files in a predetermined format.
1-2 or the AV contents recorded on the HDDs 31-1 and 31-2 are expanded on the image processing board 34 to generate predetermined uncompressed image or audio digital data. And the speaker 32 reproduces the sound.

An AV content management search program 82
Is HDD 31-1 or 31-2, or HDD 31-1
And predetermined information such as the content of the AV content recorded in the < RTI ID = 0.0 > 31-2 < / RTI > Further, the AV content management / search program 82 instructs the recording / playback program 81 to play back predetermined AV content, selects an AV content to be edited, and transmits information on the selected AV content to the AV content editing program 83. To the timer recording setting program 84 to instruct the timer recording.

The AV content editing program 83 is an HD content editing program.
Based on the AV contents recorded on D31-1 or 31-2 or the HDDs 31-1 and 31-2, a predetermined image and sound of the selected AV content are edited (images included in the predetermined AV content). And audio), and generate AV content of a predetermined format for reproducing the edited image or audio. This AV
The content has no image or audio digital data and is composed of information for specifying the selected AV content and information for specifying the image and audio to be used, and can be reproduced by the recording / reproducing program 81.

The programmed recording setting program 84 generates AV contents for executing programmed recording based on the settings. The AV contents correspond to the settings (recording mode for determining the recording time and image quality), and secure the storage areas of the HDDs 31-1 and 31-2 or the HDDs 31-1 and 31-2 in advance. The reservation monitoring program 85 always operates (so-called resident) when the personal computer 11 is operating (when the OS is operating), and executes the scheduled recording generated by the scheduled recording setting program 84. AV content and RTC not shown
Performs scheduled recording based on the time supplied from (Real Time Clock). Further, the reservation monitoring program 85 changes the setting of the AV content for executing the reservation recording.

FIG. 5 is a diagram for explaining the configuration of application programs, middleware, and drivers executed by the personal computer 11. The middleware operates predetermined drivers in response to a request from an application program. The drivers actually operate predetermined hardware resources such as the MPEG encoder 58 of the image processing board 34.

The hardware interface 91 includes a recording / reproducing program 81, an AV content management / retrieval program 82, an AV content editing program 83, a scheduled recording setting program 84, or a scheduled monitoring program 85.
Arbitrates the use of hardware resources requested by the application program, and allows the application program to appropriately use predetermined hardware resources based on various settings such as priorities.

The content database 92 manages data of attributes of the AV content, which will be described later, and the like.
2. The AV content editing program 83, the reservation recording setting program 84, or the reservation monitoring program 85 is sent to the attribute data (described later) of the AV content or A
This is a database that provides data specifying a file storing digital data of images or sounds corresponding to V content.

A file I / O (Input / Output) 93 is transmitted via a content database 92 to a recording / reproducing program 81, an AV content management search program 82, an AV
The content editing program 83, the reservation recording setting program 84, or the reservation monitoring program 85 responds to a read or write request for predetermined AV content (consisting of one or more files). Read or write data.

The encode 94 is provided on the image processing board 34.
The MPEG encoder 58 executes control to compress the image or audio data input from the digital selector 57 into MPEG digital data. The decode 95
The bridge 5 is connected to the MPEG decoder 60 of the image processing board 34.
The control for expanding the digital data of the image or sound of the MPEG system input from 9 is executed.

The output switch 96 is connected to the image processing board 34.
The analog selector 52 and the 1394 interface 51 are operated to control the output of analog signals from the image processing board 34 or digital data via the network 16-1. The input switch 97 operates the analog selector 52, the 1394 interface 51, the DV data interface 52, and the digital selector 57 of the image processing board 34 to select an analog signal or digital data input to the image processing board 34.

The screen display 98 controls the display of an image on the CRT 30 by operating the digital selector 57, the bridge 59, and the like. The driver 99 responds to requests for encoding 94, decoding 95, output switching 96, input switching 97, and screen display 98, and
Is a program that actually operates. In the following:
The description of the processing related to audio is omitted.

FIG. 6 is a view for explaining an example of the configuration of AV contents. The attribute of each AV content is recorded in the content database 92 recorded on the HDD 31-1 or 31-2. AV content attribute record 10 recorded in content database 92
Reference numeral 2-1 denotes attributes of the AV content 101-1: name, ID (Identification data), creation date and time, change date and time, recording time, channel name, recording mode, state, and expiration date (indicated by date and time). , Data for erroneous deletion prevention, presence or absence of an error, two-dimensional barcode (for example, Cybercode (trademark)), and memo. The AV content attribute record 102-2 recorded in the content database 92 includes the following attributes of the AV content 101-2: name, ID, creation date and time, change date and time, recording time, channel name, recording mode,
It stores data such as status, expiration date, setting to prevent accidental deletion, presence / absence of error, and memo.

The recording mode data stored in the AV content attribute record 102-1 is such that the moving image data files 111-1-1 to 111-1-3 are compatible with high quality, standard, or video CD compatible (image data). Is MPEG1 format). Similarly, the data stored in the AV content attribute record 102-1 is that the AV content 101-1 is waiting for reservation, during recording, during recording / reproduction (recording, and reproducing the data of the recorded image. ), Not played, playing, or played.

For example, the error may be that the personal computer 11 failed during recording and the recording was only partially performed, the receiving condition during recording was poor, and the image could not be reproduced with the signal input from the antenna 12, Alternatively, the status of the AV content 101-1 is such that a part of the moving image data file 111-1-1 is missing. Neither the expiration date nor the accidental deletion setting is set, or either of them is set, and both the expiration date and the accidental deletion prevention are not set at the same time.

The recording mode data stored in the AV content attribute record 102-2 is such that the moving image data files 111-2-1 to 111-2-3 are either high-quality, standard, or video CD compatible. Indicates that there is. Similarly, the data stored in the AV content attribute record 102-2 is the AV content 101
-2 indicates one of the following states: waiting for reservation, recording, recording / reproduction, unreproduction, reproduction, or reproduction.

The AV contents 101-1 are stored in the HDD 31-
Moving image data files 111-1-1 to 111-1-3 recorded in HDD 1 or 31-2, and HDD 31
-1 or 31-2 is composed of still image data files 112-1-1 to 112-1-3. Moving image data files 111-1-1 to 111-
1-3 stores image data of the MPEG system. The image corresponding to the image data stored at the beginning of the moving image data file 111-1-2 is continuous with the image corresponding to the image data stored at the end of the moving image data file 111-1-1. I have. Similarly, the image corresponding to the image data stored at the head of the moving image data file 111-1-3 is the moving image data file 111-1.
-2 is continuous with the image corresponding to the last stored image data.

Still image data file 112-1-1
Are image data obtained by converting a scene switching image of the image data stored in the moving image data file 111-1-1 into a still image, and the time of the scene switching (or the moving image data file 111 -1
(Offset position on -1).
The still image data file 112-1-2 includes image data obtained by converting a scene switching image of image data stored in the moving image data file 111-1-2 into a still image, and a switching image of the scene. Time (or an offset position on the moving image data file 111-1-2) is stored. The still image data file 112-1-3 corresponds to the moving image data file 11
The image switching scene of the image data stored in the image data 1-1-1-3 is converted into a still image, and the image switching time (or the time at which the scene is switched (or the moving image data file 111-1-3)). Offset position) is stored.

The AV contents 101-2 are composed of moving image data files 111-2-1 and 111-2-2 and still image data files 112-2-1 and 112-112.
-2-2, which is the same as in the case of the AV content 101-1, and a description thereof will be omitted.

Hereinafter, the AV contents 101-1 or A
When there is no need to individually distinguish the V content 101-2, it is simply referred to as the AV content 101. Hereinafter, when there is no need to individually distinguish the AV content attribute record 102-1 or the AV content attribute record 102-2, it is simply referred to as the AV content attribute record 102.
Hereinafter, the moving image data files 111-1-1 to 111-1-3 or the moving image data file 111-2-1 or the moving image data file 11
When it is not necessary to distinguish 1-2-2 individually, it is simply referred to as a moving image data file 111. Hereinafter, the still image data file 112-1-1 through the still image data file 112-1-3 or the still image data file 112-
2-1 or still image data file 112-2-2
Are simply referred to as a still image data file 112 when there is no need to distinguish them individually.

FIG. 7 shows an AV file without a moving image data file.
FIG. 3 is a diagram illustrating an example of content 101. For example, A
Images and sounds corresponding to the moving image data files 111-1-1 to 111-1-3 stored in the V-content 101-1 are recorded on a predetermined video tape cassette. -1 to 111-1-3, the AV content 101
-1 is the still image data files 112-1-1 to 112-1
12-1-3, a moving image data file 11
Does not include 1.

AV contents 1 not including moving picture data file 111 corresponding to a predetermined video tape cassette
By retrieving and using 01, it is possible to know the contents of images and sounds recorded on a predetermined video tape cassette.

FIG. 8 shows an AV content editing program 8
FIG. 3 is a diagram illustrating an example of AV content generated when a predetermined AV content 101 is edited. AV
The AV content 121-1 generated by the content editing program 83 includes, for example, the ID of the referenced AV content a, the reproduction start position of the AV content a, and A
Playback end position of V content a, I of AV content b
D, the reproduction start position of the AV content b, the reproduction end position of the AV content b, and the I of the AV content c.
D, an editing data file 131-1 for storing data such as a reproduction start position of the AV content c and a reproduction end position of the AV content c.

Similarly, the AV content editing program 8
3 is, for example, the ID of the AV content p referred to and the AV content p.
, Playback end position of AV content p, ID of AV content q, playback start position of AV content q, playback end position of AV content q, ID of AV content r, playback start position of AV content r , And an edit data file 131-2 for storing data such as the reproduction end position of the AV content r.

The AV content attribute record 132-1 corresponding to the AV content 121-1 generated by the AV content editing program 83 includes the AV content 121-
Data such as name, ID, date and time of creation, date and time of change, recording time, status, expiration date, setting for preventing erroneous deletion, presence / absence of an error, and memo, which are attributes of No. 1, are stored. A
The AV content attribute record 132-2 corresponding to the V content 121-2 includes the attributes of the AV content 121-2: name, ID, creation date and time, change date and time, recording time, status, expiration date, and setting for preventing accidental deletion. , The presence or absence of an error, and data such as a memo.

The data stored in the AV content attribute record 132-1 is the AV content 131
-1 indicates one of the following states: unreproduced, reproducing, or reproduced. AV content attribute record 13
The data in the state stored in 2-2 indicates that the AV content 131-2 is in any state of unplayed, playing, or played.

AV contents 121-1 or 121-
With the use of 2, it becomes possible to edit images and sounds only with a small storage area. Hereafter, AV content 1
When there is no need to individually distinguish 21-1 or 121-2, it is simply referred to as AV content 121. Hereafter, AV
When there is no need to individually distinguish the content attribute record 132-1 or the AV content attribute record 132-2, it is simply referred to as the AV content attribute record 132.

Next, a screen displayed by the recording / reproducing program 81 on the CRT 30 of the personal computer 11 will be described. FIG. 9 shows a case where the recording / reproducing program 81 allows the personal computer 1 to perform a recording operation.
FIG. 3 is a diagram illustrating a screen displayed on one CRT 30.

A recording window 141 is displayed on an image display window 140 on which an image to be recorded or reproduced is displayed.
And a playback window 146 are displayed. In the recording window 141, a channel to be recorded, a recording mode, and the like are set. Also, on the recording window 141,
When the recording button 141a is displayed and the recording window 141 is active, the recording process is started by operating and clicking the mouse. Also, record button 1
When the recording is not being performed, for example, as shown in FIG. 9, the input source 41a of the content to be recorded is displayed, and when the recording is started, the display 41a changes to the display of "REC" (FIG. 9). 10). Also, the playback window 146
Has a play button 146a, and like the record button 146, when the play window 146 is active, the mouse is operated and clicked to start the play processing. The recording process and the reproduction process will be described later.

When recording is started, the recording / reproducing program 81 starts the tuner 54 or the MPEG encoder 58 of the image processing board 34 based on the setting of the recording window 141.
And the like, and a predetermined AV content 101 and AV content attribute record 102 are generated.
Record in 1. When the recording window 141 is selected and active, the recording button 142 and the stop button 143 become active and can be operated. That is, when the recording window 141 is selected and active, the recording / reproducing program 81 executes the recording button 1
Recording is started when 46a or 142 is clicked, and stopped when the stop button 143 is clicked.

On the other hand, the recording window 141 is selected,
When active, the play button 146a or 14
4 and the pause button 145 become inactive, and the recording / playback program 81 does not operate even if the play button 144 or the pause button 145 is clicked.

The user moves the cursor 147 over a button for performing a desired operation with the mouse 29, and
Thereafter, an instruction can be issued by clicking.

FIG. 10 shows that when the recording / reproducing program 81 starts recording, the CRT of the personal computer 11
FIG. 3 is a diagram illustrating a screen displayed on a screen 30; The recording window 141 displays the elapsed time from the start of recording, the current time, and the like, in addition to the channel to be recorded and the recording mode. When recording starts, the recording button 142
It is changed to a recording time change button 151. The recording time is
Each time the recording time change button 151 is clicked, it is changed.

FIG. 11 is a diagram for explaining the change of the recording time when the recording time change button 151 is clicked. When recording starts, the recording start time is HDD3
Set to the maximum recordable time calculated from the size of data that can be recorded in 1-1 and 31-2 (so-called free space), the amount of image data per unit recording time determined by the recording mode, and the like. Is done. For example, HDD3
The size of recordable data of 1-1 is 3 Gbytes, and the size of recordable data of HDD 31-2 is 6 Gbytes.
If it is a byte and the data amount of the image per second in the standard recording mode is 5 Mbits, the maximum recordable time is calculated from the following equation. (3 GB + 6 GB) * (8 bits / byte) /
(5 Mbit / s) = 14400 seconds = 4 hours

If less than 30 minutes have elapsed since the start of recording, as shown in FIG. 11A, when the maximum recording time is set as the recording time, when the recording time change button 151 is clicked. , The recording time is set to 30 minutes. From here, every time the recording time change button 151 is clicked, the recording time is 1 hour, 1 hour 30 minutes,
It is changed to 2 hours, 2 hours 30 minutes, and 3 hours. If the recording time change button 151 is clicked when the recording time is set to 3 hours, the recording time returns to the maximum recordable time.

When 30 minutes or more and less than 1 hour have elapsed since the start of recording, as shown in FIG. 11B, when the maximum recordable time is set as the recording time, the recording time change button 151 is pressed. When clicked, the recording time will be 1
Set to time. From here, recording time change button 15
Each time 1 is clicked, the recording time is 1 hour 30
Minutes, 2 hours, 2 hours 30 minutes, 3 hours. If the recording time change button 151 is clicked when the recording time is set to 3 hours, the recording time returns to the maximum recordable time.

When one hour and a half hour or more and less than two hours have elapsed since the start of recording, as shown in FIG.
When the maximum recording time is set as the recording time and the recording time change button 151 is clicked, the recording time is set to 2 hours. From this point, every time the recording time change button 151 is clicked, the recording time is changed to 2 hours 30 minutes and 3 hours. If the recording time change button 151 is clicked when the recording time is set to 3 hours, the recording time returns to the maximum recordable time.

As described above, the user simply and appropriately clicks the recording time change button 151,
You can change the recording time.

The recording time can be set from a recording time setting window displayed by selecting a predetermined menu command from the screen of the recording / reproducing program 81. 12 and 13 are diagrams showing a recording time setting window. FIG. 12 is a diagram showing a screen when the recording time from the start time is selected by a pull-down menu. FIG. 13 is a diagram showing a screen when the maximum recordable time is selected. By using the recording time setting window, the user can quickly set the recording time.

Next, a predetermined AV content 101 or AV content 121 is
The screen for reproducing is described. FIG. 14 is a diagram illustrating a screen displayed on the CRT 30 of the personal computer 11 when the recording / reproducing program 81 can perform a reproducing operation.

In the reproduction window 146, the AV to be reproduced is displayed.
The content recording mode and the like are displayed. When the play window 146 is selected and active, the stop button 143, the play buttons 144, 146a, and the pause button 145 become active and can be operated. That is, when the playback window 146 is selected and active, the recording and playback program 81 starts playback when the playback button 144 (or 146a) is clicked, and plays when the pause button 145 is clicked. Is paused, and when the stop button 143 is clicked, the reproduction is stopped.

On the other hand, when the playback window 146 is selected,
When active, the recording button 142 is inactive, and the recording / playback program 81
Even if 42 or 141a is clicked, it does not operate.

As described above, in response to the selection of the recording window 141 or the reproduction window 146, the recording / reproduction program 81 executes the recording button 142, the stop button 143,
By changing the state of the play button 144 or the pause button 145 to either the active state or the inactive state, the user can surely know what can be operated, so that the user can operate quickly. Incorrect operation can be prevented.

FIG. 15 shows, for example, the recording / playback program 8
1 is a screen displayed on the CRT 30 of the personal computer 11 when reproducing the AV content 101-1 and displaying the still images stored in the still image data files 112-1-1 to 112-1-3. FIG. The still image display window 171 displays still images (still images at scene changes) stored in the still image data files 112-1-1 to 112-1-3 as thumbnail images of a predetermined size. The horizontal position in the figure of the still image display window 171 corresponds to the time axis of the image to be reproduced.

The position indicated by the current position indicating gauge 172 is
This corresponds to the current time, that is, the time point of the image being reproduced.
The left side in the drawing shows a predetermined past time point (an image has already been reproduced) after a predetermined time period corresponding to the distance from the position of the current position indicating gauge 172 has elapsed. The right side in the figure shows a future time point (an image is to be reproduced from now) of a predetermined time corresponding to the distance from the position of the current position indicating gauge 172.

The thumbnail image is arranged at a position corresponding to the point of the scene change (scene change).
It is displayed in the still image display window 171. When a scene change occurs in a short time, the thumbnail images are displayed in a superimposed manner. As the display of the reproduced image progresses (as time elapses), the display position of the thumbnail image moves from the right side to the left side in the figure.

It is also possible to scroll only the thumbnail image displayed in the still image display window 171 separately from the image being reproduced by dragging the thumbnail image or the like. The thumbnail image is also scrolled by operating the scroll bar 173. In any case, the distance between the thumbnail images always reflects the time between the scene changes and does not change.

As described above, the user can quickly know a transition of a scene in a predetermined range from the thumbnail image displayed in the still image display window 171 and can immediately see a desired scene.

Here, the display of a thumbnail image in the still image display window 171 will be described. As described above, when a scene change occurs in a short time, FIG.
As shown in (A), thumbnail images are superimposed and displayed. In FIG. 16A, since the thumbnail images A to C overlap, as a result, the user can refer only to the thumbnail image C displayed at the top.

Conversely, there is a case where no thumbnail image is displayed in the still image display window 171 as shown in FIG. Thus, when no thumbnail image is displayed, the user has no clue to search for a desired scene.

In order to prevent such a situation from occurring, the thumbnail images are not overlapped, and the thumbnail images are not displayed at all. Control the display. First, the still image display window 171 will be described with reference to FIG. As shown in FIG. 17A, the length from the right end to the left end of the still image display window 171 is equivalent to 30 seconds in terms of time. The length of one thumbnail image is equivalent to 5 seconds. Therefore, when the thumbnail images are displayed in the still image display window 171 so as not to overlap with each other, FIG.
As shown in (B), six thumbnail images A to F can be displayed.

In order to always display at least one part of at least one thumbnail image in the still image display window 171, one thumbnail image is required for about 30 seconds. The reason for setting to about 30 seconds is that when a thumbnail image actually exists every 30 seconds, the still image display window 1
There is a case where one thumbnail image is not displayed in 71. For example, if a thumbnail image exists every 29 seconds, a thumbnail image of at least one second is always displayed in the still image display window 171.

However, in a state where the thumbnail images for only one second are displayed, the images cannot be referred to for the user. Therefore, in order to ensure that at least one thumbnail image is always displayed in the still image display window 171 in perfect form, it is sufficient that a thumbnail image exists every 15 seconds, for example. Fifteen
If there is a thumbnail image every second, at least one thumbnail image is always displayed in the still image display window 171 as shown in FIG.

As described above, by displaying the thumbnail images in the still image display window 171, the user can easily perform an operation of searching for a desired scene based on the displayed thumbnail images. However, the position of the displayed thumbnail image in the program including the thumbnail image is determined by, for example, the image currently displayed (reproduced) in the image display window 140. On the other hand, since there is no information such as whether the thumbnail image exists at a time earlier or later, the user searches for a desired scene only from the displayed thumbnail images. I have to put it out.

As described above, searching for a desired scene only from a thumbnail image may be inconvenient. Therefore, information on the time for the thumbnail image is also presented. With reference to FIG. 19, a method of presenting information on time will be described. Note that FIG.
Here, only a part of the display screen displayed on the CRT 30 (the lower part of the display screen shown in FIG. 15) is shown.

As shown in FIG. 19, when the user moves and drags the cursor 147 on the scroll bar 173 or clicks (drags) the thumbnail image, the position time is displayed above the still image display window 171. The display 181 and the difference time display 182 are displayed. The position time display unit 181 displays the time from the start time of the program including the thumbnail image displayed on the still image display window 171. For example, if a user views a program from the beginning and clicks a thumbnail image corresponding to a screen displayed after 30 minutes has elapsed, as shown in FIG. 00 seconds "is displayed.

The difference time display section 182 displays the time for the image displayed (reproduced) in the image display window 140. For example, if the thumbnail image clicked on the screen displayed in the image display window 140 is an image corresponding to the screen one minute before, FIG.
As shown in FIG. 1 (A), the difference time display section 182 displays "-
00:01:00 ”(a minus sign indicates the previous time). If the image corresponds to the screen one minute later, as shown in FIG. Minutes 00 seconds "is displayed.

In the above example, the time corresponding to the clicked thumbnail image is displayed on the position time display section 181 and the difference time display section 182, respectively.
When the user is dragging and operating the scroll bar 173, a time corresponding to the center of the still image display window 171 is displayed. For example, as shown in FIG. 22, when the current position indicating gauge 172 is displayed at the center of the still image indicating window 171 by dragging the scroll bar 173, the difference time display unit 182 displays 00 minutes 00 seconds "is displayed.

By presenting the position time and the difference time in this manner, the user can search for a desired scene by referring to those times. For example, if the user wants to view the program 30 minutes after the start of the program,
The scroll bar 173 may be dragged so that the time displayed in No. 1 is “00:30:30”.
When the user wants to view the content two minutes after the current location, the time displayed on the difference time display unit 182 is set to “00:02:00”.
What is necessary is just to drag the scroll bar 173.

As described above, the user can easily and immediately search for a desired scene.

Next, the recording / reproducing program 81
The recording process when the CPU 21 executes the recording / playback program 81 will be described with reference to the flowchart of FIG. In step S1, the recording / reproducing program 81 reads the content database 92
An attribute indicating that a predetermined AV content is being recorded is registered in the. In step S2, the hardware interface 9 based on the instruction of the recording / playback program 81
1 is a high-quality image recorded in the MPEG encoder 58
Alternatively, compression is performed in a predetermined recording mode such as standard.

At step S3, the hardware interface 91, based on the recording / playback program 81,
Based on the output of the MPEG encoder 58, it is determined whether or not the scene of the recorded image has been switched. If it is determined that the scene of the recorded image has been switched, the process proceeds to step S4, where the MPEG encoder 58 Then, a still image corresponding to the image (moving image) is generated.

If it is determined in step S3 that the scene of the image being recorded has not been switched, then in step S5, a previous image (thumbnail image)
It is determined whether or not a predetermined time has elapsed since the is generated. This is because, as described above, in order to display one or more thumbnail images in the still image display window 171, it is necessary to generate a still image every 15 seconds, for example. Therefore, the predetermined time is 1
If it is set to 5 seconds, the process of step S5 determines whether 15 seconds have elapsed since the last generation of the still image. If it is determined in step S5 that the predetermined time has elapsed, the process proceeds to step S4, where a still image is generated.

On the other hand, if it is determined in step S5 that the predetermined time has not elapsed, there is no need to generate a still image, so step S4 is skipped and the procedure proceeds to step S6.

In step S6, based on the instruction of the recording / playback program 81, the file I / O 93 determines whether or not the moving image data file 111 storing the compressed image has become a predetermined size or more. If it is determined that the moving image data file 111 has become equal to or larger than the predetermined size, the process proceeds to step S7, and it is determined whether or not the HDD 31 in which the moving image data file 111 is recorded runs out of free space.

If it is determined in step S7 that the HDD 31 on which the moving image data file 111 has been recorded has run out, the process proceeds to step S8, where the recording / reproducing program 81 selects another HDD 31.

If it is determined in step S7 that there is free space on the HDD 31 in which the moving image data file 111 is recorded, another moving image data file 111 can be recorded on the HDD 31, so that step S8 is skipped. The procedure proceeds to step S9.

In step S9, based on the instruction of the recording / playback program 81, the file I / O 93
In D31, a new moving image data file 111 and a new still image data file 112 are generated, the compressed image is recorded in the new moving image data file 111, and the generated still image is stored in a new still image data file. Then, it is set to be recorded in 112, and the process proceeds to step S10.

If it is determined in step S6 that the moving image data file 111 is not larger than the predetermined size, the compressed image can be continuously recorded in the moving image data file 111. Proceed to step S10.

In step S 10, the file I / O 93 records the image compressed by the MPEG encoder 58 in the moving image data file 111 on the predetermined HDD 31 based on the instruction of the recording / reproducing program 81. Step S1
In 1, the recording / playback program 81 records a still image generated by the MPEG encoder 58 in a still image data file 112 on a predetermined HDD 31 together with predetermined data such as a scene reproduction time.

In step S12, the recording / reproducing program 81 determines whether or not to end the recording based on the setting of the recording time or an input from the mouse 29. Returning to S62,
Continue the recording process.

If it is determined in step S12 that the recording is to be ended, the process proceeds to step S13, where the recording / reproducing program 81 registers an attribute indicating that the recording of the predetermined AV content 101 is completed in the content database 92, and executes the processing. Ends.

Next, the recording / reproducing program 81, the hardware interface 91, and the file I / O 93
24 is loaded into the RAM 23, and the CPU 21 executes the recording / reproducing program 81, the hardware interface 91, and the file I / O 93, the process of displaying a still image will be described with reference to the flowchart of FIG. The processing in the flowchart of FIG. 24 is performed in the synchronous mode in which the reproduced image and the position of the thumbnail image on the still image display window 171 correspond to each other, or the reproduced image and the thumbnail on the still image display window 171 are displayed. This is a process performed regardless of the asynchronous mode in which the position of the image does not correspond.

In step S21, in the synchronous mode, the still image data corresponding to the time of the image being reproduced is stored. In the asynchronous mode, the position and time of the dragged thumbnail image (scroll bar 173) are displayed. Is read from the still image data file 112. The display position of the thumbnail image displayed based on the still image data read in step S22 is calculated, and the calculated display position is
A thumbnail image is displayed.

In step S23, step S22
It is determined whether there is a thumbnail image within 5 seconds at a time after the time of the thumbnail image displayed in. If it is determined in step S23 that there is a thumbnail image within 5 seconds, the process proceeds to step S24. In step S24, the data of the still image corresponding to the next image (the image after the 6th second) of the thumbnail image (up to 4 images) within 5 seconds is read. When the data is read, the process returns to step S22, and the subsequent processing is repeated.

In step S23, when it is determined that there is no thumbnail image within 5 seconds, in other words, when it is determined that the next thumbnail image is after 6 seconds or more, the process proceeds to step S25, and the next thumbnail image is displayed. The data of the still image of the image is read. When the data reading is completed, the process returns to step S22, and the subsequent processes are repeated.

By controlling the display of the thumbnail images in this manner, as described above, the thumbnail images are not overlapped, and there is no section in which no thumbnail images are displayed, and the thumbnail images are displayed. It is displayed in the still image display window 171.

Next, the process of displaying the time displayed on the position time display section 181 and the difference time display section 182 will be described with reference to the flowchart of FIG. In step S31, the thumbnail image displayed on the still image display window 171 or the scroll bar 1
If it is determined that 73 has been dragged, step S32
Proceed to.

In step S32, the time displayed on the position time display section 181 and the time displayed on the difference time display section 182 are calculated in accordance with the amount of change by dragging. As described above, the time displayed on the position time display unit 181 is based on the start time of the program.
The time indicating how much time has elapsed, and the time displayed on the difference time display unit 182 is the image being reproduced (the image displayed on the image display window 140).
Time relative to. When the calculation of the time is completed, in step S33, the calculated time is stored in the position time display unit 181 and the difference time display unit 182.
Are displayed respectively.

In step S34, it is determined whether or not the drag has been completed. If it is determined that the drag has not been completed, the process returns to step S32, and the subsequent processing is repeated. On the other hand, if it is determined in step S34 that the drag has been completed, the process proceeds to step S35,
The time displayed on the position time display section 181 and the difference time display section 182 is deleted.

By presenting the time information to the user in this way, the user can easily and quickly search for a desired scene.

In the above description, the position time and the difference time are displayed, but only one of them may be displayed. Also, the date and time when the program was actually recorded may be displayed.

The above series of processing can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may be executed by a computer built into dedicated hardware or by installing various programs to execute various functions. It is installed from a program storage medium to a possible general-purpose personal computer or the like.

The program storage medium is not limited to the hard disk drives 31-2 and 31-2 in which the program is recorded, which is provided to the user in a state of being incorporated in the personal computer 11 in advance as shown in FIG. Apart from the computer, a magnetic disk 111 (including a floppy disk) on which the program is recorded and an optical disk 112 (CD-ROM (Compact Disk-Read Only Memory) distributed to provide the program to the user are provided.
y), a DVD (including a Digital Versatile Disk), a magneto-optical disk 113 (including an MD (Mini-Disk)), or a package medium including a semiconductor memory 114 or the like.

In this specification, the steps of describing a program recorded on a program storage medium are not necessarily performed in a time-series manner, of course. Both include processes executed in parallel or individually.

[0110]

As described above, according to the information processing apparatus according to the first aspect, the information processing method according to the third aspect, and the program storage medium according to the fourth aspect, a moving image and a moving image of the moving image Still images corresponding to scene switching are recorded, and the time indicating the relationship between the moving images and the still images is displayed, so that the user can search for desired still images and moving images by referring to the time. Becomes possible.

[Brief description of the drawings]

FIG. 1 is a diagram showing an embodiment of an image recording / reproducing system according to the present invention.

FIG. 2 is a block diagram illustrating a configuration of a personal computer 11.

FIG. 3 is a diagram showing a configuration of an image processing board 34.

FIG. 4 is a diagram illustrating an application program executed by the personal computer 11.

FIG. 5 is a diagram illustrating a configuration of an application program, middleware, and drivers executed by the personal computer 11.

FIG. 6 is a diagram illustrating an example of a configuration of AV content.

FIG. 7 is a diagram illustrating an example of a configuration of AV content.

FIG. 8 is a diagram illustrating an example of a configuration of AV content.

FIG. 9 is a diagram illustrating a screen of a recording / reproducing program 81.

FIG. 10 is a diagram illustrating a screen of a recording / playback program 81.

FIG. 11 is a diagram illustrating a change in recording time caused by clicking a recording time change button 151.

FIG. 12 is a diagram illustrating a recording time setting window.

FIG. 13 is a diagram illustrating a recording time setting window.

FIG. 14 is a diagram illustrating a screen of a recording / playback program 81.

FIG. 15 is a diagram illustrating a screen of a recording / playback program 81.

FIG. 16 is a diagram illustrating a thumbnail image displayed in a still image display window 171.

FIG. 17 is a diagram illustrating a thumbnail image displayed in a still image display window 171.

FIG. 18 is a diagram illustrating a thumbnail image displayed in a still image display window 171.

FIG. 19 is a diagram illustrating time display.

FIG. 20 is a diagram illustrating time display.

FIG. 21 is a diagram illustrating time display.

FIG. 22 is a diagram illustrating time display.

FIG. 23 is a flowchart illustrating a recording process.

FIG. 24 is a flowchart illustrating a thumbnail image display process.

FIG. 25 is a flowchart illustrating a time display process.

[Explanation of symbols]

11 Personal computer, 13 VCR, 14
DVCR, 15 DVCR, 16, 16-1, 16-1
Network, 21 CPU, 23 RAM, 34 image processing board, 58 MPEG encoder, 60 MPEG decoder, 81 recording / playback program, 82 AV content management search program, 83 AV content editing program, 92 content database, 1
01 AV content, 102 AV content attribute record, 111 moving image data file, 112
Still image data file, 121 AV contents,
131 edited data file, 132 AV content attribute record, 141 recording window, 141
a record button, 142 record button, 143 stop button, 144 play button, 145 pause button, 146 play window, 146a play button, 147 cursor, 171 still image display window, 172 current position indicating gauge, 173
Scroll bar, 181 position time display, 182
Difference time display section

Claims (4)

[Claims] A first recording control unit for controlling recording of a moving image; a still image corresponding to switching of a scene of the moving image;
A second recording control unit for controlling the recording of the time; a first reproduction control unit for controlling the reproduction of the moving image recorded by the first recording control unit; and a second recording control unit. Second playback control means for controlling the playback of the recorded still image; and playback of the moving image whose playback is controlled by the first playback control means and playback controlled by the second playback control means. And a display control unit for controlling display of a time indicating a relationship with the still image. 2. The time at which display is controlled by the display control means is the time recorded by the second recording control means, and the time at which recording of the moving image is started by the first recording control means. A time indicating a difference from a time at which the still image whose reproduction is controlled by the second reproduction control means is recorded, or an indication of the moving image whose reproduction is controlled by the first reproduction control means. At least one of a time indicating a difference between a time and a time indicated by the still image whose reproduction is controlled by the second reproduction control means;
The information processing apparatus according to claim 1, wherein: 3. A first recording control step of controlling recording of a moving image, a still image corresponding to switching of a scene of the moving image,
A second recording control step for controlling the recording of the time; a first reproduction control step for controlling the reproduction of the moving image recorded in the processing of the first recording control step; and the second recording control. A second reproduction control step of controlling reproduction of the still image recorded in the processing of the step, and the moving image whose reproduction is controlled in the processing of the first reproduction control step and the second reproduction control step A display control step of controlling display of a time indicating a relationship with the still image whose reproduction is controlled in the processing of (a). 4. A first recording control step of controlling recording of a moving image, a still image corresponding to switching of a scene of the moving image,
A second recording control step for controlling the recording of the time; a first reproduction control step for controlling the reproduction of the moving image recorded in the processing of the first recording control step; and the second recording control. A second reproduction control step of controlling reproduction of the still image recorded in the processing of the step, and the moving image whose reproduction is controlled in the processing of the first reproduction control step and the second reproduction control step A display control step of controlling display of a time indicating a relationship with the still image whose reproduction is controlled in the processing of step (b). A program storage medium storing a computer-readable program.