JP2001285784A - Device and method for processing information and program storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily and quickly edit images. SOLUTION: When a read button 211 is operated, a material clip 212 as an editing object is displayed at a material tray 201. When a tag 271-1 is selected, a shaker window provided with selection buttons 281 is displayed. The respective plural selection buttons 281 correspond to scenarios. To the respective scenarios, the number of scenes and effects to be imparted to the respective scenes, etc., are specified beforehand. A user selects one scenario by selecting one selection button 281. When a shake button 285 is operated, the prescribed one is randomly selected from the material clips 212 specified beforehand by the user and allocated to the respective scenes of the scenario selected by the user.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and method, and a program storage medium, and more particularly, to an information processing apparatus and method and a program storage medium capable of easily editing an image.

[0002]

2. Description of the Related Art In recent years, the functions of personal computers have been improved, and it has become possible to edit not only text data but also image data.

[0003]

However, in order to edit an image, the user must learn the operation functions, and even if it learns, it takes a long time to obtain a predetermined editing result. .

[0004] The present invention has been made in view of such a situation, and it is an object of the present invention to be able to easily and quickly edit an image.

[0005]

An information processing apparatus according to the present invention comprises: scenario data comprising a plurality of scenes; and associating means for arbitrarily associating a plurality of images to be edited with each of the plurality of scenes. It is characterized by having.

[0006] The plurality of scenes can have different predetermined lengths.

[0007] Correction means for correcting the image associated by the association means according to the length of the scene may be further provided.

[0008] A reproduction means for continuously reproducing a plurality of images associated by the association means based on the scenario data may be further provided.

[0009] The reproducing means can reproduce the image by applying the special effect information to a plurality of images based on the predetermined special effect information associated with the scene.

[0010] The image processing apparatus further comprises a deciding means for arbitrarily determining the special effect information to be associated with the scene from the plurality of special effect information, and the reproducing means determines the special effect information for the plurality of images based on the decision result of the deciding means. The information can be applied and reproduced.

[0011] The associating means may arbitrarily associate a plurality of images to be edited with a plurality of scenes of the scenario data selected from the plurality of scenario data.

Registration means for registering an image to be edited, image information display means for displaying a list of information on a plurality of images to be edited, and a plurality of images associated by the associating means in accordance with the order of a plurality of scenes. Output information display means for arranging and displaying information relating to the image described above.

[0013] The associating means performs association using a scenario corresponding to a command from a user among a first scenario based on repeated continuous playback and a second scenario not based on repeated playback. You can do so.

According to the information processing method of the present invention, an associating processing step of arbitrarily associating a plurality of images to be edited with each of a plurality of scenes constituting scenario data; It is characterized by including a correction processing step of correcting each of the associated images, and a reproduction processing step of continuously reproducing a plurality of images based on the scenario data.

[0015] The image processing apparatus may further include a determining step of arbitrarily determining special effect information to be associated with the scene from among the plurality of special effect information.

An image information display processing step for displaying a list of information on a plurality of images to be edited, and output information for arranging and displaying information on the plurality of images associated in the association processing step in accordance with the order of the plurality of scenes And a display processing step.

The program of the storage medium according to the present invention comprises: an associating processing step for arbitrarily associating a plurality of images to be edited with each of a plurality of scenes constituting scenario data; And a correction processing step of correcting each of the associated images, and a reproduction processing step of continuously reproducing a plurality of images based on the scenario data.

[0018] The image processing apparatus may further include a determining step of arbitrarily determining special effect information to be associated with the scene from a plurality of pieces of special effect information.

An image information display processing step for displaying a list of information on a plurality of images to be edited, and output information for arranging and displaying information on a plurality of images associated in the association processing step in accordance with the order of the plurality of scenes And a display processing step.

In the information processing apparatus, method and program according to the present invention, image information is associated with an acquired scene.

[0021]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of an information processing apparatus according to the present invention will be described below with reference to the drawings.

FIGS. 1 to 6 show examples of the configuration of a portable personal computer to which the present invention is applied. The personal computer 1 is a mini-notebook type personal computer, and basically includes a main body 2 and a display unit 3 which can be opened and closed with respect to the main body 2. FIG. 1 is an external perspective view showing a state in which the display unit 3 of the personal computer 1 is opened with respect to the main body 2, FIG. 2 is a plan view thereof, and FIG. FIG. 4 is a right side view showing a state in which the display unit 3 is opened by 180 degrees with respect to the main body 2, FIG. 5 is a front view thereof, and FIG. 6 is a bottom view thereof.

The main body 2 is provided on its upper surface with a keyboard 4 operated when inputting various characters and symbols, and a stick type pointing device 5 operated when moving a mouse cursor. Also,
On the upper surface of the main body 2 are further provided speakers 8-1 and 8-2 for outputting sound and a shutter button 10 which is operated when taking an image with the CCD video camera 23 provided on the display unit 3.

The display unit 3 is connected to the main body 2 by hinges 9-1 and 9-2 so as to be openable and closable. A battery 7 is detachably mounted between the hinge 9-1 and the hinge 9-2 of the main body 2.

The display unit 3 has claws 13-1 and 13-
As shown in FIG. 3, when the display unit 3 is closed with respect to the main body 2, the main body 2 at a position facing the claws 13-1 and 13-2 has a claw 1.
Hole 6-1 into which each of 3-1 and 13-2 fits
And 6-2 are provided (FIG. 2).

Next to the image pickup unit 22, a microphone 24
Is attached. This microphone 24 is shown in FIG.
As shown in the figure, the sound from the back can also be picked up.

On the left side of the main body 2, as shown in FIG.
An exhaust hole 11 is provided.
As shown in FIG. 5, an intake hole 14 is provided. Further, next to the exhaust hole 11, a PCMCIA (Personal Computer)
A slot 12 for inserting a card (PC card) conforming to the standard defined by Memory Card International Association is provided.

An LCD for displaying an image is provided on the front of the display unit 3.
(Liquid Crystal Display) 21 is provided, and an imaging unit 22 is provided at the upper end thereof so as to be rotatable with respect to the display unit 3. That is, this imaging unit 22
It can rotate to any position within a range of 180 degrees between the same direction as D21 and the opposite direction (backward direction). A CCD video camera 23 is attached to the imaging unit 22.

On the front side of the main body 2, there are provided a power lamp PL, a battery lamp BL, a message lamp ML, and other lamps composed of LEDs. Note that reference numeral 40 shown in FIG.
Is a power switch provided next to the shutter button 10, and reference numeral 25 shown in FIG.
This is an adjustment ring for adjusting the focus. Further, reference numeral 26 shown in FIG. 6 is a lid for covering an opening for mounting an additional memory in the main body 2.

Next, the internal configuration of the personal computer 1 will be described with reference to FIG.

A central processing unit (CPU (Central Process
ng Unit) 51 is composed of, for example, a Pentium (trademark) processor manufactured by Intel (trade name) and is connected to the host bus 52. A bridge 53 (a so-called north bridge) is further connected to the host bus 52.
PC with GP (Accelerated Graphics Port) 50
It is connected to an I (Peripheral Component Interconnect / Interface) bus 56.

The bridge 53 is, for example, manufactured by Intel Corporation.
It is composed of an AGP Host Bridge Controller, such as 400BX, and has a CPU 51 and a RAM (Random-Access
Memory) 54 (so-called main memory) and the like. Further, the bridge 53 controls the video controller 57 via the AGP 50. The bridge 53 and a bridge (so-called south bridge (PCI-ISA
Bridge)) 58 constitute a so-called chipset.

The bridge 53 is further connected to a cache memory 55. The cache memory 55
Compared with the RAM 54 such as an SRAM (Static RAM), the RAM 51 is configured by a memory that can execute a write or read operation at a higher speed, and caches (temporarily stores) a program or data used by the CPU 51.

The CPU 51 has a primary cache memory (a memory that can operate at a higher speed than the cache memory 55 and is controlled by the CPU 51 itself).

The RAM 54 is, for example, a DRAM (Dynami
c RAM) and stores a program executed by the CPU 51 or data necessary for the operation of the CPU 51. More specifically, for example, the RAM 54 stores the e-mail program 54A and the auto-pilot program 5
4B, operating program (OS) 54C, shaker program 54D, capture program 54
E, storing other application programs 54F1 to 54Fn.

The e-mail program 54A is connected to the modem 7
5 is a program for exchanging communication messages (so-called e-mail) via a communication line such as a telephone line 76 via the communication line 5. The electronic mail program 54A has an incoming mail acquisition function. This incoming mail acquisition function is provided by the mail server 7 provided by the Internet service provider 77.
In step S8, a check is made to see if mail addressed to the user has arrived in the mailbox 79, and if there is mail addressed to the user, a process for acquiring the mail is executed.

The autopilot program 54B includes a plurality of preset processes (or programs),
This is a program that is started and processed sequentially in a preset order.

The OS (Operating System) 54C is, for example, a so-called Windows 95 (trademark) or Windows 98 of Microsoft (trade name).
(Trademark) or a program that controls the basic operation of a computer, such as the so-called Mac OS (trademark) of Apple Computer (trade name).

The shaker program 54D is a program for executing an automatic editing process. The capture program 54E is a program for controlling capture of a captured image by the CCD video camera 23.

The video controller 57 is connected to the bridge 53 via the AGP 50, receives data (image data or text data) supplied from the CPU 51 via the AGP 50 and the bridge 53, and converts the received data into data. The corresponding image data is generated, or the received data is stored as it is in a built-in video memory (not shown). The video controller 57 causes the LCD 21 of the display unit 3 to display an image corresponding to the image data stored in the video memory. Further, the video controller 57 transmits the video data supplied from the CCD video camera 23 to the PCI bus 56.
Via the RAM 54.

A sound controller 64 is connected to the PCI bus 56. Sound controller 64
Captures a signal corresponding to a voice from the microphone 24, generates data corresponding to the voice, and outputs the data to the RAM. In addition, the sound controller 64 drives the speaker 8 to cause the speaker 8 to output sound.

A modem 75 is connected to the PCI bus 56. The modem 75 transmits predetermined data to a communication network 80 such as the Internet or a mail server 78 via a public telephone line 76 and an Internet service provider 77, and receives predetermined data from the communication network 80 or the mail server 78. .

PC card slot interface 11
1 is connected to the PCI bus 56 and supplies the data supplied from the interface card 112 mounted in the slot 12 to the CPU 51 or the RAM 54 and outputs the data supplied from the CPU 51 to the interface card 112. The drive 113 is connected to the PCI bus 56 via the PC card slot interface 111 and the interface card 112.

The drive 113 reads data recorded on a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, or a semiconductor memory 124 mounted as necessary, and reads the read data into an interface card 112, a PC card slot. Via the interface 111 and the PCI bus 56, the RAM 54
To supply.

The bridge 58 is connected to the PCI bus 56.
(So-called South Bridge) is also connected. The bridge 58 is made of, for example, PIIX4E (trademark) manufactured by Intel Corporation, and has an IDE (Integrated Drive).
Electronics) A controller / configuration register 59, a timer circuit 60, an IDE interface 61, a USB interface 68, and the like are built in. The bridge 58 is a device connected to the IDE bus 62 or an ISA / EIO (Industry Standard).
Architecture / Extended Input Output) Various I / Os (Input / Output) such as control of devices connected via the bus 63 or the I / O interface 69 are controlled.

The IDE controller / configuration register 59 stores two IDs of a so-called primary IDE controller and a secondary IDE controller.
It is composed of an E controller, a configuration register and the like (both not shown).

The primary IDE controller has an ID
The HDD 67 is connected via the E bus 62. When a so-called IDE device such as a CD-ROM drive or HDD (not shown) is mounted on another IDE bus, the mounted IDE device is electrically connected to the secondary IDE controller.

The HDD 67 has an electronic mail program 67A, an autopilot program 67B, and an OS
67C, a shaker program 67D as an application program, a capture program 67E, and a plurality of other application programs 67F1 to 67F.
Fn and the like are recorded. E-mail program 67A, auto-pilot program 67B, OS 67C, shaker program 67D recorded on HDD 67,
The capture program 67E, the application programs 67F1 to 67Fn, and the like are sequentially supplied to the RAM 54 and loaded in the course of the startup (boot-up) process.

The USB interface 68 is connected to the GPS antenna 1 via the USB port 107.
The pseudo-noise code is received from 06, and the received pseudo-noise code is transmitted to the RAM 54 via the PCI bus 56.

The timer circuit 60 sends data indicating the current time to the PCI bus 5 in response to requests from various programs.
6 to the CPU 51.

The ISA / EIO bus 63 further includes an I
The / O interface 69 is connected. This I /
The O interface 69 is composed of an embedded controller, in which the ROM 70, RA
M71 and CPU72 are mutually connected.

The ROM 70 includes an IEEE 1394 interface program 70A, an LED control program 70
B, a touch pad input monitoring program 70C, a key input monitoring program 70D, a wake-up program 70E, and the like are stored in advance.

The IEEE 1394 interface program 70A transmits and receives data (data stored in a packet) conforming to the standard defined by IEEE 1394 via the IEEE 1394 port 101. The LED control program 70B controls lighting of a power lamp PL, a battery lamp BL, a message lamp ML as required, or other lamps including LEDs. Touchpad input monitoring program 70C
Is a program for monitoring an input from the touch pad 33 corresponding to a user operation.

The key input monitoring program 70D is a program for monitoring inputs from the keyboard 4 or other key switches. Wake-up program 70E
Checks whether or not a preset time has been reached based on data indicating the current time supplied from the timer circuit 60 of the bridge 58. When the preset time has come, a predetermined process (or program ) Is a program for managing the power supply of each chip constituting the personal computer 1 in order to activate the above.

The ROM 70 further contains a BIOS (Basic
Input / Output System (basic input / output system)) 70G
Is written. The BIOS 70G includes an OS or an application program and peripheral devices (the touch pad 3).
3, the keyboard 4, the HDD 67, etc.).

The RAM 71 includes registers for LED control, touch pad input status, key input status, or set time, or IEEE 1394 I / F registers as registers 71A to 71F. For example, when the e-mail program 54A is started, a predetermined value is stored in the LED control register, and lighting of the message lamp ML is controlled in accordance with the stored value. The key input status register stores a predetermined operation key flag. The setting time register is
A predetermined time is set according to the operation of the keyboard 4 or the like by the user.

The I / O interface 69
Is a touch pad 3 via a connector (not shown).
3, a keyboard 4, an IEEE 1394 port 101, a shutter button 10, etc. are connected, and a signal corresponding to an operation on each of the stick type pointing device 5, the touch pad 33, the keyboard 4, and the shutter button 10 is output to the ISA / EIO bus 63. I do.
Also, the I / O interface 69 is an IEEE 139
It controls the transmission and reception of data with connected devices via the four ports 101. Further, the I / O interface 69 includes a power lamp PL, a battery lamp BL, a message lamp ML, a power control circuit 73, and other Ls.
A lamp made of ED is connected.

The power supply control circuit 73 is connected to the built-in battery 74 or the AC power supply, supplies necessary power to each block, and controls charging of the built-in battery 74 or a second battery of a peripheral device. . The I / O interface 69 monitors the power switch 40 operated when turning on or off the power.

Even when the power is off, the I / O interface 69 operates according to the IEEE standard by the internal power supply.
The 1394 interface program 70A to the wake-up program 70E are executed. That is, IE
The EE1394 interface program 70A to the wake-up program 70E are always operating.

FIG. 8 shows a display example of an image displayed on the LCD 21 when the shaker program 54D is activated. As shown in the figure, a material tray 201 is displayed at the upper left of the screen. On the material tray 201, a read button 211 is displayed. The read button 211 is operated by the user when the user attempts to edit predetermined image information and attempts to read the information to be edited. This operation is performed by operating the stick-type pointing device 5. The material tray 201 is shown in an enlarged manner in FIG.

For example, when the user sets the capture program 5
When 4E is started, the video controller 57 outputs an image captured by the CCD video camera 23 to the LCD 21 to display the image. FIG. 10 shows an example of the image displayed in this manner.

When the user operates the shutter button 10 at a predetermined timing, the video controller 57 supplies the still image or the moving image data currently displayed on the LCD 21 to the RAM 54 and stores it therein. This image data is also transferred from the RAM 54 to the hard disk 6 as needed.
7 and recorded.

The user reads out the image data stored in the RAM 54 or the hard disk 67 in this manner, and operates the read button 211 to use the image data as an image to be edited (material clip).
It can be stored in M54. The image data set to be shaken in this way is displayed as a material clip 212 on the material tray 201. As shown in an enlarged manner in FIG. 9, the title of the material clip 212, the distinction between a moving image and a still image, and the reproduction time are displayed on the right side of the material clip 212. Scroll bar 213
Means that the number of material clips 212 increases,
In the case where it becomes impossible to display all within the range of 01, the material clip 212 is operated by the user when scrolling.

The files that can be edited (material clips) are .MOV and .A as shown in FIG.
Movies with extensions such as VI, .BMP, .GIF, .JPG, .P
Still images with extensions such as NG and .PCT, or .WA
The music can have an extension such as V, .AIF.

On the right side of the material tray 201, a reproduction screen 2
21 is displayed. The user operates the stick-type pointing device 5 to move the material tray 201.
When a predetermined one of the material clips 212 displayed in is displayed and the play button 231 is operated, the specified image is reproduced and displayed on the reproduction screen 221.
At this time, as the playback progresses, the playback position display button 23
In 5, the display position moves from left to right according to the reproduction position.

As shown in FIG. 12, the pointer 234L
By specifying the start point by using, and specifying the end point by using the pointer 234R, it is possible to trim a predetermined range of the moving image. When trimmed, only the trimmed image data in the file is set as a substantial image to be edited.

When the designated range playback button 232 is operated, only the trimmed range is displayed on the playback screen 221. When the rewind button 236 is operated, the display image on the reproduction screen 221 is temporally rewind-displayed from the new image to the old image. When the fast forward button 237 is operated, the image displayed on the playback screen 221 is fast forwarded.

When the mode button 233 is operated in the story reproduction mode, the mode is changed to the edit mode. When the mode button 233 is operated in the edit mode, the mode is changed to the story reproduction mode. You.

In the editing mode, for example, when the play button 231 is operated, the material clip 212 specified from the material tray 201 at that time is displayed on the playback screen 221.
When the play button 231 is operated in a state where the story playback mode is set, as described later, an automatically or manually edited story (scenario) displayed on the output tray 291 is displayed. ) Is played from start to finish.

When performing the editing process manually (instead of automatic editing), the user selects a predetermined one of the material clips 212 displayed on the material tray 201, and selects the material clip 212 on the image track 301 shown in FIG. A desired scenario (story) is created by dragging and dropping to an arbitrary position of the plurality of image display units 301A. The image (material clip) once dragged and dropped on the predetermined image display unit 301A can be moved by dragging and dropping it on the image display unit 301A at another position.

When a music file exists on the material tray 201, the user drags and drops the icon (material clip 212) of the music file onto the BGM track 302 on the output tray 291, so that the sound is output. It can correspond as BGM. The length to which the music information is assigned on the BGM track 302 corresponds to the length of the music information. Therefore, when the length of the music information is short, another music information can be assigned by dragging and dropping it on the BGM drag 302.

On the right side of the playback screen 221, a volume button 241, a color tone button 242, and a playback speed button 2
43 is displayed. When the volume button 241 is operated, a window 331 as shown in FIG. 14 is displayed below the volume button 241. By operating the adjustment bar 332, the user can adjust the volume at the time of outputting the audio to be edited.

When the color tone button 242 is operated, FIG.
Is displayed below the color tone button 242. In this example, the user operates the adjustment bar 342 to obtain X-ray, high contrast,
As is, any color tone of sepia or monochrome can be selected.

When the reproduction speed button 243 is operated, a window 351 as shown in FIG. 16 is displayed below the reproduction speed button 243. By operating the adjustment bar 352, the user can increase or decrease the reproduction speed of the image or adjust the image reproduction speed.

Below the playback speed button 243, an effect display button 244 is displayed. The user can select a selection button icon 36 displayed in FIG.
4 or the selection button icon 362 displayed in FIG. 18 is dragged and dropped on the effect display button 244 to display the effect on the playback screen 2.
21 can be assigned to the material displayed.

On the right side of the volume buttons 241 to the effect display button 244, a special effect tray 261 is displayed. The special effect tray 261 has a tag 2
71-1 to 271-4 are displayed.

When the tag 271-2 is selected, a text window is displayed as shown in FIG. In this window, an image 361 to be edited is displayed. The font button 362 is operated when selecting the font of the text to which the effect is applied.
The text input window 363 displays text input by the user operating the keyboard 4.
The selection button icon 364 is operated when selecting an effect to be added to text (character string). The scroll bar 365 is operated when the selection button icon 364 is scrolled.

By dragging and dropping a predetermined one of the selection button icons 364 onto the effect display button 244, the text currently input and displayed in the text input window 363 is selected by the selection button icon 364. Text effects (text animations) can be added. When the play button 231 is operated after dragging and dropping the selection button icon 364 to the effect display button 244, the image to which the selected text effect is added is immediately displayed on the playback screen 221. In this way, the user can check the text effect in real time.

In the example of FIG. 17, a text animation of “oblique merging” is displayed on the reproduction screen 221.

FIG. 18 shows a display example when the tag 271-3 is selected. When this tag 271-3 is selected, an effect window is displayed as shown in FIG. In this window, an image 381 to be edited is displayed, and a selection button icon 362 for selecting an animation effect is displayed below the image 381. The scroll bar 363 is operated when the selection button icon 362 is scrolled.

Also in this case, the selection button icon 362
By dragging and dropping a predetermined one on the effect display button 244, a predetermined animation effect can be selected. After making this selection, when the play button 231 is operated, the playback screen 2
The image with the animation effect added to 21 is displayed in real time. In the example of FIG. 18, the animation effect of “palpitation” is displayed.

FIG. 19 shows a display example when the tag 271-4 is selected. In this case, a transition window is displayed as shown in FIG. In this window, a selection button icon 391 is displayed, and the user can select a predetermined one from the plurality of selection button icons 391. When this selection is made, a schematic image corresponding to the selected transition is displayed on the display unit 393. Scroll bar 39
When 2 is operated, the selection button icon 391 is scrolled.

The user selects a predetermined selection button icon 39
After selecting the image track 30, the image track 30 shown in FIG.
1 by dragging and dropping it on the transition display section 301B of the first and second transition display sections 301B.
A transition can be added to the image (material clip) displayed in 1A.

For example, when a wipe transition is set, as shown in FIG. 21, the image displayed on the left side of the figure gradually moves to the right while gradually hiding the image displayed on the right side. Then, a transition is performed.

When the tag 271-1 is selected, a shaker window for automatic editing is displayed as shown in an enlarged view in FIG. Selection buttons 281-1 to 281-5 are displayed in this shaker window. Each of the selection buttons 281-1 to 281-5 is associated with a predetermined scenario (story) in advance. Each scenario corresponds to a predetermined music set in advance, and the music corresponding to the selection button 281-1 on the leftmost side in FIG. 22 is the slowest tempo, and the music on the rightmost side is selected. The one corresponding to the selection button 281-5 is the fastest and violent one. The music corresponding to the selection buttons 281-2 to 281-4 between them is music having an intermediate tempo.

Specifically, ambient music (environmental music) is selected on the selection button 281-1, and the selection button 281-2 is displayed on the selection button 281-2.
Is associated with jazz music, the selection button 281-4 is associated with hip-hop music, and the selection button 281-5 is associated with techno music.

Therefore, the number of scenes constituting the scenario corresponding to the selection button 281-1 corresponding to these musics is relatively small (the number of scene changes is small).
It has been. On the other hand, the scenario corresponding to the select button 281-5 has a large number of scenes (a large number of scene changes). The lengths of the scenarios corresponding to the selection buttons 281-1 to 281-5 are all the same, and in this example, are 30 seconds.

The loop button 282 is operated by the user when it is assumed that a 30-second scenario generated by automatic editing is repeatedly reproduced.
The text shake button 283 is operated by the user when shaking text (character). When the text shake button 283 is operated, the window 2
84 is displayed, and the user displays in this window 284:
By operating the keyboard 4, a text (character string) to be edited (text shaking) can be input. In this example, three character strings “Let's do our best”, “Junko”, and “Happy !!” are input and displayed.

The shake button 285 is operated by the user when starting a shake (automatic editing).

When the output button 304 is operated, FIG.
A window 401 is displayed as shown in FIG. The user selects a desired item from this window 401.
As a result, it is possible to select a mode of storing the information displayed on the output tray 291 (manually or automatically edited). For example, if “simple saving” is selected, a file including the used image and the editing information of the image are stored. The editing information is, for example, information as shown in FIG. In FIG.
The leftmost frame number indicates the start timing of each scene constituting the scenario. In the example of FIG. 24, the scenario is composed of ten scenes, and the first scene of the scenario starts from the sixth frame.

The next animation effect represents the processing of the animation effect corresponding to the scene. As animation effects, 2
Since 0 effects are prepared, the values of 0 to 19 indicate the effect, and the value 99 indicates that the animation effect is not applied. The value of -1 indicates that a predetermined one is randomly selected from the 20 animation effects.

The next transition indicates which of the eight transitions is the transition. The value 99 indicates that no transition has been applied. Further, the next value indicates the timing of the transition.

The color effect has a value of 0 to 23 of 24.
It indicates which of the types of color tones. A value of -1 indicates that a predetermined color tone is randomly selected from the 24 types of color tones. The value of 99 is
Indicates that the color effect is not applied.

The last value indicates whether or not the black mat is used as the background. A value of 1 indicates that the black mat is used as the background, and a value of 0 indicates that the black mat is not used. ing.

On the other hand, when “Save as normal movie” shown in FIG. 23 is selected, the editing information shown in FIG. 24 is actually applied to the image assigned to each scene. , Image data to which such an effect is applied is actually generated (rendered).
Therefore, this process takes a longer time than the case of “simple saving”. In other words, "simple save"
By selecting, the storage time can be shortened.

Next, the shaker processing (automatic editing processing) will be described with reference to the flowcharts of FIGS. In addition, the following processing, unless otherwise described,
Basically, it is executed by the shaker program 54D.
First, in step S1, a reading process is executed using a specified file as a material clip. That is, as described above, the user activates the capture program 54E and designates a predetermined file from among image data files captured from the CCD video camera 23 and audio data files input from the microphone 24. Then, by operating the read button 211, the file is designated as a target (material clip) of the automatic editing process. When this designation process is performed, the shaker program 54D stores the designated file as a material clip, processes the image of the first frame of the file, and displays the image on the material tray 201 as the material clip 212. If the specified information is audio information, an image indicating that the information is audio information prepared in advance is displayed as the material clip 212.

The information fetched at this time includes not only the information fetched from the CCD video camera 23 and the microphone 24, but also the information fetched from the Internet 80 via the modem 75, the magnetic disk 121, the optical disk 122, Magneto-optical disk 123, semiconductor memory 1
24 or the like, it is also possible to take in the data via the interface card 112.

Next, proceeding to step S2, if a text has been input as a shake target, the shaker program 54D executes processing for taking in the input text. That is, when performing the automatic editing process, the user operates the tag 271-1 to display the shaker window (FIG. 22). When performing a text shake, the user further operates the text shake button 283. Thereby, as shown in FIG.
A window 284 is displayed. At this time, the user operates the keyboard 4 to input a text to be shaken. The shaker program 54D captures this text and causes the window 284 to display it.

The user designates one of the five shaker buttons 281-1 to 281-5. As described above, the shaker buttons 281-1 to 281
A predetermined scenario is preliminarily associated with -5. By selecting the shaker button 281, the scenario is selected. Therefore, when a predetermined one of the shaker buttons 281-1 to 281-5 is designated in step S3, the shaker program 54D executes a process of storing the designated one.

For example, as shown in FIG.
A scenario as shown in FIG. 8A is supported. This scenario is composed of four scenes, scene 1 to scene 4. Scenes 1 to 4 have lengths of times T1 to T4, respectively. Then, in the case of this example, an animation effect is added to scene 1 and monochrome color adjustment processing is performed for scene 2.
Then, a transition is added between scene 1 and scene 2. Further, music M1 is supported in this scenario.

Although the details will be described later, the shaker program 54D executes a process of randomly selecting predetermined ones from the image information of the material clips displayed on the material tray 201 and assigning them to scenes 1 to 4. I do. As a result, the editing process according to the prepared scenario is automatically performed by the shaker program 54D.

FIG. 28B shows a scenario corresponding to the selection button 281-2. This scenario is composed of five scenes, scene 1 to scene 5, and the length of each scene is T11 to T1.
5 is set. Scene 2 has a sepia color, scene 3 has a random effect, and transitions between scenes 4 and 5 are added. The music is set to M2.

Although illustration is omitted, such a scenario is prepared in advance corresponding to the selection buttons 281-3 to 281-5.

In step S4, the shaker program 54D executes a process of storing a specified loop. That is, the user operates the loop button 282 on the assumption that the scenario obtained by editing is continuously and repeatedly reproduced. When this operation is performed, in step S4, the shaker program 54D
Memorizes it.

For example, the scenario corresponding to the selection button 281-1 is basically configured as shown in FIG. 28A. However, when the loop button 282 is not operated (continuously). It is assumed that the scene is not repeatedly played back).
It is configured as shown in FIG. That is, a fade-in portion SC1 'is formed at the beginning of scene 1 (SC1), and a fade-out portion SC4' is formed in the last scene 4 (SC4). In addition, a silence portion M1 'is formed at the end of the music M1.

Therefore, when the information edited based on the scenario configured as shown in FIG. 29A is dared to be continuously and repeatedly reproduced, the result becomes as shown in FIG. 29B. That is, the reproduction is started by the fade-in portion SC1 ', and after the scene 1, the scene 2, the scene 3, and the scene 4 are reproduced, the first reproduction is finished by the fade-out portion SC4'. Then, subsequently, the reproduction of the image of the scene SC1 'with the fade-in is started again, the scene 1, the scene 2, the scene 3, and the scene 4 are reproduced, and the fade-out portion SC4' is displayed again. In the music, a silent portion M1 'is reproduced at a boundary portion A between the first reproduction and the second reproduction. Therefore, the viewer
At the boundary portion A, it can be easily recognized that the reproduction has been once completed.

On the other hand, if the loop button 282 is further operated after the selection button 281-1 is selected, a scenario as shown in FIG. 29C is selected.

[0108] This scenario is composed of four scenes, scene 1 to scene 4. The beginning of scene 1 and the end of scene 4 are the same as those of scene 4, even if scene 1 is reproduced. The change is, for example, similar to the timing of switching between scene 1 and scene 2, or switching between scene 2 and scene 3, and further, the timing of switching between scene 3 and scene 4. The configuration is such that it is not recognized as being completed.
That is, the configuration is such that it can be recognized that the screen is simply switched.

Similarly, even if the music M1 is reproduced continuously and continuously from the beginning to the end of the music M1, the end of the scene is not recognized in that part. .

As a result, as shown in FIG. 29 (D), even if scenes 1 to 4 are successively reproduced again after scenes 1 to 4, the viewer at the boundary A is not There is little possibility of intuitive recognition that the first reproduction has ended and the second reproduction has started.

As described above, the shaker program 54D
Corresponds to the selection buttons 281-1 to 281-5,
There are two scenarios: a scenario on the assumption that playback is not repeated continuously and a scenario on the assumption that playback is repeated continuously. When the loop button 282 is not operated, the former is selected, and when the loop button 282 is operated, the latter is selected.

Next, in step S5, the shaker program 54D determines whether or not the shake button 285 has been operated, and if not, returns to step S1 and repeats the subsequent processing. If it is determined that the shake button 285 has been operated, step S
Proceeding to 6, the shaker program 54D determines whether a loop has been designated, that is, whether the loop button 282 has been operated. If it is determined that a loop has been designated, the process proceeds to step S7, where the shaker program 54D selects a loop scenario corresponding to the operated one of the selection buttons 281-1 to 281-5. On the other hand, if it is determined in step S6 that a loop has not been designated, step S8
, The shaker program 54D includes the selection button 2
A non-loop scenario corresponding to the selected one is selected from 81-1 to 281-5.

After the processing of step S7 or step S8, the process proceeds to step S9, where the shaker program 54D
Is the material clip 2 displayed on the material tray 201
12 is assigned an ID (identification number). Then, in step S10, the shaker program 54D
Selects one of the material clips with a random number. In other words, one out of the IDs assigned in the process of step S9.
One material clip is selected by randomly selecting one ID.

In step S11, the shaker program 54D converts the material clip selected in step S10 into one scene (the first scene in this case) in the scenario selected in step S7 or step S8. To correspond to.

In step S12, it is determined whether or not the process of associating the material clips with all scenes has been completed. If the process has not been completed, the process returns to step S10, and the subsequent processes are repeatedly executed. In this way, for example, predetermined material clips are associated with scene 1, scene 2, scene 3, and scene 4 shown in FIG.

If it is determined in step S12 that the association processing has been completed for all scenes, the flow advances to step S13, where the shaker program 54D selects one scene. For example, here, the first scene is selected. In step S14, the shaker program 54D determines whether the length of the scene selected in step S13 is shorter than the length of the material clip associated with the scene. If the length of the selected scene is shorter than the length of the associated material clip,
Proceeding to step S15, the shaker program 54D
The part corresponding to the scene in the material clip is determined by a random number. For example, when the length of the material clip is 5 seconds and the length of the corresponding scene is 1 second, which one of the 5 seconds of the image corresponds to the scene is
The number from 1 to 5 is determined by generating a random number.

On the other hand, if it is determined in step S14 that the length of the selected scene is not shorter than the length of the associated material clip, the process proceeds to step S16.
The shaker program 54D executes a process of extending the length of the material clip so as to match the length of the scene. For example, if the length of the material clip is 1 second and the length of the scene is 5 seconds, the length of the material clip is increased by a factor of 5 (reproduction at 1/5 times speed). That is, by performing slow motion playback, the length of the material clip and the length of the scene correspond.

After the processing in step S15 or S16, the process proceeds to step S17, where the shaker program 54D determines whether or not an effect is specified for the scene in the scenario. For example, if the scene to be processed is scene 1 in FIG. 28A, an animation effect is specified for this scene 1. In such a case, step S18
And the shaker program 54D determines whether an effect has been determined. That is, the designation of the effect is performed in a case where the effect is already determined as an animation effect as in the case of the scene 1 in FIG. 28A, and in a case where the effect is in the scene 3 in FIG. In some cases, it is specified as a random effect. In the case of a random effect, it is decided to add an effect, but it is not yet decided which effect to apply. Therefore, in such a case, the process proceeds to step S19, where the shaker program 54D is prepared in advance, for example, 24
A random number is generated from among the effects, and one effect is determined.

When it is determined in step S18 that the effect has already been determined, or in step S19
When the effect is determined, the process proceeds to step S20, where the shaker program 54D associates the determined effect with the material clip corresponding to the scene.

If it is determined in step S17 that no effect has been specified for the scene, the process proceeds to step S17.
Steps S18 to S20 are unnecessary and are omitted.

Next, in step S21, the shaker program 54D determines whether or not a transition has been designated. If the transition has been designated, the process proceeds to step S22, where the shaker program 54D sets a transition between the next material clip. Thus, for example, when the screen of the scene currently being processed and the screen of the scene to be processed next are switched, for example, the screen is switched by applying a wipe effect as shown in FIG. become.

If it is determined in step S21 that no transition is specified, the process in step S22 is unnecessary and is skipped.

At step S23, the shaker program 54D determines whether or not text has been captured. That is, as described above, when performing text shaking, in step S2, the target text is fetched. In this case, the process proceeds to step S24, and the shaker program 54D randomly determines whether or not to shake the text in the scene currently being processed. In step S25, the shaker program 54D determines whether or not to perform text shaking. If it is determined to perform text shaking, the shaker program 54D proceeds to step S26.
To randomly select one text from the captured text. For example, as shown in FIG. 22, when three texts are captured, one of them is selected as the text corresponding to the scene to be processed.

Next, in step S27, the shaker program 54D randomly determines a text insertion position. In this example, there are five insertion positions for the text at the center, upper right, upper left, lower left, and lower right of the screen.
From these five positions, one position is determined at random.

If it is determined in step S25 that text shaking is not to be performed, steps S26 and S27 are skipped. Step S2
If it is determined in step 3 that the text has not been captured, the processing of steps S24 to S27 is skipped.

Next, in step S28, it is determined whether or not the processing has been completed for all scenes. If the processing has not been completed for all scenes, the process returns to step S13 to return to step S13. , The same processing as that described above is performed.

If it is determined in step S28 that the processing for all scenes has been completed, step S2
The program proceeds to step S9, where the shaker program 54D displays an image corresponding to the edited scenario on the image track 301 of the output tray 291. At this time, the image of the first frame of each scene is displayed on the image display section 301A of the image track 301, and if there is a transition, the image corresponding to the transition (FIG. 19) is displayed on the transition display section 301B. ) Is displayed.

The above processing is schematically described in FIG.
0.

That is, in the case of this example, the material clips CL1 to CL5 are designated as the material clips.
Further, one scenario is determined by operating the selection button 281 specified by the user. This scenario is composed of n scenes SC1 to SCn in this example. Among them, the scene SC3 is subjected to a sepia color adjustment, the scene SC _n−1 is given a random effect, and the scene SC _n is subjected to a sepia color adjustment.
Also, between scenes SC2 and SC3, between scenes SC3 and SC4,
A transition is formed between each of the scenes SC _n−1 and SC _n . Scene SC1 is 2 seconds long
SC2 is 2.2 seconds long, scene SC3 is 4.0 seconds long,
The length of scene SC _n-3 is 1 second, the length of scene SC _n-1 is 5 seconds,
The length of the scene SC _n is set to 3 seconds. The music corresponding to this scene is also determined in advance. These are already prepared in advance by the shaker program 54D.

On the other hand, the shaker program 54D
Randomly selects a predetermined one out of five material clips CL1 to CL5, assigned to each scene SC1 to SC _n. Then, for example, the material clip CL is added to the scene SC _n-3.
When 5 is assigned, the length of the scene SC _n-3 is 1 second, whereas the length of the material clip CL5 exists for 1 second or more. Therefore, in this case, a portion of 1 second between the times t2 and t3, which are randomly selected, between the times when the playback time of the material clip CL5 is t1 and t4 is assigned to the scene SC _n-3 . Can be

In this way, the user can automatically obtain predetermined edited image information only by specifying the material clip. Assignment of source clips
Since they are determined at random, even if the same material clip is selected, basically different editing results are obtained.

When the play button 231 is operated in a state where the editing result is displayed on the output tray 291, the shaker program 54D causes an image corresponding to the edited scenario (a modified scenario prepared in advance) to be displayed. It is displayed on the playback screen 221. The user can then
You can check the editing result.

When the user operates the output button 304 after confirming on the reproduction screen 221, a window 401 as shown in FIG. 23 is displayed. The user can save the information obtained as a result of editing in a predetermined format by selecting a predetermined item from the items displayed in the window 401.

When "Save as a normal movie" is selected, the shaker program 54D actually applies the editing information to the selected material clip and executes the rendering process. As a result, for example, an image to which a predetermined effect is given is actually formed, and the image is stored in the specified storage medium (for example, the hard disk 67).

However, the rendering process takes a relatively long time. On the other hand, when “simple save” is selected, the actual rendering process is not executed, and the file of the material clip selected as the editing target and the editing information (information as shown in FIG. 24) are stored. Will be saved. Therefore, the storage process can be completed in a shorter time than when the rendering process is performed.

In the processing shown in the flowcharts of FIGS. 25 to 27, the rendering processing is not actually performed, but only the editing information shown in FIG. 24 is created. As a result, for example, a scenario having a length of 30 seconds can be edited in a short time of at most about 10 seconds.

As shown in FIG. 7, a program for executing the above-described processing is provided to a user in a state where the program is previously installed in a hard disk 67 as a recording medium built in the personal computer 1 or in a ROM 70 as a semiconductor memory. Can be.

Alternatively, the program may be stored on a magnetic disk 121 such as a floppy (registered trademark) disk or a CD-R.
Optical disk 1 such as OM (Compact Disk-Read Only Disk)
22, magneto-optical disk 123 such as MD, semiconductor memory 1
24 temporarily or permanently, and can be provided as package software.

Further, the program is wirelessly transferred from the download site to the personal computer 1 via an artificial satellite for digital satellite broadcasting, or wired to the personal computer 1 via a network such as a local area network or the Internet. The data can be transferred and stored in the built-in hard disk 67 of the personal computer 1.

In the present specification, the medium means a broad concept including all these media.

In this specification, the step of describing a program provided by a medium is not limited to processing performed in chronological order in the order described, but is not necessarily performed in chronological order. It also includes processes that are executed individually or individually.

In this specification, the system is defined as:
It represents the entire device composed of a plurality of devices.

[0143]

As described above, according to the information processing apparatus, the information processing method, and the program of the present invention, a predetermined one of the image information is selected and corresponded to the scene, so that it is quick and simple. Then, the editing process can be performed.

[Brief description of the drawings]

FIG. 1 is a perspective view showing an external configuration of a personal computer to which the present invention is applied.

FIG. 2 is a plan view showing an external configuration of a personal computer to which the present invention is applied.

FIG. 3 is a left side view showing an external configuration of a personal computer to which the present invention is applied.

FIG. 4 is a right side view showing a configuration of an external appearance of a personal computer to which the present invention is applied.

FIG. 5 is a front view showing an external configuration of a personal computer to which the present invention is applied.

FIG. 6 is a bottom view showing an external configuration of a personal computer to which the present invention is applied.

FIG. 7 is a block diagram showing an example of the internal configuration of the personal computer shown in FIG. 1;

8 is a diagram showing a display example of the LCD 21 of FIG.

FIG. 9 is a diagram showing a display example of a material tray portion of FIG. 8;

FIG. 10 is a diagram illustrating a display example of an image captured from the CCD video camera in FIG. 7;

FIG. 11 is a diagram showing an example of an image file to be taken into the material tray of FIG. 8;

FIG. 12 is a diagram showing an example of trimming of the reproduction screen of FIG. 8;

FIG. 13 is a diagram illustrating rearrangement of clips on the output tray in FIG. 8;

FIG. 14 is a diagram illustrating a display example of a window when the volume button in FIG. 8 is operated.

FIG. 15 is a diagram illustrating a display example of a window when the color tone button in FIG. 8 is operated.

FIG. 16 is a diagram illustrating a display example when the reproduction speed button in FIG. 8 is operated.

FIG. 17 is a diagram illustrating a display example of a text window of the special effect tray in FIG. 8;

18 is a diagram illustrating a display example of an effect window of the special effect tray in FIG. 8;

FIG. 19 is a diagram illustrating a display example of a transition window of the special effect tray in FIG. 8;

20 is a diagram showing a display example when the transition of the output tray in FIG. 8 is applied.

FIG. 21 is a diagram illustrating a display example for explaining a wipe effect.

FIG. 22 is a diagram illustrating a display example of a shaker window of the special effect tray in FIG. 8;

FIG. 23 is a diagram showing a display example of a window displayed when the output button of FIG. 8 is operated.

FIG. 24 is a diagram illustrating an example of editing information for simple storage.

FIG. 25 is a flowchart illustrating a shaker process.

FIG. 26 is a flowchart illustrating a shaker process.

FIG. 27 is a flowchart illustrating a shaker process.

FIG. 28 is a diagram illustrating the configuration of a scene.

[Fig. 29] Fig. 29 is a diagram for describing the configuration of a scene on the premise of continuous and repeated playback.

FIG. 30 is a diagram illustrating a shaker process.

[Explanation of symbols]

1 Personal computer, 9-1 and 9-2
Hinge, 54D, 57D Shaker program, 5
4E, 67E Capture program, 201 material tray, 212 material clips, 221 playback screen, 231 playback button, 241 volume button, 242 color tone button, 243 playback speed button, 244 effect display button, 261 special effect tray, 271-1 to 271 -4 tag, 28
1-1 to 281-5 selection buttons, 282 loop buttons, 283 text shake buttons, 291
Output tray, 301 image track, 301A
Image display, 301B Transition display, 3
02 BGM truck

Continuation of the front page (72) Muneaki Osawa, 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Inside Sony Corporation (72) Inventor Kentaro Miura 6-35, Kita-Shinagawa, Shinagawa-ku, Tokyo Sony Incorporated F term (reference) 5B057 BA02 BA11 CE09 CE10 CH01 CH11 5C023 AA01 AA11 AA21 AA37 AA38 AA40 BA01 BA11 BA15 CA01 CA04 CA05 CA08 5C053 FA14 FA21 FA23 JA01 JA16 LA01

Claims (15)

[Claims] 1. An information processing apparatus comprising: scenario data composed of a plurality of scenes; and association means for arbitrarily associating a plurality of images to be edited with each of the plurality of scenes. 2. The information processing apparatus according to claim 1, wherein the plurality of scenes have different predetermined lengths. 3. The information processing apparatus according to claim 1, further comprising a correction unit that corrects the image associated by the association unit in accordance with the length of the scene. 4. The information processing apparatus according to claim 3, further comprising a reproducing unit that continuously reproduces the plurality of images associated by the association unit based on the scenario data. . 5. The apparatus according to claim 4, wherein said reproducing means reproduces the plurality of images by applying the special effect information to a plurality of images based on predetermined special effect information associated with the scene. An information processing apparatus according to claim 1. 6. The image processing apparatus according to claim 1, further comprising determining means for arbitrarily determining special effect information to be associated with the scene from among the plurality of special effect information, The information processing apparatus according to claim 4, wherein the image is reproduced by applying the special effect information to the image. 7. The method according to claim 1, wherein the associating means arbitrarily associates the plurality of images to be edited with the plurality of scenes of the scenario data selected from the plurality of scenario data. Item 2. The information processing device according to item 1. 8. A registration unit for registering an image to be edited, an image information display unit for displaying a list of information on the plurality of images to be edited, and an associating unit according to the order of the plurality of scenes. 2. The information processing apparatus according to claim 1, further comprising: output information display means for arranging and displaying information relating to the plurality of associated images. 9. The associating means associates using a scenario corresponding to a command from a user among a first scenario based on repeated continuous playback and a second scenario not based on repeated playback. The information processing apparatus according to claim 7, wherein: 10. An associating processing step of arbitrarily associating a plurality of images to be edited with each of a plurality of scenes constituting scenario data, and the associating step according to the length of each of the scenes. An information processing method, comprising: a correction processing step of correcting each image; and a reproduction processing step of continuously reproducing a plurality of the images based on the scenario data. 11. The image processing apparatus according to claim 1, further comprising a determination processing step of arbitrarily determining special effect information to be associated with the scene from a plurality of special effect information.
0. The information processing method according to 0. 12. An image information display processing step of displaying a list of information on the plurality of images to be edited, and information on the plurality of images associated in the associating processing step according to the order of the plurality of scenes. 11. The information processing method according to claim 10, further comprising: an output information display processing step of displaying the information side by side. 13. An associating processing step of arbitrarily associating a plurality of images to be edited with each of a plurality of scenes constituting scenario data, and the associating step according to the length of each of the scenes. A program storing a computer-readable program, comprising: a correction processing step of correcting each image; and a reproduction processing step of continuously reproducing a plurality of the images based on the scenario data. Storage medium. 14. The method according to claim 1, further comprising a determining step of arbitrarily determining special effect information to be associated with the scene from a plurality of special effect information.
A program storage medium storing the computer-readable program according to claim 3. 15. An image information display processing step of displaying a list of information on the plurality of images to be edited, and information on the plurality of images associated in the associating processing step according to the order of the plurality of scenes. 14. A program storage medium storing a computer-readable program according to claim 13, further comprising: an output information display processing step of displaying the information side by side.