JPH11168692A - Image processor and control method therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reproduce audio data added to image data and BGM, while appropriately switching them. SOLUTION: Image data and audio data outputted from a digital still camera 10 are stored via a data interface part 5 into a data storage memory 2. The image data stored in the data storage memory 2 are converted into video signals by an image display interface part 7 and outputted, to a monitor 9. When outputting the image data, the BGM and the audio data added to the image data are switched by a CPU 1. Then, digital signals are converted into analog signals and outputted to the monitor 9 by a sound output interface part 8.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and a control method thereof, for example, an image processing apparatus for reproducing image data and sound data attached thereto, and a control method thereof.

[0002]

2. Description of the Related Art In recent years, digital still cameras have appeared and become widely used, and still images and the like taken by the digital still cameras are converted into digital data by a PC.
It is frequently done with processing. Video,
Voices and the like are increasingly used as digital data by PCs. However, in order to handle such digital data on a PC, it is necessary to use a high-performance PC, and further, dedicated software is required.

Therefore, an image processing apparatus which can easily handle such digital data has been proposed. This image processing apparatus stores a still image or the like photographed by a digital still camera, performs a search process as necessary, and displays it on a monitor. Some digital still cameras have a function of recording sounds such as a surrounding sound at the time of photographing and a human voice in addition to a still image. Sounds such as human voices can also be reproduced. In addition, some have a function called a slide show display for displaying a plurality of still images at a certain interval on a monitor or the like. Further, while displaying the photographed still image on the monitor, the BGM
Some image processing apparatuses have a function of reproducing (background music).

[0004]

However, the above technique has the following problems.

When image data with sound data such as sound is displayed on a monitor or the like while reproducing BGM, sound such as sound and BGM are reproduced almost simultaneously, so that there is a problem that it is difficult to hear the sound.

An object of the present invention is to solve the above-mentioned problem, and when reproducing sound data attached to image data, an image processing apparatus capable of controlling a reproduction level of other sound data and a control method therefor. The purpose is to provide.

[0007]

The present invention has the following configuration as one means for achieving the above object.

[0008] An image processing apparatus according to the present invention comprises a storage means for storing input image data with first sound data and input second sound data; Reproduction means for reproducing a sound based on the sound data, and display means for displaying an image represented by the image data, wherein the reproduction means reproduces a sound based on the first sound data. And controlling a sound reproduction level based on the second sound data.

A control method for an image processing apparatus according to the present invention comprises: means for storing inputted image data with first sound data and inputted second sound data; A method of controlling an image processing apparatus, comprising: means for reproducing a sound based on the sound data of claim 1; and means for displaying an image represented by the image data, wherein the sound based on the first sound data is reproduced. And controlling a sound reproduction level based on the second sound data.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an image processing apparatus and an image processing method according to an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing a configuration example of an image processing apparatus according to an embodiment of the present invention.

1 is control of the entire image processing apparatus, interface with each device, image processing of input / output image data,
CP for performing audio processing of input / output sound data
U1. Reference numeral 2 denotes a data storage memory 2 for storing sound data such as still images, moving images, and sounds. As the data storage memory 2, for example, a magneto-optical disk device, a CD-R, or the like can be used. Reference numeral 3 denotes an operation input interface unit for receiving an infrared signal or the like generated when the user operates the remote controller 4 and transmitting it to the CPU 1.

Reference numeral 4 denotes a remote controller 4 for transferring image data and sound data from the digital still camera 10 to the data storage memory 2. Reference numeral 5 denotes a data interface unit 5 for inputting image data and the like from the digital still camera to the image processing device, and outputting image data and the like from the image processing device to the digital still camera. The data interface unit 5 can also be connected to a PC (not shown), and stores still image data, sound data such as sound, moving image data, various multimedia data, and the like stored in the hard disk of the PC. The data can be recorded in the data storage memory 2 of the image processing apparatus from the PC.

Reference numeral 6 denotes a voice input interface unit 6 for digitizing analog sound data input from the microphone 12 or the like. Reference numeral 7 denotes an image display interface unit 7 for converting image data into a video signal and outputting the video signal to a monitor 9. The image display interface unit 7 also displays a GUI (graphical user interface) on the monitor 9 for the user to perform various operations.

Reference numeral 8 denotes an audio output interface unit 8 for converting digital sound data into analog and outputting audio to a monitor 9 or an audio reproducing device such as an audio device (not shown). Reference numeral 9 denotes a monitor 9 for displaying image data and sound data output from the image processing apparatus according to the present embodiment. Reference numeral 10 denotes a digital still camera for recording a person, a landscape, and the like. 11
Is a buffer for storing image data, sound data, and the like to be output to the monitor 9, or a RAM 11 used as a buffer area of the CPU 1.

Reference numeral 12 denotes a microphone 12 for inputting sound data. In the present embodiment, sound data can be input by connecting the microphone 12 to the voice input interface unit 6. However, the present invention is not limited to this, and an external device such as a CD-ROM player may be used. By connecting the device to the audio input interface unit 6, sound data can be input to the image processing apparatus.

Images taken by the digital still camera 10 are stored in the data storage memory 2 via the data interface unit 5 of the image processing device. The connection between the data interface unit 5 and the digital still camera 10 may be performed by a cable, or may be performed by infrared communication or by removing a memory card attached to the digital still camera 10 and attaching it to a memory card slot of the image processing apparatus. You may do so.

The digital still camera 10 also has a function of recording, in addition to a still image, a surrounding sound at the time of shooting, a human voice, and the like (hereinafter, referred to as "voice"). When the recording mode of the digital still camera 10 is set to the image and sound mode, a still image and a sound can be recorded. Further, the digital still camera 10 can capture a moving image similarly to a video camera, and can also record surrounding sounds, human voices, and the like during shooting. When the recording mode of the digital still camera 10 is set to the audio mode, only the audio can be recorded.

As described above, the digital still camera 10
According to the recording mode, for example, a still image data (for example, JPEG) file, a file in which still image data + sound data (for example, WAV) is set, and a moving image data (for example, MPEG) + sound data are set. Files having a file structure such as files and sound data files can be stored.

The sound input from the microphone 12 can be attached to the still image data stored in the data storage memory 2 as sound data. Similarly, sound data such as music can be input from an external device or the like connected to the voice input interface unit 6,
It can be used as BGM when viewing images. Sound data such as BGM input from an external device is stored in the data storage memory 2.

FIG. 2 is a diagram showing a display example of a still image displayed on the monitor 9.

In FIG. 2, it is assumed that a still image of "mountain" is displayed first. The user presses “B”
The reproduction of BGM is started by the "GM" button. When the user presses the “next image” button on the remote controller 4, the still image displayed on the monitor 9 switches from the “mountain” still image to the “flower” still image. At this time, instead of switching the still image instantaneously, using a special effect such as fade-in or fade-out can enhance entertainment. When the “next image” button on the remote controller 4 is further pressed, the still image displayed on the monitor 9 is switched from the still image of “flower” to the still image of “ship”. Here, BGM is "mountain"
The still image of "Ship" is displayed even before the still image of "Ship" is displayed.

Next, when the user presses the "next image" button on the remote controller 4, the still image displayed on the monitor 9 switches from the still image of "ship" to the still image of "person". At this time, if the still image of "Person" is accompanied by sound data that reads "Happy New Year, thank you again this year." Sound data attached to images cannot be played.

In the present invention, in order to solve the above-mentioned problem, the user presses the "next image" button on the remote controller 4, and the still image displayed on the monitor 9 is changed from the still image of "ship" to the "person". When switching to a still image, CPU 1
The volume of the GM is controlled, and the volume of the BGM is gradually lowered. Then, after the BGM volume is lowered, the sound data attached to the still image of "Person" is reproduced, "Happy New Year. Thank you again this year." Further, after the reproduction of the sound data is completed, the CPU 1 controls the volume of the BGM, and gradually increases the volume of the BGM again. Here, while the sound data is being reproduced, the reproduction of the BGM can be paused. Also, while the sound data is being reproduced, the BGM volume can be played at a small volume without being fully reduced.

As described above, the CPU 1 controls the volume of the sound data attached to the BGM and the still image, so that the sound data attached to the image data and the BG are controlled.
The reproduction can be performed by appropriately switching M and M.

FIG. 3 is a diagram for explaining the relationship between the timing of reproducing BGM and sound data and the timing of reproducing a still image.

Arrows 21, 22, and 23 indicate the timing at which the "next image" button on the remote controller 4 is pressed by the user. As shown in FIG. 3, while the still image of “mountain” is displayed on the monitor 9, the BGM is reproduced at a predetermined volume. Next, when the user presses the “next image” button on the remote controller 4 at the timing of the arrow 21, the still image displayed on the monitor 9 switches from the still image of “mountain” to the still image of “flower”. At this time, the BGM is reproduced. Next, the user operates the remote controller 4 at the timing indicated by the arrow 22.
Is pressed, the still image displayed on the monitor 9 is switched from the still image of "flower" to the still image of "ship". At this time, the BGM is reproduced.

Next, when the user presses the "next image" button of the remote controller 4 at the timing of the arrow 23, the still image displayed on the monitor 9 is changed from the still image of "ship" to "person".
Is switched to the still image. At this time, the volume of the BGM starts to gradually decrease, and when the volume of the BGM has finished decreasing, the "person"
The sound data attached to the still image is reproduced. Then, when the reproduction of the sound data attached to the still image of “person” ends, the volume of the BGM gradually starts to rise. The BGM volume can be set to any volume by a user operation using the remote controller 4. Alternatively, the volume of BGM may be set from a PC or the like as an external device.

In FIG. 3, the solid line shows a state in which the volume of the BGM is completely reduced during the reproduction of sound data, and the dotted line does not completely reduce the volume of the BGM during the reproduction of the sound data, and the BGM is reproduced at a small volume. Shows the status of

This sound data can be recorded when a person or the like is photographed by the digital still camera 10, and can also be attached as sound data to a still image photographed by a device such as the microphone 12 later. is there.

FIG. 4 is a diagram for explaining the flow of each sound signal of BGM and sound data.

Reference numeral 31 denotes a memory 31 for temporarily storing BGM audio signals. Reference numeral 32 denotes a memory 32 in which an audio signal of sound data is temporarily stored. 33
Is a memory 33 for setting a BGM reproduction level. Reference numeral 34 denotes a memory 34 for setting a reproduction level of sound data. The RAM 11 is used as the memories 31, 32, 33, and 34. Reference numeral 35 denotes a multiplication unit 35 for multiplying the BGM audio signal stored in the memory 31 by the reproduction level stored in the memory 33. A multiplication unit 36 multiplies the audio signal of the sound data stored in the memory 32 by the reproduction level stored in the memory 34. 37
Is an adder 37 for adding the audio signals output from the multipliers 35 and 36. Reference numeral 38 denotes a D / A converter 38 for converting the audio signal output from the adder 37 into an analog signal.

The CPU 1 loads the BGM from the data storage memory 2 to the memory 31 as required, and the multiplication unit 35 multiplies the BGM audio signal by the reproduction level of the memory 33. The CPU 1 loads sound data from the data storage memory 2 to the memory 32 as necessary,
The multiplication unit 36 multiplies the sound signal of the sound data by the reproduction level of the memory 34. The adder 37 adds the audio signals output from the multipliers 35 and 36 and outputs the result to the D / A converter 38. And D / A
The converter 38 converts the audio signal output from the adder 37 into an analog signal and outputs audio from a speaker or the like attached to the monitor 9.

The reproduction level of the BGM and the sound data can be set in advance by the user using the remote controller 4. In addition, BGM is transmitted from an external device such as a PC.
Also, the reproduction level of the sound data can be arbitrarily changed. Further, the CPU 1 can change the reproduction level of BGM and sound data. The playback level set in this way is stored in the memory 33 or the memory 34, and the volume output from the speaker or the like of the monitor 9 is set by the CPU 1 based on the playback level. In the present embodiment, the process of setting the volume output from the speaker or the like of the monitor 9 is performed by the audio output interface unit 8.

FIG. 5 is a diagram for explaining the temporal transition of the reproduction level of BGM and sound data.

In FIG. 5, there is a part where the line indicating the BGM reproduction level and the line indicating the sound data reproduction level overlap, and this part means that the BGM and the sound data sound are reproduced simultaneously.

As described above, the CPU 1 controls the reproduction levels of the BGM and the sound data, so that the sound data attached to the still image and the BGM can be appropriately switched and reproduced.

The processing for controlling the sound output of the BGM and the sound data can be performed by software by the CPU 1 or by hardware as shown in FIG. is there.

The circuit configuration example shown in FIG. 4 can be a configuration example shown in FIG.

In FIG. 6, the BGM audio signal is D /
The signal is converted into an analog signal by the A converter 38. Also,
The audio signal of the sound data is converted by a D / A converter 39 into an analog signal. Reference numeral 40 denotes an analog switch 40 that is switched according to the BGM reproduction level stored in the memory 42. Reference numeral 41 denotes an analog switch 41 that is switched according to the reproduction level of the sound data stored in the memory 43. For example, the analog switch 40 and the analog switch 41 are set to 10
The switch is operated at a switching frequency of 0 KHz, and the time during which the switch is turned on is changed according to the respective reproduction levels of BGM and sound data. That is, the volume ratio of BGM or sound data is adjusted by changing the on / off duty ratio of the switch.

FIG. 7 is a diagram for explaining a slide show display for automatically switching images.

For example, when the user sets a slide show using the remote controller 4 so that the image displayed on the monitor 9 is switched every 10 seconds, and presses a "start slide show" button, the slide show is started. Then, a still image of “mountain”, which is the first image, is displayed on the monitor 9 and BGM is displayed.
Is also played. Next, after 10 seconds have elapsed, the image is switched to the still image of “flower”. Further, after 10 seconds, the image is switched to the still image of "ship". Here, the CPU 1 constantly checks whether or not sound data is attached to a still image to be displayed next, and controls the BGM volume based on the check result. That is, when sound data is attached to the next still image to be displayed, the BGM starts two seconds before the display end time of the still image currently displayed on the monitor 9 at that time.
Is gradually lowered, and this 2 seconds is defined as a fade-out time of BGM.

Therefore, when a still image with sound data is displayed on the monitor 9, the BGM has disappeared and only the sound data is reproduced. When the reproduction of the sound data ends, the volume of the BGM is gradually increased.

In some cases, sound data before and after photographing an image is recorded in the sound data. In such a case, the start time of the fade-out is further advanced and the still image is displayed before the still image is displayed. The reproduction of the sound data attached to the file may be started.

As described above, in the present embodiment, the CPU 1 always checks whether or not sound data is attached to the next still image to be displayed, so that the sound data attached to the still image and the BGM are appropriately switched. Audio can be played. As a method for the CPU 1 to check whether sound data is attached to a still image to be displayed next, for example, a header portion is provided for input data input from an external device, and the header portion is included in the input data. By storing the type of data (still image only or still image + sound data, etc.) in advance, C
The PU 1 can check whether the sound data is attached to the still image to be displayed next by reading the header part in advance. Further, a management file or the like for managing the type of data included in the input data may be provided.

Next, the case of reproducing moving image data will be described.

In FIG. 7, it is assumed that the image representing "person" is a moving image. This moving image is accompanied by sound data equal to the shooting time. In the case of such a moving image, the BGM is faded out before the moving image is reproduced as described above, and the BGM is started when the moving image is reproduced.
To make it disappear. Then, the moving image and the sound data attached thereto are reproduced, and when the reproduction ends, the BGM fades in.

As described above, the image processing apparatus according to the present invention uses the sound data attached to the image data and the BG
Since the volume of each of the M is automatically controlled, it is possible to switch between BGM and sound such as sound attached to the image data and reproduce the BGM.

Therefore, unlike the prior art, since the sound such as the sound attached to the image data and the BGM are reproduced almost simultaneously, the problem that the sound is difficult to hear is solved by the present invention.

[0050]

[Other Embodiments] Even if the present invention is applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), an apparatus (for example, a copying machine) Machine, facsimile machine, etc.).

Further, an object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or CPU) of the system or apparatus.
And MPU) read and execute the program code stored in the storage medium.

In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0056]

As described above, according to the present invention, when reproducing sound data attached to image data, an image processing apparatus capable of controlling the reproduction level of other sound data and a control method therefor are provided. Can be provided.

[0057]

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of an image processing apparatus according to an embodiment;

FIG. 2 is a view showing a display example of a still image displayed on a monitor 9;

FIG. 3 is a diagram for explaining the relationship between the timing of BGM and sound data reproduction and the timing of still image reproduction;

FIG. 4 is a diagram for explaining the flow of each sound signal of BGM and sound data.

FIG. 5 is a diagram for explaining a temporal transition of a reproduction level of BGM and sound data;

FIG. 6 is a diagram for explaining the flow of each sound signal of BGM and sound data;

FIG. 7 is a diagram for explaining the relationship between the timing of reproducing BGM and sound data and the timing of reproducing a moving image.

Claims (6)

[Claims] 1. A storage means for storing input image data with first sound data and input second sound data; and storing sound based on the first and second sound data. Reproducing means for reproducing, and display means for displaying an image represented by the image data, wherein the reproducing means reproduces a sound based on the first sound data, the second sound data An image processing apparatus for controlling a reproduction level of a sound based on a sound. 2. When reproducing a sound based on the first sound data and a sound based on the second sound data, the respective reproduction levels are:
2. The image processing apparatus according to claim 1, further comprising a setting unit for setting in advance. 3. The control of the reproduction level includes, when reproducing a sound based on the first sound data and a sound based on the second sound data, respectively controlling each of the first and second sound data. The image processing apparatus according to claim 1, wherein a reproduction level is controlled to a set value of each reproduction level set by the setting unit. 4. The image processing apparatus according to claim 1, wherein the image data is still image data or moving image data. 5. A means for storing inputted image data with first sound data and inputted second sound data, and means for reproducing a sound based on the first and second sound data. A method for controlling an image processing apparatus, comprising: means for displaying an image represented by the image data, wherein when reproducing a sound based on the first sound data, a sound based on the second sound data A control method characterized by controlling a reproduction level of a program. 6. A storage medium storing a program code for image processing, wherein the program code is for storing image data with input first sound data and input second sound data. A program code for reproducing a sound based on the first and second sound data; a program code for displaying an image represented by the image data; and a sound based on the first sound data. A program code for controlling a reproduction level of a sound based on the second sound data when reproducing.