JP3584265B2 - Information input device - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an information input device, for example, an information input device suitable for use in an electronic camera or the like that converts an image of a subject into digital data and records the digital data.
[0002]
[Prior art]
In recent years, instead of a camera using a film, an image of a subject is photographed using a CCD or the like, and the photographed image is converted into digital data and stored in a built-in memory such as an IC or a removable memory card. Cameras are being used. An image captured using this electronic camera can be immediately reproduced and displayed on a screen such as an LCD without undergoing development and printing as in a conventional camera.
[0003]
In addition, since a captured image is recorded as digital data and recorded, it is compatible with a personal computer and has been used as an input device thereof. For example, when creating an Internet homepage, it may be used as a tool for inputting image data.
[0004]
[Problems to be solved by the invention]
It is conceivable to add a function to such an electronic camera that can record a sound related to the captured image together with an image of the subject so that when the image is reproduced, the sound related thereto is output. Can be
[0005]
However, the image can be displayed immediately, but the sound must be continuously output for a predetermined time. Therefore, when the sound corresponding to the predetermined image is output, the display is displayed on another image. There has been a problem that it is necessary to determine in advance the processing method of audio when switching is performed.
[0006]
The present invention has been made in view of such a situation, and provides a number of audio output methods when a display image is switched so that a user can select the output method.
[0007]
[Means for Solving the Problems]
The information input device according to claim 1, image Imaging means (for example, the photographing lens 3 in FIG. 1 and the CCD 20 in FIG. 3) voice (For example, the microphone 8 in FIG. 1), an image captured by the imaging unit, and a storage unit (for example, FIG. 1) that stores the image corresponding to the image input by the audio input unit in association with the image. 3 memory card 24), an image reproducing means (for example, a compression / expansion memory control circuit (comp / dcomp / MC) 38 in FIG. 4) for reproducing an image stored in the storage means, and a voice stored in the storage means. (For example, the audio IC 36 in FIG. 4) for selecting the image to be reproduced, and selecting means (for example, the touch tablet 6A in FIG. 1 and the pen 6B in FIG. 4) for selecting an image to be reproduced by the image reproducing means. When the predetermined image is selected by the means, the sound reproducing means reproduces the predetermined sound associated with the predetermined image, and while the sound reproducing means reproduces the predetermined sound, Control means (for example, CPU in FIG. 4) for controlling the sound reproducing means to continue reproducing the predetermined sound even when another image different from the predetermined image is selected by the selecting means. It is characterized.
[0008]
Further, the control means controls the sound reproducing means to start reproduction of another sound associated with another image after ending reproduction of the predetermined sound associated with the predetermined image. be able to.
[0009]
Further, the control means may control the image reproducing means to switch from the predetermined image to another image and display it when another image different from the predetermined image is selected by the selection means. it can.
[0010]
The information input device according to claim 4, image Imaging means (for example, the photographing lens 3 in FIG. 1 and the CCD 20 in FIG. 3) voice (For example, the microphone 8 in FIG. 1), an image captured by the imaging unit, and a storage unit (for example, FIG. 1) that stores the image corresponding to the image input by the audio input unit in association with the image. 3 memory card 24), an image reproducing means (for example, a compression / expansion memory control circuit (comp / dcomp / MC) 38 in FIG. 4) for reproducing an image stored in the storage means, and a voice stored in the storage means. Sound reproducing means (for example, sound IC 36 in FIG. 4) for reproducing the image, selecting means (for example, touch tablet 6A in FIG. 1 and pen 6B in FIG. 4) for selecting an image reproduced by the image reproducing means, and sound. Mode selection means (for example, a mode selection means for selecting one of a first mode and a second mode for defining a method for the reproduction means to reproduce the sound stored in the storage means) When the first mode is selected by the touch tablet 6A in FIG. 1 and the pen 6B in FIG. 4) and the first mode is selected by the mode selection unit, when the predetermined image is selected by the selection unit, the sound reproduction unit changes to the predetermined image. The associated predetermined sound is reproduced, and even when another image different from the predetermined image is selected by the selecting means while the sound reproducing means is reproducing the predetermined sound, the sound reproducing means When the reproduction is continued and the second mode is selected by the mode selection means, when a predetermined image is selected by the selection means, the audio reproduction means reproduces a predetermined sound associated with the predetermined image, and Control means for controlling the sound reproducing means to interrupt reproduction of the predetermined sound when another image different from the predetermined image is selected by the selecting means while the reproducing means is reproducing the predetermined sound (e.g., , Characterized in that it comprises a CPU 34) and in FIG.
[0011]
Further, when the first mode is selected by the mode selection unit, the control unit determines that the sound reproduction unit is associated with the predetermined image when another image different from the predetermined image is selected by the selection unit. It is possible to control so that after the reproduction of the predetermined sound is finished, the reproduction of another sound associated with another image is started.
[0012]
Further, when the second mode is selected by the mode selecting means, and when another image different from the predetermined image is selected by the selecting means, the sound reproducing means is associated with the predetermined image. The reproduction of the predetermined sound may be interrupted, and the control may be performed to start the reproduction of another sound associated with another image.
[0013]
Further, the control means may control the image reproducing means to switch from the predetermined image to another image and display it when another image different from the predetermined image is selected by the selection means. it can.
[0014]
Also, a display means (for example, LCD 6 in FIG. 2) for displaying an image captured by the image capturing means and an image reproduced by the image reproducing means, a sound input by the sound input means, and a sound reproduced by the sound reproducing means. Audio output means (for example, the speaker 5 and the earphone jack 9 in FIG. 2) for outputting the generated audio can be further provided.
[0015]
Further, an illuminating unit (for example, a light emitting unit (strobe) 4 in FIG. 1) for irradiating the subject with illumination light may be further provided.
[0016]
In the information input device according to the first aspect, when a predetermined image is selected by the selection unit under the control of the control unit, the audio reproduction unit reproduces a predetermined audio associated with the predetermined image, and reproduces the audio. Even when the selecting means selects another image different from the predetermined image while the means reproduces the predetermined sound, the sound reproducing means continues to reproduce the predetermined sound. Therefore, the sound related to the predetermined image can be reproduced without interruption.
[0017]
In the information input device according to the fourth aspect, when the first mode is selected by the mode selection unit under the control of the control unit, when the predetermined image is selected by the selection unit, the audio reproduction unit is switched to the predetermined mode. A predetermined sound associated with the image is reproduced, and even when another image different from the predetermined image is selected by the selection means while the sound reproduction means is reproducing the predetermined sound, the sound reproduction means When the reproduction of the sound is continued and the second mode is selected by the mode selecting means, when the predetermined image is selected by the selecting means, the sound reproducing means reproduces the predetermined sound associated with the predetermined image. When another image different from the predetermined image is selected by the selection unit while the audio reproduction unit is reproducing the predetermined audio, the audio reproduction unit interrupts the reproduction of the predetermined audio. Therefore, it is possible to select an audio reproduction method.
[0018]
BEST MODE FOR CARRYING OUT THE INVENTION
FIGS. 1 and 2 are perspective views showing the configuration of an embodiment of an electronic camera to which the present invention is applied. For convenience of description, when photographing a subject, out of the six surfaces constituting the electronic camera 1, a surface facing the subject is defined as a surface X1, and a surface facing the user is defined as a surface X2. At the upper end of the plane X1, a finder 2 used for confirming a photographing range of the subject, a photographing lens 3 for capturing a light image of the subject, and a light emitting unit (strobe) 4 for emitting light for illuminating the subject are provided. .
[0019]
On the other hand, the finder 2 and the speaker 5 are provided at the upper end of the surface X2 facing the surface X1 (at a position corresponding to the upper end of the surface X1 where the finder 2, the photographing lens 3, and the light emitting unit 4 are formed). The speaker 5 is provided so as to output a sound corresponding to sound data recorded on a memory card or the like built in the electronic camera 1. The LCD 6 and the operation keys 7 formed on the surface X2 are formed vertically below the finder 2, the photographing lens 3, the light emitting unit 4, and the speaker 5. On the surface of the LCD 6, a so-called touch tablet 6A that outputs position data corresponding to a position specified by a contact operation of a predetermined pen-type pointing device (hereinafter abbreviated as a pen) 6B is formed. I have.
[0020]
The touch tablet 6A is made of a transparent material such as glass, resin, or the like, and the user can observe an image displayed on the LCD 6 formed inside the touch tablet 6A via the touch tablet 6A. Can be done.
[0021]
The operation keys 7 are composed of a plurality of keys corresponding to various functions as described later. The operation keys 7 are operated by the pen-type pointing device 6B, and image data, audio data, or text data recorded on a memory card or the like described later. This is used when reproducing recorded data such as data and displaying the data on the LCD 6. For example, the menu key 7A is operated when a menu screen is displayed on the LCD 6. The execute key 7B is operated when reproducing the recording data selected by the user.
[0022]
The clear key 7C is operated when deleting recorded data. The cancel key 7D is operated when the reproduction process of the recorded data is interrupted. The scroll key 7E is operated to scroll the screen up and down when a list of recording data is displayed on the LCD 6.
[0023]
On a surface Z, which is the upper surface of the electronic camera 1, a microphone (microphone) 8 for collecting sound and an earphone jack 9 for connecting an earphone (not shown) are provided.
[0024]
On the left side surface (surface Y1), there are provided a release switch 10 that is operated when shooting an object, and a power switch 11 that switches power on / off. The release switch 10 and the power switch 11 are arranged vertically below the finder 2, the photographing lens 3, and the light emitting unit 4 provided at the upper end of the surface X1.
[0025]
On the other hand, on a surface Y2 (right side) opposed to the surface Y1, a recording switch 12 operated when recording a voice and a continuous shooting mode changeover switch 13 operated when switching the continuous shooting mode during shooting. Is provided. The recording switch 12 and the continuous shooting mode changeover switch 13 are, like the release switch 10 and the power switch 11, more than the viewfinder 2, the photographing lens 3, and the light emitting unit 4 provided at the upper end of the surface X <b> 1. It is arranged vertically below. The recording switch 12 is arranged at substantially the same height as the release switch 10 on the surface Y1, so that it does not feel uncomfortable when holding it with either left or right hand.
[0026]
In addition, the height of the release switch 10 and the height of the recording switch 12 are intentionally made different from each other. For example, when only one of the switches is pressed with a finger, the moment generated by this pressing force is simultaneously canceled. When the opposite side surface is held by a finger, it is possible to prevent a switch provided on the opposite side surface from being accidentally pressed.
[0027]
The continuous shooting mode changeover switch 13 is used when the user presses the release switch 10 and shoots a subject, and sets whether to shoot a single subject or a predetermined plurality of successive frames. Can be For example, when the release switch 10 is pressed when the pointer of the continuous shooting mode changeover switch 13 is switched to the position where “S” is printed (ie, the mode is switched to S mode), only one frame is shot. Is performed.
[0028]
When the release switch 10 is pressed when the pointer of the continuous shooting mode switch 13 is switched to the position where “L” is printed (that is, the mode is switched to the L mode), the release switch 10 is turned on. While the button is pressed, shooting is performed at a rate of 8 frames per second. That is, shooting in the low-speed continuous shooting mode is performed.
[0029]
When the release switch 10 is pressed when the pointer of the continuous shooting mode switch 13 is switched to the position where "H" is printed (that is, the mode is switched to the H mode), the release switch 10 is turned on. While the button is pressed, shooting is performed at a rate of 30 frames per second. That is, shooting in the high-speed continuous shooting mode is performed.
[0030]
Next, the internal configuration of the electronic camera 1 will be described. FIG. 3 is a perspective view showing an example of the internal configuration of the electronic camera shown in FIGS. The CCD 20 is provided at a subsequent stage (on the surface X2 side) of the photographing lens 3 so as to photoelectrically convert an optical image of a subject formed through the photographing lens 3 into a corresponding electric signal (image signal) and output the electric signal. Has been done.
[0031]
Below the LCD 6, for example, four cylindrical batteries (for example, AA batteries) 21 are arranged side by side, and the power stored in the battery 21 is supplied to each unit. In addition, a capacitor 22 that stores electric charges required when the light emitting unit 4 emits light is arranged alongside the battery 21.
[0032]
Various control circuits for controlling each part of the electronic camera 1 are formed on the circuit board 23. A removable memory card (recording medium) 24 is provided between the circuit board 23, the LCD 6, and the battery 21, and various types of information input to the electronic camera 1 are preset in the memory card 24. Recorded in each area.
[0033]
In this embodiment, the memory card 24 can be inserted and removed. However, a memory may be provided on the circuit board 23 so that various information can be recorded in the memory. Further, various information recorded in the memory card (or memory) 24 can be output to an external personal computer or the like via an interface (not shown).
[0034]
Next, an example of an electrical configuration inside the electronic camera 1 of the present embodiment will be described with reference to the block diagram shown in FIG. The CCD 20 having a plurality of pixels photoelectrically converts an optical image formed on each pixel into an image signal (electric signal). The CCD drive circuit (VDRV) 39 is controlled by a digital signal processor (hereinafter, referred to as DSP) 33 described later to drive the CCD 20.
[0035]
A correlated double sampling circuit (hereinafter, referred to as CDS) 31 samples the image signal photoelectrically converted by the CCD 20 at a predetermined timing. An AGC (automatic gain control circuit) 40 controls the gain of the signal sampled by the CDS 31. An analog / digital conversion circuit (hereinafter, referred to as an A / D conversion circuit) 32 digitizes the image signal sampled by the CDS 31 and supplies it to the DSP 33.
[0036]
The DSP 33 once supplies the digitized image data to the buffer memory 37 and stores it therein. A compression / decompression memory control circuit (comp / dcomp / MC) 38 reads out the image data stored in the buffer memory 37, and compresses the image data by, for example, a JPEG (Joint Photographic Experts Group) method described later, and then via a data bus 42. The data is supplied to the memory card 24 and recorded in a predetermined area (image recording area).
[0037]
Further, the CPU 34 has a built-in clock circuit (not shown), and records information on the date and time of photographing as header information of image data in the image recording area of the memory card 24. That is, the image date and time data is added to the image data recorded in the image recording area of the memory card 24.
[0038]
The microphone (microphone) 8 inputs a voice and supplies a voice signal corresponding to the voice to the voice IC 36. The audio IC 36 converts the supplied audio signal into digital audio data, compresses it, supplies it to the memory card 24, and records it in a predetermined area (audio recording area). At this time, the data of the recording date and time is recorded in the audio recording area of the memory card 24 as header information of the audio data.
[0039]
The strobe (light emitting unit) 4 is controlled by the CPU 34, emits light at a predetermined timing, and irradiates the subject with light.
[0040]
When a predetermined position of the touch tablet 6A is pressed by the pen-type pointing device 6B operated by the user, the CPU 34 reads XY coordinates corresponding to the pressed position of the touch tablet 6A, and stores the coordinate data (line image data to be described later). (Comprising information) is stored in a predetermined memory (not shown). Further, the CPU 34 supplies the line drawing information stored in the memory to the memory card 24 together with header information such as the date and time of inputting the line drawing information, and records the line drawing information in the line drawing information recording area.
[0041]
The buffer memory 37 and the LCD 6 are connected to the CPU 34 via the CPU control bus 41 so that an image corresponding to the image data stored in the buffer memory 37 can be displayed on the LCD 6. However, the image data that has been subjected to the compression processing is once input to the compression / decompression memory control circuit 38, decompressed there, and then supplied to the buffer memory 37 via the data bus 42.
[0042]
The speaker 5 is connected to the audio IC 36, and the audio data read from the memory card 24 is expanded by the audio IC 36, converted into an analog audio signal, and then output from the speaker 5. It has been made.
[0043]
The operation switch (SW) 35 corresponds to the release switch 10, the power switch 11, the recording switch 12, and the continuous shooting mode changeover switch 13 in FIGS. 1 to 3. Is supplied to the CPU 34. Then, when each switch is operated, the CPU 34 executes a corresponding predetermined process.
[0044]
Next, the operation will be described. First, audio input / output processing in the above embodiment will be described. When the power switch 11 shown in FIG. 1 is switched to the side where “ON” is printed, the power of the electronic camera 1 is turned on, and the recording switch 12 provided on the surface Y2 is pressed, a recording process (for audio) is performed. Input and recording thereof) are started. That is, the voice input via the microphone 8 is converted into digital voice data by the voice IC 36, subjected to compression processing, supplied to the memory card 24, and recorded in the voice recording area of the memory card 24. You. At this time, data such as the recording date and time is recorded in the audio recording area of the memory card 24 as header information of the compressed audio data. Such an operation is repeatedly executed while the recording switch 12 is pressed.
[0045]
In addition, as a sound compression method, a PCM (Pulse Code Modulation) method or another method can be used.
[0046]
Next, the operation when shooting a subject will be described. First, a case where the continuous shooting mode changeover switch 13 provided on the surface Y2 is switched to the S mode (a mode in which only one frame is shot) will be described. First, as shown in FIG. 1, the power switch 11 provided on the surface Y1 side is switched to the side where "ON" is printed, and the power is turned on to the electronic camera 1. When the subject is confirmed in the viewfinder 2 and the release switch 10 provided on the surface Y1 is pressed, the subject photographing process is started.
[0047]
An optical image of the subject observed by the finder 2 is condensed by the photographing lens 3 and forms an image on the CCD 20 having a plurality of pixels. The optical image of the subject formed on the CCD 20 is photoelectrically converted into an image signal at each pixel, and is sampled by the CDS 31. The image signal sampled by the CDS 31 is supplied to an A / D conversion circuit 32 after gain is controlled via an AGC 40, where it is digitized and supplied to a DSP 33.
[0048]
The DSP 33 once supplies the digitized image data to the buffer memory 37 and stores it therein. The compression / decompression memory control circuit 38 compresses the image data read from the buffer memory 37 in accordance with the JPEG method combining discrete cosine transform, quantization, and Huffman coding. The compression / decompression memory control circuit 38 supplies the compressed image data to the memory card 24 via the data bus 42. The memory card 24 records the image data supplied from the compression / decompression memory control circuit 38 in the image recording area. At this time, in the image recording area of the memory card 24, data of the shooting date and time is recorded as header information of the image data.
[0049]
When the continuous shooting mode switch 13 is switched to the S mode, each time the release switch 10 is pressed, only one frame is shot. Therefore, even if the release switch 10 is pressed and kept pressed, only one frame is photographed. Further, when the release switch 10 is continuously pressed for a predetermined time, the image just taken is displayed on the LCD 6.
[0050]
Next, a case where the continuous shooting mode changeover switch 13 is switched to the L mode (a mode in which continuous shooting of eight frames per second is performed) will be described. When the power of the electronic camera 1 is turned on by switching the power switch 11 to the side where “ON” is printed, and the release switch 10 provided on the surface Y1 is pressed, the subject photographing process is performed as follows. Be started.
[0051]
Light from a subject observed by the finder 2 is condensed by the photographing lens 3 and forms an image on a CCD 20 having a plurality of pixels. The optical image of the subject formed on the CCD 20 is photoelectrically converted into an image signal at each pixel, and is sampled by the CDS 31 at a rate of eight times per second. At this time, the CDS 31 thins out the image electric signals corresponding to all the pixels from the CCD 20 corresponding to three quarters of the pixels.
[0052]
The image signal sampled by the CDS 31 (the image signal of a quarter of all the pixels of the CCD 20) is supplied to an A / D conversion circuit 32, where it is digitized and output to a DSP 33.
[0053]
The digitized image data is once supplied to the buffer memory 37 by the DSP 33 and stored therein. The image data stored in the buffer memory 37 is read by the compression / decompression memory control circuit 38 and is compressed according to the JPEG method. The image data compressed by the compression / decompression memory control circuit 38 is supplied to the memory card 24 via the data bus 42 and recorded in the image recording area. At this time, in the image recording area of the memory card 24, data of the shooting date and time is recorded as header information of the image data.
[0054]
Next, a case where the continuous shooting mode changeover switch 13 is switched to the H mode (a mode in which 30 frames are continuously shot per second) will be described. When the power of the electronic camera 1 is turned on by switching the power switch 11 to the side where “ON” is printed, and the release switch 10 provided on the surface Y1 is pressed, the subject photographing process is performed as follows. Be started.
[0055]
Light from the subject observed through the viewfinder 2 is collected by the photographing lens 3 and forms an image on the CCD 20. The light image of the subject formed on the CCD 20 having a plurality of pixels is photoelectrically converted into an image signal in each pixel, and is sampled by the CDS 31 at a rate of 30 times per second. At this time, the CDS 31 thins out the image electrical signals corresponding to all the pixels from the CCD 20 corresponding to 8/9 pixels.
[0056]
The image signal sampled by the CDS 31 (the image signal of one-ninth of all the pixels of the CCD 20) is supplied to an A / D conversion circuit 32, where it is digitized and output to a DSP 33.
[0057]
The DSP 33 once supplies the digitized image data to the buffer memory 37 and stores it therein. The compression / decompression memory control circuit 38 reads the image data from the buffer memory 37 and compresses the image data according to the JPEG method. The digitized and compressed image data is supplied to the memory card 24 via the data bus 42, and is recorded in the image recording area of the memory card 24 together with the header information of the shooting date and time.
[0058]
Note that, at the time of photographing the subject, the strobe (light emitting unit) 4 may be operated as necessary to irradiate the subject with light.
[0059]
Next, an operation when inputting two-dimensional information (pen input information) using the touch tablet 6A will be described. When the pen tip of the pen-type pointing device 6B is brought into contact with the touch tablet 6A, data corresponding to the XY coordinates of the contacted point is input to the CPU. The data corresponding to the XY coordinates is supplied to the CPU 34, and the CPU 34 writes, for example, image data corresponding to a point of a predetermined size in a position corresponding to the XY coordinates in the buffer memory 37, and controls the CPU 34. Thereby, a dot of a predetermined size is displayed at a corresponding position on the LCD 6.
[0060]
As described above, since the touch tablet 6A formed on the surface of the LCD 6 is formed of a transparent member, the user presses the touch tablet 6A on the LCD 6 with the pen tip of the pen-type pointing device 6B. The point displayed at the position can be observed, and it can be felt as if a pen input was made directly on the LCD 6. When the pen-type pointing device 6B is moved while being in contact with the touch tablet 6A, a line is displayed on the LCD 6 along the locus of the movement of the pen-type pointing device 6B. Further, when the pen-type pointing device 6B is intermittently moved on the touch tablet 6A, a broken line is displayed on the LCD 6 as the pen-type pointing device 6B moves. As described above, the user can input desired line drawing information such as characters and graphics using the touch tablet 6A (LCD 6).
[0061]
Further, when an image is displayed on the LCD 6, when line drawing information such as a character is input by the pen-type pointing device 6 </ b> B, the line drawing information is combined with the image information in the buffer memory 37, and is displayed on the LCD 6. Displayed at the same time.
[0062]
By operating a color selection switch (not shown), the user can select a line drawing color displayed on the LCD 6 from a plurality of colors such as black, white, red, and blue.
[0063]
When the enter key 7B of the operation keys 7 is pressed after the line drawing information is input by the pen-type pointing device 6B and the touch tablet 6A, the line drawing information stored in a predetermined memory is stored in the CPU control bus 41 together with the header information of the input date and time. Is supplied to the memory card 24 via the memory card 24 and recorded in the line drawing information recording area of the memory card 24.
[0064]
The line drawing information recorded on the memory card 24 is information that has been subjected to compression processing. Since the line drawing information input to the touch tablet 6A contains a lot of information having a high spatial frequency component, if the compression processing is performed by the JPEG method used for compressing the image, the compression efficiency is low and the information amount does not decrease much. . Further, since the compression by the JPEG method is irreversible compression, it is not suitable for compression of line drawing information having a small amount of information. This is because when the image is expanded and displayed on the LCD 6, gathers, bleeding, and the like due to missing information become noticeable.
[0065]
Therefore, in the present embodiment, the line drawing information is compressed by a run length method used in a facsimile or the like. The run-length method scans a line drawing screen in the horizontal direction, and continues the length of information (points) of each color such as black, white, red, and blue, and the length of continuous non-information (portion without pen input). This is a method of compressing line drawing information by encoding the line drawing information.
[0066]
By using this run-length method, line drawing information can be efficiently compressed, and even when the compressed line drawing information is decompressed, loss of information can be suppressed. When the information amount of the line drawing information is relatively small, it is possible not to compress it.
[0067]
As described above, when an image is displayed on the LCD 6 and pen input is performed, the image data and the line drawing information input by the pen are synthesized in the buffer memory 37, and the synthesized image of the image and the line drawing is displayed on the LCD 6. Displayed above. However, on the memory card 24, the image data is recorded in the image recording area, and the line drawing information is separately recorded in the line drawing information recording area. As described above, since the two pieces of information are recorded in different areas, the user can delete only one of the combined images of the image and the line drawing. Further, each image information can be compressed and recorded by an individual compression method.
[0068]
When data is recorded in at least one of the audio recording area, the image recording area, and the line drawing information recording area of the memory card 24, as shown in FIG. 5, a predetermined list display screen showing a list of the recorded information Can be displayed on the LCD 6. On the list display screen of the LCD 6 shown in FIG. 5, the date when the information was recorded (recorded date) (in this case, August 25, 1995) is displayed at the lower end of the screen, and the recorded date is recorded. The recording time of the information recorded on the date is displayed on the leftmost side of the screen.
[0069]
On the right side of the recording time, when image data is recorded, a thumbnail image is displayed. This thumbnail image is a reduced image created by thinning out bitmap data of each image data of the image data recorded on the memory card 24. Therefore, information on which a thumbnail image is displayed is information including image information. That is, the information recorded (input) at “10:16” and “10:21” includes image information, and includes “10:05”, “10:28”, and “10:28”. The information recorded at “14:00” and “13:10” does not include image information.
[0070]
The memo symbol “*” indicates that a predetermined memo is recorded as line drawing information.
[0071]
Further, an audio information bar is displayed on the right side of the thumbnail image display area, and a bar (line) having a predetermined length corresponding to the time at which the audio was recorded is displayed. If no audio information is recorded, this audio information bar is not displayed.
[0072]
The user selects and specifies information to be reproduced by pressing the rectangular area on which desired information is displayed on the list display screen shown in FIG. 5 with the pen tip of the pen-type pointing device 6B. By pressing the execution key 7B shown in FIG. 2 with the pen tip of the pen-type pointing device 6B, the reproduction of the selected information is instructed. As a result, the selected information is output.
[0073]
For example, on the screen shown in FIG. 5, when the pen-shaped pointing device 6B presses the inside of the band-shaped area where “10:05” is displayed, the CPU 34 sets the selected recording date and time (10:05). ) Is instructed to reproduce the voice corresponding to the voice IC 36.
[0074]
The voice IC reads the voice data from the memory card 24 in accordance with a command from the CPU 34, performs expansion processing, converts the data into an analog signal, and outputs the analog signal from the speaker 5. When an earphone (not shown) is connected to earphone jack 9, sound is not output from speaker 5, but sound is output from the earphone (not shown).
[0075]
When reproducing the image data recorded on the memory card 24, the user presses the desired thumbnail image with the pen tip of the pen-type pointing device 6B to select the information, and then presses the execution key 7B. To instruct the reproduction of the selected information.
[0076]
Image data corresponding to the selected thumbnail image is read from the memory card 24 and decompressed by the compression / decompression memory control circuit 38. The expanded image data is supplied to the buffer memory 37 via the data bus 42, and is stored as bitmap data. Next, a control signal corresponding to the image data stored in the buffer memory 37 is supplied to the LCD 6 by the CPU 34, and the corresponding image is displayed.
[0077]
At this time, when audio data is also recorded (for example, when the recording time is “10:16” or “10:21”), the audio may be output from the speaker 5 as described above. it can.
[0078]
Next, a method of reproducing the image data recorded on the memory card 24 will be described.
[0079]
First, the procedure for setting the audio output mode (playback mode) will be described with reference to the flowchart shown in FIG. First, in step S1, for example, when a predetermined position of the touch tablet 6A corresponding to the menu key 7A is pressed using the pen-type pointing device 6B, position data corresponding to the pressed position is sent from the touch tablet 6A to the CPU 34. Supplied. The CPU 34 recognizes that the menu key 7A has been selected from the position data, controls the LCD 6, and displays a main menu screen as shown in FIG.
[0080]
On the main menu screen, for example, various setting items such as “date setting”, “panel display”, “audio output”, and “interface” are displayed, and any one of them can be selected. The selected item is displayed in reverse video so that the selected item is clearly displayed.
[0081]
Next, proceeding to step S2, when the setting item "voice output" is selected using the pen-type pointing device 6B, the item "voice output" is highlighted and it is clearly indicated that the item is selected. Next, when the execution key 7B written as "EXEC" is pressed by using the pen-type pointing device 6B, a voice output setting screen as shown in FIG.
[0082]
On the audio output setting screen, setting items “operation sound”, “reproduction mode”, and “volume” can be set. The setting item “operation sound” is operated by operating the operation switch 35, operating the operation key 7 using the pen-type indicating device 6B, or pressing the touch tablet 6A using the pen-type indicating device 6B. When an item displayed on the menu screen is selected, whether or not to output an operation sound is selected and set. When the position where the character string "on" is displayed is selected by pressing it with the pen-type pointing device 6B, the character string "on" is highlighted and the operation sound is set. When the character string “off” is selected, the character string “off” is highlighted and set so that the operation sound is not output.
[0083]
As will be described later with reference to FIGS. 9 to 11, the setting item “reproduction mode” is used when the image data recorded on the memory card 24 is reproduced and the sound recorded in association with the image data is reproduced. This is for setting the data reproduction method. In this case, the character "A" corresponding to the reproduction mode A and the character "B" corresponding to the reproduction mode B are displayed. When the character is selected using the pen-type pointing device 6B or the like, the selected character is highlighted. And set to the selected mode.
[0084]
The setting item "volume" is used to set the volume when reproducing the audio data recorded on the memory card 24 and outputting the corresponding audio. When the position where the left-pointing triangle is displayed is pressed by the pen-type pointing device 6B or the like, the number displayed next to the right decreases by one, and the position where the right-pointing triangle is displayed is pressed with the pen-type pointing device 6B. When selected, the number increases by one. The displayed number indicates the set volume.
[0085]
Next, in step S3, either the mode A or the mode B is selected and set as the reproduction mode.
[0086]
In step S4, the CPU 34 recognizes whether the set reproduction mode is the reproduction mode A or the reproduction mode B. When the reproduction mode A is set, a predetermined mode flag is set to a value 0 and the reproduction mode is set. When B is set, a value 1 is set to the mode flag. After that, the process ends.
[0087]
Next, a description will be given, with reference to flowcharts of FIGS. 9 to 11, of a method of reproducing images and sounds when the reproduction mode A is set as the reproduction mode and when the reproduction mode B is set. .
[0088]
First, in step S11 of FIG. 9, among the thumbnail images displayed on the list display screen as shown in FIG. 5, the thumbnail image corresponding to the image to be reproduced is selected by the pen-type pointing device 6B. Next, proceeding to step S12, under the control of the CPU 34, the compression / decompression memory control circuit 38 reads out the compressed image data corresponding to the selected image from the memory card 24, temporarily supplies the image data to the buffer memory 37, and stores it therein. . Next, the image data stored in the buffer memory 37 is subjected to decompression processing by the compression / decompression memory control circuit 38, and the CPU 34 performs processing based on the decompressed image data stored in the buffer memory 37. The LCD 6 is controlled to display an image corresponding to the selected thumbnail image.
[0089]
Next, in step S13, the CPU 34 sets the first address of the recording area on the memory card 24 where the audio data corresponding to the image data just reproduced is recorded as the "read address".
[0090]
Next, proceeding to step S14, it is determined whether or not the value of the mode flag set in step S5 or S6 of FIG. 6 is 0 (reproduction mode A). When it is determined that the value of the mode flag is 0, the process proceeds to step S15, and the image corresponding to the reproduction mode A is reproduced. On the other hand, when it is determined that the value of the mode flag is not 0 (is 1 (reproduction mode B)), the process proceeds to step S16, and the image corresponding to the reproduction mode B is reproduced. When the reproduction processing in step S15 or S16 ends, the processing ends.
[0091]
Next, the procedure of the image reproduction process corresponding to the reproduction mode A will be described with reference to the flowchart shown in FIG.
[0092]
First, in step S21, the CPU 34 sets a value 1 to a predetermined image display counter. The image display counter corresponds to the number of times that the display of another image is selected while a predetermined image is displayed and the sound corresponding to the image is output.
[0093]
Next, proceeding to step S22, the audio IC 36 reads audio data from the “read address” on the memory card 24 set in step S13 of FIG. Next, in step S23, after subjecting the read audio data to a decompression process, the read audio data is converted into an analog audio signal, and the corresponding audio is output from the speaker 5. When an earphone (not shown) is connected to the earphone jack 9, sound is output from the earphone.
[0094]
In step S24, CPU 34 determines whether display switching to another image has been instructed or not. If it is determined that the display switching to another image has not been instructed, the process proceeds to step S28. On the other hand, when it is determined that the display of the next image has been instructed by operating the scroll key 7E or the like with the pen-type indicating device 6B, the process proceeds to step S25. Command to display the next image.
[0095]
The compression / decompression memory control circuit 38 reads the image data corresponding to the next image from the memory card 24 according to the instruction from the CPU 34, supplies the image data to the buffer memory 37, and stores the image data. Next, the compression / decompression memory control circuit 38 performs decompression processing on the image data stored in the buffer memory 37. The CPU 34 controls the LCD 6 based on the image data on which the decompression process has been performed, and displays a corresponding image.
[0096]
Next, proceeding to step S26, a predetermined image ID for identifying the image, which is associated with the image displayed on the LCD 6, is stored in, for example, the buffer memory 37. Next, in step S27, the value of the image display counter is incremented by one.
[0097]
In step S28, it is determined whether or not the output of the currently output audio related to the predetermined image has been completed. If it is determined that the output of the sound related to the predetermined image that has been output is not yet completed, the process returns to step S24, and the processes of steps S24 to S28 are repeatedly performed. On the other hand, when it is determined that the output of the sound related to the predetermined image that has been output is completed, the process proceeds to step S29.
[0098]
In step S29, the value of the image display counter is decremented by one. Next, in step S30, it is determined whether the value of the image display counter is greater than zero. When it is determined that the value of the image display counter is greater than 0, that is, when it is determined that there is still audio data to be reproduced and output, the process proceeds to step S31.
[0099]
In step S31, the CPU 34 reads out only one of the image IDs previously stored in the buffer memory 37 in the order in which the image IDs are stored, and stores the image data in the recording area on the memory card 24 in which the audio data corresponding to the image ID is recorded. Is the “read address”. Next, the process proceeds to step S32, where the read image ID is deleted from the buffer memory 37.
[0100]
Thereafter, the audio data is read from the “read address” of the memory card 24 set in step S31, and the corresponding audio is output from the speaker 5 or the earphone connected to the earphone jack 9. Then, the process returns to step S28, and the same processing as in the case described above is executed.
[0101]
On the other hand, if it is determined in step S30 that the value of the image display counter is equal to 0, the process ends, and the process returns.
[0102]
Next, a method of reproducing an image corresponding to the reproduction mode B in step S16 of FIG. 9 will be described with reference to a flowchart of FIG.
[0103]
First, in step S41, the audio IC 36 reads audio data from the “read address” of the recording area on the memory card 24 set in step S13 in FIG. Then, the process proceeds to step S42, where the read audio data is expanded and converted into an analog audio signal, and the corresponding audio is output from the speaker 5 or the earphone connected to the earphone jack 9.
[0104]
Next, in step S43, the CPU 34 determines whether or not the output of the sound corresponding to the image currently being displayed on the LCD 6 has been completed. If it is determined that the output of the sound corresponding to the image being displayed on the LCD 6 has not been completed, the process proceeds to step S44, and the CPU 34 determines whether or not the display switching to another image has been instructed. If it is determined that the display switching to another image has not been instructed, the process returns to step S42, and the processes of steps S42 to S44 are repeatedly executed until it is determined in step S43 that the output of the sound has been completed. .
[0105]
On the other hand, if it is determined in step S44 that the scroll key 7E has been operated by the CPU 34, for example, using the pen-type pointing device 6B, and the display switching to another image has been instructed, the process proceeds to step S45.
[0106]
In step S45, the CPU 34 instructs the compression / decompression memory control circuit 38 to display the specified image. The compression / decompression memory control circuit 38 reads out image data corresponding to another image from the memory card 24 based on a command from the CPU 34 and transfers the image data to the buffer memory 37. Next, the image data transferred to the buffer memory 37 is expanded. The CPU 34 controls the LCD 6 based on the decompressed image data stored in the buffer memory 37 to display another corresponding image.
[0107]
Next, the process proceeds to step S46, in which the "first address" of the recording area on the memory card 24 in which the audio data corresponding to the image currently displayed on the LCD 6 is recorded is "read address". Next, the process returns to step S41, and the processes of steps S41 to S46 are repeatedly executed.
[0108]
On the other hand, if it is determined in step S43 that the output of the sound corresponding to the image being displayed on the LCD 6 has been completed, the process ends and the process returns.
[0109]
As described above, when the reproduction mode A is set, as described above with reference to the flowchart of FIG. 10, while the sound corresponding to the image being displayed on the LCD 6 is being reproduced, the reproduction of another image is performed. Is instructed and another image is displayed on the LCD 6, the currently reproduced sound is reproduced as it is, and when the reproduction of the sound ends, the reproduction of the sound corresponding to the other image is started. Can be
[0110]
In the reproduction mode A, the reproduction of the sound is not interrupted by the switching of the display image, so that the sound is not missed.
[0111]
Further, when the reproduction mode B is set, as described above with reference to the flowchart of FIG. 11, the reproduction of another image is instructed during the reproduction of the sound corresponding to the image being displayed on the LCD 6, When another image is displayed on the LCD 6, the reproduction of the sound corresponding to the image currently displayed is interrupted, and the reproduction of the sound corresponding to the other image newly displayed on the LCD 6 is started. can do.
[0112]
In the reproduction mode B, the sound corresponding to the switched image is immediately reproduced by switching the displayed image, and thus is suitable for, for example, searching for a desired image.
[0113]
As described above, the reproduction mode can be selected and set according to the user's preference and application.
[0114]
Further, in the above embodiment, when another image is selected during reproduction of the sound related to the predetermined image, the output of the reproduced sound is terminated without immediately displaying the selected other image. After that, another image can be displayed. This makes it possible to always associate the image and the sound. Further, at the same time when the output of the sound is completed, the next image can be displayed and the sound related thereto can be output.
[0115]
In the above embodiment, only one microphone is provided. However, it is also possible to provide two microphones on the left and right sides and record sound in stereo.
[0116]
Further, in the above embodiment, various information is input using the pen-type pointing device, but it is also possible to input using a finger.
[0117]
Furthermore, each screen displayed on the LCD 6 is an example, and the screen is not limited to this, and screens with various layouts can be used. Similarly, the types and layouts of the operation keys are also examples, and are not limited thereto.
[0118]
【The invention's effect】
According to the information input device of the first aspect, when another image is selected during the reproduction of the sound corresponding to the predetermined image, the reproduction of the sound corresponding to the predetermined image is continued. Therefore, all the sounds corresponding to the displayed image can be reproduced, and it is possible to prevent the sounds from being overlooked.
[0119]
Claim 4 According to the information input device described in (1), when the first mode is selected, even when another image is selected during reproduction of the predetermined audio corresponding to the predetermined image, the audio corresponding to the predetermined image is selected. When the second mode is selected, when another image is selected during reproduction of the predetermined sound corresponding to the predetermined image, reproduction of the sound corresponding to the predetermined image is interrupted. With this configuration, it is possible to change the audio reproduction method according to the user's preference and application.
[Brief description of the drawings]
FIG. 1 is a perspective view of an embodiment of an electronic camera to which the present invention is applied, as viewed from the front side.
FIG. 2 is a perspective view of the electronic camera 1 as viewed from the back.
FIG. 3 is a diagram showing an example of an internal configuration of the electronic camera 1.
FIG. 4 is a block diagram illustrating an example of an internal electrical configuration of the electronic camera 1.
FIG. 5 is a diagram showing an example of a display screen displayed on the LCD 6 of the electronic camera 1.
FIG. 6 is a flowchart showing a procedure for setting a sound reproduction mode.
FIG. 7 is a diagram illustrating an example of a main menu screen.
FIG. 8 is a diagram showing an example of an audio output setting screen.
FIG. 9 is a flowchart showing a procedure when an image is reproduced.
FIG. 10 is a flowchart illustrating a procedure of an image reproduction process when a reproduction mode A is set.
FIG. 11 is a flowchart illustrating a procedure of an image reproduction process when a reproduction mode B is set.
[Explanation of symbols]
1 electronic camera
2 Finders
3 Shooting lens (imaging means)
4 Light-emitting part (lighting means)
5 Speakers (voice output means)
6 LCD (display means)
6A touch tablet (selection means, mode selection means)
6B Pen-type pointing device (pen) (selection means, mode selection means)
7 Operation keys
7A Menu key
7B execution key
7C clear key
7D Cancel key
7E scroll key
8 microphone (voice input means)
9 Earphone jack (audio output means)
10 Release switch
11 Power switch
12 Recording switch
13 Continuous shooting mode switch
20 CCD (imaging means)
21 Battery
22 capacitors
23 circuit board
24 memory card (recording means)
31 Correlated Double Sampling Circuit (CDS)
32 analog / digital conversion circuit (A / D)
33 Digital Signal Processor (DSP)
34 CPU (control means)
35 Operation switch (SW)
36 Voice IC (voice playback means)
37 buffer memory
38 Compression / expansion memory control circuit (image reproducing means)
39 VDRV (CCD drive circuit)
40 AGC (Automatic gain control circuit)
41 CPU control bus
42 Data bus

Claims (9)

Imaging means for capturing an image,
Voice input means for inputting voice,
A storage unit that stores the image captured by the imaging unit and the audio corresponding to the image input by the audio input unit in association with each other;
Image reproduction means for reproducing the image stored in the storage means,
Sound reproduction means for reproducing the sound stored in the storage means,
Selecting means for selecting the image reproduced by the image reproducing means,
When the predetermined image is selected by the selection unit, the sound reproduction unit reproduces the predetermined sound associated with the predetermined image, and the sound reproduction unit reproduces the predetermined sound, Control means for controlling the sound reproducing means to continue reproduction of the predetermined sound even when another image different from the predetermined image is selected by the selecting means. Information input device. The control unit controls the audio reproduction unit to start reproduction of another audio associated with another image after the audio reproduction unit ends reproduction of the predetermined audio associated with the predetermined image. The information input device according to claim 1, wherein: The control unit controls the image reproducing unit to switch from the predetermined image to another image and display the image when another image different from the predetermined image is selected by the selection unit. The information input device according to claim 1, wherein: Imaging means for capturing an image,
Voice input means for inputting voice,
A storage unit that stores the image captured by the imaging unit and the audio corresponding to the image input by the audio input unit in association with each other;
Image reproduction means for reproducing the image stored in the storage means,
Sound reproduction means for reproducing the sound stored in the storage means,
Selecting means for selecting the image reproduced by the image reproducing means,
A first mode that defines a method in which the audio reproduction unit reproduces the audio stored in the storage unit, a mode selection unit that selects one of a second mode,
When the first mode is selected by the mode selection means, when the predetermined image is selected by the selection means, the sound reproduction means reproduces the predetermined sound associated with the predetermined image. While the sound reproducing means is reproducing the predetermined sound, even when another image different from the predetermined image is selected by the selecting means, the sound reproducing means reproduces the predetermined sound. Continuing, when the second mode is selected by the mode selecting means, and when the predetermined image is selected by the selecting means, the sound reproducing means sets the predetermined sound associated with the predetermined image. When the sound reproducing means is reproducing the predetermined sound and another image different from the predetermined image is selected by the selecting means, the sound reproducing means Information input device, characterized in that it comprises a control means for interrupting playback of the audio. The control means, when the first mode is selected by the mode selection means, when the other one of the images different from the predetermined image is selected by the selection means, the sound reproduction means The method according to claim 4, wherein after the reproduction of the predetermined sound associated with the image is completed, the reproduction of the other sound associated with the other image is controlled to start. Information input device. The control means, when the second mode is selected by the mode selection means, when another image different from the predetermined image is selected by the selection means, the sound reproduction means The information input according to claim 4, wherein control is performed such that reproduction of the predetermined sound associated with the image is interrupted, and reproduction of the other sound associated with the other image is started. apparatus. The control unit controls the image reproducing unit to switch from the predetermined image to another image and display the image when another image different from the predetermined image is selected by the selection unit. The information input device according to claim 4, wherein: Display means for displaying the image captured by the image capturing means, and the image reproduced by the image reproducing means,
8. The apparatus according to claim 1, further comprising: an audio output unit configured to output the audio input by the audio input unit and the audio reproduced by the audio reproduction unit. 9. Information input device. The information input device according to any one of claims 1 to 8, further comprising an illumination unit configured to irradiate the subject with illumination light.

Images