JP4735495B2 - Voice processing apparatus and program - Google Patents

Description

  The present invention relates to an audio processing apparatus and program suitable for a digital camera having an audio recording mode, for example.

  A digital camera generally has a so-called voice recording function that records only sound without taking an image, and can perform recording only for a time corresponding to the capacity of a memory card as a recording medium. Many.

  In addition, since a digital camera is originally intended to capture an image of a subject, a technique may be considered in which an image is captured in accordance with voice recording and the obtained image data is recorded in association with an audio data file. ing.

As this type of technology, for example, there is a technique in which a plurality of still image data are associated with one audio file, and the audio and the related still image can be reproduced according to the audio content. (Patent Document 1)
JP 2001-066943 A

  In the technique of the above-mentioned patent document 1, the related image is only additionally displayed at the recording timing at the time of photographing when reproducing the sound, and the main purpose is to confirm the content of the recorded sound with the image.

  However, taking into account that memory cards, which are recording media for digital cameras, have recently become widely available at affordable prices, it is possible to take many images even when the voice recording function is executed. Based on this, it is desired to use image data more actively.

  The present invention has been made in view of the above circumstances, and the object of the present invention is to efficiently reproduce audio data by actively utilizing image data associated with the audio data. An object is to provide a possible voice processing apparatus and program.

Invention of claim 1, wherein a display means for displaying an imaging means for image shooting of the subject, and a first recording means for recording the sound, the image of the subject picked up by the image pickup means, the subject by the image pickup means a setting unit configured to set the image capture command of the each of the plurality of types, based on the type of image capture command which is set by the setting means, the image of the subject picked up by the image pickup means first recording means a first selection detecting means for detecting a second recording means for recording in association the sound recorded, the selection of the type of images recorded in association with the second recording means by, the first Display control means for displaying on the display means an image corresponding to the type detected by the first selection detection means, and second for detecting selection of a specific image from the images displayed by the display control means. of And択検detecting means, and further comprising a reproducing means for reproducing sound recorded by said first recording means from the position of the sound corresponding to the image selected is detected by the second selection detecting means Do
According to a second aspect of the present invention, there is provided an imaging means for imaging a subject, a first recording means for recording sound, a display means for displaying an image of the subject imaged by the imaging means, and a subject image by the imaging means. A setting unit that sets an imaging instruction for each of a plurality of types, and an image of the subject captured by the imaging unit is recorded by the first recording unit based on the type of the imaging instruction set by the setting unit. A second recording means for recording a plurality of images in association with the recorded audio, a first selection detecting means for detecting the selection of the type of image recorded in association with the second recording means, and the first Display control means for displaying on the display means a plurality of images corresponding to the type detected by the selection detection means, and selection of a specific image from the plurality of images displayed by the display control means Second selection detecting means for detecting a plurality of sounds, and reproduction of the sound recorded by the first recording means for continuously playing back each sound position corresponding to a specific image with a plurality of selections detected by the selection detecting means. Means.
According to a third aspect of the present invention, there is provided an imaging means for imaging a subject, a first recording means for recording sound, a display means for displaying an image of the subject imaged by the imaging means, and a subject image by the imaging means. A setting unit that sets an imaging instruction for each of a plurality of types, and an image of the subject captured by the imaging unit is recorded by the first recording unit based on the type of the imaging instruction set by the setting unit. A second recording means for recording a plurality of images in association with the recorded audio, a first selection detecting means for detecting the selection of the type of image recorded in association with the second recording means, and the first Display control means for displaying on the display means a plurality of images corresponding to the type detected by the selection detection means, and selection of a specific image from the plurality of images displayed by the display control means A plurality of second selection detecting means for detecting, a voice extracting means for extracting positions of a plurality of sounds corresponding to a specific image whose selection is detected by the second selection detecting means, and an extraction by the voice extracting means; Editing means for editing a new sound file from the sound recorded in the first recording means based on the positions of the plurality of sounds, and storage means for saving the new sound file edited by the editing means; It is provided with.

According to the present invention, actively utilize the type of image data associated with the audio data, by selecting an image corresponding to the type and the type that is displayed, effectively only necessary audio data Can be played and edited .

(First embodiment)
A first embodiment when the present invention is applied to a digital camera will be described below with reference to the drawings.
FIG. 1 shows a conceptual configuration of an electronic circuit of the entire digital camera 10.
In the drawing, in the monitoring state in the photographing mode, the position of a part of the lenses in the photographing lens optical system 12, specifically the zoom lens and the focus lens, is appropriately moved by driving the motor (M) 11. A CCD 13 that is a solid-state imaging device is disposed at an imaging position behind the photographing optical axis of the photographing lens optical system 12 via a mechanical shutter (not shown).

  The CCD 13 is scanned and driven by a timing generator (TG) 14 and a CCD driver 15 and outputs a photoelectric conversion output corresponding to a light image formed at fixed intervals for one screen.

  In the AGC / SH (Auto Gain Control / Sample Hold) circuit 16, this photoelectric conversion output is automatically gain-adjusted according to the ISO sensitivity set for each primary color component of RGB in the state of an analog value signal. After being sampled and held, it is sent to the A / D converter 17.

  The A / D converter 17 converts analog image data into digital data and outputs the digital data to the color process circuit 18.

  The color process circuit 18 performs color process processing including pixel interpolation processing and γ correction processing on digital image data, generates digital luminance luminance / chrominance image data YUV by matrix conversion, and then performs DMA (Direct Memory Access). ) Output to the controller 19.

  The DMA controller 19 once writes the image data YUV output from the color process circuit 18 into a buffer inside the DMA controller 19 using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 18 as well. DMA transfer is performed to a DRAM 21 used as a buffer memory via an interface (I / F) 20.

  The control unit 22 includes a CPU and a non-volatile memory such as a flash memory in which an operation program including recording and reproduction of audio data corresponding to marking described later is fixedly stored. The main memory is used as a work memory. While temporarily developing and writing necessary data in the memory 23 as appropriate, the control operation of the entire digital camera 10 is controlled.

  Thus, after the DMA transfer of the image data to the DRAM 21 is completed, the control unit 22 reads the image data from the DRAM 21 via the DRAM interface 20 and writes it to the VRAM 25 via the display controller 24.

  The display controller 24 periodically reads the image data from the VRAM 25 and outputs it to the display unit 26.

  The display unit 26 includes, for example, a backlit color liquid crystal panel disposed on the rear surface of the housing of the digital camera 10 and a drive circuit thereof. The display unit 26 functions as an electronic viewfinder in the shooting mode, and the display controller 24. By performing the display based on the image data from the image, the image captured from the display controller 24 at that time is displayed on the monitor in real time, while the selected image is reproduced and displayed in the reproduction mode.

  In this way, a part of the key input unit 27 is configured at a timing at which a still image is to be captured in a so-called through image display state in which the image of the subject at that time is displayed in real time as a monitor image on the display unit 26 When the shooting key is operated, a trigger signal is generated.

  In response to the trigger signal, the control unit 22 cancels the DMA transfer of the luminance and color difference signals for one screen currently captured from the CCD 13 to the DRAM 21, and is not shown at a shutter speed according to the appropriate exposure conditions. The mechanical shutter and the CCD 13 are driven to obtain luminance and color difference signals for one screen and transfer them to the DRAM 21. Thereafter, this path is stopped and the state is changed to the storage and storage state.

  In this storage and storage state, the control unit 22 outputs the image data YUV for one frame written in the DRAM 21 to 8 pixels × 8 pixels for each of Y, U, and V components via the DRAM interface 20. A unit called a basic block is read out and written to the image compression / decompression circuit 28. The image compression / decompression circuit 28 uses a predetermined image format such as ADCT (Adaptive Discrete Couse Transform) in accordance with JPEG (Joint Photographic Coding Experts Group) : Adaptive discrete cosine transform) and encoding by data compression processing such as Huffman coding which is an entropy coding method.

  The obtained code data is read out from the image compression / decompression circuit 28 as a data file for one image, and written into a memory card 29 that is detachably attached to the digital camera 10.

  Then, along with the compression processing of the luminance and color difference signals for one frame and the writing of all the compressed data to the memory card 29, the control unit 22 activates the path from the CCD 13 to the DRAM 21 again.

  The control unit 22 is further connected to the key input unit 27, the audio processing unit 30, the flash drive unit 31, and the USB interface 32 described above.

  FIG. 2 exemplifies keys provided in the key input unit 27. In addition to the photographing key 27d described above, the marking key A27a, marking key B27b, marking key C27c, recording key 27e, playback key 27f, and stop key 27g are illustrated. The cursor keys 27h and 27i and the execution key 27j are provided, and signals accompanying the key operations are directly sent to the control unit 22.

  The configuration of the key input unit 27 is used for ease of explanation, and is provided in the same manner as a general digital camera on the actual model of the digital camera 10, and includes a power key, a zoom key, and a photographing key. The function may be appropriately changed and set to a mode key, a playback mode key, a cursor key, a set key, a menu key, a macro key, a flash key, and the like.

  The sound processing unit 30 includes a sound source circuit such as a PCM sound source, and at the time of recording sound, the sound processing unit 30 digitizes the sound signal input from the microphone unit 33 disposed on the front surface of the digital camera 10, and has a predetermined data file format. For example, the data is compressed according to MP3 (Moving Picture Coding Experts Group-1 audio layer 3) standard, and an audio data file is created and sent to the memory card 29.

  On the other hand, the audio processing unit 30 uncompresses and converts the audio data file read from the memory card 29 during audio reproduction into an analog signal, and a speaker unit 34 provided on the back side of the digital camera 10 as with the display unit 26. Drive to emit loud sounds.

  The flash drive unit 31 charges a flash-use large-capacitance capacitor (not shown) at the time of still image shooting, and flash-drives the flash light-emitting unit 35 including a xenon discharge tube or the like based on control from the control unit 22. .

  However, when shooting of a moving image instead of a still image is selected in the shooting mode, the above-described still image data is acquired and the image compression / expansion circuit 27 is used when the first shooting key is operated. A series of operations of compressing data and storing in the memory card 29 is started as a continuous execution at an appropriate frame rate, for example, 30 [frames / second], and the shutter key is operated for the second time, or When a predetermined time limit, for example, 30 seconds elapses, the series of still image data files are collectively set as a motion JPEG data file (AVI file).

  In the playback mode, the control unit 22 selectively reads out the image data stored in the memory card 29, and the image compression / decompression circuit 28 compresses the image data in a procedure that is completely opposite to the data compression procedure in the shooting mode. The image data is decompressed, and the decompressed image data is held in the DRAM 21 via the DRAM interface 20, and then the content held in the DRAM 21 is stored in the VRAM 25 via the display controller 24, and the image data is periodically transferred from the VRAM 25. The video signal is read out and generated on the display unit 26.

  If the selected image data is not a still image but a moving image, playback of the individual still image data constituting the selected moving image file is executed continuously in time at a predetermined frame rate, and the last still image is When the data reproduction is finished, the data is reproduced and displayed using only the still image data positioned at the head until the next reproduction instruction is given.

  The USB interface 32 performs transmission and reception with various external devices such as a personal computer and a printer connected to the USB terminal 36 in accordance with the USB (Universal Serial Bus) standard.

Next, the operation of the above embodiment will be described.
FIG. 4 shows the processing contents during the recording operation in the voice record mode, and all the operation control is executed by the control unit 22 based on an operation program stored in advance.

  At the beginning of the process, the system waits for an instruction to start recording by operating the recording key 27e of the key input unit 27 (step A01). Thus, when the key operation for instructing the start is performed, a recording process is performed with a preset sampling frequency and recording level (step A02), and the obtained audio data is sequentially filed to form a recording medium. While recording in the memory card 29 (step A03), it is determined whether or not the recording key 27e has been operated (step A04), and whether or not a key operation to end recording has been performed by operating the stop key 27g (step A09). The process is repeatedly executed.

  By repeatedly executing the processes of steps A02 to A04 and A09 in this manner, an instruction to end recording by operating the shooting key 27d or operating the stop key 27g while sequentially recording the audio data file on the memory card 29 is given. Wait to be done.

  If the shooting key 27d is operated during recording, this is determined in step A04, a still image shooting process is executed (step A05), and the image data file obtained by the shooting is stored in the memory card 29. (Step A06).

  At the same time, the control unit 22 takes in time information from the start of recording as the recording position during the recording operation (step A07), and uses the file name of the image data recorded on the memory card 29 and the recording position. In association with this, a marking management file constructed in the main memory 23 is entered (step A08), and a series of processing corresponding to the operation of the photographing key 27d is completed as described above, and the process proceeds to step A09.

  FIG. 3 shows the marking created in the main memory 23 when the photographing key 27d is repeatedly operated (total 5 times) during the recording of the audio data, and the processing of steps A05 to A08 is executed each time. It illustrates the contents of the management file.

  Accordingly, when the stop key 27g of the key input unit 27 is operated so as to end the voice recording in the voice record mode in which the still image data is associated by operating the photographing key 27d at an appropriate timing as described above, the step This determination is made at A09, and the audio data files continuously recorded on the memory card 29 are combined into one, and the marking management file as shown in FIG. 3 stored in the main memory 23 at that time is stored. Post-processing such as addition setting to the audio data file as additional data is executed (step A10).

  The series of audio data recording processing is completed as described above, and the process returns to step A01 to prepare for recording of the next audio data.

  Next, the operation in the reproduction mode for reproducing the audio data file recorded on the memory card 29 will be described.

  FIG. 5 shows the processing contents when an audio data file is selected and played back in the playback mode, and all the operation control is executed by the control unit 22 based on an operation program stored in advance.

  When an arbitrary audio data file initially recorded on the memory card 29 is selected (step B01), the marking management file additionally set in the audio data file is read (step B02). The thumbnail images of all the marked image data recorded in the image data are read out from the image data file and expanded (step B03), displayed as a list on the display unit 26 (step B04). The marking portion of each image data in the audio data file is displayed in a bar graph indicating the audio data file (step B05).

  6 to 9 exemplify display processes related to the list display of the marking images. Immediately after the desired audio data file is selected, an icon simulating a microphone indicating that the selected audio data file is selected is displayed on the display unit 26 as shown in FIG. Thus, the marking corresponding to the recording position of the image data is displayed with the entire audio data as one bar graph.

  Assuming that the contents of each marking are specifically image data having the contents as shown in FIG. 6B, the thumbnail images in each image data are read and expanded, for example, FIG. 7 or FIG. It is assumed that image display as shown in FIG.

  In FIG. 7A, on the bar graph with the marking, one thumbnail image is selected, for example, in time series, and triangles indicating that there are other images are displayed on the left and right, respectively. The presence of images.

  Therefore, by operating the cursor keys 27h and 27i of the key input unit 27 according to the display of the triangle, the image selected and displayed along the time series direction is moved as shown in FIG. In addition, the rectangular mark indicating the marking position moves in the bar graph.

  In addition, instead of the display shown in FIGS. 7A and 7B, a triangle for urging the image to move on the bar graph side may be left and displayed as shown in FIG. 7B. .

  In FIG. 8A, an icon simulating a microphone indicating that a plurality of, for example, three thumbnail images are arranged, for example, in chronological order on the bar graph with the marking, and further indicates an audio data file at the upper part thereof. An example of arranging and displaying is shown. By displaying triangles indicating that there are other images on the left and right of the plurality of thumbnail images, the presence of a plurality of images is further indicated.

  Therefore, by operating the cursor keys 27h and 27i of the key input unit 27 according to the display of the triangle, a plurality of images selected and displayed are moved along the time series direction as shown in FIG. 8B. At the same time, the reproduction position cursor of the rectangular mark indicating the marking position also moves in the bar graph.

  FIG. 9 shows that a large number, for example, eight image areas are prepared in advance on a bar graph with markings regardless of the number of actually marked images, and the actual marked images are inserted into each image area and displayed. An example is shown. Here, since the number of marked images is five, the remaining three image areas are displayed empty.

  On the contrary, when there are many methods of the number of image data marked with respect to the image area prepared in advance, the number that can be displayed by using the triangular display as shown in FIGS. 7 and 8 above. Only a part of the image is displayed.

  As described above, in a state where at least a part of the thumbnail image of the marked image data is displayed, any one of the thumbnail images is displayed by the operation of the cursor keys 27h and 27i (Step B06).

  When it is determined that the operation has been performed, the recording position in the audio data file corresponding to the image data that is the source of the selected thumbnail image is determined according to the operation content, the file name of the image data and the marking management file (Step B07).

  In accordance with the read recording position, the reproduction position cursor of the rectangular mark indicating the marking position in the bar graph is also moved and moved (step B08), and whether or not the reproduction key 27f for instructing the reproduction of voice has been operated is determined. If it is judged (step B08) and it is not operated, the process returns to step B04.

  Thus, in the process of repeatedly executing the processes of steps B04 to B09, when the playback key 27f is operated, this is determined in step B09, and the sound is reproduced from the recording position displayed by the playback position cursor. (Step B10).

  While executing this audio reproduction process, it is determined whether or not all audio data has been reproduced (step B11). If not completed, the processes from step B04 are repeated.

  In this way, the operation of the cursor keys 27h and 27i instructing the movement to another marking position is accepted while reproducing the audio data, and when the key operation is performed, the immediate reproduction position is jumped to the corresponding marking recording position. .

  Then, when the reproduction is completed to the end of the audio data file in the process of reproducing the audio, this is judged in the above-mentioned step B11, the above-described series of audio data reproduction processing is completed, and the next audio data file is reproduced again. In order to prepare for data recording, the process returns to step B01.

  As described above, by actively utilizing a plurality of image data recorded in association with the audio data and selecting any one of the images displayed in a list according to the display capacity on the display unit 26, the image is immediately displayed. It is possible to shift to audio reproduction from the recording position.

  For this reason, necessary audio data can be easily found out by visual judgment, such as a scene at the time of audio recording, and can be efficiently reproduced.

(Second Embodiment)
A second embodiment when the present invention is applied to a digital camera will be described below with reference to the drawings.
Note that the conceptual configuration of the entire electronic circuit relating to the digital camera is basically the same as the content shown in FIG. 1 above, and particularly the configuration example of the key input unit is basically the same as the content shown in FIG. As a matter of course, the same reference numerals are used for the same parts, and illustration and description thereof are omitted.

Next, the operation of the above embodiment will be described.
FIG. 10 shows the processing contents during the recording operation in the voice record mode, and all the operation control is executed by the control unit 22 based on an operation program stored in advance.

  At the beginning of the process, the system waits for an instruction to start recording by operating the recording key 27e of the key input unit 27 (step C01). Thus, when the key operation for instructing the start is performed, a recording process is performed with a preset sampling frequency and recording level (step C02), and the obtained audio data is sequentially filed to form a recording medium. While recording in the memory card 29 (step C03), whether or not any of the marking key A27a, marking key B27b, and marking key C27c of the key input unit 27 has been operated (step C04) is recorded by operating the stop key 27g. The process of determining whether or not a key operation to be ended has been performed (step C10) is repeatedly executed.

  By repeatedly executing the processes of steps C02 to C04 and C10 in this manner, the sound data file is sequentially recorded on the memory card 29, and the photographing by the operation of the key input unit 27, the marking key B27b or the marking key C27c, or the stop key. It waits for the end of recording to be instructed by the operation of 27g.

  If any of the marking keys 27a to 27c is operated during recording, it is determined in step C04, and the type of the operated marking key (any of A to C) is determined ( Step C05), still image shooting processing is executed (step C06), and the image data file obtained by the shooting is recorded in the memory card 29 (step C07).

  At the same time, the control unit 22 takes in time information from the start of recording as the recording position during the recording operation (step C08), and the file name of the image data recorded on the memory card 29, the recording position, and The marking type is associated and entered in the marking management file built in the main memory 23 (step C09), and the series of processing corresponding to any of the marking keys 27a to 27c is completed. Then, the process proceeds to step C10.

  In FIG. 11, the marking key A27a, the marking key B27b, and the marking key C27c are repeatedly operated (a total of five times) during the recording of the audio data, and the processing of steps C05 to C09 is executed each time. The contents of the marking management file created in the storage memory 23 are exemplified.

  Here, in the process of recording a series of audio data, the marking key A27a is operated twice, the marking key B27b is operated once, and the marking key C27c is operated twice.

  Accordingly, the key input unit 27 is stopped so as to end the voice recording in the voice record mode in which the still image data is associated by operating the marking key A27a, the marking key B27b, and the marking key C27c at a necessary timing as described above. When the key 27g is operated, this is determined in step C10, and the audio data files that have been continuously recorded on the memory card 29 are combined into one, and are stored in the main memory 23 at that time as shown in FIG. The post-processing such as adding the marking management file as shown in FIG. 5 to the audio data file as additional data is executed (step C11).

  Thus, the series of audio data recording processing is completed, and the process returns to step C01 to prepare for recording of the next audio data.

  Next, the operation in the reproduction mode for reproducing the audio data file recorded on the memory card 29 will be described.

  FIG. 12 shows the processing contents when an audio data file is selected and played back in the playback mode, and all the operation control is executed based on the operation program stored in advance by the control unit 22.

  Initially, an arbitrary audio data file recorded on the memory card 29 is selected (step D01), and at least one of the marking key A27a, marking key B27b, or marking key C27c of the key input unit 27 is operated. The marking type is selected by (Step D02).

  By these operations, the marking management file additionally set in the audio data file is read out. Whether or not the keys operated by the operation in step D02 are all the marking keys 27a to 27c. Is determined (step D03).

  Here, when all of the three marking keys 27a to 27c are operated, the marking portions of all types are read as if all types are selected (step D04), and the types in the bar graph of the display unit 26 are read. The colors are classified and displayed (step D07).

  FIG. 13A exemplifies the display state of the marking portion on such a display unit 26. Here, the type A by the marking key A27a operation is red (black solid in the figure), and the marking key B27b is operated. The type B is represented by blue (horizontal hatching in the figure) marking, and the type C by the marking key C27c operation is represented by green (white in the figure) marking.

  If it is determined that the key operated in step D03 does not include all the marking keys 27a to 27c, only the marking portion of the type corresponding to the operated key is read (step D06). In the bar graph of the display unit 26, color classification is performed according to the type (step D07).

  FIGS. 13B to 13D illustrate the display state of the marking portion on such a display unit 26. FIG. 13B shows the type A by the marking key A27a operation with red (solid black in the figure) marking.

  Similarly, FIG. 13C shows type B by marking key B27b operation in blue (horizontal hatching in the figure), and FIG. 13D shows type C green by marking key C27c operation. This is indicated by the markings (outlined in the figure).

  Thus, while only the type corresponding to the operation of the marking keys 27a to 27c is displayed as the marking portion, the selection of the marking portion is waited for by the operation of the cursor keys 27h and 27i (step D06).

  When it is determined that the operation has been performed, the recording position in the audio data file corresponding to the selected marking location is read out from the file name of the image data and the marking management file according to the operation content (step D09). ).

  In accordance with the read recording position, the reproduction position cursor of the rectangular mark indicating the marking position in the bar graph is also moved (step D10), and whether or not the reproduction key 27f for instructing the reproduction of the sound is operated. (Step D11), and if not operated, the process returns to step D02.

  Thus, in the process of repeatedly executing the processes in steps D02 to D11, when the playback key 27f is operated, this is determined in step D11, and the audio playback from the recording position displayed by the playback position cursor is executed. (Step D12).

  While executing this audio reproduction process, it is determined whether or not all audio data has been reproduced (step D13), and if not, the processes from step D02 are repeated.

  In this way, the operation of the cursor keys 27h and 27i instructing the movement to another marking position is accepted while reproducing the audio data, and when the key operation is performed, the immediate reproduction position is jumped to the corresponding marking recording position. .

  Then, when the playback of the audio data file is completed until the end of the audio data file, it is determined in step D13 above, and the process of reproducing a series of audio data is completed as described above, and the next audio data file is again processed. In order to prepare for data recording, the process returns to step D01.

  As described above, when the user selectively operates the marking key A27a, the marking key B27b, and the marking key C27c according to an arbitrary intention together with the selection of the voice data file, for example, if the voice to be recorded is a conference, the agenda Confirmation of important points when playing back the audio data file later by devising the marking method at the time of recording, such as selecting separately or selecting separately for questions and responses. And editing work is much easier.

(Third embodiment)
A third embodiment when the present invention is applied to a digital camera will be described below with reference to the drawings.
Note that the conceptual configuration of the entire electronic circuit relating to the digital camera is basically the same as the content shown in FIG. 1 above, and particularly the configuration example of the key input unit is basically the same as the content shown in FIG. As a matter of course, the same reference numerals are used for the same parts, and illustration and description thereof are omitted.

Next, the operation of the above embodiment will be described.
Here, the processing contents during the recording operation in the voice record mode are the same as those shown in FIG. 10, and the description thereof is omitted.

  In addition, the contents of the marking management file reproduced in the main memory 23 by the operation of the marking key A 27a, the marking key B 27b, and the marking key C 27c at the time of recording the voice data are the same as those shown in FIG. 11, for example. It shall be.

  Next, the operation of the above embodiment will be described.

  Here, as shown in FIG. 10, it is assumed that the voice is recorded with the marking key type operation, and the operation in the playback mode for reproducing the recorded voice will be described below.

  FIG. 14 shows the processing contents when an audio data file is selected and automatically played back in the playback mode, and all the operation control is executed by the control unit 22 based on an operation program stored in advance.

  Initially, an arbitrary audio data file recorded on the memory card 29 is selected (step E01), and at least one of the marking key A27a, marking key B27b, or marking key C27c of the key input unit 27 is operated. The marking type is selected by (Step E02).

  At this time, it is always confirmed that the marking type is selected by any one of the marking keys 27a to 27c (step E03). If the marking type is not selected, it is determined and the above-described step E02 is started. Returning to the above processing, the marking type must be selected.

  If it is determined that the marking type selection operation has been performed, then the marking location of the type corresponding to the operated key is read from the marking management file (step E04), and the recording position in the audio data file corresponding to the marking location is read. Is read from the file name of the image data and the marking management file (step E05).

  While reproducing the audio data corresponding to the marking portion according to the recording position (step E06), it is determined whether or not a predetermined time, for example, 5 [seconds] has elapsed and the end time has been reached (step E07). If not, the process of returning to step E06 is repeated to reproduce audio data for a predetermined time from the marked recording position.

  When the audio reproduction for a predetermined time is completed, this is determined in step E07, and it is determined from the marking management file whether there is a next marking portion corresponding to the selected type (step E08).

  Here, when it is determined that there is a next marking location, the process returns to the process from step E04 again, and audio reproduction for a predetermined time from the next marking location is executed.

  In this way, by repeatedly executing the processes of steps E04 to E08, voice reproduction for a predetermined time corresponding to the selected marking type is automatically and continuously executed.

  Thereafter, all sound reproduction corresponding to the selected marking type is terminated, and if it is determined in step E08 that there is no next marking portion, whether or not the automatic reproduction is to be terminated next is determined by a key operation for instructing the user to terminate. Judgment is made based on the presence or absence (step E07).

  Here, when there is no key operation for instructing the end from the user and the automatic reproduction is not ended, the process returns to step E01 and the same operation is repeated.

  Accordingly, when an instruction to end automatic reproduction is given, this is determined in step E09, and the processing in FIG.

  As described above, by performing the marking type selection operation, it is possible to execute automatic reproduction in which only the corresponding marking portion is successively reproduced in sequence for a predetermined time, and it is necessary to simplify the key operation of the user as much as possible. The audio of the part can be extracted and played back, and the playback can be realized efficiently.

(Fourth embodiment)
A fourth embodiment in which the present invention is applied to a digital camera will be described below with reference to the drawings.
Note that the conceptual configuration of the entire electronic circuit relating to the digital camera is basically the same as the content shown in FIG. 1 above, and particularly the configuration example of the key input unit is basically the same as the content shown in FIG. As a matter of course, the same reference numerals are used for the same parts, and illustration and description thereof are omitted.

Next, the operation of the above embodiment will be described.
Here, the processing contents during the recording operation in the voice record mode are the same as those shown in FIG. 10, and the description thereof is omitted.

  In addition, the contents of the marking management file reproduced in the main memory 23 by the operation of the marking key A 27a, the marking key B 27b, and the marking key C 27c at the time of recording the voice data are the same as those shown in FIG. 11, for example. It shall be.

  Next, the operation of the above embodiment will be described.

  Here, as shown in FIG. 10, it is assumed that the voice is recorded with the marking key type operation, and the operation in the playback mode for reproducing the recorded voice will be described below.

  FIG. 15 shows the processing contents when an audio data file is selected and automatically edited in the playback mode, and all the operation control is executed by the control unit 22 based on an operation program stored in advance.

  Initially, an arbitrary audio data file recorded in the memory card 29 is selected (step F01), and at least one of the marking key A27a, marking key B27b, or marking key C27c of the key input unit 27 is operated. The marking type is selected by (Step F02).

  At this time, it is always confirmed that the marking type is selected by any of the marking keys 27a to 27c (step F03). If the marking type is not selected, it is determined and the above-described step F02 is started. Returning to the above processing, the marking type must be selected.

  If it is determined that the marking type selection operation has been performed, then the marking location of the type corresponding to the operated key is read from the marking management file (step F04), and the recording position in the audio data file corresponding to the marking location is read. Are read from the file name of the image data and the marking management file (step F05).

  According to this recording position, the portion of the audio data corresponding to the marking location, that is, the portion immediately before the next marking location is extracted, buffered (step F06), and whether there is a next marking location corresponding to the selected type. It is judged from the marking management file (step F07).

  Here, if it is determined that there is a next marking location, the process returns to the process from step F04 again to extract the voice data portion from the next marking location.

  Thus, by repeatedly executing the processes of steps F04 to F07, the audio data portions corresponding to the selected marking type are sequentially extracted and buffered.

  Thereafter, extraction of all audio data portions corresponding to the selected marking type is completed, and if it is determined in step F07 that there is no next marking location, the extracted audio data portions buffered at that time are collectively displayed. Are edited as one new audio data file, and recorded and stored in the memory card 29 (step F08).

  Thereafter, whether or not to end automatic editing is determined based on whether or not there is a key operation for instructing the user to end (step F09).

  If there is no key operation for instructing termination from the user and automatic editing is not terminated, the process returns to step F01 and the same operation is repeated.

  If an instruction to end automatic editing is given, this is determined in step F09, and the processing in FIG. 15 is ended.

  As described above, since the audio data from a plurality of recording positions corresponding to the selected marking type is collectively edited and recorded as a new audio data file, only the content corresponding to the corresponding marking location is separately selected. Can be re-recorded as a new audio data file, and if the original audio data file is subsequently deleted, even if the recording capacity of the memory card 29 is limited, the capacity can be used efficiently, and the recording capacity can be reduced. More audio data can be recorded.

  In the above embodiment, the image data to be recorded in association with the audio data file has been described as a still image. However, the present invention is not limited to this, and the moving image data may be associated and recorded. .

  In this case, the user may manually start and end the shooting of the moving image data, and further, by setting a uniform shooting time, for example, 5 [seconds] in advance, only when starting shooting. It is good also as what performs operation.

  Each of the above embodiments has been described with reference to a case where the present invention is applied to a digital camera. However, the present invention is not limited to this. For example, a mobile phone having a camera function or a PDA (Personal Digital Assistants) Terminal), a portable music player having a voice recording function, and a personal computer program for recording a scene at the same time as executing a presentation program, and can be easily applied to various other devices.

  In addition, the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention in the implementation stage. In addition, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination according to a plurality of disclosed structural requirements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect can be obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

1 is a block diagram showing a functional circuit configuration of a digital camera according to a first embodiment of the present invention. The figure which illustrates the specific structure of the key input part of FIG. 1 which concerns on the embodiment. The figure which illustrates the content of the marking management file produced at the time of recording of the audio | voice file which concerns on the embodiment. The flowchart which shows the processing content of the operation | movement at the time of the audio | voice recording mode which concerns on the embodiment. The flowchart which shows the processing content of the operation | movement at the time of the audio | voice reproduction | regeneration mode which concerns on the embodiment. The figure which illustrates the display screen at the time of the audio | voice reproduction | regeneration mode which concerns on the embodiment. The figure which illustrates the display screen at the time of the audio | voice reproduction | regeneration mode which concerns on the embodiment. The figure which illustrates the display screen at the time of the audio | voice reproduction | regeneration mode which concerns on the embodiment. The figure which illustrates the display screen at the time of the audio | voice reproduction | regeneration mode which concerns on the embodiment. The flowchart which shows the processing content of the operation | movement at the time of the audio | voice recording mode which concerns on the 2nd Embodiment of this invention. The figure which illustrates the content of the marking management file produced at the time of recording of the audio | voice file which concerns on the embodiment. The flowchart which shows the processing content of the operation | movement at the time of the audio | voice reproduction | regeneration mode which concerns on the embodiment. The figure which illustrates the display screen at the time of the audio | voice reproduction | regeneration mode which concerns on the embodiment. The flowchart which shows the processing content of the automatic preparation operation | movement at the time of the audio | voice reproduction | regeneration mode which concerns on the 3rd Embodiment of this invention. The flowchart which shows the processing content of the automatic edit operation | movement at the time of the audio | voice reproduction | regeneration mode which concerns on the 4th Embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Digital camera, 11 ... Motor (M), 12 ... Shooting lens optical system, 13 ... CCD, 14 ... Timing generator (TG), 15 ... CCD driver, 16 ... AGC / SH circuit, 17 ... A / D conversion 18 ... color process circuit, 19 ... DMA controller, 20 ... DRAM interface (I / F), 21 ... DRAM, 22 ... control unit, 23 ... main memory, 24 ... display controller, 25 ... VRAM, 26 ... display 27, key input unit, 27a ... marking key A, 27b ... marking key B, 27c ... marking key C, 27d ... shooting key, 27e ... recording key, 27f ... playback key, 27g ... stop key, 27h, 27i ... Cursor key, 27j ... execution key, 28 ... image compression / decompression circuit, 29 ... memory card, 30 ... audio processing unit, 31 ... flat Interview driver, 32 ... USB interface (I / F), 33 ... microphone unit, 34 ... speaker, 35 ... flash unit, 36 ... USB terminal.

Claims (6)

Imaging means for image shooting of the subject,
First recording means for recording audio;
Display means for displaying an image of the subject imaged by the imaging means;
Setting means for setting an instruction for imaging an object by the imaging means for each of a plurality of types;
Based on the type of image capture command which is set by the setting means, the second recording for recording an image of the subject picked up by the image pickup means in association to the sound recorded by the first recording means Means,
First selection detection means for detecting selection of the type of image recorded in association with the second recording means ;
Display control means for displaying an image corresponding to the type selected is detected by the first selection detection means on the display means,
Second selection detecting means for detecting selection of a specific image from the images displayed by the display control means;
Reproduction means for reproducing the sound recorded by the first recording means from the position of the sound corresponding to the image whose selection is detected by the second selection detection means;
Speech processing apparatus characterized by comprising a. Imaging means for imaging a subject;
First recording means for recording audio;
Display means for displaying an image of the subject imaged by the imaging means;
Setting means for setting an instruction for imaging an object by the imaging means for each of a plurality of types;
Second recording that records a plurality of images of the subject imaged by the imaging unit in association with the audio recorded by the first recording unit based on the type of imaging instruction set by the setting unit Means,
First selection detection means for detecting selection of the type of image recorded in association with the second recording means;
Display control means for causing the display means to display a plurality of images corresponding to the types detected by the first selection detection means;
Second selection detection means for detecting a plurality of selections of a specific image from a plurality of images displayed by the display control means;
Reproduction means for continuously reproducing the sound recorded by the first recording means for each position of the sound corresponding to a specific image in which a plurality of selections are detected by the selection detection means;
Speech processing apparatus characterized by comprising a. Imaging means for imaging a subject;
First recording means for recording audio;
Display means for displaying an image of the subject imaged by the imaging means;
Setting means for setting an instruction for imaging an object by the imaging means for each of a plurality of types;
Second recording that records a plurality of images of the subject imaged by the imaging unit in association with the audio recorded by the first recording unit based on the type of imaging instruction set by the setting unit Means,
First selection detection means for detecting selection of the type of image recorded in association with the second recording means;
Display control means for causing the display means to display a plurality of images corresponding to the types detected by the first selection detection means;
Second selection detection means for detecting a plurality of selections of a specific image from a plurality of images displayed by the display control means;
A voice extractor means selected by the second selection detecting means extracts the position of a plurality of sounds corresponding to the specific image in which a plurality detected,
Editing means for editing a new sound file from the sound recorded in the first recording means based on the positions of the plurality of sounds extracted by the sound extracting means ;
Storage means for storing a new audio file edited by the editing means;
Speech processing apparatus characterized by comprising a. A computer of an audio reproduction device including an imaging unit that images a subject, a recording unit that records sound, and a display unit that displays an image of the subject captured by the imaging unit.
Setting means for setting an instruction for imaging an object by the imaging means for each of a plurality of types;
A recording control unit that records an image of the subject imaged by the imaging unit in association with the audio recorded by the recording unit based on the type of imaging instruction set by the setting unit;
First selection detection means for detecting selection of the type of image recorded in association with the recording control means;
Display control means for causing the display means to display an image corresponding to the type detected by the first selection detection means;
Second selection detecting means for detecting selection of a specific image from the images displayed by the display control means; and
Reproducing means for reproducing the sound recorded by the first recording means from the position of the sound corresponding to the image whose selection is detected by the second selection detecting means.
A program characterized by functioning as A computer of an audio reproduction device including an imaging unit that images a subject, a recording unit that records sound, and a display unit that displays an image of the subject captured by the imaging unit.
Setting means for setting an instruction for imaging an object by the imaging means for each of a plurality of types;
A recording control unit for recording a plurality of images of the subject imaged by the imaging unit in association with the audio recorded by the recording unit based on the type of imaging instruction set by the setting unit;
First selection detection means for detecting selection of the type of image recorded in association with the recording control means;
Display control means for causing the display means to display a plurality of images corresponding to the types whose selection has been detected by the first selection detecting means;
Second selection detecting means for detecting a plurality of selections of a specific image from the plurality of images displayed by the display control means; and
Playback means for continuously playing back the sound recorded by the first recording means for each position of the sound corresponding to a specific image when a plurality of selections are detected by the selection detecting means.
A program characterized by functioning as An audio editing apparatus comprising: an imaging unit that images a subject; a recording unit that records sound; and a display unit that displays an image of the subject captured by the imaging unit .
Setting means for setting an instruction for imaging an object by the imaging means for each of a plurality of types;
A second recording unit that records a plurality of images of the subject imaged by the imaging unit in association with the audio recorded by the recording unit based on the type of imaging instruction set by the setting unit;
First selection detection means for detecting selection of the type of image recorded in association with the second recording means;
Display control means for causing the display means to display a plurality of images corresponding to the types whose selection has been detected by the first selection detecting means;
A second selection detecting means for detecting a plurality of selections of a specific image from a plurality of images displayed by the display control means;
Voice extraction means for extracting the positions of a plurality of voices corresponding to a specific image for which a plurality of selections have been detected by the second selection detection means;
Editing means for editing a new sound file from the sound recorded in the recording means based on the positions of the plurality of sounds extracted by the sound extracting means; and
A program that functions as a storage unit that stores a new audio file edited by the editing unit .

Images