JP2002366179A - Information terminal device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to easily process audio data and easily know the processing contents of the audio data by generating and displaying image data corresponding to the kind and degree of processing of the audio data. SOLUTION: In an information terminal device 1, a CPU 11 makes 1st image data correspond to the audio data, processes the audio data according to the selected kind and degree of processing, puts together variation of image data made to correspond to the kind and degree of the processing or variation of the 2nd image data and the 1st image data together, and records the processed audio data while making them correspond to the composite image data. Further, the CPU 11 makes the 1st image data correspond to the audio data, analyzes the audio data, puts together the variation of the 1st image data corresponding to the analysis data or the 2nd image data and 1st image data, and records the audio data while making them correspond to the composite image data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information terminal device and a program for recording audio data in association with image data.

[0002]

2. Description of the Related Art In recent years, digitalization of music has progressed,
More and more users handle audio data on personal computers, including downloading music via the Internet. Conventionally, as a function of managing audio data, by associating the audio data with image data in which a note, a speaker, or the like is displayed, it is possible to visually distinguish the audio data on the screen of a personal computer, and Audio stamps that can reproduce audio data by simple operations such as clicking with a mouse are used.

[0003] Normally, a voice stamp is automatically associated with default image data at the time of recording and voice registration from a received mail, and the user has a function of changing this image data to another image data. . The image data is changed by the user selecting arbitrary image data via the input unit, and a musical note indicating that the selected image data is a voice stamp is synthesized.

[0004]

However, with the conventional voice stamp, although image data can be changed,
There is no function of performing processing such as changing the sound quality of existing audio data or changing image data according to the type and degree of processing. For this reason, it was not possible for the user to process the audio data as desired and to create an audio stamp capable of visually identifying the type and degree of the processing.

An object of the present invention is to create and display image data corresponding to the type and degree of processing of audio data, thereby enabling a user to easily process audio data and processing contents of the audio data. Is to be easily known.

[0006]

The present invention has the following features to solve the above-mentioned problems. In the following description of the means, a configuration corresponding to the embodiment is exemplified in parentheses. The reference numerals correspond to the reference numerals in the drawings described later.

According to the first aspect of the present invention, in an information terminal device (for example, the information terminal device 1 in FIG. 1) for recording audio data in association with image data, recorded audio data or recorded audio data Image selection means for selecting the first image data to be associated (for example, the input unit 12 for executing step S10 in FIG. 7), and a second image corresponding to the type of processing for processing the audio data By selecting data, processing type selection means (for example, input unit 12 for executing step S13 in FIG. 7) for selecting the type of processing, and processing type selected by the processing type selection means, Audio processing means for processing the recorded audio data or the recorded audio data (for example, a CP for executing step S14 in FIG. 7)
U11) and combined image recording means for recording image data obtained by combining the first image data and the second image data with the sound data processed by the sound processing means (for example, FIG. Step S16 to step S1
CPU 11 for causing storage device 17 to execute 8);
It is characterized by having.

According to the first aspect of the present invention, the recorded
Alternatively, the image data corresponding to the recorded audio data is selected from the list of displayed image data, and the second image data corresponding to the type of processing for processing the audio data is selected. Select the type.
Then, the audio data is processed according to the selected type of processing, and the processed audio data is recorded in association with the image data obtained by combining the first image data and the second image data. Therefore, the user can perform desired processing on the audio data, and by displaying image data corresponding to the type of processing, the user can easily know the processing content of the audio data.

According to the second aspect of the present invention, in the information terminal device (for example, the information terminal device 1 in FIG. 1) for recording the audio data in association with the image data, the recorded audio data or the recorded audio is recorded. First image selecting means for selecting first image data corresponding to data (for example, FIG.
An input unit 12) for executing step S30 of No. 5;
A processing type selection unit (for example, the input unit 12 for executing step S32 in FIG. 15) for selecting a processing type of the audio data, and a second processing type corresponding to the processing type selected by the processing type selection unit. A second image selecting means (for example, the input unit 12 for executing step S33 in FIG. 15) for selecting the image data, and a processing degree specifying means for specifying the processing degree of the audio data (for example, the step in FIG. 15) According to the input unit 12) for executing S34, the type of processing selected by the processing type selecting means, and the processing degree designated by the processing degree designating means, the recorded audio data or the recorded audio data is recorded. Voice processing means for processing voice data (for example, CPU 11 for executing step S35 in FIG. 15); and voice data processed by the voice processing means. , The step S3 of the first image data and the second synthesized image recording unit image data in association with synthesized image data is recorded (e.g., FIG. 15
And a CPU 11) for causing the storage device 17 to execute Steps 7 to S39.

According to the second aspect of the present invention, the recorded
Alternatively, image data corresponding to the recorded audio data is selected from the list of image data, a type of processing of the audio data is selected, and second image data corresponding to the selected processing type is selected. After the selection, the degree of processing of the audio data is designated. Then, the audio data is processed according to the selected type of processing and the specified processing degree, and the processed audio data is recorded in association with the image data obtained by combining the first image data and the second image data. . Therefore,
The user can perform desired processing on the audio data, and by displaying image data according to the type of processing, the user can easily know the processing content of the audio data.

According to a fourth aspect of the present invention, there is provided an information terminal device for recording audio data in association with image data (eg, the information terminal device 1 in FIG. 1). First image selecting means for selecting the first image data to be associated (for example, the input unit 12 for executing step S70 in FIG. 28), and a voice for analyzing the recorded voice data or the recorded voice data Analysis means (for example, CPU 11 for executing step S71 of FIG. 28) and image data corresponding to the type of processing determined based on the analysis result by the voice analysis means or new image data selected and designated; A second image selecting means for selecting as the second image data (for example, the input unit 12 for executing steps S73 to S75 in FIG. 28); The audio data being audio data or recording recorded sound, the said first image data a second
A composite image recording means (for example, step S76 in FIG. 28) for recording image data obtained by combining the image data of
C for causing the storage device 17 to execute Step S78
PU11).

According to the fourth aspect of the present invention, the recorded
Alternatively, image data to be associated with the audio data that was recorded is selected from the list of image data, and the audio data is analyzed, and the image data corresponding to the processing type determined based on the analysis result, or The selected and designated new image data is selected as the second image data, and the audio data is recorded in association with the image data obtained by combining the first image data and the second image data. Therefore, the contents of the audio data can be visually identified, and as a result, the user can grasp the processing contents of the audio data at a glance. Therefore, the contents of the audio data can be visually identified, and as a result, the user can grasp the processing contents of the audio data at a glance.

[0013]

Embodiments of the present invention will be described below in detail with reference to the drawings.

[First Embodiment] First, the configuration will be described. FIG. 1 is a diagram illustrating an overall configuration of an information terminal device 1 according to the present embodiment. As shown in FIG. 1, the information terminal device 1 includes a CPU 11, an input unit 12, a RAM 13, a transmission control unit 14, a VRAM 15, a display unit 16, a storage device 17 having a recording medium 17a, a speaker 18a, and a voice including a microphone 18b. The recording medium 17a
Each part except for is a computer connected by a bus 19.

CPU (Central Processing Unit) 11
Reads out various control programs stored in the recording medium 17a of the storage device 17, expands them into a work memory formed in the RAM 13, and centrally controls the operation of each unit according to the control programs. In addition, the CPU 11
In accordance with the control program developed in the work memory in the RAM 13, an audio stamp creation process A described later is executed, and the processing result is stored in the work memory in the RAM 13 and displayed on the display unit 16. Then, the processing result stored in the work memory is stored in a predetermined storage destination in the storage device 17 or the recording medium 17a.

That is, when executing the voice stamp creation processing A, the CPU 11 starts recording and creates voice data for creating a voice stamp when a voice recording instruction is given. If there is no recording instruction, a list of previously recorded voice data is displayed, and the voice data selected from the list is recognized as voice data for creating a voice stamp. Then, a list of image data is displayed, and image data corresponding to the recorded or selected audio data is selected. After the selection of the image data, when a voice data processing instruction is given, a list of composite marks indicating the type and degree of processing is displayed, and a processing corresponding to the selected composite mark is performed on the audio data. And
The selected image data is combined with the combined mark, and the combined image is associated with the processed audio data, and an audio stamp is set and registered. If there is no instruction of audio data processing,
An audio stamp is set and registered by associating the selected image data with the recorded or selected audio data.

The input unit 12 includes a keyboard having character / alphanumeric input keys, a cursor key, various function keys, and the like, and a mouse as a pointing device. The CPU 1 receives a pressing signal and an operation signal from a mouse as input signals.
Output to 1. Alternatively, the input unit 12 is configured by a touch panel that outputs position information input by touching a transparent sheet panel covering the display screen of the display unit 16 with a finger or a dedicated touch pen to the CPU 11 as an input signal.

A RAM (Random Access Memory) 13
In the various processes executed and controlled by the CPU 11, a system program, a control program, input or output data, parameters, and the like that can be executed by the information terminal device 1 and that are read from the storage device 17 are temporarily stored.

The transmission control unit 14 includes a router and a TA (Termin
al Adapter), dedicated line, or IS
It controls communication with other terminals connected to the network via a communication line such as a DN (Integrated Service Digital Network) line. When the information terminal device 1 is a LAN,
Is a device for connecting to an external LAN, and the TA uses an existing interface to communicate with an external device via an ISDN line.
This is a device for converting to an interface corresponding to.

The VRAM 15 temporarily stores image data to be displayed on the display unit 16 in accordance with a display instruction from the CPU 11. The display 16 is an LCD (Liquid Crystal).
Display), a CRT (Cathode Ray Tube), or the like, and on the display screen, an audio data file selection screen 1001, an image data selection screen 1002, and a composite mark selection screen 1003, which will be described later, in accordance with a display signal input from the CPU 11. , A voice stamp setting screen 1004 and the like are displayed.

The storage device 17 has a recording medium 17a in which programs and data are stored in advance.
Reference numeral 7a denotes a magnetic or optical recording medium or a nonvolatile memory such as a semiconductor. The recording medium 17a is fixedly provided in the storage device 17, or is removably mounted. The recording medium 17a has a system program corresponding to the information terminal device 1 and an executable program on the system program. Various processing programs such as a voice stamp creation process A, and data processed by these programs are stored. Each of these processing programs is stored in the form of a readable program code,
U11 sequentially executes the operation according to the program code.

In the present embodiment, the storage device 17
As shown in FIG. 2, it is configured to internally include an audio data file 171, an image data file 172, an audio stamp registration information file (1) 173, and a combined mark file 174. Hereinafter, the data structure in each of these files will be described in detail with reference to FIGS.

FIG. 3 is a diagram showing an example of data storage in an audio data file 171 for storing recorded audio data. As shown in FIG. 3, the audio data file 171 includes identification codes (for example, “yama.def”, “kawa.def”, “umi.de”) uniquely assigned to identify the audio data.
..) as “audio data names” and recorded or existing audio data (eg, “audio 1”, “audio 2”, “audio 3”).
..) As audio data
71b.

FIG. 4 is a diagram showing an example of data storage in an image data file 172 for storing image data. FIG.
As shown in FIG. 7, the image data file 172 includes identification codes (for example, “speaker.ghi”, “house.ghi”, “maru.gh”) uniquely assigned to specify the image data.
..) as “image data names” and registered or existing image data (eg, “image 1”, “image 2”, “image 3”).
…) Is stored as “image data” in the image data area 1
72b.

FIG. 5 shows an audio stamp registration information file (1) 173 for storing information necessary for audio stamp registration.
FIG. 6 is a diagram showing an example of data storage in the storage device. As shown in FIG. 5, the voice stamp registration information file (1) 173 includes identification codes (for example, “onsei.abc”, “onsei1.abc”, “onsei1.abc”) uniquely assigned to specify the voice stamp.
2.abc ”,...) As a“ file name ”and an identification code (for example,“ yama. def ”,“ kawa.def ”,
An audio data name area 173b storing “umi.def”,...) As an “audio data name” and an identification code (for example, uniquely assigned to identify the image data registered in the audio stamp) “Speaker.ghi”, “house.g
hi ”,“ maru.ghi ”,...) as“ image data names ”, and character string data (for example,“ volume ”,“ volume ”,“ volume ”) indicating the type of processing performed on the audio data. “Pitch”, “sound quality”,…) to “type of processing”
And a numerical data (for example, a processing type area 173d) representing the processing degree applied to the audio data.
A processing degree area 173e for storing “1”, “2”, “4”,...) As “processing degree”, and date data (eg, “01.03.10”, “ 0
1.03.09 ”,“ 01.02.10 ”,...) As a“ registration date ”and data indicating the time at which the voice stamp was registered (for example,“ 15:01 ”,“ 14: Five
8 ”,“ 12:00 ”,...) As“ registration time ”. The “type of processing” and “degree of processing” are blank if the voice data is not processed when the voice stamp is created.

FIG. 6 is a diagram showing an example of data storage in a combined mark file 174 for storing a combined mark associated with the type and degree of processing of audio data. As shown in FIG. 6, the composite mark file 174 stores character string data (for example, “volume”,.
, A processing degree area 174b storing numerical data (for example, “1”, “2”, “3”,...) As the processing degree, and a composite mark image And a composite mark data area 174c for storing data (for example, “note 1”, “note 2”, “note 3”,...) As “composite mark data”.

The audio processing unit 18 comprises an analog / digital converter, an amplifier and the like, and includes a speaker 18a and a microphone 18b. The audio processing unit 18 converts the audio data stored in the storage device 17 into an analog signal by a converter, and outputs the analog signal to the outside from the speaker 18a via the amplifier. The audio processing unit 18 converts an audio signal input from the microphone 18b or the like into a digital signal using a converter,
The voice data is stored in the voice data file 171 as voice data.

Next, the operation will be described. The voice stamp creation process A executed by the information terminal device 1 will be described with reference to the flowchart in FIG. As a premise of the description of the operation, a program for realizing each function described in the following flowchart is stored in a recording medium 17a in the form of a readable program code, and C
The PU 11 sequentially executes an operation according to the program code. Further, the CPU 11 can also sequentially execute an operation according to the above-described program code transmitted via the transmission medium. That is, an operation unique to the present embodiment can be executed using a program or data externally supplied via a transmission medium in addition to the recording medium 17a.

First, when a signal instructing creation of a voice stamp is input from the input unit 12 (step S1), the CPU 11 determines whether to create voice data by recording or to use existing voice data. A selection screen is displayed (step S2). When recording is selected (step S3;
Y), the CPU 11 starts recording via the audio processing unit 18 (step S4), and ends the recording (step S4).
5; Y), an audio data file is created, and the audio data file is recognized as audio data for creating an audio stamp (step S6). On the other hand, when the use of the existing voice data is selected (step S3; N), C
The PU 11 displays a list of the audio data files 171 stored in the storage device 17 (step S7), and when the audio data is selected, recognizes the audio data as audio data for creating an audio stamp. (Step S8).

FIG. 8 is a diagram showing an example of an audio data file selection screen 1001 showing a list of audio data files 171 displayed on the display unit 16 in step S7. FIG.
As shown in the figure, the audio data file selection screen 1001
An instruction message to the user such as "Please select audio data" is displayed, and a list of audio data files is displayed below. The user selects the audio data by moving the cursor to a file name corresponding to a desired file from among the audio data files displayed in the list and designating a selection button.

Next, the CPU 11 displays the image data of the image data file 172 stored in the storage device 17 (step S9). When image data corresponding to the audio data is selected from the display list (step S10), the CPU 11 causes the display unit 16 to display a selection screen as to whether or not to process the audio data. When processing is selected (step S11; Y), the storage device 1
A list of the combined marks of the combined mark file 174 stored in the storage unit 7 and the types of processing corresponding to the combined marks is displayed (step S12).

When a composite mark is selected (step S1)
3), the CPU 11 performs a processing corresponding to the composite mark on the audio data (step S14). When the processing of the audio data is completed, the CPU 11 combines the combined mark and the image data (step S1).
5) Associating the audio data with the synthesized image (step S16), setting and registering an audio stamp, and terminating a series of audio stamp creation processing A (step S1).
8).

FIG. 9 shows an example of an image data selection screen 1002 showing a list of images of the image data file 172 displayed on the display unit 16 in step S9. As shown in FIG. 9, on the image data selection screen 1002, an instruction message to the user such as "Please select an image of the voice stamp" is displayed, and the content of the image data is displayed below the instruction message. The user selects image data by moving the cursor to a desired image from the images displayed in the list and designating a selection button. Image data selection screen 100
2 indicates that a speaker image such as the image data (a) is selected.

FIGS. 10 and 11 show that when the processing of the audio data is selected in step S11, the audio data is processed in steps S12 to S18 and displayed on the display unit 16 in the process of setting and registering the audio stamp. It is an example of a screen to be displayed.

FIG. 10 shows an example of a composite mark selection screen 1003 showing a list of composite mark files 174 displayed on the display unit 16 in step S13. As shown in FIG. 10, an instruction message to the user such as “Please select an image of the sound effect” is displayed on the composite mark selection screen 1003, and a composite mark corresponding to the type of audio data processing is displayed below the instruction message. Is displayed. The user selects the type of audio data processing by moving the cursor to the composite mark corresponding to the type of audio data processing desired from the displayed composite marks. The composite mark selection screen 1003 indicates that the lightest note that is the composite mark corresponding to the type of processing indicating that the volume is to be minimized has been selected.

FIG. 11 is a diagram showing an example of the voice stamp setting screen 1004 displayed on the display unit 16 in step S18. The voice stamp setting screen 1004 displays a voice stamp in which the image (here, the speaker) selected in FIG. 9 and the synthesis mark (here, the lightest note) selected in FIG. 10 are synthesized. . When an operation of selecting a registration button instructed at the bottom of the screen is performed, the displayed voice stamp is registered (recorded).

The image indicating the type of processing of the audio data is a synthetic mark such as a musical note here, but may be a picture frame or the like. That is, a frame may be added to the image data selected in FIG. 9, and the type of processing may be distinguished by the shape, pattern, color, or the like of the frame. In this case, it is of course possible to use a combination mark such as a musical note together with a frame.

On the other hand, if there is an instruction not to process the audio data in step S11 (step S1).
1; N), the CPU 11 associates the audio data with the image data (step S17), sets and registers an audio stamp, and ends a series of audio stamp creation processing A (step S18).

FIG. 12 shows an example of an audio stamp setting screen 1005 displayed on the display unit 16 in step S18 when a speaker image is selected in step S9 and no audio data processing is selected in step S11. FIG. When a registration button selection operation indicated at the bottom of the screen is performed, the displayed voice stamp is registered.

As described above, according to the information terminal device 1, an audio stamp is created and registered by associating audio data with desired image data. The audio data can be processed, and in the case of processing, the audio data is processed by selecting a composite mark corresponding to the type of the audio data processing, and an image obtained by synthesizing the composite mark and the image data is processed as a voice. Set as a stamp. As a result, the user can easily process the audio data, and the type of the processing can be easily known from the image of the set audio stamp.

The description in the first embodiment is a preferred example of the information terminal device 1 according to the present invention, and the present invention is not limited to this. For example, in the above-described embodiment, after the audio data file 171 recorded in step S6 is created, the process of creating an audio stamp continues. However, the recorded and created audio data file 171 is stored and stored at a later date. You can also create audio stamps. Alternatively, the type of audio data processing may be determined in advance and then recorded, and the recorded audio data may be automatically processed to create an audio stamp.

Further, according to the above-described embodiment, the image data is synthesized immediately after the audio data processing in step S14.
If the voice that matches the user's preference is not output, the process returns to the step of displaying the composite mark list in step S12, and the processes in steps S12 to S14 are repeated until the voice processing that matches the preference is performed. Good.

[Second Embodiment] Hereinafter, as an application example of the first embodiment, a type and a degree of processing of audio data are specified, and the audio data is processed based on the specification.
Depending on the processed audio data, the size of the image data,
What changed the brightness etc. (hereinafter, "image effect"
It is written. An embodiment utilizing ()) will be described in detail. Since the configuration of the information terminal device 1 in the present embodiment is the same as that of the above-described first embodiment, the same reference numerals are given to the components, and the illustration and description of the configuration are omitted. .

However, the storage device 17 of the information terminal device 1
As shown in FIG.
1, an image data file 172 and an audio stamp registration information file (2) 175. Since the audio stamp registration information file (2) 175 is a component unique to the present embodiment, it will be described in detail below. explain.

FIG. 14 is a diagram showing an example of data storage in the voice stamp registration information file (2) 175 for storing information necessary for voice stamp registration in voice stamp creation processing B described later. As shown in FIG. 15, the voice stamp registration information file (2) 175 has a file name area 1
75a, an audio data name area 175b, an image data name area 175c, a processing type area 175d, a processing degree area 175e, image effect information 175f, a registration date area 175g, and a registration time area 175h. Is done.

The file name area 175a contains identification codes (eg, “onsei.abc”, “onsei1.abc”, “onsei2.abc”) uniquely assigned to specify the voice stamp.
abc ”,…) is stored as the“ file name ”. The audio data name area 175b includes an identification code (for example, “yama.def”, “kawa.def”, “yama.def”) uniquely assigned to identify the audio data registered in the audio stamp.
“Umi.def”,...) Are stored as “audio data names”. The image data name area 175c includes identification codes (for example, “speaker.ghi”, “hous”) uniquely assigned to specify the image data registered in the voice stamp.
e.ghi ”,“ maru.ghi ”,...) are stored as“ image data names ”.

The processing type area 175d contains character string data (for example, character string data indicating the type of processing performed on the audio data.
“Volume”, “sound quality”,...) Are stored as “type of processing”. The processing degree area 175e includes numerical data (for example, “1”, “4”,
..) Are stored as “degree of processing”. The image effect information 175f includes symbol data (for example, “a”, “b”,...) For identifying information that associates how an image is changed depending on the type and degree of processing of audio data. Information ”. Note that the “type of processing”, “degree of processing”, and “image effect information” are blank as in the second record from the top if audio data is not processed when the audio stamp is created.

The registration date area 175g stores date data (eg, "01.03.1
0 ”,“ 01.03.09 ”,“ 01.02.10 ”,…)
Stored as The registration time area 175h contains data indicating the time at which the voice stamp was registered (for example, “15: 0”).
1), “14:58”, “12:00”,...) Are stored as “registration time”.

Next, the operation will be described. The voice stamp creation process B executed by the information terminal device 1 will be described with reference to the flowchart in FIG. First, the CPU 11
When a signal instructing creation of a voice stamp is input from the input unit 12 (step S21), a selection screen is displayed for selecting whether to create voice data by recording or to use existing voice data (step S21). Step S22). When the recording is selected (Step S23; Y), the CPU 11 starts recording by the audio processing unit 18 (Step S24), and when the recording is completed (Step S25; Y), creates a voice data file and generates the voice data. The data file is recognized as audio data for creating an audio stamp (step S26).

On the other hand, when the use of the existing voice data is selected (step S23; N), the CPU 11 displays a list of the voice data files 171 stored in the storage device 17 (step S27), and Is selected, the voice data is recognized as voice data for creating a voice stamp (step S28).

Next, the CPU 11 displays the image data of the image data file 172 stored in the storage device 17 (step S29). When image data corresponding to the audio data is selected from the display list (step S30), the CPU 11 displays a selection screen as to whether or not to process the audio data. When processing is selected (step S31; Y), the CPU 11 displays a selection screen listing types of processing.

When the type of processing is selected (step S3)
2), the CPU 11 displays the above-described image effect list screen on the display unit 16 and associates the selected image effect with the type of audio data processing (step S).
33).

Next, the CPU 11 displays a screen for inputting the degree of processing on the display unit 16 and, when the degree of processing is input (step S34), processes the voice data according to the input degree of processing (step S35). After processing the audio data, the CPU 11 changes the image data according to the image effect selected in step S33 (step S3).
6) The audio data is associated with the changed image data (step S37), an audio stamp is set and registered, and a series of audio stamp creation processing B is completed (step S39).

FIG. 16 to FIG.
21 is an example of a display screen showing a process of setting and registering an audio stamp in steps S32 to S39 when the processing of audio data is selected in 31.

FIG. 16 shows a processing type selection screen 100 to be applied to the audio data displayed on the display unit 16 in step S32.
6 is a diagram showing an example of No. 6. FIG. As shown in FIG. 16, on the processing type selection screen 1006, an instruction message to the user such as "Please select the processing type of audio data" is displayed, and the processing type of audio data is displayed below the instruction message. Is done. The user selects the type of audio data processing by moving the cursor to the type of processing to be performed on the audio data from among the types of audio data processing displayed in the list. On the processing type selection screen 1006,
The state in which the volume change is selected is shown.

FIG. 17 shows an image effect selection screen 1007 displayed on the display unit 16 in step S33 and corresponding to the type of audio data processing selected in step S32.
It is a figure showing the example of. As shown in FIG. 17, on the image effect selection screen 1007, an instruction message to the user such as "Please select an image effect corresponding to a change in volume" is displayed, and below that, a change in image data due to the image effect is displayed. Is displayed. The user selects an image effect corresponding to the type of audio data processing by moving the cursor to a desired image effect from among the image effects displayed in the list. The image effect selection screen 1007 shows a state where the volume change and the image size are associated with each other.

FIGS. 18 to 21 show examples of the processing degree input screen displayed on the display unit 16 in step S34. FIG.
FIG. 8 is a diagram showing an example of the processing degree input screen 1008 displayed when the volume is selected as the processing type in step S32 and the change of the image size of the image data is selected as the image effect in step S33. As shown in FIG. 18, an instruction message to the user such as "Please enter the degree of processing" is displayed on the degree of processing input screen 1008.
Below that, the image size of the image data selected in step S30 is displayed in association with the audio data processing degree,
An area 1008a below which a numerical value of the degree of processing can be input.
Is provided. The user specifies the degree of processing by inputting a numerical value in the area 1008a. When the operation of designating the decision button instructed at the bottom of the screen is performed, the input processing degree is set.

FIG. 19 is a diagram showing an example of the processing degree input screen 1009 displayed when the volume is selected as the processing type in step S32 and the size change of the composite mark is selected as the image effect in step S33. is there. As shown in FIG. 19, on the processing degree input screen 1009, an instruction message to the user such as "Please input the processing degree" is displayed. Below this, the size of the note as a composite mark is displayed in association with the degree of processing of the audio data, and below that is provided an area 1009a in which the degree of processing can be entered numerically. The user specifies the degree of processing by inputting a numerical value in the area 1009a. When the operation of designating the decision button instructed at the bottom of the screen is performed, the input processing degree is set.

FIG. 20 shows an example of the processing degree input screen 1010 displayed when the sound quality is selected as the processing type in step S32 and the change of the brightness of the image data is selected as the image effect in step S33. FIG.
As shown in FIG. 20, an instruction message to the user such as “Please enter the degree of processing” is displayed on the degree of processing input screen 1010. Below that, the brightness of the image of the image data selected in step S30 is displayed in association with the degree of processing of the audio data, and further below that, there is provided an area 1010a in which the degree of processing can be input as a numerical value. . The user is in area 1
The degree of processing is designated by inputting a numerical value to 010a. When the operation of designating the enter button instructed at the bottom of the screen is performed, the input processing degree is set.

FIG. 21 shows a processing degree input screen 1011 displayed when the tone pitch is selected as the processing type in step S32 and the change of the brightness of the composite mark is selected as the image effect in step S33. It is a figure showing an example. As shown in FIG. 21, the processing input screen 1011 is
An instruction message to the user, such as "Please enter the degree of processing," is displayed. Below that, the brightness of the note as a composite mark is displayed in association with the degree of processing of the audio data, and further below that, there is provided an area 1011a in which the degree of processing can be entered in numerical values. The user specifies the degree of processing by inputting a numerical value into the area 1011a. When the operation of designating the enter button indicated at the bottom of the screen is performed, the input processing degree is set.

FIG. 22 is a diagram showing an example of the voice stamp setting screen 1012 displayed on the display unit 16 in step S39. On the audio stamp setting screen 1012, the image (here, the speaker) selected in FIG. 9 is displayed with the type of audio data processing (here, volume) selected in FIG. 16 and the processing degree input in FIG. A sound stamp created by applying a corresponding image effect (here, the size of the image) is displayed. When the “registration” operation indicated at the bottom of the screen is performed, the displayed voice stamp is registered (recorded).

On the other hand, if there is an instruction not to process the audio data in step S31 (step S31;
N), the CPU 11 associates the audio data with the image data (step S38), sets and registers an audio stamp, and ends a series of audio stamp creation processing B (step S39).

FIG. 12 exemplifies an audio stamp setting screen 1005 displayed on the display section 16 in step S39 when an image of a speaker is selected in step S29 and when no processing of audio data is selected in step S31. FIG. When the “registration” operation indicated at the bottom of the screen is performed, the voice stamp of the displayed “onsei1.abc” file name is registered (recorded).

As described above, according to the information terminal device 1, an audio stamp is created and registered in association with audio data and desired image data. Audio data can be processed, and in the case of processing, the user specifies the type of processing and the degree of processing, processes the audio data simply by selecting a desired image effect, and processes and processes the audio data. An image effect corresponding to the degree is applied to the image data and set as an audio stamp. Thus, the user can easily process the audio data, and can easily know the processing content from the image of the set audio stamp.

The description in the second embodiment is a preferred example of the information terminal device 1 according to the present invention, and the present invention is not limited to this. For example, in the above-described embodiment, after the audio data file 171 recorded in step S26 is created, the process of creating an audio stamp continues. However, the recorded and created audio data file 171 is stored and stored at a later date. You can also create audio stamps. Alternatively, the type and degree of processing of the audio data may be determined in advance and then recorded, and the recorded audio data may be automatically processed to create an audio stamp.

Further, the image data is synthesized immediately after the voice data processing in step S35. If the processed voice data is output, and if the voice that meets the user's preference is not output, the process proceeds to step S33. The process returns to the step of selecting the image effect corresponding to the processing of step S33 to step S3 until the sound processing suitable for the taste is performed.
5 may be repeated.

[Third Embodiment] Hereinafter, as an application example of each of the above embodiments, an embodiment for switching the processing degree of a registered voice stamp when the registered voice stamp is displayed. It will be described in detail. Since the configuration of the information terminal device 1 in the present embodiment is the same as that of the above-described first embodiment, the same reference numerals are given to the components, and the illustration and description of the configuration are omitted. .

The operation will be described below. The processing degree change processing executed by the information terminal device 1 will be described with reference to the flowchart in FIG. It should be noted that whether the audio stamp used here is the one registered in the first embodiment or the one registered in the second embodiment, the processing degree change processing can be performed. Yes, but here,
An operation of switching the processing degree for the voice stamp registered in the first embodiment will be described.

First, when a signal instructing display of a specific voice stamp is input from the input unit 12, the CPU 11 causes the display unit 16 to display a voice stamp (step S41). Then, when an instruction to change the processing degree of the voice stamp is input (step S42; Y), C
The PU 11 determines whether or not the voice stamp has been processed, and if it determines that the voice stamp has been processed (Step S43; Y), the voice stamp registration information file (1) 173 of the storage device 17 (FIG. 2). (Refer to step S44). And CP
U11 outputs a sound each time an instruction to change the processing degree is given to the sound stamp (step S45). The instruction to change the processing degree is given, for example, by an operation of placing the mouse pointer on the voice stamp and clicking once.

Then, the CPU 11 switches and displays the voice stamp screen according to the processing degree of the output voice data (step S46). When the processing is completed (step S47; N), it is confirmed whether or not the voice stamp is to be registered. When there is a registration instruction (step S48; Y), the voice stamp is newly registered and a series of processing degree change processing is performed. Is ended (step S49).

FIGS. 24 and 25 show how the degree of processing of audio data is changed by an operation such as clicking with a mouse in step S45, and the image data is switched in accordance with the change in degree of processing in step S46. . FIG.
Fig. 8 shows a state in which the processing degree of the audio stamp is switched by a composite image of the image data set and registered in the first embodiment and a composite mark corresponding to the type of processing of the audio data. FIG. 25 illustrates a state of switching the processing degree of an audio stamp in which an image effect corresponding to the type of processing of audio data has been applied to image data set and registered in the second embodiment.

On the other hand, if it is not instructed in step S42 to change the processing degree of the voice stamp (step S4).
2; N), and output audio data (step S50).
If the audio data has not been processed (step S
43; N), perform the processing of steps S12 to S18 of the above-described voice stamp creation processing A (see FIG. 7),
Create an audio stamp by processing audio data.

As described above, according to the information terminal device 1, the processing degree of the voice data registered in the voice stamp is switched and output by a simple operation such as clicking the image of the registered voice stamp. The image of the voice stamp is also changed and displayed in accordance with the output. Then, when there is a registration instruction, the voice stamp is registered. Thus, the user can easily switch the processing degree of the audio data registered in the audio stamp.

The description in each of the above embodiments is a preferred example of the information terminal device according to the present invention, and the present invention is not limited to this. For example, in the above embodiment, the processing for switching the processing degree of the audio data in the audio stamp registered in the first embodiment is performed. However, in the audio stamp registered in the second embodiment, If the CPU 11 determines in step S44 that the voice stamp has not been processed, steps S32 to S32 of the voice stamp creation processing B (see FIG. 15) will be described.
The process of step S39 may be performed.

[Fourth Embodiment] As an application example of each of the above embodiments, audio data is analyzed, the type of processing is determined from the analysis result, and the image is displayed in correspondence with the analysis result and the type of processing. An embodiment for synthesizing data will be described in detail.
The configuration of the information terminal device 1 in the present embodiment is as follows.
Since the configuration is the same as that of the first embodiment described above, the same reference numerals are given to the respective components, and the illustration and description of the configuration are omitted.

However, the audio processing unit 18 of the information terminal device 1
Analyzes voice data input by the microphone 18b or the like. Also, an audio data file 171, an image data file 172, and the like shown in FIG.
It is configured to have a voice analysis stamp registration information file 176, and has a voice analysis stamp registration information file 176.
Are components specific to the present embodiment, and will be described in detail below.

As shown in FIG. 27, the audio analysis stamp registration information file 176 includes a file name area 176a, an audio data name area 176b, and an image data name area 176c.
, An analysis result area 176d, a registration date area 176e,
And a registration time area 176f.

The file name area 176a contains identification codes (eg, “onsei.abc”, “onsei1.abc”, “onsei1.abc”) uniquely assigned to specify the voice analysis stamp.
2.abc ”,…) is stored as the“ file name ”. The audio data name area 176b contains identification codes (eg, “yama.def”, “kawa.de”) uniquely assigned to identify the audio data registered in the audio stamp.
f ”,“ umi.def ”,...) are stored as“ audio data names ”. The image data name area 176c stores identification codes (eg, “speaker.ghi”, “h”) uniquely assigned to specify the image data registered in the voice stamp.
ouse.ghi ”,“ maru.ghi ”,...) are stored as“ image data names ”.

The analysis result area 176d stores character string data (for example, “human voice”, “musical instrument”...) For representing the analysis result of the voice data as “analysis result”. The registration date area 176e contains date data (eg, "01.03.10", "01.03.0
9 ”,“ 01.02.10 ”,...) Are stored as“ registration date ”. The registration time area 176f contains data (eg, “15:01”, “14: 5”) indicating the time at which the voice stamp was registered.
8 ”,“ 12:00 ”,...) Are stored as“ registration time ”.

The operation will be described below. FIG. 2 shows a speech analysis stamp creation process executed by the information terminal device 1.
This will be described with reference to the flowchart of FIG.

First, when a signal instructing creation of a voice analysis stamp is input from the input unit 12 (step S61), the CPU 11 determines whether to record and create voice data or to use existing voice data. Is displayed (step S62). When recording is selected (Step S63; Y), the CPU 11 starts recording by the audio processing unit 18 (Step S64). When recording is completed (Step S65; Y), the CPU 11 creates an audio data file and creates the audio data file. The data file is recognized as audio data for creating an audio analysis stamp (step S6).
6). On the other hand, when the use of the existing voice data is selected (step S63; N), the CPU 11
Is displayed (step S67), and when audio data is selected, a list of audio data files 171 is displayed.
The voice data is recognized as voice data for creating a voice analysis stamp (step S68).

Next, the CPU 11 displays the image data of the image data file 172 stored in the storage device 17 (step S69). When the image data corresponding to the audio data is selected from the display list (step S70), the CPU 11 analyzes the audio data (step S71), and displays the analysis result on the display unit 16 (step S72). ).

FIG. 29 is an example of a voice data analysis result display screen 1013 displayed on the display unit 16 in step S72 and displaying the voice data analysis result. On the screen,
"Analysis of voice data" is displayed, and below that, the analysis result is shown to the user with characters such as "Result of voice data analysis, human voice is included", and according to the analysis result Display the analysis composite image.

FIG. 30 shows an analysis / combined image list display screen 1014 displaying a list of the correspondence between the analysis / combined image and the analysis result.
It is a figure showing the example of. By a predetermined input operation, the user can freely switch and display the analysis and synthesis image on the analysis and synthesis image list display screen 1014 to check the correspondence between the image and the analysis result.

Returning to FIG. 28, after displaying the analysis result,
The CPU 11 causes the display unit 16 to display a selection screen as to whether or not to select an analysis and synthesis image. When the user gives an instruction to select an analysis composite image (step S73; Y),
The CPU 11 displays a list of the analysis / synthesized image change selection screen 1015 shown in FIG. 31 (step S74). next,
The user selects a desired analysis composite image corresponding to the analysis result from the analysis composite images on the analysis composite image change selection screen 1015 (step S75). And CPU
11 combines the image data selected in step S70 with the analysis-combined image selected in step S75 according to the analysis result (step S76), and associates the combined image with the audio data file (step S77); The setting is registered as a voice analysis stamp (step S78).

FIG. 31 is a diagram showing an example of an analysis / combined image change selection screen 1015 showing candidates for changing the analysis / combined image displayed on the display unit 16 in step S74. As shown in FIG. 31, on the analysis / combined image change selection screen 1015, an instruction message to the user such as “Please select an image” is displayed, and below that, a list of analysis / combined image selection candidates is displayed. . The user selects the image data by moving the cursor to a desired image from the list of analysis and synthesis image selection candidates and designating a selection button.

On the other hand, in step S73, if the user instructs not to select an analysis / combined image (step S73; N), the CPU 11 determines the correspondence between the analysis / combined image and the analysis result as shown in FIG. Then, the analysis and synthesis image corresponding to the analysis result in step S71 is automatically selected, and the analysis and synthesis image is synthesized with the image data selected in step S70 (step S76). Then, the CPU 11 associates the synthesized image with the audio data file (step S77), and sets and registers it as an audio analysis stamp (step S78).

As described above, according to the information terminal device 1, the content of the audio data is analyzed, and the synthesized image and the image data corresponding to the analysis result are synthesized and associated with the audio data, whereby the audio analysis is performed. Set and register (record) a stamp. Thus, the user can easily grasp the contents of the audio data.

The description in each of the above embodiments is a preferred example of the information terminal device 1 according to the present invention.
It is not limited to this. For example, regarding the voice analysis stamp registered according to the above embodiment, the third
In this embodiment, the degree of processing can be switched.

In the above-described first to fourth embodiments, the functions other than the third embodiment can be realized as independent functions. However, each of the embodiments can be realized as a function in one application. Can be selected by the user, the variation of processing can be increased, and the user interface can be improved. In addition, the detailed configuration and the detailed operation of the information terminal device 1 can be appropriately changed without departing from the spirit of the present invention.

[0091]

According to the first aspect of the present invention, image data corresponding to recorded or recorded audio data is selected from a list of image data,
The type of processing is selected by selecting the second image data corresponding to the type of processing for processing the audio data. Then, the audio data is processed according to the selected type of processing, and the processed audio data is recorded in association with the image data obtained by combining the first image data and the second image data. Therefore, the user can perform desired processing on the audio data, and by displaying image data corresponding to the type of processing, the user can easily know the processing content of the audio data.

According to the second aspect of the present invention, the recorded
Alternatively, image data to be associated with the recorded audio data is selected from the list of image data, a processing type of the audio data is selected, and the second image data corresponding to the selected processing type is selected. After the selection, the degree of processing of the audio data is designated. Then, the audio data is processed according to the selected type of processing and the specified processing degree, and the processed audio data is recorded in association with the image data obtained by combining the first image data and the second image data. . Therefore,
The user can process the audio data as desired, and more easily know the processing details of the audio data by changing and displaying not only the type of processing but also the image data according to the processing degree. Will be able to do it.

According to the third aspect of the present invention, image data associated with the recorded audio data is displayed, and image data for switching the processing degree is selected from the displayed image data. Each time is selected, the processing degree of the audio data corresponding to the image data is switched and output, and the image data is switched in accordance with the changed processing degree. Therefore, the processing of the audio data can be switched by performing a simple operation on the image data associated with the already recorded audio data, and the user can easily perform the processing of the audio data as desired. .

According to the fourth aspect of the present invention, the recorded
Alternatively, image data to be associated with the audio data that was recorded is selected from the list of image data, and the audio data is analyzed, and the image data corresponding to the processing type determined based on the analysis result, or The selected and designated new image data is selected as the second image data, and the audio data is recorded in association with the image data obtained by combining the first image data and the second image data. Therefore, the contents of the audio data can be visually identified, and as a result, the user can grasp the processing contents of the audio data at a glance.

According to the fifth aspect of the present invention, the recorded
Alternatively, the image data corresponding to the recorded audio data is selected from the list of image data, and the second image data corresponding to the type of processing for processing the audio data is selected. And a program for processing the audio data according to the selected processing type, and recording the processed audio data in association with the image data obtained by combining the first image data and the second image data. The functions described in claim 1 can be realized by causing a computer to read them. Therefore, sales and distribution as a single software product independent of the system are also facilitated. Also, by executing the program using hardware resources such as a general-purpose computer,
The technique of the present invention can be easily implemented on hardware.

According to the sixth aspect of the present invention, the recorded
Alternatively, the user selects image data corresponding to the recorded audio data from the list of image data, and selects a type of audio data processing and a second image data corresponding to the selected processing type. Processing the audio data in accordance with the type and degree of processing by designating the degree of processing of the audio data, and associating the processed audio data with the image data obtained by combining the first image data and the second image data. The functions described in claim 2 can be realized by causing a computer to read a program to be attached and recorded. Therefore, sales and distribution as a single software product independent of the system are also facilitated. Further, by executing the program using hardware resources such as a general-purpose computer, the technology of the present invention can be easily implemented on hardware.

According to the seventh aspect of the present invention, the recorded
Alternatively, the image data to be associated with the audio data that was recorded is selected from the list of image data, the audio data is analyzed, and the image data corresponding to the processing type determined based on the analysis result, or A computer is caused to read a program for causing the selected new image data to be selected as the second image data and recording the audio data in association with the image data obtained by combining the first image data and the second image data. Therefore, claim 2
Can be realized. Therefore, sales and distribution as a single software product independent of the system are also facilitated. Further, by executing the program using hardware resources such as a general-purpose computer, the technology of the present invention can be easily implemented on hardware.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a functional configuration of an information terminal device 1 according to the present invention.

FIG. 2 is a diagram showing a file configuration inside a storage device 17 of FIG.

FIG. 3 is a diagram showing an example of data storage in an audio data file 171 of FIG. 2;

FIG. 4 is a diagram showing an example of data storage in an image data file 172 of FIG. 2;

FIG. 5 is a voice stamp registration information file (1) 1 of FIG. 2;
73 is a diagram showing an example of data storage inside 73. FIG.

FIG. 6 is a diagram showing an example of data storage inside a combined mark file 174 of FIG. 2;

FIG. 7 is a flowchart showing an operation of a voice stamp creation process A executed by the CPU 11 of FIG. 1;

8 is a diagram showing an example of an audio data file selection screen 1001 displayed in step S7 of FIG.

9 is a diagram showing an example of an image data selection screen 1002 displayed in step S9 of FIG.

FIG. 10 is a diagram showing an example of a composite mark selection screen 1003 displayed in step S13 of FIG.

11 is a diagram showing an example of a voice stamp setting screen 1004 displayed in step S18 of FIG.

12 is a diagram showing an example of a voice stamp setting screen 1005 displayed in step S39 of FIG.

FIG. 13 is a diagram showing a file configuration inside a storage device 17 of FIG.

14 is a diagram showing an example of data storage in a voice stamp registration information file (2) 175 of FIG.

FIG. 15 is a flowchart showing an operation of a voice stamp creation process B executed by the CPU 11 of FIG. 1;

FIG. 16 is a diagram showing an example of a processing type selection screen 1006 displayed in step S32 of FIG.

17 is a diagram showing an example of an image effect selection screen 1007 displayed in step S33 of FIG.

FIG. 18 is a diagram showing an example of a processing degree input screen 1008 displayed in step S34 of FIG.

FIG. 19 is a diagram showing an example of a processing degree input screen 1009 displayed in step S34 of FIG.

20 is a diagram showing an example of a processing degree input screen 1010 displayed in step S34 of FIG.

FIG. 21 is a diagram showing an example of a processing degree input screen 1011 displayed in step S34 of FIG.

FIG. 22 is a diagram showing an example of a voice stamp setting screen 1012 displayed in step S39 of FIG.

FIG. 23 is a flowchart showing an operation of a processing degree changing process executed by the CPU 11 of FIG. 1;

24 is a diagram illustrating an example of screen switching in step S46 in FIG.

FIG. 25 is a diagram showing an example of screen switching in step S46 of FIG.

FIG. 26 is a diagram showing a file configuration inside a storage device 17 of FIG.

FIG. 27 is a diagram showing an example of data storage in the voice analysis stamp registration information file 176 of FIG. 26;

FIG. 28 is a flowchart showing an operation of a voice analysis stamp creation process executed by the CPU 11 of FIG. 1;

FIG. 29 is a diagram showing an example of an audio data analysis result display screen 1013 displayed in step S70 of FIG. 28.

30 is a diagram showing an example of an analysis / combined image list display screen 1014 showing the correspondence between the analysis / combination image displayed in step S70 of FIG. 28 and the analysis result.

31 is a diagram showing an example of an analysis / synthesized image change selection screen 1015 displayed in step S74 of FIG. 28. FIG.

[Explanation of symbols]

 Reference Signs List 1 information terminal device 11 CPU 12 input unit 13 RAM 14 transmission control unit 15 VRAM 16 display unit 17 storage device 17a recording medium 18 audio processing unit 18a speaker 18b microphone

 ────────────────────────────────────────────────── ─── Continued on the front page F term (reference) 5B050 AA08 BA10 CA05 CA07 EA19 FA02 FA10 FA19 5D045 AB30 5D108 CA29 5E501 AA18 AC34 BA03 BA05 CA02 CA08 FA04

Claims (7)

[Claims] 1. An information terminal device for recording audio data in association with image data, comprising: image selection means for selecting recorded audio data or first image data to be associated with recorded audio data; Processing type selecting means for selecting the type of processing by selecting the second image data corresponding to the type of processing for processing the data, according to the type of processing selected by the processing type selecting means, Voice processing means for processing the recorded voice data or recorded voice data; and image data obtained by combining the first image data and the second image data with the voice data processed by the voice processing means. An information terminal device, comprising: synthesized image recording means for recording in association with each other. 2. An information terminal device for recording audio data in association with image data, wherein: first image selecting means for selecting recorded audio data or first image data to be associated with the recorded audio data; Processing type selection means for selecting a processing type of the audio data; second image selection means for selecting second image data corresponding to the processing type selected by the processing type selection means; Machining degree designating means for designating a machining degree; and a machining type selected by the machining type selecting means,
Voice processing means for processing the recorded audio data or recorded voice data according to the processing degree designated by the processing degree designating means; and An information terminal device, comprising: synthesized image recording means for recording image data and image data obtained by synthesizing the second image data in association with each other. 3. A composite image display means for displaying image data recorded on the composite image recording means; a composite image selection means for selecting image data displayed on the composite image display means; Each time the image data is selected, the processing degree change output means for changing and outputting the processing degree of the sound data processed by the sound processing means, and the processing degree changed by the processing degree change output means The information terminal device according to claim 1, further comprising: an image switching unit that switches the image data in a corresponding manner. 4. An information terminal device for recording audio data in association with image data, wherein: first image selection means for selecting recorded audio data or first image data to be associated with the recorded audio data; Voice analysis means for analyzing the recorded voice data or recorded voice data, and image data corresponding to the type of processing determined based on the analysis result by the voice analysis means or new image data selected and designated A second image selecting unit for selecting the first image data and the second image data with the recorded audio data or the recorded audio data. An information terminal device, comprising: synthesized image recording means for recording in association with each other. 5. A computer which has a function of selecting recorded audio data or first image data corresponding to recorded audio data, and a second function corresponding to a type of processing for processing the audio data. A function of selecting the type of processing by selecting image data; a function of processing the recorded audio data or the recorded audio data in accordance with the selected processing type; A function of recording the first image data and the image data obtained by combining the second image data in association with each other. 6. A computer, wherein: a function of selecting recorded audio data or first image data corresponding to the recorded audio data; a function of selecting a type of processing of the audio data; A function of selecting the second image data corresponding to the type of the audio data; a function of specifying the degree of processing of the audio data; the type of processing selected and the specified degree of processing; A function of processing recorded audio data, and a function of recording the processed audio data in association with image data obtained by combining the first image data and the second image data. Program. 7. A function for a computer to select recorded audio data or first image data corresponding to recorded audio data, and a function for analyzing the recorded audio data or recorded audio data. The image data corresponding to the type of processing determined based on the analysis result or the new image data selected and designated is stored in the second
A function of selecting as the image data, a function of recording the recorded audio data or the recorded audio data in association with the image data obtained by synthesizing the first image data and the second image data, The program to realize.