JP2002041529A - Portable telephone set and unarranged visual information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily retrieve pieces of unarranged visual information (images, text information, etc.), file obtained by a portable telephone set. SOLUTION: The title of sound information is added as retrieval information to pieces of unarranged visual information to perform retrieval based upon the sound information. Text indexes are generated from the beginning part of a sound information file and used to facilitate retrieval.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable telephone and an unorganized visual information processing method suitable for the portable telephone.

[0002]

2. Description of the Related Art Conventionally, a portable telephone or a PDA (personal information terminal) 1 having a transmission / reception function has a digital video camera 2 for capturing moving images and still images as shown in FIG.
The digital still camera 3 capable of photographing a still image and the like, video information from the imaging camera 15 built in the mobile phone 1 and text information from the Internet network 4 (in the present invention, the video information and the text information are displayed on a display device). The information to be issued is defined as visual information, and is hereinafter referred to as visual information.)
Can be easily obtained.

For example, between the digital video camera 2 and the portable telephone 1, USB: IEEE 1394 (Univ.
eral Serial Bus: Institute
eof Electrical and Electr
nics Engineers 1394) or the like, and between the digital still camera 3 and the mobile phone 1 by Bluetooth.
wireless (a short-distance wireless transmission / reception connection interface) or the like, wireless transmission / reception via an interface such as the Internet (Internet) 4 further allows each web (Web)
b) Visual information such as various text data, graphics, and video data from the sites 5a, 5b, and 5c can be easily downloaded wirelessly through the mobile phone base station 6 and the radio tower 7, and the mobile phone [ In the present invention, a mobile phone terminal, a (64 kbps) portable information terminal, a (164 kbps)
~ 384kbps), car multimedia terminal (64k
bps, 128 kbps, 144 kbps), a portable multimedia terminal (2 Mbps), and the like, and the description will be made as a mobile phone. ] And small memory cards such as memory sticks and flash memories, and Bluetooth
h, a transmission / reception card or the like can be mounted, a large amount of visual information can be stored in the memory of the mobile phone, and transmission / reception can also be performed with a PDA or the like.

[0004]

In the above-mentioned portable telephone 1, since the display surface of the display device 8 such as an LCD is extremely small and the number of keys of the operation unit 9 such as a ten-key is small, the portable telephone 1 is stored in a small memory card, for example. If the user tries to enter titles and description information via keys to search for multiple unorganized visual information files, the operability is lower than that of a general device having a relatively large display device and a keyboard for character input. There is a problem that is bad and requires a long time.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems. The problem to be solved by the present invention is to create a voice file from a voice transmission / reception function which is a basic function of a portable telephone, Is attached to a plurality of visual information files as titles to provide a mobile phone and an unarranged visual information processing method capable of easily searching for visual information such as a predetermined image.

[0006]

A portable telephone 1 according to a first embodiment of the present invention corresponds to visual information acquisition means 14 and 16 for acquiring a plurality of unorganized visual information in a file, and an unorganized visual information file. Search voice information generating means 19 for generating search voice information, storage means 11a and 11b for storing visual information and the search voice information, and merging or linking the visual information and search voice information into the storage means. And a search file creating means 24 for causing the search file to be created.

The portable telephone 1 of the second invention has a speech recognition means 25 for recognizing the first part of the description file created by the search speech information creation means 21 of the first invention, and a speech recognition means 25. A search text information creating means 26 for converting the recognized information of the leading part into text information to create search text information, and merging or linking the search text information and the visual information with the search text information. It consists of

[0008] The mobile phone according to the third aspect of the present invention comprises the first and second mobile phones.
In the invention, the reproduction / selection means 22 for reproducing / selecting the search audio information stored in the storage means 11a, 11b;
The reproduction / selection unit 22 has a reproduction speed variable unit 22a capable of changing the reproduction speed to a high speed or a low speed, so that the search time of the search voice information is variable.

[0009] Unsorted visual information processing method of the present invention, creates a visual information obtaining step S ₁ to obtain the visual information of a plurality of non-organized file, the search for audio information corresponding to the unorganized visual information file and search for audio information creating step S ₆ that is made by and a search file creation step S ₉ to merge or link the search audio information and visual information in the storage means.

According to the first portable telephone and the unorganized visual information processing method of the present invention, when searching for a plurality of pieces of visual information stored in the storage means, the portable telephone does not input as text data which is difficult to input. , Easily input audio can be attached as title and description information,
It is possible to easily organize and search a plurality of visual information. Also, by describing a link to the audio information file and the visual information file in the text index file, the association between the audio information file and the visual information file can be easily and quickly changed. Further, the association between the audio information file and the visual information file can be flexibly performed, and not only one-to-one but also a plurality of visual information files in one audio information file or a plurality of audio information files It becomes easier to associate with files.

According to the second portable telephone of the present invention, by creating a text index at the beginning of a speech information file by speech recognition and text conversion, a search by the text index is also added, thereby further improving the retrieval efficiency. Can be.

According to the third portable telephone of the present invention, the search time can be reduced by using an audio codec capable of controlling the reproduction speed when creating the audio information file.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A portable telephone and an unorganized visual information processing method according to the present invention will be described below with reference to FIGS.

FIG. 1 is a functional block diagram of the portable telephone of the present invention, FIG. 2 is a block diagram of the portable telephone of the present invention, FIGS. 3 to 6 are flowcharts for explaining the operation, and FIGS. It is.

As shown in the block diagram of FIG. 2, the portable telephone 1 used in the present invention includes a transmitting / receiving radio section including a transmitting / receiving antenna 30, an RF block 31, and a modulation / demodulation block 32, a speaker 33, and a digital / analog converter (D / A / D converter). A) A voice output unit for voice and dialer signal emission including 34, a microphone 35, an analog-digital converter (A / D) 36
, An audio codec unit 39 having an audio input unit, a small operation unit 9 including a keyboard, a small display unit 8 such as an LCD, a system such as a microcomputer (CPU), a digital signal processor (DSP), and a processor unit for transmission control. 37, ROM and R for program data
Built-in memory unit 38 such as AM, external memory units 11a and 11b such as a memory card, imaging camera 1 built in mobile phone 1
5 and an image codec unit 40, each of which is connected to the processor 37 via a bus.

External memory (memory stick card,
PC card, smart media card, miniature card, compact flash card) 11a, 11b
Is detachable via a card insertion slot provided in the outer housing of the mobile phone 1.

FIG. 1 shows functional blocks of the present invention in the above-described hardware configuration. In FIG. 1, a visual information file 27 such as image information and an audio information file 28 are stored in the external memories 11a and 11b.

FIG. 1 shows two external memories 11a and 11b.
, But may be a single memory, and may be a built-in memory (other than the built-in memory unit 38) built into the mobile phone 1 instead of the external memories 11a and 11b.

As described with reference to FIG. 10, image information such as a still image or a moving image taken out from another device 12 (see FIG. 1) such as the digital video camera 2, digital still camera 3, image scanner, etc. 13 figures, tables, text information and image information and figures taken out from personal computers, PDAs, etc.
Combination information obtained by combining a table and text information is supplied to the external input unit 14 as visual information.

The external input unit 14 is physically a USB or a Bluetooth modem for converting digital data transmitted and received wirelessly into baseband digital data. Control software for acquiring these visual information is included in the processor 37, and the external software is included in the external input unit 14.

The built-in image device is C built in the mobile phone 1.
The image file creation unit 16 supplies the output of the built-in image device 15 to the external input unit since the image file creation unit 16 corresponds to the image codec unit 40 of FIG. You may make it.

The visual information file 27 such as image information and text information stored in the memory 11a is displayed and selected on the display unit 8 such as an LCD by the image display / selection unit 17 and the text display / selection unit 23.

Next, the audio file creation unit 19 uses an audio input device (microphone) 35, an audio codec unit 39, and an audio reproduction / selection unit 22 as functions already provided in the mobile phone 1.

In general, in the portable telephone 1, as shown in FIG.
After conversion into digital data, the audio data is encoded by the audio codec unit 39 into the determined audio codec format, and the digital data is transmitted from the antenna 30 via the modulation / demodulation unit 32 and the RF block unit 31 so that the digital data can be transmitted wirelessly.

The signal received by the antenna 30 is RF
The digital data is demodulated by the block unit 31 and the modulation / demodulation unit 32 to be converted back to digital data, decoded by the audio codec unit 39 according to the audio codec format, converted to an analog signal by the D / A 34, and output to the speaker 33.

According to the present invention, the audio file creating section 19 encodes the audio information into an audio codec format and causes the memory 11b to file it as an audio information file 28. The audio information file 28 is decoded, reproduced, and selected. 22 (audio codec unit 39) is provided with an audio file attachment unit 24 for attaching (merging) titles as explanation information and search information to a plurality of unprocessed visual information such as image information and text information. It aims at organizing a plurality of unorganized visual information downloaded from an Internet network called EZ-Web or EZ-Web to facilitate retrieval.

Conventionally, when handling a plurality of unorganized visual information, the user can automatically distinguish files without inputting search information such as an index number or a file name. There is a method of adding a sequential index number in the order of creation or using a time stamp at the time of downloading or creation to a file as a file name. When searching for necessary visual information, visual information such as an image is sequentially displayed on the display unit 8. Must be displayed on the screen.
Therefore, instead of a simple index number or timestamp file name, it is necessary to provide a title for the user to identify the file more efficiently. It is not easy to input text titles.

The present invention focuses on a part that can easily create an audio file, which is a basic function of a portable telephone, and converts the audio file into a plurality of files such as images that need to be organized by a title or a file such as an image. The above-mentioned problem is intended to be solved by newly adding a function to be attached.

FIG. 3 shows a processor (hereinafter referred to as a CPU) for attaching the above-mentioned audio information file to the image information file as one of the visual information as search information such as a title.
37 shows a flowchart of an audio file attachment process by the subroutine 37.

In the first step S ₁ in FIG. 3, image information obtained from another device 12 such as the digital video camera 2 or the digital still camera 3 by USB or Bluetooth, or text information from the Internet network 13,
Download visual information such as graphic information.

[0031] automatically file name, time stamp, etc. is added on the basis of the second step S ₂ in the download time.

In this state, the display section 8 displays the downloaded image 8a and a question 8b as to whether or not to save the image 8a.

[0033] In the third step S ₃ CPU 37 determines whether or not to save the downloaded images. The user clicks 0 (Yes) and 1 (No) of the question sentence 8b on the display unit 8. 4 displays the images 8a proceeds to step S ₄ ends if NO, the proceeds to a fifth step S _5, if YES.

[0034] In a fifth step S ₅ the display of the voice input message made, a message 8c such as "Please input speech" is displayed together with the downloaded image 8a on the display section 8.

In the sixth step S ₆ , the user inputs a search title, a description and the like corresponding to the image 8 a by voice through the microphone 35, for example, “Sunset at Zushi Beach” while watching the image 8 a on the display unit 8. I do.

[0036] In a seventh step S ₇ CPU 37 reproduces from the speaker 33 via the audio codec 39 and D / A34 as "Zushi coast sunset".

In an eighth step S ₈ , the user is asked whether or not the voice reproduction sound is OK, and a question 8 d of “OK?” Is displayed on the display unit 8. While the user is returned to the beginning of the fifth step S ₅ If NO by clicking the "1" or "0", the flow proceeds to a ninth step S ₉ if YES.

[0038] is annexed to a ninth step S ₉ in the voice information file image such visual information file and merges it with one as shown in FIG. 7 to files.

FIG. 7 shows a file image that summarizes the visual information file 27 and audio information file 28 into one voice file attachment unit 24, 50 is a file name that is automatically generated in the second step S ₂ And a text index part 51 such as “Sunset at Zushi Beach” stored in the voice information file 27 in the sixth step S _6.
2 is a visual information file such as an image that contains the image 8a obtained from the digital video camera 3 or the like in the first step S _1. Note that the file name 50 may be a time stamp such as 16:25:00 on March 01, 2000 (000301162500, PCK).

As described above, after the audio information file 51 and the visual information file 52 are merged into one file, the process ends.

Next, FIG. 4 shows a flowchart in a case where predetermined visual information is retrieved from a plurality of unarranged visual information files merged as described above.

In FIG. 4, in the first step ST ₁ , C
The PU 37 displays on the display unit 8 whether or not to reproduce the audio title. For example, a question text 8e such as "Do you want to reproduce voice?" Is displayed on the screen of the display unit 8. User is YES
Then, click "0", and if NO, click "1".

The first step ST ₁ sequentially visual information file of the plurality of images such as a second as is done conventionally proceeds to step ST _2, if NO, the is displayed, predetermined while viewing these displayed images Conventional processing such as performing a visual information search is performed.

If the first step ST ₁ is YES, in a third step ST ₃ , the CPU 37 sequentially reproduces the audio titles merged into the visual information file via the speaker 33.

In the case of the step of simply reproducing the voice at the normal speed during such reproduction (fifth step ST ₅ ), the input method is easier because the voice is input as compared with the case where the input is performed by text at the time of input. but when searching because time than the second step ST ₂ going to see images in sequence there is a possibility that it takes, thereby determines whether to perform a fast playback operation at a fourth step ST _4.

This fast-reading function is performed by the sound reproduction / selection unit 2 shown in FIG.
2 is performed by a variable reproduction speed control unit 22a provided in
This audio codec is MPEG-4 (Moving P
ictx Experts Group-4: audiovisual object coding standard) HVXC
(H armonic V ector e X citati
heard early by using the on C oding), slow to hear it can be easily performed the play.

The bit rate of voice coding in HVXC, which is parametric coding, is 2 kbps to 4 kbps, but 1.2 kbps depending on the variable bit rate mode.
Can be used to the extent. When voiced sounds such as human voices are spectrally distributed, they become uniform signals called harmonics. However, in HVXC, frequency and amplitude (pitch) are quantized as a harmonic amplitude sequence from which phase information is discarded. It can be recognized on the side, and it is easy to control and change the speed and pitch.

In this case, as for the key operation corresponding to the early listening and the late listening, for example, a question 8f such as "Do you listen early?" Is displayed on the screen of the display unit 8, and "0": yes, "1" : By clicking any one of No, it is determined whether or not the operation is a fast-listening operation. If NO, the fifth step ST is performed as described above.
₅ is performed, and if YES, the sixth step ST
_{By 6} , reproduction such as early listening and late listening is performed by the variable speed control unit 22 a.

Fifth step ST ₅ and sixth step ST
After ₆ completed to determine OK or not the visual information such as an image corresponding to audio titles played proceeds to a seventh step ST _7.

That is, the screen of the display unit 8 displays "Does this screen correspond to this voice?", "0": Yes, "1": Return,
"2": The next question text 8g is displayed. Thus, for example, audio title called "Zushi coast sunset" proceeds to the eighth step ST ₈ by clicking on the "0" and YES Once play. Returned to the head of NO in the fourth step ST _4, the click of the "1" is played back the original fast to hear again, the next voice title is reproduced by clicking the "2".

The eighth image 8a corresponding to "Zushi coast Sunset" visual information file such as an image is displayed on the display unit 8 the file search step ST ₈ corresponding, leading to reproduction display end.

According to the above-described search method, predetermined visual information can be searched at high speed by opening a voice title from a plurality of predetermined unorganized visual information.

[0053] Further following the first step S ₁ to the eighth step S ₈ of the audio information file attachment process described with reference to FIG. 3, the speech recognition text conversion unit 25 and the audio file rearrangement as shown in the functional block of FIG. 1 Through the part 26, 2
A mobile phone capable of efficiently retrieving and organizing visual information by creating an audio file with a text index of an image as shown in FIG. 9 and an unorganized visual information processing method will be described with reference to FIGS. 5 and 6 and FIGS. I do.

The voice recognition / text converter 25 in FIG. 1 converts voice information extracted from the voice information file 28 in the memory 11b into text (character). It ’s important to convert all normal conversations to text correctly,
Since it is difficult to mount the voice information on the mobile phone even in consideration of the processor capacity and the memory capacity, the voice recognition / text conversion unit 24 here needs the voice information necessary to rearrange the voice information files (for example, in dictionary order). A function that converts only a part (about one word) of the head of the file to text may be used. The file 29 of the text-indexed voice information with the text converted in this way is based on the text tags (eg, in dictionary order).
6 is performed.

In FIG. 5, the mode setting of the mobile phone 1 is shown.
Make sure that you are in index creation mode
And the first to eighth steps S described in FIG.₁
~ S ₈Step 8 when the audio file attachment process is completed
S₈From the state of YES to the first step STE₁Inn
The CPU 37 determines whether or not the mode is the index creation mode, and
If you do not create a dex, the second step STE_TwoFrom
Third step STE_ThreeProceed to the audio information file
And merge it with the visual information file.

On the other hand, if the index creation mode is YES, the process proceeds to the fourth step STE ₄ to cut out the head of the voice information file and perform voice recognition.

[0057] to create an index that some referred to as "Zushikaigan" of "Zushi coast sunset" from the fifth step STE ₅ in the voice recognition result.

In the sixth step STE ₆ , the index
The audio information file is merged with a visual information file such as an image.

In the seventh step STE ₇ , visual information files such as images are sorted by index for retrieval. For example, after sorting in dictionary order, the index creation processing ends.

[0060] Although in the above was subjected to rearrangement by the index in the seventh step STE _7, or sorted at the time of voice information file created in the sixth step S _6, has been selected at the time of the audio playback of the seventh step S ₇ (for example If the voice can be played back, the memory 11b is not sorted and the text is indexed.
It may be stored on top.

The image of one file created by merging the index, audio information file, visual information file such as image, etc. in the sixth step STE ₆ of the above index creation processing is, for example, as shown in FIG. Index 53 is added.

When three files (index, audio information, and visual information) are put together in one such file, for example, only the audio information file is replaced (change of association) with respect to the once created file. In such a case, the load on the processor increases, and the efficiency of using the memory decreases.

Then, a text tag file is created,
Linking multiple files makes searching easier,
The memory can also be made smaller. This is shown in FIG.
This will be described with reference to FIG.

FIG. 8A shows a first step S 27 in FIG.
_This is a visual information file such as an image acquired by downloading or the like in _1.
And the manner it is automatically file name added in the second step S ₂ according to the acquired date and time does not overlap with the file name in the mobile phone 1.

In FIG. 8B, reference numeral 28 denotes the sixth step S in FIG.
₆ is a voice information file named “Sunset at Zushi Beach”. wav is the file name of the audio information file.

In FIG. 8C, reference numeral 53 denotes the audio information file 28.
From speech to text by speech recognition from the beginning of
The index file “Zushikaigan” created in the fifth step STE ₅ of FIG.
190200. txt is a file name at the time of index creation.

In the present invention, the above-mentioned visual information file 27,
A text index tag file 54 that links the audio information file 28 and the index file 53 is created. When the text index tag file is created, a new file name may be created. However, since the index file shown in FIG.
6190200. Create a head and use <TITLE>, <VOICE>, <CONTENT> as link information.
S> etc. are defined, and each file name is described here.

The text index tag file 5
4 is not a user's own specification but an international standard XML
(Extensible Markup Langua
g) is described in a definable markup language, so that the text index tag is not limited to a mobile phone but can be used on a Web site on the Internet, a personal computer of another user, or any other device capable of recognizing an XML description. File link information can be recognized, and visual information files such as audio information files and images are distributed and managed together with text index tag files, so that files of different media (audio information and visual information such as images) are handled collectively. This is facilitated on Web sites on the Internet, personal computers of other users, and other devices that can recognize XML descriptions.

FIG. 6 shows a file to which an index has been added.
Search and playback and display files in index mode
Is a flowchart of the first step ST.
EP ₁Now the decision is made whether to display the index
If NO, the second step STEP_TwoWith conventional picture
Search by image display or by audio title described in FIG.
Search is performed.

When the first step STEP ₁ is YES, the process proceeds to the third step STEP ₃ to display the index list 8 h on the display unit 8 or to display the first character of the index.

In the fourth step STEP ₄ , the corresponding number of the display section 8, for example, “4” is input, or if there are many files, only the first character “Z” of the first character “Zushikaigan” is input because it cannot be listed on one page. I do.

[0072] Display and audio title visual information file of the image 8a and the like corresponding in fifth step STEP ₅ is reproduced. That is, the image 8a and the character 8i of "Zushikaigan" are displayed on the display unit 8, and at the same time, the audio title is reproduced and the process ends.

The search for the visual information file in the index mode as described above is as follows: (1) A list of the contents of the tag <TITLE> in the text index tag file 54 is displayed. (2) If the same text index exists, the audio file is reproduced. With two stages, it is possible to increase the search efficiency rather than simply reproducing and searching for an audio file. Further, by providing the text index tag file 54, the association can be easily changed only by changing the link while the audio information file 28 and the visual information file 27 are separately provided. Further, the audio information file is associated not only with the visual information file in a ratio of 1: 1, but also with respect to one audio information file, such as a plurality of visual information files such as a plurality of images, and a plurality of audio information files are associated with one visual information file. And saves memory.

[0074]

According to the portable telephone and the method of processing unarranged visual information according to the present invention, (1) a plurality of visual information files obtained by connecting to the Internet or the like, or an input from a terminal built-in or an external image device; With regard to the plurality of visual information files described above, the easily inputtable audio is attached as title and explanation information without text input which is difficult with a mobile phone, so that the plurality of visual information files can be organized. (2) When creating an audio information file, an audio codec (for example, MPEG-4 HVX) capable of controlling the playback speed
By using C), the search time can be reduced. (3) By creating a text search at the beginning of a speech information file by speech recognition and text conversion, a search using a text index is also added, so that search efficiency can be further improved. (4) Instead of recreating a visual information file such as a text index, an audio information file, and an image as a single file, a link to the visual information file such as an audio information file and an image is described in the text index file. This makes it possible to easily and quickly change the association between the audio information file and the visual information file. Furthermore, the audio information file and the visual information file can be flexibly associated with each other, and not only one-to-one but also one audio information file with a plurality of visual information files or a plurality of audio information files with one visual information file It becomes easier to associate with files. And many other effects.

[Brief description of the drawings]

FIG. 1 is a functional block diagram of a mobile phone according to the present invention.

FIG. 2 is a block diagram of a mobile phone according to the present invention.

FIG. 3 is a flowchart when an audio information file is attached according to the present invention.

FIG. 4 is a flowchart at the time of file search according to the present invention.

FIG. 5 is a flowchart at the time of creating an index according to the present invention.

FIG. 6 is a flowchart at the time of file search in the index mode of the present invention.

FIG. 7 is an image diagram of a file when an audio information file is attached according to the present invention.

FIG. 8 is an explanatory diagram of each file used in the present invention.

FIG. 9 is an image diagram of a text index tag file of the present invention.

FIG. 10 is an explanatory diagram of a conventional information acquisition method.

[Explanation of symbols]

1 mobile phone, 8 display, 11a, 11b
Memory, 14 external input unit, 16 image file creation unit, 19 audio file creation unit, 22 audio information file attachment unit, 25 speech recognition text conversion unit, 2
7 visual information file, 28 audio information file,
33 ‥‥ speaker, 35 ‥‥ microphone

[Procedure amendment]

[Submission date] August 17, 2000 (2008.1.
7)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] 0064

[Correction method] Change

[Correction contents]

FIG. 8A shows a first step S 27 in FIG.
1 is a visual information file such as an image acquired by downloading or the like. jp
g is the file name automatically added in the second step S2 according to the acquisition date and time, but is not duplicated with the file name in the mobile phone 1.

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0067

[Correction method] Change

[Correction contents]

In the present invention, the above-mentioned visual information file 27,
A text index tag file 54 that links the audio information file 28 and the index file 53 is created. When the text index tag file is created, a new file name may be created. However, since the index file shown in FIG.
6190200. Create a head and use <TITLE>, <VOICE>, <CONTENT> as link information.
S> etc. are defined, and each file name is described here.

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] 0073

[Correction method] Change

[Correction contents]

Searching for a visual information file in the index mode as described above: (1) A list of the contents of the tag <TITLE> in the text index tag file 54 is displayed. (2) If the same text index exists, the audio file is reproduced. With two stages, it is possible to increase the search efficiency rather than simply reproducing and searching for an audio file. Further, by providing the text index tag file 54, the association can be easily changed only by changing the link while the audio information file 28 and the visual information file 27 are separately provided. Further, the audio information file is associated not only with the visual information file in a ratio of 1: 1, but also with respect to one audio information file, such as a plurality of visual information files such as a plurality of images, and a plurality of audio information files are associated with one visual information file. And saves memory.

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G10L 13/00 H04M 1/00 R 5K027 15/00 H04N 5/76 B 5K067 H04Q 7/38 G10L 3/00 E H04M 1/00 551A H04N 5/76 H04B 7/26 109T F-term (reference) 5B075 ND14 ND16 ND36 NK10 NK54 5B082 EA09 GC04 5C052 AC08 DD04 5D015 EE01 HH01 KK02 KK03 5D045 AA27 A04 AB26A04 A2627 FF02 HH22 HH23 KK15

Claims (4)

[Claims] 1. A visual information obtaining means for obtaining a plurality of unorganized visual information in a file; a search audio information generating means for generating search audio information corresponding to the unorganized visual information file; A portable device comprising: storage means for storing information and the search voice information; and search file creation means for merging or linking the visual information and the search voice information in the storage means. Phone. 2. A speech recognition unit for recognizing a head of an explanation file created by the search speech information creation unit, and a search by converting information of the head recognized by the speech recognition unit into text information. 2. A search text information creating means for creating search text information, wherein the search text information is merged or linked with the search audio information and the visual information. Mobile phone. 3. A reproduction / selection unit for reproducing / selecting the search audio information stored in the storage unit, and a reproduction speed variable unit capable of changing a reproduction speed of the reproduction / selection unit to high speed or low speed. 3. The mobile phone according to claim 1, wherein a search time of the search voice information is varied. 4. A visual information obtaining step of obtaining a plurality of unorganized visual information in a file; a search audio information generating step of generating search audio information corresponding to the unorganized visual information file; An unorganized visual information processing method, comprising: a search file creating step of merging or linking information and the search audio information in a storage means.