JP2008060776A - Portable terminal device, recording notification method thereby, and communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make an improvement in the security of recording contents in a sound recording system. <P>SOLUTION: A system control unit 17 makes a connection with the other terminal of speech communication. A recording control unit detects a recording start indication through a sound input command when a connection is made and forms the sound file of transmitting/receiving sounds in a storage device when the recording start indication is given. A literation control unit 10 subjects the sound data of the sound file to literation and forms a letter file 12. A destination transmitting unit 11 informs a predetermined notification end of the letter data of the letter file 12. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a recording notification method using a mobile terminal device, a mobile terminal device, and a communication system, and more particularly to a recording notification method using a mobile terminal device that improves the security of the recording content by notifying a third party of the recording content in real time. The present invention relates to a mobile terminal device and a communication system.

  Mobile terminal devices such as mobile phones and PHSs (Personal Handy phone systems) are very convenient in that they can talk with anyone anywhere. However, when trying to memo the conversation content, it often involves time and ambiguity, such as writing on other media with stationery or the like, or storing it personally by the user.

  Therefore, an audio recording system that solves the above-described problems has been proposed (see, for example, Patent Document 1 and Patent Document 2).

  For example, in the method described in Patent Document 1, this audio recording system provides a mechanism that can automatically record conversations between headsets in a memory in the headset at all times.

  In the method described in Patent Document 2, a replaceable memory card is attached to a mobile phone, and the other party's story and one's own story are recorded so that the content of the conversation can be confirmed later.

  On the other hand, crimes using mobile phones have recently increased rapidly. For example, various crimes have occurred, including fraudulent fraud using mobile phones, illegal collection, intimidation, and slurping.

  When a good citizen is involved in these incidents, the content and situation of the conversation can be important evidence for criminal culling and tracking.

  Even with the voice recording system described above, if the other party's story and the result of recording his / her own story are sent to the appropriate place and opened, there is no doubt that it will be useful for investigation.

JP-A-2005-237017 (for example, “0037” to “0041”) JP 2000-32169 A (for example, “0018” to “0020”)

  However, the above-described conventional voice recording system has a security problem in the recorded contents.

  This is because if the recorded person is kidnapped, or the recorded terminal is stolen or lost, the evidence of the conversation cannot be disclosed.

  An object of the present invention is to record a conversation between both mobile phones, characterize the result, and send the result in real time to a pre-registered partner, thereby improving the security of the recorded content. An object of the present invention is to provide a recording notification method, a portable terminal device and a communication system.

  The present invention is characterized in that voices transmitted and received with a call partner terminal are recorded, and the recorded voices are notified to a predetermined notification destination.

  In this case, the content notified to the notification destination is a characterized version of the recorded voice.

  In addition, the notification destination is notified by e-mail every time the characterized data reaches a certain amount.

  In addition, the vibrator is vibrated when the recording is started.

  The following invention is characterized in that, when a recording start instruction is given after connection with a call partner terminal, an audio file of transmission / reception audio is created in a storage device, and audio data of the audio file is notified to a predetermined notification destination.

  In this case, the recording start instruction is a voice input command.

  In addition, the content notified to the notification destination is characterized audio data of the audio file.

  The end of the creation of the audio file is a recording end instruction or a call end by a key button.

  In addition, the characterized data is notified to the notification destination by e-mail every time the characterized data reaches a certain amount.

  In addition, when a recording start instruction is issued, a vibrator provided in advance is vibrated.

  A recording control unit that detects a recording start instruction at the time of communication with a call partner terminal and creates a voice file of transmission / reception voice in a storage device that has a recording start instruction when the recording start instruction is received, and voice data of the voice file And a destination transmission unit for notifying a predetermined notification destination.

  In this case, the recording start instruction is a voice input command.

  Further, the present invention has a characterizing control unit that converts the sound data of the sound file into characters, and the content notified to the notification destination is the characterized data.

  Also, the end of the creation of the audio file is when the recording control unit detects a recording end instruction or when a call is ended by a key button.

  In addition, the destination transmission unit notifies the notification destination of the characterized data by e-mail every time the characterized data reaches a certain amount.

  Further, the recording control unit vibrates a vibrator provided in advance when the recording start instruction is given.

  The next invention is a communication system including a first mobile terminal device, a second mobile terminal device, and a network connecting the first mobile terminal device and the second mobile terminal device, The first portable terminal device includes a system control unit that connects to the second portable terminal device, and a storage device that has a recording start instruction when the connection is made and detects the recording start instruction and has the recording start instruction in advance. And a recording control unit for creating a voice file of transmission / reception voice, and a destination transmission unit for notifying voice data of the voice file to a predetermined notification destination.

  In this case, the recording start instruction is a voice input command.

  Further, the present invention has a characterizing control unit that converts the sound data of the sound file into characters, and the content notified to the notification destination is the characterized data.

  In addition, the destination transmission unit notifies the notification destination of the characterized data by e-mail every time the characterized data reaches a certain amount.

  The recording notification method and the portable terminal device by the portable terminal device of the present invention have the effect of improving the security of the recorded content.

  This is because both conversations are recorded during the conversation using the mobile phone, and the result is converted into text and transmitted in real time to the other party registered in advance.

  Next, the best mode for carrying out the present invention will be described in detail with reference to the drawings.

  The embodiment of the present invention improves the security of recorded contents by recording both conversations using a mobile phone, converting the result into text, and transmitting the result to a pre-registered partner in real time. It is.

  Therefore, in the embodiment of the present invention, a recording control command by voice input is used for a recording start instruction of the mobile phone.

  The reason is that since conversation recording is for security purposes, it must be easy to operate and should be immediately usable when it feels necessary.

  FIG. 1 is a block diagram of a mobile phone showing an embodiment of the present invention.

  Referring to FIG. 1, a mobile phone according to an embodiment of the present invention includes a microphone 1, an antenna 2, a recording control unit 3, a transmission / reception unit 4, a voice encoding unit 5, a voice decoding unit 6, a voice reproduction control unit 7, A speaker 8 is provided. Further, the mobile phone includes an audio file 9, a characterizing control unit 10, a destination transmission unit 11, a character file 12, a character reproduction control unit 13, a display device 14, a vibration control unit 15, a vibrator 16, and a system control unit 17. Become.

  Although not shown, the system control unit 17 controls the entire apparatus by executing an OS and applications stored in a nonvolatile memory by the CPU. For example, it supervises call processing such as outgoing and incoming calls or data communication, and controls activation of each control unit as necessary.

  The system control unit 17 has a multi-access control function capable of transmitting and receiving packet data such as mail simultaneously with transmission and reception of voice.

  In FIG. 1, the system control unit 17 activates the recording control unit 3 on the assumption that a conversation is possible when a response signal is received from the partner terminal when a call is made or when an off-hook state occurs when a call is received.

  Note that the call processing control method is the same as the conventionally known technique, and therefore will not be described in detail here.

  When the recording control unit 3 is activated from the system control unit 17 at the time of communication with the partner device, for example, when the connection with the partner device is established and the call starts, the recording control unit 3 receives the input voice from the microphone 1, After analog / digital conversion, a recording control command registered in advance in the internal memory is detected. If the recording control command is a recording start command, the recording control unit 3 creates an audio file 9 in the RAM as recording data and instructs the vibration control unit 15 to start. The RAM is the same as below, but is non-volatile. If the recording control command is a recording end command, the recording control unit 3 cancels the creation of the audio file 9 as the end of recording, and instructs the vibration control unit 15 to stop starting. Details of the recording control command processing of the recording control unit 3 will be described later.

  Further, when creating the audio file 9, the recording control unit 3 creates two audio files corresponding to the user and the other party. The input sound from the microphone 1 is recorded as its own voice, and the voice data from the voice decoding unit 6 described later is recorded as the other party's voice. Each audio file contains “time stamp data” for each start point of the voice block of the conversation voice, and during playback, the voices recorded in the two voice files are synchronized to form a series of conversation flows. So that it can be played.

  If necessary, the two files can be played separately. Details will be described later.

  The voice encoding unit 5 encodes the input voice passed from the recording control unit 3 by a predetermined method and outputs the encoded voice data to the transmission / reception unit 4.

  When activated by the recording control unit 3, the vibration control unit 15 vibrates the vibrator 16 with a predetermined vibration pattern and notifies the user that conversation recording has started.

  The transmission / reception unit 4 receives a radio signal including an audio signal from the antenna 2, performs demodulation and conversion to a baseband signal, and outputs audio data to the audio decoding unit 6. In addition, the transmission / reception unit 4 frames and modulates the input voice (voice data) from the microphone 1 encoded by the voice encoding unit 5 and emits it from the antenna 2. The transmission / reception unit 4 has a circuit configuration corresponding to a communication method for mobile communication.

  The audio decoding unit 6 decodes the audio data from the transmission / reception unit 4 and outputs it to the recording control unit 3, and after decoding, digital / analog-converts and outputs it via the speaker 8.

  The audio file 9 is recording data created in the RAM by the recording control unit 3. The recording data is created by the recording control unit 3 and is composed of two audio files corresponding to the user and the other party. In each sound file, the input sound from the microphone 1 is recorded as its own sound, and the output sound from the sound decoding unit 6 is recorded as the other party's sound. Each audio file contains “time stamp data” at each start point of the audio block of the conversation audio, and the audio recorded in the two audio files can be reproduced in synchronism.

  Note that the time stamp data is time data that is given to the start point of each voice block by the recording control unit 3 when the conversation voice of the user and the other party is recorded in each voice file.

  The audio reproduction control unit 7 reproduces an audio file in response to a request from the user, and outputs it from the speaker 8.

  The characterizing control unit 10 converts the voice data of the voice file 9 into a character using a voice recognition technology, creates the character file 12 in the RAM, and activates the destination transmission unit 11. As with the audio file 9, the characterizing control unit 10 creates a file by separately characterizing the recorded voice file and the partner's voice file.

  Also, the characterizing control unit 10 activates the destination transmitting unit 11 when the characterized character data reaches a certain amount.

  The character file 12 is characterized data of recording data created in the RAM by the characterizing control unit 10. Similar to the voice file 9, the recorded voice file and the other party's voice file are separately characterized.

  When the destination transmission unit 11 is activated by the characterizing control unit 10, it transmits the data of the character file to the address designated in advance in real time.

  Detailed operation of the destination transmission unit 11 will be described later.

  The character reproduction control unit 13 displays the data of the character file 12 on the display device 14 in response to a request from the user.

  The display device 14 is a display of a mobile phone.

  FIG. 2 is an operation flow diagram of the cellular phone showing an embodiment of the present invention.

  Step 1: The system control unit 17 determines that a call has been started when a response signal is received from the other party at the time of outgoing call or goes off-hook at the time of incoming call via the transmission / reception unit 4, and the recording control unit 3 is started.

  As a premise of Step 1, it is assumed that a recording mode for recording conversation voice is selected when the mobile phone enters a call start state by operation of the operation unit.

  Step 2: When the recording control unit 3 is activated by the system control unit 17, it receives the input voice from the microphone 1 and detects a recording control command registered in advance. In this case, the recording control unit 3 performs voice analysis on the input voice at the beginning of the conversation, and compares the recording control command stored in the memory in the recording control unit 3 in advance with the input voice at the beginning of the conversation. If they almost match, the recording control command is detected.

  If a recording start command is detected in step 2, the process proceeds to step 3 and step 4. If a recording end command is detected, the process proceeds to step 7, and if not detected, step 2 is repeated.

  Step 3: The recording control unit 3 creates two audio files corresponding to the user and the other party as audio files 9, respectively.

  Step 4: The recording control unit 3 instructs the vibration control unit 15 to start. When activated by the recording control unit 3, the vibration control unit 15 vibrates the vibrator 16 with a predetermined vibration pattern and notifies the user that conversation recording has started.

  Step 5: When the system control unit 17 recognizes the creation of the audio file 9 in Step 3, the characterizing control unit 10 converts the audio data of the audio file 9 into characters using the voice recognition technology and stores the characters in the RAM. The file 12 is created and the destination transmission unit 11 is activated.

  Step 6: When the destination transmission unit 11 is activated by the characterizing control unit 10, it sends the data of the character file by mail to a predetermined address in real time.

  Step 7: If the command is the end of recording, the recording control section 3 stops the creation of the audio file 9 as the end of recording.

  Step 8; Next, the recording control unit 3 instructs the vibration control unit 9 to start and stop.

  Next, command processing of the recording control unit 3 will be described in detail.

  As described above, the recording control unit 3 receives the input voice from the microphone 1 and performs processing corresponding to the recording control command registered in advance.

  The recording control command includes a recording start command and a recording end command.

  Here, the command is input by the microphone 1 and can be detected by the recording control unit 3, and may be voice data representing a word or other sound data. In the case of voice data representing words, for example, the following command is used.

Recording start command: Example “Start memo”, “Confirm”, “Start”, “1”, “Start”, “Pipi”
Recording end command: Example “Recording end”, “It is over”, “End”, “Ni”, “Stop”, “Pe”
These commands are held in advance in a command table as shown in FIG. It is desirable that this command table can be set freely by the user.

  The recording control command may be a command represented by sound data of a certain tone color generated by any language, mimetic word, musical instrument or the like.

  FIG. 3 is an explanatory diagram showing a first processing method when the recording control command of the recording control unit 3 is detected. In FIG. 3, for convenience, the sound waveform is shown as an analog waveform.

  In the first processing method, the recording control command is set at the beginning of the conversation so that the portion is always masked.

  The recording control command at the beginning of the conversation is between time T1 and T2, and the recording control unit 3 detects the command for starting recording during this time. T1 to T2, T3 to T4,... Are blocks of the voiced part of the input voice (the same applies hereinafter).

  Input speech from the microphone 1 between times T1 and T2 is not output to the speech encoding unit 5, but is masked by the other party (hereinafter referred to as mask processing).

  When a command is detected, the recording control unit 3 performs the process (1) (see FIG. 3), that is, the recording process (creation of the audio file 9), and the vibration control unit 15 is activated.

  When the vibration control unit 15 is activated, the vibrator 16 vibrates, and the user can know that recording has started.

  Several vibration patterns of the vibrator may be prepared in advance so that the user can select them.

  The input speech from the microphone 1 after time T3 is output to the speech encoding unit 5 as it is.

  FIG. 4 is an explanatory diagram showing a second processing method when the recording control command of the recording control unit 3 is detected. In FIG. 4, for convenience, the sound waveform is shown as an analog waveform.

  In the second processing method, the input sound from the microphone 1 is delayed by the recording control command determination time of the recording control unit 3 by, for example, a register. The recording control unit 3 performs the above-described mask processing if the recording control command is included in the input voice, and simultaneously performs processing corresponding to the command. If the recording control command is not included in the input voice, the recording control unit 3 outputs the delayed input voice to the voice encoding unit 5.

  In FIG. 4, if a recording control command is not included between times T 1 and T 2, the input speech is delayed by the recording control command determination time of the recording control unit 3 and output to the speech encoding unit 5. .

  If a recording start command is included between times T3 and T4, the recording control unit 3 performs the above-described masking process, and the process (1) (see FIG. 4), that is, the recording process and vibration control unit 15 is performed. Start up.

  Thereafter, the recording control unit 3 performs processing equivalent to the times T1 to T2 at the times T5 to T6 and the times T9 to T10.

  If a recording end command is included between times T7 and T8, the recording control unit 3 performs the masking process described above, and performs the process (2) (see FIG. 4), that is, the end of the recording process and A stop instruction of the vibration control unit 15 is issued.

  Further, as a third processing method, a method of replacing background noise during a call with a control command without adding a time delay as in the second processing method may be considered.

  For example, noise, for example, high frequency is output in parallel with voice from a device operated by a speaker during a call, and the recording control unit 3 receives this high frequency data together with the voice data. The recording control unit 3 can consider a method of determining whether the command is a recording start command or a recording end command from the characteristics of the high-frequency data, for example, the time length.

  In this case, the device must output a high frequency only for the time during which the high frequency output button is pressed, and output a high frequency that can be recognized by the recording control unit 3.

  In the first and second processing methods described above, it is necessary to ignore even if the same word as a recording end command that is not intended to end recording is spoken during a conversation. For that purpose, it is decided to press a predetermined key when a recording end command is uttered, and when the recording control unit 3 detects the recording end command, the recording is performed only when this key is pressed. The termination may be performed. Alternatively, the recording end may be controlled by a key button instead of a voice control command. That is, the recording is ended simultaneously with the end of the conversation.

  Next, the detailed operation of the destination transmission unit 11 will be described.

  FIG. 6 is a block diagram of the destination transmission unit 11.

  In the destination transmission unit 11, the location information acquisition unit 60 acquires location information when the GPS is provided in the mobile terminal, and acquires a communication base station number when the GPS is not provided in the mobile terminal. .

  The transmitted text acquisition unit 61 acquires character data in a fixed amount unit as transmitted text data every time the voice control unit 10 converts the recorded voice into a fixed amount of text.

  The mail transmission means 62 creates mail information based on the acquired transmission sentence data, time and position information, and transmits the mail to the destination stored in the destination storage unit 63. The destination selection method in the destination storage unit 63 may be selection based on the priority order, or may be sequentially sent to all destinations.

  In this way, the conversation content is mailed to a predetermined destination almost in real time, and the conversation content is displayed in chronological order on a third-party receiving terminal or PC screen for easy confirmation. It becomes.

  Note that the mail transmission technology during a call is described in Japanese Patent Application Laid-Open No. 2006-109289.

  Next, a method for reproducing the recorded voice file 9 and character file 12 will be described.

  The reproduction of the audio file 9 and the character file 12 is notified to the system control unit 17 by an operation unit, for example, selection from a menu. If the request from the operation unit is the reproduction of the audio file 9, the system control unit 17 drives the audio reproduction control unit 7 to output the audio data of the audio file 9 from the speaker 8. If the request from the operation unit is to reproduce the character file 12, the character reproduction control unit 13 is driven to display the character data of the character file 12 on the display device 14.

  The audio file 9 can be reproduced by separately reproducing two audio files corresponding to the user and the other party, or combining and reproducing the two audio files.

  When two audio files are combined and reproduced, the system control unit 17 synchronizes in time with the “time stamp data” and reproduces the voices of the two people in a series of conversations.

  In addition, the audio file 9 and the character file 12 can be reproduced simultaneously.

  Also in this case, the system control unit 17 synchronizes the voice and the character with the time stamp and reproduces them in time series.

  FIG. 7 is a diagram showing an example of reproduction. In the upper row, the voice spoken by the user is output from the speaker 8 along with the time, and the converted character string is displayed on the display device 14. In the lower part, the content spoken by the other party is reproduced in the same way.

  As described above, the recording notification method and the portable terminal device by the portable terminal device according to the embodiment of the present invention have the effect of improving the security of the recorded content.

  This is because both conversations are recorded during the transmission / reception conversation by the mobile phone, and the result is converted into text and transmitted to the other party registered in advance.

  In addition, the recording notification method and the mobile terminal device using the mobile terminal device according to the embodiment of the present invention have an effect of improving the operability of recording.

  The reason is that a recording control command by voice input is used for a recording instruction.

  Furthermore, the recording notification method by the mobile terminal device and the mobile terminal device according to the embodiment of the present invention have the effect of providing real-time property to the transmission of the conversation content mail.

  This is because every time a conversational sentence is converted to a character, mail is transmitted in a predetermined unit.

  In the above-described embodiment, the text conversion of the recorded voice is performed in the mobile phone, but this may be performed by the application server. Thereby, the processing load of the text-to-text conversion of the recorded voice in the mobile phone can be reduced. In that case, it is necessary that the stored data cannot be played back by anyone other than the third party who has been notified of the recording. For this purpose, it is necessary to incorporate an encryption key into the data.

  Further, in the above-described embodiment, conversation text is converted into text characters and mail is sent to the notification destination. However, mail may be sent as the conversation voice.

  This is a method in which the audio data of the audio file 9 is attached to an e-mail and sent, and the receiving side reproduces and listens to the audio data received by the e-mail.

  The counterpart mobile phone may have the same configuration as that of the above-described embodiment, or may be a conventional mobile phone.

It is a block diagram of a mobile phone showing an embodiment of the present invention. It is an operation | movement flowchart of the mobile telephone which shows one embodiment of this invention. It is explanatory drawing which shows the 1st processing method at the time of the recording control command detection of the recording control part of FIG. It is explanatory drawing which shows the 2nd processing method at the time of the recording control command detection of the recording control part of FIG. It is a figure which shows the structural example of a command table. It is a block diagram of the destination transmission part which shows one embodiment of this invention. It is the figure which showed the example of reproduction | regeneration of a sound recording file and a text file.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Microphone 2 Antenna 3 Recording control part 4 Transmission / reception part 5 Voice encoding part 6 Voice decoding part 7 Voice reproduction control part 8 Speaker 9 Voice file 10 Characterization control part 11 Destination transmission part 12 Character file 13 Character reproduction control part 14 Display apparatus DESCRIPTION OF SYMBOLS 15 Vibration control part 16 Vibrator 17 System control part 60 Position information acquisition means 61 Transmission sentence acquisition means 62 Mail transmission means 63 Address preservation | save part

Claims (20)

A recording notification method by a portable terminal device, characterized in that a voice sent and received with a call partner terminal is recorded, and the recorded voice is notified to a predetermined notification destination. 2. The recording notification method by a portable terminal device according to claim 1, wherein the content notified to the notification destination is a characterized version of the recorded voice. 3. The recording notification method by a mobile terminal device according to claim 2, wherein an e-mail notification is sent to the notification destination whenever the characterized data reaches a certain amount. 4. The recording notification method by the mobile terminal device according to claim 1, wherein the vibrator is vibrated when the recording is started. Recording notification by a portable terminal device, wherein when a recording start instruction is issued after connection to a call partner terminal, a voice file of transmission / reception voice is created in a storage device and voice data of the voice file is notified to a predetermined notification destination Method. 6. The recording notification method by the portable terminal device according to claim 5, wherein the recording start instruction is a voice input command. 6. The recording notification method by a portable terminal device according to claim 5, wherein the content notified to the notification destination is a characterized audio data of the audio file. 6. The recording notification method by a portable terminal device according to claim 5, wherein the end of the creation of the audio file is a recording end instruction or a call end by a key button. 8. The recording notification method by a mobile terminal device according to claim 7, wherein the characterized data is notified by e-mail to the notification destination every time the characterized data reaches a certain amount. 7. The recording notification method by a portable terminal device according to claim 5, wherein when a recording start instruction is issued, a vibrator provided in advance is vibrated. A recording control unit that detects a recording start instruction at the time of communication with a communication partner terminal and creates a voice file of transmission / reception voice in a storage device that has the recording start instruction in advance, and voice data of the voice file is determined in advance A portable terminal device comprising: a destination transmission unit that notifies a notification destination. 12. The portable terminal device according to claim 11, wherein the recording start instruction is a voice input command. 12. The portable terminal device according to claim 11, further comprising: a characterizing control unit configured to characterize audio data of the audio file, and the content notified to the notification destination is the characterized data. 12. The portable terminal device according to claim 11, wherein the end of the creation of the audio file is when the recording control unit detects a recording end instruction or the call ends by a key button. 14. The portable terminal device according to claim 13, wherein the destination transmission unit sends an e-mail notification of the characterized data to the notification destination every time the characterized data reaches a certain amount. 12. The portable terminal device according to claim 11, wherein the recording control unit vibrates a vibrator provided in advance when the recording start instruction is issued. A communication system including a first portable terminal device, a second portable terminal device, and a network connecting the first portable terminal device and the second portable terminal device, wherein the first portable terminal device The terminal device has a system control unit for connecting to the second portable terminal device, and detects a recording start instruction when the connection is made, and transmits / receives audio to / from a storage device that has the recording start instruction in advance. A communication system comprising: a recording control unit for creating a file; and a destination transmission unit for notifying audio data of the audio file to a predetermined notification destination. 18. The communication system according to claim 17, wherein the recording start instruction is a voice input command. The communication system according to claim 17, further comprising: a characterizing control unit configured to characterize audio data of the audio file, wherein the content notified to the notification destination is the characterized data. 20. The communication system according to claim 19, wherein the destination transmission unit sends an e-mail notification of the characterized data to the notification destination every time the characterized data reaches a certain amount.

Images