KR101081705B1 - Management apparatus for communication data of mobile device and method thereof - Google Patents

Abstract

An apparatus and method for managing voice data of a mobile device, the method comprising: encrypting voice data in a mobile device with a unique key uniquely identifying the mobile device, converting the voice data into text, and encrypting the voice data from a mobile device in a remote storage device. Receive and store encrypted voice data and text. As a result, large-capacity voice data of the mobile device may be stored for safe and convenient retrieval, thereby preventing the possibility of legal disputes under the privacy protection law.

Mobile, security, voice data, storage

Description

Voice data management device of mobile device and its method {MANAGEMENT APPARATUS FOR COMMUNICATION DATA OF MOBILE DEVICE AND METHOD THEREOF}

The present invention relates to an apparatus and method for managing voice data of a mobile device, and more particularly, to store a large amount of voice data so that it can be retrieved safely and conveniently, The present invention relates to a voice data management apparatus of a mobile device that can be prevented and a method thereof.

As the technology for mobile devices such as a cellular phone, PDA, or smart phone is further developed, it is being used for various purposes. For example, the mobile device may support schedule management or e-mail transmission and reception in addition to a voice call, and may also function as a camera capable of capturing an image.

On the other hand, the mobile device can store audio data as well as video, but there is a limit of storage capacity. Although various efforts have been made to solve this problem in the past, it has not been satisfactory. For example, Korean Patent Laid-Open Publication No. 10-2005-002693 discloses a technique for storing voice data in a web server, which is still insufficient in terms of security problems, ease of retrieval, and protection of personal information. There is a point.

One object of the present invention is to provide an apparatus and method for managing voice data of a mobile device that can safely store and conveniently retrieve a large amount of voice data.

Another object of the present invention. When retrieving voice data, the voice data stored in the remote storage can be reproduced only on the mobile device in which the voice data is generated, thereby preventing the possibility of a dispute under the privacy protection law. To provide a way.

Another object of the present invention is to a computer that records a program for executing a method on the computer that can safely store and conveniently retrieve a large amount of voice data, and prevent the possibility of disputes under the privacy protection law. To provide a readable recording medium.

An object of the present invention is an apparatus for managing voice data of a mobile device, comprising: encrypting the voice data with a unique key uniquely identifying the mobile device, and converting the voice data into text and encrypting the voice data; And a remote storage device configured to receive and store the encrypted voice data and the encrypted text from the mobile device.

The objectives of the present invention are methods for managing voice data of a mobile device, comprising: encrypting the voice data with a unique key uniquely identifying the mobile device; Converting the voice data into text and encrypting the voice data; And transmitting and storing the encrypted voice data and the encrypted text to a remote storage device.

The above objects can be achieved by a computer readable recording medium having recorded thereon a program for executing the above method on a computer.

According to this embodiment, even if the mobile device has a limited storage capacity, it is possible to safely store and conveniently retrieve a large amount of voice data. In addition, when retrieving the voice data, the voice data stored in the remote storage can be reproduced only in the mobile device in which the voice data is generated, thereby preventing the possibility of legal dispute under the privacy protection law.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In describing the following specific embodiments, various specific details are set forth in order to explain and understand the invention in more detail. However, one of ordinary skill in the art can understand that the present invention can be used without these various specific details. In some cases, it is mentioned in advance that parts of the invention which are commonly known in the description of the invention and which are not highly related to the invention are not described in order to prevent confusion in explaining the invention without cause.

1 is a block diagram of an apparatus for managing voice data of a mobile device according to an embodiment of the present invention.

Referring to FIG. 1, a voice data management apparatus (hereinafter, referred to as a 'voice data management apparatus') of a mobile device encrypts the voice data with a unique key uniquely identifying the mobile device, and also converts the voice data into text. Mobile devices (M1, M2, M3, ...) for encryption and remote storage devices (200, 200) for receiving and storing and / or managing encrypted voice data and text from the mobile device. In FIG. 1, the remote storage device is illustrated as including a remote storage server 200 and a storage group 300, but this is an exemplary configuration, in which the remote storage server 200 and the storage group 300 are integrally configured or In addition, the remote storage server 200 stores a part of the data stored in the storage group 300, and the rest of the storage group 300 may be configured.

The operation of storing voice data in the remote storage device will now be described by taking the mobile device M1 as an example.

The mobile device M1 may uniquely identify the mobile device M1 with voice data (for example, but not limited to, call voice data of the user, but may also include music data or lecture data). And encrypts the encrypted voice data again using a second unique key that can uniquely identify the mobile device M1. In addition, the mobile device M1 converts the voice data into text and encrypts the converted text by various encryption methods.

Here, the first unique key or the second unique key is a key that only the mobile device M1 has and is assigned to not be mixed with other mobile devices M2, M3, .... This is to ensure that only the mobile device that encrypts the voice data can decrypt it.

The mobile device M1 also sends a tag (data describing voice data) from the user to the remote storage device along with the encrypted voice data.

Here, the tag may be transmitted in plain text without being encrypted, but a configuration of encrypting and transmitting the tag may be adopted. For example, a tag may be separately encrypted based on a symmetric key (private key) or an asymmetric key (public key) and transmitted with the encrypted voice data to a remote storage device. The key used when encrypting the tag is a key different from the first unique key or the second unique key used when encrypting the above-mentioned voice data. Since the tag needs to be decrypted in the remote storage device, the tag is not decrypted with a unique key unique to the mobile device M1.

On the other hand, the mobile device M1 also transmits meta information about the voice data to be encrypted together with the tag to the remote storage device. The meta information is data about the voice data, and information about the date and time of storing the voice data or the location where the voice data is generated (this is possible when the mobile device has location tracking hardware and software such as GPS) or who the contact person is. Data indicating recognition.

Similar to the tag, the meta information may be transmitted in an unencrypted plain text, but may be configured to encrypt and transmit the meta information.

For example, when the meta information is encrypted, it may be encrypted with a secret key, not with the first unique key or the second unique key. Tags and meta information can be encrypted with a single secret key, but can be encrypted with different keys.

According to an embodiment of the present invention, the mobile device M1 converts the voice data into text and encrypts the converted text with a secret key. Thereafter, the mobile device M1 transmits the above-mentioned encrypted voice data, tag and / or meta information, and the encrypted text to the remote storage device.

Describe the operation of the remote storage device.

The remote storage device stores the above-mentioned encrypted voice data, tag and / or meta information, and encrypted text received from the mobile device M1, and maps the encrypted voice data with the tag and / or meta information. Information and mapping information for mapping encrypted voice data and encrypted text is generated and stored. The mapping information between the encrypted voice data and the encrypted text is used for retrieving the voice data as information relating the encrypted voice data and the encrypted text to each other. For example, when a desired encrypted text is found, voice data corresponding to the text can be found using the mapping information. The same is true for mapping information between encrypted voice data and tag and / or meta information.

Now, an operation of retrieving voice data stored in the remote storage device by using the mobile device M1 as an example will be described. The voice data may be searched by a search word, a tag, and meta data input from a user. Hereinafter, each of these cases will be described.

When the user inputs a search word, the mobile device M1 requests to transmit corresponding voice data while transmitting the search word to the remote storage device.

When the search word is transmitted from the mobile device M1, the remote storage device decrypts the stored encrypted text and finds that the search word is included in the decrypted text. When the text including the search word is found, the encrypted voice data corresponding to the text is searched using the mapping data, and the encrypted voice data is found based on the search result. The found encrypted voice data is then transmitted to the mobile device M1. The mobile device M1 decrypts the received voice data using the first unique key and the second unique key and outputs the decoded audio data in a form that a user can listen to.

When the tag or the metadata is input from the user, the mobile device M1 transmits the tag or the metadata to the remote storage device and requests that the corresponding voice data be transmitted. When the tag or meta data is transmitted from the mobile device M1, the remote storage device finds that the tag and meta information stored in the remote device include the tag or meta data transmitted from the mobile device M1. If the included tag or metadata is found, the corresponding encrypted voice data is searched using the mapping data and transmitted to the mobile device M1. The mobile device M1 decrypts the received voice data using the first unique key and the second unique key so that the user can listen.

In the above-described embodiment, the mapping data has been described as being separately stored, but this is merely an example, and the present invention is not limited thereto. For example, when storing encrypted text without separately managing mapping data, it is possible to store the storage address (physical address and / or logical address) of encrypted voice data corresponding to each encrypted text together. . When storing tag and meta information, it is also possible to store a storage address (physical address and / or logical address) of encrypted voice data corresponding to each tag and meta information.

2 is a functional block diagram of a mobile device according to an embodiment of the present invention.

Referring to FIG. 2, in the present embodiment, the voice data processor 101, the first encryption / decoding unit 103, the second encryption / decoding unit 105, the tag and meta information collecting unit 107, and the speech-to-text conversion unit are provided. 109, a third encryption unit 111, a control unit 113, a communication unit 115, a storage unit 117, and a user interface unit (UI) 119, 121, 123, and 125.

The voice data processor 101 processes the voice data in a form that the speaker 119 can output, or in the form of data (for example, analog or Digital data).

The first encryption / decryption unit 103 may encrypt the voice data using the first unique key, and decrypt the voice data decrypted by the second encryption / decryption unit 105 using the first unique key. can do.

The second encryption unit 105 may encrypt the voice data encrypted by the first encryption unit 103 with a second unique key, and encrypt the encrypted voice data received from the remote storage device to the second unique key. Can be decoded.

As the encryption algorithm used in the first encryption / decryption unit 103 or the second encryption unit 105, an encryption algorithm known so far or any encryption algorithm developed in the future may be used. Also, in the present embodiment, the first unique key and the second unique key may be different from each other or the same.

The tag and meta information collecting unit 107 collects meta data about tags or voice data input through the UI. Thereafter, the collected tags and metadata are transmitted to the remote storage device by the communication unit 115 together with the encrypted voice data in an encrypted or unencrypted state. For example, when the tag or meta information is encrypted, for example, it may be encrypted based on a symmetric key (secret key) or an asymmetric key (public key).

The speech-to-text converter 109 converts speech data into text. The speech-to-text converter 109 may, of course, utilize hardware and / or software techniques for converting speech data to text known or hereafter developed.

The third encryption unit 111 may encrypt the text converted by the voice-to-text converter 109 using a symmetric key (secret key) or an asymmetric key (public key). In this embodiment, since the remote storage device must be able to decrypt the encrypted text, it is assumed that the remote storage device has a decryption key capable of decrypting the encrypted text.

The storage unit 117 may store various keys for encryption (a first unique key, a second unique key, a secret key, and the like), and may store data or a program necessary for operating the mobile device. Alternatively, the storage unit 117 may store data or programs necessary for the mobile device to operate, and various keys for encryption may be stored in a separate storage unit (not shown) with enhanced security. have.

The controller 113 controls the overall operation of the mobile device, and controls the interaction of each component to be performed smoothly.

The communication unit 115 may transmit the encrypted voice data, the encrypted text, and the tag and meta information (encrypted or unencrypted) to the remote storage device. In addition, the communication unit 115 may receive encrypted voice data transmitted from the remote storage device.

The UI unit 119, 121, 123, and 125 includes a speaker 119, a display unit 121, an input unit 123, and a microphone 125. The speaker 119 outputs a voice, and the display unit 121 may display a screen. In addition, the input unit 123 may receive a user's command like a keypad, and the microphone 125 may receive a voice. According to an embodiment of the present invention, the input unit 123, in addition to the keypad, may further include a constituent means integrated in the display unit 121, such as a touch screen.

The signal received through the microphone 125 is converted into data in a form that can be processed by the components by the voice data processor 101.

When the data decoded by the first decoder 103 is converted into a form that can be output by voice by the voice data processor 101, the speaker 119 outputs the converted data as voice. Meanwhile, the tag or search word may be input through the input unit 121.

The unique key used in this embodiment may be implemented by a key generation algorithm. For example, the key generation algorithm may receive a product serial number and / or a password input from a user uniquely assigned to the mobile device and generate a unique key.

Meanwhile, referring to FIG. 2, components, for example, a voice data processor 101, a first encryption / decryption unit 103, a second encryption / decryption unit 105, a tag and meta information collection unit 107 may be used. ), Voice-to-text converter 109, third encryption unit 111, control unit 113, communication unit 115, storage unit 117, and user interface unit (UI) 119, 121, 123, 125 ) Are all connected by one communication line, it should be understood that the components that interact with each other under the control of the control unit 113 to communicate with each other. Alternatively, without control of the communication of the control unit 113, only the components interacting with each other may be connected to be directly communicated. In addition, as a method of connecting these components, it is of course possible to utilize all existing wired and wireless technologies or wired and wireless technologies to be developed in the future.

3 is a functional block diagram of a remote storage device according to an embodiment of the present invention. Referring to FIG. 3, the remote storage device includes a remote storage server 200 and a storage group 300.

In the present embodiment, the remote storage server 200 includes a communication unit 201, a management unit 203, a search unit 205, and a decryption unit 207, and the storage group 300 includes a mapping data storage unit 301. , Tag and meta information storage 303, encrypted voice data storage 305, and encrypted text storage 307.

The communication unit 201 supports communication with mobile devices. For example, the mobile device receives encrypted voice data, tags and meta information, encrypted text, a search word, and the like from the mobile devices, and transmits a search result according to a request of the mobile device to the mobile device.

The management unit 203 generates mapping information between the tag and meta information and the encrypted voice data, and stores the mapping information in the mapping data storage unit 301, and generates mapping information between the encrypted text and the encrypted voice data and generates the mapping data storage unit. Save to 301.

In addition, the manager 203 stores encrypted voice data, text, tag, and meta information transmitted from the mobile device in corresponding storage units, respectively.

The searcher 205 searches for encrypted voice data corresponding to the tag, meta information, or a search word received from the mobile device.

A case where tag or meta information is received from a user will be described first. In this case, the search unit 205 searches whether the tag or meta information is included in the data stored in the tag and meta information storage unit 303 to find the corresponding tag and meta information. Thereafter, the searcher 205 searches for the mapped voice data by referring to the mapping data stored in the mapping data storage unit 301 and uses the result to find the voice data stored in the encrypted voice data storage unit 305. have. The encrypted voice data thus found is transmitted to the mobile device by the communication unit 201. In the present embodiment, the tag and the meta information have been described on the premise that they are not encrypted. However, since the tag and the meta information may be encrypted, in such a case, the decryption unit 207 decrypts the tag and the meta information, and then decrypts it. Finds the tag or meta information that the user sent to the tag and meta information. The subsequent operation is the same.

Now, a case where a search word is received from a user will be described. In this case, the decryption unit 207 decrypts the data stored in the encrypted text storage unit 307, and the search unit 205 searches whether the search word is included in the decrypted data.

Here, the decoder 207 may decrypt using a symmetric key (secret key) or an asymmetric key (public key).

Subsequently, the search unit 205 searches for encrypted voice data corresponding to the text data found in the search result by referring to the mapping data stored in the mapping data storage unit 301. Thereafter, the found voice data is transmitted to the mobile device by the communication unit 201.

With continued reference to FIG. 3, the components, for example, the communication unit 201, the management unit 203, the search unit 205, and the decryption unit 207 are all connected by one communication line 209. However, it should be understood that the components interacting with each other under the control of a controller (not shown) communicate with each other. Alternatively, the components interacting with each other may be directly connected to each other without controlling the communication of the controller (not shown). In addition, as a method of connecting these components, it is of course possible to utilize all existing wired and wireless technologies or wired and wireless technologies to be developed in the future.

4 is a view provided to explain a voice data management method according to an embodiment of the present invention.

Referring to FIG. 4, when the voice signal is input through the microphone 125, the voice processing unit 101 converts the voice data into voice data (S401), and the voice-text converter 109 converts the converted voice data into text. In operation S403, the converted text is encrypted using the secret key in operation S413.

Meanwhile, the voice data is encrypted based on the first unique key by the first decryption unit 103 (S409), and subsequently encrypted by the second decryption unit 105 based on the second unique key. (S411).

In addition, the tag and meta information collecting unit 107 collects meta information about the voice data generated by the voice data processing unit 101, and also collects a tag input from the user (S407).

Thereafter, the communication unit 115 transmits the encrypted text, the encrypted voice data, and / or the tag and the meta information to the remote storage device (S413).

5 is a view provided to explain a voice data retrieval method according to an embodiment of the present invention.

Referring to FIG. 5, when a user inputs a search word through the input unit 123 (S501), the communication unit 115 transmits the search word to the remote storage device (S503). The communication unit 201 of the remote storage device receives the search word, the decryption unit 207 decrypts the encrypted text data, and the search unit 205 finds that the search word is included in the decrypted text (S505). . When the text including the search word is found, the search unit 205 refers to the mapping data (S507) and searches encrypted voice data corresponding thereto. Thereafter, the communication unit 201 transmits the found voice data to the mobile device (S509).

Meanwhile, when a tag is input as a search word or meta data is input from the user through the input unit 123 (S511), the communication unit 115 transmits the tag or metadata to the remote storage device (S513). The search unit 205 searches for the tag and the meta data transmitted from the mobile device, including the data stored in the tag and the meta information storage unit (S515), and if the search result exists, referring to the mapping data ( S517) Find the encrypted voice data corresponding thereto. Thereafter, the communication unit 201 transmits voice data to the mobile device (S509).

According to another embodiment of the present invention, there is provided a computer-readable recording medium having recorded thereon a program for executing the methods described above on a computer.

While the above has been shown and described with respect to preferred embodiments of the present invention, the present invention is not limited to the specific embodiments described above, it is usually in the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

1 is a functional block diagram of a voice data management apparatus of a mobile device according to an embodiment of the present invention;

2 is a functional block diagram of a mobile device according to an embodiment of the present invention;

3 is a functional block diagram of a remote storage device according to an embodiment of the present invention;

4 is a view provided to explain a voice data management method according to an embodiment of the present invention; and

5 is a view provided to explain a voice data retrieval method according to an embodiment of the present invention.

Brief description of the symbols in the drawings

100: mobile device 200: remote storage server

300: storage group 201: communication unit

101: voice data processing unit 103: first encryption and decryption unit

105: second encryption and decryption unit 107: tag and meta information collection unit

109: voice-to-text converter 111: third encryption unit

113: control unit 115: communication unit

117: storage unit 119: speaker

121: display unit 123: input unit

125: microphone 203: management unit

205: Search unit 207: Decryptor

301: mapping data storage unit 303: tag and meta information storage unit

305: encrypted voice data storage unit 307: encrypted text storage unit

Claims (21)

An apparatus for managing voice data of a mobile device, And a remote storage device configured to receive the encrypted voice data and the encrypted text converted from the voice data and the encrypted text by mapping the encrypted text and the encrypted text from the mobile device. , The remote storage device receives a search word from a mobile device, determines whether the search word is included in the encrypted text, and transmits the search word to the encrypted voice data mapped to the text including the search word. Voice data management apparatus of a mobile device, characterized in that for transmitting to. The method of claim 1, The mobile device further comprises; And the mobile device comprises a first encryption / decryption unit which encrypts voice data with a first unique key for uniquely identifying the mobile device. The method of claim 2, The mobile device, And a second encryption / decryption unit for encrypting the voice data encrypted by the first encryption / decryption unit with a second unique key for uniquely identifying the mobile device. The method of claim 2, The mobile device, And a voice to text converter for converting the voice data into text. 5. The method of claim 4, The mobile device, And a third encryption unit which encrypts the text converted by the voice-to-text conversion unit with a secret key. The method of claim 2, The mobile device, And a tag and meta information collecting unit for collecting at least one of a tag received from a user and meta information about the voice data. The tag and meta information collected by the tag and meta information collecting unit is transmitted to the remote storage device together with the encrypted voice data and the encrypted text. The method of claim 6, The remote storage device, And encrypting the encrypted voice data received from the mobile device, the encrypted text, and the tag and the meta information, respectively. The method of claim 7, wherein The remote storage device, And generating and storing mapping information between the encrypted voice data and the encrypted text, mapping information, and mapping information mapping the encrypted voice data with the tag and meta information to each other. Voice data management device. The method of claim 8, The mobile device, An input unit configured to receive a search word for searching for voice data from a user; And Further comprising: a communication unit for transmitting a search word received by the input unit, The remote storage device, A communication unit for receiving a search word from the mobile device; A decryption unit for decrypting the stored encrypted text; And And a searcher for searching whether the decoded text includes a search word received from the mobile device. The method of claim 8, The mobile device, An input unit configured to receive a tag for searching for voice data from a user; And The communication unit for transmitting the tag received by the input unit; further includes, The remote storage device, A communication unit receiving a tag from the mobile device; And And a searcher for searching whether the stored tag and the meta information include the tag transmitted from the mobile device. 10. The method of claim 9, The search unit, If it is found that the search word received from the mobile device is included in the decoded text, the voice data corresponding to the found text is searched with reference to the mapping data, The communication unit, And transmit the retrieved voice data to the mobile device. The method of claim 10, The search unit, If it is found that the tag transmitted from the mobile device is included among the tag and the meta information, the voice data corresponding to the found tag and the meta information is searched with reference to the mapping data, The communication unit, And transmit the retrieved voice data to the mobile device. In the method of managing voice data of a mobile device, Encrypting the voice data with a unique key uniquely identifying the mobile device; Converting the voice data into text and encrypting the voice data; Transmitting and storing the encrypted voice data and the encrypted text to a remote storage device; Collecting at least one of a tag received from a user and meta information about the voice data; And Storing, at the remote storage device, mapping information for mapping the encrypted voice data and the encrypted text to each other and mapping information for mapping the encrypted voice data and the tag and meta information to each other; How to manage voice data on mobile devices. The method of claim 13, The encrypting step, Encrypting voice data with a first unique key that uniquely identifies the mobile device; And Encrypting the voice data encrypted with the first unique key with a second unique key uniquely identifying the mobile device. The method of claim 13, The tag and meta information collected in the collecting step are transmitted to the remote storage device together with the encrypted voice data and the encrypted text. The method of claim 15, On the remote storage device, And storing the encrypted voice data, the encrypted text, and the tag and meta information received from the mobile device. The method of claim 16, Receiving a search word for searching for voice data from a user through the mobile device; And Receiving, by the remote storage device, the received search word; Decrypting the encrypted text stored on the remote storage device; And And searching whether the decoded text includes a search word received from the mobile device. The method of claim 16, Receiving a tag for searching for voice data from a user through a mobile device; And Receiving, by the remote storage device, the received tag; And searching whether the tag and the meta information include a tag transmitted from the mobile device. The method of claim 17, Searching for the voice data corresponding to the found text by referring to the mapping data and transmitting the searched text transmitted from the mobile device to the mobile device when the searched text including the search word received from the mobile device is found; Voice data management method of a mobile device comprising a. The method of claim 17, Searching for the voice data corresponding to the found tag and the meta information with reference to the mapping data and transmitting the searched voice data to the mobile device when the tag and the meta information are found to include a tag transmitted from the mobile device; Voice data management method of a mobile device comprising a. A computer-readable recording medium having recorded thereon a program for executing the method of claim 13 on a computer.

Images