KR20150054561A - Heterogeneous data conversion system and method of the same - Google Patents

Heterogeneous data conversion system and method of the same Download PDF

Info

Publication number
KR20150054561A
KR20150054561A KR1020130137152A KR20130137152A KR20150054561A KR 20150054561 A KR20150054561 A KR 20150054561A KR 1020130137152 A KR1020130137152 A KR 1020130137152A KR 20130137152 A KR20130137152 A KR 20130137152A KR 20150054561 A KR20150054561 A KR 20150054561A
Authority
KR
South Korea
Prior art keywords
user terminal
data
voice
character
user
Prior art date
Application number
KR1020130137152A
Other languages
Korean (ko)
Inventor
남기원
박길주
Original Assignee
박길주
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 박길주 filed Critical 박길주
Priority to KR1020130137152A priority Critical patent/KR20150054561A/en
Publication of KR20150054561A publication Critical patent/KR20150054561A/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/18—Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02—Terminal devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The present invention relates to a heterogeneous data conversion system, in which a user can not make a voice call, and in a situation where a voice communication is possible by the user of the other party, the voice signal of the other party is converted into characters, The voice data input from the terminal is converted into a voice signal so that the voice data can be heard by the other party so that the voice communication can be performed. When the voice mute function of the TV is performed, the voice data included in the broadcast program can be read out, The present invention has been made in view of the above problems, and it is an object of the present invention to provide a heterogeneous data conversion system capable of accurately grasping the contents of a broadcast program even in a state where the volume of the broadcast program is greatly reduced.

Description

TECHNICAL FIELD [0001] The present invention relates to a heterogeneous data conversion system,

The present invention relates to a heterogeneous data conversion system and a method thereof, more specifically, a situation in which a user can not make a voice call, and in a situation in which a voice communication is possible, And outputting the voice data, and converting the voice data input from the user terminal into a voice signal so that the other party can hear the voice data.

In general, mobile phones have become so popular that they become a necessity for modern people, and apart from when they are sleeping, they are rarely apart from mobile phones.

However, this is often the case when voice calls can not be performed inevitably. If you are in a meeting or class, you can not make a voice call while you are enjoying a movie or a concert at a movie theater or a concert. Most of the time, you will briefly say that you will call again.

On the other hand, there are cases where all the family members are sleeping or voice calls are not possible in the late night time zone. On the other hand, the calling party may be able to make a voice call.

In this case, although it is possible to communicate with each other even if a text message is exchanged with each other, if the text message is clearly different from a voice communication and especially if the communication party does not enjoy text messages or is not skilled in text input There has been a problem that communication via a text message becomes very inconvenient.

In addition, in the case of a hearing-impaired person, since voice communication with a non-disabled person is not possible, there is a problem that voice communication with a non-disabled person is impossible in addition to morse code communication by sound generated by tapping the telephone.

This case also appears during TV watching.

That is, when the mute function must be performed urgently during the TV viewing, the viewer can sufficiently gaze at the screen of the TV, but often merely mutes. However, in this case, since the story must be judged only by the gesture of the actor appearing in the broadcast program, it is very frustrating, resulting in misunderstanding of the story or disconnection of the story during the mute time.

SUMMARY OF THE INVENTION The present invention has been made in view of the circumstances of the prior art described above, and it is an object of the present invention to provide a voice communication method, a voice communication method, And to provide a heterogeneous data conversion system and a method thereof, in which voice data input from the user terminal is converted into a voice signal so that the other party can hear the voice data so that a character conversation can be performed.

It is another object of the present invention to provide a television receiver capable of accurately displaying contents of a broadcast program even during a mute function or in a greatly reduced volume by outputting a voice signal included in a broadcast program as a character on the screen so that the voice signal can be read, A data conversion system and a method thereof.

According to a preferred embodiment of the present invention, a second user terminal (2B) for performing a voice call through a voice communication network; A text communication application 50 for converting the voice data received from the second user terminal 2B through the voice communication network into character data and outputting the character data to the screen and converting the inputted character data into voice data is built in, And a first user terminal (2A) for transmitting the converted voice data through the text communication application (50) to the second user terminal (2B) through a voice communication network.

Preferably, the first user terminal 2A is formed with a character input / output screen 6 for inputting and outputting characters on a screen in a text communication mode operation mode.

Preferably, the first user terminal 2A specifies character information for each user stored in the personal telephone directory so that the character designated by the communication partner can be output as image data or flash data on the character input / output screen 6 A heterogeneous data conversion system is provided.

Preferably, the first user terminal 2A includes therein a text communication mode selection unit 22 for selecting a text communication mode for a voice call request of the communication partner; A voice hooking unit 24 for hooking the voice data received by the voice communication unit 24 built in the terminal; A character input unit 34 for inputting a character for a character call; A data conversion unit 28 for recognizing the hooked voice data through the voice hooking unit 24 and converting the voice data into characters, and converting the character data input through the character input unit 34 into voice data; Converts the voice data transmitted from the communication counterpart terminal to a character and displays it on a screen by selecting a character currency of the user, converts the character data input by the user into corresponding voice data, and controls each configuration so as to be transmitted to the corresponding calling party terminal And a control unit (42) for controlling the data conversion system.

Preferably, the first user terminal 2A includes therein a data storage unit 40 storing a specific boilerplate as voice data; The system for converting heterogeneous data further comprises a boilerplate selection unit (36) for selecting a specific boilerplate in the data storage unit (40).

Preferably, the first user terminal 2A further includes an output voice selection unit 38 for selecting a tone color or a voice style of voice data to be transmitted to the communication partner terminal. A conversion system is provided.

Preferably, the control unit 42 controls the speaker 30 to be muted when the text communication mode is selected through the text communication mode selection unit 22.

According to another aspect of the present invention, there is provided a mobile communication terminal, comprising: a) a first user terminal (2A) receiving a voice call signal from a second user terminal (2B); b) determining whether the first user terminal 2A receives a text communication mode selection signal; c) informing the second user terminal 2B that the first user terminal 2A is a called party communication mode; d) receiving voice data from the second user terminal (2B) by the first user terminal (2A); e) converting the voice data into character data by the first user terminal 2A; f) determining whether input of character data is performed by the first user terminal 2A; g) converting the inputted character data into voice data by the first user terminal 2A; and h) transmitting the voice data to the second user terminal (2B) by the first user terminal (2A).

Preferably, the step c) further comprises the step of the first user terminal 2A initiating a mute function.

Preferably, in the e) process, the process of recognizing the voice data is pre-processed.

Preferably, the step (e) further includes a step of outputting the character data after the conversion, and the first user terminal 2A can output the characters of the calling party together. do.

Preferably, the method further comprises the step of selecting previously registered auto-voices and extracting audio data matched to the auto-voices in steps f) and g).

According to another aspect of the present invention, there is provided a mobile communication terminal, comprising: a) a first user terminal (2A) receiving a voice call signal from a second user terminal (2B); b) determining whether the first user terminal 2A receives a text communication mode selection signal; c) informing the second user terminal 2B that the first user terminal 2A is a called party communication mode; d) determining whether the second user terminal 2B receives a user's voice signal; e) converting the voice signal of the user into character data by the second user terminal 2B; f) transmitting, by the second user terminal 2B, the converted character data to the first user terminal 2A; g) outputting character data received by the first user terminal 2A from the second user terminal 2B on the screen; h) determining whether the character string data of the user is inputted by the first user terminal 2A; i) converting the corresponding character data into voice data by the first user terminal 2A; and j) transmitting the voice data to the second user terminal (2B) by the first user terminal (2A).

Preferably, the step (c) further comprises a step in which the first user terminal 2A starts a mute function.

In the meantime, the present invention provides a method for a mobile communication terminal, comprising the steps of: a) determining, by the first user terminal 2A, whether a voice call signal is received from a second user terminal 2B; b) determining whether the first user terminal 2A receives a text communication mode selection signal; c) informing the second user terminal 2B that the first user terminal 2A is a called party communication mode; d) receiving voice data from the second user terminal (2B) by the first user terminal (2A); e) converting the voice data into character data by the first user terminal 2A; f) determining whether input of character data is performed by the first user terminal 2A; g) converting the inputted character data into voice data by the first user terminal 2A; h) transmitting the voice data to the second user terminal (2B) by the first user terminal (2A); i) the first user terminal 2A receiving a text communication mode notification signal from the second user terminal 2B; j) determining whether the second user terminal 2B inputs character data; (k) transmitting the input character data to the first user terminal (2A) in a state where the second user terminal (2B) maintains a call connection, and performing a character communication. A data conversion method is provided.

Preferably, the first user terminal 2A determines whether a call connection selection signal is applied between steps a) and b); The method further comprises the step of the first user terminal 2A processing call connection to the second user terminal 2B.

Preferably, in the step k), the first user terminal 2A skips the process of converting input character data into voice data and transmits character data to the second user terminal 2B The method comprising the steps of:

Preferably, the k-th process includes a process of the second user terminal 2B performing a mute function.

Preferably, the step (k) further comprises a step of performing a connection through a data communication network so that the second user terminal 2B can communicate with the first user terminal 2A while the second user terminal 2B is in a call A heterogeneous data conversion method is provided.

Preferably, the method further comprises the step of determining whether the second user terminal 2B receives a return signal to the original voice call state after the step k); When the return signal is applied, the second user terminal 2B releases the muting and releases the connection of the data communication network.

In the meantime, the present invention provides a mobile communication terminal comprising: a second user terminal (2B) for performing a voice communication through a voice communication network; The voice data received from the second user terminal 2B through the voice communication network is transmitted to the heterogeneous data conversion server 60 and received as character data from the heterogeneous data transformation server 60 and displayed on the screen, (50) for transmitting the character data input by the second user terminal (2B) to the heterogeneous data conversion server (60) and receiving the character data as voice data and transmitting the same to the voice communication network 1 user terminal 2A; Receives the specific voice data from the first user terminal 2A and converts it into character data of the same content and transmits it to the first user terminal 2A, receives specific character data from the first user terminal 2A, And a heterogeneous data conversion server (60) for converting the data into audio data of contents and transmitting the data to the first user terminal (2A).

Preferably, the first user terminal 2A receives the voice data from the heterogeneous data conversion server 60 and is configured to automatically transmit the voice data to the second user terminal 2B where the voice call path is formed Is provided.

Preferably, the heterogeneous data conversion server 60 further comprises a data transfer unit 64 for transferring the converted voice data directly to the second user terminal 2B.

It is preferable that the telephone number information of the first user terminal 2A and the second user terminal 2B is further included in the character data packet requested to be converted from the first user terminal 2A to the voice data Is provided.

Meanwhile, the present invention includes a remote controller 80 for generating a mute signal; A data conversion unit (not shown) provided in the television apparatus 74 for receiving a mute signal from the remote controller 80 to perform a mute function, recognizing a voice signal included in the broadcast program, converting the voice signal into caption data, (90). The system for converting heterogeneous data is provided.

The data conversion unit 90 controls the screen control unit 94 to output the converted caption data to the caption output window 78 provided separately at the lower end of the screen 76 of the television device 74 A heterogeneous data conversion system is provided.

Preferably, the television apparatus 74 further includes a voice data extracting unit 92 for extracting a voice signal included in the broadcast program and providing the extracted voice signal to the data converting unit 90. / RTI >

Preferably, the broadcast program includes video data, audio data, and caption data in advance, and the caption data can be extracted by the data conversion unit 90 and displayed on the screen only when the audio data is muted. A heterogeneous data conversion system is provided.

Preferably, the data conversion unit 90 controls the subtitle data of the corresponding program to be output to the screen even when the output volume through the speaker is reduced to a preset value or less.

Preferably, the television device 74 comprises a set-top box or a mobile terminal.

In the heterogeneous data conversion system and method according to the present invention, a user who can not make a voice call can perform a text conversation while allowing a call partner to proceed with a voice conversation, thereby facilitating a call at a place of a movie theater, a conference room, And the hearing-impaired person has the advantage of being able to communicate with the non-disabled person. In addition, text communication can be performed according to a change in the status of the user, and it is possible to easily return to the voice call again without retrying call connection, thereby greatly improving the convenience of communication. In addition, even when the TV is applied, the audio included in the broadcast program is displayed on the screen as subtitles, so that the broadcast contents can be clearly judged even when the volume is greatly reduced during mute or late night.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram showing a configuration and a conversion state of a heterogeneous data conversion system according to a first embodiment of the present invention;
2 is a diagram illustrating an output state of data converted through the heterogeneous data conversion system according to the first embodiment of the present invention,
3 is a diagram illustrating a state in which a text conversation is performed through a heterogeneous data conversion system according to a first embodiment of the present invention;
FIG. 4 is a block diagram illustrating a configuration of a user terminal included in a heterogeneous data conversion system according to a first embodiment of the present invention; FIG.
5 is a diagram showing a configuration and a conversion state of a heterogeneous data conversion system according to a second embodiment of the present invention.
6 is a flowchart showing a conversion state of the heterogeneous data conversion system according to the third embodiment of the present invention,
7 is a diagram showing a configuration and a conversion state of a heterogeneous data conversion system according to a fourth embodiment of the present invention.
8 is a diagram showing a configuration and a conversion state of a heterogeneous data conversion system according to a fifth embodiment of the present invention.
9 is a view showing a data packet and a processing state to be processed in a heterogeneous data conversion system according to a fifth embodiment of the present invention;
10 is a diagram illustrating another example of data conversion through the heterogeneous data conversion system according to the fifth embodiment of the present invention.

Hereinafter, a heterogeneous data conversion system according to a first embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing a configuration and a conversion state of a heterogeneous data conversion system according to a first embodiment of the present invention. FIG. 2 is a block diagram showing the output state of data converted through the heterogeneous data conversion system according to the first embodiment of the present invention FIG. 3 is a diagram illustrating a state in which a text conversation is performed through the heterogeneous data conversion system according to the first embodiment of the present invention.

Referring to this, in the heterogeneous data conversion system according to the first embodiment of the present invention, a voice call can not be performed by any one user, and the voice communication of the user can be converted into a voice And the voice data inputted from the user terminal is converted into a voice signal so that the other party can hear the voice data so that a character conversation can be performed.

More specifically, in the heterogeneous data conversion system according to the first embodiment of the present invention, any one of a plurality of users performing a call performs a voice call, and even when a user performs a character call, mutual communication is possible .

To this end, in the heterogeneous data conversion system according to the first embodiment of the present invention, the character data inputted from the user side, which can only transmit or browse characters, is converted into voice data and outputted to the user terminal capable of voice communication, The voice data inputted through the terminal of the user who can communicate is converted into character data and outputted to the user terminal capable of the character communication.

In more detail, the heterogeneous data conversion system according to the first embodiment of the present invention comprises: a second user terminal 2B for performing a voice communication through a voice communication network; A text communication application 50 for converting the voice data received from the second user terminal 2B through the voice communication network into character data and outputting the character data to the screen and converting the inputted character data into voice data is built in, And a first user terminal 2A for transmitting the converted voice data through the text communication application 50 to the second user terminal 2B through the voice communication network.

That is, in the heterogeneous data conversion system according to the first embodiment of the present invention, when the user who owns the first user terminal 2A can perform voice communication from the second user terminal 2B, The user who owns the second user terminal 2B can perform the same voice call while maintaining the call connection.

At this time, the first user terminal 2A is equipped with the text communication application 50, so that the voice data is converted into character data and output to the screen, the input character data is converted into voice data, The terminal 2B performs voice communication just like a conventional terminal, so that the text communication application 50 is not required.

Accordingly, the first user terminal 2A forms a character input / output screen 6 for inputting and outputting characters on the screen in the text communication mode.

In addition, the first user terminal 2A stores in advance the voice data 12 that can be matched with the emoticon 8 input to the character input / output screen 6 so that the emoticon and the voice data are mutually converted .

The first user terminal 2A is configured such that character information for each user stored in the personal phone book is designated so that the character 10 designated by the call partner can be output as image data or flash data on the character input / output screen 6 .

In this case, the user designates the character 10 designated by the calling party as the character of the image as close as possible to the calling party, so that the user who performs the character conversation using the first user terminal 2A during the character conversation, You feel like you are making a voice call with the other party.

In this case, in the heterogeneous data conversion system according to the first embodiment of the present invention, the term 'character call' is used. Actually, a call means a voice call and a character is a character communication. In the present invention, It is known that the coinage is used as a character currency since it carries out communication with the other party in a state where it is maintained.

Therefore, the heterogeneous data conversion system according to the first embodiment of the present invention receives the voice call paging signal from the second user terminal 2B in a state where the character phone application 50 is mounted on the first user terminal 2A When the first user terminal 2A receives a call connection, the first user can perform a general call according to a situation, and can select a mode in which a character call can be performed.

No matter which mode the first user selects, the call connection is maintained with the call connection made.

If the first user selects the text communication mode, the first user terminal 2A informs the second user terminal 2B that the first user terminal 2A is the called character communication mode. In other words, "You have selected the text currency for the person who is currently speaking. Quot ;, the voice or voice of the other party will be output as the voice of the designated person " to the second user terminal 2B.

At the same time, the first user terminal 2A starts the mute function.

In this state, when the second user inputs a voice signal to the second user terminal 2B, the first user terminal 2A receives the voice data from the second user terminal 2B.

Then, the first user terminal 2A performs preprocessing for recognizing the voice data of the second user, converts the voice data into character data, and outputs it to the screen.

For example, the second user may say, "Nice to meet you. friend. Quot; haha ", the first user terminal 2A has said " Thank you. friend. You can convert it to "ㅋㅋ".

At this time, the user registers the designated character 10 according to the calling party in advance and causes the designated character 10 of the calling party to be displayed on the screen when inputting or outputting the character data through the character input / output screen 6. Preferably, if the calling party is a fat person, if the designated character 10 is also designated as a fat person character, a fat character is displayed on the character input / output screen 6 at the time of a next character call.

In this case, it is preferable that the character data of the received communication partner and the character data input by the first user are separately output through the different character communication windows 14a and 14b, ) On the screen.

Next, the first user terminal 2A determines whether character data is input. When the first user inputs character data through the first user terminal 2A, the first user terminal 2A 2A convert the input character data into voice data.

At this time, the first user terminal 2A registers the boilerplate in advance, and the first user can display a simple button or the corresponding boilerplate to directly select the boilerplate, thereby further enhancing convenience.

For example, a user can directly register a commercial article on the first user terminal 2A and say, "Brother, I'm supposed to have dinner this evening. "Or, you can register a sentence like" Are you kids? "Or" Where are you now? "Or" Today's weather is good. "

Then, the first user terminal 2A transmits the voice data to the second user terminal 2B. Then, the second user makes a general voice call. However, the voice of the first user may be heard in the voice of another person who has been set in advance, or the first user may record all the syllables in advance and extract the voice in accordance with the voice and transmit the voice to the second user terminal 2B, In this case, even if the pronunciation is somewhat awkward, the voice of the first user can be heard.

Therefore, the heterogeneous data conversion system according to the first embodiment of the present invention can be used conveniently by a user or a hearing-impaired person who is in a state in which voice communication is impossible, but is capable of voice communication only, It can be used very effectively.

4 is a block diagram illustrating a configuration of a user terminal included in a heterogeneous data conversion system according to a first embodiment of the present invention.

Referring to FIG. 1, a user terminal included in the heterogeneous data conversion system according to the first embodiment of the present invention, that is, a user terminal 2A equipped with the text communication application 50, A communication module (20) for performing communication and data communication; A text communication mode selection unit (22) for selecting a text communication mode with respect to a voice call request of a communication partner; A voice hooking unit 24 for hooking the voice data received by the voice communication unit 24 built in the terminal; A character input unit 34 for inputting a character for a character call; A data conversion unit 28 for recognizing the hooked voice data through the voice hooking unit 24 and converting the voice data into characters, and converting the character data input through the character input unit 34 into voice data; Converts the voice data transmitted from the communication counterpart terminal to a character and displays it on a screen by selecting a character currency of the user, converts the character data input by the user into corresponding voice data, and controls each configuration so as to be transmitted to the corresponding calling party terminal And a control unit 42 for controlling the operation of the apparatus.

At this time, the first user terminal 2A includes therein a data storage unit 40 storing a specific type of basic data as voice data; The data storing unit 40 further includes a boiler selector 36 for selecting a specific boilerplate.

In addition, the first user terminal 2A further includes an output voice selection unit 38 for selecting a tone color or a voice style of voice data transmitted to the communication partner terminal.

The control unit 42 controls the speaker 30 to be muted when the text communication mode is selected through the text communication mode selection unit 22. [

Hereinafter, a heterogeneous data conversion system according to a second embodiment of the present invention will be described in detail with reference to the drawings.

5 is a diagram showing a configuration and a conversion state of a heterogeneous data conversion system according to a second embodiment of the present invention.

Referring to this, as in the first embodiment, the heterogeneous data conversion system according to the second embodiment of the present invention allows a user to perform a text conversation because voice conversation is impossible, In order to shorten the call waiting time, the character phone application 50 is mounted on each terminal so that the first user terminal 2A can voice the character data inputted by the first user And transmits the converted data to the second user terminal 2B through the voice communication network. The second user terminal 2B converts the voice data to be transmitted to the first user terminal 2A into character data and transmits the converted character data.

That is, the first user terminal 2A converts the character data input by the first user into the voice data by the character phone application 50, and the character phone application 50 of the second user terminal 2B converts the second character by the second Converts the voice data input by the user into character data, and transmits the character data to one user terminal 2A.

In the heterogeneous data conversion system according to the second embodiment of the present invention, the first user terminal 2A is provided with the text communication application 50 And receives a voice call signal from the second user terminal 2B in a mounted state.

Then, the first user can make a call connection through the first user terminal 2A. When a call connection is made, the first user can perform a normal call according to the situation, You can choose a mode to perform.

No matter which mode the first user selects, the call connection is maintained with the call connection made.

If the first user selects the text communication mode, the first user terminal 2A informs the second user terminal 2B that the first user terminal 2A is the called character communication mode. In other words, "You have selected the text currency for the person who is currently speaking. Quot ;, the voice or voice of the other party will be output as the voice of the designated person " to the second user terminal 2B.

At the same time, the first user terminal 2A starts the mute function.

In this state, when the second user inputs a voice signal to the second user terminal 2B, the character phone application 50 mounted on the second user terminal 2B converts the voice data into character data Conversion.

Then, the second user terminal 2B transmits the converted character data to the first user terminal 2A. Then, the first user terminal 2A receives character data from the second user terminal 2B.

The first user terminal 2A outputs corresponding character data to the screen.

For example, the second user may say, "Nice to meet you. friend. Quot; haha " in the second user terminal 2B. friend. Quot ;, so that it can be transferred to the first user terminal 2A and displayed on the screen.

Next, the first user terminal 2A determines whether character data is input. When the first user inputs character data through the first user terminal 2A, the first user terminal 2A 2A convert the input character data into voice data.

At this time, the first user terminal 2A registers the boilerplate in advance, and the first user can display a simple button or the corresponding boilerplate to directly select the boilerplate, thereby further enhancing convenience.

Then, the first user terminal 2A transmits the voice data to the second user terminal 2B. Then, the second user makes a general voice call.

Hereinafter, a heterogeneous data conversion system according to a third embodiment of the present invention will be described in detail with reference to the drawings.

6 is a flowchart showing a conversion state of the heterogeneous data conversion system according to the third embodiment of the present invention.

Referring to this, as in the first and second embodiments, the heterogeneous data conversion system according to the third embodiment of the present invention allows a user to perform a text conversation because voice conversation is impossible, The second user terminal 2B is provided with a text communication application 50 capable of text communication so that when a voice communication is impossible during a voice communication, A voice communication is possible at any time in the state of a voice communication, and a voice communication can be performed through a voice communication network again when a voice communication is possible during a voice communication.

An operation state of the heterogeneous data conversion system according to the third embodiment of the present invention will be described with reference to FIG. And receives a paging signal (ST-1).

Then, the first user can make a call connection through the first user terminal 2A. When the call connection is made, the first user can perform a normal call according to the situation (ST-5 ), And can select a mode for performing a character conversation.

No matter which mode the first user selects, the call connection is maintained with the call connection made (ST-2, ST-3).

If the first user selects the text communication mode (ST-4), the first user terminal 2A informs the second user terminal 2B of the called character communication mode, that is, The terminal 2A has selected "the character telephone call for the convenience of the person who is currently speaking. The voice or voice of the other party will be outputted as the voice of the designated person " to the second user terminal 2B (ST-7).

In this state, when the second user inputs a voice signal to the second user terminal 2B, the second user terminal 2B transmits voice data to the first user terminal 2A (ST- 8).

At the same time, the first user terminal 2A starts the mute function (ST-9).

Then, the first user terminal 2A performs preprocessing for recognizing the voice data of the second user, converts the voice data into character data, and outputs it to the screen (ST-10).

Next, a step ST-11 for judging whether the first user terminal 2A inputs character data is performed. When the first user inputs character data through the first user terminal 2A, The first user terminal 2A converts the input character data into voice data.

At this time, the first user terminal 2A registers the commercial article in advance, and the first user is displayed on the screen so that the user can directly select the simple button or the commercial article, thereby further enhancing the convenience (ST-12).

Then, the first user terminal 2A transmits the voice data to the second user terminal 2B. Then, the second user makes a general voice call (ST-13).

The second user terminal 2B may determine that the second user selects the text communication mode, and the second user selects the text communication mode If so, the second user terminal 2B transmits a text communication mode notification signal to the first user terminal 2A (ST-14).

On the other hand, the second user can continuously perform voice communication and terminate the call (ST-15).

If the first user terminal 2A has received the text communication mode notification signal from the second user terminal 2B, the second user terminal 2B determines whether character data is input (ST- 16).

If the second user terminal 2B receives the character data, the second user terminal 2B connects to the data communication network while keeping the call connection state, Communication is performed (ST-17, 18).

That is, since the text communication application 50 installed in the second user terminal 2B already recognizes the call connection information, it is possible to transmit a desired user terminal, for example, a first user The character data can be immediately transmitted to the terminal 2A.

Hereinafter, since the first and second user terminals 2A and 2B perform character communication, the first user terminal 2A skips the process of converting the inputted character data into voice data, (2B).

In this state, the second user terminal 2B determines whether a return signal to the original voice call state is applied, and when the return signal is applied, the second user terminal 2B releases the muting, (ST-19).

At this time, when the character phone application 50 installed in the second user terminal 2B is in a state in which voice communication is possible again during a text conversation and returns to a voice call, since a call connection is established, So that voice communication is possible immediately.

Therefore, in the heterogeneous data conversion system according to the third embodiment of the present invention, the user can selectively perform the voice communication while maintaining the call connection, thereby allowing the user to freely change the voice communication and the text communication according to the situation of the user And it is very convenient since there is no additional call connection attempt when the change is made.

Hereinafter, a heterogeneous data conversion system according to a fourth embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 7 is a diagram showing a configuration and a conversion state of a heterogeneous data conversion system according to a fourth embodiment of the present invention.

In the heterogeneous data conversion system according to the fourth embodiment of the present invention, as in the first embodiment, a user performs a text conversation because voice conversation is impossible, and the conversation partner of the user can perform voice conversation The voice data is converted into character data or the character data is converted into voice data in a separate heterogeneous data conversion server 60. In this system,

The heterogeneous data conversion system according to the fourth embodiment of the present invention has the same function and purpose as those of the first and second embodiments, but has a constitutionally insignificant difference.

In more detail, the heterogeneous data conversion system according to the fourth embodiment of the present invention includes a second user terminal 2B for performing a voice call through a voice call network; The voice data received from the second user terminal 2B through the voice communication network is transmitted to the heterogeneous data conversion server 60 and received as character data from the heterogeneous data transformation server 60 and displayed on the screen, (50) for transmitting the character data input by the second user terminal (2B) to the heterogeneous data conversion server (60) and receiving the character data as voice data and transmitting the same to the voice communication network 1 user terminal 2A; Receives the specific voice data from the first user terminal 2A and converts it into character data of the same content and transmits it to the first user terminal 2A, receives specific character data from the first user terminal 2A, And transmits the converted voice data to the first user terminal 2A.

At this time, when the first user terminal 2A receives the voice data from the heterogeneous data conversion server 60, the first user terminal 2A is configured to automatically transmit the voice data to the second user terminal 2B where the voice call path is formed.

The heterogeneous data conversion server 60 includes a data conversion unit 62 for converting the voice data into the character data or converting the character data into the voice data and transmits the converted voice data to the second user terminal 2B. And a data transfer unit 64 for transferring data directly to the data transfer unit.

On the other hand, the telephone number information 72A and 72B of the first user terminal 2A and the second user terminal 2B are further included in the character data packet requested to be converted from the first user terminal 2A to the voice data The heterogeneous data conversion server 60 matches and stores an icon (Text, Sound: T, S) 68, 70 indicating a subject of text communication and a subject of voice communication, respectively.

Hereinafter, a heterogeneous data conversion system according to a fifth embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 8 is a diagram showing the configuration and conversion state of a heterogeneous data conversion system according to a fifth embodiment of the present invention. FIG. 9 is a diagram showing a data packet processed in the heterogeneous data conversion system according to the fifth embodiment of the present invention, And FIG. 10 is a diagram showing another example of data conversion through the heterogeneous data conversion system according to the fifth embodiment of the present invention.

Referring to this, the heterogeneous data conversion system according to the fifth embodiment of the present invention outputs a voice signal included in a broadcast program when a mute function of a TV is performed or a volume output below a preset value, It is a system that can grasp the contents of program precisely.

To this end, the heterogeneous data conversion system according to the fifth embodiment of the present invention includes a remote controller 80 for generating a mute signal; A data conversion unit (not shown) provided in the television apparatus 74 for receiving a mute signal from the remote controller 80 to perform a mute function, recognizing a voice signal included in the broadcast program, converting the voice signal into caption data, (90).

The data conversion unit 90 controls the screen control unit 94 to output the converted caption data to the caption output window 78 separately provided at the lower end of the screen 76 of the television device 74. [

The television apparatus 74 further includes a voice data extraction unit 92 for extracting the voice signal 86 included in the broadcast program and providing the extracted voice signal 86 to the data conversion unit 90.

9, the content portion 82b of the broadcast program data 82 includes the video data 84, the audio data 86 and the caption data 88 in advance, and the caption data 88 May be extracted by the data conversion unit 90 and displayed on the screen only when the voice data 86 is muted.

At this time, the broadcast program data 82 is divided into a head part 82a, a content part 82b and a frame part 82c for notifying the type of one packet, as in a general data packet.

In addition, the data conversion unit 90 controls the subtitle data of the corresponding program to be displayed on the screen even when the output volume through the speaker is reduced to a preset value or less.

Meanwhile, the television set 74 includes a set-top box or a mobile terminal, and all terminals to which a TV broadcast program is output correspond to the TV set 74.

Meanwhile, the heterogeneous data conversion system and method according to the embodiment of the present invention are not limited to the above-described embodiments, and various modifications are possible within the scope of the present invention.

2A: first user terminal, 2B: second user terminal,
22: text communication mode selection unit, 26: voice hooking unit,
28: data conversion unit, 36: boilerplate selection unit,
38: output voice selection unit, 42: control unit,
50: text communication application, 60: heterogeneous data conversion server.

Claims (30)

A second user terminal (2B) for performing a voice communication through a voice communication network;
A text communication application 50 for converting the voice data received from the second user terminal 2B through the voice communication network into character data and outputting the character data to the screen and converting the inputted character data into voice data is built in, And a first user terminal (2A) for transmitting the converted voice data through the text communication application (50) to the second user terminal (2B) through a voice communication network. The method according to claim 1,
Wherein the first user terminal (2A) is formed with a character input / output screen (6) for inputting and outputting a character on a screen during a text communication mode operation. The method according to claim 1,
The first user terminal 2A is characterized in that character information for each user stored in the personal telephone directory is designated and stored so that the character designated by the calling party can be output as image data or flash data on the character input / output screen 6 Heterogeneous data conversion system. The method according to claim 1,
The first user terminal 2A includes a text communication mode selection unit 22 for selecting a text communication mode for a voice call request of a communication partner;
A voice hooking unit 24 for hooking the voice data received by the voice communication unit 24 built in the terminal;
A character input unit 34 for inputting a character for a character call;
A data conversion unit 28 for recognizing the hooked voice data through the voice hooking unit 24 and converting the voice data into characters, and converting the character data input through the character input unit 34 into voice data;
Converts the voice data transmitted from the communication counterpart terminal to a character and displays it on a screen by selecting a character currency of the user, converts the character data input by the user into corresponding voice data, and controls each configuration so as to be transmitted to the corresponding calling party terminal And a control unit (42) for controlling the operation of the heterogeneous data conversion system. The method according to claim 1,
The first user terminal 2A includes a data storage unit 40 storing a specific type of basic data as voice data;
Wherein the data storing unit (40) further comprises a boilerplate selection unit (36) for selecting a specific boilerplate. The method according to claim 1,
Wherein the first user terminal (2A) further includes an output voice selection unit (38) for selecting the tone color or voice style of the voice data transmitted to the communication partner terminal. 5. The method of claim 4,
Wherein the control unit (42) controls the speaker (30) to be muted when the text communication mode is selected through the text communication mode selection unit (22). a) receiving a voice call signal from the second user terminal (2B) by the first user terminal (2A);
b) determining whether the first user terminal 2A receives a text communication mode selection signal;
c) informing the second user terminal 2B that the first user terminal 2A is a called party communication mode;
d) receiving voice data from the second user terminal (2B) by the first user terminal (2A);
e) converting the voice data into character data by the first user terminal 2A;
f) determining whether input of character data is performed by the first user terminal 2A;
g) converting the inputted character data into voice data by the first user terminal 2A;
and h) transmitting the voice data to the second user terminal (2B) by the first user terminal (2A). 9. The method of claim 8,
And the step c) further comprises the step of the first user terminal 2A initiating the mute function. 9. The method of claim 8,
Wherein the step of e) is pre-processing for recognizing the voice data. 9. The method of claim 8,
The step e) further includes the step of outputting the character data after the conversion,
Wherein the first user terminal (2A) is capable of outputting a character for each communication party together. 9. The method of claim 8,
The method of claim 1, further comprising the step of selecting previously registered voices and extracting audio data matched to the corresponding voices. a) receiving a voice call signal from the second user terminal (2B) by the first user terminal (2A);
b) determining whether the first user terminal 2A receives a text communication mode selection signal;
c) informing the second user terminal 2B that the first user terminal 2A is a called party communication mode;
d) determining whether the second user terminal 2B receives a user's voice signal;
e) converting the voice signal of the user into character data by the second user terminal 2B;
f) transmitting, by the second user terminal 2B, the converted character data to the first user terminal 2A;
g) outputting character data received by the first user terminal 2A from the second user terminal 2B on the screen;
h) determining whether the character string data of the user is inputted by the first user terminal 2A;
i) converting the corresponding character data into voice data by the first user terminal 2A;
and j) transmitting the voice data to the second user terminal (2B) by the first user terminal (2A). 14. The method of claim 13,
The method of claim 1, wherein the step (c) further comprises the step of the first user terminal (2A) initiating a mute function. a) determining by the first user terminal 2A whether a voice call signal is received from the second user terminal 2B;
b) determining whether the first user terminal 2A receives a text communication mode selection signal;
c) informing the second user terminal 2B that the first user terminal 2A is a called party communication mode;
d) receiving voice data from the second user terminal (2B) by the first user terminal (2A);
e) converting the voice data into character data by the first user terminal 2A;
f) determining whether input of character data is performed by the first user terminal 2A;
g) converting the inputted character data into voice data by the first user terminal 2A;
h) transmitting the voice data to the second user terminal (2B) by the first user terminal (2A);
i) the first user terminal 2A receiving a text communication mode notification signal from the second user terminal 2B;
j) determining whether the second user terminal 2B inputs character data;
(k) transmitting the input character data to the first user terminal (2A) in a state where the second user terminal (2B) maintains a call connection, and performing a character communication. Data conversion method. 16. The method of claim 15,
Between the steps a) and b)
The first user terminal 2A determining whether a call connection selection signal is applied;
Further comprising the step of the first user terminal (2A) processing call connection to the second user terminal (2B). 17. The method of claim 16,
In the step k), the first user terminal 2A may include a step of transferring character data to the second user terminal 2B, omitting the process of converting the input character data into voice data, A heterogeneous data conversion method. 17. The method of claim 16,
Wherein the step (k) includes the step of the second user terminal (2B) performing a mute function. 17. The method of claim 16,
The method of claim 1, wherein the step (k) further comprises the step of performing a connection through a data communication network so that the second user terminal (2B) can communicate with the first user terminal (2A) Way. 17. The method of claim 16,
Following the k) process,
Determining whether a return signal to the original voice call state is applied to the second user terminal (2B);
Further comprising the step of releasing the muting and releasing the connection of the data communication network when the return signal is applied to the second user terminal (2B). A second user terminal (2B) for performing a voice communication through a voice communication network;
The voice data received from the second user terminal 2B through the voice communication network is transmitted to the heterogeneous data conversion server 60 and received as character data from the heterogeneous data transformation server 60 and displayed on the screen, (50) for transmitting the character data input by the second user terminal (2B) to the heterogeneous data conversion server (60) and receiving the character data as voice data and transmitting the same to the voice communication network 1 user terminal 2A;
Receives the specific voice data from the first user terminal 2A and converts it into character data of the same content and transmits it to the first user terminal 2A, receives specific character data from the first user terminal 2A, And a heterogeneous data conversion server (60) for converting the data into audio data of contents and transmitting the data to the first user terminal (2A). 22. The method of claim 21,
When the first user terminal 2A receives voice data from the heterogeneous data conversion server 60, the first user terminal 2A automatically transmits the voice data to the second user terminal 2B where the voice call path is formed. Data conversion system. 22. The method of claim 21,
Wherein the heterogeneous data conversion server (60) further comprises a data transfer unit (64) for directly transferring the converted voice data to the second user terminal (2B). 24. The method of claim 23,
Characterized in that the telephone number information of the first user terminal (2A) and the second user terminal (2B) is further included in the character data packet requested to be converted into the voice data from the first user terminal (2A) Data conversion system. A remote controller 80 for generating a mute signal;
A data conversion unit (not shown) provided in the television apparatus 74 for receiving a mute signal from the remote controller 80 to perform a mute function, recognizing a voice signal included in the broadcast program, converting the voice signal into caption data, (90). ≪ / RTI > 26. The method of claim 25,
The data conversion unit 90 controls the screen control unit 94 to output the converted caption data to the caption output window 78 provided separately at the lower end of the screen 76 of the television device 74 Heterogeneous data conversion system. 26. The method of claim 25,
Further comprising a voice data extraction unit (92) for extracting a voice signal included in the broadcast program and providing the extracted voice signal to the data conversion unit (90). 26. The method of claim 25,
Wherein the broadcast program includes video data, audio data, and caption data in advance, and the caption data can be extracted by the data conversion unit (90) only when the audio data is muted and displayed on the screen Conversion system. 26. The method of claim 25,
Wherein the data conversion unit (90) controls the subtitle data of the corresponding program to be output to the screen even when the output volume through the speaker is reduced to a preset value or less. 26. The method of claim 25,
Characterized in that the television device (74) comprises a set-top box or a mobile terminal.
KR1020130137152A 2013-11-12 2013-11-12 Heterogeneous data conversion system and method of the same KR20150054561A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130137152A KR20150054561A (en) 2013-11-12 2013-11-12 Heterogeneous data conversion system and method of the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130137152A KR20150054561A (en) 2013-11-12 2013-11-12 Heterogeneous data conversion system and method of the same

Publications (1)

Publication Number Publication Date
KR20150054561A true KR20150054561A (en) 2015-05-20

Family

ID=53390675

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130137152A KR20150054561A (en) 2013-11-12 2013-11-12 Heterogeneous data conversion system and method of the same

Country Status (1)

Country Link
KR (1) KR20150054561A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101706507B1 (en) * 2016-07-11 2017-02-27 송수한 Robot Interlocking With Mobile, Robot Operating System Interlocking With Mobile and Operating Method Thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101706507B1 (en) * 2016-07-11 2017-02-27 송수한 Robot Interlocking With Mobile, Robot Operating System Interlocking With Mobile and Operating Method Thereof

Similar Documents

Publication Publication Date Title
US11856123B1 (en) Text assisted telephony on wireless device method and apparatus
US20190037277A1 (en) Speech interface
JP4294921B2 (en) Method and apparatus for voice navigation of information equipment
US7221405B2 (en) Universal closed caption portable receiver
CN104866264B (en) Mobile terminal, display equipment and its control method
TWI321955B (en)
US20060001737A1 (en) Video conference arrangement
RU2500081C2 (en) Information processing device, information processing method and recording medium on which computer programme is stored
US11611721B2 (en) Method and system for providing a visual indication that a video relay service call originates from an inmate at a corrections facility
JP2000196776A (en) Display device with video telephone function, control method of the same and storage medium
JP2016091057A (en) Electronic device
CN108920471A (en) A kind of voice translation method and electronic equipment
US20140002583A1 (en) Video processing apparatus and control method thereof
WO2022007618A1 (en) Video call method and display device
CN112700783A (en) Communication sound changing method, terminal equipment and storage medium
KR20150054561A (en) Heterogeneous data conversion system and method of the same
JP4636903B2 (en) Video phone equipment
JP7467636B2 (en) User terminal, broadcasting device, broadcasting system including same, and control method thereof
JP6064209B2 (en) Call system and call relay method
KR100945162B1 (en) System and method for providing ringback tone
JP4296976B2 (en) Communication terminal device
JP2015115926A (en) Portable terminal device, lip-reading communication method, and program
WO2022237381A1 (en) Method for saving conference record, terminal, and server
GB2351638A (en) Telephone that receives image of caller
JP3589702B2 (en) Communication terminal device

Legal Events

Date Code Title Description
A201 Request for examination
N231 Notification of change of applicant
E902 Notification of reason for refusal
E902 Notification of reason for refusal
E601 Decision to refuse application