KR20240048053A - Relay apparatus communicating with mobile terminal, service system and service method thereof - Google Patents

Abstract

A relay device that communicates with a mobile terminal, a service system, and a service method thereof are disclosed.
The relay device includes a first communication module for connecting to a mobile terminal, and a second communication module for connecting to a voice transmitting and receiving device that receives voice information output from the mobile terminal and outputs it to the user or inputs the user's spoken voice to the mobile terminal. It includes a communication module and a control module, wherein the control module receives voice information received from a first program installed in the mobile terminal through the first communication module, and transmits the voice information to the voice information through a second communication module. Controls delivery to the transmitting/receiving device and the service program installed on the mobile terminal.

Description

{Relay apparatus communicating with mobile terminal, service system and service method thereof}

The present invention relates to a relay device that communicates with a mobile terminal, a service system, and a service method thereof. More specifically, it relates to a method and system that can perform various services using a relay device that communicates with a mobile terminal.

The use of mobile terminals such as smart phones is becoming widespread.

When making a call using such a mobile terminal, there is a need for call-related services such as recording the call as necessary, voice recognition of the call content in real time, real-time translation, voice speech when entering the response as text, and voice modulation. It is also growing.

In order to perform call-related services when making a call using a mobile terminal, smooth communication must be established between the basic call program provided by the OS and providing call services and a third-party application. However, for security reasons or other policy reasons, an environment is being created in which the basic call program does not provide call voice to third-party applications or the basic call program does not receive information output from the third-party application.

Moreover, the security or policies of these basic currency programs may be further strengthened.

Therefore, methods and systems that can provide smooth and efficient call-related services regardless of various security policies are required.

Korean Patent Application No. 10-2002-0036203 “Small phone-type repeater terminal and tube-type earphone for mobile communication using Bluetooth”

The technical problem to be achieved by the present invention is to provide a method, device, and system that can effectively perform call-related services using a relay device that communicates with a mobile terminal and voice transmitting and receiving devices (e.g., earphones, headsets, etc.). .

The relay device according to an embodiment of the present invention for achieving the above technical problem includes a first communication module to be connected to a mobile terminal, receive voice information output from the mobile terminal and output it to the user, or transmit the user's spoken voice to the mobile terminal. It includes a second communication module for connecting to a voice transmitting and receiving device inputted to the terminal, and a control module, wherein the control module receives voice information received from a first program installed in the mobile terminal through the first communication module. , Controls the voice information to be transmitted to the voice transmitting and receiving device and the service program installed in the mobile terminal through the second communication module.

According to the technical idea of the present invention, it is possible to freely utilize voice information transmitted between a program installed on a mobile terminal and a voice transmitting and receiving device using a relay device that communicates with a mobile terminal, and use this to secure or secure the mobile terminal and/or the program. This has the effect of enabling diverse and efficient voice information-related services without being limited by the policy environment.

In order to more fully understand the drawings cited in the detailed description of the present invention, a brief description of each drawing is provided.
Figure 1 shows a schematic system configuration for implementing a service method using a relay device that communicates with a mobile terminal according to an embodiment of the present invention.

In order to fully understand the present invention, its operational advantages, and the objectives achieved by practicing the present invention, reference should be made to the accompanying drawings illustrating preferred embodiments of the present invention and the contents described in the accompanying drawings.

Additionally, in this specification, when one component 'transmits' data to another component, the component may transmit the data directly to the other component, or through at least one other component. This means that the data can be transmitted to the other components. Conversely, when one component 'directly transmits' data to another component, it means that the data is transmitted from the component to the other component without going through the other component.

Hereinafter, the present invention will be described in detail by explaining preferred embodiments of the present invention with reference to the accompanying drawings. The same reference numerals in each drawing indicate the same member.

Figure 1 shows a schematic system configuration for implementing a service method using a relay device that communicates with a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 1, a relay device 100 may be provided to implement a service method according to an embodiment of the present invention.

The relay device 100 can communicate with the mobile terminal 200 and the voice transmission/reception device 300 according to an embodiment of the present invention.

According to an embodiment, the relay device 100 may provide a service according to an embodiment of the present invention while relaying communication between the mobile terminal 200 and the voice transmission/reception device 300.

According to one example, a service according to the technical idea of the present invention may be a call-related service.

The call-related service refers to a service that utilizes voice information made in a call between the owner of the mobile terminal 200 and a terminal (not shown) owned by another person, or generates and utilizes meaningful information related to the response to the call. It can mean.

For example, it is a service that records call voice, a service that performs voice recognition on call voice and converts it into text, a service that analyzes call content converted into text and presents meaningful answers or examples of answers from this, or provides a service that performs voice recognition on call voice and converts it into text. A variety of services may be possible, such as a service that converts information into voice and transmits it to another person's terminal, or modulates one's own voice into another person's voice and transmits it to the other person on the call.

However, embodiments of the present invention are not limited to call-related services, and can be used in relation to videos by utilizing voice information included in the video or in various other services utilizing voice.

Hereinafter, call-related services will be described by way of example in this specification, but the scope of the present invention is not limited thereto.

In order to provide call-related services smoothly and diversely, a first program 210 provided in the OS of the mobile terminal 200, for example, a telephonic service program (hereinafter referred to as the 'basic call program', It may be possible to easily transmit and receive voice information in a call while communicating with 210) and the service program 220 provided by the service provider.

However, in certain mobile OSs, there are cases where voice information transmitted during a call is not provided from the basic call program 210 to a third party program, such as the service program 220. Due to this, there is a problem that call recording is impossible, and this is only possible if the specific mobile OS provides such call recording service.

In addition, a service that generates various voice information in the service program 220 and delivers it to the other party may be necessary. In this case, the basic call program 210 receives the voice information delivered by the service program 220 and It must be passed on to the other party of the call, but this function may not be permitted or may only be permitted in a very limited manner.

Ultimately, for various call-related services, the basic call program 210 provides the information necessary for the target service with the service program 220 according to the technical idea of the present invention, or the information delivered by the service program 220 is used as a basic call program. After 210 receives the call, the service program 220 must perform the requested function, but these conditions are not allowed or are only allowed in a very limited manner, so third parties may not be able to smoothly provide call-related services.

In order to solve this problem, the present invention can provide a technical idea that can smoothly provide call-related services using the relay device 100.

In order to implement the technical idea of the present invention, the service program 220 that performs communication with the relay device 100 may be provided.

According to one embodiment, the relay device 100 may be implemented to relay communication between the voice transmitting and receiving device 300 and the mobile terminal 200.

The voice transmitting and receiving device 300 is connected to the mobile terminal 200 to make a call using, for example, an earphone or headset, and outputs voice information to the user or transmits the user's spoken voice to the mobile terminal. It may be a device that transmits information to the terminal 200. In any case, the voice transmitting and receiving device 300 can output voice information transmitted from the mobile terminal 200 and may be a device that transmits voice information input from the user to the mobile terminal 200.

Typically, in the related art, the mobile terminal 200 and the voice transmitting and receiving device 300 are directly connected to transmit and receive voice information of the user or the other party generated during a call with the basic call program 210.

However, according to the technical idea of the present invention, in order to smoothly perform call-related services as described above, the relay device 100 transmits voice information during a call between the mobile terminal 200 and the voice transmitting and receiving device 300. can be relayed.

For this purpose, the relay device 100 may be equipped with a plurality of communication modules 110 and 120.

The first communication module 110 may be a module that communicates with the mobile terminal 200. The second communication module 120 may be a module that performs communication with the voice transmitting and receiving device 300.

Depending on the embodiment, a plurality of first communication modules 110 may be provided, and a plurality of second communication modules 120 may also be provided.

According to one example, the first communication module 110 may perform WiFi communication and/or Bluetooth communication with the mobile terminal 200.

Depending on the embodiment, the first communication module 110 may be equipped with a plurality of communication devices, one of which may be connected to the mobile terminal 200 via Bluetooth, and the other may be connected to WiFi.

According to one example, the first communication module 110 is connected to the mobile terminal 200 via Bluetooth, so that the first communication module 110 and the basic call program 210 can communicate through Bluetooth. Additionally, the first communication module 110 can be connected to the mobile terminal 200 via WiFi, and in this case, the first communication module 110 can also communicate with the service program 220 via WiFi.

The second communication module 120 may be a device that allows communication with the voice transmission and reception device 300, and the second communication module 120 may perform Bluetooth communication with the voice transmission and reception device 300. there is. Depending on the embodiment, the second communication module 120 may include a device for Bluetooth communication and a communication device that can be connected to the wired voice transmitting and receiving device 300.

In the end, it is sufficient for the relay device 100 to be able to communicate with the mobile terminal 200 and/or the voice transmission/reception device 300 in various ways, and examples of communication protocols used at this time may vary.

The basic call program 210 is designed to output voice information to the voice transmitting and receiving device 300 connected through communication, and is also designed to transmit voice information received from the voice transmitting and receiving device 300 to the other party.

Therefore, the technical idea of the present invention is that the relay device 100 relays the voice information output by the basic call program 210 to the voice transmitting and receiving device 300, and provides call-related services by utilizing the voice information at this time. You can.

In addition, the technical idea of the present invention is that the relay device 100 relays voice information output from the voice transmitting and receiving device 300 to the basic call program 210, and provides call-related services by utilizing the voice information at this time. can do.

In addition, the technical idea of the present invention is to freely transmit the voice information generated by the service program 220 to the basic call program 210 through the relay device 100, thereby freely transmitting the voice information generated by the service program 220. It can also be forwarded to the other party on the call.

In the end, the basic call program 210 must output voice information without limitation to the hardware, that is, the voice transmitting and receiving device 300, which is a Bluetooth device, and also transmits the information input from the voice transmitting and receiving device 300 to the other party of the call. , there is an effect of being able to smoothly obtain voice information during a call regardless of OS security or policy restrictions and transmit the desired voice information to the other party of the call.

According to one example, the control module 110 that controls the relay device 100 may acquire the other party's voice information, that is, first voice information, received from the other party.

For this purpose, when the control module 110 receives the first voice information received from the basic call program 210 installed in the mobile terminal 200 through the first communication module 110, the first voice information It can be transmitted to the voice transmission and reception device 300 through the second communication module 120 so that the user can hear it. And the control module 110 not only transmits the first voice information to the voice transmitting and receiving device 300, but can also transmit the first voice information to the first communication module 120 to the service program 220. .

Then, the service program 220 provides a call recording service by simply storing the first voice information, performs STT (Sound to Text), that is, a voice recognition service, records voice recognized text, or records the text. By analyzing the contents, a certain application service (e.g., automatically creating a transcript, entering time information into the diary, analyzing the contents to classify the call contents, automatically generating an answer by analyzing the contents of the call, or generating an example of an answer) etc.) can be provided.

This has the effect of enabling call recording through the service program 220 even when the OS does not allow call recording.

Of course, the control module 110 receives the voice uttered by the user of the mobile terminal 200, that is, the second voice information, from the voice transmitting and receiving device 300 through the second communication module 120, and sends it to the first voice transmitting and receiving device 300. The function of transmitting to the basic call program 210 can be performed through the communication module 110.

And not only that, by transmitting the second voice information to the service program 220, the service program 220 can use it to provide the call-related service as described above.

In addition, not only voice information directly uttered by the user but also voice information generated by the service program 220, that is, third voice information, can be transmitted to the other party of the call.

To this end, the control module 110 receives the third voice information generated from the service program 220 through the first communication module 110, and sends the received third voice information to the basic call program 210. ) can also be passed. In this case, the basic call program 210 recognizes the information as input from the voice transmitting and receiving device 300 and can transmit the third voice information to the other party without any restrictions.

According to one embodiment, the third voice information may be information generated through text to sound (TTS) when text is selected. Alternatively, the third voice information may be voice information that modifies voice information uttered by the user. This call-related service has the effect of allowing a user who is hearing impaired or has difficulty speaking to select the content he or she wants as text and transmits it to the other party by voice, or allows a user with difficulty speaking to transmit the voice with a clearer pronunciation.

Of course, the technical idea of the present invention is not limited to this, and an average expert in the technical field of the present invention will be able to easily infer that it has the effect of allowing various other users to freely use call-related services according to their various needs. .

Additionally, a service system in which a service program 220 for implementing this technical idea and the mobile terminal 200 are organically combined can be implemented.

The service system includes a processor, a storage medium executed by the processor and storing the service program, and the service program is transmitted from a basic call program 210 installed in the mobile terminal to the mobile terminal 200 and a voice transmitting and receiving device ( Voice information output to the relay device 100 that is connected to the communication device 300 can be received from the relay device 100 and stored.

The service system and the relay device 100 include a processor and a storage medium to implement the functions defined in this specification. The processor may refer to a computing device capable of executing a predetermined program (software code), and may be an example of an implementation of the data processing device or a variety of vendor mobile processors, microprocessors, CPUs, single processors, multi-processors, GPUs, etc. It can be named by name and implemented by one or more processors.

An average expert in the field of the present invention can easily deduce that the processor can run the program and perform data processing necessary for the technical idea of the present invention.

The storage medium may refer to a device in which a program for implementing the technical idea of the present invention is stored/installed. Depending on the implementation, the storage medium may be divided into a plurality of different physical devices, and depending on the implementation, a part of the storage medium may exist inside the processor. Depending on the implementation example, the storage medium may be implemented as a hard disk, GPU, solid state disk (SSD), optical disk, random access memory (RAM), and/or various other types of storage media, if necessary. It can also be implemented detachably into the service system.

The service system can be implemented by combining the service program 220 installed in the mobile terminal 200.

Additionally, the relay device 100 may also be implemented by combining a program for controlling the relay device 100 and a processor and hardware for executing the program. The relay device 100 may be produced as a small, independent dongle, but is not limited thereto. Depending on the embodiment, the relay device 100 may be included and installed in the voice transmitting and receiving device 300.

In addition, the service system connects the processor, the storage medium, and various peripheral devices (e.g., input/output devices, display devices, audio devices, communication devices, etc.) provided in the flight control system 100 with these devices. An average expert in the technical field of the present invention may easily deduce that a communication interface (eg, communication bus, etc.) may be provided to do so.

Meanwhile, the technical idea of the present invention can be implemented by organically combining the program stored in the storage medium and the processor.

Meanwhile, in this specification, module refers to hardware (e.g., the processor and/or storage medium) for carrying out the technical idea of the present invention and software for driving the hardware (e.g., to implement the technical idea of the present invention). It may refer to the functional and structural combination of the above programs). For example, each of the above components may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and may necessarily mean a physically connected code, or one type or specific number of hardware. It can be easily inferred by an average expert in the technical field of the present invention that it does not mean. Therefore, each of the above configurations refers to a combination of hardware and software that performs the functions defined in this specification and does not refer to a specific physical configuration.

Ultimately, the average expert in the technical field of the present invention can easily infer that when the relay device 100 or the service system performs a predetermined function in this specification, it means that the processor controls the program to perform the defined function. You will be able to.

As described above, the service system controls the service program 220 to generate second voice information input from the voice transmitting and receiving device 300 and transmitted to the basic call program 210 through the relay device 100. It can be transmitted from the relay device 100, and using this, call-related services as described above can be provided.

Additionally, as described above, the service system may generate third voice information through the service program 220 and transmit it to the basic call program 210 through the relay device 100 to be delivered to the other party.

The service method according to an embodiment of the present invention can be implemented as computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, hard disk, floppy disk, and optical data storage devices. Additionally, computer-readable recording media can be distributed across networked computer systems, so that computer-readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers in the technical field to which the present invention pertains.

The present invention has been described with reference to an embodiment shown in the drawings, but this is merely illustrative, and those skilled in the art will understand that various modifications and other equivalent embodiments are possible therefrom. Therefore, the true scope of technical protection of the present invention should be determined by the technical spirit of the attached registration claims.

Claims (10)

In a relay device that communicates with a mobile terminal,
A first communication module for connection to a mobile terminal;
a second communication module for connecting to a voice transmitting and receiving device that receives voice information output from the mobile terminal and outputs it to the user or inputs the user's spoken voice to the mobile terminal; and
Includes a control module,
The control module is,
When voice information received from the first program installed in the mobile terminal is received through the first communication module, the voice information is controlled to be transmitted to the voice transmitting and receiving device and the service program installed in the mobile terminal through the second communication module. A relay device that communicates with a mobile terminal.
The method of claim 1, wherein the voice information transmitted through the service program is:
A relay device that communicates with a mobile terminal, characterized in that the service program is stored.
The method of claim 1, wherein the control module:
A relay device that receives second voice information input from the voice transmitting and receiving device through the second wireless communication module and communicates with a mobile terminal that transmits the received second voice information to the first program and the service program.
The method of claim 1, wherein the control module:
A relay device that receives third voice information generated by the service program through the first communication module and communicates with a mobile terminal that transmits the received third voice information to the first program.
processor;
It is executed by the processor and includes a storage medium in which the service program is stored,
The service program is,
A service system that receives and stores voice information output from a first program installed in the mobile terminal to a relay device that is connected to the mobile terminal and a voice transmitting and receiving device through communication.
The method of claim 5, wherein the service program:
A service system that receives and stores second voice information input from the voice transmission and reception device and transmitted to the first program through the relay device.
The method of claim 1, wherein the service program:
A service system that generates third voice information and transmits it to the first program through the relay device.
In a service method using a relay device that communicates with a mobile terminal and a voice transmitting and receiving device,
Receiving, by the relay device, voice information from a first program installed on the mobile terminal;
A service method for controlling the relay device to include the step of transmitting the voice information to the voice transmitting and receiving device and a service program installed in the mobile terminal.
In a service method using a relay device that communicates with a mobile terminal and a voice transmitting and receiving device,
A service system installed in the mobile terminal receiving voice information output from a first program installed in the mobile terminal to a relay device that is connected to the mobile terminal and the voice transmitting and receiving device through communication;
A service method comprising the step of the service system storing the voice information.
A computer program installed in a data processing device and stored in a computer-readable recording medium for performing the method according to any one of claims 5 to 9.