TWI633445B - Instant messaging system and notification method of instant messaging - Google Patents

Abstract

The invention provides an instant messaging system and a reminding method for instant messaging. The instant messaging system includes a sender terminal, a voice gateway, a receiver terminal, an instant messaging server, and a voice outbound server. The sender terminal sends a message and sets the trigger condition. The voice gateway forwards the voice call. The recipient terminal logs into the voice gateway to change the status information. The instant messaging server converts the message into voice data, and the recipient terminal updates the status information to the instant messaging server, and the instant messaging server can send the voice data according to the status information and the trigger time. The voice outbound server is based on the voice data and dialed to the recipient terminal via the voice gateway to read the message to improve the effectiveness of the communication through the additional communication channel.

Description

Instant messaging system and instant messaging reminder method

The invention relates to an instant messaging, and in particular to an instant messaging system and a reminding method for instant messaging.

Instant messaging allows two or more people to transfer text messages, multimedia files or voice/video conversations over the Internet. Today, almost everyone has smart phones, instant messaging is diversified and convenient. Other advantages gradually replaced traditional calls and newsletters.

In the traditional instant messaging process, the sender can instantly deliver messages according to the login status of the receiver. When the message is read, the sender can receive the read result. If there is no login status, the message will be pushed to the receiving end to remind you to view the message. However, the prior art has the following problems: (1) Instant messages are not viewed in real time. (2) Reminders or messages may not be time-sensitive. (3) Lack of additional communication channels.

In view of this, the present invention provides an instant messaging system and an instant messaging reminding method, which can transmit a message to a recipient terminal through a voice dialing mode according to status information of the recipient terminal, thereby adding an additional communication channel.

The present invention provides an instant messaging system including a sender terminal, a voice gateway, a recipient terminal, an instant messaging (IM) server, and a voice outbound (Callout) server. The sender terminal sends a message. The voice gateway forwards the voice call. The recipient terminal logs into the voice gateway to change the status information. The instant messaging server converts the message into voice data, and the recipient terminal updates the status information to the instant messaging server, and the instant messaging server can send the voice data according to the status information. The voice outbound server reads the message based on the voice data and dials out to the recipient terminal via the voice gateway.

The present invention further provides an instant messaging reminding method, which is applicable to a recipient terminal, and includes the following steps. Log in to the voice gateway to change status information. Update status information to the instant messaging server. A voice call is received via a voice gateway. This voice call is triggered by the status message.

Based on the above, the message is converted into a voice call method and transmitted to the recipient terminal, which adds an additional communication channel to the traditional instant messaging technology, and improves the validity and timeliness of the communication.

The above described features and advantages of the invention will be apparent from the following description.

1 is a block diagram showing the architecture of an instant messaging (IM) system 1 according to an embodiment of the present invention. The IM system 1 includes at least but not limited to a sender terminal 100, a recipient terminal 200, a voice gateway 400, an IM server 500, and a voice outcall server 600.

The sender terminal 100 can be a networked device such as a smart phone, a tablet computer, a desktop computer, a notebook computer, a personal digital assistant (PDA), or a thin client (Thin Client). 2 is a block diagram of components of a sender terminal 100 in accordance with an embodiment of the present invention. The sender terminal 100 includes at least but not limited to the communication unit 110, the storage unit 130, and the processing unit 150. The communication unit 110 can be based on a wireless communication technology unit such as Wi-Fi, Bluetooth, ZigBee, and the like. The storage unit 130 can be any type of fixed or removable random access memory (RAM), read only memory (ROM), flash memory or the like, or a combination of the above, and used to record IM program such as gateway setting module 131, gateway registration module 132, IM registration and authentication module 133, data synchronization module 135, receiving notification module 136, recording-to-multimedia module 137, and text-to-multimedia 138 module Status information (about whether the terminal is under the service of voice gateway 400 (or medium in home/office), local information (local phone number), telephone number of terminal, IM account number, authorization code, terminal information, etc.) . The processing unit 150 is connected to the storage unit 130 and the communication unit 110, and may be a central processing unit (CPU), or other programmable general purpose or special purpose microprocessor (Microprocessor), digital signal processor (DSP) ), a programmable controller, an application specific integrated circuit (ASIC) or other similar component or a combination of the above. In the embodiment of the present invention, the processing unit 150 is configured to execute all the operations of the sender terminal 100, and can access and execute the modules recorded in the storage unit 130.

The recipient terminal 200 can be the same or similar networked device as the transmitter terminal 200. 3 is a block diagram of components of a recipient terminal 200 in accordance with an embodiment of the present invention. The sender terminal 200 includes at least the communication unit 210, the storage unit 230, and the processing unit 250. For related description, reference may be made to the communication unit 110, the storage unit 130, and the processing unit 150 of FIG. 2, and details are not described herein again.

The voice gateway 400 can be used as a device for a voice over IP gateway, a home gateway. 4 is a block diagram of components of a voice gateway 400 in accordance with an embodiment of the present invention. The voice gateway 400 includes at least the communication unit 410, the storage unit 430, and the processing unit 450. For related description, reference may be made to the communication unit 110, the storage unit 130, and the processing unit 150 of FIG. 2, and details are not described herein again. The communication unit 410 is different from the communication unit 110 in that the communication unit 410 has a communication technology corresponding to the communication unit 110, and has any other functions such as an Ethernet, an optical fiber, or the like. A type of wired network interface to connect to the Public Switched Telephone Network (PSTN) or IP multimedia subsystem (IMS) / this generation network (NGN). The storage unit 430 is different from the storage unit 130 in that the storage unit 430 is related to programs such as a record setting module 431, a registration module 432, and a signal control module 434, and local information, status information, and the like.

FIG. 5 is a block diagram of components of an IM server 500 in accordance with an embodiment of the present invention. The IM server 500 includes at least the communication unit 510, the storage unit 530, and the processing unit 550. For related description, refer to the communication unit 110, the storage unit 130, and the processing unit 150 of FIG. 2, and details are not described herein. The communication unit 510 is different from the communication unit 110 in that the communication unit 510 is any wireless (4th generation mobile communication (4G), global interoperable microwave access (WiMAX), etc.) or wired (fiber optic) that can be connected to the Internet. , Ethernet, etc.) Network interface. The storage unit 530 is different from the storage unit 130 in that the storage unit 530 is a record gateway registration module 531, an IM registration and authentication module 532, a data synchronization module 533, a scheduling module 535, and a voice media conversion module. 536, voice outbound processing module 537 and push notification module 538 and other programs, local information, status information, account number, message, multimedia file, trigger conditions (trigger time, trigger status, etc.) and other related information and materials.

6 is a block diagram of components of a voice outbound server 600 in accordance with an embodiment of the present invention. The voice outbound server 600 includes at least the communication unit 610, the storage unit 630, and the processing unit 650. For related description, reference may be made to the communication unit 110, the storage unit 130, and the processing unit 150 of FIG. 2, and details are not described herein. The communication unit 610 is different from the communication unit 110 in that the communication unit 610 is any wireless (4G, WiMAX, etc.) or wired (fiber, Ethernet, etc.) network interface that can be connected to the Internet and PSTN/NGN. The storage unit 630 is different from the storage unit 130 in that the storage unit 630 records related programs such as a voice signal control module 631, a voice outbound processing module 632, and local information, voice data, and the like.

The above is related to the architecture of the IM system 1 and the devices/equipment included therein, and then the matching method of the foregoing devices and the component descriptions thereof combined with the IM of the local telephone mainly includes the following three procedures. For convenience of explanation, the following scenario assumes that the user installs the voice gateway 400 in the home, but the embodiment of the present invention does not limit the installation location of the voice gateway 400. The various processes of the method can be adjusted accordingly according to the implementation situation, and are not limited thereto.

Obtaining local calls and status information: Mainly set the voice gateway 400 for the recipient terminal 200 and register the IM account with the IM server 500, and then register the voice gateway 400 with the IM account to obtain an additional communication channel other than the IM service. (ie, local calls/VoIP).

Specifically, FIG. 7 is a flow chart illustrating the acquisition of local calls and status information in accordance with an embodiment of the present invention. The gateway setting module 231 of the receiver terminal 200 is connected to the setting module 431 via the communication unit 210 via the communication unit 410 of the voice gateway 400, and the signal control module 434 obtains the local language in the PSTN/NGN 350 through the communication unit 410. Or new local telephone information (for example, the local telephone number registered by the voice gateway 400), and the local telephone information is stored in the storage unit 430 (step S71). The IM registration and authentication module 233 of the recipient terminal 200 registers the IM account with the IM registration and authentication module 532 via the communication unit 510 of the IM server 500 via the communication unit 210, and accepts the binding by the verification code (confirmation). The telephone number of the terminal terminal 200, the terminal device information, the local telephone information, and the like, so that the local telephone information is associated with the recipient terminal 200 (telephone number, IM account number, etc.), and the processing unit 570 stores the aforementioned information, number, account number, and the like to The storage unit 530 is in the process (step S72).

After the recipient terminal 200 registers with the IM server 500, when the recipient terminal 200 is within the service range of the voice gateway 400, it can register with the voice gateway 400 according to the gateway setting information, and successfully register (ie, log in to After the voice gateway 400) obtains the local call information (the status information is changed to the receiver terminal 200 under the voice gateway 400 service (at home), and the registration is successful), the data synchronization module 235 of the acceptor terminal 200 can be such as IM. The account, the bound phone number, the local or new local information and status, the gateway registration status, the terminal information, and the like, and the synchronization data synchronization module 533 of the IM server 500 are stored in the storage unit 530, thereby updating the local phone and status. News. On the other hand, when the recipient terminal 200 is outside the service range of the voice gateway 400, it cannot be registered with the voice gateway 400 (ie, not logged into the voice gateway 400, not at home), so the local language and status of the IM server 500 are updated. The information is null or failed to register, indicating that the recipient terminal 200 is not at home. Regardless of whether the recipient terminal 200 is at home, the IM server 500 can know the current status information of the recipient terminal 200 (ie, whether it is under the voice gateway 400 service).

Converting voice and dialing voice: mainly using an additional communication channel to provide the IM program of the sender terminal 100 to transmit voice prompts to the recipient terminal 200 of the local or new local calls, so the IM program provides recording and text conversion voice media. Then, the IM data is synchronized to the IM server 500, and the voice outbound server 600 is used to remind the voice call by using the voice outbound server 600 according to the trigger condition (including the message type, the trigger time, and the local information and status information of the recipient terminal 200).

In particular, FIG. 8 is a flow chart illustrating the conversion of voice and outbound voice in accordance with an embodiment of the present invention. The sender terminal 100 (assuming that the IM account is the user B) updates the status information to the IM server 500 in the above-described local and status information steps (step S81). The recipient terminal 200 (assuming that the IM account is the user A) also updates the status information to the IM server 500 in the above-described steps (step S82), and the information stored in the storage unit 530 of the IM server 500 is as shown in the following table (1). Table 1)  <TABLE border="1" borderColor="#000000" width="85%"><TBODY><tr><td> IM account</td><td> Local information</td><td> Gateway Registration Status</td><td> Gateway Location</td></tr><tr><td> User A </td><td> 034244104 </td><td> Registration</td><td > at home</td></tr><tr><td> User B </td><td> None</td><td> No</td><td> No</td></tr> </TBODY></TABLE>

The sender terminal 100 transmits a message to the recipient terminal 200 (step S83), and based on the data synchronization module 135, obtains the status information of the recipient terminal 200, and the sender terminal 100 records the trigger (send) time, voice reminder message input by the user, and The trigger state of the recipient terminal 200 (at home/not at home, etc.) is converted into a multimedia file by the recording to multimedia module 137 or the text to multimedia module 138, and stored in the storage unit 130. in. The data synchronization module 135 uploads and synchronizes the multimedia file in the message to the data synchronization module 533 in the IM server 500 through the communication unit 110, and triggers the trigger condition (trigger time and status) of the recipient terminal 200 with the multimedia file. It is synchronized to the IM server 500 and stored in the storage unit 530 (step S84). According to the trigger condition and the multimedia file, the voice media conversion module 560 of the IM server 500 converts the multimedia file uploaded by the sender terminal 100 into a voice coding format of the telecommunication network (for example, 8 kilohertz (kHz), 16 bits (bits). )) to form the voice data, and according to the trigger condition of the sender terminal 100 and the status information of the receiver terminal 200, and when the status information meets the trigger status, the voice outdialing server 600 is connected through the voice outbound processing module 537. The voice outbound processing module 632 (step S85) transmits voice data, and the voice data to be dialed out is stored in the storage unit 630. On the other hand, when the status information does not match the trigger status, the instant messaging server 500 does not transmit the voice data.

Since the local call information is associated with the recipient terminal 200, when the message specifies the recipient terminal 200, the instant messaging server 500 is dialed out to the recipient terminal 200 via the voice outbound server 600 based on the local call information, ie, the voice. The voice signal control module 631 of the outbound server 600 can make a voice call to the recipient terminal 200 via the communication unit 610 via the telecommunication network PSTN/NGN 300 (step S86), so that the receiver terminal 200 receives the relevant A voice call of a message transmitted by the sender terminal 100. In other words, if the recipient terminal 200 is not at home, the status information is that the recipient terminal 200 is not under the service of the voice gateway 400, so the aforementioned voice call is not received. Next, the voice outbound processing module 632 is connected to the voice outbound processing module 537 to report the outbound result to the IM server 500, and store the outbound result in the storage unit 540 (step S87). At this time, the related information recorded by the storage unit 540 regarding the message sent by the sender terminal 100 is as shown in Table (2): Table (2)  <TABLE border="1" borderColor="#000000" width="85%"><TBODY><tr><td> IM Message</td><td> Sender</td><td> Recipient < /td><td> Message Mode</td><td> Message Content</td><td> Results</td></tr><tr><td> Recording</td><td> User B < /td><td> User A </td><td> Voice Out Dial</td><td> </td><td> Outbound</td></tr></TBODY></TABLE >

The data synchronization module 533 of the IM server 500 is connected to the data synchronization module 135 of the sender terminal 100, and the pen sender terminal 100 is alerted to the message result of the recipient terminal 200 (step S88). If the IM program is in the background or not in execution, the push notification module 538 of the IM server 500 sends a push message, so that the receive notification module 336 evokes the IM program for data synchronization.

Immediate and appointment reminder message: In addition to using the additional communication channel and receiver status information, the IM server provides immediate and scheduled scheduling in the IM program to provide trigger (send) time setting, which not only improves the effectiveness of instant messaging. And timely, while increasing the use of local calls.

Specifically, FIG. 9 is a flow chart illustrating an immediate and scheduled reminder message in accordance with an embodiment of the present invention. The sender sets the immediate trigger (send) time message in the IM program, and the sender terminal 100 synchronizes the data to the IM server 500 (step S91). If it is a text message, the IM server 500 immediately transmits the message to the recipient terminal 200; if it is a voice outbound message (including a multimedia file), the voice media conversion module 536 and the voice outbound processing module 537 are in the message. The recorded or multimedia file is converted into voice data, and then dialed out to the recipient terminal 200 in a voice call mode via the voice outbound server 600 (step S92). After the recipient reads or listens to the message through the recipient terminal 200, the recipient terminal 200 will generate a message including the completion result to the IM server 500 to update the message state (step S93). The IM server 500 updates the completion result to the sender terminal 100 through the synchronization data (step S94).

If the voice message is reserved, the sender sets the trigger time (specific time in the future) through the IM program to set the message to be transmitted by the reservation, and the sender terminal 100 synchronizes the data to the IM server 500 (step S95). The scheduling module 535 schedules the message to immediately transmit the message to the recipient when the scheduled trigger time arrives (step S96). In other words, when the trigger time has not arrived, the IM server 500 does not transmit the voice material. If it is a text message, the IM server 500 immediately transmits the message to the recipient; if the voice outbound message (including the multimedia file), the voice media conversion module 536 and the voice outbound processing module 537 record the message or The multimedia file is converted into voice data (step S97), and then dialed out to the recipient terminal 200 in a voice call mode via the voice outbound server 600 (step S98). The voice outbound server 600 updates the processing result to the IM server 500 to update the message state (step S99). The IM server 500 then updates the completion result to the sender terminal 100 by synchronizing the data (step S910).

Based on the foregoing embodiments, four scenarios are hereinafter described to facilitate understanding of actual operations. The sender and the receiver are hereinafter referred to as the sender terminal 100 and the receiver terminal 200, respectively.

The first situation (immediate voice prompts for instant messaging, such as reminding parents at home to have a meeting soon): When the sender's IM program finds the recipient's home status information, but the sender is afraid that the text will delay the reminder, immediately IM The program records a voice reminder message or converts it into a voice message by text, and immediately dials out the voice transmission through the IM program settings. The IM server 500 and the voice outbound server 600 remind the recipient of the additional communication channel in the PSTN/NGN 300. After the receiver answers the reminder, the voice outbound server 600 and the IM server 500 return the result to the sender. IM program.

The second situation (using voice reminders sent by instant messaging appointments to care for relatives and friends, such as reminding family members to vaccinate at a specific time): When the sender is unable to cooperate in time, it is afraid that the recipient will not be reminded by text transmission. The sender can reserve the trigger (send) time and record the voice reminder message in the IM program or convert the text into a voice message, and send the message by the IM program setting with the scheduled trigger time and the outbound voice.

The third scenario (using instant messaging appointment time and recipient status information to send voice to-do items, such as delaying home due to work, when the child goes home, confessing the matter): when the sender wants to give the recipient somewhere When you are in the status, you can hear the to-do list of voice reminders, and you will not be able to remind the recipient by text transmission. The sender can schedule the trigger time and record the voice reminder message according to the local state information (at home). The text is converted into a voice message, and the IM program is used to send a message with the scheduled trigger time, local state information, and outbound voice.

The fourth situation (using instant messaging for a long time to send time to achieve the effect of time capsules, such as appointments for children): When the sender wants to give the recipient a voice reminder when they are in a certain time state, The appointment trigger time is based on the local state information (at home), then the IM program is used to record the voice reminder message or the text is converted into a voice message, and the IM program is used to trigger the time, the local state information and the outbound voice to send the message.

In addition, in the foregoing second to fourth scenarios, via the IM server 500 scheduling message and the local state information, the recipient can be voiced by the voice outbound server 600 in the PSTN/NGN 300 with an additional communication channel. After receiving the voice reminder, the receiver sends back the result to the sender's IM program via the voice outbound server 600 and the IM server 500.

In summary, the present invention has the following features:

The invention utilizes instant messaging in combination with a local telephone box or a home gateway to obtain status information and additional communication pipeline information.

The invention utilizes the voice-converted voice and text-to-speech technology to improve the problem that the general instant messaging message is not instantly viewed or received through the voice outbound server through the voice channel of the added communication channel.

The instant messaging of the present invention utilizes an immediate and scheduled scheduling method, combined with obtaining local state information, and provides a reminding method for instant messaging in combination with local calls, thereby improving the effectiveness and timeliness of communication.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and any one of ordinary skill in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.

1‧‧‧ instant messaging system

100‧‧‧Sender terminal

110, 210, 410, 510, 610‧‧‧ communication units

131, 231‧‧‧ gateway setting module

132, 232‧‧ ‧ Gateway registration module

133, 233‧‧‧ Instant Messaging Registration and Certification Module

135, 235‧‧‧ data synchronization module

136, 236‧‧‧ receiving notification module

137, 237‧‧‧recording to multimedia module

138, 238‧‧‧Text to multimedia module

130, 230, 430, 530, 630‧‧‧ storage units

150, 250, 450, 550, 650 ‧ ‧ processing units

200‧‧‧Receiver terminal

300‧‧‧PSTN/NGN/Internet

350‧‧‧PSTN/NGN

400‧‧‧voice gateway

431‧‧‧Setting module

432‧‧‧ Registration Module

434‧‧‧Signal Control Module

500‧‧‧ instant messaging server

531‧‧‧Gateway registration module

532‧‧‧IM registration and authentication module

533‧‧‧Data Synchronization Module

535‧‧‧ scheduling module

536‧‧‧Voice Media Conversion Module

537‧‧‧Voice Outbound Processing Module

538‧‧‧Dump notification module

600‧‧‧Voice Outbound Server

631‧‧‧Voice signal control module

632‧‧‧Voice Outbound Processing Module

S71~S72, S81~S88, S91~S910‧‧‧ steps

FIG. 1 is a schematic structural diagram of an instant messaging system according to an embodiment of the invention. 2 is a block diagram of components of a sender terminal in accordance with an embodiment of the present invention. 3 is a block diagram of components of a recipient terminal in accordance with an embodiment of the present invention. 4 is a block diagram of components of a voice gateway in accordance with an embodiment of the present invention. 5 is a block diagram of components of an instant messaging server in accordance with an embodiment of the present invention. 6 is a block diagram of components of a voice outbound server in accordance with an embodiment of the present invention. FIG. 7 is a flow chart showing the acquisition of local calls and status information according to an embodiment of the invention. FIG. 8 is a flow chart showing the process of converting voice and dialing voice according to an embodiment of the invention. FIG. 9 is a flow chart illustrating an immediate and scheduled reminder message in accordance with an embodiment of the present invention.

Claims (10)

An instant messaging (IM) system, comprising: a sender terminal, transmitting a message; a voice gateway, forwarding a voice call; and a recipient terminal logging in the voice gateway to change a status message; an instant message (IM) a server, wherein the instant messaging server converts the message into a voice data, and the recipient terminal updates the status information to the instant messaging server, and the instant messaging server sends the voice data according to the status information And a voice outbound server, which is based on the voice data and dialed to the recipient terminal via the voice gateway to read the message. The instant messaging system of claim 1, wherein if the recipient terminal logs in to the voice gateway, the status information is that the recipient terminal is under the voice gateway service; if the recipient terminal is not When the voice gateway is logged in, the status information is that the recipient terminal is not under the voice gateway service. The instant messaging system of claim 1, wherein the sender terminal sets a trigger status for the message, and when the status information matches the trigger status, the instant messaging server sends the voice data; When the status information does not meet the trigger status, the instant messaging server does not send the voice data. The instant messaging system of claim 3, wherein the triggering state is that the recipient terminal is under the voice gateway service. The instant messaging system of claim 1, wherein the sender terminal sets a trigger time for the message, and when the trigger time arrives, the instant messaging server sends the voice data; when the trigger time is not The instant messaging server does not send the voice data when it arrives. The instant messaging system of claim 1, wherein the instant messaging server notifies the sender terminal of the completion result after the recipient terminal reads the message. The instant messaging system of claim 1, wherein the recipient terminal obtains a local telephone information from the voice gateway, and the recipient terminal sends the local telephone information to the instant messaging server, the instant messaging The server associates the local call information with the recipient terminal. When the message specifies the recipient terminal, the instant messaging server dials out to the recipient via the voice outbound server based on the local call information. terminal. The instant messaging system of claim 1, wherein the message is a voice recording or a text message. An instant messaging reminding method is applicable to a recipient terminal, the reminding method includes: logging in a voice gateway to change a status information; updating the status information to an instant messaging server; and receiving a voice via the voice gateway A voice call, wherein the voice call is triggered by the instant messaging server based on the status information. The method of claim 9, wherein the status information relates to whether the recipient terminal is under the voice gateway service, and when the status information is that the recipient terminal is under the voice gateway service Receiving the voice call from the voice gateway; when the status information is that the recipient terminal is not under the voice gateway service, the voice call is not received.