KR101632434B1

KR101632434B1 - IP based Social Network Service and chat application software system using Voice over IP and sound and the method using them

Info

Publication number: KR101632434B1
Application number: KR1020150147998A
Authority: KR
Inventors: 이요훈; 치용세바스찬벡
Original assignee: 이요훈
Priority date: 2015-10-23
Filing date: 2015-10-23
Publication date: 2016-06-21

Abstract

The present invention relates to an SNS system using a wired and wireless IP-based voice and sound, and more particularly, to an SNS system using a wired / wireless IP-based voice and sound, And an SNS system using wired and wireless IP-based voice and sound.
The present invention relates to an SNS system using wired and wireless IP-based voice and sound, wherein one or more users select one of 1: 1, 1: N, and N: N bidirectional voice communication so that a single session or a multi session Creating, modifying and terminating the session; The user can listen to the voice while using the real time sharing function such as photo / video / internet / data / music / camera broadcast, etc. without using other applications for the sharing function. A multimedia sharing unit that allows chatting while real time sharing, shows attached pictures, and closes the attached pictures when clicking again, and moves to the existing screen again; A chatting part for simultaneously performing a voice call and a text chat with each of a plurality of meetings through a text chat / voice part while simultaneously performing a plurality of meetings in a multi-session, and transmitting voice or text of a user only to a selected room; The user can selectively adjust the volume of the voice delivered to each of the meeting rooms and each user through the chat room and adjusts the volume of each session according to the importance or preference when making a multi- Session volume adjustment module; A user can select a specific room from among the respective meeting rooms or select an entire room to share and designate a specific room or a whole room among the respective meeting rooms, Includes the ability to adjust the music volume by selecting a room.

Description

[0001] The present invention relates to an IP-based social network service and a chat application software system using voice and IP,

The present invention relates to an SNS system using a wired and wireless IP-based voice and a sound and a method of using the same, and more particularly, to a system and method for controlling multi-session volume, adjusting volume for each session or user, The present invention relates to an SNS system using a wired and wireless IP-based voice and a voice including a function, and a communication method using the same.

In general, wired / wireless IP based system is a system that enables wireless network and wired network to be connected to network by always building various terminal devices by IP based and can be utilized in various internet application fields.

In this paper, we propose an IP-based mobility management system to provide seamless handover service and mobile mobility of terminals in heterogeneous access network between next generation mobile communication network and existing mobile communication network which are mixed in various access networks. As a mobility provision technology to support simultaneously, mobility management technology such as interworking framework technology between heterogeneous access networks of the next generation mobile communication network, seamless domain support of seamless domain handover between heterogeneous networks, IP based global mobility support Voice and data, wired and wireless, broadcasting and communication, and the Internet.

Specifically, the wired and wireless IP-based system is capable of providing one-way (Half-Duplex) and two-way (Full-Duplex) communication between 1: 1, 1: N and N: N in various wireless communication environments such as wired, Wi-Fi, 2G, 3G, LTE, ) Voice communication.

It can connect with various devices such as smart phone, tablet, PC, and existing PTT transceiver, interworking with intercom, telephone, SIP / VoIP / RoIP equipment, And so on.

Recently, the use of smartphones has been rapidly increasing, and smartphones have made it possible to easily and conveniently use a variety of app services such as video, music, photographs, electronic books, social networks, and navigation services.

However, there has been a problem that it is difficult to satisfy various needs of users who use an app (App) that only serves a voice call or a text chat.

In particular, current smart phones could not provide various additional services other than simple voice calls.

In addition, since there are no simple products in the company that can easily make video conferences, it is inevitable to purchase a video conferencing system at a high cost.

Therefore, there is a need to introduce a new paradigm through new forms of voice and sound that can revolutionize voice / video call and chat culture by escaping existing text chatting.

Korea Patent No. 1378548 Korean Patent No. 0937025 Korea Patent No. 0619941 Korea Patent No. 0705954

The present invention has been conceived in order to solve the above problems, and it is an object of the present invention to provide music information that can be shared in real time during conversation without having to move to another application, It is an object of the present invention to provide an SNS system that utilizes wired and wireless IP-based voice and sound that can be delivered according to a taste.

In addition, the present invention provides an SNS system that utilizes a wired and wireless IP-based voice and sound capable of multi-tasking, allowing video chatting (part B) while sharing music purchased by the user (A part) The purpose is to provide.

In addition, according to the present invention, voice is converted into a character in a place where communication is difficult or quiet according to the current user situation, and when a character such as driving is difficult to read, Function or chat contents by using STT (Speech to Text) function, it is possible to provide a SNS system using a wired and wireless IP-based voice and sound which can chat at any time according to the situation.

In addition, the present invention provides an SNS system using wired and wireless IP-based voice and sound that can easily start a multi-session chat or a conference, including a function of inviting a third party of a group call and a function of re- The purpose of this paper is to provide

According to an aspect of the present invention, there is provided an SNS system using wired and wireless IP-based voice and sound, wherein one or more users select one of 1: 1, 1: N, A session unit including a function for creating, modifying and terminating a session; The user can listen to the voice while using the real time sharing function such as photo / video / internet / data / music / camera broadcast, etc. without using other applications for the sharing function. A multimedia sharing unit that allows chatting while real time sharing, shows attached pictures, and closes the attached pictures when clicking again, and moves to the existing screen again; A chatting part for simultaneously performing a voice call and a text chat with each of a plurality of meetings through a text chat / voice part while simultaneously performing a plurality of meetings in a multi-session, and transmitting voice or text of a user only to a selected room; The user can selectively adjust the volume of the voice delivered to each of the meeting rooms and each user through the chat room and adjusts the volume of each session according to the importance or preference when making a multi- Session volume adjustment module; A user can select a specific room from among the respective meeting rooms or select an entire room to share and designate a specific room or a whole room among the respective meeting rooms, And a jukebox portion including a function of selecting a room and adjusting a music volume.

The jukebox portion includes a music tuning function that tries to buy music for another person, and a gift giving function to purchase music, and when listening to the music through the sharing, Thereby inducing music purchase.

And a fade-out unit for listening to the voice while sharing data through the multimedia sharing unit and displaying the character chat as a fade-out using a transparency value.

The present invention is characterized by further comprising a time schedule unit including a function of listening and playing through the jukebox unit according to a time schedule in order of user-selected music in order.

The present invention is a speech-to-text (STT) function for chat contents in order to support chatting at any time in accordance with a function of reading a character by voice using a TTS (Text-To-Speech) And a function of generating an automatic meeting record using the STT function.

The present invention provides a method for transmitting a voice message, the method comprising: selecting one of a 1: 1, 1: N, and N: N bidirectional voice communication with a session portion to make one or more users make a single session or a multi session; The user can listen to the voice while using the real time sharing function such as photo / video / internet / data / music / camera broadcast, etc. without using other applications for the sharing function. Chatting in real-time, chatting, displaying an attached picture, moving an attached picture back to an existing screen while closing it when clicking again; Performing a voice call and a text chat simultaneously with each of a plurality of meetings through a text chat / voice unit while simultaneously conducting a plurality of meetings in a multi-session, and allowing a voice or character of a user to be transmitted only to a selected room; Allowing a user to selectively adjust the volume of voice delivered to each of the meeting rooms and each user via the chat room, and adjusting the volume of each session according to the importance or preference when making a multi-session call; A user can select a specific room from among the respective meeting rooms or select an entire room to share and designate a specific room or a whole room among the respective meeting rooms, And selecting a room to adjust the music volume.

The present invention relates to a music browsing function that tries to purchase music from another person through a jukebox portion, Limiting the listening time by restricting a time (e.g., 1 minute) when listening to the music being heard through sharing, thereby inducing music purchase; And playing the selected music by the time schedule part in the order of the time schedule according to the jukebox part.

The present invention relates to a method and apparatus for displaying a voice message while sharing data through a fade-out unit of a multimedia sharing unit, and displaying a character chatting by using a transparency value (alpha value) as a fade-out; Generating an automatic meeting list using a Speech-To-Text (STT) function; chatting with a voice when text chatting is difficult using TTS (Text-To-Speech) and implementing a keyword search function; .

In the present invention, when a multi-session call is made through the multi-session volume control module, the volume is adjusted according to the importance or the preference, and the volume is adjusted according to each conference or each user. And can deliver his / her expressions accurately and selectively to other persons during a chat or a meeting.

In addition, the present invention facilitates multi-tasking by allowing a user to share a music purchased during a video chat (part A), to listen to the same music, and to perform a video chat (part B).

In addition, since the present invention does not need to move to another application for viewing the Internet / video or the like by the multimedia sharing function during chatting, it is possible to conveniently chat and look at the same topic, so that a more interesting and rich voice chatting can be performed.

Also, according to the present invention, the voice is converted into a character in a place where the call is difficult or quiet according to the current user's situation, With the STT function, keyword search function and automatic meeting record creation function are available, so that it is possible to chat at any time according to the situation.

In addition, the present invention can maximize sales by using a jukebox to chat with each other while sharing favorite music, and to purchase music.

In addition, the present invention can easily start a multi-session chat or a meeting including a function of inviting a third party of a group call and a group call re-calling function to an existing call record.

In addition, the present invention enables the mobile ARS to select the service desired by the user directly on the screen without waiting for the voice guidance in order, thereby providing very convenient service satisfaction to the customer and saving the enterprise ARS cost of several hundred billion won every year can do.

In addition, the present invention can improve work efficiency by communicating unlimited distance at any time and anywhere between each work team with a single smart phone without having to carry two devices during a work by replacing a radio by utilizing a smart phone.

In addition, the present invention allows a customer to make a contact in a shopping mall or a homepage in real-time by voice and chat with a call center when a customer wants to contact us, and can conveniently consult a question in a voice call or a chat with a TTS function and an STT function conveniently in real time.

FIG. 1 is a diagram showing the overall configuration of an SNS system using wired and wireless IP-based voice and sound according to the present invention.
FIG. 2 is a diagram showing a real-time circular toggle screen for a voice call, a text chat, and a video call according to an embodiment of the present invention.
FIG. 3 is a diagram showing an enlarging function and a reducing function after touching a display unit with a finger according to an embodiment of the present invention.
4 is a view illustrating a volume control window of a user selected in a multi-session according to an exemplary embodiment of the present invention.
FIG. 5 is a diagram illustrating that a user purchases a video chatting through a jukebox unit and shares the same with background music according to an embodiment of the present invention. Referring to FIG.
FIG. 6 is a diagram illustrating a TTS function and an STT function according to an embodiment of the present invention. Referring to FIG.
FIG. 7 is a diagram illustrating a function of inviting a third party of a group call according to an exemplary embodiment of the present invention, and a function of redirecting a group call to an existing call record.
FIG. 8 is a diagram illustrating a function of directly selecting a desired service through a screen according to an embodiment of the present invention. Referring to FIG.
9 is a diagram illustrating a function of replacing a radio using a smartphone according to an embodiment of the present invention.
FIG. 10 is a diagram illustrating an online customer management service (CRM) function according to an embodiment of the present invention.

For a better understanding of the present invention, a preferred embodiment of the present invention will be described with reference to the accompanying drawings. The embodiments of the present invention may be modified into various forms, and the scope of the present invention should not be construed as being limited to the embodiments described in detail below. The present embodiments are provided to enable those skilled in the art to more fully understand the present invention. Therefore, the shapes and the like of the elements in the drawings can be exaggeratedly expressed to emphasize a clearer description. It should be noted that in the drawings, the same members are denoted by the same reference numerals. Further, detailed descriptions of well-known functions and configurations that may be unnecessarily obscured by the gist of the present invention are omitted.

FIG. 1 is a diagram showing the overall configuration of an SNS system using wired and wireless IP-based voice and sound according to the present invention.

Using 1 (1), 1: N, N: N chatting or voice call service using instant messaging technology (IM) technology on a smart phone, tablet, / Sound output unit 111 and provides music information that can be shared in real time during conversation without having to move to another application through the music output unit 112. The music site information, The music information is input in advance through the input unit 113. [

The session unit 1 includes a function of selecting one of 1: 1, 1: N, and N: N bidirectional voice communication to allow one or more users to create, modify and terminate a single session or a multi session .

The multimedia sharing unit 2 may simultaneously perform a plurality of text chatting and voice operations, and may listen to a voice while using a picture / video / internet / data / music / camera broadcast and move to another application It is a module that allows users to chat while chatting in real time without any need, show attached pictures, and move attached pictures back to existing screen while clicking again.

The chatting room unit 3 is a module that simultaneously performs voice communication and text chatting with various meetings through a text chatting / voice chatting unit while simultaneously performing a plurality of meetings in a multi-session, and transmitting voice or text of a user to only selected rooms.

The multisession volume adjustment module 4 allows the user to selectively adjust the volume of the voice delivered to each of the respective meeting rooms and each user through the chat room unit 3, It is a module that enables volume by adjusting the volume of each session.

The jukebox unit 5 allows the user to purchase music and then share the music and chat while listening to the same music. In the multisession, only a specific room is specified, or a whole room is selected and shared, It includes the ability to select a specific room or an entire room and adjust the music volume according to the importance or preference of each user. In this case, other participants can only share the listening.

In addition, the jukebox unit 5 has a time limit (for example, one minute) when listening to the music that has been heard through sharing, thereby restricting listening again, thereby inducing music purchase.

The jukebox unit 5 includes a music browsing function for asking other people to buy music, and a gift giving function for purchasing music.

The fade-out unit 6 is a module for listening to a voice while sharing data through the multimedia sharing unit and displaying a character chat by using a transparency value (alpha value) as a fade-out.

The time schedule unit 7 includes a function of listening and playing a selected music for each user through the jukebox unit in order according to a time schedule.

In addition, the present invention further includes a function of generating an automatic minutes by using the STT (Speech-To-Text) function.

In addition, the present invention further includes a function of chatting by voice when text chatting is difficult using the TTS (Text-To-Speech) function and implementing a keyword search function.

As shown in FIG. 2, the present invention displays a face image of each caller through a toggle screen part 14 by real time circular toggle screens 11 and 12 for voice call, text chat and video call, (13), a diagonal shape (14), a square shape (15), and the like.

In addition, when a real time toggle screen is provided for arranging information sorted in order of priority or importance, and a real time toggle screen for voice call and text chat is provided, At the same time as the view, the existing user has a function of automatically hiding when reaching a certain position, a function of viewing an existing user when dragging to the left, and a function of showing the current speaker at the center.

Also, as shown in FIG. 3, when the user touches the display unit with the finger, the user can zoom in according to the number of times the finger is tapped, Function and so on.

4, a user volume control window 111 for adjusting a volume of a selected user in a multisession, a toggle volume control window 341 for adjusting a volume in a specific toggle screen including a plurality of caller face images, Can be displayed.

Therefore, while performing various meetings in the multi-session through the chatting room (3), voice communication and text chatting are performed simultaneously with various meetings with the text chatting / voice chatting, and the volume control window (341) This is a module that allows the user's voice or text to be transmitted only to the room.

As shown in FIG. 5, video chatting (part B) is possible by sharing music purchased by a user during video chatting through the jukebox part 5 (part A) and listening to the same music.

FIG. 6 shows a voice chatting function according to the current user's situation. In a situation where the voice is difficult to read, the voice is converted into a character, To support this, it is possible to support keyword search by STT function for chat contents.

As shown in FIG. 7, includes a function of additionally inviting a third party of the group call and a function of re-calling the group call with the existing call record.

As shown in FIG. 8, the mobile ARS can directly select a service desired by the user on the screen without waiting for and listening to the voice guidance in order, thereby providing a very convenient service satisfaction to the customer, ARS costs can be saved.

FIG. 9 is a schematic diagram illustrating a radio (RoIP) service function capable of improving work efficiency by communicating with each work team anytime and anywhere (distance unlimited) without having to carry two devices during a work by replacing a radio using a smart phone .

As shown in FIG. 10, when a customer wants to contact us at a shopping mall or a home page, he or she can talk to the call center in real time by voice and chat with the call center. The TTS function and the STT function can consult the inquiries in real- And online customer care service (CRM) capabilities.

Hereinafter, a call method using an SNS system utilizing a wired and wireless IP-based voice and a sound for implementing the present invention will be described in detail.

The present invention first selects one of 1: 1, 1: N, and N: N bidirectional voice communication in a session section, and one or more users create a single session or a multi session.

In addition, it is possible to simultaneously perform a plurality of text chatting and voice and to listen to voice while using real time sharing function such as photo / video / internet / data / music / camera broadcasting, You can chat in real-time while you are chatting. You can also show attached pictures.

Continuously, multiple conversations are performed simultaneously in the multi-session, and voice and text chat is performed simultaneously with each meeting through the text chat / voice unit, and the voice or character of the user is transmitted only to the selected room.

In addition, the user can selectively adjust the volume of voice delivered to each of the respective meeting rooms and each user via the chatting room, and in the case of multi-session calling, the volume of each session is controlled according to the importance or preference .

Finally, the user can share the purchased music and chat while listening to the same music during the voice chatting, or designate a specific room among the respective meeting rooms in the multi-session, select and share the entire room, and select specific rooms or all Select room to adjust music volume.

In addition, the present invention further includes a music tuning function in which the jukebox unit tries to buy music for another person, and a gift-giving step for purchasing music.

In addition, the present invention further includes a step of displaying a voice chat by using a transparency value (alpha value) as a fade-out by listening to a voice while the fade-out unit shares data via the multimedia sharing unit.

In addition, the present invention further includes a step of the time schedule unit playing the selected music for each user in order through the jukebox unit according to a time schedule.

The present invention further includes a step of generating an automatic meeting record using a Speech-To-Text (STT) function.

In addition, the method further includes voice chatting when text chatting is difficult using TTS (Text-To-Speech), and implementing a keyword search function.

1: session section
2: Multimedia sharing unit
3:
4: Multisession volume control module
5: Jukebox part
6: Fade out section
7: Time schedule section
8: STT (Speech-To-Text)
9: Text-To-Speech (TTS)
111: Voice / Sound output unit
112: music output unit
113:

Claims

In an SNS system using wired and wireless IP-based voice and sound,
A session unit for selecting one of 1: 1, 1: N, and N: N bidirectional voice communication so that one or more users can create, modify and terminate a single session or a multi session;
The user can listen to the voice while using the real time sharing function such as photo / video / internet / data / music / camera broadcast, etc. without using other applications for the sharing function. A multimedia sharing unit that allows chatting while real time sharing, shows attached pictures, and closes the attached pictures when clicking again, and moves to the existing screen again;
A chatting part for simultaneously performing a voice call and a text chat with each of a plurality of meetings through a text chat / voice part while simultaneously performing a plurality of meetings in a multi-session, and transmitting voice or text of a user only to a selected room;
The user can selectively adjust the volume of the voice delivered to each of the meeting rooms and each user through the chat room and adjusts the volume of each session according to the importance or preference when making a multi- Session volume adjustment module;
A user volume control window for adjusting a volume of a user selected in the multisession;
A toggle volume adjustment window for adjusting the volume in a specific toggle screen portion including a plurality of caller face images;
A user can select a specific room from among the respective meeting rooms or select an entire room to share and designate a specific room or a whole room among the respective meeting rooms, It includes the ability to control the volume of music by selecting a room, a music tuning function that tries to buy music for others, and a gift giving gift by purchasing music. A jukebox unit for restricting listening again with a time limit when inducing replay and inducing music purchase;
A fade-out unit for listening to a voice while sharing data through the multimedia sharing unit and for displaying a character chat using a transparency value as a fade-out;
And a time schedule unit including a function of listening and playing through the jukebox unit in accordance with a time schedule in order of user-selected music in a sequential order, wherein the character is a text-to-speech (TTS) A voice search function or a function of generating an automatic meeting record by using a keyword search function or the STT function by using a Speech-To-Text (STT) function for chat contents to support chatting at any time according to a situation Voice and Sound based SNS system using wired and wireless IP.

delete

Selecting one of a 1: 1, 1: N, and N: N bidirectional voice communication in a session section so that one or more users make a single session or a multi session;
The user can listen to the voice while using the real time sharing function such as photo / video / internet / data / music / camera broadcast, etc. without using other applications for the sharing function. Chatting in real-time, chatting, displaying an attached picture, moving an attached picture back to an existing screen while closing it when clicking again;
Performing a voice call and a text chat simultaneously with each of a plurality of meetings through a text chat / voice unit while simultaneously conducting a plurality of meetings in a multi-session, and allowing a voice or character of a user to be transmitted only to a selected room;
Allowing a user to selectively adjust the volume of voice delivered to each of the meeting rooms and each user via the chat room, and adjusting the volume of each session according to the importance or preference when making a multi-session call;
A user can select a specific room from among the respective meeting rooms or select an entire room to share and designate a specific room or a whole room among the respective meeting rooms, Selecting a room to adjust a music volume;
The music jogging function that tries to buy music from other people through the jukebox part;
A step of restricting listening by restricting a time limit when listening to music through sharing;
A step of the time schedule part playing the selected music for each user sequentially through the jukebox part according to a time schedule;
Listening to a voice during sharing of data through a fade-out unit of the multimedia sharing unit and displaying the character chatting as a fade-out using a transparency value;
Generating an automatic meeting list using a Speech-To-Text (STT) function; chatting with a voice when text chatting is difficult using TTS (Text-To-Speech) and implementing a keyword search function; Wherein the method comprises the steps of: receiving an IP-based voice / sound signal from the SNS system;

delete