KR20130106462A - Apparatus, method and computer-readable recording medium for controlling voice input of a mobile terminal by using a moving sensor - Google Patents

Abstract

PURPOSE: A voice input controlling device and a method thereof are provided to inactivate the voice input when turning a mobile terminal over, thereby controlling the voice input. CONSTITUTION: A chatting group administration unit (410) generates a chat room in which a plurality of users is able to participate by using mobile terminals. A mode setting administration unit (420) receives the voice conversation status information about the mobile terminal of each user participating in the chat room. A real-time voice processing unit (430) receives the voice information from the mobile terminal of one user among a plurality of user. The real-time voice processing unit transmits the voice information to the mobile terminal of other users in the chat room on a real-time basis. A chatting information transmission unit (440) receives the voice conversation status information from the mobile terminal of one user among a plurality of users. The chatting information transmission unit transmits the voice conversation status information to the mobile terminal of other user in the chat room. [Reference numerals] (100) Messenger server; (410) Chatting group administration unit; (420) Mode setting administration unit; (430) Real-time voice processing unit; (440) Chatting information transmission unit; (450) D/B member information; (460) D/B chatting group information; (470) D/B mode setting information

Description

Apparatus, method and computer readable recording medium for controlling voice input in a mobile terminal using a motion sensor TECHNICAL FIELD

The present invention relates to a method for controlling voice input in a mobile terminal, and more particularly, to a system for controlling voice input in a mobile terminal using a motion sensor capable of controlling voice input of the mobile terminal using only the movement of the mobile terminal. , Apparatus and method.

Today, the widespread use of the Internet has led to the rapid development of wireless mobile communication technology beyond the fixed line, and in the real world, information retrieval on the Internet through portable terminals such as mobile phones, PDAs, and hand- It became possible regardless of time and place.

In addition, as the performance of recently launched smartphones has improved, users are moving a lot from general mobile phones to smart phones. A smart phone is an intelligent mobile phone that adds computer support to a mobile phone. It is faithful to the mobile phone function, but adds a personal digital assistant (PDA) function, Internet function, and video playback function. Etc. are provided to provide a more convenient interface. In addition, with the support of wireless Internet function, it is connected to internet and computer, and also functions as a terminal such as e-mail, web browsing, fax, banking, and game. On the other hand, smart phones have a standard operating system (OS) or a dedicated operating system to accommodate various functions. As described above, since various functions can be implemented through various user terminals such as a smart phone, various dedicated application programs and contents that are driven in the user terminal are being developed.

On the other hand, users who need various types of communication communicate on the homepage, e-mail, and telephone ARS (Auto Response Service) .However, the homepage and e-mail are less real-time in customer communication. There is an advantage, but there is a disadvantage that the communication cost burden on the user. On the other hand, there is an instant messenger (i.e., a messenger) as a useful method for real-time transmission of information using the Internet. The purpose of messenger is to deliver a simple message between users in real time. The messenger can talk in real time through the letters that are transmitted as if the two users talk directly. This is because the messenger itself attaches importance to the real-time nature of the message and immediately transmits the input contents.

Recently, such a messenger is being serviced even in a smartphone, and has evolved into an advanced form by adding various additional functions in addition to the basic functions of the messenger. For example, a voice call or a video call function is also provided through a messenger.

In addition, in order to provide separate communication means between users participating in the same game or users participating in a plurality of games provided by the same service provider, a game-only messenger (eg, game talk) has appeared. Since the game-only messenger provides a voice chat function between groups, a plurality of users who play the same game through a terminal such as a PC can communicate with other users through a game-only messenger installed in their smartphone while playing. Can be. Therefore, the number of users is increasing as a more effective means of communication than the simple text chat function provided in the game.

However, there is a case where the voice input is temporarily stopped during the voice conversation in the group which participated through the game-only messenger. Such a situation may occur frequently during game play, and a user may have to operate an input key provided in a smartphone or separately operate a controller of an earphone to interrupt voice input. In other words, if you want to turn off the voice input, it is inconvenient to turn off the voice input through the setting menu in the messenger program or leave the messenger chat group at all. have.

On the other hand, as a technology for providing a service by interlocking with a messenger and a game, Korean Patent Publication No. 10-0481140 "Online game method and online game system that provides location information of a game character by interworking with a messenger server (NH: Note)) "(Document 1) discloses a method for providing position information of a game character on an online game in association with a messenger server. However, although the above method is interworking with a messenger server and a specific game, it does not provide a method for controlling voice input.

Accordingly, there is a need for a method for effectively and easily controlling voice input without a separate user input key manipulation.

[Document 1] Online game method and online game system that provides location information of a game character in connection with the Republic of Korea Patent Publication No. 10-0481140 messenger server (NH Yen) 2005.03.25

SUMMARY OF THE INVENTION An object of the present invention is to provide a system, an apparatus, and a method for controlling voice input in a mobile terminal using a motion sensor that can deactivate the voice input when the mobile terminal is flipped (flip state) during a voice conversation in a mobile messenger through the mobile terminal. In providing.

In addition, another object of the present invention is to connect to a game messenger that can have a voice chat with a plurality of game users through the mobile terminal, the movement that can deactivate the voice input when inverting the mobile terminal during the voice chat through the game messenger A system, apparatus, and method for controlling voice input in a mobile terminal using a sensor are provided.

In addition, another object of the present invention is to connect to a game messenger that can have a voice chat with a plurality of game users through the mobile terminal, and deactivates the voice input when the mobile terminal is turned over during the voice chat through the game messenger, the voice The present invention provides a system, apparatus, and method for controlling voice input in a mobile terminal using a motion sensor that can display an inactive state of an input to terminals of other users.

In addition, another object of the present invention is connected to a game messenger that can have a voice chat with a plurality of game users through the mobile terminal, and the user selected in advance when the mobile terminal is flipped over a certain angle range during the voice chat through the game messenger The present invention provides a system, apparatus, and method for controlling voice input in a mobile terminal using a motion sensor to activate voice input only.

In order to achieve the above-described object of the present invention and to achieve the specific effects of the present invention described below, the characteristic structure of the present invention is as follows.

According to an aspect of the present invention, a messenger server that provides a voice conversation function between a plurality of mobile terminals through a messenger that controls a voice input using a motion sensor is based on a request for creating a chat room. Chat group management unit for generating a chat room that can participate by participating in any of the plurality of users participating in the generated chat room, mode setting management unit for receiving and storing voice chat status information for the mobile terminal of each user participating in the generated chat room Receiving voice information from a mobile terminal of a user, and includes a real-time voice processing unit for processing the voice information in real time to the mobile terminal of the other users in the chat room, the voice conversation status information is mobile in the first flip-talk mode The terminal does not have a flip angle with the ground And each set or more, characterized in that the transmission is blocked in the input audio signal.

Preferably, the messenger server receives the voice conversation status information from the mobile terminal of any one of the plurality of users who perform a voice conversation in the chat room generated and transmitted to the mobile terminal of the other users in the chat room. The apparatus further includes an information transmitter, wherein the transmitted voice conversation state information is displayed in an image form on the mobile terminal of the other users.

Preferably, the voice conversation status information is any one selected from a voice call enabled state, a voice call disabling state, a first flip talk mode that completely blocks the voice conversation transmission, and a second flip talk mode that partially blocks the voice conversation transmission. That's it.

Preferably, the messenger is a game messenger that provides a conversation function between a plurality of users participating in the plurality of games in cooperation with a plurality of game driving modules that provide respective game functions.

Preferably, the transmission interruption of the input voice signal is performed when a state in which the flip angle detected by the motion sensor in the mobile terminal in which the first flip talk mode is set is longer than or equal to a preset angle lasts for more than a preset time.

Preferably, the predetermined angle is characterized in that 90 ° or more and 180 ° or less.

Preferably, when the voice conversation state information received from the specific mobile terminal by the mode setting manager is the second flip-talk mode, the real-time voice processing unit is received only to the mobile terminal of a preset user among the users in the chat room. Transmit and process voice information.

Preferably, the second flip talk mode is set when the flip angle detected by the motion sensor in the specific mobile terminal is 45 ° or more and 135 ° or less.

Preferably, the preset user is a user that the user of the specific mobile terminal is set as a friend.

According to another aspect of the present invention, a method for controlling a voice input in a mobile terminal using a motion sensor, wherein each step performed in the messenger server is performed by a plurality of users using the mobile terminals based on a chat room creation request. Generating a chat room that can participate, Receiving and storing voice chat status information for the mobile terminal of each user participating in the generated chat room, and Mobile terminal of any one of the plurality of users participating in the generated chat room Receiving voice information from the mobile terminal, and transmitting the voice information to a mobile terminal of other users in the chat room in real time, wherein the user terminal whose voice conversation state information is in the first flip talk mode has a flip angle with the ground; Is more than a preset angle, the transmission of the input voice signal It is characterized in that it is blocked.

Meanwhile, information for receiving a method for controlling voice input in a mobile terminal using the motion sensor may be stored in a recording medium readable by a server computer. Such a recording medium includes all kinds of recording media in which programs and data are stored so that they can be read by a computer system. Examples include ROMs (Read Only Memory), Random Access Memory, CD (Compact Disk), DVD (Digital Video Disk) -ROM, magnetic tape, floppy disk, optical data storage device, (For example, transmission over the Internet). Such a recording medium may also be distributed over a networked computer system so that computer readable code in a distributed manner can be stored and executed.

As described above, according to the present invention, when the voice input is temporarily blocked while making a voice call through the mobile messenger installed in the mobile terminal, there is an advantage that it can be controlled more easily than the control through the conventional key input. . For example, the voice input can be cut off simply by flipping the mobile terminal upside down, and the voice input can be easily resumed by flipping the mobile terminal back to its original state.

Therefore, there is an advantage that it can be effectively used in the game messenger that can frequently occur a situation where you want to temporarily stop the voice input during game play.

In addition, the user has an advantage of clearly recognizing whether his voice input state is active or inactive even by checking only the state where his mobile terminal is placed.

1 is a diagram illustrating a system for controlling voice input in a mobile terminal according to an embodiment of the present invention.
2 is a block diagram showing a detailed structure of a user terminal according to an embodiment of the present invention.
3 is a block diagram illustrating a detailed structure of a messenger client application installed in a user terminal according to an embodiment of the present invention.
4 is a block diagram illustrating a detailed structure of a messenger server that provides voice input control according to an embodiment of the present invention.
5 is a signal flowchart illustrating a procedure for controlling voice input in a mobile terminal according to an embodiment of the present invention.
6 is a signal flow diagram illustrating a procedure for controlling voice input in a mobile terminal according to another embodiment of the present invention.
7 is a flowchart illustrating a detailed procedure of determining a flip situation according to an embodiment of the present invention.
8 is a graph illustrating a flip situation determination according to the flip angle according to an embodiment of the present invention.
9 is a diagram illustrating a flip situation in a smartphone according to an embodiment of the present invention.
10 and 11 illustrate flip angle sensing ranges according to an exemplary embodiment of the present invention.
12 is a diagram illustrating a game messenger service system to which the present invention is applied.
13 and 14 illustrate screens of a game messenger according to an exemplary embodiment of the present invention.
15 is a diagram illustrating an example of an image for displaying a user status in a messenger according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

The present invention proposes a method for deactivating a voice input by keeping the mobile terminal in a flip state (inverted state) during a voice conversation through a mobile messenger in the mobile terminal. Meanwhile, according to an exemplary embodiment of the present invention, the flip state determination of the mobile terminal may be determined through various motion sensors (eg, a geomagnetic sensor, a gyroscope sensor, a gravity sensor, etc.) provided in the mobile terminal. At this time, according to an embodiment of the present invention, if the angle formed by the mobile terminal lasts more than a preset angle for more than a preset time, it is determined as a flip state.

In particular, the present invention proposes a method for controlling the voice input according to the flip state of the mobile terminal during the voice chat through the game messenger in the mobile terminal. In addition, according to an embodiment of the present invention, when the flip angle between the mobile terminal and the ground during the voice conversation falls within a preset specific angle range, specific users selected in advance (for example, users set as friends in the conversation group). You can also control voice input to only be activated.

On the other hand, in the following description, a mobile messenger (or mobile game messenger) is installed and the 'mobile terminal' to which the present invention is applied to determine the flip state is a mobile terminal such as a smart phone, a laptop computer, Any terminal may be used as long as it is a portable or mobile terminal such as a digital broadcasting terminal, an MP3 player, a personal digital assistant (PDA), a portable multimedia player (PMP), or a navigation device. In the following description, for convenience of description, the mobile terminal will be described using the term user terminal.

In addition, in the following detailed description, the 'mobile messenger' is an application program (i.e., an application) installed in the mobile terminal, and provides a messenger function in the mobile terminal, and preferably includes a voice chat function according to the present invention. In addition, the mobile messenger may have a voice conversation with other users logged into the messenger program through a general PC.

In addition, the "game messenger" is a messenger linked to at least one game, and means a communication means for communicating between users who have subscribed to a particular game. Therefore, it is possible to log in to the game messenger and communicate with other users who have subscribed to the same game or a plurality of games provided by the same operator. Similarly, according to an embodiment of the present invention, it is preferable that the game messenger includes a voice conversation function.

In addition, a "motion sensor" is a concept of a broad term for all kinds of sensors mounted on the mobile terminal and capable of detecting the movement of the mobile terminal, and include a geomagnetic sensor, a gyro sensor, a motion sensor, an acceleration sensor, an inertial sensor, and the like. May be included. Meanwhile, in the present invention, any type of sensor may be used in the present invention as long as it is a sensor capable of determining an angle between the mobile terminal and the ground.

In addition, in the present invention described below, a function according to an embodiment of the present invention (that is, a function of controlling to block a voice input signal when the user terminal is inverted (flip state) during a voice conversation) is referred to as 'flip talk'. The function will be called.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

System for Voice Input Control in Mobile Terminal

1 is a diagram illustrating a system for controlling voice input in a mobile terminal according to an embodiment of the present invention. Referring to FIG. 1, a system according to an embodiment of the present invention may include a messenger server 100, a communication network 110, a user terminal 120, and the like, and a voice input unit ( 121).

The messenger server 100 provides a chat function through the messenger program of the user terminals 120 through the communication network 110 according to an embodiment of the present invention. In particular, a voice chat function is provided to provide a function according to the present invention. Detailed functions of the messenger server 100 will be described later with reference to FIG. 4.

The communication network 110 may be configured without regard to its communication mode, such as wired and wireless, and may be a personal area network (PAN), a local area network (LAN), a metropolitan area network ), A wide area network (WAN), and the like. Also, the communication network 410 may be a known World Wide Web (WWW), and may use a wireless transmission technology used for short-distance communication such as Infrared Data Association (IrDA) or Bluetooth It is possible.

The user terminal 120 installs and executes a messenger program and performs a chat with other user terminals 120 through the communication network 110 and the messenger server 100. At this time, the voice input unit 121 provided in each user terminal 120 and the voice conversation function of the messenger program enable voice conversation between the user terminals 120 through a messenger. For example, when a messenger program is executed and a plurality of users participate in a chat group (chat room) or a chat group (or chat room) generated in the messenger program, real-time voice chat between the plurality of participating users is possible. At this time, when some of the plurality of users who participated in the chat group are not provided with the voice chat function (eg, when the terminal is not equipped with a microphone, when the voice chat use function is turned off, a sound card or the like is not installed). In some cases, voice chat may be possible between users provided with the remaining voice chat function.

Hereinafter, detailed configurations of the messenger server 100 and the user terminal 120 will be described in detail with reference to FIGS. 2 to 4.

User terminal

2 is a block diagram showing a detailed structure of a user terminal according to an embodiment of the present invention. Referring to FIG. 2, the user terminal 120 according to an embodiment of the present invention may include a touch pad 220 including a voice input unit 210, a key input unit 221, and a screen display unit 222, and at least one sensor. It may be configured to include a storage unit 260 in which the motion sensor unit 230, the control unit 240, the wireless communication unit 250, the messenger client application 261 is included. On the other hand, the components shown in FIG. 2 are not essential and may have additional components or some components may be excluded or replaced.

Hereinafter, each component will be described in detail.

The wireless communication unit 250 includes one or more modules that enable wireless communication between the user terminal (ie, the mobile terminal) 120 and the wireless communication system or between the user terminal 120 and the network in which the user terminal 120 is located. can do. For example, the wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless internet module, and the like.

The wireless communication unit 250 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception. In addition, the wireless communication unit 250 may provide a wireless Internet access function, and wireless Internet access technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), and Wimax (World Interoperability for Microwave Access). , HSDPA (High Speed Downlink Packet Access) may be used, but the present invention is not limited thereto.

The voice input unit 210 is for inputting an audio signal and may include a microphone or the like. The microphone receives an external sound signal in a call mode, a recording mode, a voice recognition mode, etc., and processes it into electrical voice data. In particular, according to an embodiment of the present invention performs a function of receiving a voice signal for transmitting to other users in the chat group in the voice chat mode of the mobile messenger (or game messenger). The processed voice data may be converted into a form transmittable to the mobile communication base station through the wireless communication unit 250 and output in the call mode. The voice input unit 210 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal, or may be implemented by two or more microphones.

The key input unit 221 is a user interface for receiving various commands from a user, and its implementation is not particularly limited. In general, a keypad type, a wheel key type, a touch pad type, a touch screen type, or the like may be used in combination. Recently, a large number of touch screen systems have been adopted due to increased space utilization, enlargement of display screens, and design considerations. In this case, a single touch pad 220 may be used for the input unit 221 and the screen display unit 222. You can also provide functionality at the same time.

The sensor unit 230 detects a movement of the user terminal 120 and generates a sensing signal relating thereto. The sensing signal may be transmitted to the controller 240. That is, according to an embodiment of the present invention, the sensor unit 230 may detect an event related to a specific motion generated in the user terminal itself. For example, the sensor unit 230 may detect a motion event of the user terminal 120 by including a motion sensor such as a gyro sensor, a geomagnetic sensor, an acceleration sensor, or the like. That is, as the motion sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an inertial sensor, etc. may be used. In addition, any sensor capable of detecting / recognizing the movement, motion, and position of an object may be applied without particular limitation. Of course. In particular, according to an exemplary embodiment of the present invention, the user terminal 120 senses an angle formed with the ground to determine whether the user terminal 120 is converted to the flip state. Detailed description thereof will be described later with reference to FIGS. 7 to 11.

Meanwhile, whether to activate or deactivate the movement of the sensor unit 230 may be determined according to a user's setting. For example, if the user does not want to execute a function according to the movements according to the present invention described below, the sensor unit 230 may be set to be inactivated. Alternatively, whether the sensor unit 230 is activated or deactivated may be automatically controlled by the user terminal according to a specific situation. For example, when an alarm / morning call is being transmitted after a call is received until the user presses a call button or while a broadcast receiving / video playing application is running, the sensor unit may be used only in a voice conversation situation of the mobile messenger. The sensing operation of 230 may be set to be activated. This will be more clearly understood from the description below.

The screen display unit 222 displays and outputs information processed by the user terminal 120 to generate output related to visual, auditory, or tactile. For example, when the user terminal 120 is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. In addition, when the user terminal 120 is in a video call mode or a photographing mode, the user terminal 120 may display a photographed and / or received image, a UI, or a GUI. In addition, the screen display unit 222 may include two or more display devices or modules according to the implementation form of the user terminal 120. On the other hand, when the display device / module constituting the screen display unit 222 and the touch sensor have a mutual layer structure (eg, a touch screen), the screen display unit 222 may be used as an input device in addition to the output device. have. In this case, the touch sensor may have, for example, a form of a touch film, a touch sheet, or a touch pad.

Voice output unit (not shown) Audio data received from the wireless communication unit 250 or stored in the storage unit 260 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, a voice conversation mode in a mobile messenger, and the like. You can output In addition, the voice output unit may output a sound signal associated with a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the user terminal 120. The voice output unit may include a receiver, a speaker, a buzzer, and the like.

The storage unit 261 may store a program for the operation of the controller 240, and may store input / output data (eg, a phone book, a message, a still image, a video, etc.). The storage unit 260 may also store data relating to various patterns of vibration and sound output when a touch input on the touch screen is performed.

In this case, in connection with the present invention, the storage unit 260 may store and install a messenger client application 261. A detailed description thereof will be described later with reference to FIG. 3. Meanwhile, the flip state may be determined according to an angle change related to the movement sensed by the sensor unit 230, and the functions of blocking or limiting the input of the voice input unit 210 may be stored in advance.

The storage unit 260 may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (for example, SD or XD memory). Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), It may include a storage medium of at least one type of magnetic disk, optical disk. The user terminal 120 may operate in association with a web storage that performs a storage function of the storage unit 260 on the Internet.

The interface unit (not shown) serves as a path with all external devices connected to the user terminal 120. The interface unit may receive data from an external device or receive power to transfer the data to each component inside the user terminal 120 or to transmit data within the user terminal 120 to the external device. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port and the earphone port may be included in the interface unit.

The identification module (not shown) is a chip that stores various types of information for authenticating the use authority of the user terminal 120, and includes a user identification module (UIM), a subscriber identity module (SIM), and a general purpose. It may include a user authentication module (Universal Subscriber Identity Module, USIM). Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Therefore, the identification device may be connected to the user terminal 120 through the port.

In addition, when the user terminal 120 is connected to an external cradle, the interface unit may be a passage through which power from the cradle is supplied to the user terminal 120, or various command signals input from the cradle may be input by the user. It may be a passage that is delivered to the user terminal 120. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 240 typically controls the overall operation of the user terminal 120. For example, voice communication, data communication, video communication, and the like. The controller 240 may include a multimedia module for playing multimedia. The multimedia module may be implemented in the controller 240 or may be implemented separately from the controller 240. In addition, the controller 240 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

In addition, according to an exemplary embodiment of the present disclosure, when it is determined that the user terminal 120 is in a flip state from the sensed signal of the sensor unit 230, the control unit 240 receives an input signal of the voice input unit 210. It can also be controlled to block.

The power supply unit (not shown) receives an external power source and an internal power source under the control of the controller 240 to supply power for operation of each component.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the control unit 240.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the storage unit 260 and executed by the controller 240.

3 is a block diagram illustrating a detailed structure of a messenger client application 261 installed in the user terminal 120 according to an embodiment of the present invention. Referring to FIG. 3, the messenger client application 261 installed in the user terminal 120 includes a mode setting unit 310, a chat window generating unit 320, a voice input processing unit 330, and a flip state detecting unit 340. ), A voice input blocker 350, and the like.

The mode setting unit 310 sets and stores various modes provided by the mobile messenger program installed in the user terminal 120. In addition, each mode setting value set by the mode setting unit 310 may be transmitted to the messenger server 100 through the communication network 110. On the other hand, examples of the mode to be set, such as text chat mode, voice call mode, video call mode, function setting mode, voice call mode, all calls mode, 1: 1 call mode (eg whisper call mode) Call mode can be a detailed function setting mode.

In addition, the set mode according to an embodiment of the present invention may further include a mode for setting a function to control to block the voice input signal when the user terminal 120 flips in the voice call mode.

As such, when the voice input signal blocking function according to the flip of the user terminal 120 is set through the mode setting unit 310, the flip state detection unit 340 according to the setting flips the flip of the user terminal 120. When the state is detected and the detection result is determined to be the flip state, the voice input blocker 350 blocks the voice input signal of the user terminal 120.

The chat window generating unit 320 performs a function of generating a chat window for providing a basic function of a mobile messenger. In addition, the user can participate in the chat window that has already been created, the group chat. At this time, in the generated chat window, it is possible to send and receive texts with other users participating in the group, and perform a voice conversation according to an embodiment of the present invention.

Meanwhile, the chat window generating unit 320 may further display chat status information of other users in the group in the chat window according to an embodiment of the present invention. In addition, according to an embodiment of the present invention, it may be displayed whether a specific user is currently in a flip-talk state (see FIGS. 14 and 15).

The voice input processing unit 330 performs a function of transmitting the voice signal input through the voice input unit 210 to the user terminal 120 of another user in the messenger group through the wireless communication unit 250. In this case, the voice signal input according to an embodiment of the present invention is not transmitted to all users in the group, but is transmitted only to a specific user (eg, a user set as a friend) or a user selected as a 1: 1 conversation. It may be.

The flip state detector 340 detects whether the user terminal 120 is in a flip state according to an embodiment of the present invention. That is, for this purpose, the flip state detecting unit 340 is provided with real-time angle information of the ground of the user terminal 120 sensed by the sensor unit 230, and the current user terminal 120 is in a flip state ( That is, it is determined whether it is upside down). The flip state determination method of the flip state detection unit 340 may be implemented in various ways. For example, the flip state detection unit 340 may be implemented by the method of FIGS. 7 and 8 to be described later.

The voice input blocker 350 is input when the flip state detection unit 340 is determined to be in a flip state in a state where the flip talk function is set to be used in the mode setting unit 310 as described above. The voice signal is blocked and no voice signal is transmitted to the messenger server 100 or other user terminals 120 in the group.

Messenger server

4 is a block diagram illustrating a detailed structure of a messenger server that provides voice input control according to an embodiment of the present invention. Referring to FIG. 4, the messenger server 100 may include a chat group manager 410, a mode setting manager 420, a real time voice processor 430, and a chat information transmitter 440. In addition, the messenger server 100 may include at least one database, such as a member information database 450, a chat group information database 460, and a mode setting information database 470.

The chat group manager 410 sets and manages a plurality of users participating in a specific chat room generated by a messenger as a group, and stores the group related information in the chat group information database 460. In addition, when a specific user creates a new chat group, an identifier for the created group is assigned, and information related to the group (for example, group participation condition, group restriction number, group attribute information, etc.) is input or generated. Save it.

On the other hand, the present invention is preferably applied to a situation where a plurality of users voice chat at the same time in one chat room, it is applicable to the case of having a 1: 1 chat by creating a 1: 1 chat window.

The mode setting manager 420 manages a mode set for each generated chat group, and manages a set mode of each user participating in the chat group. The set mode information is stored in the mode setting information database 470. Meanwhile, when a specific user in a specific group sets the flip talk mode according to an embodiment of the present invention, the set information is checked by the mode setting manager 420, and each function of the messenger according to the mode setting (eg, Flip talk function).

When the generated chat group is a voice conversation group, the real time voice processor 430 transmits and processes the voice information transmitted from each user terminal 120 to other user terminals 120 in the corresponding group in real time. In this case, during the multi-party voice conversation, the messenger server 100 may synthesize and transmit a plurality of voice signals received from each user terminal in a corresponding group, and separately transmit individual voice signals of each user according to another embodiment. In addition, each user terminal may be implemented to synthesize and output a plurality of voice signals transmitted from a plurality of different user terminals.

When a specific user in the same group selects a specific mode or attempts to change the mode, or when a chat state is changed, the chat information transmitter 440 may transmit the chat related information of each user to another user terminal in the same group. Perform a function of transmitting to 120. For example, when a specific user terminal 120 is in a flip talk state according to an embodiment of the present invention, the user's flip talk mode conversion information is transmitted to another user terminal 120 in the same group. In this case, each user terminal 120 receiving the mode conversion information may display the mode of the corresponding user as an image through a generated chat window (see FIGS. 14 and 15).

The member information database 450 stores various personal information of users who have subscribed to the messenger service as a member.

The system and apparatus according to the embodiment of the present invention have been described above with reference to FIGS. 1 to 4. Hereinafter, a voice input control method according to an embodiment of the present invention will be described with reference to FIGS. 5 to 7.

Method for Voice Input Control in Mobile Terminal

5 is a signal flowchart illustrating a procedure for controlling voice input in a mobile terminal according to an embodiment of the present invention. Referring to FIG. 5, first, the user terminal A 120a installs a messenger client program, connects to the messenger server 100 (S501), and logs in (S502). At this time, by creating a new chat group, or by participating in the already created chat group (S503) it is possible to voice chat (S505) via a mobile messenger according to the present invention. That is, at least one other user terminal (that is, user terminal B 120b) may also participate in the chat group in which the user terminal A 120a participates (S504) and perform a voice chat together.

On the other hand, if the user terminal A (120a) detects the flip situation according to an embodiment of the present invention (S506), the voice input is blocked (S507). At this time, the user terminal A (120a) is preferably set in advance to use the flip-talk mode.

As such, when the voice input is blocked due to the flip situation, the flip state information (that is, the voice input blocking state information) of the user terminal A 120a is transmitted to the messenger server 100 (S508). The messenger server 100 changes the state of the corresponding user to a flip state (S509), and transmits the information according to the state change to another user terminal (that is, user terminal B 120b) in the group (S510). . In response to receiving the state change information of the user terminal A 120a, the user terminal B 102b changes the state display of the corresponding user to a flip state in the displayed chat window (S511).

FIG. 5 illustrates a method of blocking a voice input when a user terminal is in a flip state according to an embodiment of the present invention. However, according to another embodiment of the present invention, various modes of a voice conversation are set according to flip angles. It is also possible. For example, when the flip angle of the user terminal maintains an angle within a predetermined range, the voice may be transmitted only to a specific user set (eg, a user set as a friend) in the corresponding chat group.

6 is a signal flow diagram illustrating a procedure for controlling voice input in a mobile terminal according to another embodiment of the present invention. Referring to FIG. 6, first, the user terminal A 120a installs a messenger client program, accesses the messenger server 100 at step S601, and logs in at step S602. At this time, by creating a new chat group, or by participating in the already created chat group (S603) it is possible to voice chat (S606) via a mobile messenger according to the present invention. That is, at least one other user terminal (that is, user terminal B (120b) and user terminal C (120c)) also participates in the chat group in which the user terminal A (120a) (S604, S605) to perform a voice chat together can do.

On the other hand, when the user terminal A (120a) detects the anti-flip situation (for example, the angle between the user terminal 120 and the ground is within a predetermined predetermined angle) according to another embodiment of the present invention (S607) The half flip state information is transmitted to the messenger server 100 (S608), and the voice signal input from the user terminal A 120a is continuously transmitted. In this case, the user terminal A (120a) is preferably set in advance using a flip-talk mode or a half-flip mode.

As described above, when the anti-flip situation occurs, as described above, the anti-flip state information of the user terminal A 120a is transmitted to the messenger server 100 (S608), and the messenger server 100 displays a state of the corresponding user. Change to the half-flip state (S609), and transmits the information according to the state change to the other user terminal (ie, user terminal B (120b) and user terminal C (120c)) in the group. In this case, according to the anti-flip state setting, the voice input information of the user terminal A 120a is synthesized with the voice information of other user terminals (S610), and the synthesized voice information is transmitted only to the user terminal B 120b (S611, S612).

By doing so, the user can use various voice chat functions by changing the flip angle of the user terminal 120 during the voice chat through the mobile messenger.

Flip angle judgment method

Hereinafter, a method of determining a flip state according to an embodiment of the present invention will be described with reference to FIGS. 7 to 11.

7 is a flowchart illustrating a detailed procedure of determining a flip situation according to an embodiment of the present invention. Referring to FIG. 7, the angle between the user terminal sensed by the motion sensor and the ground according to an embodiment of the present invention (for convenience, referred to as a flip angle) is greater than or equal to a predetermined value. If held, it is determined to be in a flip state. The reason for determining the flip state in this manner is that the flip angle of the user terminal may be temporarily changed unintentionally during the voice chat when the user sets the flip talk mode.

In the flip situation determination method according to an embodiment of the present invention, first, a flip angle of a user terminal is sensed in real time by a motion sensor (S701), and a flip angle α is preset to a reference angle A (eg, 90 degrees). If exceeds (S702), the timer is driven (t). On the other hand, if the flip angle α is less than the preset reference angle A (eg, 90 degrees), t is set to 0 to initialize the timer (S703) and continue sensing.

Meanwhile, the state where the flip angle α exceeds the preset reference angle A (eg, 90 °) is maintained until the preset time T ₁ elapses according to the timer driving (S705). If so, the user terminal is determined to be in a flip state and the voice input is blocked (S706).

8 is a graph illustrating a flip situation determination according to the flip angle according to an embodiment of the present invention. Referring to FIG. 8, when the flip angle α of the user terminal is continuously sensed in real time as described above with reference to FIG. 7, and the sensed flip angle exceeds a predetermined reference value (eg, 90 °), The duration of time exceeding the reference value is measured. As shown in FIG. 8, when the flip angle temporarily exceeds the reference value and is maintained by Δt ₁ , the excess state is maintained only for a time shorter than the reference time T ₁ , and thus, the flip angle is not determined. On the other hand, if the state in which the flip angle exceeds the reference value for more than the set reference time T ₁ continues by the user directly inverting the user terminal, it is determined that the user intends the flip state, and thus the flip state is determined and the setting is flipped. Will change to state.

On the other hand, although the continuously sensed value is displayed on the graph of FIG. 8, it may be actually sensed discretely at a predetermined time interval, and the actual graph may be discontinuously shown.

9 is a diagram illustrating a flip situation in a user terminal (eg, a smartphone) according to an embodiment of the present invention. Referring to FIG. 9, when viewed from the top of the user terminal 120 with respect to the ground, when the front surface of the user terminal 120 is visible, a screen of a game messenger is displayed. However, when the user flips the user terminal 120 in a flip state according to an embodiment of the present invention, the back side of the user terminal 120 is visible, and the voice input is blocked. As such, the user can clearly recognize whether or not the user terminal 120 is in the current voice input state.

In addition, the user can easily turn over and off the voice input during the game by simply flipping the user terminal 120.

10 and 11 illustrate flip angle sensing ranges according to an exemplary embodiment of the present invention. Referring to FIG. 10, when the angle formed by the user terminal with the ground is called a flip angle α, the flip angle is continuously sensed in real time by various motion sensors provided in the user terminal. In this case, as shown in FIG. 11, when the flip angle exceeds a preset reference value (eg, 90 °), the flip state is determined.

Although not shown in the drawings, as described above in the description of FIG. 6, when the flip angle is maintained within a specific range (eg, 45 ° to 90 °), the voice is transmitted only to a specific user (eg, a user set as a friend). It may be implemented to transmit a signal.

In addition, the angle change and the direction change of the user terminal may be determined differently depending on where the reference axis of the tilt (rotation) is placed. Preferably, the reference axis can be set to be parallel to the ground.

Example

In the above description, an example in which the present invention is applied to a mobile messenger has been described, but an example in which the present invention is applied to a game messenger service according to an embodiment of the present invention will be described. 'Game messenger' is a messenger linked to at least one game as described above, and means a communication means capable of communicating between users who have subscribed to a particular game. Accordingly, it is possible to log in to a game messenger as in a general mobile messenger and communicate with other users who have subscribed to the same game or a plurality of games provided by the same operator. In this case, according to an embodiment of the present invention, it is preferable that the game messenger includes a voice conversation function.

12 is a diagram illustrating a game messenger service system to which the present invention is applied. Referring to FIG. 12, the user terminal 120 may receive a flip talk function through a chat window of a game messenger linked with a plurality of games.

As illustrated, the game driving module 1210 is provided for each of a plurality of games in the online game server 1200, and the game messenger service module 1220 is connected to the plurality of game driving modules 1210 in a messenger. Provide service. Therefore, the user who executes the game messenger can talk with other game users even without being connected to each game, and since it is linked with a plurality of games, it is possible to talk with users who do not play the same game.

On the other hand, it is preferable that the game client application 1231 is installed in the user terminal 120 and the game messenger application 1232 is installed at the same time. In addition, when a user plays a game through his PC and accesses a game messenger through a mobile terminal such as a smartphone, even if only a game messenger application 1232 is installed in the user terminal 120, the present invention can be implemented. Done.

13 and 14 illustrate screens of a game messenger according to an exemplary embodiment of the present invention. Referring to FIG. 13, when the game messenger application 1232 is installed and executed in the user terminal 120 as shown in FIG. 12, when a user logs in, the plurality of chat groups that can participate in the waiting room screen as shown in FIG. Is displayed. In this case, each chat group may be displayed with a group name (eg, 'Are U Ready?'), A number of users who can enter, and a number of users currently participating (eg, displayed as '10 / 20 ').

On the other hand, if the user selects the entry to a specific group, as shown in 14 it is possible to participate in the group to have a voice conversation. In other words, as shown in the figure, the name (eg, nickname) of each user who participated in the group is displayed, and the current voice support status (1410, 1420), volume status, and network connection status of each user are displayed. Can be.

In this case, according to an embodiment of the present invention, when a specific user enters the flip state, it may indicate that the flip state 130 is next to the name of the user as described above. When the specific user is in the flip talk state, voice input from the user is temporarily blocked.

15 is a diagram illustrating an example of an image for displaying a user status in a messenger according to an embodiment of the present invention. Referring to FIG. 15, as illustrated in FIG. 14, the voice support state of the user may be displayed as various images beside the name. For example, it is possible to display variously in the voice call enabled state, voice call disabled state, flip-talk state. On the other hand, the FlipTalk user may be set so that its current state is not exposed.

As described above, the present invention has been described by specific embodiments such as specific components and the like. For those skilled in the art, various modifications and variations are possible from these descriptions.

Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

100: messenger server 110: communication network
120: user terminal 121: voice input unit
210: voice input unit 220: touch pad
221: key input unit 222: screen display unit
230: sensor unit 240: control unit
250: wireless communication unit 260:
261: messenger client application
310: mode setting unit 320: chat window generating unit
330: Voice input processing unit 340: Flip state detection unit
350: voice input blocker 410: chat group management unit
420: mode setting management unit 430: real-time voice processing unit
440: chat information transmission unit 450: member information database
460: chat group information database 470: mode setting information database
1200: Online Game Server 1210: Game Driven Module
1220: Game Messenger Service Module

Claims (19)

A messenger server providing a voice conversation function between a plurality of mobile terminals through a messenger controlling a voice input using a motion sensor,
A chat group manager configured to generate a chat room in which a plurality of users can participate by using mobile terminals based on the chat room creation request;
A mode setting manager configured to receive and store voice conversation state information of the mobile terminal of each user participating in the generated chat room; And
Receiving voice information from the mobile terminal of any one of the plurality of users participating in the generated chat room, and includes a real-time voice processing unit for transmitting and processing the voice information to the mobile terminal of the other users in the chat room in real time,
The mobile terminal in which the voice conversation state information is a first flip talk mode has a flip angle between the ground and a predetermined angle or more, and the transmission of the input voice signal is blocked.
The messenger server according to claim 1,
The mobile terminal further includes a chat information transmission unit configured to receive voice conversation status information from a mobile terminal of one of a plurality of users who perform a voice conversation in the generated chat room and transmit the received voice conversation state information to mobile terminals of other users in the chat room.
The transmitted voice conversation status information is displayed on the mobile terminal of the other users in the form of an image, messenger server.
The method according to claim 2, wherein the voice conversation status information,
And at least one selected from among a voice call enabled state, a voice call disabled state, a first flip talk mode that completely blocks voice conversation transmission, and a second flip talk mode that partially blocks voice conversation transmission.
The method according to claim 1, wherein the messenger,
And a game messenger server that provides a conversation function between a plurality of users participating in the plurality of games in association with a plurality of game driving modules that provide respective game functions.
The method according to claim 1, wherein the transmission block of the input voice signal,
The messenger server of the present invention is performed when a state in which the flip angle detected by the motion sensor in the mobile terminal in which the first flip talk mode is set is longer than or equal to a preset angle for more than a preset time.
The messenger server according to claim 1, wherein the preset angle is 90 ° or more and 180 ° or less.
The method of claim 3, wherein the voice conversation state information received from the specific mobile terminal is the second flip talk mode by the mode setting manager.
The real time voice processing unit,
And transmitting and receiving the received voice information only to a mobile terminal of a preset user among the users in the chat room.
The method of claim 7, wherein the second flip talk mode,
And a flip angle detected by the motion sensor in the specific mobile terminal is 45 ° or more and 135 ° or less.
The method of claim 7, wherein the preset user,
A messenger server, characterized in that the user of the specific mobile terminal is a user set as a friend.
As a method for controlling a voice input in a mobile terminal using a motion sensor, each step performed in a messenger server includes:
Generating a chat room in which a plurality of users can participate using mobile terminals based on the chat room creation request;
Receiving and storing voice conversation state information about a mobile terminal of each user participating in the generated chat room; And
Receiving voice information from a mobile terminal of one of a plurality of users participating in the generated chat room, and transmitting the voice information to mobile terminals of other users in the chat room in real time;
The user terminal in which the voice conversation state information is the first flip talk mode has a flip angle with the ground that is greater than or equal to a preset angle, and the transmission of the input voice signal is blocked.
The method of claim 10, further comprising: receiving voice conversation state information from a mobile terminal of one of a plurality of users who perform a voice conversation in the generated chat room and transmitting the received voice conversation state information to mobile terminals of other users in the chat room. and,
The transmitted voice conversation status information is displayed in the form of an image on the mobile terminal of the other users.
The method of claim 11, wherein the voice conversation status information,
And at least one selected from among a voice call enabled state, a voice call disabled state, a first flip talk mode that completely blocks voice conversation transmission, and a second flip talk mode that partially blocks voice conversation transmission.
The method of claim 10, wherein the messenger is a game messenger that provides a conversation function between a plurality of users participating in the plurality of games in cooperation with a plurality of game driving modules that provide respective game functions.
The method of claim 10, wherein the transmission block of the input voice signal,
And the flip angle detected by the motion sensor in the mobile terminal in which the first flip talk mode is set is equal to or greater than a preset angle.
The method according to claim 10, wherein the preset angle is 90 ° or more and 180 ° or less.
The method of claim 12, wherein the voice conversation state information of the specific mobile terminal received in the receiving and storing of the voice conversation state information is a second flip talk mode.
The process of transmitting the voice information to the mobile terminal of the other users in the chat room in real time,
And transmitting and receiving the received voice information only to a mobile terminal of a preset user among the users in the chat room.
The method of claim 16, wherein the second flip talk mode,
And a flip angle detected by the motion sensor in the specific mobile terminal is 45 ° or more and 135 ° or less.
The method of claim 16, wherein the preset user,
And the user of the specific mobile terminal has been set as a friend.
A computer-readable recording medium having recorded thereon a program for performing on a computer each step of the method according to any one of claims 10 to 18.

Images