JP2013198150A - Server device and method for controlling voice input with mobile terminal, and computer readable recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system, a server device and a method for voice input control with a mobile terminal using a motion sensor which can deactivate a sound input in the case of reversing a mobile terminal when performing a voice chat by using a mobile messenger with the mobile terminal.SOLUTION: A chat room in which a plurality of users can participate by using a mobile terminal is generated on the basis of a request to generate the chat room, a voice chat state information on the mobile terminal of each participating user is received in the generated chat room, and in a mobile terminal, the voice chat state information of which is a first flip talk mode, a flip angle formed between the mobile terminal and a ground surface is equal to or greater than a preset angle, and the transmission of an inputted voice signal is interrupted.

Description

The present invention relates to a method for controlling voice input at a mobile terminal, and more particularly, voice input at a mobile terminal using a motion sensor capable of controlling voice input of the mobile terminal only by movement of the mobile terminal. The present invention relates to a server device, a method, and a computer-readable recording medium.

In recent years, the widespread use of the Internet has led to a rapid development of wireless mobile communication technology beyond wired, and users use mobile terminals such as mobile phones, PDAs, and hand-held computers even in real life. Internet information can be searched regardless of time and place.

Moreover, many users have shown a tendency to change from a general mobile phone to a smart phone due to an improvement in performance of a smart phone that has been recently released. A smart phone is an intelligent compound terminal that adds a computer support function to a mobile phone, and is faithful to the functions of the mobile phone, but it also has a personal digital assistant (PDA) function, Internet function, and video playback. In addition to the addition of functions, various input methods and touch screens are provided to provide a more convenient interface for use. In addition, with the support of the wireless Internet function, it also functions as a terminal for performing e-mail, web browsing, faxing, banking, games, etc. by connecting to the Internet and a computer. On the other hand, a smartphone has a standardized operating system (OS) or a dedicated operating system in order to have various functions. As described above, various functions can be implemented using various portable terminals such as smartphones, and various dedicated application programs (application programs) and contents (contents) that are driven by the user terminals. ) Has also been developed.

On the other hand, users who need various types of communication communicate using homepages, e-mails, telephone ARS (Auto Response Service), etc., but homepages and e-mails are real-time in communication with customers. Has the disadvantage of being inferior. In addition, the telephone ARS has an advantage of being excellent in real-time property, but has a disadvantage that a burden of communication cost is large for the user. On the other hand, there is an instant messenger (that is, a messenger) as a useful method for transmitting information in real time using the Internet. The purpose of the messenger is for users to communicate simple messages to each other in real time. The messenger makes it possible to communicate in real time with characters transmitted as if the two users are talking directly. This is because the messenger emphasizes the real-time nature of the message and immediately transmits the input content.

Recently, such a messenger has been provided in the smartphone as well, and has developed into a form in which various additional functions are added in addition to the basic functions of the messenger. For example, there is a situation in which a voice call or video call function is provided by a messenger.

In addition, in order to provide another means of communication between users who participate in the same game or users who participate in a plurality of games provided by the same service provider, a messenger for games (for example, “Game Talk” service of NHN) Appeared. Since the game-only messenger provides a voice chat function between groups, a plurality of users who play the same game using a terminal such as a PC can install a game installed on their smartphone while playing the game. Discuss with other users using dedicated messengers. Therefore, the number of users is increasing as a more effective communication means compared to the simple text chat function provided in the game.

However, in some cases, voice input may be temporarily interrupted during voice chat in a group that participates using a game-dedicated messenger. Such a situation frequently occurs during game play, and the user has to operate the input keys provided on the smartphone or interrupt the earphone controller to interrupt voice input. There is. That is, when the voice input is to be interrupted, there is an inconvenience that the voice input must be interrupted via the setting menu in the messenger program or the messenger group chat must be left. In this case, when leaving the messenger group chat, there is a disadvantage that other users' conversations cannot be heard.

Meanwhile, as a technique related to a method for providing a service by linking a messenger and a game, Korean registered patent No. 10-048140 “Online game method and online game system for providing position information of a game character in conjunction with a messenger server ( (N Corporation) "(Patent Document 1) discloses a method for providing position information of a game character on an online game in conjunction with a messenger server. However, the method only provides a service in conjunction with a messenger server and a specific game, and does not provide a method for controlling voice input.

Accordingly, there is a growing need for a method that can effectively and easily control voice input without the need for another user to operate input keys.

Korean Registered Patent No. 10-048140

The object of the present invention is to enable the voice input to be deactivated when turning the mobile terminal upside down (flip state) when performing voice chat using the mobile messenger on the mobile terminal. An object of the present invention is to provide a system, a server device, and a method for controlling voice input.

Another object of the present invention is to connect a game messenger that can perform voice chat with a plurality of game users via a mobile terminal, and turn the mobile terminal upside down when performing voice chat using the game messenger. It is to provide a system, a server device, and a method for voice input control in a mobile terminal using a motion sensor, which can deactivate voice input.

Another object of the present invention is to connect a game messenger that can perform voice chat with a plurality of game users via a mobile terminal, and turn the mobile terminal upside down when performing voice chat using the game messenger. A system and a server device for voice input control in a mobile terminal using a motion sensor, which can deactivate voice input and display the inactive state of the voice input on another user's terminal And providing a method.

Another object of the present invention is to connect to a game messenger capable of performing voice chat with a plurality of game users via a mobile terminal, and when performing voice chat using the game messenger, the mobile terminal is set to a specific angle. An object of the present invention is to provide a system, a server device, and a method for voice input control in a mobile terminal using a motion sensor, in which voice input is activated only for a user selected in advance when turning over in a range.

In order to achieve the above-described object of the present invention and to achieve the specific effects of the present invention described later, the characteristic configuration of the present invention is as follows.

According to an aspect of the present invention, a server device that controls voice input on a mobile terminal, the device provides a voice chat function between a plurality of mobile terminals via a messenger application, and generates a chat room request. Chat group management unit for generating a chat room in which a plurality of users can participate using a mobile terminal, and voice chat state information set for each user's mobile terminal participating in the generated chat room A mode setting management unit that receives and stores voice information from a mobile terminal of any one of a plurality of users participating in the generated chat room, and the voice information is received in real time from the chat room. Real-time audio processing unit that performs transmission processing to other users' mobile terminals , And the voice chat state information is in the first flip talk mode, the flip angle formed by the mobile terminal and the ground is equal to or greater than a preset angle, and the input voice signal is transmitted. It is cut off.

Preferably, the server device receives voice chat state information from a mobile terminal of any one of a plurality of users who perform voice chat in the generated chat room, The information processing apparatus further includes a chat information transmission unit that performs transmission processing on the user's mobile terminal, and the transmitted voice chat state information is displayed in the form of an image on the other user's mobile terminal.

Preferably, the voice chat state information is selected from a voice call enabled state, a voice call disabled state, a first flip talk mode for blocking voice chat transmission as a whole, and a second flip talk mode for partially blocking voice chat transmission. Any one or more.

Preferably, the messenger is a game messenger that provides a chat function among a plurality of users participating in the plurality of games in conjunction with a plurality of game drive modules that provide respective game functions.

Preferably, the transmission interruption of the input audio signal is set in a state where a flip angle detected by a motion sensor in the mobile terminal in which the first flip talk mode is set is greater than or equal to a preset angle. This is done if it lasts longer than the specified time.

Preferably, the preset angle is not less than 90 ° and not more than 180 °.

Preferably, when the voice chat state information received from the specific mobile terminal by the mode setting management unit is in the second flip talk mode, the real-time voice processing unit is configured to select a preset user among the users in the chat room. The received voice information is transmitted only to the mobile terminal.

Preferably, the second flip talk mode is set when a flip angle detected by a motion sensor in the specific mobile terminal is not less than 45 ° and not more than 135 °.

Preferably, the preset user is a specific user (for example, a user set as a friend) selected in advance by a user of the specific mobile terminal.

According to another aspect of the present invention, a method for controlling voice input on a mobile terminal, which generates a chat room in which a plurality of users can participate using a mobile terminal based on a chat room generation request, Voice chat state information set in each mobile terminal of each user participating in the generated chat room is received and stored, and any one of a plurality of users participating in the generated chat room Receiving voice information from a mobile terminal and transmitting the voice information to a mobile terminal of another user in the chat room in real time, wherein the voice chat state information is in a first flip talk mode In the mobile terminal, the flip angle formed between the mobile terminal and the ground is not less than a preset angle, and Transmission of speech signals, characterized in that it is cut off.

Meanwhile, information for receiving a method for voice input control in the mobile terminal can be stored in a recording medium readable by a server computer. Such recording media include all types of recording media in which programs and data are stored for execution by a computer system. Examples include ROM (Read Only Memory), RAM (Random Access Memory), CD (Compact Disk), DVD (Digital Video Disk) -ROM, magnetic tape, floppy (registered trademark) disk, optical data storage device, and the like. Also included are those embodied in the form of a carrier wave (eg, transmission over the Internet). In addition, such a recording medium can be distributed in computer systems connected via a network, and can be executed by storing computer-readable codes in a distributed manner.

As described above, according to the present invention, when trying to temporarily block voice input during voice chat using a mobile messenger installed in a mobile terminal, it is easier than control by conventional key input or the like. There are advantages that can be controlled. For example, voice input can be blocked simply by turning the mobile terminal upside down, and voice input can be easily resumed by turning the mobile terminal back to its original state.

Therefore, there is an advantage that it can be effectively used in a game messenger in which a situation in which voice input is temporarily interrupted while playing a game can frequently occur.

In addition, there is an advantage that the user can clearly recognize whether his / her voice input state is an active state or an inactive state only by checking the state where his / her mobile terminal is placed.

1 is a diagram illustrating a system for voice input control in a mobile terminal according to an embodiment of the present invention. It is a block diagram which shows the detailed structure of the user terminal (user's mobile terminal) by embodiment of this invention. It is a block diagram which shows the detailed structure of the messenger client application installed in a user terminal by embodiment of this invention. 2 is a block diagram illustrating a detailed structure of a messenger server that provides voice input control according to an embodiment of the present invention; FIG. 4 is a signal flow diagram illustrating a procedure for controlling voice input at a user terminal (user mobile terminal) according to an embodiment of the present invention. 6 is a signal flow diagram illustrating a procedure for controlling voice input in a user terminal (user mobile terminal) according to another embodiment of the present invention; 5 is a flowchart illustrating a detailed procedure for determining a flip situation according to an embodiment of the present invention. 6 is a graph illustrating determining a flip state according to a flip angle according to an embodiment of the present invention; 5 is a diagram illustrating a flip state of a smartphone according to an embodiment of the present invention. 3 is a diagram illustrating a flip angle detection range according to an exemplary embodiment of the present invention. 3 is a diagram illustrating a flip angle detection range according to an exemplary embodiment of the present invention. It is drawing which shows the game messenger service system to which this invention was applied. 5 is a diagram illustrating a screen of a game messenger according to an embodiment of the present invention. 5 is a diagram illustrating a screen of a game messenger according to an embodiment of the present invention. 5 is a diagram illustrating an example of an image for displaying a user's state with a messenger according to an exemplary embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings that illustrate, by way of illustration, specific embodiments in which the invention can be practiced. These embodiments are described in detail to enable those skilled in the art to fully practice the invention. It should be understood that the various embodiments of the present invention are different from each other but need not be mutually exclusive. For example, the specific shapes, structures, and features described herein may be embodied in other embodiments without departing from the spirit and scope of the invention in connection with one embodiment. In addition, it should be understood that the position or arrangement of individual components within each disclosed embodiment can be changed without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be construed in a limiting sense, and the scope of the present invention is, together with the full scope of equivalents of the appended claims, if properly explained, together with the appended claims. Limited only by the appended claims. In the drawings, like reference numbers indicate identical or similar functions across various aspects.

According to the present invention, when voice chat is performed using a mobile messenger on a mobile terminal, a method is proposed in which voice input can be deactivated by maintaining the mobile terminal in a flip state (inverted state). Meanwhile, according to an embodiment of the present invention, the determination of the flip state of the mobile terminal may be determined using various motion sensors (for example, a geomagnetic sensor, a gyroscope sensor, a gravity sensor, etc.) provided in the mobile terminal. it can. At this time, according to the embodiment of the present invention, if the state where the angle between the mobile terminal and the ground is equal to or greater than a preset angle is maintained for a preset time or more, it is determined that the flip state is set. .

In particular, according to the present invention, when voice chat is performed using a game messenger on a mobile terminal, a method is proposed in which voice input can be controlled according to the flip state of the mobile terminal. In addition, according to the embodiment of the present invention, when the voice chat is performed, if a flip angle formed between the mobile terminal and the ground falls within a preset specific angle range, a specific user selected in advance (for example, applicable It is also possible to control so that voice input is activated only for a user who is set as a friend in the chat group.

On the other hand, in the detailed description to be described later, a “mobile terminal” to which a mobile messenger (or a mobile game messenger) is installed and the present invention for determining a flip state is applied is a mobile terminal, a smart phone, Any terminal is applicable as long as the terminal has portability or mobility such as a laptop computer, a digital broadcasting terminal, an MP3 player, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), and a navigation. Is possible. In the following description, for convenience of explanation, the mobile terminal will be described using the term “user terminal”.

In the detailed description to be described later, “mobile messenger” is an application program (that is, an application) installed in the mobile terminal, and provides a messenger function in the mobile terminal. It is preferably included. In addition, the mobile messenger enables voice chat with other users who have logged into the messenger program using a normal PC.

The “game messenger” is a messenger that is linked to at least one game, and means a communication means that enables communication between users who have joined a specific game. Therefore, it is possible to log in to the game messenger and talk with other users who have subscribed to the same game or a plurality of games provided by the same company. Similarly, according to an embodiment of the present invention, the game messenger preferably includes a voice chat function.

The “motion sensor” is a broad concept that collectively refers to all types of sensors that can be attached to the mobile terminal and can detect the movement of the mobile terminal, and includes a geomagnetic sensor, a gyro sensor, a motion sensor, an acceleration Sensors, inertial sensors, etc. can be included. On the other hand, in the present invention, any type of sensor can be used as long as it can determine the angle formed by the mobile terminal and the ground.

In the present invention described later, the function according to the embodiment of the present invention (that is, the function of controlling the voice input signal to be cut off when the user terminal is turned over (in the flip state) at the time of voice chat) is “flip talk”. (Flip Talk) ”function.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

[System for controlling voice input on mobile devices]
FIG. 1 is a diagram illustrating a system for controlling voice input in a mobile terminal according to an embodiment of the present invention. Referring to FIG. 1, a system according to an embodiment of the present invention may include a messenger server 100, a communication network 110, and user terminals 120a, 120b,. The terminals 120a, 120b,..., 120n are preferably provided with voice input units 121a, 121b,.

According to the embodiment of the present invention, the messenger server 100 provides a chat function using the messenger program of the user terminals 120a, 120b,. In particular, a voice chat function is provided to provide a function according to the present invention. Detailed functions of the messenger server 100 will be described later with reference to FIG.

The communication network 110 can be configured regardless of its communication form such as wired and wireless, and is a personal area network (PAN), a local area network (LAN), a metropolitan area network. (MAN; Metropolitan Area Network) and wide area network (WAN). In addition, the communication network 110 may be a well-known World Wide Web (WWW) and can be used for short-distance communication such as Infrared Data Association (IrDA) or Bluetooth (registered trademark). The wireless transmission technology used can also be used.

The user terminal 120 (for example, the user terminal 120a) installs and executes a messenger program, and the other user terminal 120 (user terminals 120b other than the user terminal 120a ... 120n via the communication network 110 and the messenger server 100). Chat with). At this time, voice chat using the messenger between the user terminals 120 is possible by the voice input unit 121 provided in each user terminal 120 and the voice chat function of the messenger program. For example, when a messenger program is executed and a plurality of users participate in a chat group (chat room) generated in the corresponding messenger program, real-time voice chat between the plurality of participating users becomes possible. At this time, when a voice chat function is not provided to a terminal of some users among a plurality of users participating in the chat group (for example, when a microphone is not provided in the terminal, a voice chat use function is turned off) Even when a sound card or the like is not attached), voice chat is possible between users of terminals provided with other voice chat functions.

Hereinafter, detailed configurations of the messenger server 100 and the user terminal 120 will be described in detail with reference to FIGS.

[User terminal]
FIG. 2 is a block diagram illustrating a detailed structure of a user terminal according to an embodiment of the present invention. Referring to FIG. 2, a user terminal 120 according to an embodiment of the present invention includes a voice input unit 210, a touch pad 220 including a key input unit 221 and a screen display unit 222, a sensor unit 230 including at least one sensor, The control unit 240, the wireless communication unit 250, and the storage unit 260 in which the messenger client application 261 is stored can be configured. Meanwhile, the components illustrated in FIG. 2 are not essential, and may further include additional components, and some of the components may be excluded or replaced.

Hereafter, each said component is demonstrated in detail.

The wireless communication unit 250 includes one or more modules that enable wireless communication between the user terminal (ie, mobile terminal) 120 and the wireless communication system, or between the user terminal 120 and the network where the user terminal 120 is located. Can be included. For example, the wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless internet module, and the like.

The wireless communication unit 250 transmits and receives wireless signals to / from at least one of a base station, an external terminal, and a server over a mobile communication network. The wireless signal may include various forms of data by transmitting / receiving a voice call signal, a video call signal, or a text / multimedia message. In addition, the wireless communication unit 250 can provide a wireless Internet connection function. As a wireless Internet connection technology, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave) Access) and HSDPA (High Speed Downlink Packet Access) can be used, but the present invention is not limited thereto.

The voice input unit 210 is for inputting an audio signal, and may include a microphone or the like. The microphone receives an external acoustic signal in a call mode, a recording mode, a voice recognition mode or the like and processes it as electrical voice data. In particular, according to an embodiment of the present invention, the mobile messenger (or game messenger) performs a function of receiving a voice signal to be transmitted to other users in the chat group in a voice chat mode. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station via the wireless communication unit 250 in the case of the call mode, and can be output. The voice input unit 210 may implement various noise removal algorithms for removing noise generated in the process of receiving an external acoustic signal, and may include two or more microphones. it can.

The key input unit 221 is a user interface for receiving various commands from the user, and its implementation method is not particularly limited. In general, a keypad method, a wheel key method, a touchpad method, a touchscreen method, and a composite method in which two or more of these are combined can be used. Recently, a touch screen system has been widely adopted in terms of increased space utilization, a demand for expansion of a display screen, and a design. In this case, the functions of the key input unit 221 and the screen display unit 222 can be provided by a single touch pad 220.

The sensor unit 230 detects the movement of the user terminal 120 and generates a detection signal corresponding thereto. Such a detection signal can be transmitted to the controller 240. That is, according to an embodiment of the present invention, the sensor unit 230 can detect a specific motion event that has occurred in the user terminal. For example, the sensor unit 230 can detect a motion event of the user terminal 120 by including a motion sensor such as a gyro sensor, a geomagnetic sensor, or an acceleration sensor. That is, as the motion sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an inertial sensor, or the like can be used. In addition, a sensor that can detect / recognize the movement, motion, position, etc. of an object. If there is no particular limitation, it can be applied. In particular, according to the embodiment of the present invention, the sensor unit 230 detects an angle formed by the user terminal 120 and the ground. The flip state detection unit 340 illustrated in FIG. 3 determines whether the user terminal 120 has been converted to the flip state based on the angle detected by the sensor unit 230.

The function of determining whether or not the user terminal 120 has been converted to the flip state may be included in the voice input blocking unit 350 instead of the flip state detection unit 340 or together with the flip state detection unit 340. It may be a function that the messenger client application 261 performs as a whole.
Detailed description regarding the determination of the flip state will be described later with reference to FIGS.

Meanwhile, whether the sensor unit 230 activates or deactivates the motion detection operation may be determined according to a user setting. For example, the sensor unit 230 can be set to be deactivated when the user does not want to execute the function according to the movement of the present invention performed later. Alternatively, whether the sensor unit 230 is activated or deactivated can be automatically controlled by the user terminal according to a specific situation. For example, if an alarm / wake-up call is sent from when the call is received until the user presses the call button, or while the broadcast reception / video playback application is running, only the voice chat status of the mobile messenger, The detection operation of the sensor unit 230 may be activated. This will be more clearly understood from the following description.

The screen display unit 222 is for generating an output related to visual, auditory or tactile sense, and displays and outputs information processed by the user terminal 120. For example, when the user terminal 120 is in the call mode, a UI (User Interface) or a GUI (Graphical User Interface) related to the call is displayed. In addition, when the user terminal 120 is in the image call mode or the shooting mode, it is possible to display a shot or / and received video, UI, or GUI. In addition, the screen display unit 222 may include two or more display devices or modules according to the embodiment of the user terminal 120. On the other hand, when the display device / module and the touch sensor constituting the screen display unit 222 form a layer structure (for example, “touch screen”), the screen display unit 222 is used not only as an output device but also as an input device. Can do. In this case, the touch sensor may have a form such as a touch film, a touch sheet, or a touch pad.

The voice output unit (not shown) is received from the wireless communication unit 250 in the reception of a call signal, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, a voice chat mode using a mobile messenger, or the storage unit 260. The audio data stored in can be output. The voice output unit can output an acoustic signal related to a function performed by the user terminal 120 (for example, a call signal reception sound, a message reception sound, etc.). Such a sound output unit may include a receiver, a speaker, a buzzer, and the like.

The storage unit 260 can store a program for the operation of the control unit 240, and can also store input / output data (for example, a phone book, a message, a stop image, a moving image, etc.). The storage unit 260 may also store data related to various patterns of vibration and sound that are output when a touch input is made on the touch screen.

At this time, the storage unit 260 according to the present invention has a function of storing and installing the messenger client application 261. A detailed description thereof will be described later with reference to FIG. Meanwhile, the storage unit 260 has a function of determining a flip state based on a change in the angle of movement detected by the sensor unit 230 and blocking or restricting the input of the voice input unit 210 according to the flip state. It can also be stored.

The storage unit 260 includes a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory), a RAM, and the like. (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Magnetic-Memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory). Out may include at least one type of storage medium. The user terminal 120 may operate in connection with a web storage that performs a storage function of the storage unit 260 on the Internet.

The interface unit (not shown) serves as a path for all external devices connected to the user terminal 120. The interface unit receives data from an external device and / or receives power and transmits the data to each component in the user terminal 120, and / or transmits data in the user terminal 120 to the external device. To. For example, wired / wireless headset port, external charger port, wired / wireless data port, memory card (memory card) port, port for connecting a device with an identification module, audio I / O (Input / Output) port, video I At least one of an / O (Input / Output) port, an earphone port, and the like can be included in the interface unit.

The identification module (not shown) is a chip that stores various types of information for authenticating the right to use the user terminal 120, and includes a user authentication module (User Identify Module, UIM), a subscriber authentication module (Subscriber Identity Module, SIM). ), A universal user identity module (USIM), and the like. A device provided with an identification module (hereinafter “identification device”) may be manufactured in the form of a smart card. Accordingly, the identification device can be connected to the user terminal 120 through the port.

In addition, the interface unit may receive various command signals input from the cradle to the user terminal 120 when the user terminal 120 is connected to an external cradle, or a user inputs the cradle with the cradle. It may be a path that is transmitted to the user terminal 120. Various command signals input from the cradle or the power source may be operated as a signal for recognizing that the mobile terminal is correctly attached to the cradle.

The control unit 240 normally controls the overall operation of the user terminal 120. For example, control and processing for voice call, data communication, video call, and the like are performed. The controller 240 may include a multimedia module for multimedia playback. The multimedia module may be implemented in the controller 240 or may be implemented separately from the controller 240. The controller 240 may perform a pattern recognition process so that a writing input or a drawing input performed on the touch screen can be recognized as a character and an image, respectively.

In addition, when the user terminal 120 is determined to be in a flip state based on the signal detected by the sensor unit 230, the control unit 240 according to an embodiment of the present invention blocks the input signal of the voice input unit 210. It can also be controlled.

A power supply unit (not shown) receives an external power supply and an internal power supply under the control of the control unit 240 and supplies power necessary for the operation of each component.

The various embodiments described herein may be embodied in a computer-readable recording medium, such as software, hardware, or a combination thereof, for example.

When implemented in hardware, the embodiments described herein include ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processors), DSPDs (digital signal processors), DSP signals (digital signal processors), DSPs (digital signal processors), DSPs (digital signal processors), DSPs (digital signal processors). at least among programmable gate arrays, processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. One of the may be implemented with. In some cases, the embodiment may be implemented by the controller 240.

When implemented in software, embodiments such as procedures and functions may be implemented with another software module that performs at least one function or operation. The software code can be embodied by a software application written in an appropriate programming language. The software code is stored in the storage unit 260 and can be executed by the control unit 240.

FIG. 3 is a block diagram illustrating a detailed structure of the messenger client application 261 installed in the user terminal 120 according to the embodiment of the present invention. Referring to FIG. 3, the messenger client application 261 installed on the user terminal 120 includes a mode setting unit 310, a chat window generation unit 320, a voice input processing unit 330, a flip state detection unit 340, and a voice input blocking. Part 350.

The mode setting unit 310 sets various modes provided by the mobile messenger program installed in the user terminal 120 and performs a function of storing them. Each mode setting value set by the mode setting unit 310 can be transmitted to the messenger server 100 via the communication network 110. On the other hand, examples of the set modes include a function setting mode such as a character chat mode, a voice call mode, and a video call mode, and a detailed function setting mode for setting an overall call mode, a 1: 1 call mode, etc. in the voice call mode. Etc.

In addition, according to an embodiment of the present invention, the set mode may further include a mode for setting a function for controlling the voice input signal to be cut off when the user terminal 120 is in a flip state in the voice call mode. .

As described above, when the mode setting unit 310 sets a function to block the voice input signal when the user terminal 120 enters the flip state, the flip state detection unit 340 determines the flip state of the user terminal 120 according to the setting. If it is detected and it is determined that the flip state is detected, the voice input blocking unit 350 blocks the voice input signal of the user terminal 120.

The chat window generator 320 performs a function of generating a chat window for providing a basic function of the mobile messenger. After the messenger program installed in the user terminal is executed, first, as will be described later, the chat group management unit 410 in the messenger server 100 generates a chat group (chat room). Thereafter, the chat window generation unit 320 of the messenger client application 261 generates a chat window for enabling real-time voice chat among a plurality of users to the chat room based on the generated chat group information. To do.

In addition, the user can participate in the chat in the chat group via the already generated chat window. At this time, in the generated chat window, characters can be transmitted / received to / from other users participating in the group, and voice chat can be performed according to the embodiment of the present invention.

Meanwhile, according to an embodiment of the present invention, the chat window generator 320 may further display chat status information of other users in the group in the chat window. Further, according to the embodiment of the present invention, it can be displayed whether or not the specific user is currently in the flip talk state (see FIGS. 14 and 15).

The voice input processing unit 330 performs a function of processing so that the voice signal input by the voice input unit 210 is transmitted to the user terminals 120 of other users in the corresponding messenger group via the wireless communication unit 250. In this case, according to the embodiment of the present invention, the input audio signal is not transmitted to all users in the group, but a specific user selected in advance (for example, a user set as a friend) or 1: It can be processed so that it is transmitted only to the user selected as one chat partner.

According to the embodiment of the present invention, the flip state detector 340 performs a function of detecting whether the user terminal 120 is in the flip state. For this purpose, the flip state detection unit 340 receives in real time information about the angle between the user terminal 120 and the ground detected by the sensor unit 230, and the user terminal 120 is currently in the flip state (i.e., the flipped state). ) Or not. The flip state detector 340 may determine the flip state in various ways, for example, by the methods shown in FIGS. 7 and 8 to be described later.

When the mode setting unit 310 is set to use the flip talk function as described above, the voice input blocking unit 350 is input when the detection result of the flip state detection unit 340 is determined to be in the flip state. The voice signal being transmitted is cut off, and any voice signal is not transmitted to the messenger server 100 or other user terminals 120 in the group.

[Messenger server]
FIG. 4 is a block diagram illustrating a detailed structure of a messenger server that provides voice input control according to an embodiment of the present invention. Referring to FIG. 4, the messenger server 100 may include a chat group management unit 410, a mode setting management unit 420, a real-time voice processing unit 430, and a chat information transmission unit 440. The messenger server 100 may include at least one database such as a member information database 450, a chat group information database 460, and a mode setting information database 470.

The chat group management unit 410 performs a function of setting and managing a plurality of users participating in a specific chat room generated by the messenger program as one group, and information on the group is stored in the chat group information database 460. Is done. In addition, when a specific user has requested to generate a new chat group, the chat group management unit 410 generates a chat group according to the request, assigns an identifier for the generated chat group, and information on the chat group. (For example, group participation conditions, group restricted personnel, group attribute information, etc.) is received or generated, and the information is stored in the chat group information database 460.

On the other hand, the present invention is preferably applied to a situation in which a plurality of users perform voice chat simultaneously in one chat room, and is also applied to a case where a 1: 1 chat window is generated and voice chat is performed 1: 1. Can be done.

The mode setting management unit 420 manages the mode information set for each generated chat group and mode information set for the user terminal of each user participating in the chat group, such as voice chat state information Manage. The set mode information is stored in the mode setting information database 470. Meanwhile, according to the embodiment of the present invention, when a specific user in a specific group sets the flip talk mode, the mode setting management unit 420 confirms the set information, and a messenger message is set according to the mode setting. Processing is performed to control each function (for example, flip talk function).

When the generated chat group is a voice chat group, the real-time voice processing unit 430 transmits the voice information transmitted from each user terminal 120 to other user terminals 120 in the group in real time. At this time, it is also possible to synthesize and transmit a plurality of voice signals received from each user terminal in the group by the messenger server 100 when performing voice chat between multiple persons. Further, according to another embodiment, it may be embodied that individual audio signals of each user are separately transmitted and a plurality of audio signals transmitted from a plurality of other user terminals are synthesized and output by each user terminal. it can.

When a specific user in the same group selects a specific mode or attempts to change the mode, or when a change in chat state occurs, the chat information transmission unit 440 displays such information related to the chat of each user in the same group. The function of transmitting to another user terminal 120 is performed. For example, according to the embodiment of the present invention, when the specific user terminal 120 is in the flip talk state, the flip talk mode conversion information of the corresponding user is transmitted to the other user terminals 120 in the same group. At this time, each user terminal 120 that has received the mode conversion information can display the mode of the corresponding user as an image or the like in the generated chat window (see FIGS. 14 and 15).

The member information database 450 stores various personal information of users who have joined the messenger service as members.

The system and apparatus according to the embodiment of the present invention have been described above with reference to FIGS. Hereinafter, a method for controlling voice input according to an embodiment of the present invention will be described with reference to FIGS.

[Method for controlling voice input on mobile devices]
FIG. 5 is a signal flow diagram illustrating a procedure for voice input control in a mobile terminal according to an embodiment of the present invention. Referring to FIG. 5, first, the user terminal A (120a) installs the messenger client program, connects to the messenger server 100 (step S501), and then logs in (step S502). At this time, by generating a new chat group or requesting the messenger server 100 to join the already generated chat group via the user terminal A (120a) (step S503), Voice chat using a messenger can be performed (step S505). That is, at least one other user terminal (that is, user terminal B (120b)) participates in the chat group in which the user terminal A (120a) participates (step S504), thereby performing a voice chat together. be able to. The chat group may be generated by the chat group management unit 410 as described above.

On the other hand, when the flip state is detected by the user terminal A 120a according to the embodiment of the present invention (step S506), the voice input is blocked (step S507). At this time, it is preferable that the user terminal A (120a) is set in advance to use the flip talk mode.

As described above, when the voice input is interrupted in the flip state, the flip state information (that is, the voice input cutoff state information) of the user terminal A (120a) is transmitted to the messenger server 100 (step S508). In the messenger server 100, the state for the corresponding user is changed to the flip state (step S509), and information on the state change is transmitted to the other user terminals (that is, the user terminal B (120b)) in the corresponding group (step S510). ). The user terminal B (102b) that has received the state change information of the user terminal A (120a) changes the state display of the user to the flip state in the displayed chat window (step S511).

FIG. 5 illustrates a method of blocking voice input when a user terminal is in a flip state according to an embodiment of the present invention. However, according to another embodiment of the present invention, a voice chat mode is set according to a flip angle. Various settings can also be made. For example, when the flip angle of the user terminal is maintained at an angle within a set specific range, the sound is transmitted only to the set specific user (for example, a user set as a friend) in the chat group. It can also be embodied.

FIG. 6 is a signal flow diagram illustrating a procedure for voice input control in a mobile terminal according to another embodiment of the present invention. Referring to FIG. 6, first, the user terminal A (120a) installs the messenger client program, connects to the messenger server 100 (step S601), and then logs in (step S602). At this time, by generating a new chat group or requesting the messenger server 100 to join the already generated chat group via the user terminal A (120a) (step S603), Voice chat using a messenger (S606) can be performed. That is, at least one other user terminal (that is, user terminal B (120b) and user terminal C (120c)) participates in the chat group in which the user terminal A (120a) participates (steps S604 and S605). ), You can have a voice chat together.

On the other hand, when the user terminal A (120a) detects a half-flip situation (for example, a state where the angle between the user terminal 120 and the ground is within a predetermined angle) according to another embodiment of the present invention. (Step S607) The half-flip state information is transmitted to the messenger server 100 (Step S608), and the audio signal input at the user terminal A (120a) is also transmitted continuously. At this time, it is preferable that the user terminal A (120a) is preset to use the flip talk mode or the half flip mode.

When the half-flip state is entered as described above, as described above, the half-flip state information of the user terminal A (120a) is transmitted to the messenger server 100 (step S608). The state is changed to the flip state (step S609), and information on the state change is transmitted to other user terminals in the group (that is, user terminal B (120b) and user terminal C (120c)). At this time, according to the setting of the half-flip state, the voice input information of the user terminal A (120a) is synthesized with the voice information of other user terminals (step S610), and the synthesized voice information is the user terminal B ( 120b) (steps S611 and S612).

Accordingly, the user can use various voice chat functions by changing the flip angle of his / her user terminal 120 during voice chat using a mobile messenger.

[Flip angle judgment method]
Hereinafter, a method for determining a flip state according to an embodiment of the present invention will be described with reference to FIGS.

FIG. 7 is a flowchart showing a detailed procedure for determining a flip situation according to an embodiment of the present invention. Referring to FIG. 7, according to the embodiment of the present invention, an angle between the user terminal and the ground detected by the motion sensor in the sensor unit 230 of FIG. If the set specific value is exceeded and the time is maintained for a set time or more, the flip state is determined. The reason for determining the flip state by such a method is that when the user sets the flip talk mode, the flip angle of the user terminal may temporarily change unintentionally during the voice chat.

The flip situation determination method according to the embodiment of the present invention is performed by the messenger client application as follows. First, a flip angle of the user terminal is detected in real time by a motion sensor or the like in the sensor unit 230 (step S701), and the flip angle (α) exceeds a preset reference angle (A) (for example, 90 degrees). If so ("Y" in step S702), the timer is driven (t). On the other hand, when the flip angle (α) is less than a preset reference angle (A) (for example, 90 degrees) (“N” in step S702), t is set to 0 and the timer is initialized. (Step S703) and the detection is continued. Note that the determination of the flip state may be performed by the entire messenger client application in addition to being performed by the flip state detection unit 340.

On the other hand, until the preset time (T ₁ ) elapses due to the driving of the timer (step S705, “Y”), the flip angle (α) is a preset reference angle (A) (for example, 90 °). Is maintained (step S705, "N"), it is determined that the user terminal is in the flip state, and voice input is blocked (step S706). Note that step S706 may be performed by the entire messenger client application in addition to being performed by the voice input blocking unit 350.

FIG. 8 is a graph illustrating determining a flip situation according to a flip angle according to an embodiment of the present invention. Referring to FIG. 8, as described above with reference to FIG. 7, the flip angle (α) of the user terminal is continuously detected in real time, and the specific reference value (for example, 90 °) in which the detected flip angle is set. If it exceeds, the duration of the time exceeding the reference value is measured. As shown in FIG. 8, when the flip angle temporarily exceeds the reference value and is maintained for Δt ₁ , the excess state is maintained only for a time shorter than the reference time T _1. I do not judge it. Meanwhile, a state in which user flip angle exceeds the reference value by performing the act of turning the direct user terminal, when it is sustained to a reference time above T _1, which is set, so that the user intends to flip state Therefore, it is determined that the state is the flip state, and the setting is changed to the flip state.

On the other hand, in the graph of FIG. 8, continuously detected values are displayed, but in actuality, there is a possibility that the values are detected discontinuously at regular time intervals. Are illustrated discontinuously.

FIG. 9 is a diagram illustrating a flip state of a user terminal (for example, a smartphone) according to an embodiment of the present invention. Referring to FIG. 9, when the user terminal 120 is viewed from above when the user terminal 120 is viewed from the ground, the game messenger screen is displayed. However, according to the embodiment of the present invention, when the user flips the user terminal 120 to be in the flip state, the back side of the user terminal 120 is visible, and the voice input is blocked. In this way, the user can clearly recognize whether or not the user is in the voice input state by checking the state where the user terminal 120 is placed.

Also, the user can easily turn off or cancel the voice input during the game by turning his / her user terminal 120 upside down.

10 and 11 are diagrams illustrating a flip angle detection range according to an embodiment of the present invention. Referring to FIG. 10, when the angle formed by the user terminal and the ground is a flip angle α, the flip angle α is continuously detected in real time by various motion sensors provided in the user terminal. At this time, as shown in FIG. 11, when the flip angle exceeds a preset reference value (for example, 90 °), it is determined that the messenger client application is in the flip state.

On the other hand, although not shown in the drawing, as described above with reference to FIG. 6, when the flip angle is maintained within a specific range (for example, 45 ° to 90 °), the signal detected by the sensor unit 230. The control unit 240 may be implemented such that an audio signal is transmitted only to a specific user set based on the user (for example, a user set as a friend).

Further, the angle change and the direction change of the user terminal can be determined according to how to set a reference axis of the inclination (rotation). Preferably, the reference axis can be set parallel to the ground.

[Embodiment]
In the above description, an example in which the present invention is applied to a mobile messenger has been described. Hereinafter, an example in which the present invention is applied to a game messenger service according to an embodiment of the present invention will be described. As described above, the “game messenger” is a messenger linked with at least one game, and means a communication means that enables communication between users who have joined a specific game. Therefore, like a normal mobile messenger, after logging into the game messenger, it is possible to talk with other users who have subscribed to the same game or multiple games offered by the same business. At this time, according to the embodiment of the present invention, it is preferable that the game messenger also includes a voice chat function.

FIG. 12 shows a game messenger service system to which the present invention is applied. Referring to FIG. 12, a user can receive a flip talk function through a chat window of a game messenger that is linked to a plurality of games at the user terminal 120.

As shown, the online game server 1200 includes a game driving module 1210 for each of a plurality of games, and the game messenger service module 1220 provides a messenger service in conjunction with the plurality of game driving modules 1210. . Therefore, the user who executed the game messenger can talk with other game users even when not connected to each game, and since it is linked with a plurality of games, it can also talk with users who do not play the same game.

On the other hand, it is preferable that a game client application 1231 and a game messenger application 1232 are installed in the user terminal 120. In addition, when the user plays a game using his / her PC and connects to a game messenger using a mobile terminal such as a smartphone, the present invention can be applied even if only the game messenger application 1232 is installed on the user terminal 120. It can be implemented.

13 and 14 are views showing game messenger screens according to embodiments of the present invention. Referring to FIG. 13, after the game messenger application 1232 is installed and executed on the user terminal 120 as shown in FIG. 12, when a user logs in, a plurality of chat groups that can participate in the waiting room screen as shown are displayed. Is done. At this time, each chat group has a group name (for example, “Are U Ready?”, Etc.), the number of users who can enter the room, and the number of users who are currently participating (for example, “10/20” is displayed). Can be displayed.

On the other hand, when the user selects to enter a specific group, as shown in FIG. 14, the user can participate in the group and perform a voice chat. That is, as shown in the figure, when joining a specific group, the names (for example, nicknames) of the users participating in the group are displayed, and the current voice support status (1410, 1420) and volume level of each user. Network connection status etc. can be displayed.

At this time, according to the embodiment of the present invention, when the terminal of the specific user is in the flip state, the flip state (1430) may be displayed next to the name of the user as described above. When the terminal of the specific user is in the flip talk state, voice input from the user is temporarily blocked.

FIG. 15 is a diagram illustrating an example of an image for displaying a user status using a messenger according to an embodiment of the present invention. Referring to FIG. 15, the user's voice support status can be displayed in various images next to the name as shown in FIG. For example, various displays such as a voice call enabled state, a voice call disabled state, and a flip talk state are possible. On the other hand, the user in the flip talk state can set the current state of the user not to be exposed.

Although the present invention has been described above with reference to specific items such as specific components and limited embodiments and drawings, this is provided to facilitate a more general understanding of the invention. However, the present invention is not limited to the above-described embodiments, and various modifications and variations can be made from such description by those who have general knowledge in the field to which the present invention belongs.

Therefore, the idea of the present invention should not be determined by being limited to the above-described embodiments, and not only the appended claims but also all modifications equivalent or equivalent to the claims are within the scope of the idea of the present invention. Should belong to.

100 messenger server 110 communication network 120 user terminal 121 voice input unit 210 voice input unit 220 touch pad 221 key input unit 222 screen display unit 230 sensor unit 240 control unit 250 wireless communication unit 260 storage unit 261 messenger client application 310 mode setting unit 320 Chat window generation unit 330 Voice input processing unit 340 Flip state detection unit 350 Audio input blocking unit 410 Chat group management unit 420 Mode setting management unit 430 Real time voice processing unit 440 Chat information transmission unit 450 Member information database 460 Chat group information database 470 mode Setting information database 1200 Online game server 1210 Game drive module 1220 Game messenger server Screw module

Claims (19)

A server device that controls voice input on a mobile terminal, the server device providing a voice chat function between a plurality of mobile terminals via a messenger application,
Based on the chat room generation request, a chat group management unit that generates a chat room in which a plurality of users can participate using a mobile terminal,
A mode setting management unit that receives and stores voice chat state information set in each mobile terminal of each user participating in the generated chat room;
Audio information is received from the mobile terminal of any one of a plurality of users who participated in the generated chat room, and the audio information is transmitted to other users' mobile terminals in the chat room in real time. A real-time audio processing unit,
In the mobile terminal in which the voice chat state information is in the first flip talk mode, a flip angle formed between the mobile terminal and the ground is not less than a preset angle, and transmission of an input voice signal is blocked. A server device. Voice chat status information is received from the mobile terminal of any one of a plurality of users who perform voice chat in the generated chat room, and is transmitted to the mobile terminals of other users in the chat room. It further includes a chat information transmission unit,
The server apparatus according to claim 1, wherein the transmitted voice chat state information is displayed in the form of an image on the mobile terminal of the other user. The voice chat state information is any one selected from a voice call enabled state, a voice call disabled state, a first flip talk mode for blocking voice chat transmission as a whole, and a second flip talk mode for partially blocking voice chat transmission. The server apparatus according to claim 2, wherein the number is one or more. The server device is a game messenger that provides a chat function among a plurality of users participating in the plurality of games in conjunction with a plurality of game drive modules that provide respective game functions. Item 2. The server device according to Item 1. The transmission interruption of the input audio signal is a preset time in which the flip angle detected by the motion sensor in the mobile terminal in which the first flip talk mode is set is equal to or greater than the preset angle. The server apparatus according to claim 1, wherein the server apparatus is performed when it is maintained as described above. 2. The server device according to claim 1, wherein the preset angle is not less than 90 [deg.] And not more than 180 [deg.]. When the voice chat state information received from the specific mobile terminal by the mode setting management unit is in the second flip talk mode, the real-time voice processing unit sends the user's mobile terminal set in advance among the users in the chat room. 4. The server apparatus according to claim 3, wherein only the received voice information is transmitted. 8. The server device according to claim 7, wherein the second flip talk mode is set when a flip angle detected by a motion sensor in the specific mobile terminal is not less than 45 ° and not more than 135 °. The server device according to claim 7, wherein the preset user is a specific user selected in advance by a user of the specific mobile terminal. A method for controlling voice input on a mobile device,
Based on the chat room generation request, generate a chat room where multiple users can participate using mobile devices,
Receive and store voice chat status information for each user's mobile terminal participating in the generated chat room;
Audio information is received from the mobile terminal of any one of a plurality of users who participated in the generated chat room, and the audio information is transmitted to other users' mobile terminals in the chat room in real time. Including,
The mobile terminal of the user whose voice chat state information is in the first flip talk mode is such that the flip angle formed between the mobile terminal and the ground is equal to or greater than a preset angle, and transmission of the input voice signal is blocked. A method characterized by that. Voice chat status information is received from the mobile terminal of any one of a plurality of users who perform voice chat in the generated chat room, and is transmitted to the mobile terminals of other users in the chat room. Further including
The method of claim 10, wherein the transmitted voice chat status information is displayed in the form of an image on the mobile terminal of the other user. The voice chat state information is any one selected from a voice call enabled state, a voice call disabled state, a first flip talk mode for blocking voice chat transmission as a whole, and a second flip talk mode for partially blocking voice chat transmission. The method of claim 11, wherein there are two or more. The messenger is a game messenger that provides a chat function among a plurality of users participating in the plurality of games in conjunction with a plurality of game drive modules that provide respective game functions. 10. The method according to 10. The transmission interruption of the input audio signal is a preset time in which the flip angle detected by the motion sensor in the mobile terminal in which the first flip talk mode is set is equal to or greater than the preset angle. The method according to claim 10, wherein the method is performed when it is sustained. 11. The method according to claim 10, wherein the preset angle is not less than 90 [deg.] And not more than 180 [deg.]. In receiving and storing the voice chat status information, when the received voice chat status information of the specific mobile terminal is in the second flip talk mode, the voice information of the other users in the chat room is mobile in real time. The method according to claim 12, wherein the transmission processing to the terminal is performed by transmitting the received voice information only to a mobile terminal of a preset user among the users in the chat room. The method of claim 16, wherein the second flip talk mode is set when a flip angle detected by a motion sensor in the specific mobile terminal is 45 ° or more and 135 ° or less. The method according to claim 16, wherein the preset user is a user of a specific user selected in advance by a user of the specific mobile terminal. A computer-readable recording medium recording a program for executing the method according to any one of claims 10 to 18 using a computer.