JP2018139115A - System, method and program that enable voice chat - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable communication by a voice other than a user's utterance or the like in a voice chat.SOLUTION: A system according to an embodiment includes a plurality of terminal devices, and a server communicably connected to the terminal devices, enabling voice chat between users of the terminal devices. In the system, among a plurality of users who are members of a chat unit, the terminal devices of the users who participate in the chat unit perform voice chat communication realizing a voice chat in the chat unit, and the terminal device of one user who is a member in the chat unit requests reproduction of a voice file selected by the one user to the terminal device of another user who is a member in the chat unit on the basis of an instruction of the one user, and the terminal device of the other user reproduces the voice file in response to the request for reproduction of the voice file.SELECTED DRAWING: Figure 1

Description

  The present invention provides a system, method, and program that enable voice chat between users.

  In recent years, application programs (hereinafter, simply referred to as “applications”) for text chats that exchange text messages between users using a terminal device such as a smartphone have been provided (for example, Patent Documents). 1). In a text chat using such an application, a chat group is created by two or more users, and text messages input by the user to the chat group belong to the chat group (members of the chat group). A list is displayed in time series on the terminal device of each user.

JP 2014-050745 A

  However, in the text chat described above, the user can enjoy a conversation using a text message more easily than the conventional exchange of e-mails, but various problems caused by using the text message. Can occur. For example, since a text message remains as a history, the user may be overly cautious about speaking (sending a text message) or giving the user a sense of duty to reply. In addition, since communication by text message requires user operation for input, transmission / reception, and confirmation (display) of a text message, there is a limit to the real-time nature of communication.

  On the other hand, although voice chat using a mechanism such as an Internet telephone can enable real-time communication without using the text message described above, it is difficult to say that communication exceeding conventional telephones can be realized. For example, in the conventional voice chat, voice communication is limited to the exchange of the user's utterance and the like inputted by voice through a microphone. Therefore, it is desired to provide a mechanism that enables voice communication other than user utterances in voice chat.

  An embodiment of the present invention has an object to enable communication by voice other than a user's utterance in voice chat. Other objects of the embodiments of the present invention will become apparent by referring to the entire specification.

A system according to an embodiment of the present invention is a system that includes a plurality of terminal devices and enables voice chat between users of the terminal devices, and is a member of a chat unit that is a unit for executing voice chat. At least some of the terminal devices of the plurality of users execute voice chat communication for realizing voice chat in the chat unit, and the terminal device of the first user who is a member of the chat unit is the first user. Based on the user's instruction, the terminal device of the second user who is a member of the chat unit is requested to reproduce the audio file selected by the first user, and the terminal device of the second user The audio file is reproduced in response to the reproduction request for the audio file.

  A method according to an embodiment of the present invention is a method that enables voice chat between users of a plurality of terminal devices, and at least of a plurality of users who are members of a chat unit that is a unit for executing voice chat. Some user terminal devices execute voice chat communication for realizing voice chat in the chat unit, and the first user terminal device which is a member of the chat unit is based on the instruction of the first user. The second user terminal device that is a member of the chat unit is requested to reproduce the audio file selected by the first user, and the second user terminal device reproduces the audio file. In response to the request, the audio file is reproduced.

  The program which concerns on one Embodiment of this invention is a program for enabling the voice chat between the users of a some terminal device, Comprising: It is a unit which performs a voice chat by being performed on the said terminal device. Of the plurality of users who are members of a chat unit, at least some of the terminal devices execute voice chat communication for realizing voice chat in the chat unit, and the first user who is a member of the chat unit The terminal device requests the second user terminal device that is a member of the chat unit based on the instruction of the first user to reproduce the audio file selected by the first user, and The terminal device of the second user reproduces the audio file in response to the request to reproduce the audio file.

  In this specification, “chat unit” includes, for example, a chat room, a chat group, a chat session, and the like. In addition, in the “execution of voice chat communication”, for example, voice data input through the voice input unit of the terminal device is transmitted to another terminal device, and the voice input unit of the other terminal device is used. Receiving voice data of the inputted voice.

  According to various embodiments of the present invention, it is possible to perform voice communication other than the user's utterance in voice chat.

The lineblock diagram showing roughly the composition of system 1 concerning one embodiment of the present invention. The block diagram which shows the function which the server 10 in one Embodiment has. The figure which shows an example of the information managed by the user information management table 51a in one Embodiment. The figure which shows an example of the information managed by the chat unit information management table 51b in one Embodiment. The block diagram which shows the function of the program 60 for voice chat in one Embodiment. The flowchart which shows an example of the voice chat start process in one Embodiment. A figure showing an example of initial screen 70A of screen 70 for voice chat service in one embodiment. The figure which shows an example of the friend list screen 80 in one Embodiment. The figure which shows an example of the friend detail screen 70B of the screen 70 for voice chat services in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment. The figure which shows an example of the invitation notification screen 110 in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment. The figure which shows an example of the home screen 100 in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment. The figure which shows an example of the voice chat screen 70C of the screen 70 for voice chat service in one Embodiment.

  FIG. 1 is a configuration diagram schematically showing a configuration of a system 1 according to an embodiment of the present invention. As shown in the figure, the system 1 according to an embodiment includes a plurality of terminal devices 30 and a server 10 connected to the terminal devices 30 via a communication network 20 such as the Internet so as to be communicable. Voice chat is possible between users.

  The server 10 according to the embodiment includes a voice chat service, a service for providing various digital contents such as an online game, an electronic book, a moving picture content, and a music content, a text chat (mini mail), a circle, an avatar, a diary, and a message board. And various internet services such as a communication platform (SNS platform) service that realizes communication functions between various users such as greetings, and an electronic commerce service are provided to the user who operates the terminal device 30.

  The server 10 in one embodiment is configured as a general computer, and as illustrated, a CPU (computer processor) 11, a main memory 12, a user I / F 13, a communication I / F 14, a storage 15, and the like. These components are electrically connected to each other via a bus 17. The CPU 11 loads an operating system and various other programs from the storage 15 into the main memory 12 and executes instructions included in the loaded programs. The main memory 12 is used for storing a program executed by the CPU 11, and is configured by a DRAM or the like, for example. In addition, the server 10 in one embodiment may be configured using a plurality of computers each having a hardware configuration as described above.

  The user I / F 13 includes, for example, an information input device such as a keyboard and a mouse that accepts an operator input, and an information output device such as a liquid crystal display that outputs a calculation result of the CPU 11. The communication I / F 14 is implemented as hardware, firmware, communication software such as a TCP / IP driver or a PPP driver, or a combination thereof, and is configured to be able to communicate with the terminal device 30 via the communication network 20.

The storage 15 is composed of, for example, a magnetic disk drive, and stores various programs such as a control program for controlling the provision of various services. The storage 15 can also store various data used in providing various services. Various data that can be stored in the storage 15 may be stored in a database server or the like that is physically separate from the server 10 that is communicably connected to the server 10. The disk drive 16 reads data stored in various storage media such as CD-ROM, DVD-ROM, and DVD-R, or writes data to these storage media.

  In one embodiment, the server 10 also functions as a web server that manages a website composed of a plurality of hierarchical web pages, and provides the terminal device 30 with the various Internet services described above via the website. Can do. The storage 15 can also store HTML data corresponding to this web page. HTML data is associated with various image data, and various programs described in a script language such as JavaScript (registered trademark) can be embedded.

  In one embodiment, the server 10 can provide the above-described various Internet services to the terminal device 30 via an application executed on the terminal device 30 in an execution environment other than the web browser. Such applications can also be stored in the storage 15. This application is created by using a programming language such as Objective-C or Java (registered trademark), and can include various image data. The application stored in the storage 15 is distributed to the terminal device 30 in response to the distribution request. Note that the terminal device 30 can also download such an application from a server other than the server 10 (a server that provides an application market) or the like.

  As described above, the server 10 manages the website for providing various services, and distributes the web page (HTML data) constituting the website in response to a request from the terminal device 30, thereby providing a terminal. Various services can be provided to the user of the device 30. Further, as described above, the server 10 can communicate with an application executed in the terminal device 30 in place of or in addition to the provision of a service using such a web page (web browser). Various services can be provided based on this. Whichever service is provided, the server 10 can transmit / receive various data (including data necessary for screen display) necessary for providing various services to / from the terminal device 30. Further, the server 10 stores various data necessary for providing the service for each identification information (for example, user ID) for identifying each user, thereby providing the service providing status (for example, game progress status) for each user. ) Can be managed. Although detailed description is omitted, the server 10 can also have a function of performing user authentication processing at the start of service provision, billing processing that occurs in response to service provision, and the like.

  The terminal device 30 according to the embodiment is an arbitrary information processing device that displays a web page of a website provided by the server 10 on a web browser and implements an execution environment for executing an application. Tablet terminals, wearable devices, game-dedicated terminals, and the like.

  The terminal device 30 is configured as a general computer and includes a CPU (computer processor) 31, a main memory 32, a user I / F 33, a communication I / F 34, and a storage 35, as shown in FIG. These components are electrically connected to each other via a bus 36.

  The CPU 31 loads an operating system and various other programs from the storage 35 into the main memory 32 and executes instructions included in the loaded programs. The main memory 32 is used for storing a program executed by the CPU 31, and is configured by, for example, a DRAM or the like.

The user I / F 33 is, for example, a touch panel that accepts user input, a keyboard,
An information input device such as a button and a mouse, and an information output device such as a liquid crystal display for outputting the calculation result of the CPU 31 are included. In addition, the user I / F 33 includes a general microphone 33a (audio input unit) that inputs sound and converts it into an electric signal, and a general speaker (audio output unit) 33b that converts the electric signal into sound and outputs the sound. Including. The communication I / F 34 is implemented as hardware, firmware, communication software such as a TCP / IP driver or a PPP driver, or a combination thereof, and is configured to be able to communicate with the server 10 via the communication network 20.

  The storage 35 is composed of, for example, a magnetic disk drive, a flash memory, or the like, and stores various programs such as an operating system. The storage 35 can store various applications received from the server 10 or the like.

  The terminal device 30 includes, for example, a web browser for interpreting an HTML file (HTML data) and displaying the screen, and interprets and receives the HTML data acquired from the server 10 by the function of the web browser. A web page corresponding to the HTML data thus displayed can be displayed. The web browser of the terminal device 30 can incorporate plug-in software that can execute various types of files associated with HTML data.

  When the user of the terminal device 30 receives various services provided by the server 10, for example, HTML data, an animation instructed by an application, an operation icon, or the like is displayed on the terminal device 30. The user can input various instructions using the touch panel of the terminal device 30 or the like. The instruction input from the user is transmitted to the server 10 via the function of the application execution environment such as the web browser of the terminal device 30 and NgCore (trademark).

  Next, functions of the server 10 in the embodiment configured as described above will be described. The server 10 according to the embodiment has various functions for providing the various Internet services described above. Here, the function for managing the voice chat described above will be mainly described. FIG. 2 is a block diagram schematically illustrating functions of the server 10 according to an embodiment. As illustrated, the server 10 responds to receiving a voice chat start request with an information storage unit 51 that stores various information and an invited user invited to the voice chat from the terminal device 30 of the requesting user. A notification information transmission unit 52 that transmits predetermined notification information to the terminal device 30 of the inviting user, and a state monitoring unit that monitors that the requesting user and the inviting user can execute voice chat. 53, a voice chat control unit that enables voice chat communication between the request source user's terminal device 30 and the invitee user's terminal device 30 when the request source user and the invitee user are in the executable state described above. 54. These functions are realized when hardware such as the CPU 11 and the main memory 12 of the server 10 and software such as various programs stored in the storage 15 operate in cooperation. This is realized by the CPU 11 of the server 10 executing instructions included in one or more computer programs corresponding to the functions.

The information storage unit 51 is realized by the storage 15 of the server 10 and manages a user information management table 51a for managing user information regarding users and chat unit information regarding chat units, which are units of voice chat executed between users. A chat unit information management table 51b. FIG. 3 shows an example of information managed in the user information management table 51a of the embodiment. As illustrated, the user information management table 51a includes “basic information” (for example, nickname, gender, age, user image, etc.) of this user in association with a “user ID” that identifies each user. ), “Friend information” indicating information related to this user's friend (for example, established when the other user accepts a friend application by one user), “voice stamp indicating information related to the voice stamp held by this user” Information such as “information” and “login status” indicating the login status (online status) of the user to the voice chat service are managed.

  Here, the above-mentioned “voice stamp” will be described. The voice stamp is a voice file that can be used in the voice chat service according to the embodiment, and is played back (voice output) on the terminal device 30 of each user. The audio stamp is configured as an audio file to which a file format such as WAV or AIFF is applied. In one embodiment, the voice stamp held by the user is stored in the terminal device 30 (eg, storage 35) of the user and is also redundantly stored in the server 10 (eg, storage 15), either automatically or The voice stamps stored in the terminal device 30 and the server 10 are synchronized according to the operation by the user. The user can obtain the voice stamp by, for example, purchasing or receiving a present from another user or the like. Furthermore, in one embodiment, a user can create (record) a voice stamp that can be used in a voice chat service. The “voice stamp information” of the user information management table 51a described above includes, for example, identification information (including a file name) for identifying individual voice stamps (voice files), and information such as icons, names, and descriptions of the voice stamps. Is included.

  FIG. 4 shows an example of information managed in the chat unit information management table 51b according to one embodiment. As shown in the figure, the chat unit information management table 51b is associated with a “chat unit ID” for identifying each chat unit, and stores information such as “member information” indicating information related to users who are members of the chat unit. to manage. As described above, the “chat unit” in one embodiment is a unit of voice chat performed between users, and may be called a chat room, a chat group, or the like. “Member information” indicates “user ID” of each user who is a member belonging to this chat unit, and “executable” indicating whether or not each user can execute voice chat in this chat unit. Information such as “flag” is included. In one embodiment, members of the chat unit are invited further from the user who created the chat unit (newly started a voice chat), the user invited to the chat unit by the user, and the invited user. Users, etc. may be included.

  As described above, the state monitoring unit 53 according to the embodiment monitors that the requesting user and the invited user (members in chat units) are in an executable state in which voice chat can be performed. Specifically, the user monitoring is performed by setting the “executable flag” in the “member information” of the chat unit information management table 51b described above based on various data transmitted from the terminal device 30 in response to an operation by the user. Done by updating. Details will be described later.

As described above, the voice chat control unit 54 according to the embodiment, when the requesting user and the invited user are in an executable state, between the requesting user's terminal device 30 and the invited user's terminal device 30. Enable voice chat communication. When the number of users who are members of the chat unit is 3 or more, voice chat communication between the terminal devices 30 of the users who are in the executable state when two or more users are in the executable state. Is possible. Specifically, enabling voice chat communication is, for example, by allowing voice data of voice input via the microphone 33a of each terminal device 30 to be transmitted to the other terminal devices 30. Realized. In this case, the voice data from each terminal device 30 may be received by the server 10 and transmitted to the other terminal device 30, or the voice data from each terminal device 30 may be directly transmitted to the other terminal device 30. The audio data from each terminal device 30 may be transmitted to another terminal device 30 via a computer other than the server 10. That is, a part or all of the functions of the voice chat control unit 54 of the server 10 are one or more terminal devices 30 (a terminal device 30 that is executing voice chat communication and a terminal device 30 that is not executing voice chat communication). Or other devices may be included. Moreover, the transmission of the audio data to the terminal device 30 can be performed by applying a streaming method, for example.

  Next, a voice chat program 60 according to an embodiment of the present invention executed on the terminal device 30 (by the CPU 31) will be described. The voice chat program 60 is a program for the user of the terminal device 30 to use the voice chat service provided by the server 10, and may be configured as, for example, HTML data or an application. FIG. 5 is a block diagram illustrating functions (module configuration) of the voice chat program 60 according to an embodiment. As shown in the figure, the voice chat program 60 of one embodiment includes a voice chat communication execution module 61 that executes voice chat communication with another terminal device 30, and a chat in which the user is a member based on a user instruction. The voice stamp reproduction request module 62 that requests the terminal device 30 of another user who is a unit member to reproduce the voice stamp (audio file) selected by the user, and this request in response to the request to reproduce the voice stamp. And an audio stamp reproduction module 63 for reproducing an audio file. Specifically, the voice chat communication execution module 61 transmits, for example, voice data of voice input via the microphone 33a of the terminal device 30 and voice input via the microphone 33a of the other terminal device 30. Audio data is received and output as voice via the speaker 33b. The voice chat communication execution module 61 can operate in cooperation with the voice chat control unit 54 of the server 10 described above.

  Next, the operation of the system 1 in one embodiment will be described. FIG. 6 is a flowchart illustrating an example of a voice chat start process executed by the server 10 when the user of the terminal device 30 newly starts a voice chat. This voice chat start process is executed when a voice chat start request is received from the user of the terminal device 30. In one embodiment, the voice chat start request by the user is made via the voice chat service screen 70 displayed on the terminal device 30. Here, the voice chat service screen 70 according to the embodiment will be described.

  The voice chat service screen 70 is a screen that is displayed when the voice chat program 60 is executed on the terminal device 30 and is used to use the voice chat service provided by the server 10. FIG. 7 is an example of the initial screen 70 </ b> A of the voice chat service screen 70. As shown in the figure, the voice chat service screen 70 has a main area 72 located on the upper stage, a stream area 74 located on the lower left side for notifying the user of various information on the voice chat service, and a voice located on the lower right side. A stamp area 76 for displaying information about the stamp. In the main area 72, various information according to the usage scene of the voice chat service is displayed. As shown in the figure, the stream area 74 and the stamp area 76 are configured as tab-type areas, and can be switched and displayed by selecting a tab. In the initial screen 70 </ b> A illustrated in FIG. 6, a start button 72 a displayed as “Start conversation” is arranged in the main area 72. The start button 72a is a button for instructing the user to newly start a voice chat (create a chat unit). In the main area 72 of the initial screen 70A, it is also possible to display a history of voice chats (chat units) executed in the past.

When the user selects the start button 72a, the friend list screen 80 illustrated in FIG. 8 is displayed as an overlay on the voice chat service screen 70 (initial screen 70A). As shown in the figure, the friend list screen 80 displays a list of information related to the user's friends of the terminal device 30 (for example, user images and nicknames). The user's friends are managed in the “friend information” of the user information management table 51a, and the information displayed on the friend list screen 80 is transmitted from the server 10 in response to a request from the terminal device 30. In one embodiment, among the friends displayed in the list, a user who is logged in to the voice chat service (managed in the “login state” of the user information management table 51a) is a login indicator in the upper left corner of the user image. 82 are displayed in an overlapping manner, and the user can check the login status of the friend.

  When the user selects a desired user (friend) to be invited to the voice chat from among a plurality of friends listed on the friend list screen 80, the voice chat service screen 70 is displayed as a friend detail screen illustrated in FIG. Transition to 70B. In the friend detail screen 70B, as shown in the figure, basic information regarding the selected user (in this example, user B) is displayed in the main area 72, and the selected information is displayed in the stamp area 76. A list of information (for example, icon image, name, description, etc.) related to the voice stamps held by a user is displayed. Information on the voice stamp held by the selected user is managed in “voice stamp information” of the user information management table 51a.

  In one embodiment, the user makes a voice chat start request with the selected user by selecting any of the voice stamps listed in the stamp area 76 of the friend detail screen 70B of FIG. be able to. When the user selects any voice stamp, specifically, invited user information that can identify the selected user (invited user invited to voice chat), and voice identifying the selected voice stamp A voice chat start request including stamp identification information is transmitted from the terminal device 30 to the server 10.

  Here, when a voice chat start request is made by selecting any voice stamp displayed in a list in the stamp area 76, the user confirms the voice corresponding to the voice stamp (contents of the voice file) in advance. You may be able to do it. For example, when any audio stamp in the stamp area 76 is selected, first, an audio file corresponding to the selected audio stamp is transmitted from the server 10 to the terminal device 30, and the received audio file is reproduced in the terminal device 30. . Thereafter, a voice chat start request may be made in response to a confirmation operation by the user (for example, selection of a confirmation button). Further, the user of the terminal device 30 may be able to obtain all or part of the voice stamp (voice file) held by the selected user in accordance with the operation of the user of the terminal device 30. In this case, the obtained voice stamp is downloaded to the terminal device 30 and stored in the storage 35 or the like.

  When the voice stamp is selected and a voice chat start request is made, the voice chat service screen 70 transitions to a voice chat screen 70C illustrated in FIG. The voice chat screen 70 </ b> C is a screen displayed on the terminal device 30 when the user performs voice chat. As shown in the figure, the main area 72 has a microphone icon 92 disposed in the center and the voice chat. An invitation icon 94 for newly inviting another user to (chat unit), and a user icon 96 for displaying other users (users other than the user of the terminal device 30) who are members of this chat unit for each user Have The microphone icon 92 is also configured as an icon corresponding to a so-called mute function that can enable / disable the microphone 33a of the terminal device 30 by selection by the user. In one embodiment, the user icon 96 indicates whether the user is logged in to the voice chat service, and whether the voice icon (chat unit) is executable (ie, participates in the voice chat). Is displayed so that it can be recognized. For example, in the example of FIG. 10, the user's login state can be recognized by the above-described login indicator 82, and whether or not the user can execute this voice chat depending on the display mode of the user icon 96. (For example, the user icon 96 is grayed out for a user who is not in an executable state in which this voice chat can be executed).

  Here, in one embodiment, the main area 72 of the voice chat screen 70 </ b> C displays information related to one chat unit among a plurality of chat units of which the user of the terminal device 30 is a member. For example, a chat unit to be displayed can be selected (switched) by a flick operation).

  Returning to the flowchart of FIG. 6, when receiving a voice chat start request from the terminal device 30, the server 10 first sets a chat unit (step S100). This process is executed by the state monitoring unit 53 of the server 10. Specifically, a new record is created in the chat unit information management table 51b, a unique value is generated and set to “chat unit ID”, and the voice chat requesting user is invited to the voice chat. Information about the invited user is set to “member information”. Here, in the “executable flag” of “member information”, a value (for example, a value “1”) indicating that the requesting user is in an executable state is set at this stage, and executed for the invited user. A value indicating that it is not in a possible state (for example, a value “0”) is set.

  Then, the push notification regarding the invitation to voice chat is performed with respect to the inviting user's terminal device 30 (step S120), and this voice chat start process is complete | finished. This process is executed by the notification information transmission unit 52 of the server 10. Specifically, the notification information for notifying that the requesting user is invited to the voice chat and the identification information of the voice stamp selected by the requesting user are transmitted to the terminal device 30 of the inviting user.

  Thus, in one embodiment, when a voice chat start request is made, notification information is transmitted to the invited user invited to the voice chat, and then the state monitoring unit 53 and the voice chat control unit described above. When the requesting user and the inviting user can execute this voice chat by the function 54, voice chat communication between the requesting user's terminal device 30 and the inviting user's terminal device 30 is performed. It becomes possible. Hereinafter, a specific operation until the voice chat communication is enabled after the notification information is transmitted to the invited user will be described.

  In the terminal device 30 of the invited user who has received the push notification (notification information and voice stamp identification information) related to the voice chat invitation from the server 10, an operation corresponding to the state of the invited user when the push notification is received is performed. For example, the invited user is logged in to the voice chat service (for example, the voice chat program 60 is being executed) and the voice chat with another user (voice in other chat units). When the chat is not being performed, the invitation notification screen 110 illustrated in FIG. 11 is displayed as an overlay on the voice chat service screen 70. As shown in the figure, the invitation notification screen 110 displays information related to a voice chat requesting user (user X in this example), an accept button 112 for accepting an invitation to voice chat, and a voice chat. A reject button 114 for rejecting the invitation is arranged. The operation when accepting or rejecting the invitation will be described later.

  For example, when the invited user is logged in to the voice chat service and is in a voice chat with another user, as shown in FIG. In the stream area 74 of the service screen 70 (voice chat screen 70C), the fact that the push notification related to the voice chat invitation has been received is displayed. Specifically, in the stream area 74, the content (number of notifications) of the new arrival notification number area 74a indicating the number of newly received notifications is updated, and the user image 74b of the request source user “receives an invitation”. Is displayed with the text. When the invited user selects the user image 74b in the stream area 74, the above-described invitation notification screen 110 is displayed in an overlay manner.

  Furthermore, for example, when the invited user is not logged in to the voice chat service (for example, the voice chat program 60 is not executed), a notification is displayed by the function of the operating system of the terminal device 30. The FIG. 13 is an example of a home screen (screen based on operating system functions) 100 of the terminal device 30 on which notification display is performed based on operating system functions. As shown in the figure, an icon indicating the presence of a push notification for the user is displayed in the notification information display area 102 located at the upper end of the home screen 100. When the user selects a push notification corresponding to this icon, for example, the voice chat program 60 is executed (started) and the voice chat service is logged in, and the invitation notification screen 110 is overlaid. A screen 70 is displayed.

  Here, in one embodiment, an audio stamp (audio file) corresponding to the audio stamp identification information received together with the notification information is reproduced at the timing when the above-described invitation notification screen 110 is displayed on the inviting user's terminal device 30. . Specifically, the terminal device 30 identifies and reproduces a voice stamp identified by the received voice stamp identification information from among a plurality of voice stamps (voice files) stored in the storage 35. The reproduction of the voice stamp (voice file) can be executed, for example, using the function of the voice chat program 60 (voice stamp reproduction module 63), the function of another application, or the function of the operating system. Here, the timing of reproducing the voice stamp is not limited to the timing at which the invitation notification screen 110 is displayed. For example, when the invited user is in a voice chat with another user, before the invitation notification screen 110 is displayed (for example, the fact that the push notification has been received is displayed in the stream area 74). Audio stamps may be played back at the same time. Further, for example, when the invited user is not logged in to the voice chat service, the voice stamp may be reproduced at the timing when the notification display by the function of the operating system is made.

  Thus, via the invitation notification screen 110 displayed on the terminal device 30, the inviting user can select whether to accept or reject the invitation to the voice chat from the requesting user. When the inviting user selects the accept button 112 on the invitation notification screen 110, acceptance information indicating that the inviting user has accepted the invitation to the voice chat is transmitted from the terminal device 30 to the server 10. When the acceptance information is received from the terminal device 30, the state monitoring unit 53 of the server 10 stores the chat unit information management table 51 b so that the invited user can execute the voice chat (chat unit). Update. Specifically, the “executable flag” of the invited user in “member information” of the corresponding chat unit is changed to a value indicating that it is in an executable state.

  On the other hand, when the invited user selects the reject button 114 on the invitation notification screen 110, rejection information indicating that the invited user has refused the invitation to the voice chat is transmitted from the terminal device 30 to the server 10. Then, when the rejection information is received from the terminal device 30, the state monitoring unit 53 of the server 10 updates the chat unit information management table 51b so that the invited user is deleted from the members of the chat unit. Specifically, information on the invited user is deleted from the “member information” of the corresponding chat unit. In this case, the notification information transmission unit 52 of the server 10 may make a push notification regarding the rejection of the invitation by the invited user to the terminal device 30 of the requesting user.

Here, when the requesting user maintains the executable state when the invited user accepts the voice chat invitation and becomes ready to execute this voice chat (chat unit), Since both the requesting user and the inviting user are in an executable state, the voice between the requesting user's terminal device 30 and the inviting user's terminal device 30 is obtained by the above-described function of the voice chat control unit 54 of the server 10. Chat communication becomes possible, and voice chat communication between the terminal devices 30 is executed by the function of the voice chat communication execution module 61 of the voice chat program 60. FIG. 14 is an example of a voice chat screen 70 </ b> C displayed on the terminal device 30 of the invited user at this time. As shown in the figure, in the main area 72, a user icon 96 corresponding to the voice chat requesting user (user X) is displayed. The stamp area 76 displays a list of information on voice stamps held by requesting users who are members of voice chat (chat units). Note that a voice chat screen 70C similar to the voice chat screen 70C illustrated in FIG. 14 is also displayed on the terminal device 30 of the request source user.

  When the voice chat communication between the terminal device 30 of the requesting user and the terminal device 30 of the inviting user becomes possible in this way, the requesting user and the inviting user can execute a voice chat. Specifically, voice data of voice input via the microphone 33a of each user's terminal device 30 is transmitted to the other user's terminal device 30 and output from the speaker 33b.

  On the other hand, when the requesting user is not in an executable state when the invited user accepts the invitation to the voice chat and becomes ready to execute the voice chat, the requesting user's terminal device 30 and Voice chat communication with the terminal device 30 of the invited user is not possible. FIG. 15 is an example of a voice chat screen 70 </ b> C displayed on the terminal device 30 of the invited user at this time. As shown in the figure, in this case, the user icon 96 corresponding to the requesting user (user X) displayed in the main area 72 is in a display mode (for example, grayed out display) indicating that it is not in an executable state. As a case where the requesting user is not in an executable state when the invited user accepts the invitation to the voice chat, for example, the requesting user logs off after making a voice chat start request (voice chat program 60). In other words, a case where voice chat with another user (voice chat in another chat unit) is started can be considered.

  In one embodiment, when the requesting user is not in an executable state when the invited user accepts the invitation to the voice chat and enters the executable state in which the voice chat can be executed, the notification information transmission unit of the server 10 By 52, the push notification regarding acceptance of the invitation by an inviting user is performed with respect to the terminal device 30 of a request origin user. Then, in the terminal device 30 of the requesting user who has received the push notification, an operation according to the state of the requesting user when the push notification is received can be performed. For example, a notification display indicating that a push notification regarding acceptance of an invitation has been received is displayed by a function of the operating system, or a notification indicating that a push notification regarding acceptance of an invitation has been received is displayed in the stream area 74 of the voice chat screen 70C.

FIG. 16 shows a request source when the requesting user is executing a voice chat with other users (in this example, user D and user F) when the invited user accepts the voice chat invitation. It is an example of the voice chat screen 70C displayed on a user's terminal device 30. As shown in the drawing, in the stream area 74 of the voice chat screen 70C, the fact that the push notification regarding the acceptance of the invitation has been received is displayed. The user image 74b of the invited user (user B) who accepted the invitation is displayed with the text “accept the invitation”. Then, when the requesting user selects the user image 74b in the stream area 74 (or flicks the main area 72), the main area 72 becomes the invited user (user B) as illustrated in FIG. Switch to the display of information about voice chat (chat unit). At this stage, the requesting user is not in a state where voice chat with the invited user can be executed, and voice chat with other users (user D and user F) is continued. The icon 92 is a display (invalid state display) corresponding to the invalid state (mute state) of the microphone 33a.

  When the request source user selects the microphone icon 92 in the invalid state display, the microphone icon 92 is displayed (valid state display) corresponding to the valid state (non-mute state) of the microphone 33a, and the request source user is the invited user. A voice chat with (User B) becomes executable (participates in a voice chat with an invited user (User B)). That is, the state monitoring unit 53 of the server 10 updates the chat unit information management table 51b so that the requesting user can execute a voice chat (chat unit) with the invited user (user B). To do. Specifically, the “executable flag” of the requesting user in the “member information” of the corresponding chat unit is changed to a value indicating that it is in an executable state. In addition, the voice chat that the requesting user is performing with other users (user D and user F) is no longer executable, and the “executable flag” of the requesting user in the “member information” of the corresponding chat unit is It is changed to a value indicating that it is not in an executable state. When the invited user remains in an executable state, both the requesting user and the invited user are in an executable state, so the function of the voice chat control unit 54 of the server 10 enables the requesting user's terminal device. The voice chat communication between the terminal device 30 of the inviting user and 30 is possible.

  Thus, in one embodiment, the chat unit displayed in the main area 72 of the voice chat screen 70C is switched by a flick operation or the like, and the microphone icon 92 is selected (switching between valid state display / invalid state display). Thus, the user of the terminal device 30 selects (switches) a chat unit that is in an executable state (that is, a chat unit that executes (participates in) voice chat). In other words, the state monitoring unit 53 of the server 10 transmits the data transmitted from the terminal device 30 so that the chat unit selected by the user through the operation of the terminal device 30 (voice chat screen 70C) is executable. The “executable flag” in the chat unit information management table 51b is updated based on the above.

  Here, in one embodiment, after a voice chat is newly started (after a chat unit is created), a member of the chat unit can newly invite a user. In this case, with respect to the new invited user, the same operation as the operation related to the invited user when the voice chat described above is newly started is performed. Specifically, for example, when the user selects the invitation icon 94 arranged in the main area 72 of the voice chat screen 70C described above, the friend list screen 80 illustrated in FIG. 8 is displayed in an overlay manner. When a desired user to be newly invited is selected from the friends displayed in the list, the screen changes to the friend details screen 70B illustrated in FIG. 9, and is displayed in a list in the stamp area 76 of the friend details screen 70B. By selecting any one of the voice stamps, it is possible to make a request (invitation request) to invite the selected user to voice chat (chat unit). The state monitoring unit 53 of the server 10 that has received the invitation request from the terminal device 30 updates the “member information” in the chat unit information management table 51b so that the new invited user becomes a member of this chat unit, and a new one is added. The push notification regarding the invitation to voice chat is performed with respect to the terminal device 30 of an inviting user. The subsequent operations are the same as the operations when a voice chat is newly started. For example, when a new invited user accepts an invitation to the voice chat, the new invited user can execute the voice chat. Ready to run.

  Here, in one embodiment, each user can request the terminal device 30 of another user to play a voice stamp in a chat unit of which the user is a member. Specifically, for example, when a desired voice stamp is selected from the voice stamps displayed in a list in the stamp area 76 of the voice chat screen 70C, the identification information of the selected voice stamp is obtained via the server 10, for example. The voice stamp (voice file) transmitted to the terminal device 30 of the other user and identified by the voice stamp identification information is reproduced on the terminal device 30 of the other user.

  In one embodiment, the reproduction request for the selected voice stamp may be issued to all other users who are members of the chat unit, or selected by the user from the members of the chat unit. It may be performed for one or a plurality of other users. Further, when a request for reproducing a voice stamp is made to a plurality of other users, it is also conceivable that some of the other users do not have the selected voice stamp. In this case, the voice stamp stored in the server 10 may be acquired and played (streaming playback, download playback, etc.) in the terminal device 30 of another user. Further, each user may be able to acquire voice stamps held by other users who are members of the chat unit from the server 10 and store them in the terminal device 30 automatically or in response to an operation by the user.

  In one embodiment, the voice stamp reproduction request is sent to other voice chat members who are participating in the voice chat (users in an executable state) and in the voice chat. This can be done for other users (users who are not in an executable state). FIG. 18 is an example of a voice chat screen 70 </ b> C displayed on the terminal device 30 of another user when the other user participating in the voice chat is requested to reproduce the voice stamp. In this case, information related to the audio stamp requested to be reproduced (in this example, the audio icon 97) is displayed in the lower right corner of the user icon 96 corresponding to the user who has requested the reproduction. Notify receipt of playback request. When the user icon 96 including the audio icon 97 is selected by the user, an audio stamp (audio file) is reproduced on the terminal device 30. Here, in one embodiment, when a reproduction request for another audio stamp is received before the user selects the user icon 96 and reproduces the corresponding audio stamp, the audio of the last received reproduction request is received. When a stamp audio icon 97 is displayed and the user selects the user icon 96, a plurality of unreproduced audio stamps are continuously reproduced. In addition, the terminal device 30 may output a predetermined alarm sound at the timing when the request for reproducing the voice stamp is received (for example, when information related to the voice stamp (voice icon 97) is displayed). Further, the voice stamp may be reproduced without any user action such as selection of the user icon 96.

  FIG. 19 is an example of a voice chat screen 70 </ b> C displayed on the terminal device 30 of the other user when the other user who is not participating in the voice chat is requested to reproduce the voice stamp. In this case, a reception notification 98 indicating reception of a voice stamp reproduction request from another voice chat member is displayed in the main area 72 that displays information related to the voice chat (chat unit) that is being executed (participated). Is done. In one embodiment, the reception notification 98 displays information (for example, a user image) regarding a user who requested the reproduction of the audio stamp and information (for example, an audio icon) regarding the audio stamp requested to be reproduced. When the user selects the reception notification 98, the main area 72 is switched to the display of the corresponding chat unit (the chat unit for which the reproduction requesting user requested to reproduce the voice stamp), as illustrated in FIG. . When the user selects the user icon 96, the voice stamp is reproduced on the terminal device 30. As can be seen from the fact that the microphone icon 92 is displayed in an invalid state in FIG. 20, at this stage, participation in the voice chat (chat unit) in which the other user who played the voice stamp has participated continues. When the other user selects the microphone icon 92, the participating voice chat is switched.

Further, in one embodiment, each user can request the reproduction of the voice stamp from other members of the voice chat (chat unit) that the user is a member of and does not participate in. For example, on the voice chat screen 70C of FIG. 20, the voice chat to be performed is selected for another user who is a member of this voice chat (user B in this example) without switching the voice chat to participate by selecting the microphone icon 92. It is possible to request the reproduction of the stamp.

  As described above, in one embodiment, within a chat unit member, regardless of the participation state in the voice chat, playback of the voice stamp on the terminal device 30 of another user (when viewed from the user, You can also enjoy “sending” a voice stamp). For example, in the chat unit to participate, it is possible to enjoy communication using voice stamps as well as communication using utterances via the microphone 33a. Further, for example, it is possible to enjoy communication by speech in a chat unit to participate, and enjoy communication by voice stamp in a chat unit that does not participate. Furthermore, for example, even when the user is in an environment where speech cannot be spoken, communication using voice stamps can be enjoyed.

  In the above-described embodiment, when the voice chat start request is made, the voice stamp reproduced on the invited user's terminal device 30 is selected. However, only the invited user is selected without selecting the voice stamp. You may make it select and perform a voice chat start request.

  In the above-described embodiment, the voice stamp possessed by the user is stored in the user terminal device 30 and is also stored in the server 10 in a duplicated manner, but the storage destination of the voice stamp is limited to this. Not. For example, you may memorize | store in only one of a user's terminal device 30 and the server 10, and may memorize | store in another apparatus. If the voice stamp is not stored in the user's terminal device 30, when the voice stamp is played back, it may be obtained from the device storing the voice stamp and played back. Furthermore, the reproduction request for the voice stamp stored in the terminal device 30 of the user who has requested reproduction can be made to another user. In this case, the voice stamp (voice file) itself stored in the terminal device 30 of the requesting user may be transmitted to the terminal device 30 of another user.

  In the embodiment described above, the inviting user selects whether to accept or reject the invitation to the voice chat via the invitation notification screen 110, but accepts the invitation using the voice stamp. It can also be. For example, the invitation user may accept the invitation by transmitting a voice stamp to the invitation requesting user (requesting the invitation requesting user to reproduce the voice stamp). That is, for example, when a voice chat start request is made and when a new user is invited after the voice chat is started, a voice stamp (for example, a voice stamp held by the invited user) is given to the invited user. And then, when the invited user returns a voice stamp (sends a voice stamp to the user requesting the invitation), it is determined that the invited user has accepted the voice chat invitation. This voice chat (chat unit) can also be made executable.

  In the system 1 in the embodiment described above, the terminal device 30 of a user who participates in this chat unit (is in an executable state) among a plurality of users who are members of the chat unit realizes voice chat in this chat unit. The terminal device 30 of one user who is a member of this chat unit performs the voice chat communication to the terminal device 30 of another user who is a member of this chat unit based on the instruction of this one user. The terminal device 30 of the other user requests the reproduction of the audio file, and reproduces the audio file in response to the request for reproducing the audio file. Therefore, the user can enjoy communication using a voice stamp (voice file) in addition to communication by utterance via the microphone 33a. In other words, the system 1 according to the embodiment can enable communication by voice other than the user's utterance in voice chat.

  In one embodiment, when an invited user accepts an invitation to a voice chat, the invited user is allowed to execute this voice chat (chat unit), but the invited user is allowed to execute. The opportunity is not limited to this. For example, the inviting user may be in an executable state in response to the notification information pushed from the server 10 being displayed, viewed, or confirmed by the inviting user. Furthermore, the invited user may be in an executable state regardless of whether or not there is an action on the notification information notified from the server 10.

  Furthermore, when a voice chat is newly started, a push notification to the terminal device 30 of the invited user invited to the voice chat is not performed, and the requesting user's terminal device 30 and the inviting user's terminal device 30 are connected. It is also possible to immediately enable voice chat communication.

  That is, in another embodiment of the present invention, when a voice chat start request is received from the terminal device 30, the state monitoring unit 53 of the server 10 is first in an executable state in which the invited user can execute a new voice chat. It is determined whether or not there is. For example, the invited user is logged in to the voice chat service (determined by referring to the “login state” in the user information management table 51a) and voice chat with other users (other chat units) If the invited user is in an executable state in which a new voice chat can be executed when the voice chat is not performed (can be determined by referring to the chat unit information management table 51b). Can do. If it is determined that the invited user is in an executable state in which a new voice chat can be performed, the state monitoring unit 53 of the server 10 sets both the requesting user and the invited user as an executable state in a chat unit. Is set (a new record is created in the chat unit information management table 51b). Thereafter, the function of the voice chat control unit 54 enables voice chat communication immediately between the terminal device 30 of the requesting user and the terminal device 30 of the invited user. In another embodiment, when it is determined that the inviting user is not in an executable state in which a new voice chat can be executed, a push notification to the terminal device 30 of the inviting user is issued as in the above-described embodiment. Done.

  In another embodiment, when it is determined that the inviting user is ready to perform a new voice chat and voice chat communication is immediately possible, the microphone of the terminal device 30 of the inviting user at the start of the voice chat 33a may be in an invalid state. Thereafter, for example, when the invited user selects the microphone icon 92 on the voice chat screen 70C, the microphone 33a is enabled.

  In another embodiment, when the inviting user is in an executable state in which a new voice chat can be executed, after the voice chat start request from the requesting user, the requesting user's terminal device 30 and the inviting user's Since voice chat communication with the terminal device 30 is immediately possible, the user can easily start voice chat with other users.

  In the above-described embodiment, when the user is in a voice chat state, a voice chat with another user (voice chat in another chat unit) cannot be performed (it is not in an executable state). As described above, it is also possible to simultaneously perform voice chat communication of a plurality of voice chats (a plurality of chat units) with different members. In this case, for example, in response to the start of a new voice chat, the volume of the voice chat being executed can be reduced. Specifically, for example, the volume of the voice data corresponding to each voice chat (chat unit) can be adjusted by the function of the voice chat control unit 54. In this way, even when the user is in a voice chat state, another voice chat (chat unit) can be started immediately.

  The processes and procedures described in this specification are implemented by software, hardware, or any combination thereof other than those explicitly described in the embodiments. More specifically, the processes and procedures described in this specification are performed by mounting logic corresponding to the processes on a medium such as an integrated circuit, a volatile memory, a nonvolatile memory, a magnetic disk, or an optical storage. Is also realized. Further, the processes and procedures described in this specification can be implemented as a computer program and executed by various computers.

  Even if the processes and procedures described herein are described as being performed by a single device, software, component, or module, such processes or procedures may be performed by multiple devices, multiple software, multiple Component and / or multiple modules. In addition, even though the data, tables, or databases described herein are described as being stored in a single memory, such data, tables, or databases are provided on a single device. Alternatively, the data can be distributed and stored in a plurality of memories or a plurality of memories arranged in a plurality of devices. Further, the software and hardware elements described herein may be implemented by integrating them into fewer components or by decomposing them into more components.

  In the present specification, when the constituent elements of the invention are described as one or a plurality, or when they are described without being limited to one or a plurality of cases, they should be understood separately in context. The component may be either singular or plural.

DESCRIPTION OF SYMBOLS 10 Server 30 Terminal apparatus 51 Information storage part 52 Notification information transmission part 53 Status monitoring part 54 Voice chat control part 60 Voice chat program 70 Voice chat service screen 70A Voice chat service screen (initial screen)
70B Voice chat service screen (Friend details screen)
70C Screen for voice chat service (voice chat screen)
80 Friends list screen 100 Home screen 110 Invitation notification screen

Claims (14)

A system comprising a plurality of terminal devices, enabling voice chat between users of the terminal devices,
The terminal device of at least some users among a plurality of users who are members of a chat unit, which is a unit that performs voice chat, executes voice chat communication that realizes voice chat in the chat unit,
The terminal device of the first user who is a member of the chat unit is selected by the first user with respect to the terminal device of the second user who is a member of the chat unit based on the instruction of the first user Request playback of the recorded audio file,
The terminal device of the second user plays the sound file in response to the request to play the sound file;
system. The system of claim 1, comprising:
The chat unit members include participating users participating in voice chat in the chat unit and non-participating users not participating in voice chat in the chat unit,
The terminal device of the participating user executes the voice chat communication.
system.   The voice chat communication is performed by transmitting voice data input via the voice input unit of the terminal device to another terminal device and inputting the voice data input via the voice input unit of the other terminal device. The system according to claim 1, further comprising receiving voice data of   The terminal device of the first user plays back the audio file selected by the first user from one or more audio files stored in the terminal device of the second user. The system according to claim 1, wherein a request is made to a user terminal device. 5. The system according to claim 4, wherein
A first storage device for storing an audio file stored in the terminal device of the second user;
The terminal device of the first user acquires the audio file from the first storage device and reproduces the audio file according to the selection of the audio file that requests the reproduction by the first user. System. A system according to any one of claims 1 to 3,
A second storage device for storing the audio file;
The terminal device of the first user plays back the audio file selected by the first user from one or more audio files stored in the second storage device. Request to the terminal device,
The terminal device of the second user acquires and reproduces the audio file from the second storage device in response to a request for reproduction of the audio file.
system. A system according to any one of claims 1 to 3,
The terminal device of the first user selects an audio file selected by the first user from one or a plurality of audio files stored in the terminal device of the first user. Sent to the terminal device,
The terminal device of the second user reproduces the audio file in response to the reception of the audio file;
system.   8. The system according to claim 1, wherein the second user terminal device displays reproduction request information for notifying the reproduction request in response to the reproduction request for the audio file.   The system according to claim 8, wherein the reproduction request information includes information on the first user and information on the audio file.   The system according to claim 8 or 9, wherein the terminal device of the second user reproduces the audio file in response to a predetermined action by the second user. The system according to any one of claims 1 to 10,
A third storage device for storing at least information on the audio file held by the user;
The terminal device of the first user causes the terminal device of the second user to reproduce an audio file selected by the first user from one or a plurality of audio files held by the second user. Request
system.   The terminal device of the first user displays the one or more chat units of which the first user is a member so as to be selectable, and is selected by the first user from the one or more chat units. One or a plurality of other users who are members of the selected chat unit are displayed in a selectable manner, and the terminal device of the second user selected by the first user from the one or more other users The system according to claim 1, wherein the system requests the playback of the audio file. A method for enabling voice chat between users of a plurality of terminal devices,
The terminal device of at least some users among a plurality of users who are members of a chat unit, which is a unit that performs voice chat, executes voice chat communication that realizes voice chat in the chat unit,
The terminal device of the first user who is a member of the chat unit is selected by the first user with respect to the terminal device of the second user who is a member of the chat unit based on the instruction of the first user Request playback of the recorded audio file,
The terminal device of the second user plays the sound file in response to the request to play the sound file;
Method. It is a program for enabling voice chat between users of a plurality of terminal devices, and is executed on the terminal device,
The terminal device of at least some users among a plurality of users who are members of a chat unit, which is a unit that performs voice chat, executes voice chat communication that realizes voice chat in the chat unit,
The terminal device of the first user who is a member of the chat unit is selected by the first user with respect to the terminal device of the second user who is a member of the chat unit based on the instruction of the first user Request playback of the recorded audio file,
The terminal device of the second user plays the sound file in response to the request to play the sound file;
program.

Images