JP6531196B2 - System, method and program for enabling voice chat - Google Patents

Description

  The present invention is a system, method and program that enables voice chat between users.

  BACKGROUND In recent years, application programs (hereinafter, sometimes simply referred to as “applications”) for performing text chats for exchanging text messages between users using a terminal device such as a smartphone have been provided (for example, patent documents) 1). In text chat using such an application, a chat group is created by two or more users, and a text message entered by the user for this chat group belongs to this chat group (it is a member of the chat group) The list is displayed in chronological order on the terminal device of each user.

JP, 2014-050745, A

  However, in the text chat described above, although the user can more easily enjoy the conversation using the text message as compared with the conventional e-mail exchange and the like, various problems resulting from the use of the text message Can occur. For example, since text messages remain as a history, they may be overly cautious about what a user speaks (sends a text message) and may give the user a sense of obligation to reply. In addition, since communication by text message requires user operation for inputting, sending and receiving text messages, and confirmation (display), there is a limit to the real time nature of communication.

  On the other hand, although voice chat using a mechanism such as Internet telephone may be capable of real-time communication without using the above-mentioned text message, it can not be said that communication beyond conventional telephones can be realized. For example, in conventional voice chat, voice communication is limited to the exchange of the user's speech or the like that is voice-input via the microphone. Therefore, in voice chat, it is desirable to provide a mechanism that enables communication by voice other than the user's speech or the like.

  An embodiment of the present invention has an object to enable communication by voice other than the user's speech or the like in voice chat. Other objects of embodiments of the present invention will become apparent by reference to the present specification as a whole.

A system according to an embodiment of the present invention is a system that includes a plurality of terminal devices and enables voice chat among users of the terminal devices, and is a member of a chat unit that is a unit for executing voice chat. The terminal device of at least a part of the plurality of users executes voice chat communication for realizing voice chat in the chat unit, and the terminal device of the first user who is a member of the chat unit is the first terminal. Request the reproduction of the audio file selected by the first user to the terminal device of the second user who is a member of the chat unit based on the instruction of the second user, and the terminal device of the second user And reproducing the audio file in response to the request for reproducing the audio file.

  A method according to an embodiment of the present invention is a method for enabling voice chat among users of a plurality of terminal devices, and at least among a plurality of users who are members of a chat unit, which is a unit for executing voice chat. The terminal devices of some users execute voice chat communication for realizing voice chat in the chat unit, and the terminal device of the first user who is a member of the chat unit is based on an instruction of the first user. Request the terminal device of the second user who is a member of the chat unit to reproduce the audio file selected by the first user, and the terminal device of the second user reproduces the audio file Play the audio file in response to the request.

  A program according to an embodiment of the present invention is a program for enabling voice chat among users of a plurality of terminal devices, and is executed on the terminal device in units of executing voice chat. The terminal device of at least a part of a plurality of users who are members of a certain chat unit executes voice chat communication for realizing voice chat in the corresponding chat unit, and the first user who is a member of the chat unit The terminal device requests the terminal device of the second user who is a member of the chat unit to reproduce the audio file selected by the first user based on the instruction of the first user, The terminal device of the user 2 reproduces the audio file in response to the request for reproducing the audio file.

  In the present specification, the “chat unit” includes, for example, a chat room, a chat group, a chat session and the like. Also, for “execution of voice chat communication”, for example, voice data of voice input via the voice input unit of the terminal device is transmitted to another terminal device, and via the voice input unit of the other terminal device Receiving the voice data of the input voice.

  Various embodiments of the present invention allow voice communication to be enabled for voice communication other than the user's speech or the like.

BRIEF DESCRIPTION OF THE DRAWINGS The block diagram which shows roughly the structure of the system 1 which concerns on one Embodiment of this invention. The block diagram which shows the function which server 10 in one embodiment has. The figure which shows an example of the information managed by the user information management table 51a in one Embodiment. The figure which shows an example of the information managed by the chat unit information management table 51b in one Embodiment. FIG. 2 is a block diagram showing the function of a program 60 for voice chat in one embodiment. The flowchart which shows an example of the voice chat start process in one embodiment. FIG. 6 is a view showing an example of an initial screen 70A of a screen 70 for voice chat service in one embodiment. The figure which shows an example of the friend list screen 80 in one Embodiment. A figure showing an example of friend detailed screen 70B of screen 70 for voice chat services in one embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment. The figure which shows an example of the invitation notification screen 110 in one Embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment. The figure which shows an example of the home screen 100 in one Embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment. The figure which shows an example of 70 C of audio chat screens of the screens 70 for audio chat services in one Embodiment.

  FIG. 1 is a block diagram schematically showing the configuration of a system 1 according to an embodiment of the present invention. As illustrated, the system 1 according to one embodiment includes a plurality of terminal devices 30 and a server 10 communicably connected to the terminal devices 30 via a communication network 20 such as the Internet. Enable voice chat between users of.

  In one embodiment, the server 10 is a voice chat service, as well as services for providing various digital contents such as online games, electronic books, video contents, and music contents, text chat (mini-mail), circles, avatars, diary, message board , And various communication services between users such as greetings (SNS platform) services, and various Internet services such as electronic commerce services are provided to the user operating the terminal device 30.

  The server 10 in one embodiment is configured as a general computer, and as illustrated, a CPU (computer processor) 11, a main memory 12, a user I / F 13, a communication I / F 14, and a storage 15 , And a disk drive 16, and these respective components are electrically connected to one another via a bus 17. The CPU 11 loads an operating system and various other programs from the storage 15 into the main memory 12 and executes instructions included in the loaded program. The main memory 12 is used to store a program to be executed by the CPU 11, and is constituted by, for example, a DRAM or the like. The server 10 in one embodiment may be configured using a plurality of computers each having the hardware configuration as described above.

  The user I / F 13 includes, for example, an information input device such as a keyboard or a mouse that receives an input from an operator, and an information output device such as a liquid crystal display that outputs the calculation result of the CPU 11. The communication I / F 14 is implemented as hardware, firmware, or communication software such as a TCP / IP driver or a PPP driver, or a combination thereof, and is configured to be able to communicate with the terminal device 30 via the communication network 20.

The storage 15 is formed of, for example, a magnetic disk drive, and stores various programs such as a control program for controlling provision of various services. The storage 15 may also store various data used in providing various services. Various data that may be stored in the storage 15 may be stored in a database server or the like physically separate from the server 10 communicably connected to the server 10. The disk drive 16 reads data stored in various storage media such as a CD-ROM, a DVD-ROM, and a DVD-R, or writes data in these storage media.

  In one embodiment, the server 10 also functions as a web server that manages a web site composed of a plurality of web pages in a hierarchical structure, and provides the terminal device 30 with the various internet services described above via such web site. It can. The storage 15 may also store HTML data corresponding to this web page. Various pieces of image data are associated with the HTML data, and various programs described in a script language such as JavaScript (registered trademark) can be embedded.

  In one embodiment, the server 10 may provide the terminal device 30 with the various Internet services described above via an application executed on an execution environment other than a web browser in the terminal device 30. The storage 15 may also store such applications. This application is created using a programming language such as, for example, Objective-C or Java (registered trademark), and may include various image data. The application stored in the storage 15 is distributed to the terminal device 30 in response to the distribution request. The terminal device 30 can also download such an application from a server other than the server 10 (a server providing an application market) or the like.

  As described above, the server 10 manages a website for providing various services, and distributes a web page (HTML data) configuring the website in response to a request from the terminal device 30, thereby a terminal Various services can be provided to the user of the device 30. In addition, as described above, the server 10 communicates with an application executed on the terminal device 30 instead of or in addition to providing a service using such a web page (web browser). Can provide various services based on Whichever mode the service is provided, the server 10 can transmit and receive various data (including data necessary for screen display) necessary for providing various services with the terminal device 30. In addition, the server 10 stores various data necessary for providing the service for each identification information (for example, user ID) for identifying each user, thereby providing the service provision situation (for example, the progress of the game, etc.) for each user. ) Can be managed. Although the detailed description is omitted, the server 10 may have a function of performing an authentication process or the like which is generated according to the user authentication process or the service provision at the start of the service provision.

  The terminal device 30 in one embodiment is an arbitrary information processing device that implements an execution environment for displaying a web page of a website provided by the server 10 on a web browser and executing an application, such as a personal computer or a smartphone , A tablet terminal, a wearable device, a game dedicated terminal, and the like.

  The terminal device 30 is configured as a general computer, and includes a CPU (computer processor) 31, a main memory 32, a user I / F 33, a communication I / F 34, and a storage 35, as shown in FIG. These components are electrically connected to one another via a bus 36.

  The CPU 31 loads an operating system and various other programs from the storage 35 into the main memory 32, and executes instructions included in the loaded program. The main memory 32 is used to store a program executed by the CPU 31, and is constituted by, for example, a DRAM.

The user I / F 33 is, for example, a touch panel that receives user input, a keyboard,
It includes an information input device such as a button and a mouse, and an information output device such as a liquid crystal display that outputs the calculation result of the CPU 31. In addition, the user I / F 33 inputs a voice and converts it into an electrical signal, a general microphone 33a (voice input unit), and a general speaker (voice output unit) 33b, which converts the electrical signal into voice and outputs it. And. The communication I / F 34 is implemented as hardware, firmware, or communication software such as a TCP / IP driver or a PPP driver, or a combination thereof, and is configured to be able to communicate with the server 10 via the communication network 20.

  The storage 35 is constituted by, for example, a magnetic disk drive or a flash memory, and stores various programs such as an operating system. In addition, the storage 35 may store various applications received from the server 10 or the like.

  The terminal device 30 includes, for example, a web browser for interpreting a file in HTML format (HTML data) and displaying the screen, and interprets and receives HTML data acquired from the server 10 by the function of the web browser. Web pages corresponding to the HTML data can be displayed. In addition, the web browser of the terminal device 30 may incorporate plug-in software capable of executing various types of files associated with HTML data.

  When the user of the terminal device 30 receives various services provided by the server 10, for example, HTML data, an animation instructed by an application, an operation icon, and the like are displayed on the terminal device 30 on the screen. The user can input various instructions using the touch panel of the terminal device 30 or the like. The instruction input from the user is transmitted to the server 10 via the web browser of the terminal device 30 and the function of the application execution environment such as NgCore (trademark).

  Next, functions of the server 10 in the embodiment configured as described above will be described. Although the server 10 in one embodiment has various functions for providing the various Internet services described above, here, the functions for managing the voice chat described above will be mainly described. FIG. 2 is a block diagram schematically showing functions of the server 10 in one embodiment. The server 10 responds to the reception of the voice chat start request from the information storage unit 51 storing various information and the inviting user who is invited to the voice chat from the terminal device 30 of the request source user, as illustrated. A notification information transmission unit 52 for transmitting predetermined notification information to the terminal device 30 of the inviting user, and a state monitoring unit monitoring that the request source user and the inviting user are in an executable state capable of executing voice chat And a voice chat control unit that enables voice chat communication between the request source user's terminal device 30 and the invitation user's terminal device 30 when the request source user and the invitation user are in the above-described executable state And 54. These functions are realized by the cooperation of hardware such as the CPU 11 of the server 10 and the main memory 12 and software such as various programs stored in the storage 15 etc. It is realized by the CPU 11 of the server 10 executing instructions included in one or more computer programs corresponding to the functions.

The information storage unit 51 is realized by the storage 15 of the server 10 and the like, and manages a user information management table 51a that manages user information related to the user, and chat unit information related to a chat unit which is a unit of voice chat executed between users. Chat unit information management table 51b. FIG. 3 shows an example of information managed in the user information management table 51a of one embodiment. The user information management table 51a includes “basic information” (for example, a nickname, a gender, an age, a user image, etc.) of the user in association with a “user ID” for identifying each user as illustrated. ) "Friend information" indicating information on the friend of this user (for example, established by the acceptance of a friend application by one user by the other user), "speech stamp indicating information on a voice stamp owned by this user "Information" manages information such as "login state" indicating the login state (online state) of the user to the voice chat service.

  Here, the above-mentioned "voice stamp" will be described. The voice stamp is a voice file available for the voice chat service in one embodiment, and is reproduced (voice output) on the terminal device 30 of each user. The audio stamp is configured, for example, as an audio file to which a file format such as WAV or AIFF is applied. In one embodiment, the voice stamp owned by the user is stored in the terminal device 30 (for example, the storage 35) of the user and also redundantly stored in the server 10 (for example, the storage 15). The voice stamps stored in the terminal device 30 and the server 10 are synchronized according to the operation by the user. The user can obtain an audio stamp by, for example, purchasing or giving a present from another user or the like. Furthermore, in one embodiment, the user can also create (record) voice stamps available for the voice chat service. The "voice stamp information" in the user information management table 51a described above includes, for example, identification information (including a file name) for identifying each voice stamp (voice file), an icon of the voice stamp, a name, and information such as a description. Is included.

  FIG. 4 shows an example of information managed in the chat unit information management table 51b of the embodiment. The chat unit information management table 51b associates information such as "member information" indicating information on the user who is a member of the chat unit in association with the "chat unit ID" identifying each chat unit as illustrated. to manage. As described above, the “chat unit” in one embodiment is a unit of voice chat performed between users, and may be referred to as a chat room, a chat group or the like. "Member information" indicates the "user ID" of each user who is a member belonging to this chat unit, and "executable" indicates whether each user can execute voice chat in this chat unit or not Information such as "flag" is included. In one embodiment, members of the chat unit are further invited from the user who has created this chat unit (newly started voice chat), the user invited from this user to this chat unit, and the invited user. Users etc. may be included.

  As described above, the state monitoring unit 53 according to one embodiment monitors that the request source user and the invited user (members in chat units) are in an executable state in which voice chat can be performed. Specifically, monitoring of the user is performed based on various data and the like transmitted from the terminal device 30 according to the user's operation, the "executable flag" in the "member information" of the chat unit information management table 51b described above. It is done by updating. Details will be described later.

As described above, the voice chat control unit 54 in one embodiment operates between the terminal device 30 of the request source user and the terminal device 30 of the invitation user when the request source user and the invitation user become executable. Enable voice chat communication. Also, when the number of users who are members of the chat unit is three or more, voice chat communication between the terminal devices 30 of the users who are in the executable state when the two or more users are in the executable state. Make it possible. Specifically, to enable voice chat communication, for example, voice data of voice input via the microphone 33a of each terminal device 30 is transmitted to another terminal device 30. To be realized. In this case, the server 10 may receive voice data from each terminal device 30 and transmit it to the other terminal devices 30, or voice data from each terminal device 30 may be directly transmitted to the other terminal device 30. The voice data from each terminal device 30 may be sent to another terminal device 30 via another computer other than the server 10. That is, part or all of the functions of the voice chat control unit 54 of the server 10 can be performed by one or more terminal devices 30 (the terminal device 30 performing voice chat communication and the terminal device 30 not performing voice chat communication May be included) or other devices may have. In addition, transmission of audio data to the terminal device 30 can be performed, for example, by applying a streaming method.

  Next, a voice chat program 60 according to an embodiment of the present invention that is executed on the terminal device 30 (by the CPU 31) will be described. The voice chat program 60 is a program for the user of the terminal device 30 to use the voice chat service provided by the server 10, and may be configured as, for example, HTML data or an application. FIG. 5 is a block diagram showing the function (module configuration) of the voice chat program 60 in one embodiment. The voice chat program 60 according to one embodiment includes a voice chat communication execution module 61 for executing voice chat communication with another terminal device 30 as shown in the figure, and a chat of which the user is a member based on a user's instruction. A voice stamp reproduction request module 62 for requesting the terminal device 30 of another user who is a member of the unit to play back the voice stamp (voice file) selected by the user; And an audio stamp reproduction module 63 for reproducing an audio file. Specifically, the voice chat communication execution module 61 transmits, for example, voice data of voice input via the microphone 33 a of the terminal device 30, and voices input via the microphone 33 a of another terminal device 30. Audio data is received and output as audio through the speaker 33b. The voice chat communication execution module 61 can operate in cooperation with the voice chat control unit 54 of the server 10 described above.

  Next, the operation of the system 1 in one embodiment will be described. FIG. 6 is a flowchart showing an example of voice chat start processing executed by the server 10 when the user of the terminal device 30 newly starts voice chat. This voice chat start process is executed when a voice chat start request is received from the user of the terminal device 30. In one embodiment, the user's voice chat start request is made via the voice chat service screen 70 displayed on the terminal device 30. Here, the voice chat service screen 70 according to an embodiment will be described.

  The voice chat service screen 70 is a screen displayed when the voice chat program 60 is executed on the terminal device 30, and is used to use the voice chat service provided by the server 10. FIG. 7 is an example of the initial screen 70A of the voice chat service screen 70. As shown in the figure, the voice chat service screen 70 is a main area 72 located in the upper stage, a stream area 74 located on the lower left, and notifying the user of various information on the voice chat service, and a voice located on the lower right And a stamp area 76 for displaying information on the stamp. The main area 72 displays various information according to the use situation of the voice chat service. As illustrated, the stream area 74 and the stamp area 76 are configured as a tab type area, and can be switched and displayed by selecting a tab. In the initial screen 70A illustrated in FIG. 6, in the main area 72, a start button 72a displayed as "start conversation" is arranged. The start button 72a is a button for instructing the user to newly start voice chat (create a chat unit). In the main area 72 of the initial screen 70A, it is also possible to display the history of voice chat (chat unit) executed in the past.

When the user selects the start button 72a, the friend list screen 80 illustrated in FIG. 8 is overlaid on the voice chat service screen 70 (initial screen 70A). As illustrated, the friend list screen 80 displays a list of information (for example, a user image, a nickname, and the like) regarding friends of the user of the terminal device 30. The friend of the user is managed in "friend information" of the user information management table 51a, and the information displayed on the friend list screen 80 is transmitted from the server 10 in response to a request from the terminal device 30. In one embodiment, among the friends listed, the user who is logged in to the voice chat service (managed in the “login state” of the user information management table 51a) is a login indicator in the upper left corner of the user image. 82 is displayed overlapping, which allows the user to confirm the login status of the friend.

  When the user selects a desired user (friend) to be invited to a voice chat from among a plurality of friends listed in the friend list screen 80, the voice chat service screen 70 is a friend detail screen illustrated in FIG. Transition to 70B. In the friend detail screen 70B, as shown, basic information on the selected user (user B in this example) is displayed in the main area 72, and the stamp area 76 displays the selected basic information. Information (for example, an icon image, a name, an explanation, and the like) relating to an audio stamp held by a certain user is displayed as a list. Information on the voice stamp held by the selected user is managed in "voice stamp information" of the user information management table 51a.

  In one embodiment, the user makes a voice chat start request with the selected user by selecting any of the voice stamps listed in the stamp area 76 of the friend details screen 70B of FIG. 9. be able to. Specifically, when the user selects any of the voice stamps, voices identifying the selected user (invited users who are invited to the voice chat) and voices identifying the selected voice stamp can be identified. A voice chat start request including stamp identification information is transmitted from the terminal device 30 to the server 10.

  Here, when making a voice chat start request by selecting any of the voice stamps listed in the stamp area 76, the user confirms in advance the voice (content of the voice file) corresponding to the voice stamp. It may be possible. For example, when any voice stamp in the stamp area 76 is selected, first, a voice file corresponding to the selected voice stamp is transmitted from the server 10 to the terminal device 30, and the voice file received by the terminal device 30 is reproduced. . After that, the voice chat start request may be made in response to the user's confirmation operation or the like (for example, selection of the confirmation button). Also, the user of the terminal device 30 may be able to obtain all or part of the voice stamps (voice files) held by the selected user according to the operation of the user of the terminal device 30. In this case, the acquired voice stamp is downloaded to the terminal device 30 and stored in the storage 35 or the like.

  When a voice stamp is selected and a voice chat start request is issued, the voice chat service screen 70 transitions to a voice chat screen 70C illustrated in FIG. The voice chat screen 70C is a screen displayed on the terminal device 30 when the user performs voice chat, and as shown in the figure, in the main area 72, a microphone icon 92 disposed at the center, and the voice chat An invitation icon 94 for newly inviting another user to (the chat unit), and a user icon 96 for displaying another user (a user other than the user of the terminal device 30) who is a member of the chat unit for each user Have. The microphone icon 92 is also configured as an icon corresponding to a so-called mute function capable of enabling / disabling the microphone 33 a of the terminal device 30 by selecting by the user. In one embodiment, the user icon 96 is in a state where the user has logged in to the voice chat service, and whether or not the voice chat (chat unit) can be executed (ie, participate in the voice chat). Is displayed so that it can be recognized. For example, in the example of FIG. 10, the login status of the user can be recognized by the above-described login indicator 82, and the display mode of the user icon 96 enables the user to execute this voice chat. (E.g., a user who is not in an executable state that can execute this voice chat, the user icon 96 is grayed out, etc.).

  Here, in one embodiment, in the main area 72 of the voice chat screen 70C, information on one chat unit among a plurality of chat units of which the user of the terminal device 30 is a member is displayed, and the operation by the user ( For example, a chat unit to be displayed can be selected (switched) by flick operation).

  Returning to the flowchart of FIG. 6, when receiving a voice chat start request from the terminal device 30, the server 10 first sets a chat unit (step S100). This process is executed by the state monitoring unit 53 of the server 10. Specifically, a record is newly created in the chat unit information management table 51b, a unique value is generated and set as the "chat unit ID", and a voice chat request source user and a voice chat are invited. Set the information about the invited user to "Member information". Here, a value (for example, a value "1") indicating that the request source user is in an executable state is set to the "executable flag" of the "member information" at this stage, and the execution is performed for the invitation user A value (for example, a value “0”) indicating that it is not possible is set.

  Subsequently, a push notification regarding the invitation to the voice chat is issued to the terminal device 30 of the inviting user (step S120), and the voice chat start process is ended. This process is executed by the notification information transmission unit 52 of the server 10. Specifically, notification information notifying that a request source user has been invited to a voice chat and identification information of a voice stamp selected by the request source user are transmitted to the terminal device 30 of the invitation user.

  Thus, in one embodiment, when a voice chat start request is made, notification information is sent to the invited user invited to the voice chat, and thereafter, the state monitoring unit 53 and the voice chat control unit described above The voice chat communication between the terminal device 30 of the requesting user and the terminal device 30 of the inviting user is performed when the requesting user and the inviting user are in an executable state capable of executing the voice chat by the functions of 54. It becomes possible. Hereinafter, after the notification information is sent to the inviting user, a specific operation until voice chat communication becomes possible will be described.

  The terminal device 30 of the inviting user who receives the push notification (notification information and voice stamp identification information) regarding the invitation of the voice chat from the server 10 performs an operation according to the state of the inviting user when the push notification is received. For example, a state where the inviting user is logged in to the voice chat service (for example, a state where the voice chat program 60 is being executed), and voice chat with another user (voice at another chat unit) When the chat) is not performed, the invitation notification screen 110 illustrated in FIG. 11 is overlaid on the voice chat service screen 70. As shown in the figure, the invitation notification screen 110 displays information on a voice chat request source user (user X in this example), an accept button 112 for accepting a voice chat invitation, and a voice chat request. A reject button 114 for rejecting the invitation is arranged. The operation at the time of accepting or rejecting the invitation will be described later.

  Also, for example, in a state where the inviting user is logged in to the voice chat service and is in a state of performing voice chat with another user, voice chat as illustrated in FIG. In the stream area 74 of the service screen 70 (voice chat screen 70C), the fact that the push notification regarding the voice chat invitation has been received is displayed. Specifically, in the stream area 74, the contents (number of notices) of the newly arrived notice number area 74a indicating the number of newly received notices are updated, and the user image 74b of the request source user receives "invite" It is displayed with the text. Then, when the inviting user selects the user image 74b in the stream area 74, the invitation notification screen 110 described above is displayed in an overlay.

  Furthermore, for example, when the invited user is not logged in to the voice chat service (for example, the voice chat program 60 is not executed), the notification display by the function of the operating system of the terminal device 30 is performed. Ru. FIG. 13 is an example of a home screen (a screen by the function of the operating system) 100 of the terminal device 30 on which notification display by the function of the operating system is made. As illustrated, in the notification information display area 102 located at the upper end of the home screen 100, an icon indicating the presence of a push notification for the user is displayed. Then, when the user selects a push notification corresponding to this icon, for example, the voice chat program 60 is executed (started) and at the same time, the voice chat service is logged in, and the invitation notification screen 110 is overlaid for voice chat service Screen 70 is displayed.

  Here, in one embodiment, at the timing when the invitation notification screen 110 described above is displayed on the terminal device 30 of the invitation user, the audio stamp (audio file) corresponding to the audio stamp identification information received together with the notification information is reproduced. . Specifically, the terminal device 30 specifies and reproduces, from among the plurality of audio stamps (audio files) stored in the storage 35, the audio stamp identified by the received audio stamp identification information. The reproduction of the voice stamp (voice file) may be performed using, for example, the function of the voice chat program 60 (voice stamp reproduction module 63), the function of another application, or the function of the operating system. Here, the timing at which the voice stamp is reproduced is not limited to the timing at which the invitation notification screen 110 is displayed. For example, when the invitation user is in a state of performing voice chat with another user, the invitation notification screen 110 is displayed (for example, the stream area 74 displays that the push notification has been received). The audio stamp may be played back at the same time. Also, for example, when the inviting user is not logged in to the voice chat service, the voice stamp may be reproduced at the timing when the notification display is performed by the function of the operating system.

  Thus, via the invitation notification screen 110 displayed on the terminal device 30, the invitation user can select whether to accept or decline the invitation to the voice chat from the request source user. When the inviting user selects the accept button 112 of the invitation notification screen 110, acceptance information indicating that the inviting user accepts the invitation to the voice chat is transmitted from the terminal device 30 to the server 10. Then, when the acceptance information is received from the terminal device 30, the state monitoring unit 53 of the server 10 changes the chat unit information management table 51b to an executable state in which the invited user can execute this voice chat (chat unit). Update. Specifically, the “executable flag” of the inviting user in the “member information” of the corresponding chat unit is changed to a value indicating that the execution is possible.

  On the other hand, when the invitation user selects the rejection button 114 on the invitation notification screen 110, rejection information indicating that the invitation user has rejected the invitation to the voice chat is transmitted from the terminal device 30 to the server 10. And if refusal information is received from the terminal device 30, the state monitoring part 53 of the server 10 will update the chat unit information management table 51b so that an invitation user may be deleted from the member of this chat unit. Specifically, the information on the invited user is deleted from the corresponding "member information" of the chat unit. In this case, the notification information transmitting unit 52 of the server 10 may perform a push notification regarding rejection of the invitation by the inviting user to the terminal device 30 of the request source user.

Here, when the requesting user accepts the invitation to the voice chat and enters an executable state in which the voice chat (chat unit) can be executed, the request source user maintains the executable state. Since both the request source user and the invitation user are in the executable state, the above-described function of the voice chat control unit 54 of the server 10 makes the voice between the request source user terminal device 30 and the invitation user terminal device 30 Chat communication is enabled, and voice chat communication between the terminal devices 30 is executed by the function of the voice chat communication execution module 61 of the voice chat program 60. FIG. 14 shows an example of the voice chat screen 70C displayed on the terminal device 30 of the inviting user at this time. As illustrated, in the main area 72, a user icon 96 corresponding to the voice chat request source user (user X) is displayed. In addition, in the stamp area 76, a list of information on voice stamps held by the request source user who is a member of the voice chat (chat unit) is displayed. Also in the terminal device 30 of the request source user, a voice chat screen 70C similar to the voice chat screen 70C illustrated in FIG. 14 is displayed.

  Thus, when voice chat communication between the terminal device 30 of the request source user and the terminal device 30 of the invite user is enabled, the request source user and the invite user can execute voice chat. Specifically, voice data of voice input via the microphone 33a of the terminal device 30 of each user is transmitted to the terminal device 30 of another user and voice-outputted from the speaker 33b.

  On the other hand, when the inviting user accepts the invitation to the voice chat and enters an executable state where the voice chat can be executed, if the request source user is not in the executable state, the terminal device 30 of the requesting user and Voice chat communication with the terminal device 30 of the inviting user is not possible. FIG. 15 shows an example of the voice chat screen 70C displayed on the terminal device 30 of the inviting user at this time. As illustrated, in this case, the user icon 96 corresponding to the request source user (user X) displayed in the main area 72 has a display mode (for example, grayed out display) indicating that it is not in the executable state. As a case where the request source user is not in the executable state when the invitation user accepts the invitation to the voice chat, for example, the request source user logs off after making a request to start the voice chat (program 60 for voice chat If, for example, voice chat with another user (voice chat in another chat unit) is started, etc. may be considered.

  In one embodiment, the notification information transmission unit of the server 10 when the requesting user is not in the executable state when the inviting user accepts the voice chat invitation and the voice chat can be executed. At 52, a push notification regarding acceptance of the invitation by the inviting user is issued to the terminal device 30 of the request source user. Then, the terminal device 30 of the request source user who has received the push notification may perform an operation according to the state of the request source user when the push notification is received. For example, a notification display indicating that a push notification regarding acceptance of an invitation has been received is displayed by the function of the operating system, or that a push notification regarding acceptance of an invitation has been received is displayed in the stream area 74 of the voice chat screen 70C.

FIG. 16 shows a request source when the request source user performs voice chat with another user (user D and user F in this example) when the invitation user accepts the voice chat invitation. It is an example of 70 C of audio | voice chat screens displayed on the terminal device 30 of a user. As illustrated, in the stream area 74 of the voice chat screen 70C, the fact that the push notification regarding acceptance of the invitation has been received is displayed, and more specifically, the content (the number of notifications) of the newly arrived notification number area 74a is updated. The user image 74b of the inviting user (user B) who accepted the invitation is displayed together with the text "accepting invitation". When the request source user selects the user image 74b in the stream area 74 (or flicks the main area 72), the main area 72 is an invited user (user B), as illustrated in FIG. Switch to the display of information about voice chat (chat unit). At this stage, the requesting user is not in the state of being able to execute voice chat with the invited user, and voice chat with other users (user D and user F) is continued, and the user of the main area 72 is The icon 92 is a display (inactive state display) corresponding to the ineffective state (mute state) of the microphone 33a.

  Then, when the request source user selects the microphone icon 92 in the invalid state display, the microphone icon 92 becomes a display (active state display) corresponding to the valid state (non-mute state) of the microphone 33a, and the request source user is an invited user. The voice chat with (user B) becomes executable (it participates in the voice chat with the inviting user (user B)). That is, the state monitoring unit 53 of the server 10 updates the chat unit information management table 51b so that the request source user can be put into an executable state where voice chat (chat unit) with the invited user (user B) can be performed. Do. Specifically, the "executable flag" of the request source user in the "member information" of the corresponding chat unit is changed to a value indicating that the execution is possible. Also, the voice chat that the request source user is executing with other users (user D and user F) is not in the executable state, and the “executable flag” of the request source user in the “member information” of the corresponding chat unit is It is changed to a value indicating that it is not executable. Then, when the invitation user is still in the executable state, both the request source user and the invitation user are in the executable state, and the terminal device of the request source user is operated by the function of the voice chat control unit 54 of the server Voice chat communication between the T.30 and the terminal device 30 of the inviting user is enabled.

  Thus, in one embodiment, the chat unit displayed in the main area 72 of the voice chat screen 70C is switched by flick operation or the like, and the microphone icon 92 is selected (switching of the display of the valid state / the display of the invalid state). Thus, the user of the terminal device 30 selects (switches) a chat unit (that is, a chat unit for executing (joining) a voice chat) in an executable state. In other words, the state monitoring unit 53 of the server 10 transmits the data transmitted from the terminal device 30 so that the chat unit selected by the user via the operation of the terminal device 30 (voice chat screen 70C) becomes an executable state. The "executable flag" of the chat unit information management table 51b is updated based on the above.

  Here, in one embodiment, after a voice chat is newly started (after creating a chat unit), members of the chat unit can also newly invite the user. In this case, with respect to the new invitation user, the same operation as the operation regarding the invitation user at the time of newly starting the voice chat described above is performed. Specifically, for example, when the user selects the invitation icon 94 arranged in the main area 72 of the voice chat screen 70C described above, the friend list screen 80 illustrated in FIG. 8 is overlaid and displayed. Then, when a desired user to be newly invited is selected from the friends displayed in the list, a transition is made to the friend detail screen 70B illustrated in FIG. 9, and the list is displayed in the stamp area 76 of the friend detail screen 70B. By selecting any of the voice stamps, a request for invitation (request for invitation) can be made to the voice chat (chat unit) of the selected user. The state monitoring unit 53 of the server 10 having received the invitation request from the terminal device 30 updates the “member information” of the chat unit information management table 51b so that the new invitation user becomes a member of this chat unit, A push notification regarding an invitation to a voice chat is issued to the terminal device 30 of the inviting user. The subsequent operation is similar to the operation at the start of a new voice chat. For example, when a new invited user accepts an invitation to a voice chat, this new invited user can execute this voice chat. It becomes an executable state.

  Here, in one embodiment, each user can request the terminal device 30 of another user to reproduce a voice stamp in a chat unit of which he is a member. Specifically, for example, when a desired voice stamp is selected from the voice stamps listed in the stamp area 76 of the voice chat screen 70C, the identification information of the selected voice stamp is, for example, via the server 10. The audio stamp (audio file) transmitted to the terminal device 30 of the other user and identified by the audio stamp identification information is reproduced on the terminal device 30 of the other user.

  In one embodiment, a request to play the selected voice stamp may be made to all of the other users who are members of the chat unit, or the user is selected from among the members of the chat unit. It may be performed for one or more other users. Further, in the case where the reproduction request of the voice stamp is issued to a plurality of other users, it is possible that some of the other users do not have the selected voice stamp. In this case, the voice stamp stored in the server 10 may be acquired and reproduced (streaming reproduction, download reproduction, etc.) in the terminal device 30 of another user. Alternatively, each user may be able to acquire from the server 10 voice stamps possessed by other users who are members of the chat unit and store them in the terminal device 30 automatically or in response to an operation by the user.

  Further, in one embodiment, the voice stamp reproduction request is a member of the voice chat who is participating in the voice chat and another user who is participating in the voice chat (a user who is in an executable state) and the voice chat. It can be done for other users (users who are not in an executable state). FIG. 18 shows an example of the voice chat screen 70C displayed on the terminal device 30 of another user who requests the other user participating in the voice chat to play back the voice stamp. In this case, in the lower right corner of the user icon 96 corresponding to the reproduction request source user, information on the audio stamp requested to be reproduced (in this example, the audio icon 97) is displayed. Notify receipt of playback request. Then, when the user icon 96 including the voice icon 97 is selected by the user, the voice stamp (voice file) is reproduced on the terminal device 30. Here, in one embodiment, if the user has received a request to play another audio stamp prior to selecting the user icon 96 to play the corresponding audio stamp, the last received audio of the playback request is received. A stamp voice icon 97 is displayed, and when the user selects the user icon 96, a plurality of unplayed voice stamps are played back continuously. In addition, the terminal device 30 may output a predetermined alarm sound at the timing when the reproduction request of the voice stamp is received (for example, when information on the voice stamp (voice icon 97) is displayed). Furthermore, even if there is no action of the user such as selection of the user icon 96, the voice stamp may be reproduced.

  FIG. 19 shows an example of the voice chat screen 70C displayed on the terminal device 30 of another user who requests the other user not participating in the voice chat to play back the voice stamp. In this case, in the main area 72 displaying information on an active (participating) voice chat (chat unit), a reception notification 98 indicating reception of a voice stamp reproduction request from another voice chat member is displayed. Be done. In one embodiment, the receipt notification 98 displays information (e.g., a user image) about the user who requested the reproduction of the audio stamp and information (e.g., an audio icon) related to the audio stamp requested to be reproduced. When the user selects this reception notification 98, the main area 72 switches to the display of the corresponding chat unit (the chat unit for which the reproduction request source user has made the reproduction request of the voice stamp) as illustrated in FIG. . Then, when the user selects the user icon 96, the voice stamp is reproduced on the terminal device 30. As can be seen from the disabled state display of the microphone icon 92 in FIG. 20, at this stage, participation in the voice chat (chat unit) in which the other user who played the voice stamp was participating continues. When the other user selects the microphone icon 92, the voice chat to be joined is switched.

Also, in one embodiment, each user may request other members of the voice chat (chat unit) who are members of the voice chat not to participate to play back the voice stamp. For example, in the voice chat screen 70C of FIG. 20, without switching the voice chat to select and participate in the microphone icon 92, a voice is sent to another user (user B in this example) who is a member of the voice chat. Reproduction of the stamp can be requested.

  Thus, in one embodiment, within the members of the chat unit, regardless of the state of participation in the voice chat, reproduction of the voice stamp on the terminal device 30 of the other user (when viewed from the user, to the other user) You can also say "send" the audio stamp. For example, in a chat unit participating, communication by speech stamps can be enjoyed together with communication by speech via the microphone 33a. In addition, for example, it is possible to enjoy communication by utterance in a chat unit to participate, and to enjoy communication by an audio stamp in a chat unit not to participate. Furthermore, for example, even in an environment where the user can not speak, it is possible to enjoy the communication by the voice stamp.

  In the embodiment described above, the voice stamp to be reproduced on the terminal device 30 of the inviting user is selected when the voice chat start request is made, but only the inviting user is selected without selecting the voice stamp. A voice chat start request may be made by making a selection.

  In the above-described embodiment, the voice stamp owned by the user is stored in the terminal device 30 of the user and also redundantly stored in the server 10, but the storage destination of the voice stamp is limited to this. I will not. For example, it may be stored in only one of the terminal device 30 and the server 10 of the user, or may be stored in another device. In the case where the voice stamp is not stored in the terminal device 30 of the user, when the voice stamp is reproduced, it may be acquired from the device in which the voice stamp is stored and reproduced. Furthermore, the reproduction request of the voice stamp stored in the terminal device 30 of the user of the reproduction request source can also be made to other users. In this case, the voice stamp (voice file) itself stored in the terminal device 30 of the requesting user may be transmitted to the terminal device 30 of the other user.

  In the embodiment described above, the invitation user selects whether to accept or decline the invitation to the voice chat through the invitation notification screen 110, but acceptance of the invitation is performed using the voice stamp. It can also be For example, the inviting user may accept the invitation by transmitting a voice stamp to the requesting user of the invitation (requesting the requesting user of the invitation to play the audio stamp). That is, for example, when a voice chat start request is made and when a user is newly invited after voice chat is started, a voice stamp (for example, a voice stamp owned by the inviting user) is sent to the inviting user. After that, when the invitation user returns a voice stamp (sends a voice stamp to the invitation request source user), it determines that the invite user has accepted the invitation to the voice chat, and This voice chat (chat unit) can also be made executable.

  In the system 1 according to the embodiment described above, the terminal device 30 of the user (in the executable state) participating in the chat unit among the plurality of users who are members of the chat unit realizes the voice chat in the chat unit. Voice chat communication is performed, and the terminal device 30 of one user who is a member of this chat unit is directed to the terminal device 30 of the other user who is a member of this chat unit based on the instruction of this one user. The reproduction of the audio file is requested, and the terminal device 30 of the other user reproduces the audio file in response to the request for reproduction of the audio file. Therefore, the user can enjoy communication using a voice stamp (voice file) in addition to communication by speech via the microphone 33a. That is, in the voice chat, the system 1 according to an embodiment can enable communication by voice other than the user's speech or the like.

  In one embodiment, when the inviting user accepts the invitation to the voice chat, the inviting user is put into an executable state capable of executing the voice chat (chat unit), but the invitation user becomes an executable state. The opportunity is not limited to this. For example, in response to the invitation user displaying, browsing, or confirming the notification information that is pushed from the server 10, the invitation user may be made executable. Furthermore, regardless of the presence or absence of the action on the notification information that is pushed from the server 10, the invited user may be in the executable state.

  Furthermore, when a voice chat is newly started, without performing a push notification to the terminal device 30 of the invitation user invited to the voice chat, between the terminal device 30 of the request source user and the terminal device 30 of the invitation user It is also possible to immediately enable voice chat communication.

  That is, in another embodiment of the present invention, when the voice chat start request is received from the terminal device 30, the state monitoring unit 53 of the server 10 first performs an executable state in which the invitation user can execute a new voice chat. Determine if there is. For example, in the state where the invited user is logged in to the voice chat service (can be determined by referring to the “login status” in the user information management table 51a), and the voice chat with other users (other chat unit If the invited user is in an executable state in which the new voice chat can be executed if the voice chat in (a) can not be performed (it can be determined with reference to the chat unit information management table 51b) Can. Then, when it is determined that the invited user is in an executable state capable of executing a new voice chat, the state monitoring unit 53 of the server 10 sets both the request source user and the invited user as the executable state. Are set (a new record is created in the chat unit information management table 51b). Thereafter, by the function of the voice chat control unit 54, voice chat communication between the request source user's terminal device 30 and the invitation user's terminal device 30 becomes immediately possible. In another embodiment, when it is determined that the invitation user is not in an executable state capable of executing a new voice chat, the push notification to the terminal device 30 of the invitation user is performed as in the above-described one embodiment. To be done.

  In another embodiment, when it is determined that the invitation user is in an executable state capable of executing a new voice chat and voice chat communication is immediately enabled, the microphone of the terminal device 30 of the invitation user at the start of the voice chat 33a may be in an invalid state. Thereafter, for example, when the inviting user selects the microphone icon 92 of the voice chat screen 70C, the microphone 33a is put into an enabled state.

  In another embodiment, when the inviting user is in an executable state capable of executing a new voice chat, the terminal device 30 of the requesting user and the inviting user are requested after the start request of the voice chat from the requesting user. Since voice chat communication with the terminal device 30 is immediately available, the user can easily initiate voice chat with other users.

  In the embodiment described above, when the user is in a state of performing voice chat, voice chat with another user (voice chat in another chat unit) can not be performed (it is not possible to be executable). Although described, it is also possible to simultaneously perform voice chat communication of a plurality of voice chats (a plurality of chat units) with different members. In this case, for example, in response to the start of a new voice chat, the volume of the voice chat in progress may be reduced. Specifically, for example, with the function of the voice chat control unit 54, the volume of voice data corresponding to each voice chat (chat unit) can be adjusted. In this way, even when the user is in a state of voice chat, another voice chat (chat unit) can be started immediately.

  The processes and procedures described herein may be implemented by software, hardware, or any combination thereof other than those explicitly described in the embodiments. More specifically, the processes and procedures described herein may be implemented by implementing logic corresponding to the process on a medium such as an integrated circuit, volatile memory, non-volatile memory, magnetic disk, optical storage, etc. Is also realized. In addition, the processes and procedures described in this specification can be implemented as computer programs of the processes and procedures and can be executed by various computers.

  Even though the processes and procedures described herein may be described as being performed by a single device, software, component, module, such processes or procedures may be implemented in multiple devices, multiple software, multiple , And / or modules. Also, even though it is stated that the data, tables or databases described herein are stored in a single memory, such data, tables or databases are provided on a single device. It may be distributed and stored in a plurality of memories or a plurality of memories distributed and arranged in a plurality of devices. Furthermore, the software and hardware elements described herein may be implemented by integrating them into fewer components or by breaking them into more components.

  In the present specification, when a component of the invention is described as one or more or one or more without limitation, it is necessary to be understood in context. Except for the above, the component may be either singular or plural.

10 Server 30 Terminal Device 51 Information Storage Unit 52 Notification Information Transmission Unit 53 Condition Monitoring Unit 54 Voice Chat Control Unit 60 Voice Chat Program 70 Voice Chat Service Screen 70 A Voice Chat Service Screen (Initial Screen)
70B Voice chat service screen (friend details screen)
70C Voice chat service screen (voice chat screen)
80 Friend list screen 100 Home screen 110 Invitation notification screen

Claims (5)

A program for enabling voice chat between users of a plurality of terminal devices, said program being executed on a terminal device of a first user among the plurality of terminal devices, said terminal device comprising:
The other user of the terminal device start request which requests start of the voice chat communications the first user and other users to realize the voice chat chat unit is a unit for running a member der Ruoto voice chat Processing received from
A process of executing voice chat communication in the chat unit in response to receiving the start request ;
A process of identifying an audio file based on audio file identification information included in the start request, and reproducing the identified audio file;
To run
program. The program according to claim 1, wherein the member in the chat unit includes a participating user participating in a voice chat in the chat unit and a non-participating user not participating in a voice chat in the chat unit,
The terminal device of the first user is a terminal device of the participating user,
program.   In the execution of the voice chat communication, voice data of voice input through the voice input unit of the terminal device of the first user is transmitted to the terminal device of the other user, and the terminal device of the other user The program according to claim 1, further comprising: receiving audio data of audio input via the audio input unit. The terminal device of the first user requests the terminal device of the other user to reproduce the other audio file selected by the first user. Described program. A program for enabling voice chat between users of a plurality of terminal devices connected to a server, said program being executed on a terminal device of a first user among the plurality of terminal devices. To the terminal
First user and other users is a member, from the terminal device of the other user start request which requests start of the voice chat communication to realize a voice chat definitive chat unit is a unit for executing a voice chat The process to receive,
A process of executing voice chat communication in the chat unit in response to receiving the start request ;
The voice stored in the server is specified when a voice file is specified based on voice file identification information included in the start request, and the specified voice file is not stored in the terminal device of the first user. get the file, to play the voice file that has been acquired,
program.

Images