JP2022185174A - Message service providing method, message service providing program and message service system - Google Patents

Abstract

To solve such a problem that an attraction and a value as sound contents are not provided well to a user since conventional techniques about sound content contribution is just a technique configured for convenience of contributing contents and is not text-based or image-based, and the sound contents have poor visibility.MEANS FOR SOLVING THE PROBLEM: A method of providing a message service that can contribute a plurality of sound messages constituted within a prescribed time via the network comprises the steps of: acquiring user information being information for identifying a user; acquiring sound by linking it with the user information of the user being an acquisition source; displaying a sound reproduction UI being an interface for enabling reproduction of the acquired sound; and outputting, upon reception of selection of the sound reproduction UI, the sound according to the received selection.SELECTED DRAWING: Figure 2

Description

The present invention relates to a message service providing method, providing program, message service system, etc., capable of posting a plurality of voice messages composed within a predetermined time via a network.

2. Description of the Related Art Conventionally, techniques for promoting various communications through social network services (SNS) and the like have been known.

In such services, text-based and image (moving image)-based information has been transmitted and received in the past, but recently, voice-based posting services have been developed and related technologies have been disclosed. It has reached the point where For example, Patent Literature 1 discloses a technique of recording a voice call and publicly posting the recorded data as voice content on social media with the consent of the other party.

Japanese Patent Application Laid-Open No. 2020-052794

However, the prior art described in Patent Literature 1 is merely a technique for facilitating the posting of content, and it cannot be said that it provides a suitable presentation means for users who come into contact with posted content. I wanted to That is, since the audio content itself is not text-based or image-based and lacks visuality, it is difficult to say that the attractiveness and value of the audio content have been successfully provided to the user.

In order to solve the above problems, the present invention provides a method for providing a message service system capable of posting a plurality of voice messages configured within a predetermined time via a network, wherein information identifying a user A user information acquisition step of acquiring user information, a voice acquisition step of acquiring voice in association with the user information of the user who is the acquisition source, and a voice playback UI that is an interface for enabling playback of the acquired voice , a selection receiving step of receiving a selection of an audio playback UI, and a voice outputting step of outputting voice according to the received selection.

Also, in relation to the above method, a method is proposed in which the voice acquisition step further includes an edit acquisition sub-step of editing the acquired voice according to the playback time length of the acquired voice.

Also, in relation to the above method, a method is proposed in which the voice output step further includes a time-series output substep of sequentially outputting the plurality of posted voice messages.

Further, in relation to the above method, when receiving a selection in the selection receiving step, the method further includes a pre-processing step of performing acoustic processing of the selected voice according to the user information of the user who made the selection, and a voice outputting step However, it also proposes a method having a processed audio output sub-step that outputs the audio processed in the pre-processing step.

In addition, in relation to the above method, the method further includes a characterization processing step of recognizing the acquired voice and converting a part or all of it into characters, and the UI display step includes character data processed in the characterization processing step. Also proposed is a method that further includes a character display substep for displaying a voice playback UI.

We also propose programs and systems for realizing the above method.

With the present invention, which mainly has the configuration described above, it is possible to improve the visibility of posted audio content for many users.

Schematic diagram of the system of the invention FIG. 2 is a diagram showing an example of functional blocks of the system of Embodiment 1; Schematic diagram showing an example of a configuration when each functional configuration of the system of Embodiment 1 is collectively realized as one piece of hardware. FIG. 4 is a diagram showing an example of the flow of processing in the system of the first embodiment; FIG. 11 is a diagram showing an example of functional blocks of the system of the second embodiment; A diagram showing an example of the flow of processing in the system of the second embodiment. FIG. 11 is a diagram showing an example of functional blocks of the system of Embodiment 3; A diagram showing an example of the flow of processing in the system of the third embodiment. FIG. 11 is a diagram showing an example of functional blocks of the system of Embodiment 4; A diagram showing an example of the flow of processing in the system of the fourth embodiment. FIG. 11 is a diagram showing an example of functional blocks of the system of Embodiment 5; A diagram showing an example of the flow of processing in the system of the fifth embodiment.

First, FIG. 1 is shown. FIG. 1 is a diagram showing an outline of the present invention. As shown in the figure, the present invention can be realized by a computer 0121 and a server 0131 connected to a plurality of smartphones 0101, 0102, 0111, tablets 0112, and other terminals via a network. Since the present invention has a technical feature in audio reproduction, each of the smart phones and tablets must be equipped with some kind of audio output interface. In that sense, the type of terminal is not particularly limited as long as it has such an interface, and may also include, for example, smart glasses, smart watches, AR/VR goggles, and the like. In addition, the computer 0121 and the server 0131 may constitute one system as a whole in the form of so-called cloud computing in which they are connected and cooperated via a network as shown in FIG. Of course, it may be constructed integrally with.

Each embodiment of the present invention will be described below with reference to the drawings. First, mutual relationships between the embodiments and the claims are as follows. First, Embodiment 1 mainly corresponds to claims 1, 6, 7, and the like. Embodiment 2 mainly corresponds to claim 2 and the like. Embodiment 3 mainly corresponds to claim 3 and the like. Embodiment 4 mainly corresponds to claim 4 and the like. Embodiment 5 mainly corresponds to claim 5 and the like.

In addition, the present invention is not limited to these embodiments at all, and has the technical idea described in each claim of the claims according to common general technical knowledge, and various can be implemented in any manner.

<<Embodiment 1>>
<Overview>
FIG. 2 is a diagram showing an example of functional blocks of the message service providing system of this embodiment. As shown in the figure, the ``message service providing system'' 0200 of this embodiment includes a ``user information acquisition unit'' 0201, a ``voice acquisition unit'' 0202, a ``UI display unit'' 0203, and a ``selection unit'' 0203. It has a reception unit 0204 and an audio output unit 0205 .

In addition, the message service providing system described in detail below can also be configured so that one or more of its functions are realized by a plurality of devices, and the functional blocks are either hardware or It can be implemented as software. Taking a computer as an example, CPU, main memory, GPU, TPU, image memory, bus, secondary storage device (hard disk or non-volatile memory), keyboard, microphone, touch panel, electronic pen for touching the touch panel Various input devices such as, speakers, displays and other various output devices, hardware components such as other external peripheral devices, interfaces for external peripheral devices, communication interfaces, and driver programs for controlling those hardware and other application programs.

Then, by arithmetic processing according to the program developed on the main memory, data input from input devices and other interfaces and held in memory and hardware are processed and accumulated, and each hardware and software described above is processed and accumulated. Create commands to control. Here, the above program may be realized as a plurality of modularized programs, or may be realized as one program by combining two or more programs by cloud computing or other methods.

<Functional configuration>
Each functional block constituting the message service providing system of this embodiment is configured to provide a message service capable of posting a plurality of voice messages constructed within a predetermined time via a network. Specifically, it is a service that can be used by multiple users, and by enabling each user to post voice messages, the multiple users can communicate interactively on the service. It is conceivable to configure it as a service. The interactive communication can be viewed by all or some of the users who use the service, and the range of users who can view it can be appropriately set by each user.

Although the message service providing system of the present embodiment is technically characterized in that voice messages can be posted, information that can be posted is not limited to voice messages. In addition to voice messages, it is also possible to post text, images, and videos together with voice messages or selectively. It becomes possible to provide an environment for

A 'user information acquisition unit' 0201 is configured to acquire user information, which is information for identifying a user. The user identification information is generated or acquired in response to an application for using the message service providing system of this embodiment via a terminal managed by the user. Specifically, in addition to the case where an ID arbitrarily set by the user or the system is used as user information, the user's name, email address, SNS account, face photo, profile and other user information acquired in association with the ID Information that can be used to identify can also be treated as user information here.

For example, when a user requests to use a service, the user information acquisition unit acquires user information when performing login processing by operating the terminal in advance. A configuration may be adopted in which user information is acquired each time a request for use is made, or once a login process is performed and user information is acquired, the acquired user information may be used to make it possible to use the service for a predetermined period of time. good too.

The 'speech acquisition unit' 0202 is configured to acquire the speech in association with the user information of the user who is the acquisition source. As a specific aspect of voice acquisition, it is conceivable to acquire the voice uttered by the user via a microphone provided in a terminal managed by the user. In addition, it accepts transmission of audio data recorded in advance on the user terminal, or reads and acquires audio data that has been received in advance from the user terminal, etc., and has been acquired by this system or an external content server. Configurations are also conceivable.

In addition to the voice, the voice acquisition unit also acquires the date and time when the voice was acquired, the time length of the acquired voice, the frequency, the wavelength, the association with a specific user, and other voice-related information that is associated with the voice. is possible. By adopting a configuration in which the UI display unit, which will be described later, displays an audio UI using also the audio-related information, it becomes possible for the user to more easily recognize the characteristics of the audio.

It should be noted that, when acquiring audio from the user, the user may be allowed to set in advance the time or time during which the audio can be reproduced, and information related to the setting may be acquired as the audio-related information. If this configuration is adopted, for example, when it is desired to send a birthday message to a certain user, or to send a predetermined message just before a specific schedule, voice is acquired in advance by the voice acquisition unit. , it is also possible to acquire the time or time when those sounds can be played as sound related information, and based on this information, it is possible to display the sound playback UI in the UI display unit described later, so it is timely It becomes possible to guarantee the opportunity of voice reproduction.

Furthermore, a configuration may be adopted in which the acquired voice is erased as data after a certain period of time (for example, 24 hours) has elapsed after acquisition. In many cases, careful handling of voice data is required, such as the fact that it is easy to identify the individual who entered the voice data based on its content, tone of voice, and other factors. From the point of view, it becomes possible to prompt voice input safely and securely.

Also, in the voice acquisition unit, it is possible to acquire a plurality of voices in advance from one user. How to process the plurality of sounds can be appropriately set, and a specific example thereof will be described in the third embodiment.

The 'UI display unit' 0203 is configured to display an audio playback UI, which is an interface for enabling playback of acquired audio. As an example of the voice playback UI display here, it is conceivable to display a button or other icon on the screen of the terminal for enabling playback of the acquired voice.

In addition, in the UI display unit, when the audio-related information acquired together with the audio is associated with a specific user, the audio playback UI is displayed only for the associated specific user. It is also possible to control By adopting this configuration, for example, for audio with private content, it is possible to perform processing such that the audio playback UI is displayed only for a specific user. It is possible to avoid the risk of voice data leaking out of range.

Here, the audio playback UI whose selection is accepted by the selection acceptance unit described later and the audio playback UI linked to the audio output by the audio output unit described later may be similarly displayed on the user terminal. However, after each process is performed once or a predetermined number of times, or after a certain period of time (for example, 24 hours) has passed, the UI display unit may be controlled so as not to be displayed on the user terminal. The number of times each process is performed for hiding can be made selectable by the user who is the audio acquisition destination. By adopting this configuration, it becomes possible to give scarcity to voices and to set charging or other incentives for the provision of such voices.

Furthermore, in order to preferentially reproduce the most recently acquired audio, a configuration may be considered in which the audio reproduction UI is displayed in a manner such as performing pop-up display processing or the like. By adopting this configuration, it is possible to provide the most "seasonal" audio information with a message that "should be listened to" visually as well as preferentially, and it is possible to further improve the viewing motivation of the output destination user. .

The 'selection reception unit' 0204 is configured to receive selection of the audio reproduction UI. Specifically, it is conceivable to accept the selection of the audio reproduction UI by tapping or clicking the button or other icon described above. Here, the selection reception unit can also receive a selection of an audio output mode from the user together with the selection of the audio reproduction UI. Specifically, the size of voice output, the time length or output range of voice output (for example, output only for a predetermined time at the beginning, etc.), designation of the output destination terminal, etc. can be set to be selectable as a mode of voice output. Conceivable. By adopting this configuration, it becomes possible to meet the convenience of not only the user who transmits the voice but also the user who receives the voice.

The 'audio output unit' 0205 is configured to output audio according to the received selection. Here, according to the received selection, it is not limited to simply outputting the selected sound, but the output mode of how to output the sound is also controlled according to the received selection. means to get According to the above example, it is conceivable to output the selected voice at the selected volume, to output only the selected range, or to transmit and output to the specified terminal. be done. By adopting this configuration, it is possible to select a smart speaker that does not have a display function as an audio output destination and output audio from that device, so it will differ depending on the user's environment and timing. It is possible to enjoy audio output in various situations.

Here, it is conceivable that after the voice is output, processing is performed on the user terminal to enable communication with the user who is the output source of the voice. For example, it is conceivable to display a button for starting a call, or to start a voice input program that accepts a voice instruction as to whether or not to request a call. It is possible to appropriately set at what timing the processing for enabling a call is performed. It is preferable that the process is performed at an opportunity when the user feels that it might be quicker to talk. By adopting this configuration, it is possible to provide a suitable one among various communication means according to the situation.

<Specific configuration>
FIG. 3 is shown here. This figure is a schematic diagram showing an example of a configuration when each functional configuration of the message service providing system of the present embodiment is collectively realized as one piece of hardware. Each device has a ``CPU'' 0301, a ``storage device (storage medium)'' 0302, a ``main memory'' 0303, an ``input interface'' 0304, and an ``output interface'' 0305 for executing various kinds of arithmetic processing. , and a “network interface” 0306, and transmits and receives information to and from external peripheral devices such as a “touch panel” 0307 and a “display” 0308 via input/output interfaces. Information may also be transmitted and received to and from external devices such as a plurality of "user terminals" 0309 and "content servers" 0310 via a network interface. The specific aspect of this network interface may be wired or wireless, and the communication method may be direct or indirect. Therefore, it is possible to adopt a form of so-called cloud computing in which information is transmitted and received between a specific external device or a user of the same device and a server managed by a third party.

Various programs as described below are stored in the storage device, and the CPU reads these various programs into the work area of the main memory, expands them, and executes them. These components are interconnected by a data communication path such as a "system bus" 0399, and perform information transmission/reception and processing (the basic configuration of the above configuration can be used by any of the other devices described below). The same is true for

(Specific Configuration of User Information Acquisition Unit)
The user information acquisition unit is composed of a computer program and computer hardware. Acquire information and store it at a predetermined address in the main memory.

(Specific Configuration of Voice Acquisition Unit)
The speech acquisition unit is composed of a computer program and computer hardware. Acquire the voice by attaching it and store it at a predetermined address in the main memory.

(Specific configuration of UI display unit)
The UI display unit is composed of a computer program and computer hardware. Specifically, the CPU reads a "UI display program" 0340 from the storage device into the main memory and executes it, and outputs the sound acquired by executing the sound acquisition program. A process for displaying an audio playback UI, which is an interface for enabling playback on the user terminal, is performed on the user terminal.

(Specific configuration of the selection reception unit)
The selection reception unit is composed of a computer program and computer hardware. Specifically, the CPU reads out a "selection reception program" 0350 from the storage device into the main memory and executes it, and executes the UI display program to display the audio reproduction UI. is displayed, the selection of the audio reproduction UI is accepted.

(Specific configuration of audio output unit)
The audio output unit is composed of a computer program and computer hardware. Specifically, the CPU reads out the "audio output program" 0360 from the storage device to the main memory and executes it. In response, the voice data acquired by executing the voice acquisition program is read, and the voice is output.

<Process flow>
FIG. 4 is a diagram showing an example of the flow of processing in the message service providing system of this embodiment. The flow of processing in the figure consists of the following steps. First, in step S0401, user information that identifies a user is acquired (user information acquisition step). Then, in step S0402, the voice is acquired in association with the user information of the user who is the acquisition source (sound acquisition step), and in step S0403, the voice playback UI, which is an interface for enabling playback of the acquired voice, is displayed. (UI display step). After that, in step S0404, selection of the audio reproduction UI is accepted (selection acceptance step), and in step S0405, audio is output according to the accepted selection (audio output step).

<effect>
By using the message service providing system that employs the above configuration, it is possible to improve the visibility of posted audio content for many users.

<<Embodiment 2>>
<Overview>
The message service providing system of this embodiment basically has the same technical features as the message service providing system described in Embodiment 1, but when acquiring voice, It has a further feature in that it edits the .

<Functional configuration>
FIG. 5 is a diagram showing an example of functional blocks of the message service providing system of this embodiment. As shown in the figure, the 'message service providing system' 0500 of this embodiment includes a 'user information acquisition unit' 0501, a 'speech acquisition unit' 0502, a 'UI display unit' 0503, and a 'selection unit' 0503. It has a reception section 0504 and a 'speech output section' 0505 , and the speech acquisition section further has an 'edit acquisition means' 0512 . Since the basic configuration is the same as that of the message service providing system described with reference to FIG. 2 of Embodiment 1, the function of the 'edit acquisition means' 0512, which is the difference, will be described below.

The 'edit acquisition means' 0512 is configured to edit the acquired audio according to the reproduction time length of the acquired audio in the audio acquisition unit. Specifically, if the reproduction time length of the sound to be acquired is longer than a predetermined time, it is conceivable to perform editing processing for cutting out a part of the sound. More specifically, it is conceivable to perform an editing process of cutting out only a part of the beginning (for example, within 10 seconds), and then acquire the edited audio.

In addition, for example, when the reproduction time length of the voice to be acquired is longer than a predetermined length of time, it is conceivable to perform editing processing to speed up the pitch of the voice so that the voice has the predetermined length of time. By adopting this configuration, the message can be heard within a predetermined time, which is convenient for busy users.

After editing, it is conceivable to store both the pre-edited audio and the edited audio in association with each other. Acquiring and outputting the voice processed in this way enables the acquisition of a relatively long voice by the voice acquisition unit, with a time length that is more intuitively recognizable. Audio can be output to make it comprehensible.

The timing at which the audio is edited by the edit acquisition means may be the timing at which the audio is acquired by the audio acquisition section, or the timing after the selection reception section accepts the selection and before the audio output by the audio output section. It can be timing.

Further, when the audio is edited, it is assumed that the audio output unit outputs the edited audio, but a separate configuration that enables the output of the pre-edited audio may be provided. In this case, for example, once the edited sound is output, and furthermore, when information is received indicating that the output sound before editing is desired to be output, the pre-edited sound is output again. By adopting this configuration, it is possible to satisfy the user's demand, such as listening to the edited voice at the beginning to understand the outline, and later listening to the unedited voice again when there is time. becomes possible.

Up to this point, in the edit acquisition means, the process of editing the sound based on a specific function has been explained. Of course, it may be configured to edit the . By adopting this configuration, the user can extract and output the most suitable part for him/herself from the input voice information.

<Specific configuration>
The hardware configuration of each device constituting the message service providing system of this embodiment is basically the same as the hardware configuration of the message service providing system of the first embodiment described with reference to FIG. Therefore, in the following, specific processing of the "edit acquisition means", which has not been explained so far, will be explained.

(Specific Configuration of Editing Acquisition Means)
The edit acquisition means is specifically composed of a computer program and computer hardware, and when executing the voice acquisition program, the CPU reads out an "edit acquisition subprogram" from the storage device to the main memory and executes it to obtain the voice to be acquired. The audio is edited according to the playback time length and stored at a predetermined address in the main memory.

<Process flow>
FIG. 6 is a diagram showing an example of the flow of processing in the message service providing system of this embodiment. The flow of processing in the figure consists of the following steps. First, in step S0601, user information that identifies the user is acquired (user information acquisition step). Then, in step S0602, the audio is edited according to the playback time length of the audio in association with the user information of the user who is the acquisition source (audio acquisition step). to display an audio reproduction UI, which is an interface of (UI display step). After that, in step S0604, selection of the audio reproduction UI is accepted (selection acceptance step), and in step S0605, audio is output according to the accepted selection (audio output step).

<effect>
By using the message service providing system of the present embodiment, it is possible to grasp the contents of voice more intuitively than in the case of using the message service providing system of the first embodiment.

<<Embodiment 3>>
<Overview>
The message service providing system of this embodiment basically has the same technical characteristics as those of the message service providing system described in the first and second embodiments. It is characterized by continuous output.

<Functional configuration>
FIG. 7 is a diagram showing an example of functional blocks when the message service providing system of this embodiment is realized by one computer (device). As shown in the figure, the 'message service providing system' 0700 of this embodiment includes a 'user information acquisition unit' 0701, a 'speech acquisition unit' 0702, a 'UI display unit' 0703, and a 'selection unit' 0703. It has a "reception unit" 0704 and a "voice output unit" 0705, and the voice output unit has a "time-series acquisition means" 0715 on its plate. Since the basic configuration is the same as that of the message service providing system described with reference to FIG. 2 of Embodiment 1, the function of the "time-series output means" 0715, which is the difference, will be described below.

The 'time-series output means' 0715 is configured to sequentially output a plurality of posted voice messages in the voice output unit. Here, "in order" may be based on a plurality of voice messages posted by a specific poster, or may be based on a plurality of voice messages posted by a plurality of posters. Regarding "continuously in order", regardless of the poster, it may be configured to output continuously in the order of posting, that is, in the order of the oldest posting date and time, or multiple posts for one poster. It may be configured such that only the voice messages that have been posted multiple times are sequentially output in chronological order of posting date and time. By adopting this configuration, the user does not have to operate for voice output one by one, and voice output is performed continuously, providing an environment as if the user were trying to communicate with the contributor. becomes possible.

Further, here, a configuration may be adopted in which whether or not to include the voice message in the order of output in "in order" is controlled depending on whether or not the voice message has been voice-output once. In other words, if there is a voice message that has already been output once among a plurality of voice messages, only the other voice messages other than the voice message are targeted and the voice is continuously output in order. configuration is conceivable. By adopting this configuration, it is possible to avoid the annoyance of repeatedly listening to the same sound.

Conversely, if there is a voice message that has already been output once among a plurality of voice messages, there may be a configuration in which the voice is continuously output in order only for that voice message. . By adopting this configuration, it becomes possible to repeatedly listen to an important voice message and confirm its intention.

<Specific configuration>
The hardware configuration of each device constituting the message service providing system of this embodiment is basically the same as the hardware configuration of the message service providing system of the first embodiment described with reference to FIG. Therefore, the specific processing of the "time-series output means", which has not been described so far, will be described below.

(Specific configuration of time-series output means)
The time-series output means is specifically composed of a computer program and computer hardware, and when the CPU reads the sound output program from the storage device, it reads the "time-series output subprogram" into the main memory, executes it, and posts it. output multiple voice messages in sequence.

<Process flow>
FIG. 8 is a diagram showing an example of the flow of processing in the message service providing system of this embodiment. The flow of processing in the figure consists of the following steps. First, in step S0801, user information that identifies a user is acquired (user information acquisition step). Then, in step S0802, audio is acquired in association with the user information of the user who is the acquisition source (audio acquisition step), and in step S0803, an audio playback UI, which is an interface for enabling playback of the acquired audio, is displayed. (UI display step). After that, in step S0804, selection of the audio reproduction UI is accepted (selection acceptance step), and in step S0805, audio is output according to the accepted selection (audio output step).

<effect>
By using the message service providing system of the present embodiment, compared to the case of using the message service providing system of the first or second embodiment, it is possible to avoid a situation in which a plurality of voice messages must be listened to in pieces, or It is possible to listen to voice messages stresslessly without having to operate them one by one. It is possible to receive audio output by It is possible to output voice for suitable communication without being affected by the environment in which the voice is emitted.

<<Embodiment 4>>
<Overview>
The message service providing system of this embodiment is basically the same as the technical features of the message service providing system described in the first embodiment. It is further characterized in that audio processing is performed on audio selected according to information, and the audio that has undergone the audio processing is output at the time of audio output.

<Functional configuration>
FIG. 9 is a diagram showing an example of functional blocks of the message service providing system of this embodiment. As shown in the figure, the 'message service providing system' 0900 of this embodiment includes a 'user information acquisition unit' 0901, a 'speech acquisition unit' 0902, a 'UI display unit' 0903, and a 'selection unit' 0903. It includes a reception unit 0904 , a voice output unit 0905 and a preprocessing unit 0906 , and the voice output unit further has a “processed voice output unit” 0915 . Since the basic configuration is the same as that of the message service providing system described with reference to FIG. explain.

The 'preprocessing unit' 0906 is configured to, when the selection receiving unit receives the selection of the audio reproduction UI, perform acoustic processing of the selected audio according to the user information of the user who has made the selection. Here, "according to user information" means, for example, performing sound processing using user information. In this case, as user information, the user, the user who posted the voice message, or another There may be a case in which a phonetic dictionary of voice tones is included. The "other specific person" can be, for example, a celebrity, a voice actor of a character, an acquaintance, etc., and can be appropriately selected by the user. By performing acoustic processing using these speech dictionaries, it is possible to receive speech output in accordance with the tone desired by the selected user.

The speech dictionary may be edited/modified, added, or deleted as appropriate, and it is also a design matter based on what kind of technical concept it is constructed. The data of the speech dictionary may be obtained from an external server, or the speech dictionary may be held by itself.

In some cases, the frequency and volume of a voice uttered by a certain user are stored as user information, and sound processing is performed using the information. Specifically, when the user information contains information indicating that the voice is usually low, that is, the volume is low, when outputting the voice posted by the user, the volume of the voice to be output is set. It is conceivable to preliminarily perform acoustic processing to increase the to a certain degree. By adopting this configuration, it becomes possible for the user who listens to the voice to comfortably listen to the voice without having to make adjustments by himself/herself.

The 'processed audio output means' 0915 is configured to output the audio processed by the pre-processing unit in the audio output unit. The specific nature of "speech that has been acoustically processed by the pre-processing unit" has already been described, but in the processed speech output means, the speech is output along with information indicating that acoustic processing has been completed. It is desirable to be configured as follows. Specifically, along with voice output, a message such as "sound processing completed" or "playing back in Mr. XX's voice" is displayed on a screen such as a display. Also, an explanation voice such as "Sound processing has been completed" may be additionally output at the beginning or end of the voice. By adopting these configurations, it is possible to prevent this function from being used for fraudulent means such as so-called "spoofing" of a person who outputs audio.

<Specific configuration>
The hardware configuration of each device constituting the message service providing system of this embodiment is basically the same as the hardware configuration of the message service providing system of the first embodiment described with reference to FIG. Therefore, in the following, specific processing of the "preprocessing section" and "processed audio output means", which have not been described so far, will be described.

(Specific configuration of preprocessing unit)
The pre-processing unit is specifically composed of a computer program and computer hardware. When executing the audio output program, the CPU reads out the "pre-processing program" from the storage device to the main memory and executes it.

(Specific configuration of processed voice output means)
The processed voice output means is specifically composed of a computer program and computer hardware. When executing the voice output program, the CPU reads out the "processed voice output means subprogram" from the storage device to the main memory and executes it. .

<Process flow>
FIG. 10 is a diagram showing an example of the flow of processing in the message service providing system of this embodiment. The flow of processing in the figure consists of the following steps. First, in step S1001, user information that identifies a user is acquired (user information acquisition step). Then, in step S1002, the audio is acquired in association with the user information of the user who is the acquisition source (audio acquisition step), and in step S1003, the audio playback UI, which is an interface for enabling playback of the acquired audio, is displayed. (UI display step). After that, in step S1004, selection of the audio reproduction UI is accepted (selection acceptance step), and in step S1005, audio is output according to the accepted selection (audio output step).

<effect>
By using the message service providing system of the present embodiment, it becomes possible to enjoy the tone desired by the user more than when using the message service providing system of the first embodiment.

<<Embodiment 5>>
<Overview>
The message service providing system of this embodiment is basically the same as the technical features of the message service providing system described in the first embodiment. It is further characterized in that the voice reproduction UI is displayed together with the character data that has been converted into characters when the voice reproduction UI is displayed.

<Functional configuration>
FIG. 11 is a diagram showing an example of functional blocks of the message service providing system of this embodiment. As shown in the figure, the ``message service providing system'' 1100 of this embodiment includes a ``user information acquisition unit'' 0201, a ``speech acquisition part'' 1102, a ``UI display part'' 1103, and a ``selection It has a "reception unit" 1104, a "voice output unit" 1105, and a "character processing unit" 1106, and the UI display unit further has a "character display unit" 1113. Since the basic configuration is the same as that of the message service providing system described with reference to FIG. explain.

The 'text processing unit' 1106 is configured to perform voice recognition on the acquired voice and to transcribe part or all of the voice. In order to carry out this process, it is necessary to have various engines for speech recognition, and the engine is used to perform the recognition process of the acquired speech. Here, noise canceling processing for unnecessary sounds and the like are performed, but how to perform those processing may be set as appropriate.

The 'character display unit' 1113 is configured to display the voice reproduction UI together with the character data processed by the character processing unit in the UI display unit. By adopting a configuration in which a voice reproduction UI is displayed together with character data, even when a user who has acquired a message is in an environment where voice reproduction is difficult, the content of the posted voice message can be grasped in advance. becomes possible.

Here, the character data may be displayed and output after being subjected to decoration processing related to the character content. Specifically, if the text has a positive image, such as "Happy Birthday" or "Goal Accomplished!" It is conceivable to output as Processing using a dictionary database that associates the character with a predetermined semantic content is conceivable as the processing for analyzing the character content in performing the decoration processing. By adopting a configuration that analyzes the character content using the database and displays and outputs the characters after applying suitable decoration processing, the user of the voice output destination can receive rich visual as well as auditory information. It becomes possible to provide the amount of information.

<Specific configuration>
The hardware configuration of each device constituting the message service providing system of this embodiment is basically the same as the hardware configuration of the message service providing system of the first embodiment described with reference to FIG. Therefore, in the following, specific processing of the "character conversion processing unit" and "character display means", which have not been described so far, will be described.

(Specific configuration of characterization processing unit)
The characterization processing unit is specifically composed of a computer program and computer hardware, and the CPU reads a "characterization processing program" from the storage device into the main memory and executes it.

(Specific configuration of character display means)
The character display means is specifically composed of a computer program and computer hardware. When executing the UI display program, the CPU reads a "character display subprogram" from the storage device into the main memory and executes it.

<Process flow>
FIG. 12 is a diagram showing an example of the flow of processing in the message service providing system of this embodiment. The flow of processing in the figure consists of the following steps. First, in step S1201, user information that identifies a user is acquired (user information acquisition step). Then, in step S1202, audio is acquired in association with the user information of the user who is the acquisition source (audio acquisition step), and in step S1203, an audio playback UI, which is an interface for enabling playback of the acquired audio, is displayed. (UI display step). After that, in step S1204, selection of the audio reproduction UI is accepted (selection acceptance step), and in step S1205, audio is output according to the accepted selection (audio output step).

<effect>
By using the message service providing system of this embodiment, communication can be achieved even in an environment in which voice output is difficult compared to when using the message service providing system of the first embodiment.

0200... Message service providing system 0201... User information acquisition unit 0202... Voice acquisition unit 0203... UI display unit 0204... Selection reception unit 0205... Voice output unit

Claims (7)

A method for providing a message service capable of posting a plurality of voice messages composed within a predetermined time via a network, comprising:
a user information acquisition step of acquiring user information that is information that identifies a user;
a voice acquisition step of acquiring voice in association with user information of a user who is an acquisition source;
a UI display step of displaying an audio playback UI, which is an interface for enabling playback of the acquired audio;
a selection acceptance step for accepting selection of an audio playback UI;
an audio output step of outputting audio in response to the received selection;
A method of providing a message service that causes a computer to execute The audio acquisition step is
2. The message service providing method according to claim 1, further comprising an edit obtaining substep of editing the obtained audio according to the playback time length of the obtained audio. The audio output step is
3. The message service providing method according to claim 1 or 2, further comprising a time series output substep of sequentially outputting the plurality of posted voice messages. a pre-processing step of performing acoustic processing of the selected voice according to the user information of the user who made the selection when the selection is received in the selection receiving step;
The audio output step is
4. A method of providing a message service according to any one of claims 1 to 3, comprising a processed voice output substep of outputting the voice processed in the preprocessing step. further comprising a characterization processing step of characterizing a part or all of the obtained voice after speech recognition,
The UI display step is
5. The message service providing method according to any one of claims 1 to 4, further comprising a character display substep of displaying a voice reproduction UI together with the character data processed in the characterization processing step. A message service providing program capable of posting a plurality of voice messages configured within a predetermined time via a network,
a user information acquisition step of acquiring user information that is information that identifies a user;
a voice acquisition step of acquiring voice in association with user information of a user who is an acquisition source;
a UI display step of displaying an audio playback UI, which is an interface for enabling playback of the acquired audio;
a selection acceptance step for accepting selection of an audio playback UI;
an audio output step of outputting audio in response to the received selection;
A message service provider program that causes a computer to run A message service system capable of posting and using a plurality of voice messages configured within a predetermined time via a network,
a user information acquisition unit that acquires user information that is information that identifies a user;
a voice acquisition unit that acquires voice in association with user information of a user that is an acquisition source;
a UI display unit for displaying an audio playback UI, which is an interface for enabling playback of acquired audio;
a selection reception unit that receives selection of the audio playback UI;
an audio output unit that outputs audio according to the accepted selection;
A message service system comprising:

Images