JP7534829B1 - COMMUNICATION SYSTEM, COMMUNICATION METHOD, SERVER DEVICE, AND PROGRAM - Google Patents

Abstract

[Problem] To accept voice posts from users, distribute them, and strengthen connections between users. [Solution] The present invention is a server device that includes a receiving unit 11a that accepts posted information including voice data from a terminal device, a storage unit 13 that stores the posted information, a generating unit 11d that generates display data so that the posted information is published on a timeline as talks or threads, a transmitting unit 11e that transmits the display data and voice data to the terminal device, and a main control unit 11f that, by transmission, arranges talks or threads in chronological order on the timeline and prompts automatic playback of voice data related to the talk or thread in the center position. [Selected Figure] Figure 2

Description

Application of Article 30, paragraph 2 of the Patent Act On September 1, 2023, the communication system, communication method, and some of the functions of the program related to the invention were published on the website https://apps.apple.com/jp/app/juke-vox/id6448889618. On September 1, 2023, the communication system, communication method, and some of the functions of the program related to the invention were published on the website https://play.google.com/store/apps/details?id=com.tugboat.jukevox. On September 1, 2023, the communication system, communication method, and some of the functions of the program related to the invention were published on the website https://lp.jukevox.net/.

The present invention relates to a technology that enables voice posting and connects users with each other.

Conventionally, there are various platforms for social networking services (SNS) that accept posts of text data, image data, etc. from users, disseminate them globally, and connect users with each other. This posted text data and image data are, for example, published on the user's timeline and can be viewed, and users can also rate posts by giving them a "like."

For example, Patent Document 1 discloses a system in which, in order to increase the possibility of building good connections between people, a server registers in a database for each user account, schedule information that a user inputs into a user terminal as an action plan for a specific date, in association with that date, and if schedule information that is understood to have the same date and action location is registered in the database for multiple user accounts, the system mediates the exchange of messages between the user terminals corresponding to the multiple user accounts.

JP 2015-97009 A

However, Patent Document 1 does not disclose anything about accepting voice posts from users, distributing them, or strengthening connections between users.

The present invention was made in consideration of these problems, and its purpose is to provide a technology that accepts voice posts from users, distributes them, and strengthens connections between users.

In order to solve the above problem, a server device according to one embodiment of the present invention comprises a receiving unit that receives posted information including audio data from a terminal device, a memory unit that stores the posted information, a generating unit that generates display data so that the posted information is published as talks or threads arranged chronologically on a timeline from top to bottom of the screen, with the display area for the central talk or thread being the largest and the display area gradually becoming smaller as one moves upward and downward from the center , a transmitting unit that transmits the display data and audio data to the terminal device, and a control unit that, as a result of the transmission, arranges the talks or threads in chronological order on the timeline, and prompts automatic playback of audio data related to the talk or thread in a specified position.

A communication system according to another aspect of the present invention is a communication system including a terminal device and a server device, wherein the terminal device includes a first transmission unit that transmits posted information including voice data to the server device, a first reception unit that receives display data and voice data from the server device, a display unit that performs a display based on the display data, a voice input/output unit that performs voice output based on the voice data, and a first control unit that controls the display and voice output, and the server device includes a second reception unit that receives posted information including voice data from the terminal device, a memory unit that stores the posted information, and a communication unit that arranges the posted information as talks or threads in chronological order in the vertical direction of a screen on a timeline and displays the posted information in a centered manner. The device comprises a generation unit that generates display data so that the display area for a talk or thread is largest and becomes gradually smaller as it moves upward and downward from the center , a second transmission unit that transmits the display data and audio data to the terminal device, and a second control unit that, through the transmission, the talks or threads are arranged in chronological order on a timeline and prompts automatic playback of audio data related to the talk or thread at a predetermined position, and in the terminal device, the talks or threads are arranged in chronological order on the timeline displayed by the display unit, and automatic playback of audio data related to the talk or thread at the central position.

A communication method according to another aspect of the present invention is a communication method using a communication system including a terminal device and a server device, wherein in the terminal device, a first transmission unit transmits posted information including voice data to the server device, and in the server device, a second reception unit receives the posted information including the voice data from the terminal device, a memory unit stores the posted information, and a generation unit generates display data such that the posted information is published in a manner in which the posted information is arranged in chronological order in the vertical direction of a screen on a timeline as talks or threads, with the display area of the central talk or thread being the largest and the display area becoming gradually smaller from the center in an upward and downward direction, and a second transmission unit transmits the display data and the voice data to the terminal device. The second control unit prompts the terminal device to automatically play back audio data related to the talk or thread at a specified position, with the first receiving unit receiving display data and audio data from the server device, the display unit performing display based on the display data, the audio input/output unit performing audio output based on the audio data, and the first control unit controls the display and audio output, and in the terminal device, the talk or thread is arranged in chronological order on the timeline displayed by the display unit, and the second control unit prompts the terminal device to automatically play back audio data related to the talk or thread at a specified position, with the first receiving unit receiving display data and audio data from the server device, the display unit performing display based on the display data, the audio input/output unit performing audio output based on the audio data, and the first control unit controlling the display and audio output, and in the terminal device, the talk or thread is arranged in chronological order on the timeline displayed by the display unit, and the talk or thread at the central position is automatically played back.

Another aspect of the program of the present invention causes a computer having a memory unit that stores posted information including audio data to function as a receiving unit that receives the posted information from a terminal device, a generating unit that generates display data so that the posted information is published as talks or threads, arranged chronologically from top to bottom on a timeline, with the display area for the central talk or thread being the largest and the display area gradually becoming smaller as one moves upward and downward from the center , a transmitting unit that transmits the display data and audio data to the terminal device, and a control unit that, through the transmission, arranges the talks or threads in chronological order on the timeline on the terminal device, and prompts the automatic playback of audio data related to the talk or thread in a specified position.

The present invention provides a technology that accepts voice posts from users, distributes them, and strengthens connections between users.

FIG. 1 is a configuration diagram of a communication system according to an embodiment of the present invention. 2(a) and 2(b) are configuration diagrams of a server device of the communication system. FIG. 3 is a configuration diagram of a terminal device in the communication system. FIG. 4 is a flowchart showing a processing procedure relating to the reception of a voice posting by the communication system. FIG. 5 is a flowchart showing a process for audio reproduction by the communication system. FIG. 6 is a diagram showing an example of a screen display of a terminal device. FIG. 7 is a diagram showing an example of a screen display of a terminal device. FIG. 8 is a diagram showing an example of a screen display of a terminal device. FIG. 9 is a diagram showing an example of a screen display of a terminal device. FIG. 10 is a diagram showing an example of a screen display of a terminal device. FIG. 11 is a diagram illustrating a hardware configuration of the server device.

The following describes an embodiment of the present invention with reference to the drawings.

Figure 1 shows and explains the configuration of a communication system according to an embodiment of the present invention.

As shown in the figure, the communication system according to the embodiment of the present invention is composed of a server device 1 and a user's terminal device 2. The server device 1 and the terminal device 2 are connected wirelessly or by wire via a communication network 3 such as the Internet. Note that the terminal device 2 can be any of a variety of devices, such as a smartphone, a tablet terminal, a notebook personal computer, or a desktop personal computer.

In such a configuration, the server device 1 accepts posts of voice data from the user's terminal device 2, manages the voice data by linking it to the user's account, and transmits it as talks and threads on the timeline. The user's terminal device 2 can play back the audio of talks and threads on the timeline. For example, playback may automatically start from the talk or thread displayed in the center of the screen, and when playback ends, playback of the next talk or thread on the timeline may start. The server device 1 may manage talks and threads on the timeline so that they are automatically deleted from the timeline after a predetermined period of time (e.g., 30 days) has passed.

Figures 2(a) and 2(b) show and explain the configuration of the server device of the communication system.

As shown in FIG. 2(a), the server device 1 has a control unit 11, a communication unit 12, and a storage unit 13. The control unit 11, the communication unit 12, and the storage unit 13 are communicatively connected via a system bus. In addition to these components, the server device 1 may also have an input unit such as a keyboard or a mouse, and a display unit such as a liquid crystal display that displays various information.

The communication unit 12 is realized by, for example, a NIC, and is a communication interface that is connected to a communication network 3 such as the Internet by wired or wireless means and communicates with the user's terminal device 2, etc. The storage unit 13 is realized by, for example, a semiconductor memory element such as a RAM or flash memory, a HDD, or an optical disk device, and stores in advance the programs to be executed by the control unit 11. The storage unit 13 also has a user information storage unit 14, a talk thread storage unit 15, and a timeline storage unit 16.

In more detail, the user information storage unit 14 stores at least user information such as an account name, a user name, an email address, a login password, a profile picture, self-introduction voice data, and self-introduction text data, linked to a user ID assigned to the user when the user registers, and posting information such as posted text (including hash tags, quoted URLs, etc.), like record information, comment information, like list information, block information, follower information, audio data of posts, and audio data of comments on posts.

The talk/thread storage unit 15 stores the user ID of the user who posted, the audio data of the post, the date and time of the post, "like" information, audio data of comments on the post, thread ID, etc., linked to the talk ID assigned at the time of posting. The timeline storage unit 16 stores the order of talks and threads on the timeline, etc.

The control unit 11 is realized by a CPU, an MPU, or the like. The control unit 11 is composed of an integrated circuit such as an ASIC or an FPGA. The control unit 11 reads and executes programs stored in the memory unit 13, thereby functioning as a receiving unit 11a, a management unit 11b, a search unit 11c, a generating unit 11d, a transmitting unit 11e, and a main control unit 11f.

In this configuration, the receiving unit 11a receives user information and posted information sent from the user's terminal device 2. More specifically, as shown in FIG. 2(b), the management unit 11b is made up of a user management unit 11b-1, a talk/thread management unit 11b-2, and a timeline management unit 11b-3.

The user management unit 11b-1 stores and manages the user information received by the receiving unit 11a in the user information storage unit 14. More specifically, the user management unit 11b-1 issues a user ID when the user registers, and in the user information storage unit 14, at least the following information is stored or updated in association with the user ID: user information such as an account name, user name, email address, login password, profile image, self-introduction voice data, and self-introduction text data; and posting information such as posted text (including hash tags, quoted URLs, etc.), like record information, comment information, like list information, block information, follower information, audio data of posts, and audio data of comments on posts.

The talk thread management unit 11b-2 stores and manages the posted information received by the receiving unit 11a in the user information storage unit 14 and the talk thread storage unit 15. More specifically, the talk thread management unit 11b-2 issues a talk ID when audio data is posted, and stores and manages the user ID of the user who posted, the audio data of the post, the date and time of the post, like information, audio data of comments on the post, the thread ID, etc., in association with the talk ID in the talk thread storage unit 15.

The timeline management unit 11b-3 manages the order of talks and threads on the timeline based on the posting date and time, etc. The timeline management unit 11b-3 also deletes talks and threads from the timeline when a predetermined time (e.g., 30 days) has passed since the posting date and time.

The search unit 11c extracts relevant talks and threads from the talk/thread storage unit 15 based on the words sent from the terminal device 2. The generation unit 11d generates display data. The transmission unit 11e transmits the display data, etc. to the user's terminal device 2 via the communication unit 12. The main control unit 11f then handles other controls, such as authentication at the time of login. The main control unit 11f also plays a role in arranging talks or threads in chronological order on a timeline on the terminal device 2 side through transmission by the transmission unit 11e, and in prompting automatic playback of audio data related to the talk or thread in the central position.

Figure 3 shows and explains the configuration of the terminal device of the communication system.

As shown in the figure, the terminal device 2 has a control unit 21, a communication unit 22, an imaging unit 23, a display unit 24, an operation unit 25, an audio input/output unit 25, and a storage unit 26. Each unit 21 to 26 is connected to each other so as to be able to communicate freely via a system bus. The communication unit 22 is realized, for example, by a NIC or the like, and is a communication interface that is connected to a communication network 3 such as the Internet by wire or wirelessly and communicates with the server device 1, etc.

The imaging unit 23 takes pictures of images to be posted. The display unit 24 is realized by a liquid crystal display or the like, and displays various types of information. The operation unit 25 is realized by a mouse, keyboard, or the like, and accepts various operational inputs by the user. The display unit 24 and the operation unit 25 may be integrated into a touch panel. The audio input/output unit 26 is composed of a microphone, speaker, or the like. The storage unit 27 is realized by a semiconductor memory element such as a RAM or flash memory, a HDD, or an optical disk device, and stores the programs executed by the control unit 21.

The control unit 21 is realized by a CPU, an MPU, or the like, and may be configured as an integrated circuit such as an ASIC or an FPGA. The control unit 21 functions as a transmission unit 21a, a display control unit 21b, a reception unit 21c, and the like, by reading and executing a program stored in the memory unit 27. In more detail, the transmission unit 21a transmits user information, posted information, and the like to the server device 1. The reception unit 21c receives display data, and the like from the server device 1. The display control unit 21b performs display on the display unit 24 based on the display data. The main control unit 21d is responsible for other controls, such as playing audio from the audio input/output unit 26 based on audio data.

The following describes the processing steps involved in accepting voice posts via the communication system, with reference to the flowchart in Figure 4.

When this process begins, under the control of the main control unit 21d, the transmission unit 21a of the terminal device 2 transmits a login request to the server device 1 (S1). Then, in the server device 1, the reception unit 11a accepts this login request (S2), and the main control unit 11f performs a predetermined authentication (S3). If the authentication is successful, the generation unit 11d generates display data, and the transmission unit 11e transmits the display data to the terminal device 2 (S4).

In the terminal device 2, when the receiving unit 21c receives the display data, under the control of the display control unit 21b, the display unit 24 displays the display data based on the display data (S5). The display state is, for example, as shown in FIG. 6. As shown in FIG. 6, talks and threads are displayed on a timeline, and the audio data of the talks and threads located in the center of the display screen is automatically played. In the talk and thread display area 101, the left end area 101a displays the profile image of the talk and thread owner, and the upper area 101b to the left of the left end area 101a displays the account name of the talk and thread owner. The upper right area 101c of the area 101 displays the date and time of posting, and the central area 101d displays the talk and thread title, hashtag, quoted URL, etc. Below the area 101d, a like button 101f, a comment button 101g, and a share button 101h are displayed, and the number of likes, the number of comments, the number of sharers, etc. are also displayed. A follow button is also displayed in the upper left of the display area 101a of the profile image.

In this example, on the display unit 24, talks and threads are displayed in chronological order in the vertical direction of the screen on a timeline, with the display area for the central talks and threads being the largest, and the display area gradually becoming smaller as one moves upward and downward from the center. In other words, this is a display mode that allows the user to visually recognize the rotation and switching of each display area related to the talks and threads in a sense of depth.

When a user makes a new post using voice data, the screen switches to screen 200 as shown in FIG. 7. On this screen 200, the tempo (speaking speed) and pitch (pitch) of the recording can be adjusted by operating gauges 200b and 200c. The user taps the record button 200a, inputs voice via the voice input/output unit 26 of the terminal device 2, and then adjusts the tempo and pitch (S6). Then, the user taps the next button 200d on screen 200 to switch screens and input text such as a title and hashtags (S7), and pastes a link if there is a quoted URL or the like (S8). The transmission unit 21a then transmits this data to the server device 1 (S9).

In the server device 1, the receiver 11a receives the posted information from the terminal device 2 (S10), the user management unit 11b-1 stores it in the user information storage unit 14, the talk thread management unit 11b-2 stores it in the talk thread storage unit 15, and the timeline management unit 11b-3 updates the information in the timeline storage unit 16 (S11). This completes the series of processes related to voice posts, etc.

Next, the processing procedure for audio playback by the communication system will be described with reference to the flowchart in FIG.

When this process starts, under the control of the main control unit 21d, the transmission unit 21a of the terminal device 2 transmits a login request to the server device 1 (S21). Then, in the server device 1, the reception unit 11a accepts this login request (S22), and the main control unit 11f performs a predetermined authentication (S23). If the authentication is successful, the generation unit 11d generates display data, and the transmission unit 11e transmits the display data to the terminal device 2 (S24).

In the terminal device 2, when the receiving unit 21c receives the display data, under the control of the display control unit 21b, a display based on the display data is performed on the display unit 24 (S25). The display state is, for example, as shown in FIG. 6 above. When a talk or thread that is desired to be played back is selected in this timeline, the screen switches to one as shown in FIG. 8. In the screen 300 of FIG. 8, the detailed contents of the thread selected by the user are displayed, and it is also possible to add a comment in the form of voice or text by tapping the comment button 300a. In the terminal device 2, the transmitting unit 21a transmits a request to play the voice to the server device 1 (S26).

In the server device 1, the receiving unit 11a accepts the request to play back the audio (S27), the talk thread management unit 11b-2 reads out the audio data from the talk thread storage unit 15, and the transmitting unit 11e transmits the audio data to the terminal device 2 (S28). In the terminal device 2, the receiving unit 21c receives the audio data (S29), and the main control unit 21d plays back the audio based on the audio data through the audio input/output unit 26 (S30). This completes the series of processes related to audio playback, etc.

In addition to the above, the terminal device 2 can also display a screen such as that shown in FIG. 9, and on screen 400, the user can check the following/follower status of not only his/her own account but also other users. The user can also search for words of interest, and the search results are displayed on a screen such as that shown in FIG. 10. On screen 500, audio is played automatically (or manually) in the same way as on the timeline. It is also possible to switch the display between new arrivals, rankings, and user-specific display by selecting tabs 500a to 500c.

Figure 6 shows and explains the hardware configuration of the server device.

As shown in the figure, the server device 1 is equipped with a RAM 104, a ROM 103, and a HDD 102. These correspond to the storage unit 13. Furthermore, the server device 1 is equipped with a CPU 101. This functions as the control unit 11 by reading and executing programs from the ROM 103 and the like. In addition, the server device 1 is equipped with a communication I/F 105, which corresponds to the communication unit 12, and an external I/F 106.

As described above, according to an embodiment of the present invention, a server device 1 is provided that includes a receiving unit 11a that receives posted information including audio data from a terminal device, a storage unit 13 that stores the posted information, a generating unit 11d that generates display data so that the posted information is published on a timeline as a talk or thread, a transmitting unit 11e that transmits the display data and audio data to the terminal device, and a main control unit 11f that, through this transmission, arranges the talks or threads in chronological order on the timeline and prompts automatic playback of the talk or audio data related to the thread in the central position. Thus, audio posts from users can be received and distributed, strengthening connections between users.

The above describes an embodiment of the present invention, but the present invention is not limited to this, and various improvements and modifications are possible without departing from the spirit of the invention.

For example, the display format is not limited to the above, and various formats can be used, such as highlighting the talk being played or the display area of an icon.

1...server device, 2...terminal device, 3...communication network, 11...control unit, 11a...receiving unit, 11b...management unit, 11b-1...user management unit, 11b-2...talk thread management unit, 11b-3...timeline management unit, 11c...search unit, 11d...generation unit, 11e...generation unit, 11f...transmission unit, 11g...main control unit, 12...communication unit, 13...storage unit, 14...user information storage unit, 15...talk thread storage unit, 16...timeline storage unit, 21...control unit, 21a...transmission unit, 21b...display control unit, 21c...receiving unit, 21d...main control unit, 22...communication unit, 23...imaging unit, 24...display unit, 25...operation unit, 26...audio input/output unit, 27...storage unit.

Claims (4)

A receiving unit that receives posted information including voice data from a terminal device;
A storage unit that stores the posted information;
A generation unit that generates display data so that the posted information is published as talks or threads on a timeline in a chronological order in the vertical direction of the screen, with the display area of the talk or thread in the center being the largest and the display area gradually becoming smaller from the center in the upward and downward directions ;
a transmission unit that transmits the display data and the audio data to the terminal device;
A server device comprising: a control unit that, by the transmission, arranges talks or threads in chronological order on a timeline and prompts automatic playback of audio data related to talk or threads at a specified position. In a communication system including a terminal device and a server device,
The terminal device
a first transmission unit that transmits posted information including voice data to the server device;
A first receiving unit that receives display data and audio data from the server device;
A display unit that performs display based on the display data;
a voice input/output unit that outputs voice based on the voice data;
A first control unit that controls the display and audio output;
Equipped with
The server device includes:
A second receiving unit that receives posted information including voice data from the terminal device;
A storage unit that stores the posted information;
A generation unit that generates display data so that the posted information is published in a manner in which the posted information is arranged in chronological order in the vertical direction of the screen on a timeline as talks or threads, the display area of the talk or thread in the center is the largest, and the display area becomes gradually smaller from the center to the top and bottom.
a second transmission unit that transmits the display data and the audio data to the terminal device;
A second control unit that, by the transmission, arranges talks or threads in chronological order on a timeline, and prompts automatic playback of audio data related to talks or threads at a predetermined position;
Equipped with
In the terminal device, talks or threads are arranged in chronological order on a timeline displayed by the display unit, and the talk or thread in the center position or audio data related to the thread is automatically played back. A communication method for a communication system including a terminal device and a server device,
In the terminal device,
a first transmission unit transmitting posted information including voice data to the server device;
In the server device,
a second receiving unit receiving posted information including voice data from the terminal device;
A storage unit stores the posted information,
The generation unit generates display data so that the posted information is published in a manner in which the posted information is arranged in chronological order in the vertical direction of the screen on a timeline as talks or threads, with the display area of the talk or thread in the center being the largest, and the display area gradually becoming smaller as it moves upward and downward from the center;
a second transmission unit transmitting the display data and the audio data to the terminal device;
The second control unit, by the transmission, prompts the terminal device to arrange talks or threads in chronological order on a timeline, and to automatically play back audio data related to the talk or thread at a predetermined position,
In the terminal device,
a first receiving unit receiving display data and audio data from the server device;
A display unit performs a display based on the display data,
an audio input/output unit that outputs audio based on the audio data;
a first control unit that controls the display and audio output;
In the terminal device, talks or threads are arranged in chronological order on a timeline displayed by the display unit, and the talk or thread in the center position, or audio data related to the thread, is automatically played back. A computer including a storage unit for storing posted information including voice data,
A receiving unit that receives the posted information from a terminal device;
A generation unit that generates display data so that the posted information is published in a manner in which the display area of the talk or thread is the largest in the center and the display area becomes gradually smaller from the center to the top and bottom of the screen on a timeline, and the posted information is arranged in chronological order in the top and bottom directions of the screen on a timeline, and the display area of the talk or thread is the largest in the center and the display area becomes gradually smaller from the center to the top and bottom directions .
a transmission unit that transmits the display data and audio data to the terminal device; and a control unit that, through the transmission, arranges talks or threads in chronological order on a timeline on the terminal device, and prompts the automatic playback of talk or thread related to a predetermined position, or audio data related to the thread.

Images