WO2022127197A1 - 语音转换文字的方法、系统、设备及介质 - Google Patents
语音转换文字的方法、系统、设备及介质 Download PDFInfo
- Publication number
- WO2022127197A1 WO2022127197A1 PCT/CN2021/115897 CN2021115897W WO2022127197A1 WO 2022127197 A1 WO2022127197 A1 WO 2022127197A1 CN 2021115897 W CN2021115897 W CN 2021115897W WO 2022127197 A1 WO2022127197 A1 WO 2022127197A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- client
- language
- conversation message
- user account
- voice
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 73
- 230000004044 response Effects 0.000 claims abstract description 39
- 230000000694 effects Effects 0.000 claims abstract description 28
- 238000006243 chemical reaction Methods 0.000 claims description 34
- 238000004590 computer program Methods 0.000 claims description 11
- 230000002093 peripheral effect Effects 0.000 claims description 10
- 238000013519 translation Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 description 18
- 238000010586 diagram Methods 0.000 description 16
- 238000013461 design Methods 0.000 description 14
- 238000012545 processing Methods 0.000 description 13
- 230000009471 action Effects 0.000 description 5
- 230000009183 running Effects 0.000 description 5
- 238000004088 simulation Methods 0.000 description 5
- 230000004083 survival effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 241001465754 Metazoa Species 0.000 description 3
- 230000009184 walking Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 2
- 230000002860 competitive effect Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000009193 crawling Effects 0.000 description 2
- 230000009187 flying Effects 0.000 description 2
- 230000035876 healing Effects 0.000 description 2
- 230000009191 jumping Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000036544 posture Effects 0.000 description 2
- AFJYYKSVHJGXSN-KAJWKRCWSA-N selamectin Chemical compound O1[C@@H](C)[C@H](O)[C@@H](OC)C[C@@H]1O[C@@H]1C(/C)=C/C[C@@H](O[C@]2(O[C@@H]([C@@H](C)CC2)C2CCCCC2)C2)C[C@@H]2OC(=O)[C@@H]([C@]23O)C=C(C)C(=N\O)/[C@H]3OC\C2=C/C=C/[C@@H]1C AFJYYKSVHJGXSN-KAJWKRCWSA-N 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- PICXIOQBANWBIZ-UHFFFAOYSA-N zinc;1-oxidopyridine-2-thione Chemical class [Zn+2].[O-]N1C=CC=CC1=S.[O-]N1C=CC=CC1=S PICXIOQBANWBIZ-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/85—Providing additional services to players
- A63F13/87—Communicating with other players during game play, e.g. by e-mail or chat
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Definitions
- the present application relates to the field of human-computer interaction, and in particular, to a method, system, device and medium for speech-to-text conversion.
- the speech-to-text implementation in an application program based on competitive confrontation usually does not have the function of language conversion, which makes it difficult for users using different languages to communicate in different languages in the same game. .
- the first client displays a first user interface, where the first user interface is a display screen of a virtual environment that provides a virtual activity place for the first virtual character controlled by the first user account;
- the second client displays a second user interface
- the second user interface is a display screen of a virtual environment that provides a virtual activity place for the second virtual character controlled by the second user account;
- the first client In response to a voice input operation on the first client, the first client displays the conversation message input by the first user account in a first language, and the second client displays all messages in a second language.
- the conversation message sent by the first user account the first language category is the language category associated with the first user account or the first client
- the second language category is the language category associated with the second
- the language type associated with the user account or the second client and the text content of the conversation message is recognized based on the voice content input by the voice input operation.
- a method for converting speech into text, applied to a server includes:
- first language category is a language category associated with the first user account or the first client
- second language category is a language category associated with the second user account or the first client
- a system for converting text into speech includes a first device and a second device, the system includes:
- the first device is configured to display a first user interface, where the first user interface is a display screen of a virtual environment that provides a virtual activity place for the first virtual character controlled by the first user account;
- the second device is configured to display a second user interface, where the second user interface is a display screen of a virtual environment that provides a virtual activity place for the second virtual character controlled by the second user account;
- the first device is further configured to display, in response to a voice input operation on the first device, a conversation message input by the first user account in a first language type, where the first language type is related to the first language type.
- a user account or a language type associated with the first client the text content of the conversation message is recognized based on the voice content input by the voice input operation;
- the second device is further configured to display the conversation message sent by the first user account in a second language type, where the second language type is associated with the second user account or the second client type of language.
- a device for converting speech to text comprising:
- a receiving module for receiving the voice content sent by the first client
- the receiving module is further configured to determine a first language category and a second language category, where the first language category is a language category associated with the first user account or the first client, and the first user account uses controlling the first virtual character in the virtual activity place of the virtual environment provided by the first client, the second language type is the language type associated with the second user account or the second client, the second user The account is used to control the second virtual character in the virtual activity place of the virtual environment provided by the second client;
- the conversion module is configured to convert the speech content into a conversation message of the first language type according to the speech content and the first language type, and the text content of the conversation message is recognized based on the speech content. of;
- a translation module configured to translate the conversation message in the second language to obtain the conversation message in the second language according to the conversation message in the first language and the second language;
- a sending module configured to send the conversation message of the second language category to the second client.
- a computer device comprising a memory and one or more processors, the memory storing computer program readable instructions that, when executed by the one or more processors, cause the one or more processors to A processor implements the above-mentioned method for converting speech to text.
- One or more non-volatile computer-readable storage media having computer-readable instructions stored thereon that, when executed by one or more processors, cause the one or a plurality of processors to implement the above-mentioned method of speech-to-text conversion.
- a computer program product or computer program wherein the computer program product or computer program includes computer-readable instructions, and the computer-readable instructions are stored in a computer-readable storage medium.
- the processor of the computer device reads the computer-readable instructions from the computer-readable storage medium, and the processor executes the computer-readable instructions, so that the computer device executes the voice-to-text method.
- FIG. 1 is a structural block diagram of a computer system provided by an exemplary embodiment of the present application.
- FIG. 2 is a flowchart of a method for speech-to-text conversion provided by an exemplary embodiment of the present application
- FIG. 3 is a schematic diagram of a camera model provided by an exemplary embodiment of the present application.
- FIG. 4 is a schematic interface diagram of a method for speech-to-text conversion provided by an exemplary embodiment of the present application
- FIG. 5 is a schematic interface diagram of a method for speech-to-text conversion provided by an exemplary embodiment of the present application
- FIG. 6 is a flowchart of a method for converting text by speech provided by an exemplary embodiment of the present application
- FIG. 7 is a schematic interface diagram of a method for speech-to-text conversion provided by an exemplary embodiment of the present application.
- FIG. 8 is a flowchart of a method for speech-to-text conversion provided by an exemplary embodiment of the present application.
- FIG. 9 is a schematic interface diagram of a method for speech-to-text conversion provided by an exemplary embodiment of the present application.
- FIG. 10 is a schematic interface diagram of a method for speech-to-text conversion provided by an exemplary embodiment of the present application.
- FIG. 11 is a flowchart of a method for converting text by speech provided by an exemplary embodiment of the present application.
- FIG. 12 is a schematic structural diagram of a system for converting text by speech provided by an exemplary embodiment of the present application.
- FIG. 13 is a schematic structural diagram of an apparatus for speech-to-text conversion provided by an exemplary embodiment of the present application.
- FIG. 14 is a structural block diagram of a terminal provided by an exemplary embodiment of the present application.
- FIG. 15 is a schematic structural diagram of a server provided by an exemplary embodiment of the present application.
- Virtual environment is the virtual environment displayed (or provided) at runtime on the client.
- the virtual environment may be a three-dimensional virtual environment or a two-dimensional virtual environment.
- the three-dimensional virtual environment may be a simulated environment of the real world, a semi-simulated and semi-fictional environment, or a purely fictional environment.
- Virtual character Refers to an active character in a virtual environment.
- the movable characters may be virtual characters, virtual animals, cartoon characters, etc., such as characters, animals, plants, oil barrels, walls, stones, etc. displayed in the virtual environment.
- the virtual character is a three-dimensional three-dimensional model created based on animation skeleton technology, and each virtual character has its own shape and volume in the three-dimensional virtual environment, occupying a part of the space in the three-dimensional virtual environment. .
- the virtual character is a two-dimensional plane model created based on animation technology, and each virtual character has its own shape and area in the two-dimensional virtual environment, occupying the two-dimensional virtual environment. part of the area.
- Multiplayer online tactical competition In a virtual environment, different virtual teams belonging to at least two enemy factions occupy their respective map areas and compete with a certain victory condition as the goal.
- the victory conditions include but are not limited to: occupying the stronghold or destroying the enemy camp's stronghold, killing the virtual character of the enemy camp, ensuring one's own survival within the specified scene and time, snatching a certain resource, and exceeding the opponent's score within the specified time.
- Tactical competitions can be carried out in rounds, and the map of each round of tactical competitions can be the same or different.
- Each virtual team includes one or more virtual characters, such as 1, 2, 3 or 5.
- MOBA Multiplayer Online Battle Arena
- It is a game that provides several strongholds in a virtual environment, and users in different camps control virtual characters to fight in the virtual environment, occupying strongholds or destroying the strongholds of enemy camps.
- a MOBA game can divide the user into two rival factions, and disperse the virtual characters controlled by the user in a virtual environment to compete with each other, and destroy or occupy all the enemy's strongholds as a victory condition.
- MOBA games are based on rounds, and the duration of a MOBA game is from the moment the game starts to the moment when the victory conditions are met.
- FPS First Person Shooting game
- FPS games It is a game that provides several strongholds in a virtual environment. Users in different camps control virtual characters to fight in the virtual environment, occupying strongholds or destroying enemy camp strongholds or killing all enemy camps or Some character games.
- the user plays the game from a first-person perspective, and the user can also select a third-person perspective to play the game.
- an FPS game can divide the user into two rival camps, and disperse the virtual characters controlled by the user in a virtual environment to compete with each other, and kill all the enemy users as a victory condition.
- FPS games are based on rounds, and the duration of a round of FPS games is from the moment the game starts to the moment when the victory conditions are met.
- SLG (Simulation Games) game It is a game type that provides virtual resources in a virtual environment and simulates reality. For example, SLG games can divide multiple users into a single camp, and multiple users can work together to complete designated tasks. Optionally, there are usually no specific victory conditions for a round of SLG games.
- Text-to-speech conversion refers to converting the voice content input by the user into text and outputting it. Exemplarily, if the user inputs the voice content "good morning”, the corresponding text "good morning” will be output. Generally speaking, text-to-speech only supports converting speech content to one language type at a time.
- FIG. 1 shows a structural block diagram of a computer system provided by an exemplary embodiment of the present application.
- the computer system 100 includes: a first terminal 120 , a server 140 and a second terminal 160 .
- the first terminal 120 installs and runs a client that supports a virtual environment.
- the client can be any one of MOBA games, virtual reality clients, three-dimensional map clients, military simulation clients, FPS games, multiplayer shootout survival games, and SLG games.
- the first terminal 120 is a terminal used by the first user, and the first user account is an account held by the first user.
- the first user uses the first terminal 120 to operate the first virtual character in the three-dimensional virtual environment to perform activities, including but not limited to: attacking, releasing skills, purchasing props, treating, adjusting body posture, crawling, walking, riding, At least one of flying, jumping, driving, picking up, shooting, throwing.
- the first avatar is the first avatar.
- the first terminal 120 is connected to the server 140 through a wireless network or a wired network.
- the server 140 includes at least one of a server, multiple servers, a cloud computing platform and a virtualization center.
- the server 140 is used to provide background services for clients supporting the virtual environment.
- the server 140 undertakes the main computing work, and the first terminal 120 and the second terminal 160 undertake the secondary computing work; or, the server 140 undertakes the secondary computing work, and the first terminal 120 and the second terminal 160 undertake the main computing work;
- the server 140 , the first terminal 120 and the second terminal 160 use a distributed computing architecture to perform collaborative computing.
- the second terminal 160 has a client that supports the virtual environment installed and running.
- the client can be any one of MOBA games, virtual reality clients, three-dimensional map clients, military simulation clients, FPS games, multiplayer gun battle survival games, and SLG games.
- the second terminal 160 is a terminal used by the second user, and the second user account is an account held by the first user.
- the second user uses the second terminal 160 to operate the second virtual character in the virtual environment to perform activities, including but not limited to: attacking, releasing skills, purchasing props, healing, adjusting body posture, crawling, walking, riding, flying , at least one of jumping, driving, picking up, shooting, and throwing.
- the second avatar is a second avatar.
- the first virtual character and the second virtual character may belong to the same team, the same organization, have a friend relationship or have temporary communication authority, and the first virtual character and the second virtual character may also belong to different teams or different organizations.
- the clients installed on the first terminal 120 and the second terminal 160 are the same, or clients of the same type on different platforms.
- the first terminal 120 may generally refer to one of multiple terminals
- the second terminal 160 may generally refer to one of multiple terminals. This embodiment only takes the first terminal 120 and the second terminal 160 as examples for illustration.
- the device types of the first terminal 120 and the second terminal 160 are the same or different, and the device types include: smart phones, tablet computers, e-book readers, MP3 players, MP4 players, laptop computers and desktop computers. at least one.
- the first client on the first terminal 120 may display a first user interface, where the first user interface provides a virtual environment of a virtual activity place for the first virtual character controlled by the first user account display screen; the second client on the second terminal 160 can display a second user interface, the second user interface is a display screen of a virtual environment providing a virtual activity place for the second virtual character controlled by the second user account; in response to the first A voice input operation on a client, the first client uses the first language to display the conversation message input by the first user account, and the second client uses the second language to display the conversation message sent by the first user account; the first language The type is the language type associated with the first user account or the first client, the second language type is the language type associated with the second user account or the second client, and the text content of the conversation message is input based on the voice input operation voice content recognized.
- conversation messages in different languages will be displayed on different clients, and the input voice information can be translated into conversation messages in different languages, which is convenient for using different languages. Users to communicate to remove language barriers. At the same time, the user does not need to use additional translation software to translate conversation messages in other languages, which reduces the user's operation steps and improves the efficiency of human-computer interaction.
- FIG. 2 shows a flow chart of a method for speech-to-text conversion provided by an exemplary embodiment of the present application.
- the method can be executed by the first terminal 120 or the second terminal 160 shown in FIG. 1 , the method is applied to at least two clients, and the method includes:
- Step 202 The first client displays a first user interface, where the first user interface is a display screen of a virtual environment that provides a virtual activity place for the first virtual character controlled by the first user account.
- the first client refers to a client program running on the first terminal.
- the client program includes any one of a MOBA game, a virtual reality client, a three-dimensional map client, a military simulation client, an FPS game, a multiplayer gun battle survival game, and an SLG game.
- the first user account refers to an account held by the first user.
- the first virtual character refers to a master character controlled by the first user in the first client.
- the first virtual character is at least one of a character, an animal, a plant, and an animation character.
- the first user interface refers to a screen that can be observed on the first terminal when the first client is running.
- the first user interface is a picture when the first virtual character is observed through a camera model in a virtual environment.
- the camera model automatically follows the virtual character in the virtual environment, that is, when the position of the virtual character in the virtual environment changes, the camera model changes simultaneously with the position of the virtual character in the virtual environment, and the camera The model is always within the preset distance of the avatar in the virtual environment.
- the relative positions of the camera model and the virtual character do not change.
- the camera model refers to the three-dimensional model located around the virtual character in the virtual environment.
- the camera model is located near the head of the virtual character or on the head of the virtual character;
- the camera The model can be located behind the avatar and bound to the avatar, or it can be located at any position with a preset distance from the avatar.
- the camera model can be used to observe the avatar in the virtual environment from different angles, optional Specifically, when the third-person perspective is a first-person over-the-shoulder perspective, the camera model is located behind the virtual character (for example, the head and shoulders of the virtual character).
- the perspective also includes other perspectives, such as a top-down perspective; when the top-down perspective is used, the camera model can be located above the head of the virtual character, and the top-down perspective is from the sky.
- the camera model is not actually displayed in the virtual environment, that is, the camera model is not displayed in the virtual environment displayed by the user interface.
- the camera model is located at any position with a preset distance from the virtual character as an example to illustrate.
- a virtual character corresponds to a camera model, and the camera model can be rotated around the virtual character. Rotate the camera model at any point of the rotation center. During the rotation, the camera model not only rotates in angle, but also offsets in displacement. The distance between the camera model and the rotation center remains unchanged during rotation. That is, the camera model is rotated on the spherical surface with the center of rotation as the center of the sphere, wherein any point of the virtual character may be the head, torso, or any point around the virtual character. Not limited.
- the center of the viewing angle of the camera model points to the direction of the center of the sphere where the point on the sphere where the camera model is located points to the center of the sphere.
- the camera model can also observe the virtual character at preset angles in different directions of the virtual character.
- a point is determined in the virtual character 11 as the rotation center 12, and the camera model rotates around the rotation center 12.
- the camera model is configured with an initial position, and the initial position is the virtual character.
- Posterior upper position eg the posterior position of the brain.
- the initial position is position 13.
- the viewing angle direction of the camera model changes with the rotation of the camera model.
- the first user screen further includes: conversation messages, chat controls, a thumbnail map from God's perspective, backpack controls, orientation indicating controls, a voice switch, a microphone switch, a control for moving the virtual character, a control for At least one other display element in the controls for controlling the virtual character to perform preset actions.
- a virtual character 401 a chat control 402 , a conversation message 403 , a thumbnail map 404 , a movement control 405 , a user icon 406 , a skill control 407 and a purchase control 408 are displayed on the first user interface. .
- Step 204 The second client displays a second user interface, where the second user interface is a display screen of a virtual environment that provides a virtual activity venue for the second virtual character controlled by the second user account.
- the second client refers to a client program running on the second terminal.
- the client program includes MOBA games, virtual reality clients, 3D map clients, military simulation clients, FPS games, and multiplayer gun battle survival. Either game or SLG game.
- the device types of the second terminal and the first terminal may be the same or different.
- the second user account refers to an account held by the second user. Wherein, the first user account and the second user account are different.
- the second virtual character refers to a master character controlled by a second user in the second client.
- the second virtual character is at least one of a character, an animal, a plant, and an animation character.
- the first virtual character and the second virtual character may be the same or different.
- the second user interface refers to a screen that can be observed on the second terminal when the second client is running.
- the second user interface is a picture when the second virtual character is observed through the camera model in the virtual environment.
- the second user interface is the same as or different from the first user.
- the second user screen further includes: a conversation message, a chat control, a thumbnail map from God's perspective, a backpack control, an orientation indication control, an external voice switch, a microphone switch, a control for moving a virtual character, a control for At least one other display element in the controls for controlling the virtual character to perform preset actions.
- a virtual character 501 a chat control 502 , a conversation message 503 , a thumbnail map 504 , a movement control 505 , a user icon 506 , a skill control 507 and a purchase control 508 are displayed on the second user interface. .
- Step 206 In response to the voice input operation on the first client, the first client uses the first language to display the conversation message input by the first user account, and the second client uses the second language to display the message sent by the first user account. conversation message.
- the voice input operation refers to the user inputting voice content into the terminal.
- the voice input operation may be pressing one or more preset physical keys to input voice content, or the voice input operation may be performed by long pressing, clicking, double-clicking and/or sliding on a designated area of the touch screen.
- the generated signal is used to perform the voice input operation, or the voice input operation may be the direct input of the voice content through a microphone device.
- the language types corresponding to the first language type and the second language type are different.
- the first language type is Chinese
- the second language type is English.
- the language types include, but are not limited to: at least one of Chinese, English, Japanese, German, Russian, Latin, and French.
- Conversation messages include the user name and the content of the conversation.
- the conversation message and the conversation message correspond to the voice content input by the voice input operation.
- the voice content input by the user ABC is “I'm sorry”
- the conversation message in the first language is “ABC: I'm sorry”
- the conversation message in the second language is “ABC: I'm sorry”
- the conversation message and The meaning expressed by the conversation message should correspond to the input content.
- the display position of the conversation message can be set by the user.
- the upper left corner of the user interface or, the lower right corner of the user interface. This application does not limit the specific display position of the conversation message.
- the content of the conversation message 403 displayed on the first user interface in FIG. 4 is “ABC: Hello”, and the content of the conversation message 503 displayed on the second user interface in FIG.
- the content is "ABC: Hello”, the language types of the conversation message 403 and the conversation message 503 are different, but the meanings expressed by the two are the same.
- the input content of the voice input operation can be translated, and conversation messages in different languages can be displayed on the first client and the second client, which facilitates direct communication between users of different languages.
- Communication improves the communication efficiency between users.
- the real-time performance of the system can be improved, and it is convenient for users to obtain information of other users in time.
- FIG. 6 shows a flow chart of a method for speech-to-text conversion provided by an exemplary embodiment of the present application.
- the method can be executed by the first terminal 120 or the second terminal 160 shown in FIG. 1 , the method is applied to at least two clients, and the method includes:
- Step 601 Display a first user interface.
- the first client displays the first user interface.
- Step 602 Display a second user interface.
- the second client displays a second user interface.
- Step 601 and step 602 are in no particular order in terms of time sequence.
- Step 603 In response to the voice input operation on the first client, the first client obtains the voice content.
- the voice content refers to voice information input by the user through the first client.
- the first client obtains the voice content through a voice collection device, or the first client downloads the voice content through the network, or the first client receives the voice content sent by other clients, or the first client Query local storage for voice content.
- Step 604 Send the voice content.
- the first client sends the voice content to the server.
- the first client sends the voice content and the first language type to the server.
- Step 605 Determine the first language category and the second language category.
- the server determines the first language category and the second language category.
- the server receives the first language category sent by the first client, or stores the first language category in the server.
- the server receives the second language category sent by the second client, or stores the second language category in the server.
- this step includes at least one of the following two steps:
- the first client sends the first language type to the server.
- the server receives the first language type sent by the first client, and determines the first language type.
- the first client sends version information to the server, where the version information includes the first language category, or the first client sends region information to the server, where the region information corresponds to the first language category, for example, the region If the information indicates that the first client terminal is located in China, the first language type is Chinese, or the first client terminal sends the language setting of the first terminal to the server, and the language setting includes the first language type.
- the second client sends the second language type to the server.
- the server receives the second language category sent by the second client, and determines the second language category.
- the server receives the second language category sent by the second client to determine the second language category.
- the second client sends version information to the server, where the version information includes the second language category, or the second client sends region information to the server, where the region information corresponds to the second language category, for example, the region If the information indicates that the second client is located in China, the second language type is Chinese, or the second client sends the language setting of the second terminal to the server, where the language setting includes the second language type.
- the second client receives the language category acquisition request sent by the server; the second client sends the second language category to the server according to the language category acquisition request.
- the language category acquisition request is used by the server to request the client to send the language category.
- Step 606 Generate a conversation message in the first language type and a conversation message in the second language type according to the voice content.
- the server generates a conversation message in the first language and a conversation message in the second language according to the voice content.
- the server converts the voice content into conversation messages in the first language, and then translates the conversation messages in the first language into conversation messages in the second language.
- the server converts the voice content "I'm sorry” into the conversation message “I'm sorry” in the first language, and then translates the conversation message “I'm sorry” in the first language into the conversation message “I'm sorry” in the second language. ".
- the first client generates a conversation message in the first language type according to the voice content; the first client sends the conversation message in the first language type to the server; the server generates the second language type according to the conversation message in the first language type conversation message. That is, the task of generating the conversation message in the first language is assigned to the first client for execution.
- Step 607 Send a conversation message in the first language.
- the server sends the session message in the first language to the first client.
- Step 608 Send a conversation message in the second language.
- the server sends the session message in the second language to the second client.
- Step 607 and step 608 are in no particular order in terms of time sequence.
- Step 609 Receive a conversation message of the first language type.
- the first client receives the conversation message in the first language type sent by the server.
- Step 610 Display the conversation message in the first language category.
- the first client displays the conversation message in the first language on the first user interface.
- Step 611 Cancel the display of the conversation message.
- the first client cancels the display of the conversation message in the first language.
- the first client cancels the display of the conversation message.
- the first client can cancel the display of the session message.
- the first client cancels the display of the conversation message in response to the first cancel display operation.
- the first cancel display operation is used to cancel the display of the conversation message.
- the first cancel display operation may be pressing one or more preset physical buttons to cancel the display of the conversation message, or the first cancel display operation may be performed by long pressing, clicking, double clicking and/or on a designated area of the touch screen Or slide the generated signal to perform the first display cancellation operation, or, the first display cancellation operation may be performed by recognizing the input voice content.
- Step 612 Receive a conversation message in the second language.
- the second client receives the conversation message of the first language type sent by the server; the second client determines the conversation message of the second language type according to the conversation message of the first language type and the second language type. That is, the task of determining the conversation message of the second language type is assigned to the second client to complete.
- Step 613 Display the conversation message in the second language category.
- the second client displays the conversation message in the first language and the conversation message in the second language on the second user interface.
- the conversation messages displayed on the second user interface include conversation messages in the first language type and conversation messages in the second language type, wherein the conversation message in the first language type is “Hello”, and the second The conversation message of the language category is "Hello".
- simultaneously displaying the conversation message in the first language and the conversation message in the second language can help the user to learn other languages, so that the user can communicate better later.
- Step 614 Cancel the display of the conversation message.
- the second client cancels the display of the conversation message in the second language.
- the second client cancels the display of the conversation message.
- the second client can cancel the display of the session message.
- the second client cancels the display of the session message in response to the second cancel display operation.
- the second cancel display operation is used to cancel the display of the conversation message.
- the second cancel display operation may be pressing one or more preset physical keys to cancel the display of the conversation message, or the second cancel display operation may be performed by long pressing, clicking, double clicking and/or on a designated area of the touch screen Or sliding the generated signal to perform the second display cancellation operation, or, the second cancellation display operation may be performed by recognizing the input voice content to perform the second cancellation display operation.
- the specific operation manners of the second cancel display operation and the first cancel display operation may be the same or different, which are not specifically limited in this application.
- the input content of the voice input operation can be translated, and conversation messages in different languages can be displayed on the first client and the second client, which facilitates direct communication between users of different languages. Communication improves the communication efficiency between users.
- the voice conversion and conversation message translation are performed by the server, so that the obtained conversation message and conversation message are more accurate, and the accuracy of the speech conversion and information translation is improved.
- the user can also cancel the display of the conversation message and the conversation message according to his own needs, so as to prevent the conversation message and the conversation message from interfering with the operation of the user.
- the user can also implement voice-to-text in a more efficient way.
- FIG. 8 shows a flowchart of a method for speech-to-text conversion provided by an exemplary embodiment of the present application.
- the method can be executed by the first terminal 120 or the second terminal 160 shown in FIG. 1 , the method is applied to at least two clients, and the method includes:
- the above steps 202 to 204 may be alternatively implemented as the following steps 802 to 804 .
- Step 802 The first client displays a first user interface.
- Step 804 The second client displays a second user interface.
- Step 806 In response to the first trigger operation on the chat control on the first client, the first client displays the conversation message in the first language type, and the second client displays the conversation message in the second language type.
- Chat controls are used for information exchange between users of different clients.
- the first triggering operation is used for inputting voice content by a user of the first client.
- the first trigger operation may be pressing one or more preset physical keys to input voice content, or the first trigger operation may be a long press, click, double click and/or slide on a designated area of the touch screen. generated signal to perform the first trigger operation.
- the first client In response to the start input operation of the chat control on the first client, the first client displays a voice recording prompt at the peripheral position of the chat control, and starts to receive the voice content.
- the start input operation is used to control the first client to start receiving the voice content.
- the starting input operation may be pressing one or more preset physical keys to start receiving voice content, or the starting input operation may be generated by long-pressing, clicking, double-clicking and/or sliding on a designated area of the touch screen signal to perform the start input operation.
- the voice recording prompt is used to prompt the user that the first client terminal is accepting the voice content.
- the voice recording prompt is at least one or a combination of words, icons, sounds, images, vibration feedback, and lights.
- the voice recording prompt is displayed on at least one of the upper side, the lower side, the left side, the right side, the upper left side, the lower left side, the upper right side, and the lower right side of the chat control.
- the user long presses the chat control 402 on the first client to display a voice recording prompt 901, wherein the voice recording prompt 901 displays a microphone icon and text prompts "Countdown: 9s" and "Finger”. Swipe left to cancel".
- the first client cancels the display of the voice recording prompt, and ends receiving the voice content.
- the ending input operation is used to control the first client to end receiving the voice content.
- the end input operation may be pressing one or more preset physical keys to end the input of voice content, or the end input operation may be generated by long pressing, clicking, double clicking and/or sliding on a designated area of the touch screen signal to perform the end input operation.
- the first client terminal cancels displaying the voice recording prompt, and ends receiving the voice content.
- the first client terminal cancels displaying the voice recording prompt, and ends receiving the voice content.
- the user inputs a piece of voice content for 10 seconds
- the input duration of the voice content reaches the duration threshold
- the first client ends receiving the voice content.
- the user presses the chat control 402 for a long time and inputs the voice content, the user releases the chat control 402 and ends inputting the voice content, or the user continues to press the chat control for 9 seconds until the duration threshold is reached, the first The client ends receiving voice content.
- a conversion reminder 1001 will be displayed during the voice conversion process, wherein the conversion reminder 1001 is displayed as “Converting”.
- the first client terminal displays a voice conversion prompt.
- the voice conversion prompt is used to prompt the user that the input of the voice content has been completed and that the voice content is being converted into a conversation message.
- the voice conversion prompt is at least one or a combination of text, icons, sounds, images, vibration feedback, and lights.
- the first client terminal displays the conversation message in the first language type
- the second client terminal displays the conversation message in the second language type.
- the first client terminal uses the first language type to display the conversation message 403, and the second client terminal uses the second language type to display the conversation message 503, wherein the conversation message 403 is "ABC: Hello", the session message 503 is "ABC: Hello".
- this embodiment provides a shortcut for the user to input voice content, which facilitates the user to quickly input the voice content, reduces the user's operation steps, and improves the efficiency of human-computer interaction.
- FIG. 11 shows a flow chart of a method for speech-to-text conversion provided by an exemplary embodiment of the present application.
- the method can be executed by the server 140 shown in FIG. 1, the server 140 is connected with at least two clients, and the method includes:
- Step 1101 Receive the voice content sent by the first client.
- the server receives the voice content sent by the first client.
- Step 1102 Determine the first language category and the second language category.
- the server receives the first language category sent by the first client to determine the first language category.
- the first client sends version information to the server, where the version information includes the first language type, or the first client sends region information to the server, where the region information corresponds to the first language category, for example, the region If the information indicates that the first client is located in China, the first language type is Chinese, or the first client sends the language setting of the first terminal to the server, where the language setting includes the first language type.
- the server receives the second language category sent by the second client to determine the second language category.
- the second client sends version information to the server, where the version information includes the second language category, or the second client sends region information to the server, where the region information corresponds to the second language category, for example, the region If the information indicates that the second client is located in China, the second language type is Chinese, or the second client sends the language setting of the second terminal to the server, where the language setting includes the second language type.
- the server sends a language category acquisition request to the second client, and the server receives the second language category sent by the second client.
- the language category acquisition request is used by the server to request the client to send the language category.
- Step 1103 Convert the voice content into a conversation message of the first language type according to the voice content and the first language type.
- the server converts the speech content into conversational messages.
- the server converts the voice content "sorry” into a conversation message "sorry”.
- Step 1104 Translate the conversation message in the second language to obtain the conversation message in the second language according to the conversation message in the first language and the second language.
- the server translates the conversation message in the first language into the conversation message in the second language.
- the server translates the conversation message "I'm sorry” in the first language into the conversation message "I'm sorry” in the second language.
- Step 1105 Send the conversation message in the second language to the second client.
- the server sends the session message in the second language to the second client.
- this embodiment converts the voice content into conversation messages in the server, and then translates the conversation messages into conversation messages, which facilitates direct communication between users in different languages and improves the communication efficiency between users.
- using a server can improve the accuracy of conversion and translation, and provide users with more accurate results.
- the present application is used in MOBA games.
- user A and user B are playing the MOBA game
- user A inputs Chinese voice content
- a Chinese conversation message is displayed on user A's client
- an English conversation message is displayed on user B's client.
- the present application is used in FPS games.
- user A and user B are playing an FPS game
- user A inputs Chinese voice content
- a conversation message in Russian is displayed on user A's client
- a conversation message in English is displayed on user B's client.
- this application is used in SLG games.
- user A and user B are playing the SLG game, after user A inputs Chinese voice content, a Chinese conversation message is displayed on user A's client, and a Japanese conversation message is displayed on user B's client.
- a method of speech-to-text is also provided.
- the method can be performed by the first terminal 120 shown in FIG. 1, and the method includes:
- the first user interface is a display screen of a virtual environment that provides a virtual activity place for the first virtual character controlled by the first user account;
- the conversation message input by the first user account is displayed in the first language type
- the first language type is the language type associated with the first user account or the first client
- the second language type is the language type associated with the second user account or the second client
- the text content of the conversation message is based on voice The voice content entered by the input operation is recognized.
- the input content of the voice input operation can be translated, and conversation messages in different languages can be displayed on the first client and the second client, which facilitates direct communication between users of different languages.
- Communication improves the communication efficiency between users.
- the real-time performance of the system can be improved, and it is convenient for users to obtain information of other users in time.
- FIG. 12 shows a schematic structural diagram of a system for converting text by speech provided by an exemplary embodiment of the present application.
- the system can be implemented as all or a part of computer equipment through software, hardware or a combination of the two.
- the system 120 includes a first device 121 and a second device 122, and specifically includes:
- the first device 121 is configured to display a first user interface, where the first user interface is a display screen of a virtual environment that provides a virtual activity place for the first virtual character controlled by the first user account;
- the second device 122 is configured to display a second user interface, where the second user interface is a display screen of a virtual environment that provides a virtual activity place for the second virtual character controlled by the second user account;
- the first device 121 is further configured to, in response to a voice input operation on the first device 121, display the conversation message input by the first user account in a first language type, where the first language type is related to the first user account or the first client The associated language type, the text content of the conversation message is recognized based on the voice content input by the voice input operation;
- the second device 122 is further configured to display the conversation message sent by the first user account in a second language type, where the second language type is a language type associated with the second user account or the second client.
- the first device 121 is further configured to, in response to a voice input operation on the first device 121, obtain the voice content by the first device; send the voice content to the server, and the server is used for according to the voice content A conversation message in the first language type and a conversation message in the second language type are generated; after receiving the conversation message sent by the server, the conversation message is displayed in the first language type.
- the second device 122 is further configured to display the conversation message in the second language after receiving the conversation message sent by the server.
- the first device 121 is further configured to send the first language category to the server.
- the second device 122 is further configured to send the second language category to the server.
- the first device 121 is further configured to send the voice content and the first language category to the server.
- the second device 122 is further configured to receive a language category acquisition request sent by the server; and send the second language category to the server according to the language category acquisition request.
- the first device 121 is further configured to display the conversation message in the first language type in response to the first trigger operation on the chat control on the first device 121 .
- the second device 122 is further configured to display the conversation message in the second language in response to the first triggering operation on the chat control on the first device 121 .
- the first device 121 is further configured to, in response to a start input operation on the chat control on the first device 121, display a voice recording prompt at the peripheral position of the chat control, and start receiving the voice content ; In response to the end input operation of the chat control on the first device, cancel the display of the voice recording prompt, and end receiving the voice content.
- the first device 121 is further configured to cancel the display of the conversation message when the display time of the conversation message displayed in the first language type reaches a preset duration; or, in response to the first canceling the display Action to suppress the display of the conversation message.
- the second device 122 is further configured to cancel the display of the conversation message when the display time of the conversation message displayed in the second language reaches a preset duration; or, in response to the second canceling the display Action to suppress the display of the conversation message.
- the second device 122 is further configured to display the conversation message in the first language type and the second language type in response to the voice input operation on the first device 121 .
- conversation messages in different languages are displayed on different clients, so that the input voice information can be translated into conversation messages in different languages , which is convenient for users of different languages to communicate and eliminate language barriers.
- the user does not need to use additional translation software to translate conversation messages in other languages, which reduces the user's operation steps and improves the efficiency of human-computer interaction.
- An exemplary embodiment of the present application further provides a device for converting text by speech.
- the device can be implemented as all or a part of the first terminal through software, hardware or a combination of the two, specifically including:
- a display module configured to display a first user interface, where the first user interface is a display screen of a virtual environment that provides a virtual activity place for the first virtual character controlled by the first user account;
- the display module is further configured to display the conversation message input by the first user account in the first language type in response to the voice input operation on the first client;
- a sending module configured to send the conversation message to the second terminal, so that the second client on the second terminal uses the second language to display the conversation message sent by the first user account;
- the first language type is the language type associated with the first user account or the first client
- the second language type is the language type associated with the second user account or the second client
- the text content of the conversation message is based on voice The voice content entered by the input operation is recognized.
- the input content of the voice input operation can be translated, and conversation messages in different languages can be displayed on the first client and the second client, which facilitates direct communication between users of different languages.
- Communication improves the communication efficiency between users.
- the real-time performance of the system can be improved, and it is convenient for users to obtain information of other users in time.
- FIG. 13 shows a schematic structural diagram of an apparatus for converting text by speech provided by an exemplary embodiment of the present application.
- the apparatus can be implemented as all or a part of the server through software, hardware or a combination of the two, and the apparatus 130 includes:
- a receiving module 131 configured to receive the voice content sent by the first client
- the receiving module 131 is further configured to determine the first language category and the second language category;
- the conversion module 132 is used to convert the speech content into a conversation message of the first language type according to the speech content and the first language type, and the text content of the conversation message is recognized based on the speech content;
- a translation module 133 configured to translate the conversation message of the second language type according to the conversation message of the first language type and the second language type;
- the sending module 134 is configured to send the conversation message of the second language type to the second client.
- the receiving module 131 is further configured to receive the first language type sent by the first client; and receive the second language type sent by the second client.
- the sending module 134 is further configured to send a language category acquisition request to the second client.
- the server converts the voice content into conversation messages in the first language, and then translates the conversation messages in the first language into conversation messages in the second language, which is convenient for users of different languages Direct communication between users improves the communication efficiency between users.
- using a server can improve the accuracy of conversion and translation, and provide users with more accurate results.
- the present application also provides a terminal, the terminal includes a processor and a memory, the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the method for displaying a virtual world screen provided by the above method embodiments. It should be noted that the terminal may be the terminal provided in FIG. 14 below.
- FIG. 14 shows a structural block diagram of a terminal provided by an exemplary embodiment of the present application.
- the terminal may be the aforementioned first terminal or the second terminal.
- the terminal 1400 can be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, the standard audio level 3 of moving picture expert compression), MP4 (Moving Picture Experts Group Audio Layer IV, moving picture expert compression standard audio layer IV) Level 4) Player, laptop or desktop computer.
- Terminal 1400 may also be called user equipment, portable terminal, laptop terminal, desktop terminal, and the like by other names.
- the terminal 1400 includes: a processor 1401 and a memory 1402 .
- the processor 1401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like.
- the processor 1401 can use at least one hardware form among DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, programmable logic array) accomplish.
- the processor 1401 may also include a main processor and a coprocessor.
- the main processor is a processor used to process data in the wake-up state, also called CPU (Central Processing Unit, central processing unit); the coprocessor is A low-power processor for processing data in a standby state.
- the processor 1401 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen.
- the processor 1401 may further include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.
- AI Artificial Intelligence, artificial intelligence
- Memory 1402 may include one or more computer-readable storage media, which may be non-transitory. Memory 1402 may also include high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices. In some embodiments, a non-transitory computer-readable storage medium in the memory 1402 is used to store at least one computer-readable instruction for execution by the processor 1401 to implement the methods herein The embodiment provides a method for displaying a picture of a virtual world.
- the terminal 1400 may optionally further include: a peripheral device interface 1403 and at least one peripheral device.
- the processor 1401, the memory 1402 and the peripheral device interface 1403 may be connected through a bus or a signal line.
- Each peripheral device can be connected to the peripheral device interface 1403 through a bus, a signal line or a circuit board.
- the peripheral device includes: at least one of a radio frequency circuit 1404 , a display screen 1405 , a camera assembly 1406 , an audio circuit 1407 , a positioning assembly 1408 and a power supply 1409 .
- FIG. 14 does not constitute a limitation on the terminal 1400, and may include more or less components than the one shown, or combine some components, or adopt different component arrangements.
- FIG. 15 is a schematic structural diagram of a server provided by an embodiment of the present application.
- the server 1500 includes a central processing unit (English: Central Processing Unit, referred to as: CPU) 1501, includes a random access memory (English: Random Access Memory, referred to as: RAM) 1502 and a read-only memory (English: Read-Only Memory, abbreviated as: ROM) 1503 of the system memory 1504, and the system bus 1505 connecting the system memory 1504 and the central processing unit 1501.
- Computer device 1500 also includes a basic input/output system (I/O system) 1506 that facilitates the transfer of information between various devices within the computer, and a mass storage device for storing operating system 1513, application programs 1514, and other program modules 1515 1507.
- I/O system basic input/output system
- the basic input/output system 1506 includes a display 1508 for displaying information and input devices 1509 such as a mouse, keyboard, etc., for user input of information. Both the display 1508 and the input device 1509 are connected to the central processing unit 1501 through the input/output controller 1510 connected to the system bus 1505.
- Basic input/output system 1506 may also include input/output controller 1510 for receiving and processing input from various other devices such as a keyboard, mouse, or electronic stylus. Similarly, input/output controller 1510 also provides output to a display screen, printer, or other type of output device.
- Mass storage device 1507 is connected to central processing unit 1501 through a mass storage controller (not shown) connected to system bus 1505 .
- Mass storage device 1507 and its associated computer-readable media provide non-volatile storage for server 1500. That is, the mass storage device 1507 may include a computer-readable medium (not shown) such as a hard disk or a compact disc read-only memory (English: Compact Disc Read-Only Memory, CD-ROM for short) drive.
- Computer-readable media can include computer storage media and communication media.
- Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
- Computer storage media include RAM, ROM, Erasable Programmable Read-Only Memory (English: Erasable Programmable Read-Only Memory, referred to as: EPROM), Electrically Erasable Programmable Read-Only Memory (English: Electrically Erasable Programmable Read-Only Memory) , referred to as: EEPROM), flash memory or other solid-state storage technology, CD-ROM, Digital Versatile Disc (English: Digital Versatile Disc, referred to as: DVD) or other optical storage, tape cassettes, magnetic tape, disk storage or other magnetic storage devices.
- the system memory 1504 and the mass storage device 1507 described above may be collectively referred to as memory.
- the server 1500 may also operate on a remote computer connected to a network through a network such as the Internet. That is, the server 1500 may be connected to the network 1512 through the network interface unit 1511 connected to the system bus 1505, or may use the network interface unit 1511 to connect to other types of networks or remote computer systems (not shown).
- a computer storage medium is also provided, where at least one piece of program code is stored in the computer-readable storage medium, and the program code is loaded and executed by a processor to implement the above-mentioned method for speech-to-text conversion.
- a computer program product or computer program wherein the computer program product or computer program includes computer-readable instructions, and the computer-readable instructions are stored in a computer-readable storage medium.
- the processor of the computer device reads the computer-readable instructions from the computer-readable storage medium, and the processor executes the computer-readable instructions, so that the computer device executes the above-mentioned method for converting speech to text.
- references herein to "a plurality” means two or more.
- "And/or" which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone.
- the character “/” generally indicates that the associated objects are an "or" relationship.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Information Transfer Between Computers (AREA)
Abstract
一种语音转换文字的方法,包括:第一客户端显示第一用户界面,第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;第二客户端显示第二用户界面,第二用户界面是为第二用户账号控制的第二虚拟角色提供虚拟活动场所的虚拟环境的展示画面;响应于第一客户端上的语音输入操作,第一客户端采用第一语言种类显示第一用户账号输入的会话消息,第二客户端采用第二语言种类显示第一用户账号发送的所述会话消息。
Description
本申请要求于2020年12月18日提交中国专利局,申请号为202011504638.0,申请名称为“语音转换文字的方法、系统、设备及介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及人机交互领域,特别涉及一种语音转换文字的方法、系统、设备及介质。
在基于竞技对抗的应用程序中,多名用户会被分为敌对的两组,用户操纵虚拟环境中的虚拟角色进行行走、购买、治疗、战斗等动作,并且同一组用户在该虚拟环境中协同完成某项任务。
相关技术中,在基于竞技对抗的应用程序中实现语音转换文字,通常不具备语言转换的功能,导致使用不同语言种类的用户在同一场对战中,使用不同的语言交流,用户之间很难交流。
发明内容
一种语音转换文字的方法,应用于至少两个客户端中,该方法包括:
第一客户端显示第一用户界面,所述第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;
第二客户端显示第二用户界面,所述第二用户界面是为第二用户账号控制的第二虚拟角色提供虚拟活动场所的虚拟环境的展示画面;
响应于所述第一客户端上的语音输入操作,所述第一客户端采用第一语言种类显示所述第一用户账号输入的会话消息,所述第二客户端采用第二语言种类显示所述第一用户账号发送的所述会话消息,所述第一语言种类是与所述第一用户账号或所述第一客户端关联的语言种类,所述第二语言种类是与所述第二用户账号或所述第二客户端关联的语言种类,所述会话消息的文字内容是基于所述语音输入操作所输入的语音内容识别到的。
一种语音转换文字的方法,应用于服务器,该方法包括:
接收由第一客户端发送的语音内容;
确定第一语言种类和第二语言种类,所述第一语言种类是与第一用户账号或所述第一客户端关联的语言种类,所述第二语言种类是与第二用户账号或所述第二客户端关联的语言种类;
根据所述语音内容和所述第一语言种类,将所述语音内容转换为所述第一语言种类的会话消息,所述会话消息的文字内容是基于所述语音内容识别到的;
根据所述第一语言种类的所述会话消息和所述第二语言种类,翻译获得所述第二语言种类的所述会话消息;
将所述第二语言种类的所述会话消息发送给第二客户端。
一种语音转换文字的系统,该系统包括第一装置和第二装置,该系统包括:
所述第一装置,用于显示第一用户界面,所述第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;
所述第二装置,用于显示第二用户界面,所述第二用户界面是为第二用户账号控制的第二虚拟角色提供虚拟活动场所的虚拟环境的展示画面;
所述第一装置,还用于响应于所述第一装置上的语音输入操作,采用第一语言种类显示所述第一用户账号输入的会话消息,所述第一语言种类是与所述第一用户账号或所述第一客户端关联的语言种类,所述会话消息的文字内容是基于所述语音输入操作所输入的语音内容识别到的;
所述第二装置,还用于采用第二语言种类显示所述第一用户账号发送的所述会话消息,所述第二语言种类是与所述第二用户账号或所述第二客户端关联的语言种类。
一种语音转换文字的装置,该装置包括:
接收模块,用于接收由第一客户端发送的语音内容;
所述接收模块,还用于确定第一语言种类和第二语言种类,所述第一语言种类是与第一用户账号或所述第一客户端关联的语言种类,所述第一用户账号用于在所述第一客户端提供的虚拟环境的虚拟活动场所中控制第一虚拟角色,所述第二语言种类是与第二用户账号或第二客户端关联的语言种类,所述第二用户账号用于在所述第二客户端提供的虚拟环境的虚拟活动场所中控制第二虚拟角色;
转换模块,用于根据所述语音内容和所述第一语言种类,将所述语音内容转换为所述第一语言种类的会话消息,所述会话消息的文字内容是基于所述语音内容识别到的;
翻译模块,用于根据所述第一语言种类的所述会话消息和所述第二语言种类,翻译获得所述第二语言种类的所述会话消息;
发送模块,用于将所述第二语言种类的所述会话消息发送给所述第二客户端。
一种计算机设备,包括存储器和一个或多个处理器,所述存储器存储有计算机程序可读指令,所述计算机可读指令被所述一个或多个处理器执行时,使得所述一个或多个处理器实现上述的语音转换文字的方法。
一个或多个存储有计算机可读指令的非易失性计算机可读存储介质,其上存储有计算机可读指令,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器实现上述的语音转换文字的方法。
一种计算机程序产品或计算机程序,上述计算机程序产品或计算机程序包括计算机可读指令,上述计算机可读指令存储在计算机可读存储介质中。计算机设备的处理器从上述计算机可读存储介质读取上述计算机可读指令,上述处理器执行上述计算机可读指令,使得上述计算机设备执行上述语音转换文字的方法。
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的 附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本申请一个示例性实施例提供的计算机系统的结构框图;
图2是本申请一个示例性实施例提供的语音转换文字的方法的流程图;
图3是本申请一个示例性实施例提供的摄像机模型的示意图;
图4是本申请一个示例性实施例提供的语音转换文字的方法的界面示意图;
图5是本申请一个示例性实施例提供的语音转换文字的方法的界面示意图;
图6是本申请一个示例性实施例提供的语音转换文字的方法的流程图;
图7是本申请一个示例性实施例提供的语音转换文字的方法的界面示意图;
图8是本申请一个示例性实施例提供的语音转换文字的方法的流程图;
图9是本申请一个示例性实施例提供的语音转换文字的方法的界面示意图;
图10是本申请一个示例性实施例提供的语音转换文字的方法的界面示意图;
图11是本申请一个示例性实施例提供的语音转换文字的方法的流程图;
图12是本申请一个示例性实施例提供的语音转换文字的系统的结构示意图;
图13是本申请一个示例性实施例提供的语音转换文字的装置的结构示意图;
图14是本申请一个示例性实施例提供的终端的结构框图;
图15是本申请一个示例性实施例提供的服务器的结构示意图。
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。
首先,对本申请实施例中涉及的名词进行介绍:
虚拟环境:是客户端上运行时显示(或提供)的虚拟环境。该虚拟环境可以是三维虚拟环境,也可以是二维虚拟环境。该三维虚拟环境可以是对真实世界的仿真环境,也可以是半仿真半虚构的环境,还可以是纯虚构的环境。
虚拟角色:指在虚拟环境中的可活动角色。该可活动角色可以是虚拟人物、虚拟动物、动漫人物等,比如:在虚拟环境中显示的人物、动物、植物、油桶、墙壁、石块等。可选地,当虚拟环境为三维虚拟环境时,虚拟角色是基于动画骨骼技术创建的三维立体模型,每个虚拟角色在三维虚拟环境中具有自身的形状和体积,占据三维虚拟环境中的一部分空间。可选地,当虚拟环境为二维虚拟环境时,虚拟角色是基于动画技术创建的二维平面模型,每个虚拟角色在二维虚拟环境中具有自身的形状和面积,占据二维虚拟环境中的一部分面积。
多人在线战术竞技:在虚拟环境中,分属至少两个敌对阵营的不同虚拟队伍分别占据各自的地图区域,以某一种胜利条件作为目标进行竞技。该胜利条件包括但不限于:占领据点或摧毁敌对阵营据点、击杀敌对阵营的虚拟角色、在指定场景和时间内保证自身的存活、抢夺到某种资源、在指定时间内比分超过对方中的至少一种。战术竞技可以以局为单位来进行,每局战术竞技的地图可以相同,也可以不同。每个虚拟队伍包括一个或多个虚拟角色,比如1个、2个、3个或5个。
MOBA(Multiplayer Online Battle Arena)游戏:是一种在虚拟环境中提供若干个据点,处于不同阵营的用户控制虚拟角色在虚拟环境中对战,占领据点或摧毁敌对阵营据点的游戏。例如,MOBA游戏可将用户分成两个敌对阵营,将用户控制的虚拟角色分散在虚拟环境中互相竞争,以摧毁或占领敌方的全部据点作为胜利条件。MOBA游戏以局为单位,一局MOBA游戏的持续时间是从游戏开始的时刻至达成胜利条件的时刻。
FPS(First Person Shooting game)游戏:是一种在虚拟环境中提供若干个据点,处于不同阵营的用户控制虚拟角色在虚拟环境中对战,占领据点或摧毁敌对阵营据点或击杀敌对阵营全部或部分角色的游戏。通常,FPS游戏中用户以第一人称视角进行游戏,用户也可以选择第三人称视角进行游戏。例如,FPS游戏可将用户分成两个敌对阵营,将用户控制的虚拟角色分散在虚拟环境中互相竞争,以击杀敌方的全部用户作为胜利条件。FPS游戏以局为单位,一局FPS游戏的持续时间是从游戏开始的时刻至达成胜利条件的时刻。
SLG(Simulation Games)游戏:是一种在虚拟环境中提供虚拟资源,模拟现实的游戏类型。例如,SLG游戏可将多名用户分入单个阵营,多名用户协同完成指定任务。可选地,一局SLG游戏通常不存在具体的胜利条件。
语音转换文字:指将用户输入语音内容转换为文字,并进行输出。示例性的,用户输入语音内容“早上好”,则会输出相应的文字“早上好”。通常而言,语音转换文字同时只支持将语音内容转换一种语言种类。
图1示出了本申请一个示例性实施例提供的计算机系统的结构框图。该计算机系统100包括:第一终端120、服务器140和第二终端160。
第一终端120安装和运行有支持虚拟环境的客户端。该客户端可以是MOBA游戏、虚拟现实客户端、三维地图客户端、军事仿真客户端、FPS游戏多人枪战类生存游戏、SLG游戏中的任意一种。第一终端120是第一用户使用的终端,第一用户账户是第一用户所持有的账户。第一用户使用第一终端120操作位于三维虚拟环境中的第一虚拟角色进行活动,该活动包括但不限于:攻击、释放技能、购买道具、治疗、调整身体姿态、爬行、步行、骑行、飞行、跳跃、驾驶、拾取、射击、投掷中的至少一种。示意性的,第一虚拟角色是第一虚拟人物。
第一终端120通过无线网络或有线网络与服务器140相连。
服务器140包括一台服务器、多台服务器、云计算平台和虚拟化中心中的至少一种。服务器140用于为支持虚拟环境的客户端提供后台服务。可选地,服务器140承担主要计算工作,第一终端120和第二终端160承担次要计算工作;或者,服务器140承担次要计算工作,第一终端120和第二终端160承担主要计算工作;或者,服务器140、第一终端120和第二终端160三者之间采用分布式计算架构进行协同计算。
第二终端160安装和运行有支持虚拟环境的客户端。该客户端可以是MOBA游戏、虚拟现实客户端、三维地图客户端、军事仿真客户端、FPS游戏、多人枪战类生存游戏、SLG游戏中的任意一种。第二终端160是第二用户使用的终端,第二用户账户是第一用户所持有的账户。第二用户使用第二终端160操作位于虚拟环境中的第二虚拟角色进行活动,该活动包括但不限于:攻击、释放技能、购买道具、治疗、调整身体姿态、爬行、步行、骑行、飞行、跳跃、驾驶、拾取、射击、投掷中的至少一种。示意性的,第二虚拟角 色是第二虚拟人物。第一虚拟角色和第二虚拟角色可以属于同一个队伍、同一个组织、具有好友关系或具有临时性的通讯权限,第一虚拟角色和第二虚拟角色也可以属于不同队伍或不同组织。
可选地,第一终端120和第二终端160上安装的客户端是相同的,或不同平台的同一类型客户端。第一终端120可以泛指多个终端中的一个,第二终端160可以泛指多个终端中的一个,本实施例仅以第一终端120和第二终端160来举例说明。第一终端120和第二终端160的设备类型相同或不同,该设备类型包括:智能手机、平板电脑、电子书阅读器、MP3播放器、MP4播放器、膝上型便携计算机和台式计算机中的至少一种。
在一个示意性的实施例中,第一终端120上的第一客户端可以显示第一用户界面,第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;第二终端160上的第二客户端可以显示第二用户界面,第二用户界面是为第二用户账号控制的第二虚拟角色提供虚拟活动场所的虚拟环境的展示画面;响应于第一客户端上的语音输入操作,第一客户端采用第一语言种类显示第一用户账号输入的会话消息,第二客户端采用第二语言种类显示第一用户账号发送的会话消息;第一语言种类是与第一用户账号或第一客户端关联的语言种类,第二语言种类是与第二用户账号或第二客户端关联的语言种类,会话消息的文字内容是基于语音输入操作所输入的语音内容识别到的。
这样,当第一客户端上接收到语言输入操作时,会在不同的客户端上显示不同语言种类的会话消息,可以将输入的语音信息翻译成不同语言种类的会话消息,方便使用不同语言种类的用户进行交流,以消除语言障碍。同时,不需要用户使用额外的翻译软件翻译其它语言种类的会话消息,减少用户的操作步骤,提升人机交互效率。
图2示出了本申请一个示例性实施例提供的语音转换文字的方法的流程图。该方法可由图1所示的第一终端120或第二终端160执行,该方法应用于至少两个客户端中,该方法包括:
步骤202:第一客户端显示第一用户界面,第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面。
第一客户端指在第一终端上运行的客户端程序。可选地,客户端程序包括MOBA游戏、虚拟现实客户端、三维地图客户端、军事仿真客户端、FPS游戏、多人枪战类生存游戏、SLG游戏中的任意一种。
第一用户账户指第一用户所持有的账户。
第一虚拟角色指由在第一客户端中由第一用户操控的主控角色。可选地,第一虚拟角色是人物、动物、植物、动漫角色中的至少一种。
第一用户界面指第一客户端在运行的过程中,在第一终端上所能观察到的画面。可选地,第一用户界面是在虚拟环境中通过摄像机模型对第一虚拟角色进行观察时的画面。
可选地,摄像机模型在虚拟环境中对虚拟角色进行自动跟随,即,当虚拟角色在虚拟环境中的位置发生改变时,摄像机模型跟随虚拟角色在虚拟环境中的位置同时发生改变,且该摄像机模型在虚拟环境中始终处于虚拟角色的预设距离范围内。可选地,在自动跟随过程中,摄像头模型和虚拟角色的相对位置不发生变化。
摄像机模型是指在虚拟环境中位于虚拟角色周围的三维模型,当采用第一人称视角 时,该摄像机模型位于虚拟角色的头部附近或者位于虚拟角色的头部;当采用第三人称视角时,该摄像机模型可以位于虚拟角色的后方并与虚拟角色进行绑定,也可以位于与虚拟角色相距预设距离的任意位置,通过该摄像机模型可以从不同角度对位于虚拟环境中的虚拟角色进行观察,可选地,该第三人称视角为第一人称的过肩视角时,摄像机模型位于虚拟角色(比如虚拟人物的头肩部)的后方。可选地,除第一人称视角和第三人称视角外,视角还包括其他视角,比如俯视视角;当采用俯视视角时,该摄像机模型可以位于虚拟角色头部的上空,俯视视角是以从空中俯视的角度进行观察虚拟环境的视角。可选地,该摄像机模型在虚拟环境中不会进行实际显示,即,在用户界面显示的虚拟环境中不显示该摄像机模型。
对该摄像机模型位于与虚拟角色相距预设距离的任意位置为例进行说明,可选地,一个虚拟角色对应一个摄像机模型,该摄像机模型可以以虚拟角色为旋转中心进行旋转,如:以虚拟角色的任意一点为旋转中心对摄像机模型进行旋转,摄像机模型在旋转过程中的不仅在角度上有转动,还在位移上有偏移,旋转时摄像机模型与该旋转中心之间的距离保持不变,即,将摄像机模型在以该旋转中心作为球心的球体表面进行旋转,其中,虚拟角色的任意一点可以是虚拟角色的头部、躯干、或者虚拟角色周围的任意一点,本申请实施例对此不加以限定。可选地,摄像机模型在对虚拟角色进行观察时,该摄像机模型的视角的中心指向为该摄像机模型所在球面的点指向球心的方向。
可选地,该摄像机模型还可以在虚拟角色的不同方向以预设的角度对虚拟角色进行观察。
示意性的,请参考图3,在虚拟角色11中确定一点作为旋转中心12,摄像机模型围绕该旋转中心12进行旋转,可选地,该摄像机模型配置有一个初始位置,该初始位置为虚拟角色后上方的位置(比如脑部的后方位置)。示意性的,如图3所示,该初始位置为位置13,当摄像机模型旋转至位置14或者位置15时,摄像机模型的视角方向随摄像机模型的转动而进行改变。
可选地,第一用户画面还包括:会话消息、聊天控件、以上帝视角的缩略地图、背包控件、方位指示控件、外放语音开关、麦克风开关、用于移动虚拟角色的控件、用于控制虚拟角色进行预设动作的控件中的至少一种其它显示元素。
示例性的,如图4所示,在第一用户界面上显示有虚拟角色401、聊天控件402、会话消息403、缩略地图404、移动控件405、用户图标406、技能控件407和购买控件408。
步骤204:第二客户端显示第二用户界面,第二用户界面是为第二用户账号控制的第二虚拟角色提供虚拟活动场所的虚拟环境的展示画面。
第二客户端指在第二终端上运行的客户端程序,可选地,客户端程序包括MOBA游戏、虚拟现实客户端、三维地图客户端、军事仿真客户端、FPS游戏、多人枪战类生存游戏、SLG游戏中的任意一种。可选地,第二终端和第一终端的设备种类可以相同或不同。
第二用户账户指第二用户所持有的账户。其中,第一用户账户和第二用户账户不同。
第二虚拟角色指由在第二客户端中由第二用户操控的主控角色。可选地,第二虚拟角色是人物、动物、植物、动漫角色中的至少一种。其中,第一虚拟角色和第二虚拟角色可以相同,也可以不同。
第二用户界面指第二客户端在运行的过程中,在第二终端上所能观察到的画面。可选 地,第二用户界面是在虚拟环境中通过摄像机模型对第二虚拟角色进行观察时的画面。可选地,第二用户界面和第一用户相同,或不同。
可选地,第二用户画面还包括:会话消息、聊天控件、以上帝视角的缩略地图、背包控件、方位指示控件、外放语音开关、麦克风开关、用于移动虚拟角色的控件、用于控制虚拟角色进行预设动作的控件中的至少一种其它显示元素。
示例性的,如图5所示,在第二用户界面上显示有虚拟角色501、聊天控件502、会话消息503、缩略地图504、移动控件505、用户图标506、技能控件507和购买控件508。
步骤206:响应于第一客户端上的语音输入操作,第一客户端采用第一语言种类显示第一用户账号输入的会话消息,第二客户端采用第二语言种类显示第一用户账号发送的会话消息。
语音输入操作指用户将语音内容输入终端中。可选地,语音输入操作可以是按压一个或多个预设的物理按键以输入语音内容,或者,语音输入操作可以是通过在触摸屏的指定区域上进行长按、点击、双击和/或滑动所产生的信号来执行语音输入操作,或者,语音输入操作可以是通过麦克风设备直接输入语音内容。
第一语言种类和第二语言种类所对应的语言种类不同。示例性的,第一语言种类为中文时,第二语言种类为英语。示例性的,语言种类包括但不限于:中文、英语、日语、德语、俄语、拉丁语、法语中的至少一种。
会话消息包括用户名称和对话内容。会话消息和会话消息与语音输入操作所输入的语音内容相对应。示例性的,用户ABC所输入的语音内容为“对不起”,第一语言种类的会话消息为“ABC:对不起”,第二语言种类的会话消息为“ABC:I’m sorry”,会话消息和会话消息所表达的含义应当与输入内容相对应。
可选地,会话消息显示位置可由用户自行设定。例如,用户界面的左上角,或者,用户界面的右下角。本申请对会话消息的具体显示位置不做限定。
示例性的,如图4和图5所示,图4在第一用户界面上显示的会话消息403的内容为“ABC:你好”,图5在第二用户界面上显示的会话消息503的内容为“ABC:Hello”,会话消息403和会话消息503的语言种类不同,但两者所表达的含义相同。
综上所述,本实施例可以对语音输入操作的输入内容进行翻译,在第一客户端和第二客户端上显示不同的语言种类的会话消息,便于使用不同语言种类的用户之间直接进行交流,提高了用户之间的交流效率。而且,可以提高系统的实时性,便于用户及时获得其他用户的信息。
图6示出了本申请一个示例性实施例提供的语音转换文字的方法的流程图。该方法可由图1所示的第一终端120或第二终端160执行,该方法应用于至少两个客户端中,该方法包括:
步骤601:显示第一用户界面。
第一客户端显示第一用户界面。
步骤602:显示第二用户界面。
第二客户端显示第二用户界面。
步骤601和步骤602在时序上不分先后。
步骤603:响应于第一客户端上的语音输入操作,第一客户端获得语音内容。
语音内容指用户通过第一客户端输入的语音信息。可选地,第一客户端通过语音采集设备获得语音内容,或者,第一客户端通过网络下载语音内容,或者,第一客户端接收由其他客户端发送的语音内容,或者,第一客户端查询本地存储获得语音内容。
步骤604:发送语音内容。
第一客户端将语音内容发送给服务器。
可选地,第一客户端将语音内容和第一语言种类发送给服务器。
步骤605:确定第一语言种类和第二语言种类。
服务器确定第一语言种类和第二语言种类。
服务器通过接收由第一客户端发送的第一语言种类,或者,在服务器中存储有第一语言种类。
服务器通过接收由第二客户端发送的第二语言种类,或者,在服务器中存储有第二语言种类。
可选地,本步骤包括以下两个步骤中的至少一个:
1、第一客户端向服务器发送第一语言种类。
服务器接收第一客户端发送的第一语言种类,并确定第一语言种类。
示例性的,第一客户端向服务器发送版本信息,该版本信息中包括第一语言种类,或者,第一客户端向服务器发送地域信息,该地域信息与第一语言种类相对应,例如,地域信息表示第一客户端位于中国,则第一语言种类为中文,或者,第一客户端向服务器发送第一终端的语言设置,该语言设置中包括第一语言种类。
2、第二客户端向服务器发送第二语言种类。
服务器接收第二客户端发送的第二语言种类,并确定第二语言种类。
可选地,服务器接收由第二客户端发送的第二语言种类,以确定第二语言种类。示例性的,第二客户端向服务器发送版本信息,该版本信息中包括第二语言种类,或者,第二客户端向服务器发送地域信息,该地域信息与第二语言种类相对应,例如,地域信息表示第二客户端位于中国,则第二语言种类为中文,或者,第二客户端向服务器发送第二终端的语言设置,该语言设置中包括第二语言种类。
可选地,第二客户端接收由服务器发送的语言种类获取请求;第二客户端根据语言种类获取请求,向服务器发送第二语言种类。语言种类获取请求用于服务器向客户端请求发送语言种类。
步骤606:根据语音内容生成第一语言种类的会话消息和第二语言种类的会话消息。
服务器根据语音内容生成第一语言种类的会话消息和第二语言种类的会话消息。
可选地,服务器将语音内容转换为第一语言种类的会话消息,再将第一语言种类的会话消息翻译为第二语言种类的会话消息。示例性的,服务器将语音内容“对不起”转换为第一语言种类的会话消息“对不起”,再将第一语言种类的会话消息“对不起”翻译为第二语言种类的会话消息“I’m sorry”。
可选地,第一客户端根据语音内容生成第一语言种类的会话消息;第一客户端将第一语言种类的会话消息发送给服务器;服务器根据第一语言种类的会话消息生成第二语言种类的会话消息。即,将生成第一语言种类的会话消息的任务交由第一客户端执行。
步骤607:发送第一语言种类的会话消息。
服务器将第一语言种类的会话消息发送给第一客户端。
步骤608:发送第二语言种类的会话消息。
服务器将第二语言种类的会话消息发送给第二客户端。
步骤607和步骤608在时序上不分先后。
步骤609:接收到第一语言种类的会话消息。
第一客户端接收到由服务器发送的第一语言种类的会话消息。
步骤610:采用第一语言种类显示会话消息。
第一客户端在第一用户界面上显示第一语言种类的会话消息。
步骤611:取消显示会话消息。
第一客户端取消显示第一语言种类的会话消息。
可选地,当以第一语言种类显示的会话消息的显示时间达到预设时长时,第一客户端取消显示会话消息。示例性的,当会话消息显示10秒后,第一客户端会取消显示会话消息。
可选地,第一客户端响应于第一取消显示操作,取消显示会话消息。第一取消显示操作用于取消显示会话消息。其中,第一取消显示操作可以是按压一个或多个预设的物理按键以取消显示会话消息,或者,第一取消显示操作可以是通过在触摸屏的指定区域上进行长按、点击、双击和/或滑动所产生的信号来执行第一取消显示操作,或者,第一取消显示操作可以是通过识别输入的语音内容来执行第一取消显示操作。
步骤612:接收到第二语言种类的会话消息。
可选地,第二客户端接收到由服务器发送的第一语言种类的会话消息;第二客户端根据第一语言种类的会话消息和第二语言种类确定第二语言种类的会话消息。即,将确定第二语言种类的会话消息的任务交由第二客户端完成。
步骤613:采用第二语言种类显示会话消息。
可选地,响应于第一客户端上的语音输入操作,第二客户端在第二用户界面上显示第一语言种类的会话消息和第二语言种类的会话消息。如图7所示,在第二用户界面上显示的会话消息包括第一语言种类的会话消息和第二语言种类的会话消息,其中,第一语言种类的会话消息为“你好”,第二语言种类的会话消息为“Hello”。并且,同时显示第一语言种类的会话消息和第二语言种类的会话消息可以帮助用户学习其他语言种类,便于用户之后更好地进行交流。
步骤614:取消显示会话消息。
第二客户端取消显示第二语言种类的会话消息。
可选地,当以第二语言种类显示的会话消息的显示时间达到预设时长时,第二客户端取消显示会话消息。示例性的,当会话消息显示10秒后,第二客户端会取消显示会话消息。
可选地,第二客户端响应于第二取消显示操作,取消显示会话消息。第二取消显示操作用于取消显示会话消息。其中,第二取消显示操作可以是按压一个或多个预设的物理按键以取消显示会话消息,或者,第二取消显示操作可以是通过在触摸屏的指定区域上进行长按、点击、双击和/或滑动所产生的信号来执行第二取消显示操作,或者,第二取消显 示操作可以是通过识别输入的语音内容来执行第二取消显示操作。第二取消显示操作和第一取消显示操作的具体操作方式可以相同,也可以不同,本申请对此不作具体限定。
综上所述,本实施例可以对语音输入操作的输入内容进行翻译,在第一客户端和第二客户端上显示不同的语言种类的会话消息,便于使用不同语言种类的用户之间直接进行交流,提高了用户之间的交流效率。
并且,通过服务器进行语音转换和会话消息翻译,使得获得的会话消息和会话消息更为准确,提高了语音转换和信息翻译的准确率。
此外,用户还可以根据自身的需要取消显示会话消息和会话消息,防止会话消息和会话消息干扰用户的操作。
在本申请中,用户还可以通过更为快捷的方式来实现语音转换文字。
图8示出了本申请一个示例性实施例提供的语音转换文字的方法的流程图。该方法可由图1所示的第一终端120或第二终端160执行,该方法应用于至少两个客户端中,该方法包括:
基于图2实施例的可选实施例中,上面步骤202至步骤204可替代实现成为如下步骤802至步骤804。
步骤802:第一客户端显示第一用户界面。
步骤804:第二客户端显示第二用户界面。
步骤806:响应于对第一客户端上的聊天控件的第一触发操作,第一客户端采用第一语言种类显示会话消息,第二客户端采用第二语言种类显示会话消息。
聊天控件用于不同客户端之间的用户进行信息交流。示例性的,用户点击聊天控件,并输入文本。
第一触发操作用于使用第一客户端的用户输入语音内容。其中,第一触发操作可以是按压一个或多个预设的物理按键以输入语音内容,或者,第一触发操作可以是通过在触摸屏的指定区域上进行长按、点击、双击和/或滑动所产生的信号来执行第一触发操作。
可选地,给出一种输入语音内容并显示会话消息的实现方式:
1、响应于对第一客户端上的聊天控件的开始输入操作,第一客户端在聊天控件的周侧位置显示语音收录提示,开始接收语音内容。
开始输入操作用于控制第一客户端开始接收语音内容。其中,开始输入操作可以是按压一个或多个预设的物理按键以开始接收语音内容,或者,开始输入操作可以是通过在触摸屏的指定区域上进行长按、点击、双击和/或滑动所产生的信号来执行开始输入操作。
语音收录提示用于提示用户第一客户端正在接受语音内容。可选地,语音收录提示是文字、图标、声音、影像、震动反馈、灯光中的至少一种或多种的组合。
可选地,语音收录提示显示在聊天控件的上侧、下侧、左侧、右侧、左上侧、左下侧、右上侧、右下侧中的至少一种。
示例性的,如图9所示,用户长按第一客户端上的聊天控件402,显示语音收录提示901,其中,语音收录提示901显示有话筒图标和文字提示“倒计时:9s”和“手指左划取消”。
2、响应于对第一客户端上的聊天控件的结束输入操作,第一客户端取消显示语音收 录提示,结束接收语音内容。
结束输入操作用于控制第一客户端结束接收语音内容。其中,结束输入操作可以是按压一个或多个预设的物理按键以结束输入语音内容,或者,结束输入操作可以是通过在触摸屏的指定区域上进行长按、点击、双击和/或滑动所产生的信号来执行结束输入操作。
可选地,当语音内容的输入时长达到时长阈值时,第一客户端取消显示语音收录提示,结束接收语音内容。示例性的,当用户输入一段10秒的语音内容时,语音内容的输入时长达到时长阈值,第一客户端结束接收语音内容。
示例性的,如图10所示,用户长按聊天控件402并输入语音内容,用户松开聊天控件402,结束输入语音内容,或者,用户继续长按聊天控件9秒直至达到时长阈值,第一客户端结束接收语音内容。
示例性的,如图10所示,在语音转换的过程中会显示转换提醒1001,其中,转换提醒1001显示有“转换中”。
可选地,在完成语音内容的输入后,第一客户端显示语音转换提示。语音转换提示用于提示用户语音内容输入已经完成和语音内容正在被转换为会话消息。语音转换提示是文字、图标、声音、影像、震动反馈、灯光中的至少一种或多种的组合。
3、第一客户端采用第一语言种类显示会话消息,第二客户端采用第二语言种类显示会话消息。
示例性的,如图4和图5所示,第一客户端采用第一语言种类显示会话消息403,第二客户端采用第二语言种类显示会话消息503,其中,会话消息403为“ABC:你好”,会话消息503为“ABC:Hello”。
综上所述,本实施例为用户输入语音内容提供了快捷方式,便于用户快速输入语音内容,可以减少用户的操作步骤,提高人机交互效率。
图11示出了本申请一个示例性实施例提供的语音转换文字的方法的流程图。该方法可由图1所示的服务器140执行,服务器140至少与两个客户端连接,该方法包括:
步骤1101:接收由第一客户端发送的语音内容。
服务器接收由第一客户端发送的语音内容。
步骤1102:确定第一语言种类和第二语言种类。
可选地,服务器接收由第一客户端发送的第一语言种类,以确定第一语言种类。
可选地,第一客户端向服务器发送版本信息,该版本信息中包括第一语言种类,或者,第一客户端向服务器发送地域信息,该地域信息与第一语言种类相对应,例如,地域信息表示第一客户端位于中国,则第一语言种类为中文,或者,第一客户端向服务器发送第一终端的语言设置,该语言设置包括第一语言种类。
可选地,服务器接收由第二客户端发送的第二语言种类,以确定第二语言种类。
可选地,第二客户端向服务器发送版本信息,该版本信息中包括第二语言种类,或者,第二客户端向服务器发送地域信息,该地域信息与第二语言种类相对应,例如,地域信息表示第二客户端位于中国,则第二语言种类为中文,或者,第二客户端向服务器发送第二终端的语言设置,该语言设置包括第二语言种类。
可选地,服务器向第二客户端发送语言种类获取请求,服务器接收由第二客户端发送 的第二语言种类。其中,语言种类获取请求用于服务器向客户端请求发送语言种类。
步骤1103:根据语音内容和第一语言种类,将语音内容转换为第一语言种类的会话消息。
可选地,服务器将语音内容转换为会话消息。示例性的,服务器将语音内容“对不起”转换为会话消息“对不起”。
步骤1104:根据第一语言种类的会话消息和第二语言种类,翻译获得第二语言种类的会话消息。
可选地,服务器将第一语言种类的会话消息翻译为第二语言种类的会话消息。示例性的,服务器将第一语言种类的会话消息“对不起”翻译为第二语言种类的会话消息“I’m sorry”。
步骤1105:将第二语言种类的会话消息发送给第二客户端。
服务器将第二语言种类的会话消息发送给第二客户端。
综上所述,本实施例在服务器中将语音内容转换为会话消息,再将会话消息翻译为会话消息,便于使用不同语言种类的用户之间直接进行交流,提高了用户之间的交流效率。同时,使用服务器可以提高转换和翻译的正确率,为用户提供更为准确的结果。
可选地,本申请运用于MOBA游戏中。示例性的,用户A和用户B在游玩MOBA游戏的过程中,用户A输入中文的语音内容后,在用户A的客户端显示中文的会话消息,在用户B的客户端显示英文的会话消息。
可选地,本申请运用于FPS游戏中。示例性的,用户A和用户B在游玩FPS游戏的过程中,用户A输入中文的语音内容后,在用户A的客户端显示俄语的会话消息,在用户B的客户端显示英文的会话消息。
可选地,本申请运用于SLG游戏中。示例性的,用户A和用户B在游玩SLG游戏的过程中,用户A输入中文的语音内容后,在用户A的客户端显示中文的会话消息,在用户B的客户端显示日语的会话消息。
在一个示例性实施例中,还提供了一种语音转换文字的方法。该方法可由图1所示的第一终端120执行,该方法包括:
显示第一用户界面,第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;
响应于第一客户端上的语音输入操作,采用第一语言种类显示第一用户账号输入的会话消息;
将会话消息发送至第二终端,以使第二终端上的第二客户端采用第二语言种类显示第一用户账号发送的会话消息;
其中,第一语言种类是与第一用户账号或第一客户端关联的语言种类,第二语言种类是与第二用户账号或第二客户端关联的语言种类,会话消息的文字内容是基于语音输入操作所输入的语音内容识别到的。
综上所述,本实施例可以对语音输入操作的输入内容进行翻译,在第一客户端和第二客户端上显示不同的语言种类的会话消息,便于使用不同语言种类的用户之间直接进行交流,提高了用户之间的交流效率。而且,可以提高系统的实时性,便于用户及时获得其他用户的信息。
图12示出了本申请的一个示例性实施例提供的语音转换文字的系统的结构示意图。该系统可以通过软件、硬件或者两者的结合实现成为计算机设备的全部或一部分,该系统120包括第一装置121和第二装置122,具体包括:
第一装置121,用于显示第一用户界面,第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;
第二装置122,用于显示第二用户界面,第二用户界面是为第二用户账号控制的第二虚拟角色提供虚拟活动场所的虚拟环境的展示画面;
第一装置121,还用于响应于第一装置121上的语音输入操作,采用第一语言种类显示第一用户账号输入的会话消息,第一语言种类是与第一用户账号或第一客户端关联的语言种类,会话消息的文字内容是基于语音输入操作所输入的语音内容识别到的;
第二装置122,还用于采用第二语言种类显示第一用户账号发送的会话消息,第二语言种类是与第二用户账号或第二客户端关联的语言种类。
在本申请的一个可选设计中,第一装置121,还用于响应于第一装置121上的语音输入操作,第一装置获得语音内容;将语音内容发送给服务器,服务器用于根据语音内容生成第一语言种类的会话消息和第二语言种类的会话消息;在接收到由服务器发送的会话消息后,采用第一语言种类显示会话消息。
在本申请的一个可选设计中,第二装置122,还用于在接收到由服务器发送的会话消息后,采用第二语言种类显示会话消息。
在本申请的一个可选设计中,第一装置121,还用于向服务器发送第一语言种类。
在本申请的一个可选设计中,第二装置122,还用于向服务器发送第二语言种类。
在本申请的一个可选设计中,第一装置121,还用于将语音内容和第一语言种类发送给服务器。
在本申请的一个可选设计中,第二装置122,还用于接收由服务器发送的语言种类获取请求;根据语言种类获取请求,向服务器发送第二语言种类。
在本申请的一个可选设计中,第一装置121,还用于响应于对第一装置121上的聊天控件的第一触发操作,采用第一语言种类显示会话消息。
在本申请的一个可选设计中,第二装置122,还用于响应于对第一装置121上的聊天控件的第一触发操作,采用第二语言种类显示会话消息。
在本申请的一个可选设计中,第一装置121,还用于响应于对第一装置121上的聊天控件的开始输入操作,在聊天控件的周侧位置显示语音收录提示,开始接收语音内容;响应于对第一装置上的聊天控件的结束输入操作,取消显示语音收录提示,结束接收语音内容。
在本申请的一个可选设计中,第一装置121,还用于当以第一语言种类显示的会话消息的显示时间达到预设时长时,取消显示会话消息;或,响应于第一取消显示操作,取消显示会话消息。
在本申请的一个可选设计中,第二装置122,还用于当以第二语言种类显示的会话消息的显示时间达到预设时长时,取消显示会话消息;或,响应于第二取消显示操作,取消显示会话消息。
在本申请的一个可选设计中,第二装置122,还用于响应于第一装置121上的语音输入操作,采用第一语言种类和第二语言种类显示会话消息。
综上所述,本实施例通过在第一客户端上接收到语言输入操作时,在不同的客户端上显示不同语言种类的会话消息,可以将输入的语音信息翻译成不同语言种类的会话消息,方便使用不同语种的用户进行交流,消除语言障碍。同时,不需要用户使用额外的翻译软件翻译其它语言种类的会话消息,减少用户的操作步骤,提升人机交互效率。
本申请的一个示例性实施例,还提供了一种语音转换文字的装置。该装置可以通过软件、硬件或者两者的结合实现成为第一终端的全部或一部分,具体包括:
显示模块,用于显示第一用户界面,第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;
显示模块,还用于响应于第一客户端上的语音输入操作,采用第一语言种类显示第一用户账号输入的会话消息;
发送模块,用于将会话消息发送至第二终端,以使第二终端上的第二客户端采用第二语言种类显示第一用户账号发送的会话消息;
其中,第一语言种类是与第一用户账号或第一客户端关联的语言种类,第二语言种类是与第二用户账号或第二客户端关联的语言种类,会话消息的文字内容是基于语音输入操作所输入的语音内容识别到的。
综上所述,本实施例可以对语音输入操作的输入内容进行翻译,在第一客户端和第二客户端上显示不同的语言种类的会话消息,便于使用不同语言种类的用户之间直接进行交流,提高了用户之间的交流效率。而且,可以提高系统的实时性,便于用户及时获得其他用户的信息。
图13示出了本申请的一个示例性实施例提供的语音转换文字的装置的结构示意图。该装置可以通过软件、硬件或者两者的结合实现成为服务器的全部或一部分,该装置130包括:
接收模块131,用于接收由第一客户端发送的语音内容;
接收模块131,还用于确定第一语言种类和第二语言种类;
转换模块132,用于根据语音内容和第一语言种类,将语音内容转换为第一语言种类的会话消息,会话消息的文字内容是基于语音内容识别到的;
翻译模块133,用于根据第一语言种类的会话消息和第二语言种类,翻译获得第二语言种类的会话消息;
发送模块134,用于将第二语言种类的会话消息发送给第二客户端。
在本申请的一个可选设计中,接收模块131,还用于接收由第一客户端发送的第一语言种类;接收由第二客户端发送的第二语言种类。
在本申请的一个可选设计中,发送模块134,还用于向第二客户端发送语言种类获取请求。
综上所述,本实施例在服务器中将语音内容转换为第一语言种类的会话消息,再将第一语言种类的会话消息翻译为第二语言种类的会话消息,便于使用不同语言种类的用户之间直接进行交流,提高了用户之间的交流效率。同时,使用服务器可以提高转换和翻译的正确率,为用户提供更为准确的结果。
本申请还提供了一种终端,该终端包括处理器和存储器,存储器中存储有至少一条指令,至少一条指令由处理器加载并执行以实现上述各个方法实施例提供的虚拟世界的画面显示方法。需要说明的是,该终端可以是如下图14所提供的终端。
图14示出了本申请一个示例性实施例提供的终端的结构框图。该终端可以是前文提及的第一终端或第二终端。该终端1400可以是:智能手机、平板电脑、MP3播放器(Moving Picture Experts Group Audio Layer III,动态影像专家压缩标准音频层面3)、MP4(Moving Picture Experts Group Audio Layer IV,动态影像专家压缩标准音频层面4)播放器、笔记本电脑或台式电脑。终端1400还可能被称为用户设备、便携式终端、膝上型终端、台式终端等其他名称。
通常,终端1400包括有:处理器1401和存储器1402。
处理器1401可以包括一个或多个处理核心,比如4核心处理器、8核心处理器等。处理器1401可以采用DSP(Digital Signal Processing,数字信号处理)、FPGA(Field-Programmable Gate Array,现场可编程门阵列)、PLA(Programmable Logic Array,可编程逻辑阵列)中的至少一种硬件形式来实现。处理器1401也可以包括主处理器和协处理器,主处理器是用于对在唤醒状态下的数据进行处理的处理器,也称CPU(Central Processing Unit,中央处理器);协处理器是用于对在待机状态下的数据进行处理的低功耗处理器。在一些实施例中,处理器1401可以在集成有GPU(Graphics Processing Unit,图像处理器),GPU用于负责显示屏所需要显示的内容的渲染和绘制。一些实施例中,处理器1401还可以包括AI(Artificial Intelligence,人工智能)处理器,该AI处理器用于处理有关机器学习的计算操作。
存储器1402可以包括一个或多个计算机可读存储介质,该计算机可读存储介质可以是非暂态的。存储器1402还可包括高速随机存取存储器,以及非易失性存储器,比如一个或多个磁盘存储设备、闪存存储设备。在一些实施例中,存储器1402中的非暂态的计算机可读存储介质用于存储至少一个计算机可读指令,该至少一个计算机可读指令用于被处理器1401所执行以实现本申请中方法实施例提供的虚拟世界的画面显示方法。
在一些实施例中,终端1400还可选包括有:外围设备接口1403和至少一个外围设备。处理器1401、存储器1402和外围设备接口1403之间可以通过总线或信号线相连。各个外围设备可以通过总线、信号线或电路板与外围设备接口1403相连。具体地,外围设备包括:射频电路1404、显示屏1405、摄像头组件1406、音频电路1407、定位组件1408和电源1409中的至少一种。
本领域技术人员可以理解,图14中示出的结构并不构成对终端1400的限定,可以包括比图示更多或更少的组件,或者组合某些组件,或者采用不同的组件布置。
图15是本申请一个实施例提供的服务器的结构示意图。具体来讲:服务器1500包括中央处理单元(英文:Central Processing Unit,简称:CPU)1501、包括随机存取存储器(英文:Random Access Memory,简称:RAM)1502和只读存储器(英文:Read-Only Memory,简称:ROM)1503的系统存储器1504,以及连接系统存储器1504和中央处理单元1501的系统总线1505。计算机设备1500还包括帮助计算机内的各个器件之间传输信息的基本输入/输出系统(I/O系统)1506,和用于存储操作系统1513、应用程序1514和其他程序模块1515的大容量存储设备1507。
基本输入/输出系统1506包括有用于显示信息的显示器1508和用于用户输入信息的诸如鼠标、键盘之类的输入设备1509。其中显示器1508和输入设备1509都通过连接到系统总线1505的输入/输出控制器1510连接到中央处理单元1501。基本输入/输出系统1506还可以包括输入/输出控制器1510以用于接收和处理来自键盘、鼠标、或电子触控笔等多个其他设备的输入。类似地,输入/输出控制器1510还提供输出到显示屏、打印机或其他类型的输出设备。
大容量存储设备1507通过连接到系统总线1505的大容量存储控制器(未示出)连接到中央处理单元1501。大容量存储设备1507及其相关联的计算机可读介质为服务器1500提供非易失性存储。也就是说,大容量存储设备1507可以包括诸如硬盘或者只读光盘(英文:Compact Disc Read-Only Memory,简称:CD-ROM)驱动器之类的计算机可读介质(未示出)。
不失一般性,计算机可读介质可以包括计算机存储介质和通信介质。计算机存储介质包括以用于存储诸如计算机可读指令、数据结构、程序模块或其他数据等信息的任何方法或技术实现的易失性和非易失性、可移动和不可移动介质。计算机存储介质包括RAM、ROM、可擦除可编程只读存储器(英文:Erasable Programmable Read-Only Memory,简称:EPROM)、电可擦除可编程只读存储器(英文:Electrically Erasable Programmable Read-Only Memory,简称:EEPROM)、闪存或其他固态存储其技术,CD-ROM、数字通用光盘(英文:Digital Versatile Disc,简称:DVD)或其他光学存储、磁带盒、磁带、磁盘存储或其他磁性存储设备。当然,本领域技术人员可知计算机存储介质不局限于上述几种。上述的系统存储器1504和大容量存储设备1507可以统称为存储器。
根据本申请的各种实施例,服务器1500还可以通过诸如因特网等网络连接到网络上的远程计算机运行。也即服务器1500可以通过连接在系统总线1505上的网络接口单元1511连接到网络1512,或者说,也可以使用网络接口单元1511来连接到其他类型的网络或远程计算机系统(未示出)。
根据本申请的另一方面,还提供了一种计算机存储介质,计算机可读存储介质中存储有至少一条程序代码,程序代码由处理器加载并执行以实现如上述的语音转换文字的方法。
根据本申请的另一方面,还提供了一种计算机程序产品或计算机程序,上述计算机程序产品或计算机程序包括计算机可读指令,上述计算机可读指令存储在计算机可读存储介质中。计算机设备的处理器从上述计算机可读存储介质读取上述计算机可读指令,上述处理器执行上述计算机可读指令,使得上述计算机设备执行如上述的语音转换文字的方法。
应当理解的是,在本文中提及的“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。
以上所述仅为本申请的较佳实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。
Claims (20)
- 一种语音转换文字的方法,应用于至少两个客户端中,所述方法包括:第一客户端显示第一用户界面,所述第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;第二客户端显示第二用户界面,所述第二用户界面是为第二用户账号控制的第二虚拟角色提供虚拟活动场所的虚拟环境的展示画面;响应于所述第一客户端上的语音输入操作,所述第一客户端采用第一语言种类显示所述第一用户账号输入的会话消息,所述第二客户端采用第二语言种类显示所述第一用户账号发送的所述会话消息;其中,所述第一语言种类是与所述第一用户账号或所述第一客户端关联的语言种类,所述第二语言种类是与所述第二用户账号或所述第二客户端关联的语言种类,所述会话消息的文字内容是基于所述语音输入操作所输入的语音内容识别到的。
- 根据权利要求1所述的方法,其特征在于,响应于所述第一客户端上的语音输入操作,所述第一客户端采用第一语言种类显示所述第一用户账号输入的会话消息,包括:响应于所述第一客户端上的所述语音输入操作,所述第一客户端获得所述语音内容;所述第一客户端将所述语音内容发送给服务器,以使所述服务器根据所述语音内容生成所述第一语言种类的所述会话消息和所述第二语言种类的所述会话消息;所述第一客户端在接收到由所述服务器发送的所述第一语言种类的所述会话消息后,采用所述第一语言种类显示所述会话消息;所述第二客户端采用第二语言种类显示所述第一用户账号发送的所述会话消息,包括:所述第二客户端在接收到由所述服务器发送的所述第二语言种类的所述会话消息后,采用所述第二语言种类显示所述会话消息。
- 根据权利要求2所述的方法,其特征在于,所述方法还包括如下两个步骤中的至少一个:所述第一客户端向所述服务器发送所述第一语言种类;所述第二客户端向所述服务器发送所述第二语言种类。
- 根据权利要求3所述的方法,其特征在于,所述第一客户端向所述服务器发送所述第一语言种类,包括:所述第一客户端将所述语音内容和所述第一语言种类发送给所述服务器。
- 根据权利要求3所述的方法,其特征在于,所述第二客户端向所述服务器发送所述第二语言种类,包括:所述第二客户端接收由所述服务器发送的语言种类获取请求;所述第二客户端根据所述语言种类获取请求,向所述服务器发送所述第二语言种类。
- 根据权利要求1至5任一所述的方法,其特征在于,所述第一客户端上还显示有聊天控件;所述响应于所述第一客户端上的语音输入操作,所述第一客户端采用第一语言种类显示所述第一用户账号输入的会话消息,所述第二客户端采用第二语言种类显示所述第一用 户账号发送的所述会话消息,包括:响应于对所述第一客户端上的所述聊天控件的第一触发操作,所述第一客户端采用所述第一语言种类显示所述会话消息,所述第二客户端采用所述第二语言种类显示所述会话消息。
- 根据权利要求6所述的方法,其特征在于,所述响应于对所述第一客户端上的所述聊天控件的第一触发操作,所述第一客户端采用第一语言种类显示所述会话消息,包括:响应于对所述第一客户端上的聊天控件的开始输入操作,所述第一客户端在所述聊天控件的周侧位置显示语音收录提示,所述语音收录提示用于提示所述第一客户端开始接收所述语音内容;响应于对所述第一客户端上的聊天控件的结束输入操作,所述第一客户端取消显示所述语音收录提示,用于提示所述第一客户端结束接收所述语音内容;所述第一客户端采用所述第一语言种类显示所述会话消息。
- 根据权利要求1至5任一所述的方法,其特征在于,所述方法还包括:当以所述第一语言种类显示的所述会话消息的显示时间达到预设时长时,所述第一客户端取消显示所述会话消息;或,所述第一客户端响应于第一取消显示操作,取消显示所述会话消息。
- 根据权利要求1至5任一所述的方法,其特征在于,所述方法还包括:当以所述第二语言种类显示的所述会话消息的显示时间达到所述预设时长时,所述第二客户端取消显示所述会话消息;或,所述第二客户端响应于第二取消显示操作,取消显示所述会话消息。
- 根据权利要求1至5任一所述的方法,其特征在于,所述方法还包括:响应于所述第一客户端上的所述语音输入操作,所述第二客户端采用所述第一语言种类和所述第二语言种类显示所述第一用户账号发送的所述会话消息。
- 一种语音转换文字的方法,应用于第一终端,所述方法包括:显示第一用户界面,所述第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;响应于第一客户端上的语音输入操作,采用第一语言种类显示所述第一用户账号输入的会话消息;将所述会话消息发送至第二终端,以使所述第二终端上的第二客户端采用第二语言种类显示所述第一用户账号发送的所述会话消息;其中,所述第一语言种类是与所述第一用户账号或所述第一客户端关联的语言种类,所述第二语言种类是与所述第二用户账号或所述第二客户端关联的语言种类,所述会话消息的文字内容是基于所述语音输入操作所输入的语音内容识别到的。
- 一种语音转换文字的方法,应用于服务器,所述方法包括:接收由第一客户端发送的语音内容;确定第一语言种类和第二语言种类,所述第一语言种类是与第一用户账号或所述第一客户端关联的语言种类,所述第一用户账号用于在所述第一客户端提供的虚拟环境的虚拟活动场所中控制第一虚拟角色,所述第二语言种类是与第二用户账号或第二客户端关联的语言种类,所述第二用户账号用于在所述第二客户端提供的虚拟环境的虚拟活动场所中控制第二虚拟角色;根据所述语音内容和所述第一语言种类,将所述语音内容转换为所述第一语言种类的会话消息,所述会话消息的文字内容是基于所述语音内容识别到的;根据所述第一语言种类的所述会话消息和所述第二语言种类,翻译获得所述第二语言种类的所述会话消息;将所述第二语言种类的所述会话消息发送给所述第二客户端。
- 根据权利要求12所述的方法,其特征在于,所述确定第一语言种类和第二语言种类,包括:接收由所述第一客户端发送的所述第一语言种类;向所述第二客户端发送语言种类获取请求;接收由所述第二客户端发送的所述第二语言种类。
- 一种语音转换文字的系统,所述系统包括第一装置和第二装置,所述系统包括:所述第一装置,用于显示第一用户界面,所述第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;所述第二装置,用于显示第二用户界面,所述第二用户界面是为第二用户账号控制的第二虚拟角色提供虚拟活动场所的虚拟环境的展示画面;所述第一装置,还用于响应于所述第一装置上的语音输入操作,采用第一语言种类显示所述第一用户账号输入的会话消息,所述第一语言种类是与所述第一用户账号或所述第一装置关联的语言种类,所述会话消息的文字内容是基于所述语音输入操作所输入的语音内容识别到的;所述第二装置,还用于采用第二语言种类显示所述第一用户账号发送的所述会话消息,所述第二语言种类是与所述第二用户账号或所述第二装置关联的语言种类。
- 根据权利要求14所述的装置,其特征在于,所述第一装置,还用于响应于所述第一装置上的所述语音输入操作,所述第一装置获得所述语音内容;将所述语音内容发送给服务器,所述服务器用于根据所述语音内容生成所述第一语言种类的所述会话消息和所述第二语言种类的所述会话消息;在接收到由所述服务器发送的所述会话消息后,采用所述第一语言种类显示所述会话消息。
- 根据权利要求14或15任一项所述的装置,其特征在于,所述第一装置,还用于响应于对所述第一装置上的聊天控件的开始输入操作,在所述聊天控件的周侧位置显示语音收录提示,所述语音收录提示用于提示所述第一装置开始接收所述语音内容;响应于对所述第一装置上的聊天控件的结束输入操作,取消显示所述语音收录提示,用于提示所述第一装置结束接收所述语音内容。
- 一种语音转换文字的装置,应用于第一终端,包括:显示模块,用于显示第一用户界面,所述第一用户界面是为第一用户账号控制的第一虚拟角色提供虚拟活动场所的虚拟环境的展示画面;显示模块,还用于响应于第一客户端上的语音输入操作,采用第一语言种类显示所述第一用户账号输入的会话消息;发送模块,用于将所述会话消息发送至第二终端,以使所述第二终端上的第二客户端采用第二语言种类显示所述第一用户账号发送的所述会话消息;其中,所述第一语言种类是与所述第一用户账号或所述第一客户端关联的语言种类,所述第二语言种类是与所述第二用户账号或所述第二客户端关联的语言种类,所述会话消息的文字内容是基于所述语音输入操作所输入的语音内容识别到的。
- 一种语音转换文字的装置,包括:接收模块,用于接收由第一客户端发送的语音内容;所述接收模块,还用于确定第一语言种类和第二语言种类,所述第一语言种类是与第一用户账号或所述第一客户端关联的语言种类,所述第一用户账号用于在所述第一客户端提供的虚拟环境的虚拟活动场所中控制第一虚拟角色,所述第二语言种类是与第二用户账号或第二客户端关联的语言种类,所述第二用户账号用于在所述第二客户端提供的虚拟环境的虚拟活动场所中控制第二虚拟角色;转换模块,用于根据所述语音内容和所述第一语言种类,将所述语音内容转换为所述第一语言种类的会话消息,所述会话消息的文字内容是基于所述语音内容识别到的;翻译模块,用于根据所述第一语言种类的所述会话消息和所述第二语言种类,翻译获得所述第二语言种类的所述会话消息;发送模块,用于将所述第二语言种类的所述会话消息发送给所述第二客户端。
- 一种计算机设备,包括存储器和一个或多个处理器,所述存储器存储有计算机程序,其特征在于,所述计算机可读指令被所述一个或多个处理器执行时,使得所述一个或多个处理器计算机程序时实现权利要求1至13中任一项所述的方法的步骤。
- 一个或多个存储有计算机可读指令的非易失性一种计算机可读存储介质,存储有计算机可读指令程序,其特征在于,所述计算机可读指令程序被一个或多个处理器执行时,使得所述一个或多个处理器实现如权利要1至13中任一项所述的方法的步骤。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020217034957A KR20220088633A (ko) | 2020-12-18 | 2021-09-01 | 음성을 텍스트로 변환하는 방법, 시스템, 장치 및 매체 |
JP2021564719A JP2023510057A (ja) | 2020-12-18 | 2021-09-01 | 音声テキスト変換方法、システム、装置、機器及びプログラム |
US17/500,011 US20220199087A1 (en) | 2020-12-18 | 2021-10-13 | Speech to text conversion method, system, and apparatus, and medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011504638.0A CN112494958B (zh) | 2020-12-18 | 2020-12-18 | 语音转换文字的方法、系统、设备及介质 |
CN202011504638.0 | 2020-12-18 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/500,011 Continuation US20220199087A1 (en) | 2020-12-18 | 2021-10-13 | Speech to text conversion method, system, and apparatus, and medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022127197A1 true WO2022127197A1 (zh) | 2022-06-23 |
Family
ID=74922371
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/115897 WO2022127197A1 (zh) | 2020-12-18 | 2021-09-01 | 语音转换文字的方法、系统、设备及介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112494958B (zh) |
WO (1) | WO2022127197A1 (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112494958B (zh) * | 2020-12-18 | 2022-09-23 | 腾讯科技(深圳)有限公司 | 语音转换文字的方法、系统、设备及介质 |
CN114124864B (zh) * | 2021-09-28 | 2023-07-07 | 维沃移动通信有限公司 | 消息处理方法、装置 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106875764A (zh) * | 2017-04-26 | 2017-06-20 | 北京大生在线科技有限公司 | 基于网络的虚拟现实外语学习系统及控制方法 |
CN110992947A (zh) * | 2019-11-12 | 2020-04-10 | 北京字节跳动网络技术有限公司 | 一种基于语音的交互方法、装置、介质和电子设备 |
CN111309207A (zh) * | 2020-02-06 | 2020-06-19 | 北京一起教育信息咨询有限责任公司 | 一种译文显示方法、装置、电子设备及存储介质 |
WO2020149271A1 (ja) * | 2019-01-15 | 2020-07-23 | 株式会社シーエスレポーターズ | 仮想空間におけるキャラクタの制御方法 |
CN111672099A (zh) * | 2020-05-28 | 2020-09-18 | 腾讯科技(深圳)有限公司 | 虚拟场景中的信息展示方法、装置、设备及存储介质 |
CN112494958A (zh) * | 2020-12-18 | 2021-03-16 | 腾讯科技(深圳)有限公司 | 语音转换文字的方法、系统、设备及介质 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9031829B2 (en) * | 2013-02-08 | 2015-05-12 | Machine Zone, Inc. | Systems and methods for multi-user multi-lingual communications |
WO2019084890A1 (en) * | 2017-11-03 | 2019-05-09 | Tencent Technology (Shenzhen) Company Limited | Method and system for processing audio communications over a network |
CN110619126A (zh) * | 2018-06-20 | 2019-12-27 | 钉钉控股(开曼)有限公司 | 消息处理方法、装置、终端设备 |
CN111046680B (zh) * | 2018-10-15 | 2022-05-24 | 华为技术有限公司 | 一种翻译方法及电子设备 |
CN111415665A (zh) * | 2020-04-07 | 2020-07-14 | 浙江国贸云商控股有限公司 | 视频通话的语音处理方法、装置及电子设备 |
-
2020
- 2020-12-18 CN CN202011504638.0A patent/CN112494958B/zh active Active
-
2021
- 2021-09-01 WO PCT/CN2021/115897 patent/WO2022127197A1/zh active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106875764A (zh) * | 2017-04-26 | 2017-06-20 | 北京大生在线科技有限公司 | 基于网络的虚拟现实外语学习系统及控制方法 |
WO2020149271A1 (ja) * | 2019-01-15 | 2020-07-23 | 株式会社シーエスレポーターズ | 仮想空間におけるキャラクタの制御方法 |
CN110992947A (zh) * | 2019-11-12 | 2020-04-10 | 北京字节跳动网络技术有限公司 | 一种基于语音的交互方法、装置、介质和电子设备 |
CN111309207A (zh) * | 2020-02-06 | 2020-06-19 | 北京一起教育信息咨询有限责任公司 | 一种译文显示方法、装置、电子设备及存储介质 |
CN111672099A (zh) * | 2020-05-28 | 2020-09-18 | 腾讯科技(深圳)有限公司 | 虚拟场景中的信息展示方法、装置、设备及存储介质 |
CN112494958A (zh) * | 2020-12-18 | 2021-03-16 | 腾讯科技(深圳)有限公司 | 语音转换文字的方法、系统、设备及介质 |
Also Published As
Publication number | Publication date |
---|---|
CN112494958B (zh) | 2022-09-23 |
CN112494958A (zh) | 2021-03-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111589126B (zh) | 虚拟对象的控制方法、装置、设备及存储介质 | |
CN112691377B (zh) | 虚拟角色的控制方法、装置、电子设备及存储介质 | |
US8628424B1 (en) | Interactive spectator features for gaming environments | |
JP2021518197A (ja) | 人工知能を使用した音声ヘルプシステム | |
JP2022527662A (ja) | 仮想オブジェクトの制御方法、装置、機器及びコンピュータプログラム | |
CN111228811B (zh) | 虚拟对象的控制方法、装置、设备及介质 | |
WO2022127197A1 (zh) | 语音转换文字的方法、系统、设备及介质 | |
JP7492611B2 (ja) | バーチャルシーンにおけるデータ処理方法、装置、コンピュータデバイス、及びコンピュータプログラム | |
CN112691366B (zh) | 虚拟道具的显示方法、装置、设备及介质 | |
WO2022121503A1 (zh) | 预购道具的显示方法、装置、设备、介质及产品 | |
JP2024019394A (ja) | 仮想オブジェクトの制御方法並びにその、装置、端末及びコンピュータプログラム | |
TWI831074B (zh) | 虛擬場景中的信息處理方法、裝置、設備、媒體及程式產品 | |
US20230065576A1 (en) | Battle settlement interface display method, apparatus, device, and storage medium | |
KR20230042517A (ko) | 연락처 정보 디스플레이 방법, 장치 및 전자 디바이스, 컴퓨터-판독가능 저장 매체, 및 컴퓨터 프로그램 제품 | |
CN113018862B (zh) | 虚拟对象的控制方法、装置、电子设备及存储介质 | |
US20220199087A1 (en) | Speech to text conversion method, system, and apparatus, and medium | |
KR20210151843A (ko) | 가상 객체 제어 방법 및 장치, 컴퓨터 디바이스, 및 저장 매체 | |
US20230033902A1 (en) | Virtual object control method and apparatus, device, storage medium, and program product | |
WO2023024880A1 (zh) | 虚拟场景中的表情显示方法、装置、设备以及介质 | |
KR20230130109A (ko) | 가상 시나리오 디스플레이 방법, 장치, 단말 및 저장매체 | |
CN114356097A (zh) | 虚拟场景的振动反馈处理方法、装置、设备、介质及程序产品 | |
CN114288670B (zh) | 虚拟对象的互动方法、装置、设备及存储介质 | |
WO2024125163A1 (zh) | 基于虚拟世界的角色互动方法、装置、设备和介质 | |
WO2024021847A1 (zh) | 虚拟对象的标记方法、装置、终端及存储介质 | |
JP2019524180A (ja) | 場所ベースゲームプレイコンパニオンアプリケーションを使用するチャレンジの生成 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2021564719 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21905130 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21905130 Country of ref document: EP Kind code of ref document: A1 |