CN113162844A

CN113162844A - Instant messaging method, instant messaging device, electronic equipment and storage medium

Info

Publication number: CN113162844A
Application number: CN202110357580.XA
Authority: CN
Inventors: 张驰
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2021-04-01
Filing date: 2021-04-01
Publication date: 2021-07-23
Anticipated expiration: 2041-04-01
Also published as: WO2022206651A1; CN113162844B

Abstract

The application discloses an instant messaging method, an instant messaging device, electronic equipment and a storage medium, and belongs to the field of communication. The method comprises the following steps: under the condition that a user carries out instant messaging with a plurality of chat objects through a group interface at the same time, receiving first input of a target object identifier in the group interface; responding to the first input, and communicating with opposite-end equipment corresponding to the target chat object and opposite-end equipment corresponding to other chat objects except the target chat object in the plurality of chat objects by using different modes; wherein the modes include a normal mode and a mask mode. The method and the device realize directional communication or directional shielding between the local terminal equipment and the target chat object, and improve the flexibility of communication.

Description

Instant messaging method, instant messaging device, electronic equipment and storage medium

Technical Field

The application belongs to the field of communication, and particularly relates to an instant messaging method, an instant messaging device, electronic equipment and a storage medium.

Background

Currently, a plurality of clients can use social software to perform group video or group voice, and the social software is widely applied to work discussions or remote chatting.

In group video or group voice, video or voice sent by a client is forwarded to all other clients participating in the group video or group voice via the server. Meanwhile, the server forwards the video or voice sent by all other clients at the same time to the client. In the process of implementing the present application, the inventor finds that at least the following problems exist in the prior art:

in the group video or the group voice, if a certain client needs to send the video or the voice to other clients designated in the group video or the group voice, other chat tools need to be used, and the operation is inconvenient.

When the environmental sound of a certain client is too noisy, the client needs to be informed to turn off the microphone, so that the operation is inconvenient.

Disclosure of Invention

An object of the embodiments of the present application is to provide an instant messaging method, an instant messaging apparatus, an electronic device, and a storage medium, which can solve the problem of inconvenient directional communication in group video or group voice.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides an instant messaging method, where the method includes:

under the condition that a user carries out instant messaging with a plurality of chat objects through a group interface at the same time, receiving first input of a target object identifier in the group interface; wherein the target object identification is used to indicate a target chat object of the plurality of chat objects;

responding to the first input, and communicating with opposite-end equipment corresponding to the target chat object and opposite-end equipment corresponding to other chat objects except the target chat object in the plurality of chat objects by using different modes;

wherein the modes include a normal mode and a mask mode;

the normal mode comprises at least one of sending an actual audio and video data packet of the user and receiving and playing the actual audio and video data packet sent by the opposite terminal equipment;

the shielding mode comprises at least one item of actual audio and video data packets which are not sent by the user and actual audio and video data packets which are not received and received but are not played and sent by the opposite terminal equipment.

In a second aspect, an embodiment of the present application provides an apparatus for instant messaging, including:

the system comprises a receiving module, a processing module and a display module, wherein the receiving module is used for receiving a first input of a target object identifier in a group interface under the condition that a user carries out instant messaging with a plurality of chat objects through the group interface simultaneously; wherein the target object identification is used to indicate a target chat object of the plurality of chat objects;

a response module, configured to respond to the first input, and communicate with peer devices corresponding to the target chat object and peer devices corresponding to other chat objects except the target chat object in the plurality of chat objects by using different modes;

wherein the modes include a normal mode and a mask mode;

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In the embodiment of the application, the local terminal device communicates with the opposite terminal devices corresponding to the target chat objects and other chat objects in different modes according to the input of the target object identification in the group interface by the user, so that the directional shielding of the partial chat objects communicated by using the shielding mode is realized, and the flexibility of communication is improved through the directional communication between the local terminal device and the partial chat objects.

Drawings

Fig. 1 is a flow chart of a communication method provided herein;

FIG. 2 is a schematic diagram of a group interface in the communication method provided in the present application;

FIG. 3 is a second schematic diagram of a group interface in the communication method provided in the present application;

FIG. 4 is a third schematic diagram of a group interface in the communication method provided in the present application;

FIG. 5 is a fourth schematic diagram of a group interface in the communication method provided by the present application;

FIG. 6 is a fifth schematic diagram of a group interface in the communication method provided by the present application;

FIG. 7 is a sixth schematic diagram of a group interface in the communication method provided by the present application;

FIG. 8 is a seventh schematic diagram of a group interface in the communication method provided by the present application;

FIG. 9 is an eighth schematic diagram of a group interface in the communication method provided by the present application;

FIG. 10 is a ninth schematic diagram of a group interface in the communication method provided by the present application;

FIG. 11 is a cross-sectional view of a group interface in the communication method provided by the present application;

FIG. 12 is an eleventh schematic diagram of a group interface in the communication method provided by the present application;

FIG. 13 is a twelve-part schematic diagram of a group interface in the communication method provided by the present application;

FIG. 14 is a thirteen schematic diagram of a group interface in the communication method provided by the present application;

fig. 15 is a structural diagram of a communication apparatus provided in the present application;

fig. 16 is a schematic diagram of a hardware structure of an electronic device provided in the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The instant messaging method, the instant messaging device, the electronic device, and the storage medium provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

As shown in fig. 1, an instant messaging method provided in an embodiment of the present application includes:

step 101, receiving a first input of a target object identifier in a group interface under the condition that a user performs instant messaging with a plurality of chat objects through the group interface at the same time; wherein the target object identification is used to indicate a target chat object of the plurality of chat objects;

the execution main body of the instant messaging method provided by the embodiment of the application is the local terminal equipment. The local terminal equipment can be a smart phone, a personal computer, a tablet personal computer or wearable intelligent equipment and the like.

The instant messaging method provided by the embodiment of the application is applied to scenes of group video or group voice chat in social software.

The group interface is a chat interface of group video or group voice. In a group video or group voice scene, the group communication interface includes at least two chat objects.

The target chat object is a certain or some chat objects determined by the user from the chat objects of the group video or the group voice according to actual needs.

For example, if a user wants to listen to his voice or see his video only for a chat object or objects participating in a group video or group voice, the user regards the chat object as a target chat object.

When a user does not want to listen to his or her voice or see his or her video by a chat object or objects participating in a group video or group voice, the chat object is set as a target chat object.

And in the case that the background sound of the video or voice of a certain or some chat objects played by the local terminal equipment is noisy, or the user does not want to hear the speech of the certain or some chat objects, taking the chat objects as target chat objects.

In the case where the user wants to hear only the speech of a certain chat object or objects, the chat object is set as a target chat object. The first input of the user includes a drag operation, a click operation, a keyboard input, and the like, and the embodiment is not limited to a specific form of the first input.

The user firstly opens the social software on the local terminal device and joins in group video or group voice chat. And then, operating the target object identification of the target chat object on a group interface of the group video or group voice chat, and using the operation as a first input of the user to the target chat object.

The local terminal equipment receives a first input of a user to a target chat object.

Step 102, responding to the first input, and communicating with opposite terminal equipment corresponding to the target chat object and opposite terminal equipment corresponding to other chat objects except the target chat object in the plurality of chat objects by using different modes; wherein the modes include a normal mode and a mask mode;

the communication with the opposite terminal equipment corresponding to the target chat object and other chat objects by using different modes comprises the following steps:

using a normal mode to communicate with opposite terminal equipment corresponding to the target chat object, and using a shielding mode to communicate with opposite terminal equipment corresponding to other chat objects; alternatively, the first and second electrodes may be,

and communicating with the opposite terminal equipment corresponding to the target chat object by using a shielding mode, and communicating with the opposite terminal equipment corresponding to other chat objects by using a normal mode.

the audio and video data packet is an audio data packet or a video data packet.

In the normal mode, the local terminal device communicates with the target chat object or the opposite terminal device corresponding to the other chat object normally.

Optionally, in a normal mode, the local device sends an actual audio/video data packet of a user on the local device to the opposite device through the cloud server, or receives and plays the actual audio/video data packet sent by the opposite device through the cloud server.

In the shielding mode, the local terminal device does not communicate with the target chat object, or even if normal communication is carried out, the local terminal device receives but does not play the actual audio/video data packet sent by the opposite terminal device.

Optionally, when the local device and the target chat object do not communicate with each other, the local device and the peer device send an actual audio/video data packet to the cloud server, but the cloud server does not forward the actual audio/video data packet of the local device to the peer device or forward the actual audio/video data packet of the peer device to the local device.

According to the embodiment of the application, the local terminal equipment communicates with the opposite terminal equipment corresponding to the target chat and other chat objects in different modes according to the input of the target object identification in the group interface by the user, so that the directional shielding of the partial chat objects communicated by using the shielding mode is realized, and the flexibility of communication is improved through the directional communication between the local terminal equipment and the partial chat objects.

Optionally, the normal mode includes a normal sending mode and a normal receiving mode, and the shielding mode includes a sending shielding mode and a receiving shielding mode;

the normal sending mode is to send an actual audio and video data packet of the user, the normal receiving mode is to receive and play the actual audio and video data packet sent by the opposite terminal device, the sending shielding mode is not to send the actual audio and video data packet of the user, and the receiving shielding mode is not to receive or receive but not to play the actual audio and video data packet sent by the opposite terminal device;

the using different modes to communicate with the opposite terminal device corresponding to the target chat object and the opposite terminal devices corresponding to other chat objects except the target chat object in the plurality of chat objects comprises:

taking the normal sending mode and the sending shielding mode as sending modes, and taking the normal receiving mode and the receiving shielding mode as receiving modes;

and communicating with the opposite terminal equipment corresponding to the target chat object and the opposite terminal equipment corresponding to the other chat objects by using different sending modes or different receiving modes.

Optionally, the normal sending mode is used for communicating with the peer device corresponding to the target chat object, and the sending shielding mode is used for communicating with the peer device corresponding to the other chat object.

In this case, the local device first transmits the acquired audio or video to the cloud server in the form of an audio/video data packet, and then the cloud server only forwards the audio/video data packet sent by the local device to the opposite device corresponding to the target chat object, but does not forward the opposite device corresponding to other chat objects.

Optionally, the home terminal device sends the audio/video data packet to the cloud server, and sends the list of the target chat object to the cloud server. The cloud server updates the issued object of the audio and video data packet of the local terminal device to the target chat object in the list, so that the audio and video data packet of the local terminal device is only forwarded to the opposite terminal device corresponding to the target chat object.

Optionally, the sending screening mode is used for communicating with the peer device corresponding to the target chat object, and the normal sending mode is used for communicating with the peer device corresponding to the other chat object.

In this case, the cloud server only forwards the audio/video data packet sent by the local device to the peer device corresponding to the other chat object, but does not forward the peer device corresponding to the target chat object.

Optionally, the home terminal device sends the audio/video data packet to the cloud server, and sends the list of other chat objects to the cloud server. The cloud server updates the issued object of the audio and video data packet of the local terminal device to other chat objects in the list, so that the audio and video data packet of the local terminal device is only forwarded to the opposite terminal devices corresponding to the other chat objects.

Optionally, the receiving shielding mode is used for communicating with the peer device corresponding to the target chat object, and the normal receiving mode is used for communicating with the peer device corresponding to the other chat object.

In this case, the target chat object sends the audio/video data packet to the cloud server, and the cloud server does not forward the audio/video data packet sent by the target chat object to the local terminal device. Or the cloud server forwards the audio and video data packet sent by the target chat object to the home terminal device, but the home terminal device does not perform playing operation after receiving the audio and video data packet of the target chat object, so that directional shielding is realized.

Optionally, the home terminal device sends the list of other chat objects to the cloud server. The cloud server updates the object which transmits the audio and video data packet to the local terminal equipment into other chat objects, so that the audio and video data packet which is transmitted to the local terminal equipment by the target chat object is shielded.

Optionally, the normal receiving mode is used to communicate with the peer device corresponding to the target chat object, and the receiving shielding mode is used to communicate with the peer device corresponding to the other chat object.

In this case, the other chat objects send audio and video data packets to the cloud server, and the cloud server does not forward the audio and video data packets sent by the other chat objects to the local terminal device. Or the cloud server forwards the audio and video data packets sent by other chat objects to the local terminal equipment, but the local terminal equipment does not perform playing operation after receiving the audio and video data packets of other chat objects, so that directional shielding is realized.

Optionally, the home terminal device sends the list of other chat objects to the cloud server. The cloud server updates the object which transmits the audio and video data packet to the local terminal equipment into a target chat object, so that the audio and video data packet transmitted to the local terminal equipment by other chat objects is shielded.

According to the embodiment of the application, the local terminal equipment only forwards the audio and video data packet sent by the local terminal equipment to the target chat object or other chat objects according to the input of the user to the target chat object, so that the directional chat is realized, or the audio and video data sent by the target chat object or other chat objects to the local terminal equipment are not forwarded to the local terminal equipment, even if the audio and video data are forwarded to the local terminal equipment, the local terminal equipment does not play, the directional shielding is realized, and the flexibility of communication is improved through the directional communication between the local terminal equipment and the target chat object or other chat objects.

Optionally, the first input comprises: the user moves the target control on the group interface to the operation of the picture area where the group interface target object identifier is located; alternatively, the first and second electrodes may be,

optionally, the target control comprises one or more of a first control, a second control, a third control, and a fourth control.

Optionally, the target control is a picture control or a button control. The target control is displayed on the group interface.

And responding to a first input of the user for operating the first control, communicating with the opposite terminal equipment corresponding to the target chat object by using a normal sending mode, and communicating with the opposite terminal equipment corresponding to the other chat objects by using a sending shielding mode.

And responding to the first input of the user for operating the second control, communicating with the opposite terminal equipment corresponding to the target chat object by using a sending shielding mode, and communicating with the opposite terminal equipment corresponding to other chat objects by using a normal sending mode.

And responding to the first input of the user for operating the third control element, communicating with the opposite terminal equipment corresponding to the target chat object by using the receiving shielding mode, and communicating with the opposite terminal equipment corresponding to other chat objects by using the normal receiving mode.

And responding to the first input of the user for operating the fourth control, communicating with the opposite terminal equipment corresponding to the target chat object by using a normal receiving mode, and communicating with the opposite terminal equipment corresponding to other chat objects by using a receiving shielding mode.

When the target control comprises the first control and the second control at the same time, the first control can be selected for operation under the condition that the user only wants to chat with a few chat objects; when the user only wants to chat with a few chat objects, the second control can be operated, so that the operation times can be reduced.

When the target control comprises the third control and the fourth control at the same time, the fourth control can be selected for operation under the condition that the user only wants to chat with a few chat objects; when the user wants to chat with only a few chat objects, the third control element can be operated, so that the operation times can be reduced.

As shown in fig. 2, the smiling face image in the group interface is the subject identifier of the chat subject, each region containing the smiling face image is the screen region where the subject identifier is located, and there are 9 chat subjects in total.

The target controls in the group interface include a first control and a third control.

The group interface also comprises other controls, namely a mute control, a hands-free control, a camera opening control and an ending control.

FIG. 2 is merely an example of a group interface. The embodiment is not limited to the interface layout, the number of chat objects, the number of other controls and the number of target controls in the group interface.

And under the condition that the user needs to chat directionally only a certain chat object in the group interface, the chat object is the target chat object. And dragging the first control to the picture area where the target object identification of the target chat object is located, as shown in fig. 3.

When a plurality of target chat objects are available, a schematic diagram of a group interface after a user drags the first control is shown in fig. 4. At this time, the local terminal equipment carries out directional chat with a plurality of target chat objects.

Optionally, the local terminal device responds to a dragging operation of the user on the first control, performs communication with the opposite terminal device corresponding to the target chat object by using a normal sending mode, and performs communication with the opposite terminal device corresponding to the other chat object by using a sending shielding mode.

And under the condition that the user only needs to directionally shield a certain chat object in the group interface, the chat object is the target chat object. Dragging the third control element to the screen area where the target object identification of the target chat object is located, as shown in fig. 5.

When there are multiple target chat objects, the schematic diagram of the group interface after the user drags the third control element is shown in fig. 6. At this time, the local terminal equipment carries out directional shielding on a plurality of target chat objects.

And the local terminal equipment responds to the dragging operation of the user on the third control element, communicates with the opposite terminal equipment corresponding to the target chat object by using the receiving shielding mode, and communicates with the opposite terminal equipment corresponding to other chat objects by using the normal receiving mode.

In addition, the user may drag the first control to the screen area where the one or more target chat objects are located in the group interface according to actual needs, and drag the third control to the screen area where the one or more target chat objects are located in the group interface, as shown in fig. 7.

It should be noted that the first control and the second control cannot perform the first input operation at the same time, and the third control and the fourth control cannot perform the first input operation at the same time. The first control and the fourth control can simultaneously perform first input operation, and the first control and the third control can simultaneously perform first input operation.

The picture areas dragged by the first control and the third control may be the same or different. Similarly, the screen areas dragged by the first control and the fourth control may be the same or different. Under the condition that the mute control in the group interface on the local terminal equipment is in the selected state, the local terminal equipment does not collect voice, so that the audio data packet of the local terminal equipment cannot be received by the local terminal equipment no matter the local terminal equipment is a target chat object or other chat objects.

And the user clicks a target control displayed on a picture area where the target object identification is located in the group interface so as to enable the target control to be in a selected state.

As shown in fig. 8, each chat object includes a first control and a third control in the screen area. The first control and the third control are check box controls.

In the case that the user needs to chat on one or some chat objects in the group interface, click the first control and/or the third control on the screen area where the corresponding chat object is located, as shown in fig. 9.

And under the condition that the first control on the picture area of the chat object is in the selected state, the local terminal equipment communicates with the opposite terminal equipment corresponding to the target chat object by using a normal sending mode, and communicates with the opposite terminal equipment corresponding to other chat objects by using a sending shielding mode.

And under the condition that the third control on the picture area where the chat object is located is in the selected state, the local terminal equipment communicates with the opposite terminal equipment corresponding to the target chat object by using a receiving shielding mode, and communicates with the opposite terminal equipment corresponding to other chat objects by using a normal receiving mode.

The first control and the third control on the picture area where each chat object mark is located can be in a selected state.

As shown in fig. 10, the first control and the third control are radio button controls.

In the case that the user needs to chat on one or some chat objects in the group interface, click the first control or the third control on the screen area where the corresponding chat object identifier is located, as shown in fig. 11.

And under the condition that the first control on the picture area where the chat object identifier is located is in the selected state, the local terminal equipment communicates with the opposite terminal equipment corresponding to the target chat object by using a normal sending mode, and communicates with the opposite terminal equipment corresponding to other chat objects by using a sending shielding mode.

And under the condition that the third control on the picture area where the chat object identifier is located is in the selected state, the local terminal equipment communicates with the opposite terminal equipment corresponding to the target chat object by using a receiving shielding mode, and communicates with the opposite terminal equipment corresponding to other chat objects by using a normal receiving mode.

Due to the nature of the radio buttons, the first control and the third control on the screen area where each chat object is located may not be in the selected state.

According to the method and the device, the target control on the picture area where the target object identifier is located is set in a dragging mode, or the selection state of the target control on the picture area where the target object identifier is located is set in a mouse clicking mode, so that operation is facilitated, and a foundation is laid for subsequent directional chatting or directional shielding.

Optionally, the method further comprises: and under the condition of communicating with the opposite terminal equipment by using the sending shielding mode, sending the simulation picture data packet or the head portrait picture data packet of the user to the other chat objects.

Optionally, in a case of performing with the peer device corresponding to the other chat object using the transmission mask mode, the simulation screen data packet or the avatar screen data packet of the user is transmitted to the other chat object, so that the peer device corresponding to the other chat object displays the simulation screen or the avatar screen.

Optionally, in the case of a video call, a packet of analog pictures of the user on the home device is sent. The analog picture data packet is different from the actual audio and video data packet.

Optionally, the analog picture data packet is obtained by processing a video in an actual audio/video data packet sent by the home terminal device.

The processing process of the video in the actual audio and video data packet sent by the local terminal equipment comprises the following steps: the mouth in each video frame is identified and replaced with the mouth in the reference frame, thereby immobilizing the mouth in the video seen by the other chat objects.

The reference frame is any video frame in the video.

Optionally, the avatar picture data packet is a user avatar preset in a group video or a group voice on the home device by the user.

Optionally, the simulation picture data packet or the avatar picture data packet of the local device is sent to other chat objects through the cloud server.

Optionally, in a case of performing with the peer device corresponding to the target chat object using the sending mask mode, sending the simulation picture data packet or the avatar picture data packet of the user to the peer device corresponding to the target chat object, so that the peer device corresponding to the target chat object displays the simulation picture or the avatar picture.

Optionally, the simulation picture data packet or the head portrait picture data packet of the local device is sent to the target chat object through the cloud server.

According to the embodiment of the application, the simulation picture data packet or the head portrait picture data packet of the local terminal equipment is sent to the other shielded chat objects or the target chat objects in the group interface under the condition of directional chat with the target chat object or the other chat objects, so that the other shielded chat objects are not easy to perceive under the condition of realizing the directional chat, and the user experience is improved.

Optionally, the method further comprises: under the condition that the receiving shielding mode is used for communicating with the opposite terminal equipment and the receiving shielding mode is used for receiving but not playing the actual audio and video data packet sent by the opposite terminal equipment, analyzing the audio data in the actual audio and video data packet sent by the opposite terminal equipment into corresponding characters, and displaying the characters in a preset area in the group interface.

Under the condition that the local terminal device receives but does not play actual audio and video data sent by the opposite terminal device corresponding to the target chat object, a user may not want to hear or see the audio and video corresponding to the audio and video data packet sent by the target chat object, but the background sound of the audio and video of the target chat object is noisy and is not clear to hear, and the listening of the audio and video of other chat objects may be influenced.

Therefore, in order to avoid the local device from losing important information sent by the target chat object, after receiving the audio/video data packet sent by the target chat object, although the audio/video corresponding to the audio/video data packet is not played, the audio data in the audio/video data packet is analyzed into corresponding characters, and the corresponding characters are displayed in the group interface, as shown in fig. 12 to 14.

Optionally, the audio data in the audio/video data packet sent from the target chat object is parsed into corresponding words by using a STT (Speech to Text) function of the local device.

Under the condition that the local terminal device receives but does not play actual audio and video data sent by the opposite terminal device corresponding to other chat objects, a user may not want to hear or see the audio and video corresponding to the audio and video data packets sent by other chat objects, but the background sound of the audio and video of other chat objects is noisy and is not clear to hear, and the listening of the audio and video of a target chat object may be influenced.

Therefore, in order to avoid the loss of important information sent by other chat objects by the local terminal equipment, after the audio and video data packets sent by other chat objects are received, although the audio and video corresponding to the audio and video data packets are not played, the audio data in the audio and video data packets are analyzed into corresponding characters and displayed in the group interface.

According to the embodiment of the application, under the condition of directionally shielding the target chat object or other objects, the audio data in the audio and video data packet sent by the target chat object or other objects is analyzed into corresponding characters to be displayed, and the information sent by the target chat object can still be received.

Optionally, the method further comprises: receiving a second input of the target chat object from the user;

the second input is an operation of canceling the first input.

And under the condition that the user does not need to communicate with a certain target chat object or other chat objects by using the shielding mode, the user performs second input on the corresponding target chat object in the group interface.

And the local terminal equipment receives a second input of the target chat object from the user.

The form of the second input is determined in accordance with the form of the first input.

And responding to the second input, and under the condition that the shielding mode is used for communicating with the opposite terminal equipment, switching to the normal mode for communicating with the opposite terminal equipment.

And the local terminal equipment responds to the second input, and re-sends the actual audio and video data packet of the user to the target chat object or other chat objects under the condition that the actual audio and video data packet of the user is not sent to the target chat object or other chat objects.

And under the condition of not receiving or receiving but not playing the actual audio and video data packet sent by the target chat object or other chat objects, re-receiving and playing the actual audio and video data packet sent by the target chat object or other chat objects.

In the case where targeted chat and targeted screening are canceled for a target chat object, the target chat object is treated as a normal chat object. The chat mode, i.e. the default mode, before the first input thereto is resumed.

According to the embodiment of the application, the directional chat or the directional shielding of the target chat object is cancelled according to the second input of the user, so that the flexibility of communication is improved.

Optionally, the second input comprises: the user drags a target control in the group interface to leave the operation on the picture area where the target chat object is located in the group interface;

the second input is the operation of canceling the first input, and the form of the second input is determined according to the form of the first input, so that the second input is the situation that the user drags the target control to leave the picture area where the target chat object is located when the first input is the situation that the user drags the target control to the picture area where the target chat object is located.

The user can drag the target control away from the region of the screen where some or all of the target chat object is located.

And under the condition that the user drags the target control to leave the picture areas where all the target chat objects are located, the group interface is restored to the figure 2.

Or the user clicks a target control displayed on a picture area where the target chat object is located in the group interface so as to enable the target control to be in an unselected state.

And under the condition that the first input is that the user clicks the target control displayed on the picture area where the target chat object is located so as to enable the target control to be in the selected state, the second input is that the user clicks the target control displayed on the picture area where the target chat object is located so as to enable the target control to be in the unselected state.

And clicking a target control displayed on the picture area where part or all of the target chat objects are located by the user to enable the target control to be in an unselected state.

When the user clicks the target control displayed on the screen region where all the target chat objects are located, the group interface returns to fig. 8 or fig. 10.

According to the method and the device, the target control on the picture area where the target chat object is located is cancelled in a dragging mode, or the target control on the picture area where the target chat object is located is in an unselected state in a mouse clicking mode, so that operation is facilitated, and a foundation is laid for subsequent directional chat cancellation or directional shielding cancellation.

The instant messaging method provided by the embodiment of the application comprises the following complete steps:

1. firstly, a user opens the social software on the local terminal equipment and joins in group video or group voice chat.

2. And operating one or more target chat objects on a group interface of the user video or group voice chat, and taking the operation as a first input of the user to the target chat objects.

3. And the local terminal equipment responds to the first input and conducts directional chat or directional shielding on the target chat object.

4. The user makes a second input to the target chat object in the group interface.

5. And the local terminal equipment responds to the second input and cancels the directional chat or the directional shielding of the target chat object.

6. The target chat object resumes the default chat mode.

Optionally, the method further comprises: converting actual audio and video data to be transmitted into corresponding characters; and sending a data packet carrying the characters to the opposite terminal equipment corresponding to each chat object.

Under the condition that the local device detects that the network state of the local device is not good, the local device sends an audio/video data packet to the cloud server with delay, so that the chat object in the group interface plays the video or voice of the local device intermittently, the chat object is blocked and experiences are poor.

In order to solve the problem, the local terminal device converts actual audio/video data to be sent by the local terminal device into corresponding characters and forwards the corresponding characters to each chat object through the cloud server. The converted text is displayed on the client of each chat object.

When the video is converted into corresponding characters, audio is extracted from the video, and then the extracted audio is converted into characters.

Because the size of the text data packet is far smaller than that of the audio and video data packet, the transmission speed of the text data packet is higher than that of the audio and video data packet, and the blocking can be avoided.

The local terminal equipment judges the network state of the local terminal equipment and determines whether to convert the audio and video data to be sent into corresponding characters or not according to the judgment result.

And when the judging result is that the network state is poor, the local terminal equipment converts the audio and video data to be sent into corresponding characters, and when the network state is monitored to be good, the local terminal equipment stops converting the audio and video data to be sent into the corresponding characters.

And when the judgment result is that the network state is good, the local terminal equipment does not perform character conversion on the audio and video data to be transmitted.

According to the embodiment of the application, the audio and video data to be sent of the local terminal device are converted into corresponding characters and then forwarded to the chat objects through the cloud server, so that the transmission speed of the data packet is improved, and the blockage is avoided when the network state of the local terminal device is not good.

Optionally, after sending the data packet carrying the text to the peer device corresponding to each chat object, the method further includes: and sending the simulation picture data packet or the head portrait picture data packet of the user to the opposite terminal equipment corresponding to each chat object.

Optionally, the analog picture data packet is obtained by processing a video in an audio/video data packet sent by the home device before.

The processing process of the video in the audio and video data packet sent by the home terminal equipment before is as follows: and identifying the mouth in each video frame, and replacing the mouth in each video frame with the mouth corresponding to the converted characters, so that the change of the mouth in the video seen by other chat objects is consistent with the converted characters.

The mouth corresponding to the text transmitted to each chat target is a mouth that matches the lip shape of the text read from the chat target.

Optionally, a voice with a tone similar to that of the user on the local device is generated according to the converted characters, and the generated voice is sent to each chat object through the cloud server to be played.

According to the application, the user experience is improved by sending the converted characters to each chat object and simultaneously sending the simulation picture data packet or the head portrait picture data packet.

It should be noted that, in the instant messaging method provided in the embodiment of the present application, the execution main body may be an instant messaging device, or a control module in the instant messaging device for executing the loading of the instant messaging method. In the embodiment of the present application, an instant messaging device is taken as an example to execute a method for loading instant messaging, so as to describe the instant messaging method provided in the embodiment of the present application.

As shown in fig. 15, the instant messaging apparatus provided in the embodiment of the present application includes a receiving module 1501 and a response module 1502, where:

the receiving module 1501 is configured to receive a first input of a target object identifier in a group interface when a user performs instant messaging with multiple chat objects through the group interface at the same time; wherein the target object identification is used to indicate a target chat object of the plurality of chat objects;

the user firstly opens the social software on the local terminal device and joins in group video or group voice chat. And then, operating the target chat object on a group interface of the group video or group voice chat, and using the operation as a first input of the user to the target chat object.

The response module 1502 is a response module configured to, in response to the first input, use different modes to communicate with a peer device corresponding to the target chat object and peer devices corresponding to other chat objects in the plurality of chat objects except the target chat object; wherein the modes include a normal mode and a mask mode;

the response module is to: taking the normal sending mode and the sending shielding mode as sending modes, and taking the normal receiving mode and the receiving shielding mode as receiving modes; and communicating with the opposite terminal equipment corresponding to the target chat object and the opposite terminal equipment corresponding to other chat objects except the target chat object in the plurality of chat objects by using different sending modes or different receiving modes.

Optionally, the first input comprises: the user moves the target control on the group interface to the operation on the picture area where the target object identification is located; or the user clicks a target control displayed on the picture area where the target object identifier is located, so that the target control is in a selected state.

Optionally, the execution module is further configured to: and under the condition of communicating with the opposite terminal equipment by using the sending shielding mode, sending a simulation picture data packet or an avatar picture data packet of the user to the opposite terminal equipment.

Optionally, the response module is further configured to: under the condition that the receiving shielding mode is used for communicating with the opposite terminal equipment and the receiving shielding mode is used for receiving but not playing the actual audio and video data packet sent by the opposite terminal equipment, analyzing the audio data in the actual audio and video data packet sent by the opposite terminal equipment into corresponding characters, and displaying the characters in a preset area in the group interface.

Optionally, the response module is further configured to: receiving a second input of the target object identification by the user; and responding to the second input, and under the condition that the shielding mode is used for communicating with the opposite terminal equipment, switching to the normal mode for communicating with the opposite terminal equipment.

Optionally, the response module is further configured to: converting actual audio and video data to be transmitted into corresponding characters; and sending a data packet carrying the characters to the opposite terminal equipment corresponding to each chat object.

Optionally, after the response module sends the data packet carrying the text to the peer device corresponding to each chat object, the response module is further configured to:

and sending the simulation picture data packet or the head portrait picture data packet of the user to the opposite terminal equipment corresponding to each chat object.

The instant messaging device in the embodiment of the present application may be a device, and may also be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The instant messaging in the embodiments of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The instant messaging provided in the embodiment of the present application can implement each process implemented by the instant messaging device in the method embodiments of fig. 1 to 16, and is not described herein again to avoid repetition.

Fig. 16 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure, and as shown in fig. 16, the electronic device 1600 includes, but is not limited to: at least some of the components of the radio unit 1601, the network module 1602, the audio output unit 1603, the input unit 1604, the sensor 1605, the display unit 1606, the user input unit 1607, the interface unit 1608, the memory 1609, and the processor 1610, etc.

Those skilled in the art will appreciate that the electronic device 1600 may further include a power supply (e.g., a battery) for supplying power to various components, which may be logically coupled to the processor 1610 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 16 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description thereof is omitted.

It should be understood that in the embodiment of the present application, the input Unit 1604 may include a Graphics Processing Unit (GPU) 16041 and a microphone 16042, and the Graphics processor 16041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1606 may include a display panel 16061, and the display panel 16061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1607 includes a touch panel 16071 and other input devices 16072. Touch panel 16071, also referred to as a touch screen. The touch panel 16071 may include two parts of a touch detection device and a touch controller. Other input devices 16072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

In this embodiment, the radio frequency unit 1601 receives downlink data from a network device and then processes the downlink data in the processor 1610; in addition, the uplink data is sent to the network side equipment. In general, the radio frequency unit 1601 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

The memory 1609 may be used to store software programs or instructions as well as various data. The memory 1609 may mainly include a stored program or instruction area and a stored data area, wherein the stored program or instruction area may store an operating system, an application program or instruction (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. In addition, the Memory 1609 may include a high-speed random access Memory, and may also include a nonvolatile Memory, which may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable Programmable PROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), or a flash Memory. Such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.

Processor 1610 may include one or more processing units; alternatively, processor 1610 may integrate an application processor, which primarily handles operating system, user interface, and applications or instructions, etc., and a modem processor, which primarily handles wireless communications, such as a baseband processor. It is to be appreciated that the modem processor described above may not be integrated into processor 1610.

The system comprises a user input unit 1607, a group interface and a display unit, wherein the user input unit 1607 is used for receiving a first input of a target object identifier in the group interface under the condition that a user performs instant messaging with a plurality of chat objects through the group interface simultaneously; wherein the target object identification is used to indicate a target chat object of the plurality of chat objects; a processor 1610 configured to, in response to the first input, communicate with a peer device corresponding to the target chat object and peer devices corresponding to other chat objects in the plurality of chat objects except the target chat object using different modes;

wherein the modes include a normal mode and a mask mode;

the processor is configured to: taking the normal sending mode and the sending shielding mode as sending modes, and taking the normal receiving mode and the receiving shielding mode as receiving modes;

and communicating with the opposite terminal equipment corresponding to the target chat object and the opposite terminal equipment corresponding to other chat objects except the target chat object in the plurality of chat objects by using different sending modes or different receiving modes.

Optionally, the processor is further configured to: and under the condition of communicating with the opposite terminal equipment by using the sending shielding mode, sending a simulation picture data packet or an avatar picture data packet of the user to the opposite terminal equipment.

Optionally, the processor is further configured to: under the condition that the receiving shielding mode is used for communicating with the opposite terminal equipment and the receiving shielding mode is used for receiving but not playing the actual audio and video data packet sent by the opposite terminal equipment, analyzing the audio data in the actual audio and video data packet sent by the opposite terminal equipment into corresponding characters, and displaying the characters in a preset area in the group interface.

Optionally, the processor is further configured to: receiving a second input of the target object identification by the user; and responding to the second input, and under the condition that the shielding mode is used for communicating with the opposite terminal equipment, switching to the normal mode for communicating with the opposite terminal equipment.

Optionally, the processor is further configured to: converting the audio and video data to be sent of the local terminal equipment into corresponding characters; and sending a data packet carrying the characters to the opposite terminal equipment corresponding to each chat object.

Optionally, after the processor sends the data packet carrying the text to the peer device corresponding to each chat object, the processor is further configured to: and sending the simulation picture data packet or the head portrait picture data packet of the user to the opposite terminal equipment corresponding to each chat object.

The electronic device embodiment in the embodiment of the present application is a product embodiment corresponding to the method embodiment, and all implementation manners in the method embodiment are applicable to the electronic device embodiment, and may also achieve the same or similar technical effects, so that details are not described herein again.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned embodiment of the object distance measuring method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above embodiment of the object distance measurement method, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatuses in the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order, depending on the functions involved, for example, performing the described methods in an order different from that described, and may also add, omit, or combine various steps. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An instant messaging method, comprising:

wherein the modes include a normal mode and a mask mode;

2. The instant messaging method according to claim 1, wherein the normal mode comprises a normal transmission mode and a normal reception mode, and the mute mode comprises a transmission mute mode and a reception mute mode;

3. The instant messaging method of claim 1 or 2, wherein the first input comprises:

the user moves the target control on the group interface to the operation on the picture area where the target object identification is located; alternatively, the first and second electrodes may be,

and the user clicks the target control displayed on the picture area where the target object identification is located, so that the target control is in a selected state.

4. The instant messaging method of claim 2, wherein the method further comprises:

and under the condition of communicating with the opposite terminal equipment by using the sending shielding mode, sending a simulation picture data packet or an avatar picture data packet of the user to the opposite terminal equipment.

5. The instant messaging method of claim 2, wherein the method further comprises:

under the condition that the receiving shielding mode is used for communicating with the opposite terminal equipment and the receiving shielding mode is used for receiving but not playing the actual audio and video data packet sent by the opposite terminal equipment, analyzing the audio data in the actual audio and video data packet sent by the opposite terminal equipment into corresponding characters, and displaying the characters in a preset area in the group interface.

6. The instant messaging method of claim 1 or 2, wherein the method further comprises:

receiving a second input of the target object identification by the user;

7. The instant messaging method of claim 2, wherein the method further comprises:

converting actual audio and video data to be transmitted into corresponding characters;

and sending a data packet carrying the characters to the opposite terminal equipment corresponding to each chat object.

8. The instant messaging method according to claim 7, wherein after sending the data packet carrying the text to the peer device corresponding to each of the chat objects, further comprising:

9. An instant messaging device, comprising:

wherein the modes include a normal mode and a mask mode;

10. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the instant messaging method of any of claims 1-8.

11. A readable storage medium, on which a program or instructions are stored, which when executed by a processor, carry out the steps of the instant messaging method according to any one of claims 1 to 8.