CN106803916B - Information display method and device - Google Patents

Information display method and device Download PDF

Info

Publication number
CN106803916B
CN106803916B CN201710109310.0A CN201710109310A CN106803916B CN 106803916 B CN106803916 B CN 106803916B CN 201710109310 A CN201710109310 A CN 201710109310A CN 106803916 B CN106803916 B CN 106803916B
Authority
CN
China
Prior art keywords
deformation
boundary
window
client
video information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710109310.0A
Other languages
Chinese (zh)
Other versions
CN106803916A (en
Inventor
王超
梁颖蕾
匡皓琦
付玓瓅
朱莹
陈炉军
符德恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201710109310.0A priority Critical patent/CN106803916B/en
Publication of CN106803916A publication Critical patent/CN106803916A/en
Application granted granted Critical
Publication of CN106803916B publication Critical patent/CN106803916B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Abstract

The invention discloses an information display method and device, and belongs to the technical field of video calls. The method comprises the following steps: in the process of video communication with a second client, when a boundary deformation condition is met, a first deformation amplitude and a first deformation direction of a first boundary are obtained; the first boundary is a boundary adjacent to a first window and a second window, the first window is a window for displaying first video information acquired by the first client, and the second window is a window for displaying second video information acquired by the second client; displaying the first video information in a first window after the first boundary deformation, and displaying the second video information in a second window after the first boundary deformation; the deformed first boundary is deformed according to the first deformation magnitude and the first deformation direction. The problem of video information's display mode among the prior art is more single is solved.

Description

Information display method and device
Technical Field
The embodiment of the invention relates to the technical field of video calls, in particular to an information display method and device.
Background
At present, video call is one of the commonly used means for people to communicate with others.
In the video call process, both parties of the call can display the video information collected by the parties and the video information from the opposite end of the call. Specifically, two parties in a call can respectively display two windows, wherein one window is used for displaying video information acquired by the two parties, and the other window is used for displaying video information sent by an opposite end of the call.
Because the video information of both parties of the call can be displayed only in a fixed window, the display mode of the video information is single.
Disclosure of Invention
In order to solve the problems in the prior art, embodiments of the present invention provide an information display method and apparatus. The technical scheme is as follows:
according to a first aspect of the embodiments of the present invention, there is provided an information presentation method, used in a first client, the method including:
in the process of video communication with a second client, when a boundary deformation condition is met, a first deformation amplitude and a first deformation direction of a first boundary are obtained; the first boundary is a boundary adjacent to a first window and a second window, the first window is a window for displaying first video information acquired by the first client, and the second window is a window for displaying second video information acquired by the second client;
displaying the first video information in a first window after the first boundary deformation, and displaying the second video information in a second window after the first boundary deformation; the deformed first boundary is deformed according to the first deformation magnitude and the first deformation direction.
A second aspect provides an information presentation method, used in a second client, the method including:
receiving boundary deformation information sent by a first client in the process of video call with the first client; the boundary deformation information is generated according to a first deformation amplitude and a first deformation direction of an acquired first boundary when the first client meets a boundary deformation condition, the first boundary is a boundary adjacent to a first window and a second window, the first window is a window used for displaying first video information acquired by the first client, and the second window is a window used for displaying second video information acquired by the second client;
displaying the first video information in a third window with a deformed second boundary, and displaying the second video information in a fourth window with a deformed second boundary, wherein the second boundary is a boundary adjacent to the third window and the fourth window; and the deformed second boundary is deformed according to the boundary deformation information.
In a third aspect, an information presentation apparatus is provided, which is used in a first client, and includes:
the acquisition module is used for acquiring a first deformation amplitude and a first deformation direction of a first boundary when a boundary deformation condition is met in the process of video communication with a second client; the first boundary is a boundary adjacent to a first window and a second window, the first window is a window for displaying first video information acquired by the first client, and the second window is a window for displaying second video information acquired by the second client;
the display module is used for displaying the first video information in a first window after the first boundary deformation and displaying the second video information in a second window after the first boundary deformation; the deformed first boundary is deformed according to the first deformation magnitude and the first deformation direction.
In a fourth aspect, an information presentation apparatus is provided, which is used in a second client, and includes:
the receiving module is used for receiving boundary deformation information sent by a first client in the process of video call with the first client; the boundary deformation information is generated according to a first deformation amplitude and a first deformation direction of an acquired first boundary when the first client meets a boundary deformation condition, the first boundary is a boundary adjacent to a first window and a second window, the first window is a window used for displaying first video information acquired by the first client, and the second window is a window used for displaying second video information acquired by the second client;
the display module is used for displaying the first video information in a third window with a deformed second boundary and displaying the second video information in a fourth window with a deformed second boundary, wherein the second boundary is a boundary adjacent to the third window and the fourth window; and the deformed second boundary is deformed according to the boundary deformation information.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
in the process of video call between a first client and a second client, when the first client meets a boundary deformation condition, acquiring a first deformation amplitude and a first deformation direction of a first boundary, displaying first video information acquired by the first client in a first window after the first boundary deforms according to the first deformation amplitude and the first deformation direction, and displaying second video information acquired by the second client in a second window after the first boundary deforms; that is, when the first client meets the boundary deformation condition, the boundary of the window displaying the first video information and the second video information is deformed, so that the problem that the display mode of the video information in the prior art is single is solved, and the effect of enriching the display mode of the video information is achieved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of an implementation environment related to an information presentation method according to various embodiments of the present invention;
FIG. 2 is a flow chart of an information presentation method provided by an embodiment of the present invention;
FIG. 3 is a diagram illustrating a first window and a second window presented by a first client according to an embodiment of the present invention;
FIG. 4 is a diagram of an arc determined by a first client provided by an embodiment of the invention;
FIG. 5 is another exemplary arc defined by the first client according to an embodiment of the present invention;
fig. 6 is a schematic diagram of the first client displaying video information in the first window and the second window according to the determined boundary points according to an embodiment of the present invention;
FIG. 7 is another flow chart of an information presentation method according to an embodiment of the present invention;
FIG. 8 is a diagram illustrating a video call interface presented by a client during a multi-person video call according to an embodiment of the present invention;
FIG. 9 is a schematic view of an information presentation device provided in accordance with one embodiment of the present invention;
FIG. 10 is a schematic view of an information presentation device provided in accordance with another embodiment of the present invention;
fig. 11 is a schematic diagram of a terminal according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a schematic diagram of an implementation environment shown in an exemplary embodiment of the invention, including: a first client 110, a server 120, and a second client 130.
The first client 110 is a client having video call capability operating in a first terminal. The first client 110 may be a social application client, for example, an instant messaging client. Also, the first terminal may be a terminal such as a mobile phone, a tablet computer, or a desktop computer. The first terminal where the first client 110 is located may be connected to the server 120 through a wired or wireless network.
The server 120 is a server for providing a background service to the first client 110 and the second client 130. The server 120 may be a single server or a server cluster including a plurality of servers. In practice, the server 120 may be connected to a second terminal where the second client 130 is located through a wired or wireless network.
The second client 130 is a client having video call capability operating in the second terminal. The second client 130 may be a social application client, for example, an instant messaging client. The second terminal may be a terminal such as a cell phone, tablet or desktop computer.
In addition, in the implementation scenario, the first terminal and the second terminal are terminals that render video information in a preset manner. The preset mode is openGL (Open Graphics Library, graphical program interface).
Referring to fig. 2, a flowchart of a method of an information displaying method according to an embodiment of the present invention is shown, and the embodiment illustrates that the information displaying method is used in the implementation environment shown in fig. 1. As shown in fig. 2, the information presentation method may include:
step 201, in the process of video call between the first client and the second client, when the first client meets the boundary deformation condition, the first client obtains a first deformation amplitude and a first deformation direction of the first boundary.
Two clients in a video call can detect whether the clients meet boundary deformation conditions in real time, and if one of the clients, such as the first client, meets the boundary deformation conditions, the first client can acquire a first deformation amplitude and a first deformation direction.
Wherein the boundary deformation condition comprises at least one of the following conditions:
first, a sliding signal is received that slides a first boundary.
The first client, upon receiving the sliding signal sliding the first boundary, may declare that the user of the first client wants to trigger the first boundary deformation, and thus the boundary deformation condition may include receiving the sliding signal sliding the first boundary.
The first boundary is a boundary adjacent to a first window and a second window, the first window is a window used for displaying first video information acquired by a first client in the first client, and the second window is a window used for displaying second video information acquired by a second client in the first client. For example, referring to fig. 3, in the process of a video call between a first client and a second client, a first window 31 for displaying first video information acquired by the first client and a second window 32 for displaying second video information sent by the second client may be displayed in the first client. As shown in fig. 3, the adjacent boundary of the first window 31 and the second window 32 is the first boundary 33.
The sliding direction of the sliding signal may be from the first window to the second window, or may be from the second window to the first window, which is not limited herein. For example, referring to fig. 3, when the user wants the first border 33 to deform toward the first window 31, the user may apply a slide signal sliding leftward, and accordingly, the first client may receive the slide signal sliding leftward.
Fig. 3 only shows the video information acquired by the user in the left window, and shows the video information of the opposite call end in the right window, optionally, the second video information sent by the opposite call end, that is, the second client, may also be shown in the left window, and shows the video information acquired by the user in the right window, which is not limited in this embodiment.
And secondly, the image information of the first video information acquired by the first client comprises target posture information.
The first client may be preset with setting information that triggers boundary deformation through the target pose information, and thus at this time, the boundary deformation condition may include that the target pose information is included in the image information of the first video information. The target posture information may be default information in the first client, or may be user-defined information, which is not limited herein. In practical implementation, the target posture information may include at least one of facial expressions, gesture information, and head movements, which is not limited thereto.
For example, the user preset that the first boundary deformation is triggered by the "OK" gesture, at this time, the boundary deformation condition may include that the image information of the first video information includes the "OK" gesture. For another example, the user preset that the first boundary deformation is triggered by waving the hand left or right, and at this time, the boundary deformation condition may include that the image information of the first video information includes a gesture of waving the hand left or right.
And thirdly, the audio information of the first video information collected by the first client comprises target content.
Similarly to the second condition, setting information for triggering boundary deformation through target content may also be preset in the first client, and for this case, the boundary deformation condition may include that the target content is included in the audio information of the first video information. The target content may be a default content in the first client, or may be a user-defined content, which is not limited herein. In actual implementation, the target content may be a voice keyword, a mood word, or the like, which is not limited herein.
In this embodiment, the boundary deformation conditions include the above mentioned several conditions, and in actual implementation, the boundary deformation conditions may further include other conditions, which are not limited.
Taking the boundary deformation condition including the first kind as an example, when the first client receives a sliding signal sliding the first boundary to the left, the first client determines that the boundary deformation condition is satisfied. Taking the example that the boundary deformation condition includes the second type and the target posture information includes the "OK" gesture, when the first client recognizes that the image information of the first video information includes the "OK" gesture, the first client determines that the boundary deformation condition is satisfied. For another example, if the boundary deformation condition includes the third kind and the target content is a semantic word "haha", the first client determines that the boundary deformation condition is satisfied when the first client recognizes that the audio information of the first video information includes "haha".
When the first client side meets the boundary deformation condition, the first client side can acquire a first deformation amplitude and a first deformation direction. Wherein:
the step of the first client obtaining the first deformation magnitude may include any one of the following implementation manners:
first, a default first deformation magnitude is obtained.
The first client may set a default deformation amplitude, and therefore, the first client may obtain the default deformation amplitude as the first deformation amplitude. The default deformation amplitude may be a default deformation amplitude of a system in the first client, or may be a deformation amplitude set by a user in a user-defined manner in advance, which is not limited herein.
Secondly, when the boundary deformation condition comprises that a sliding signal of a sliding first boundary is received, acquiring the sliding distance of the sliding signal, and acquiring a first deformation amplitude according to the sliding distance; the first deformation amplitude is in positive correlation with the sliding distance.
In a second possible implementation manner, the first client may preset a corresponding relationship between the deformation amplitude and the sliding distance, at this time, after the first client receives the sliding signal, the first client may obtain the sliding distance corresponding to the sliding signal, query the deformation amplitude corresponding to the sliding distance according to the preset corresponding relationship, and use the queried deformation amplitude as the first deformation amplitude.
The sliding distance in this embodiment is a distance in the arrangement direction of the first window and the second window. For example, referring to fig. 3, the sliding distance is a sliding distance in a horizontal direction, which is not limited to this.
Alternatively, the deformation amplitude may be provided with a limit value, i.e. after the deformation amplitude reaches the limit value, its corresponding deformation amplitude remains unchanged even if the sliding distance is greater. In practice, the limit value may be 1/4 of the total width of the first window and the second window, but the limit value may be other values, which is not limited.
Thirdly, when the boundary deformation condition includes that the image information of the first video information includes a target gesture, acquiring a gesture amplitude of the target gesture, and acquiring a first deformation amplitude according to the acquired gesture amplitude; the first deformation amplitude is positively correlated with the amplitude.
In a third possible implementation manner, when the boundary deformation condition includes that the image information of the first video information includes the target gesture, the first client may set a corresponding relationship between the gesture amplitude and the deformation amplitude, and when the image information obtained through recognition includes the target gesture, the first client may obtain the gesture amplitude of the target gesture through several consecutive frames of images, then query the deformation amplitude corresponding to the obtained gesture amplitude in the corresponding relationship between the gesture amplitude and the deformation amplitude, and determine the obtained deformation amplitude as the first deformation amplitude.
Alternatively, similar to the second implementation, the deformation magnitude may be provided with a limit value, which is not described in detail herein.
Certainly, in actual implementation, if the target posture information further includes a facial expression, at this time, the first client may further obtain a change frequency of the mouth shape of the user through image recognition, then query a deformation amplitude corresponding to the obtained change frequency according to a corresponding relationship between the deformation amplitude and the change frequency of the mouth shape, and determine the queried deformation amplitude as the first deformation amplitude. Wherein, the deformation amplitude of the change frequency domain of the mouth shape is in a sheet correlation relationship.
Fourthly, when the boundary deformation condition includes that the audio information of the first video information includes the target content, acquiring the volume corresponding to the target content, and acquiring a first deformation amplitude according to the volume; the first deformation amplitude is in positive correlation with the volume.
In a fourth possible implementation manner, if the boundary deformation condition includes that the audio information of the first video information includes the target content, at this time, the first client may obtain, through speech recognition, a volume corresponding to the target content in the audio information, and then query, according to a correspondence between the deformation amplitude and the volume, the deformation amplitude corresponding to the volume, and use the queried deformation amplitude as the first deformation amplitude, which is not described herein again.
Moreover, similar to the second implementation manner and the third implementation manner, in a fourth possible implementation manner, a limit value may also be set for the deformation amplitude, which is not described herein again.
In this embodiment, only the first client obtains the first deformation amplitude through the obtaining method, and optionally, the first client may also obtain the first deformation amplitude through other methods, which is not limited to this.
The step of the first client obtaining the first deformation direction of the first boundary may include the following two possible implementations:
first, when the boundary deformation condition includes that a sliding signal sliding a first boundary is received, a sliding direction of the sliding signal is acquired, and the sliding direction is taken as a first deformation direction.
The sliding direction of the user is the direction in which the first boundary deformation is expected, and therefore, the first client may use the sliding direction of the sliding signal as the first deformation direction. The sliding direction in this embodiment refers to a direction in which the first window and the second window are arranged, for example, a horizontal direction in conjunction with fig. 3.
Secondly, when the boundary deformation condition includes other conditions, acquiring a direction in which the first window points to the second window, and taking the acquired direction as a first deformation direction.
When the boundary deformation condition includes other conditions, and when the first client meets the boundary deformation condition, it is described that the user desires that the first boundary deforms toward the direction of the call friend, so that the first client may take the direction in which the first window points toward the second window as the first deformation direction at this time.
It should be added that, the above is only an example of obtaining the first deformation direction by the obtaining method, and optionally, the first client may also obtain the first deformation direction by other methods, which is not limited to this.
Step 202, the first client displays the first video information in the first window after the first boundary deformation, and displays the second video information in the second window after the first boundary deformation, wherein the first boundary after deformation is deformed according to the first deformation amplitude and the first deformation direction.
Optionally, before this step, the first client may determine the deformed first window and the deformed second window, specifically, the determining step includes:
firstly, the first client determines n boundary points according to the first deformation amplitude and the first deformation direction, wherein n is an integer greater than or equal to 1.
In practical implementation, the step of the first client determining n boundary points may include the following sub-steps:
(1) and determining a shift position after shifting from the preset position of the first boundary along the first deformation direction by the first deformation amplitude.
The preset position may be a midpoint of the first boundary, any vertex of the first boundary, or other positions, which is not limited herein.
For example, taking the preset position as the middle point of the first boundary as an example, referring to fig. 3, after receiving the sliding signal sliding to the left, referring to fig. 4, the first client may obtain a shift position "O1" after the middle point "O" of the first boundary is shifted to the left by the first deformation magnitude.
For another example, taking the preset position as the lower vertex of the first boundary as an example, referring to fig. 3, after receiving the sliding signal sliding leftward, referring to fig. 5, the first client may obtain a shift position "B1" after the lower vertex "B" of the first boundary shifts leftward by the first deformation magnitude.
(2) An arc is determined that passes through the offset location and at least one vertex in the first boundary.
Optionally, the first client may determine an arc in a circle passing through the offset location and two vertices of the first boundary; an arc in a circle passing through the offset location and one of the vertices in the first boundary may also be determined. The circle in this embodiment may be a perfect circle or an ellipse, which is not limited herein.
For example, referring to fig. 4, the first client may determine that an arc 41 is obtained. For another example, referring to fig. 5, the first client may determine that an arc 51 is obtained.
(3) And selecting n points except the vertex in the arc as n boundary points.
Alternatively, the first client may select n points that divide the arc n +1 equally, for example, taking n ═ 5 as an example, and in conjunction with fig. 4, the first client may select C, D, E, F and G5 points.
In general, the value of n is in a positive correlation with the height of the first window, that is, the higher the height of the first window, the larger the value of n. For example, taking the first client as the client running in the mobile phone as an example, the value of n is usually 200-300. In actual implementation, the larger the value of n is, the higher the processing complexity of the first client is, the smoother the curve formed by the n boundary points is, so that in actual application, a designer can set the processing complexity according to actual requirements, and the processing complexity is not limited to the setting.
Secondly, according to the n boundary points and at least one vertex in the first boundary before deformation, a first window after deformation of the first boundary and a second window after deformation of the first boundary are determined.
The first client may use a connecting line of the n boundary points and the at least one vertex as the deformed first boundary, determine a window formed by other boundaries of the first window before the deformation and the deformed first boundary as the first window after the deformation of the first boundary, and determine a window formed by other boundaries of the second window before the deformation and the deformed first boundary as the second window after the deformation of the first boundary.
After determining the deformed first window and the deformed second window, the first client may display the first video information in the deformed first window and display the second video information in the deformed second window.
Optionally, the first client may present the first video information in the deformed first window and the second video information in the deformed second window according to the openGL technique.
Referring to fig. 6, taking n boundary points determined by the first client as 1, 2, 3 … shown in the figure as an example, the first client may present the first video information by rendering triangles ABC, AD1, a12, a23, …, AnC according to the openGL technique; the first video information is shown by rendering triangles EFC, ED1, E12, E23, …, EnC.
And step 203, the first client generates boundary deformation information according to the first deformation amplitude and the first deformation direction.
This step may include two possible implementations as follows:
firstly, a first client generates boundary deformation information comprising a first deformation amplitude, a first deformation direction and a preset width; the preset width includes: the total width of the first window and the second window.
Secondly, the first client calculates the ratio of the first deformation amplitude to the preset width, and generates boundary deformation information comprising the ratio and the first deformation direction.
Step 204, the first client sends boundary deformation information to the server.
In step 205, the server forwards the boundary deformation information to the second client.
And step 206, the second client displays the first video information in the third window after the second boundary deformation, and displays the second video information in the fourth window after the second boundary deformation, wherein the second boundary is a boundary adjacent to the third window and the fourth window, and the deformed second boundary is deformed according to the boundary deformation information.
Optionally, before this step, the second client may determine the deformed third window and the deformed fourth window, specifically:
first, the second client determines a second deformation amplitude and a second deformation direction according to the boundary deformation information.
Optionally, this step may include:
(1) if the boundary deformation information comprises a first deformation amplitude, a first deformation direction and a preset width, calculating a second deformation amplitude according to the first deformation amplitude, the preset width and the total width of the third window and the fourth window; the preset width includes: a total width of the first window and the second window; and if the boundary deformation information comprises the ratio of the first deformation amplitude to the preset width and the first deformation direction, calculating a second deformation amplitude according to the ratio and the total width of the third window and the fourth window.
Optionally, the second deformation amplitude (first deformation amplitude total width)/preset width. Alternatively, the second deformation amplitude is a ratio of the total width.
(2) And acquiring a second deformation direction according to the first deformation direction, wherein the second deformation direction is consistent with the first deformation direction.
Optionally, the first deformation direction is that a first window displaying the first video information points to a second window displaying the second video information, and the second deformation direction is that a third window displaying the first video information points to a fourth window displaying the second video information; similarly, the first warping direction is from the second window displaying the second video information to the first window displaying the first video information, and the second warping direction is from the fourth window displaying the second video information to the first window displaying the first video information.
Secondly, the second client determines m boundary points according to the second deformation amplitude and the second deformation direction, wherein m is an integer greater than or equal to 1.
This step is similar to the determination method of determining n boundary points by the first client, and is not described herein again. In actual implementation, the value of m may be the same as or different from n, and is not limited thereto.
And thirdly, determining a third window after the deformation of the second boundary and a fourth window after the deformation of the second boundary according to the m boundary points and at least one vertex in the second boundary before the deformation.
This step is similar to the determination manner of determining the deformed first window and the deformed second window by the first client in step 202, and is not described herein again.
Moreover, the display manner in which the second client displays the first video information in the deformed third window and displays the second video information in the deformed fourth window is similar to the display manner in step 202, and is not repeated here.
It should be noted that steps 203 to 206 are optional steps, and may or may not be executed in actual implementation, which is not limited herein.
Another point to be supplemented is that, referring to fig. 7, the information presentation method may further include:
in step 207, the first client counts the deformation duration of the first boundary deformation.
And the first client starts a timer after the first boundary is deformed, and starts timing.
And 208, if the deformation duration reaches the preset duration, the first client displays the first video information in the first window before deformation, and displays the second video information in the second window before deformation.
The preset duration may be a default duration in the first client, or may be a user-defined duration, which is not limited herein.
When the deformation duration reaches the preset duration, the deformation is already expected, and at this time, the first client may restore the deformation of the first boundary, display the first video information in the first window before the deformation, and display the second video information in the second window before the deformation.
In step 209, the first client sends a recovery request to the server.
Step 210, the server forwards the recovery request to the second client.
Alternatively, this step may be performed simultaneously with step 208, or after step 208, without limitation.
In step 211, the second client displays the first video information in the third window before the deformation, and displays the second video information in the fourth window before the deformation.
After receiving the resume request, the second client may present the first video information in a third window before degeneration and present the second video information in a fourth window before degeneration.
The steps 209 to 211 are optional steps, and may or may not be executed in actual implementation, which is not limited herein.
In actual implementation, if the second client also meets the boundary deformation condition before the boundary deformation is recovered, at this time, the first client may determine a final deformation amplitude and a final deformation direction according to the first deformation amplitude and the first deformation direction acquired by the first client and the third deformation amplitude and the third deformation direction determined according to the boundary deformation information sent by the second client, and then deform according to the finally determined deformation amplitude and the finally determined deformation direction, which is not described herein again.
The above embodiment is only exemplified by that the first client and the second client are both one, and in practical implementation, in a scene of a multi-person video call, there may be at least two first clients and at least two second clients. For example, in a scene of a video call of four people (assuming that A, B, C and D clients used by four users are an a client, a B client, a C client and a D client, respectively), a window showing a video information collected by the a client is an a window, a window showing a video information collected by the B client is a B window, a window showing a video information collected by the C client is a C window, and a window showing a video information collected by the D client is a D window. Assuming that a user A applies a sliding signal sliding from a window A to a window B, at the moment, a client A meets a boundary deformation condition, the client A obtains the deformation amplitude and the deformation direction of an AB boundary of the window A and the window B, video information A acquired by the client A is displayed in the window A after the AB boundary is deformed, and video information B acquired by the client B is displayed in the window B after the AB boundary is deformed; the client side A generates boundary deformation information according to the acquired deformation amplitude and deformation direction, and sends the boundary deformation information to the client side B, the client side C and the client side D; the client side B, the client side C and the client side D display video information A in the window A after the boundary AB is deformed according to the received boundary deformation information, and display video information B in the window B after the boundary AB is deformed; similarly, if the user D applies a sliding signal sliding from the window D to the window C, at this time, the client D meets the boundary deformation condition, the client D obtains the deformation amplitude and the deformation direction of the window C and the CD boundary of the window D, the video information C is displayed in the window C after the CD boundary is deformed according to the obtained deformation amplitude and the obtained deformation direction, and the video information D is displayed in the window D after the CD boundary is deformed; the client side generates boundary deformation information according to the acquired deformation amplitude and the deformation direction, and sends the boundary deformation information to the client side A, the client side B and the client side C; the client a, the client B, and the client C display the video information C in the window C after the CD boundary is deformed according to the boundary deformation information, and display the video information D in the window D after the CD boundary is deformed, where a display schematic diagram of the display schematic diagram is shown in fig. 8, and details are not repeated here in this embodiment.
In summary, in the information display method provided in this embodiment, in the process of video call between the first client and the second client, when the first client meets the boundary deformation condition, the first deformation amplitude and the first deformation direction of the first boundary are obtained, the first video information acquired by the first client is displayed in the first window after the first boundary is deformed according to the first deformation amplitude and the first deformation direction, and the second video information acquired by the second client is displayed in the second window after the first boundary is deformed; that is, when the first client meets the boundary deformation condition, the boundary of the window displaying the first video information and the second video information is deformed, so that the problem that the display mode of the video information in the prior art is single is solved, and the effect of enriching the display mode of the video information is achieved.
Meanwhile, the adjacent boundaries of the windows for displaying the two paths of video information in the first client and the second client can be deformed, so that the interaction between the two clients is increased in the video call process by the information display mode, and the interest of the video call of a user is improved.
In addition, after the preset time length is deformed, the video information is displayed in the window before deformation again, so that the interaction frequency of the two parties in the call is improved.
It should be added that, in the above embodiment, only the first deformation amplitude and the first deformation direction are obtained when the first client meets the boundary deformation condition as an example, and in actual implementation, a call mode may also be preset in the first client, where the first call mode is to allow boundary deformation, and the second call mode is not to allow boundary deformation. Therefore, in this case, after the first client meets the boundary deformation condition, the first client may further detect whether the first client is currently in the first call mode, and if so, obtain a first deformation amplitude and a first deformation direction; if not, the process is terminated, which is not limited to this. Similarly, the second client may also have a call mode, so that after the second client receives the boundary deformation information, the second client may detect whether the second client is currently in the first call mode, and if so, execute step 206; if not, the process is terminated, which is not limited to this.
Another point to be added is that, in the above embodiment, the step related to the first client side may be implemented separately as an information presentation method of the first client side, and the step related to the second client side may be implemented separately as an information presentation method of the second client side.
Please refer to fig. 9, which illustrates a schematic structural diagram of an information presentation apparatus according to an embodiment of the present invention, and the embodiment is exemplified by the information presentation apparatus being used in the first client shown in fig. 1. As shown in fig. 9, the information presentation apparatus may include: an acquisition module 910 and a presentation module 920.
An obtaining module 910, configured to obtain a first deformation amplitude and a first deformation direction of a first boundary when a boundary deformation condition is met in a process of a video call with a second client; the first boundary is a boundary adjacent to a first window and a second window, the first window is a window for displaying first video information acquired by the first client, and the second window is a window for displaying second video information acquired by the second client;
a displaying module 920, configured to display the first video information in the first window after the first boundary deformation, and display the second video information in the second window after the first boundary deformation; the deformed first boundary is deformed according to the first deformation magnitude and the first deformation direction.
In summary, in the information displaying apparatus provided in this embodiment, in the process of video call between the first client and the second client, when the first client meets the boundary deformation condition, the first deformation amplitude and the first deformation direction of the first boundary are obtained, the first video information acquired by the first client is displayed in the first window after the first boundary is deformed according to the first deformation amplitude and the first deformation direction, and the second video information acquired by the second client is displayed in the second window after the first boundary is deformed; that is, when the first client meets the boundary deformation condition, the boundary of the window displaying the first video information and the second video information is deformed, so that the problem that the display mode of the video information in the prior art is single is solved, and the effect of enriching the display mode of the video information is achieved.
Meanwhile, the adjacent boundaries of the windows for displaying the two paths of video information in the first client and the second client can be deformed, so that the interaction between the two clients is increased in the video call process by the information display mode, and the interest of the video call of a user is improved.
Based on the information displaying apparatus provided in the foregoing embodiment, optionally, the obtaining module 910 is further configured to:
acquiring the default first deformation amplitude;
alternatively, the first and second electrodes may be,
when the boundary deformation condition comprises that a sliding signal sliding the first boundary is received, acquiring a sliding distance of the sliding signal, and acquiring the first deformation amplitude according to the sliding distance; the first deformation amplitude and the sliding distance are in positive correlation;
alternatively, the first and second electrodes may be,
when the boundary deformation condition comprises that the image information of the first video information comprises a target gesture, acquiring the gesture amplitude of the target gesture, and acquiring the first deformation amplitude according to the gesture amplitude; the first deformation amplitude and the gesture amplitude are in positive correlation;
alternatively, the first and second electrodes may be,
when the boundary deformation condition includes that the audio information of the first video information includes target content, acquiring volume corresponding to the target content, and acquiring the first deformation amplitude according to the volume; the first deformation amplitude and the volume are in positive correlation.
Optionally, the obtaining module 910 is further configured to:
when the boundary deformation condition comprises that a sliding signal sliding the first boundary is received, acquiring the sliding direction of the sliding signal, and taking the sliding direction as the first deformation direction;
alternatively, the first and second electrodes may be,
and when the boundary deformation condition comprises other conditions, acquiring the direction of the first window pointing to the second window, and taking the acquired direction as the first deformation direction.
Optionally, the apparatus further comprises:
a first determining module, configured to determine n boundary points according to the first deformation magnitude and the first deformation direction, where n is an integer greater than or equal to 1;
a second determining module, configured to determine, according to the n boundary points and at least one vertex in the first boundary before deformation, the first window after deformation of the first boundary and the second window after deformation of the first boundary.
Optionally, the first determining module is further configured to:
determining a shift position after shifting the first deformation magnitude along the first deformation direction from a preset position of the first boundary;
determining an arc that passes through the offset location and at least one vertex in the first boundary;
and selecting n points of the arc except the vertex as the n boundary points.
Optionally, the apparatus further comprises:
the statistical module is used for counting the deformation duration of the first boundary deformation;
the displaying module 920 is further configured to display the first video information in the first window before the deformation and display the second video information in the second window before the deformation when the deformation duration counted by the counting module reaches a preset duration.
Optionally, the apparatus further comprises:
the generating module is used for generating boundary deformation information according to the first deformation amplitude and the first deformation direction;
the sending module is used for sending the boundary deformation information to the second client; the second client displays the first video information in a third window with a deformed second boundary, and displays the second video information in a fourth window with a deformed second boundary, wherein the second boundary is a boundary adjacent to the third window and the fourth window; and the deformed second boundary is deformed according to the boundary deformation information.
Referring to fig. 10, a schematic structural diagram of an information presentation apparatus according to an embodiment of the present invention is shown, and the embodiment is exemplified by using the information presentation apparatus in the second client shown in fig. 1. As shown in fig. 10, the information presentation apparatus may include: a receiving module 1010 and a display module 1020.
A receiving module 1010, configured to receive boundary deformation information sent by a first client during a video call with the first client; the boundary deformation information is generated according to a first deformation amplitude and a first deformation direction of an acquired first boundary when the first client meets a boundary deformation condition, the first boundary is a boundary adjacent to a first window and a second window, the first window is a window used for displaying first video information acquired by the first client, and the second window is a window used for displaying second video information acquired by the second client;
a displaying module 1020, configured to display the first video information in a third window with a deformed second boundary, and display the second video information in a fourth window with a deformed second boundary, where the second boundary is a boundary between the third window and the fourth window; and the deformed second boundary is deformed according to the boundary deformation information.
In summary, the information displaying apparatus provided in this embodiment displays, after receiving the boundary deformation information sent by the first client, the first video information in the third window after the second boundary is deformed according to the boundary deformation information, and displays the second video information in the fourth window after the second boundary is deformed according to the boundary deformation information; that is, when the first client meets the boundary deformation condition, the boundary of the window displaying the first video information and the second video information is deformed, so that the problem that the display mode of the video information in the prior art is single is solved, and the effect of enriching the display mode of the video information is achieved.
Meanwhile, the adjacent boundaries of the windows for displaying the two paths of video information in the first client and the second client can be deformed, so that the interaction between the two clients is increased in the video call process by the information display mode, and the interest of the video call of a user is improved.
Based on the information display device provided in the above embodiment, optionally, the device further includes:
the first determining module is used for determining a second deformation amplitude and a second deformation direction according to the boundary deformation information;
a second determining module, configured to determine m boundary points according to the second deformation magnitude and the second deformation direction determined by the first determining module, where m is an integer greater than or equal to 1;
a third determining module, configured to determine the third window after the deformation of the second boundary and the fourth window after the deformation of the second boundary according to the m boundary points and at least one vertex in the second boundary before the deformation.
Optionally, the second determining module is further configured to:
determining a shift position after shifting the second deformation magnitude along the second deformation direction from the preset position of the second boundary;
determining an arc that passes through the offset location and at least one vertex in the second boundary;
and selecting m points of the arc except the vertex as the m boundary points.
Optionally, the apparatus further comprises:
a receiving module, configured to receive a recovery request sent by the first client; the recovery request is a request sent by the first client when the counted deformation time of the first boundary exceeds a preset time;
the displaying module 1020 is further configured to display the first video information in the third window before the deformation, and display the second video information in the fourth window before the deformation.
It should be noted that: the information display device provided in the above embodiment is only illustrated by dividing the functional modules, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the server is divided into different functional modules to complete all or part of the functions described above. In addition, the information display apparatus and the information display method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.
Embodiments of the present invention also provide a computer-readable storage medium, which may be a computer-readable storage medium contained in a memory; or it may be a separate computer-readable storage medium not incorporated in the terminal. The computer-readable storage medium stores one or more programs, which are used by one or more processors to execute the above-described information presentation method.
Fig. 11 is a block diagram of a terminal 1100 provided by an embodiment of the present invention, which may include Radio Frequency (RF) circuitry 1101, a memory 1102 including one or more computer-readable storage media, an input unit 1103, a display unit 1104, a sensor 1105, an audio circuit 1106, a Wireless Fidelity (WiFi) module 1107, a processor 1108 including one or more processing cores, and a power supply 1109. Those skilled in the art will appreciate that the terminal structure shown in fig. 11 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the RF circuit 1101 may be used for receiving and transmitting signals during a message transmission or communication process, and in particular, for receiving downlink information from a base station and then processing the received downlink information by one or more processors 1108; in addition, data relating to uplink is transmitted to the base station. In general, the RF circuitry 1101 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), and the like.
The memory 1102 may be used for storing software programs and modules, and the processor 1108 may execute various functional applications and data processing by operating the software programs and modules stored in the memory 1102. The memory 1102 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal, etc. Further, the memory 1102 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 1102 may also include a memory controller to provide the processor 1108 and the input unit 1103 with access to the memory 1102.
The input unit 1103 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in a particular embodiment, the input unit 1103 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1108, and can receive and execute commands sent by the processor 1108. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 1103 may include other input devices in addition to the touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 1104 may be used to display information input by or provided to the user and various graphical user interfaces of the terminal, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 1104 may include a Display panel, and optionally, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may overlay the display panel, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the processor 1108 to determine the type of touch event, and the processor 1108 then provides a corresponding visual output on the display panel according to the type of touch event. Although in FIG. 11 the touch-sensitive surface and the display panel are two separate components to implement input and output functions, in some embodiments the touch-sensitive surface may be integrated with the display panel to implement input and output functions.
The terminal may also include at least one sensor 1105, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel according to the brightness of ambient light, and a proximity sensor that may turn off the display panel and/or the backlight when the terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.
Audio circuitry 1106, a speaker, and a microphone may provide an audio interface between the user and the terminal. The audio circuit 1106 may transmit the electrical signal converted from the received audio data to a speaker, and the electrical signal is converted into a sound signal by the speaker and output; on the other hand, the microphone converts the collected sound signal into an electric signal, which is received by the audio circuit 1106 and converted into audio data, which is then processed by the audio data output processor 1108, and then passed through the RF circuit 1101 to be sent to, for example, another terminal, or output to the memory 1102 for further processing. The audio circuitry 1106 may also include an earbud jack to provide peripheral headset communication with the terminal.
WiFi belongs to short distance wireless transmission technology, and the terminal can help the user to send and receive e-mail, browse web page and access streaming media etc. through the WiFi module 1107, which provides wireless broadband internet access for the user. Although fig. 11 shows the WiFi module 1107, it is understood that it does not belong to the essential constitution of the terminal, and it may be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 1108 is a control center of the terminal, connects various parts of the entire handset using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 1102 and calling data stored in the memory 1102, thereby performing overall monitoring of the handset. Optionally, processor 1108 may include one or more processing cores; preferably, the processor 1108 may integrate an application processor, which primarily handles operating systems, user interfaces, application programs, etc., and a modem processor, which primarily handles wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1108.
The terminal also includes a power supply 1109 (e.g., a battery) for powering the various components, which may preferably be logically connected to the processor 1108 via a power management system that may provide management of charging, discharging, and power consumption. The power supply 1109 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
Although not shown, the terminal may further include a camera, a bluetooth module, and the like, which will not be described herein. Specifically, in this embodiment, the processor 1108 in the terminal executes one or more program instructions stored in the memory 1102, so as to implement the information display methods on the first client side and the second client side provided in the foregoing method embodiments.
It should be understood that, as used herein, the singular forms "a," "an," "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (16)

1. An information presentation method, used in a first client, the method comprising:
in the process of video communication with a second client, when a boundary deformation condition is met, a first deformation amplitude and a first deformation direction of a first boundary are obtained; the first boundary is a boundary adjacent to a first window and a second window, the first window is a window for displaying first video information acquired by the first client, and the second window is a window for displaying second video information acquired by the second client;
determining a shift position after shifting the first deformation magnitude along the first deformation direction from a preset position of the first boundary;
determining an arc that passes through the offset location and at least one vertex in the first boundary;
selecting n points in the arc line except the vertex as the n boundary points, wherein n is an integer greater than or equal to 1;
determining a first window after the deformation of the first boundary and a second window after the deformation of the first boundary according to the n boundary points and at least one vertex in the first boundary before the deformation;
displaying the first video information in the first window after the first boundary deformation, and displaying the second video information in the second window after the first boundary deformation; the deformed first boundary is deformed according to the first deformation magnitude and the first deformation direction.
2. The method of claim 1, wherein obtaining the first magnitude of deformation of the first boundary comprises:
acquiring the default first deformation amplitude;
alternatively, the first and second electrodes may be,
when the boundary deformation condition comprises that a sliding signal sliding the first boundary is received, acquiring a sliding distance of the sliding signal, and acquiring the first deformation amplitude according to the sliding distance; the first deformation amplitude and the sliding distance are in positive correlation;
alternatively, the first and second electrodes may be,
when the boundary deformation condition comprises that the image information of the first video information comprises a target gesture, acquiring the gesture amplitude of the target gesture, and acquiring the first deformation amplitude according to the gesture amplitude; the first deformation amplitude and the gesture amplitude are in positive correlation;
alternatively, the first and second electrodes may be,
when the boundary deformation condition includes that the audio information of the first video information includes target content, acquiring volume corresponding to the target content, and acquiring the first deformation amplitude according to the volume; the first deformation amplitude and the volume are in positive correlation.
3. The method of claim 1, wherein obtaining the first deformation direction of the first boundary comprises:
when the boundary deformation condition comprises that a sliding signal sliding the first boundary is received, acquiring the sliding direction of the sliding signal, and taking the sliding direction as the first deformation direction;
alternatively, the first and second electrodes may be,
and when the boundary deformation condition comprises other conditions, acquiring the direction of the first window pointing to the second window, and taking the acquired direction as the first deformation direction.
4. The method of any of claims 1 to 3, further comprising:
counting deformation duration of the first boundary deformation;
and if the deformation time length reaches a preset time length, displaying the first video information in the first window before deformation, and displaying the second video information in the second window before deformation.
5. The method of any of claims 1 to 3, further comprising:
generating boundary deformation information according to the first deformation amplitude and the first deformation direction;
sending the boundary deformation information to the second client; the second client displays the first video information in a third window with a deformed second boundary, and displays the second video information in a fourth window with a deformed second boundary, wherein the second boundary is a boundary adjacent to the third window and the fourth window; and the deformed second boundary is deformed according to the boundary deformation information.
6. An information presentation method, used in a second client, the method comprising:
receiving boundary deformation information sent by a first client in the process of video call with the first client; the boundary deformation information is generated according to a first deformation amplitude and a first deformation direction of an acquired first boundary when the first client meets a boundary deformation condition, the first boundary is a boundary adjacent to a first window and a second window, the first window is a window used for displaying first video information acquired by the first client, and the second window is a window used for displaying second video information acquired by the second client;
determining a second deformation amplitude and a second deformation direction according to the boundary deformation information;
determining a shift position after shifting the second deformation magnitude along the second deformation direction from the preset position of the second boundary;
determining an arc that passes through the offset location and at least one vertex in the second boundary;
selecting m points in the arc line except the vertex as the m boundary points, wherein m is an integer greater than or equal to 1;
determining a third window after the deformation of the second boundary and a fourth window after the deformation of the second boundary according to the m boundary points and at least one vertex in the second boundary before the deformation;
displaying the first video information in the third window after the second boundary deformation, and displaying the second video information in the fourth window after the second boundary deformation, wherein the second boundary is a boundary adjacent to the third window and the fourth window; and the deformed second boundary is deformed according to the boundary deformation information.
7. The method of claim 6, further comprising:
receiving a recovery request sent by the first client; the recovery request is a request sent by the first client when the counted deformation time of the first boundary exceeds a preset time;
and displaying the first video information in the third window before deformation, and displaying the second video information in the fourth window before deformation.
8. An information presentation apparatus, for use in a first client, the apparatus comprising:
the acquisition module is used for acquiring a first deformation amplitude and a first deformation direction of a first boundary when a boundary deformation condition is met in the process of video communication with a second client; the first boundary is a boundary adjacent to a first window and a second window, the first window is a window for displaying first video information acquired by the first client, and the second window is a window for displaying second video information acquired by the second client;
a first determining module, configured to determine a shift position after shifting the first deformation magnitude along the first deformation direction from a preset position of the first boundary; determining an arc that passes through the offset location and at least one vertex in the first boundary; selecting n points in the arc line except the vertex as the n boundary points, wherein n is an integer greater than or equal to 1;
a second determining module, configured to determine, according to the n boundary points and at least one vertex in the first boundary before deformation, a first window after deformation of the first boundary and a second window after deformation of the first boundary;
the display module is used for displaying the first video information in the first window after the first boundary deformation and displaying the second video information in the second window after the first boundary deformation; the deformed first boundary is deformed according to the first deformation magnitude and the first deformation direction.
9. The apparatus of claim 8, wherein the obtaining module is further configured to:
acquiring the default first deformation amplitude;
alternatively, the first and second electrodes may be,
when the boundary deformation condition comprises that a sliding signal sliding the first boundary is received, acquiring a sliding distance of the sliding signal, and acquiring the first deformation amplitude according to the sliding distance; the first deformation amplitude and the sliding distance are in positive correlation;
alternatively, the first and second electrodes may be,
when the boundary deformation condition comprises that the image information of the first video information comprises a target gesture, acquiring the gesture amplitude of the target gesture, and acquiring the first deformation amplitude according to the gesture amplitude; the first deformation amplitude and the gesture amplitude are in positive correlation;
alternatively, the first and second electrodes may be,
when the boundary deformation condition includes that the audio information of the first video information includes target content, acquiring volume corresponding to the target content, and acquiring the first deformation amplitude according to the volume; the first deformation amplitude and the volume are in positive correlation.
10. The apparatus of claim 8, wherein the obtaining module is further configured to:
when the boundary deformation condition comprises that a sliding signal sliding the first boundary is received, acquiring the sliding direction of the sliding signal, and taking the sliding direction as the first deformation direction;
alternatively, the first and second electrodes may be,
and when the boundary deformation condition comprises other conditions, acquiring the direction of the first window pointing to the second window, and taking the acquired direction as the first deformation direction.
11. The apparatus of any one of claims 8 to 10, further comprising:
the statistical module is used for counting the deformation duration of the first boundary deformation;
the display module is further configured to display the first video information in the first window before deformation and display the second video information in the second window before deformation when the deformation duration counted by the counting module reaches a preset duration.
12. The apparatus of any one of claims 8 to 10, further comprising:
the generating module is used for generating boundary deformation information according to the first deformation amplitude and the first deformation direction;
the sending module is used for sending the boundary deformation information to the second client; the second client displays the first video information in a third window with a deformed second boundary, and displays the second video information in a fourth window with a deformed second boundary, wherein the second boundary is a boundary adjacent to the third window and the fourth window; and the deformed second boundary is deformed according to the boundary deformation information.
13. An information presentation apparatus, for use in a second client, the apparatus comprising:
the receiving module is used for receiving boundary deformation information sent by a first client in the process of video call with the first client; the boundary deformation information is generated according to a first deformation amplitude and a first deformation direction of an acquired first boundary when the first client meets a boundary deformation condition, the first boundary is a boundary adjacent to a first window and a second window, the first window is a window used for displaying first video information acquired by the first client, and the second window is a window used for displaying second video information acquired by the second client;
the first determining module is used for determining a second deformation amplitude and a second deformation direction according to the boundary deformation information;
a second determining module, configured to determine a shift position after shifting the second deformation magnitude along the second deformation direction from the preset position of the second boundary; determining an arc that passes through the offset location and at least one vertex in the second boundary; selecting m points in the arc line except the vertex as the m boundary points, wherein m is an integer greater than or equal to 1;
a third determining module, configured to determine, according to the m boundary points and at least one vertex in the second boundary before deformation, a third window after deformation of the second boundary and a fourth window after deformation of the second boundary;
a display module, configured to display the first video information in the third window after a second boundary deformation, and display the second video information in the fourth window after the second boundary deformation, where the second boundary is a boundary between the third window and the fourth window; and the deformed second boundary is deformed according to the boundary deformation information.
14. The apparatus of claim 13, further comprising:
a receiving module, configured to receive a recovery request sent by the first client; the recovery request is a request sent by the first client when the counted deformation time of the first boundary exceeds a preset time;
the display module is further configured to display the first video information in the third window before the deformation, and display the second video information in the fourth window before the deformation.
15. A terminal, characterized in that the terminal comprises a processor and a memory, in which at least one program is stored, which is loaded and executed by the processor to implement the information presentation method according to any one of claims 1 to 7.
16. A computer-readable storage medium, in which at least one program is stored, the at least one program being loaded and executed by a processor to implement the information presentation method according to any one of claims 1 to 7.
CN201710109310.0A 2017-02-27 2017-02-27 Information display method and device Active CN106803916B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710109310.0A CN106803916B (en) 2017-02-27 2017-02-27 Information display method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710109310.0A CN106803916B (en) 2017-02-27 2017-02-27 Information display method and device

Publications (2)

Publication Number Publication Date
CN106803916A CN106803916A (en) 2017-06-06
CN106803916B true CN106803916B (en) 2021-03-19

Family

ID=58988765

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710109310.0A Active CN106803916B (en) 2017-02-27 2017-02-27 Information display method and device

Country Status (1)

Country Link
CN (1) CN106803916B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107479784B (en) * 2017-07-31 2022-01-25 腾讯科技(深圳)有限公司 Expression display method and device and computer readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104854550A (en) * 2012-12-06 2015-08-19 三星电子株式会社 Display device and method for controlling the same
CN105204733A (en) * 2015-09-02 2015-12-30 小米科技有限责任公司 Video chat window display method and device
CN105490928A (en) * 2016-01-21 2016-04-13 努比亚技术有限公司 Mobile terminal and multitask processing method thereof
CN106101423A (en) * 2016-06-28 2016-11-09 努比亚技术有限公司 Split screen area size adjusting apparatus and method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9325938B2 (en) * 2014-03-13 2016-04-26 Google Inc. Video chat picture-in-picture

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104854550A (en) * 2012-12-06 2015-08-19 三星电子株式会社 Display device and method for controlling the same
CN105204733A (en) * 2015-09-02 2015-12-30 小米科技有限责任公司 Video chat window display method and device
CN105490928A (en) * 2016-01-21 2016-04-13 努比亚技术有限公司 Mobile terminal and multitask processing method thereof
CN106101423A (en) * 2016-06-28 2016-11-09 努比亚技术有限公司 Split screen area size adjusting apparatus and method

Also Published As

Publication number Publication date
CN106803916A (en) 2017-06-06

Similar Documents

Publication Publication Date Title
WO2016169465A1 (en) Method, apparatus and system for displaying screen information
CN105786878B (en) Display method and device of browsing object
CN106506321B (en) Group message processing method and terminal device
CN105094501B (en) Method, device and system for displaying messages in mobile terminal
US11216997B2 (en) Method and apparatus for displaying historical chat record
TWI674555B (en) Emoticon display method, apparatus, computer-readable storage medium and terminal
WO2017125027A1 (en) Method and device for displaying information, and computer storage medium
CN105630846B (en) Head portrait updating method and device
CN106293738B (en) Expression image updating method and device
CN109121008B (en) Video preview method, device, terminal and storage medium
US20210352040A1 (en) Message sending method and terminal device
CN105245432B (en) Unread message counting method and device and terminal
CN106791916B (en) Method, device and system for recommending audio data
WO2019076250A1 (en) Push message management method and related products
CN108958606B (en) Split screen display method and device, storage medium and electronic equipment
WO2019129264A1 (en) Interface display method and mobile terminal
CN109660445B (en) Message processing method, device and storage medium
CN107734153B (en) Call control method, terminal and computer readable storage medium
CN108513671B (en) Display method and terminal for 2D application in VR equipment
CN106936980B (en) Message display method and terminal
CN105513098B (en) Image processing method and device
CN106803916B (en) Information display method and device
CN107193551B (en) Method and device for generating image frame
CN110874128A (en) Visualized data processing method and electronic equipment
CN107632985B (en) Webpage preloading method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant