CN115242994B - Video call system, method and device - Google Patents

Video call system, method and device Download PDF

Info

Publication number
CN115242994B
CN115242994B CN202210655605.9A CN202210655605A CN115242994B CN 115242994 B CN115242994 B CN 115242994B CN 202210655605 A CN202210655605 A CN 202210655605A CN 115242994 B CN115242994 B CN 115242994B
Authority
CN
China
Prior art keywords
terminal
video
video information
area
video call
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210655605.9A
Other languages
Chinese (zh)
Other versions
CN115242994A (en
Inventor
熊正
韩健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202210655605.9A priority Critical patent/CN115242994B/en
Publication of CN115242994A publication Critical patent/CN115242994A/en
Application granted granted Critical
Publication of CN115242994B publication Critical patent/CN115242994B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/06Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
    • H04W4/08User group management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the application provides a video call system, a video call method and a video call device, which are applied to the technical field of terminals. The video call system comprises a first terminal, a second terminal and a third terminal; the first terminal is configured to establish a video call based on the first application and the second terminal, and display a first video call interface; the first terminal is further configured to receive a first operation for selecting a third terminal, and the third terminal and the first terminal are logged in with the same account in the first application; the third terminal and the first terminal are positioned in the same local area network and/or positioned in the same Bluetooth coverage area; and responding to the first operation, and displaying a third video call interface. In the system, the first terminal can acquire video pictures of other areas by calling the cameras and the microphones of nearby available equipment, so that the nearby available equipment can be conveniently added into the video call, the limitation of user addition and video pictures in the video call is reduced, and the user experience is improved.

Description

Video call system, method and device
Technical Field
The present application relates to the field of terminal technologies, and in particular, to a video call system, method, and apparatus.
Background
With the development of terminal technology, the functions of the terminal equipment are more and more abundant, the terminal equipment can configure the video chat function, and a user can carry out video chat through the terminal equipment.
In a possible implementation, in the video call process of the first user and the second user, the mobile phone a of the first user may receive a video picture captured by the front camera or the rear camera of the mobile phone B of the second user, and the mobile phone B of the second user may also receive a video picture captured by the front camera or the rear camera of the mobile phone a of the first user.
However, in the method, the video picture obtained in the video call of the terminal equipment has limitation, and the user experience is affected.
Disclosure of Invention
The embodiment of the application provides a video call system, a method and a device, which can reduce the limitation of video pictures in video call and improve user experience.
In a first aspect, an embodiment of the present application provides a video call system, including a first terminal, a second terminal, and a third terminal; the first terminal is configured to establish a video call based on the first application and the second terminal, and display a first video call interface, wherein the first video call interface displays first video information collected by a camera of the first terminal and second video information collected by a camera of the second terminal; the second terminal is configured to establish a video call based on the first application and the first terminal, and display a second video call interface, wherein the second video call interface displays first video information and second video information; the first terminal is further configured to receive a first operation, the first operation is configured to select a third terminal, and the third terminal and the first terminal are logged in the same account in the first application; the third terminal and the first terminal are positioned in the same local area network and/or positioned in the same Bluetooth coverage area; and responding to the first operation, displaying a third video call interface, wherein the third video call interface displays first video information, second video information and third video information, and the third video information is video information collected by a camera of a third terminal; the second terminal is further configured to display a fourth video call interface, and the fourth video call interface displays the first video information, the second video information and the third video information.
In this way, the first terminal can acquire video pictures in other areas by calling the cameras and the microphones of nearby available equipment, so that the nearby available equipment can be conveniently added into the video call, the limitation of user addition and video pictures in the video call is reduced, and the user experience is improved.
Optionally, the third terminal is configured to display a prompt interface when the application running in the third terminal is a preset application and/or the service running in the third terminal is a preset service, where the prompt interface includes prompt information for prompting whether to enter a video call, a first button for indicating that the video call is agreed, and a second button for indicating that the video call is not agreed; the preset application comprises an application for playing video, and the preset service comprises a video playing service; the third terminal is further configured to receive a second operation for the first button, and respond to the second operation to display a fifth video call interface; the fifth video call interface displays the first video information, the second video information and the third video information; or the fifth video call interface displays the second video information and the third video information.
Therefore, when the priority of the application running in the third terminal is higher, or the video played in the third terminal is important, whether the user agrees to enter the video call or not can be determined through the prompt interface, negative influence on the user caused by directly entering the video interface is reduced, and user experience is improved.
Optionally, the third terminal is further configured to respond to the second operation, further open the microphone and the camera, and collect third video information including voice and pictures.
Therefore, when the third terminal agrees to enter the video call, the camera is turned on, and meanwhile, the microphone is turned on, so that a video picture can be acquired, voice information can be acquired, and user experience is improved.
Optionally, the third terminal is configured to display a sixth video call interface, or continue to display an interface of the application running in the third terminal, when the application running in the third terminal is not a preset application and/or the service running in the third terminal is not a preset service;
the sixth video call interface displays the first video information, the second video information and the third video information; or the sixth video call interface displays the second video information and the third video information;
When the third terminal continues to display the interface of the application running in the third terminal, if the microphone of the third terminal is occupied, the third terminal does not acquire audio information when acquiring the third video information, and if the microphone of the third terminal is unoccupied, the third terminal acquires the audio information when acquiring the third video information.
Therefore, when the application priority level running in the third terminal is lower, or the video played in the third terminal is unimportant video such as advertisement video, the video interface can be directly accessed, whether the user agrees to access the video call or not is not required to be determined through the prompt interface, operation is reduced, and user experience is improved. In addition, when the third terminal continues to display the interface of the application running in the third terminal, whether the third terminal collects audio information when collecting the third video information is controlled by determining whether the microphone of the third terminal is occupied, so that the interference of sound in the application running in the third terminal on video call can be reduced, and the user experience is improved.
Optionally, the first terminal is specifically configured to join one path of video stream and/or audio stream after establishing video communication with the second terminal, so as to obtain first video information, and establish a first session, and send the first video information to the second terminal through the first session; the third terminal is configured to establish communication connection with the first terminal, then join one path of video stream and/or audio stream to obtain third video information, and send the third video information to the server; the server is configured to send third video information to the first terminal according to the relation that the first terminal and the third terminal log in the same account in the first application; the first terminal is further configured to receive third video information from the server, establish a second session, and send the third video information to the second terminal over the second session.
Optionally, the first terminal is specifically configured to join one path of video stream and/or audio stream after establishing video communication with the second terminal, so as to obtain first video information, and establish a first session, and send the first video information to the second terminal through the first session; the third terminal is configured to establish communication connection with the first terminal, then join one path of video stream and/or audio stream to obtain third video information, and send the third video information to the first terminal; the first terminal is further configured to receive third video information from the third terminal, establish a second session, and send the third video information to the second terminal over the second session.
Optionally, the third terminal is configured to send the third video information to the first terminal and send the third video information to the second terminal.
In this way, through the data interaction among the first terminal, the second terminal, the third terminal and the server, the video call among the first terminal, the second terminal and the third terminal can be realized.
Optionally, the first terminal is specifically configured to receive a sliding operation on the preset area, display a calling device button in response to the sliding operation, display a device list in response to a triggering operation on the calling device button, and receive a first operation in the device list, and display a third video call interface in response to the first operation; the device list comprises at least one terminal identifier, wherein the terminal identifier is the identifier of the terminal discovered by the first terminal based on the local area network and/or Bluetooth technology, and the terminal corresponding to the terminal identifier comprises a tablet personal computer, a notebook computer, a smart screen and/or a smart watch.
In this way, nearby available equipment can be selected through the equipment list, and the camera and the microphone of the selected terminal equipment are called, so that video pictures in the area which the user wants to acquire are acquired, the nearby available equipment can be conveniently added into the video call, and the user experience is improved.
Optionally, the first terminal is specifically configured to include a small horn button in the area where the third video information is displayed when the third terminal continues to display the interface of the application running in the third terminal; and receiving a third operation for the small horn button, and controlling a microphone of the third terminal to be turned on or off in response to the third operation.
Therefore, the microphone of the third terminal is controlled by the first terminal, so that the sound of the external environment where the third terminal is located or the sound of the video played by the third terminal can be reduced, the interference to the video call is reduced, and the user experience is improved.
Optionally, the first terminal is further configured to receive a fourth operation for adding a camera button, in response to the fourth operation, display a camera selection list, receive a fifth operation in the camera selection list, the fifth operation is configured to select other cameras of the first terminal, and in response to the fifth operation, display a sixth video call interface, the sixth video call interface displaying first video information, second video information, third video information and fourth video information, the fourth video information being video information collected by other cameras of the first terminal; the camera selection list comprises at least one camera type, wherein the camera type comprises a main camera, a wide-angle camera and a long-focus camera; the second terminal is further configured to display a seventh video call interface, and the seventh video call interface displays the first video information, the second video information, the third video information and the fourth video information.
Optionally, the second terminal is specifically configured to receive a sixth operation for adding a camera button, in response to the sixth operation, display a camera selection list, receive the sixth operation in the camera selection list, the sixth operation is configured to select other cameras of the second terminal, and in response to the sixth operation, display an eighth video call interface; the eighth video call interface displays first video information, second video information, third video information, fourth video information and fifth video information, wherein the fifth video information is video information collected by other cameras of the second terminal; the first terminal is further configured to display a ninth video call interface, and the ninth video call interface displays the first video information, the second video information, the third video information, the fourth video information and the fifth video information.
Optionally, the ninth video call interface displays a first area, a second area, a third area, a fourth area and a fifth area, wherein the first area displays first video information, the second area displays second video information, the third area displays third video information, the fourth area displays fourth video information, and the fifth area displays fifth video information; the first area, the second area, the third area and the fourth area do not have cross coverage areas, the fifth area is a full-screen display area, and the first area, the second area, the third area and the fourth area can move on the upper layer of the fifth area based on user triggering;
Or the ninth video call interface is displayed with a sixth area, a seventh area, an eighth area, a ninth area and a tenth area, wherein the sixth area is displayed with the first video information, the seventh area is displayed with the second video information, the eighth area is displayed with the third video information, the ninth area is displayed with the fourth video information, and the tenth area is displayed with the fifth video information; the sixth, seventh, eighth, ninth and tenth areas have no cross-coverage areas.
Therefore, the video pictures shot by each terminal are displayed through a plurality of independent areas without cross coverage, so that a user can see a clearer and comprehensive video picture, the user can adjust the position of the area, the operation is convenient, and the user experience is improved.
Optionally, the first terminal includes a first mobile phone, and the second terminal includes a second mobile phone.
In a second aspect, an embodiment of the present application provides a video call method, which is applied to a video call system, where the video call system includes a first terminal, a second terminal, and a third terminal, and the method includes: the method comprises the steps that a first terminal establishes video call based on a first application and a second terminal, and a first video call interface is displayed, wherein the first video call interface displays first video information collected by a camera of the first terminal and second video information collected by a camera of the second terminal; the second terminal displays a second video call interface, and the second video call interface displays first video information and second video information; the first terminal receives a first operation, wherein the first operation is to select a third terminal, and the third terminal and the first terminal are logged in the same account in a first application; the third terminal and the first terminal are positioned in the same local area network and/or positioned in the same Bluetooth coverage area; the first terminal responds to the first operation, a third video call interface is displayed, the third video call interface displays first video information, second video information and third video information, and the third video information is video information collected by a camera of the third terminal; the second terminal displays a fourth video call interface, and the fourth video call interface displays the first video information, the second video information and the third video information.
Optionally, the first terminal receives the first operation, and in response to the first operation, displays a third video call interface, which may include: the first terminal receives a sliding operation on the preset area, displays a calling device button in response to the sliding operation, displays a device list in response to a triggering operation on the calling device button, receives a first operation in the device list, and displays a third video call interface in response to the first operation. The device list comprises at least one terminal identifier, wherein the terminal identifier is the identifier of the terminal discovered by the first terminal based on the local area network and/or Bluetooth technology, and the terminal corresponding to the terminal identifier comprises a tablet personal computer, a notebook computer, a smart screen and/or a smart watch.
Optionally, the method may further include: and when the application running in the third terminal is a preset application and/or the service running in the third terminal is a preset service, the third terminal displays a prompt interface. The prompt interface comprises prompt information for prompting whether to enter the video call, a first button for indicating that the video call is agreed to enter, and a second button for indicating that the video call is not agreed to enter. The preset application comprises an application for playing video, and the preset service comprises a video playing service.
Optionally, after displaying the prompt interface, the method may further include: and the third terminal receives a second operation aiming at the first button, and responds to the second operation, a fifth video call interface is displayed. The fifth video call interface displays the first video information, the second video information and the third video information; or the fifth video call interface displays the second video information and the third video information.
Optionally, the method further comprises: and the third terminal responds to the second operation, and also opens the microphone and the camera to acquire third video information comprising voice and pictures.
Optionally, the method may further include: and when the application running in the third terminal is not the preset application and/or the service running in the third terminal is not the preset service, the third terminal displays a sixth video call interface or continuously displays the interface of the application running in the third terminal. The sixth video call interface displays the first video information, the second video information and the third video information; or the sixth video call interface displays the second video information and the third video information.
Optionally, when the third terminal continues to display the interface of the application running in the third terminal, if the microphone of the third terminal is occupied, the third terminal does not collect audio information when collecting the third video information, and if the microphone of the third terminal is unoccupied, the third terminal collects audio information when collecting the third video information.
Optionally, the method may further include a communication relationship between the first terminal, the second terminal, and the third terminal, and the specific implementation may be:
in one possible implementation, after the first terminal establishes video communication with the second terminal, adding a path of video stream and/or audio stream to obtain first video information, and establishing a first session, and sending the first video information to the second terminal through the first session; after the third terminal establishes communication connection with the first terminal, adding one path of video stream and/or audio stream to obtain third video information, and sending the third video information to the server; the server sends third video information to the first terminal according to the relation that the first terminal and the third terminal log in the same account in the first application; the first terminal receives the third video information from the server, establishes a second session, and transmits the third video information to the second terminal through the second session.
In another possible implementation, after the first terminal establishes video communication with the second terminal, adding a path of video stream and/or audio stream to obtain first video information, and establishing a first session, and sending the first video information to the second terminal through the first session; after the third terminal establishes communication connection with the first terminal, adding one path of video stream and/or audio stream to obtain third video information, and sending the third video information to the first terminal; the first terminal receives the third video information from the third terminal, establishes a second session, and transmits the third video information to the second terminal through the second session.
In yet another possible implementation, the third terminal sends third video information to the first terminal and sends third video information to the second terminal.
Optionally, the method may further include: when the third terminal continues to display the interface of the application running in the third terminal, the area, in which the third video information is displayed, in the first terminal comprises a small horn button; and receiving a third operation for the small horn button, and controlling a microphone of the third terminal to be turned on or off in response to the third operation.
Optionally, the method may further include: the first terminal receiving a fourth operation for adding a camera button, displaying a camera selection list in response to the fourth operation, receiving a fifth operation in the camera selection list, the fifth operation configured to select other cameras of the first terminal, and displaying a sixth video call interface in response to the fifth operation; the second terminal displays a seventh video call interface. The sixth video call interface displays first video information, second video information, third video information and fourth video information, wherein the fourth video information is video information collected by other cameras of the first terminal; the seventh video call interface displays the first video information, the second video information, the third video information and the fourth video information. The camera selection list comprises at least one camera type, and the camera type comprises a main camera, a wide-angle camera and a tele camera.
Optionally, the method may further include: the second terminal receiving a sixth operation for adding the camera button, in response to the sixth operation, displaying a camera selection list, receiving the sixth operation in the camera selection list, the sixth operation configured to select other cameras of the second terminal, and in response to the sixth operation, displaying an eighth video call interface; the first terminal displays a ninth video call interface. The eighth video call interface displays first video information, second video information, third video information, fourth video information and fifth video information, wherein the fifth video information is video information collected by other cameras of the second terminal; the ninth video call interface displays the first video information, the second video information, the third video information, the fourth video information, and the fifth video information.
In a possible implementation, the ninth video call interface displays a first area, a second area, a third area, a fourth area and a fifth area, where the first area displays first video information, the second area displays second video information, the third area displays third video information, the fourth area displays fourth video information, and the fifth area displays fifth video information; the first area, the second area, the third area and the fourth area do not have cross coverage areas, the fifth area is a full-screen display area, and the first area, the second area, the third area and the fourth area can move in an upper layer in the fifth area based on user triggering.
In another possible implementation, the ninth video call interface displays a sixth area, a seventh area, an eighth area, a ninth area, and a tenth area, where the sixth area displays the first video information, the seventh area displays the second video information, the eighth area displays the third video information, the ninth area displays the fourth video information, and the tenth area displays the fifth video information; the sixth, seventh, eighth, ninth and tenth areas have no cross-coverage areas.
Alternatively, the first terminal may include a first mobile phone, and the second terminal may include a second mobile phone.
In a third aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor executes the computer program to cause the electronic device to execute a method executed by the first terminal, or a method executed by the second terminal, or a method executed by the third terminal provided in the second aspect.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing a computer program, where the computer program when executed by a processor causes the computer to perform the method performed by the first terminal, or the method performed by the second terminal, or the method performed by the third terminal provided in the second aspect.
In a fifth aspect, embodiments of the present application provide a computer program product, including a computer program, which when executed causes a computer to perform the method performed by the first terminal, or the method performed by the second terminal, or the method performed by the third terminal provided in the second aspect.
The advantages of each of the possible implementation manners of the second aspect to the fifth aspect may be referred to as the advantages of the first aspect, and are not described herein.
Drawings
Fig. 1 is a schematic structural diagram of a terminal device provided in an embodiment of the present application;
fig. 2 is a software architecture block diagram of a terminal device provided in an embodiment of the present application;
fig. 3 is a schematic view of a scenario suitable for use in the embodiments of the present application;
FIG. 4 is a schematic diagram illustrating an operation of invoking an intelligent screen according to an embodiment of the present application;
fig. 5A is a schematic diagram of a video call interface of a mobile phone a after an intelligent screen is invoked according to an embodiment of the present application;
fig. 5B is a schematic diagram of a video call interface of a mobile phone a after an intelligent screen is invoked according to an embodiment of the present application;
fig. 6 is a schematic diagram of a video call interface of a mobile phone a after an intelligent screen is invoked according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a prompt interface of an intelligent screen according to an embodiment of the present application;
FIG. 8A is a schematic diagram of a video call interface of an intelligent screen according to an embodiment of the present application;
FIG. 8B is a schematic diagram of a video call interface of an intelligent screen according to an embodiment of the present disclosure;
fig. 9A is a schematic diagram of a video call interface of an intelligent screen according to an embodiment of the present application;
fig. 9B is a schematic diagram of a video call interface of an intelligent screen according to an embodiment of the present application;
FIG. 10 is a schematic diagram of a display interface of an intelligent screen according to an embodiment of the present disclosure;
fig. 11 is an interaction schematic diagram of a mobile phone a, a mobile phone B and an intelligent screen according to an embodiment of the present application;
fig. 12 is an operation schematic diagram of adding a video frame shot by a mobile phone a according to an embodiment of the present application;
fig. 13A is a schematic diagram of a video call interface of a mobile phone a after adding a video picture shot by the mobile phone a according to an embodiment of the present application;
fig. 13B is a schematic diagram of a video call interface of a mobile phone a after adding a video picture shot by the mobile phone a according to another embodiment of the present application;
fig. 14 is an operation schematic diagram of adding a video frame shot by a mobile phone a according to an embodiment of the present application;
Fig. 15 is an operation schematic diagram of adding a video frame shot by a mobile phone B according to an embodiment of the present application;
fig. 16 is an operation schematic diagram of switching video frames of a mobile phone a according to an embodiment of the present application;
fig. 17 is an interaction schematic diagram of a mobile phone a and a mobile phone B according to an embodiment of the present application;
fig. 18 is a flowchart of a video call method according to an embodiment of the present application;
fig. 19 is a schematic hardware structure of a video call system according to an embodiment of the present application.
Detailed Description
In the embodiments of the present application, the words "first," "second," and the like are used to distinguish between identical or similar items that have substantially the same function and effect. For example, the first chip and the second chip are merely for distinguishing different chips, and the order of the different chips is not limited. It will be appreciated by those of skill in the art that the words "first," "second," and the like do not limit the amount and order of execution, and that the words "first," "second," and the like do not necessarily differ.
It should be noted that, in the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
In the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a alone, a and B together, and B alone, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b, or c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.
The embodiment of the application provides a multi-channel video call method which can be applied to electronic equipment with a video call function. The electronic device includes a terminal device, which may also be referred to as a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), or the like. The terminal device may be a mobile phone, a smart television, a wearable device, a tablet (Pad), a computer with wireless transceiving function, a Virtual Reality (VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in industrial control (industrial control), a wireless terminal in unmanned driving (self-driving), a wireless terminal in teleoperation (remote medical surgery), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation safety (transportation safety), a wireless terminal in smart city (smart city), a wireless terminal in smart home (smart home), or the like. The embodiment of the application does not limit the specific technology and the specific equipment form adopted by the terminal equipment.
In order to better understand the embodiments of the present application, the following describes the structure of the terminal device in the embodiments of the present application:
fig. 1 shows a schematic structure of a terminal device 100. The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriberidentification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, terminal device 100 may include more or less components than illustrated, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processingunit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.
The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it may be called from memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.
In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.
The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively, through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the terminal device 100.
The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, to implement a function of answering a call through the bluetooth headset.
PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.
The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.
The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (displayserial interface, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing function of terminal device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display function of the terminal device 100.
The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.
The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the terminal device 100, or may be used to transfer data between the terminal device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.
It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is a schematic illustration, and does not constitute a structural limitation of the terminal device 100. In other embodiments of the present application, the terminal device 100 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.
The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the terminal device 100. The charging management module 140 may also supply power to the terminal device through the power management module 141 while charging the battery 142.
The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 to power the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.
The wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. The antennas in the terminal device 100 may be used to cover single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.
The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wirelesslocal area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., applied to the terminal device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.
In some embodiments, antenna 1 and mobile communication module 150 of terminal device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that terminal device 100 may communicate with a network and other devices via wireless communication techniques. Wireless communication techniques may include global system for mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (codedivision multiple access, CDMA), wideband code division multiple access (wideband code division multipleaccess, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidounavigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellitesystem, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).
The terminal device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrixorganic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot lightemitting diodes, QLED), or the like. In some embodiments, the terminal device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.
The terminal device 100 may implement a photographing function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, so that the electrical signal is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.
The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.
Optionally, the position of the camera on the terminal device may be front, rear, or internal (which may extend out of the body when in use), which is not limited in this embodiment of the present application.
Alternatively, the terminal device may include a single camera, a dual camera, or a triple camera, which is not limited in the embodiments of the present application. Cameras include, but are not limited to, wide angle cameras, tele cameras, depth cameras, and the like. For example, the terminal device may include three cameras, one of which is a main camera, one of which is a wide-angle camera, and one of which is a tele camera.
Alternatively, when the terminal device includes a plurality of cameras, the plurality of cameras may be all front-mounted, all rear-mounted, all built-in, at least part of front-mounted, at least part of rear-mounted, at least part of built-in, or the like, which is not limited in the embodiment of the present application.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to realize expansion of the memory capability of the terminal device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.
The internal memory 121 may be used to store computer-executable program code that includes instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data (such as audio data, phonebook, etc.) created during use of the terminal device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like. The processor 110 performs various functional applications of the terminal device 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
The terminal device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.
The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.
The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The terminal device 100 can listen to music or to handsfree talk through the speaker 170A.
A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When the terminal device 100 receives a call or voice message, it is possible to receive voice by approaching the receiver 170B to the human ear.
Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The terminal device 100 may be provided with at least one microphone 170C. In other embodiments, the terminal device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the terminal device 100 may be further provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, implement directional recording functions, etc.
The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The terminal device 100 determines the intensity of the pressure according to the change of the capacitance. When a touch operation is applied to the display 194, the terminal device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The terminal device 100 may also calculate the position of the touch from the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions.
The touch sensor 180K, also referred to as a "touch device". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the terminal device 100 at a different location than the display 194.
Fig. 2 is a block diagram illustrating a software configuration of the terminal device 100 according to the embodiment of the present application.
The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.
The application layer may include a series of application packages. As shown in fig. 2, the application package may include camera, gallery, phone, map, phone, music, settings, mailbox, video, social, etc. applications.
The social application program can acquire the audio data and the video data of the user in the video call process, and can also call the cameras and the microphones of nearby available devices through near field capability such as Bluetooth or WiFi so as to acquire video pictures shot by the nearby available devices.
The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.
As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a resource manager, a view system, a notification manager, and the like.
The window manager is used for managing window programs. The window manager may obtain the display screen size, determine if there is a status bar, lock the screen, touch the screen, drag the screen, intercept the screen, etc.
The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.
The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.
The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.
The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the terminal equipment vibrates, and an indicator light blinks.
Android runtimes include core libraries and virtual machines. Android run time is responsible for scheduling and management of the Android system.
The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.
The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.
The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.
The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio video encoding formats, such as: MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.
The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.
The 2D graphics engine is a drawing engine for 2D drawing.
The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.
The workflow of terminal equipment software and hardware is illustrated below in connection with the scenario of terminal equipment interface switching.
When a touch sensor in the terminal equipment receives touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into the original input event (including information such as touch coordinates, touch strength, time stamp of the touch operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer and identifies a button corresponding to the input event. Taking the touch operation as a touch click operation, taking a button corresponding to the click operation as an example of a button of a social application icon, the social application calls an interface of an application framework layer, starts the social application, and further starts a display driver by calling a kernel layer to display a functional interface of the social application.
With the development of terminal technology, the functions of the terminal equipment are more and more abundant, the terminal equipment can be configured with a camera and a video chat function, and a user can carry out video chat through the terminal equipment.
In a possible implementation, in the video call process of the first user and the second user, the first terminal of the first user may receive a video picture captured by the front camera or the rear camera of the second terminal of the second user, and the second terminal of the second user may also receive a video picture captured by the front camera or the rear camera of the first terminal of the first user. The common video call pulling is realized by using social software, and the terminal equipment only supports the video call pulled by friends in the social software in a single chat or group chat mode. For example, the first user, the second user, and the third user are friends in the social application a, and after the first user, the second user, and the third user respectively open the social application a, the first user, the second user, and the third user may pull up the video call each other, or after three people enter a chat group, pull up a group video chat of three people.
In this implementation, for the fourth user who does not open the social application a or does not join the chat group, if the fourth user wants to join the video call of the first user, the second user, and/or the third user in the social application a, or if the first user, the second user, and/or the third user wants to know the fourth user based on the terminal device of the fourth user in the video chat of the social application a, the situation cannot be implemented.
For example, when the first user and the second user are in the same residence during video chat, but the first user and the fourth user are in different rooms, if the second user wants to acquire a video picture including the fourth user, the first user cannot pull up the terminal device of the fourth user, cannot obtain the video picture of the fourth user based on the terminal device of the fourth user, and the first user needs to move the first terminal to the room where the fourth user is located for shooting. Therefore, in the method, the video call of the terminal equipment has limitation, and the user experience is affected.
In view of this, an embodiment of the present application provides a video call system, including a first terminal, a second terminal, and a third terminal; the first terminal is configured to establish a video call based on the first application and the second terminal, and display a first video call interface, wherein the first video call interface displays first video information collected by a camera of the first terminal and second video information collected by a camera of the second terminal; the second terminal is configured to establish a video call based on the first application and the first terminal, and display a second video call interface, wherein the second video call interface displays first video information and second video information; the first terminal is further configured to receive a first operation, the first operation is configured to select a third terminal, and the third terminal and the first terminal are logged in the same account in the first application; the third terminal and the first terminal are positioned in the same local area network and/or positioned in the same Bluetooth coverage area; and responding to the first operation, displaying a third video call interface, wherein the third video call interface displays first video information, second video information and third video information, and the third video information is video information collected by a camera of a third terminal; the second terminal is further configured to display a fourth video call interface, and the fourth video call interface displays the first video information, the second video information and the third video information. In the video call system, the first terminal can acquire video pictures in other areas by calling the cameras and the microphones of nearby available equipment, so that the nearby available equipment can be conveniently added into the video call, the limitation of user addition and video pictures in the video call is reduced, and the user experience is improved.
In this embodiment of the present application, the terminal device of the first user may be a first terminal, the terminal device of the second user may be a second terminal, the available nearby device may be a third terminal, and the example is illustrated by taking the first terminal as a mobile phone a, the second terminal as a mobile phone B, and the third terminal as a smart screen, which does not constitute a limitation of the embodiment of the present application.
Fig. 3 shows a schematic view of a scenario where the video call method according to the embodiment of the present application is applicable.
As shown in a in fig. 3, when the second user sends a video call request to the mobile phone a through the mobile phone B to invite the first user to make a video call, an avatar set by the second user in the social software may be included in the video call request interface on the mobile phone a, and an "answer" button 301 and a "reject" button 302. The display positions of the second user avatar and the avatar are not specifically limited in the embodiment of the present application, and the display icons of the "answer" button 301 and the "reject" button 302 are not specifically limited in the embodiment of the present application.
Illustratively, the first user enters the video call interface as shown at b in fig. 3 by clicking the "answer" button 301. As shown in B in fig. 3, the video shot by the mobile phone a is located in the area 1, and the video shot by the mobile phone B is located in the area 2.
Optionally, the video picture shot by the mobile phone a may be located in the area 1, and the video picture shot by the mobile phone B may be located in the area 2; alternatively, the video frame shot by the mobile phone a may be located in the area 2, and the video frame shot by the mobile phone B may be located in the area 1.
In this embodiment of the present application, in the video call interface of the mobile phone a, the area 1 may be an area displayed as a full screen, and the area 2 may be an area displayed as a small window. The position and size of the area 2 are not particularly limited in the embodiment of the present application. The first user can switch the display areas of the pictures shot by the mobile phone a and the mobile phone B according to the need, for example, by clicking the small window of the area 2, switch the video picture of the small window of the area 2 to the full-screen display of the area 1, switch the video picture of the full-screen display of the area 1 to the small window of the area 2, and the specific switching triggering mode is not limited specifically. The display area of the picture shot by the mobile phone a and the display area of the picture shot by the mobile phone B are not particularly limited.
By way of example, in a video call interface as shown in b in fig. 3, a "multiple camera" button 303, a "hang-up" button 304, and a "switch voice" button 305 may be included.
Illustratively, when the mobile phone a is in the video call interface shown as b in fig. 3, the camera of the mobile phone a may be preset as a front camera, the front camera of the mobile phone a is used by the first user to perform video call with the second user, and the first user may select to trigger to switch the camera or to add the camera by clicking the "multiple camera" button 303, such as the "switch camera" button 307 and the "add camera" button 306 shown in c in fig. 3. When the first user clicks the "switch camera" button 307, the mobile phone a will switch the camera, for example, switch the front camera to the rear camera, or when the first user clicks the "add camera" button 306, the mobile phone a may add one or more rear cameras to collect images, and may simultaneously obtain video images captured by the front camera and/or one or more rear cameras in the mobile phone, and detailed description of specific implementation of adding cameras will be omitted herein.
Of course, the first user may click on the "hang-up" button 304 to end the video call with the second user, or click on the "switch voice" button 305 to switch the video call to the voice call.
Note that, in the embodiment of the present application, the display icons of the "multiple camera" button 303, the "hang-up" button 304, the "switch voice" button 305, the "add camera" button 306, and the "switch camera" button 307 are not particularly limited.
Illustratively, the first user may swipe a "call device" button 308 in the video call interface as shown by e in fig. 3 by an operation as shown by d in fig. 3, e.g., swipe up at the lower left corner of the screen of the mobile phone a. Wherein the first user may retrieve the video pictures taken by the nearby available devices by clicking the "invoke device" button 308 to invoke the cameras of the nearby available devices. The implementation of the specific calling device will be described in detail in the following embodiments, which are not described herein.
Note that, in the embodiment of the present application, the generation manner, the position, and the display icon of the "call device" button 308 are not particularly limited.
The technical scheme of the present application and the technical scheme of the present application are described in detail below with specific examples. The following embodiments may be implemented independently or combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.
The embodiment of the application provides a video call system, and the following describes the video call system related to the embodiment of the application.
The embodiment of the application provides a video call system, in which a video picture shot by an intelligent screen can be acquired, as shown in fig. 4. For example, as shown in a of fig. 4, during the video call, the first user triggers to display the device list 401 shown in b of fig. 4 by clicking the "call device" button 308, where the device list 401 may include a third terminal such as a tablet computer, a notebook computer, a smart screen, or a smart watch, or when there are a plurality of terminal devices of the same type, the same type of device may be distinguished by different device identifiers, where the device identifiers may be device models or the like. For example, if there are three tablet computers in the device list 401, the three tablet computers are respectively identified by tablet computer a, tablet computer B, and tablet computer C. The embodiment of the application does not specifically limit the device identifier.
The third terminal shown in the device list 401 is an exemplary terminal device that can be invoked by the first user, and the terminal device that can be invoked can be understood as a connection between the terminal device and the mobile phone a through a near field sensing capability, for example, the mobile phone a and the terminal device can be in the same local area network and/or be in a range covered by bluetooth signals at the same time, and the application account registered by the mobile phone a and the terminal device is the same account, and the application can be a system application or third party social software, and the like. For example, the mobile phone a and the terminal are provided with the same social software, the account registered on the social software is the same account, or the mobile phone a and the terminal are provided with the same mobile phone number, and so on. Because of the connection relationship between the terminal device and the mobile phone a, the mobile phone a may invoke the terminal device and invoke the camera and/or microphone of the terminal device.
It should be noted that, in the embodiment of the present application, the connection manner between the mobile phone a and the terminal device is not specifically limited, and the account form in which the mobile phone a logs in with the terminal device is not specifically limited.
Illustratively, as shown in b of fig. 4, the first user invokes the smart screen by clicking the smart screen in the device list 401 to acquire a video picture taken by the smart screen. The location and size of the device list 401 are not specifically limited in the embodiment of the present application.
In one possible implementation, the smart screen supports a video chat function, when the mobile phone a and the smart screen are connected through the local area network, the mobile phone a and the smart screen are simultaneously provided with the same social software, and when the accounts registered on the social software are the same account, the mobile phone a can call the camera and/or the microphone of the smart screen.
When the smart screen is added to the video call between the mobile phone a and the mobile phone B, the camera of the smart screen is turned on, and the video pictures collected by the camera of the smart screen can be obtained by the mobile phone a and the mobile phone B.
The video call interface of the mobile phone a is described in detail below, and the video call interface of the mobile phone B is similar to the video call interface of the mobile phone a, and the video call interface of the smart screen is described in detail in the following embodiments, which are not described herein.
In one possible implementation, when the smart screen is invoked by the mobile phone a, the microphone of the third terminal is turned on by default, and the microphone of the smart screen is not controlled in the video call interface of the mobile phone a, where the video call interface of the mobile phone a is shown in fig. 5A and 5B.
As shown in fig. 5A, an area 1, an area 2, and an area 3 are displayed in the video call interface of the mobile phone a. Wherein, region 1 is a full screen display region, region 2 and region 3 do not have cross coverage area, and are displayed as independent portlets. For example, the area 1 may display a video shot by the smart screen, the area 2 may display a video shot by the mobile phone B, and the area 3 may display a video shot by the mobile phone a. The embodiment of the application does not specifically limit the video picture shot by the mobile phone a, the video picture shot by the mobile phone B and the video picture shot by the smart screen.
It should be noted that, in the embodiment of the present application, the camera opened by the mobile phone a and the camera opened by the mobile phone B are not specifically limited.
The first user may switch the display areas of one video picture shot by the mobile phone a, one video picture shot by the mobile phone B, and one video picture shot by the smart screen, for example, the first user may switch the video picture of the small window in the area 2 to be displayed in the area 1 in a full screen manner by touching the small window in the area 2 by double clicking the mobile phone a, and the specific triggering manner is not limited specifically. The embodiment of the application does not specifically limit the area in which one video picture shot by the mobile phone A, one video picture shot by the mobile phone B or one video picture shot by the intelligent screen is displayed.
In the embodiment of the present application, the size and position of the area 3 are not particularly limited. The size of the region 3 may be the same as the region 2 or may be different from the region 2.
The video call interface of the mobile phone a may be an interface shown in fig. 5B, where, as shown in fig. 5B, the video frames are displayed in the form of separate portlets, the display areas of the video frames are an area 4, an area 5 and an area 6, and no cross coverage area exists between the area 4, the area 5 and the area 6. For example, the area 4 may display a video shot by the mobile phone a, the area 5 may display a video shot by the mobile phone B, and the area 6 may display a video shot by the smart screen.
For example, the first user may switch the display areas of one video picture shot by the mobile phone a, one video picture shot by the mobile phone B, and one video picture shot by the smart screen, for example, the first user drags the video picture displayed in the area 4 to the area 6 by touching the mobile phone a, then the video picture displayed in the area 4 may be moved to the area 6 to be displayed, and the video picture displayed in the area 6 may be moved to the area 4 to be displayed, and the specific triggering mode is not limited specifically. The embodiment of the application does not specifically limit the area in which one video picture shot by the mobile phone A, one video picture shot by the mobile phone B or one video picture shot by the intelligent screen is displayed.
In the embodiment of the present application, the sizes and positions of the areas 4, 5, and 6 are not particularly limited. The dimensions of the region 4, the region 5 and the region 6 may be the same or different.
In another possible implementation, as shown in fig. 6, in the video call interface of the mobile phone a, a "small horn" button 601 may be set in the display area of the picture shot by the smart screen in the area 6, so that the first user may control the on/off of the microphone of the smart screen.
Illustratively, after the first user selects the smart screen in the device list 401, the handset a may send a video call request to the smart screen.
In a possible implementation, if the mobile phone a sends a video call request to the smart screen for the first time, after receiving the video call request sent by the mobile phone a, the smart screen displays a prompt interface as shown in fig. 7 on a display screen of the smart screen, where the prompt interface includes prompt information for prompting whether to enter the video call, "yes" button 701 and "no" button 702, where the "yes" button 701 is used to indicate that the mobile phone a is authorized to enter the video call, the "no" button 702 is used to indicate that the mobile phone a is not authorized to enter the video call, and a third user may agree to the video call request sent by the mobile phone a by clicking the "yes" button 701. If the mobile phone A does not send the video call request to the smart screen for the first time, the smart screen defaults to agree with the video call request sent by the mobile phone A, and displays a video call interface, or continues to display an interface of an application running in the smart screen.
In another possible implementation, each time the mobile phone a sends a video call request to the smart screen, the smart screen displays a prompt interface as shown in fig. 7 on the display screen of the smart screen after receiving the video call request sent by the mobile phone a, where the prompt interface includes prompt information for prompting whether to enter a video call, and a yes button 701 and a no button 702 are included in the prompt interface, and the third user may agree to the video call request sent by the mobile phone a by clicking the yes button 701, display the video call interface, or continue to display the interface of the application running in the smart screen.
In still another possible implementation, when the application running in the smart screen is a preset application and/or the service running in the smart screen is a preset service, a prompt interface as shown in fig. 7 is displayed on the display screen of the smart screen, where the prompt interface includes prompt information for prompting whether to enter a video call, a yes button 701 and a no button 702, and the third user may agree to the video call request sent by the mobile phone a by clicking the yes button 701.
It should be noted that, the preset application includes an application for playing video, and the preset service includes a video playing service. For example, the preset application may be a game application, a video application, or a video conference application, and the preset service may be a play service of a television or a movie, and the preset service does not include an advertisement play service, where the advertisement generally has an advertisement identifier, and whether the preset service is the advertisement play service may be determined by the advertisement identifier.
In addition, when the application running in the intelligent screen is not a preset application and/or the service running in the intelligent screen is not a preset service, the intelligent screen defaults to the video call request sent by the mobile phone A, and displays a video call interface, or continues to display the interface of the application running in the intelligent screen. When the smart screen is added to the video call between the mobile phone a and the mobile phone B, for example, the camera of the smart screen may be up-down, which is not limited in the embodiment of the present application.
In one possible implementation, the microphone of the smart screen is turned on by default, and a video picture shot by the mobile phone a, a video picture shot by the mobile phone B and a video picture shot by the smart screen are displayed in the video call interface of the smart screen. After joining the video call, the display interface of the smart screen may be as shown in fig. 8A and 8B.
Illustratively, in the interface shown in fig. 8A, the video call interface of the smart screen may be divided into a region 7, a region 8, and a region 9. In the video call interface of the intelligent screen, the area 7 can be an area which is displayed as a full screen, the area 8 and the area 9 can be areas which are displayed as independent small windows, and no cross coverage area exists between the area 8 and the area 9.
For example, the area 7 may display a video shot by the smart screen, the area 8 may display a video shot by the mobile phone B, and the area 9 may display a video shot by the mobile phone a.
In the display interface of the smart screen, the third user may switch the display areas of one video picture shot by the mobile phone a, one video picture shot by the mobile phone B, and one video picture shot by the smart screen, for example, the third user may switch the video picture displayed by the small window of the area 8 to be displayed in the area 7 in a full screen manner through double clicking the small window of the area 8 with a mouse, and switch the video picture displayed in the area 7 in the full screen manner to be displayed in the small window of the area 8, which is not limited in a specific triggering manner. The embodiment of the application does not specifically limit in which area the video picture shot by the mobile phone a, the mobile phone B or the smart screen is displayed.
In the embodiment of the present application, the sizes and positions of the areas 8 and 9 are not particularly limited. The dimensions of the region 8 and the region 9 may be the same or different.
Illustratively, in the interface shown in fig. 8B, the video call interface of the smart screen may be divided into a region 10, a region 11, and a region 12. In the video call interface of the smart screen, the area 10, the area 11 and the area 12 can be all displayed as independent small windows, and no cross coverage area exists among the area 10, the area 11 and the area 12.
For example, the area 10 may display a video shot by the smart screen, the area 11 may display a video shot by the mobile phone B, and the area 12 may display a video shot by the mobile phone a. In the display interface of the smart screen, for example, the third user may switch the display areas of the video frame shot by the mobile phone a, the video frame shot by the mobile phone B, and the video frame shot by the smart screen, for example, the third user drags the video frame displayed in the area 10 to the area 12 through the mouse, so that the video frame displayed in the area 10 may be moved to be displayed in the area 12, and the video frame displayed in the area 12 may be moved to be displayed in the area 10, and the specific triggering mode is not limited specifically. The embodiment of the application does not specifically limit in which area the video picture shot by the mobile phone a, the mobile phone B or the smart screen is displayed.
In the embodiment of the present application, the sizes and positions of the areas 10, 11, and 12 are not particularly limited. The dimensions of the region 10, the region 11 and the region 12 may be the same or different.
Of course, in the video call interface of the smart screen, the third user may exit the video call by clicking the "hang-up" button 801.
In another possible implementation, the microphone of the smart screen is turned on by default, and because the distance between the mobile phone a and the smart screen is relatively short, one video picture shot by the mobile phone B and one video picture shot by the smart screen can be displayed in the video call interface of the smart screen, and one video picture shot by the mobile phone a is not displayed. After joining the video call, the display interface of the smart screen is shown in fig. 9A and 9B.
Illustratively, in the interface shown in fig. 9A, the video call interface of the smart screen may be divided into a region 13 and a region 14. In the video call interface of the smart screen, the area 13 may be an area displayed as a full screen, and the area 14 may be an area displayed as an independent small window.
For example, the area 13 may display a video shot by the smart screen, and the area 14 may display a video shot by the mobile phone B. In the display interface of the smart screen, the third user can switch the display area of one video picture shot by the mobile phone B and one video picture shot by the smart screen, and the specific triggering mode is not limited specifically. The embodiment of the application does not specifically limit in which area the video picture shot by the smart screen or the mobile phone B is displayed.
In the embodiment of the present application, the size and position of the region 14 are not particularly limited. The dimensions of the regions 14 may be the same or different.
Illustratively, in the interface shown in fig. 9B, the video call interface of the smart screen may be divided into a region 15 and a region 16. In the video call interface of the intelligent screen, the area 15 and the area 16 can be used as the areas displayed by independent small windows, and no cross coverage area exists between the area 15 and the area 16.
For example, the area 15 may display a video shot by the smart screen, and the area 16 may display a video shot by the mobile phone B. In the display interface of the smart screen, the third user can switch the display area of one video picture shot by the mobile phone B and one video picture shot by the smart screen, and the specific triggering mode is not limited specifically. The embodiment of the present application does not specifically limit in which area the video picture of the smart screen or the mobile phone B is displayed.
In the embodiment of the present application, the sizes and positions of the regions 15 and 16 are not particularly limited. The dimensions of the region 15 and the region 16 may be the same or different.
In yet another possible implementation, in order not to affect the normal viewing of the smart screen by the third user, the smart screen may not display the video call interface after accessing the video call, and continue displaying the interface of the application running in the smart screen. For example, when the mobile phone a sends a video call request to the smart screen, the smart screen is playing a television play, and after the smart screen is connected to the video call, the smart screen does not display a video call interface, and continues to play the television play.
The mobile phone a can control whether the microphone of the smart screen is turned on, and when the microphone of the smart screen is turned on, the mobile phone a can call the camera and the microphone of the smart screen at the same time to acquire video information of the smart screen including voice and pictures; when the microphone of the smart screen is not started, the mobile phone A can call the camera of the smart screen to acquire video information of the smart screen including the picture. In addition, when the smart screen continues to display the interface of the application running in the smart screen, if the microphone in the smart screen is occupied, the smart screen may not collect audio information; if the microphone in the intelligent screen is unoccupied, the intelligent screen collects audio information.
For example, in the video call process of the mobile phone a and the mobile phone B, after the mobile phone a calls the smart screen, one video picture shot by the mobile phone a, one video picture shot by the mobile phone B, and one video picture shot by the smart screen are displayed in the video call interfaces of the mobile phone a and the mobile phone B, and the display picture on the display area 17 of the smart screen is still playing a television, as shown in the interface of fig. 10. The embodiment of the application does not specifically limit the picture played on the intelligent screen.
The smart screen may not display a video call interface after the smart screen is connected to the video call, the mobile phone a and the mobile phone B may acquire video pictures shot by the camera of the smart screen, so that in order to enable the third user to join in the chat between the first user and the second user in the form of voice chat, the mobile phone a may control the microphone of the smart screen to be turned on, and since the third user plays sound in videos such as a television play or a movie, the chat between the first user, the second user and the third user may be affected, and in order to not enable the sound of the video played in the smart screen to affect the chat between the first user, the second user and the third user, the playing of videos such as the television play or the movie may be paused after the smart screen is connected to the video call.
For example, in the process of making video call between the mobile phone a and the mobile phone B and the smart screen, an interaction diagram between the mobile phone a and the mobile phone B and the smart screen is shown in fig. 11. After video communication connection is established between the mobile phone A and the mobile phone B, one path of video stream and one path of audio stream are added into the mobile phone A, and after the video communication connection is established between the mobile phone A and the mobile phone B, a session 1 is established between the mobile phone A and the mobile phone B, so that video communication can be carried out between the mobile phone A and the mobile phone B.
For example, after the mobile phone a and the mobile phone B establish the session 1, in one possible implementation, the smart screen sends the video information collected by the camera of the smart screen to the mobile phone a, the mobile phone a receives the video information from the smart screen, and sends the video information collected by the camera of the mobile phone a to the mobile phone B through the session 1, and sends the video information collected by the camera of the smart screen to the mobile phone B through the session 2.
When the mobile phone A invokes the camera and the microphone of the smart screen, private communication connection is established between the mobile phone A and the smart screen through a private communication protocol, for example, the mobile phone A and the smart screen can be connected through near field sensing capability such as local area network and/or Bluetooth, another path of video stream and another path of audio stream are added into the mobile phone A through the smart screen, the video stream and the audio stream are transmitted to the mobile phone A, the mobile phone A establishes a session 2 with the mobile phone B after adding one path of video stream and one path of audio stream, and video call connection is completed among the mobile phone A, the mobile phone B and the smart screen.
In another possible implementation, the smart screen sends video information collected by the camera of the smart screen to a server (not shown), the server sends the video information to mobile phone a according to the relationship between mobile phone a and the same account in the smart screen login social application, mobile phone a receives the video information from the server, and sends video information collected by the camera of mobile phone a to mobile phone B through session 1, and sends video information collected by the camera of the smart screen to mobile phone B through session 2.
In yet another possible implementation, the smart screen sends video information collected by the camera of the smart screen to the mobile phone a and video information collected by the camera of the smart screen to the mobile phone B.
It can be understood that the mobile phone a in the embodiment of the present application may be replaced by a first terminal in any form, similarly, the mobile phone B may be replaced by a second terminal in any form, and the smart screen may be replaced by a third terminal in any form.
In the video call system, the first terminal can acquire video pictures in other areas by calling cameras of nearby available equipment, so that the nearby available equipment can be conveniently added into the video call, the limitation of user addition and video pictures in the video call is reduced, and user experience can be improved.
The embodiment of the application provides a video call system, in which video pictures can be added, as shown in fig. 12. Illustratively, as shown in a of fig. 12, the first user gets an interface as shown in b of fig. 12 by clicking on the "add camera" button 306. As shown in b in fig. 12, a camera selection list 1201 is popped up above the "add camera" button 306, and a main camera, a wide-angle camera, a telephoto camera, and the like may be included in the camera selection list 1201. The position and size of the camera selection list 1201 are not particularly limited in the embodiment of the present application.
For example, as shown in B in fig. 12, the front camera or one of the rear cameras, for example, the front camera, is turned on during the video call, the first user clicks the main camera in the camera selection list 1201, the mobile phone a turns on the rear main camera, and the mobile phone a turns on both front and rear cameras, so as to obtain the interface shown in fig. 13A and 13B. In the video call process, whether the front camera or the rear camera is started is preset in the mobile phone A, and the method is not particularly limited.
For example, the mobile phone a may further include a plurality of cameras, for example, on the basis of opening the front camera, a rear main camera and a rear wide-angle camera are added, so that the mobile phone a may obtain one video frame shot by the front camera, one video frame shot by the rear main camera, and one video frame shot by the rear wide-angle camera.
In one possible implementation, as shown in fig. 13A, in the video call interface of the mobile phone a, an area 18, an area 19, and an area 20 are displayed. Wherein region 18 is a full screen display region, region 19 and region 20 do not cross over the area, and are displayed as separate portlets. For example, the area 18 may display a video shot by a rear camera of the mobile phone a, the area 19 may display a video shot by a front camera of the mobile phone B, and the area 20 may display a video shot by a front camera of the mobile phone a. The embodiment of the application does not specifically limit the video picture shot by the front camera of the mobile phone A, the video picture shot by the rear camera of the mobile phone A and the video picture shot by the mobile phone B.
It should be noted that, in the embodiment of the present application, the camera turned on by the mobile phone B is not specifically limited.
For example, the first user may switch the display areas of one video image captured by the front camera of the mobile phone a, one video image captured by the rear camera of the mobile phone a, and one video image captured by the mobile phone B, for example, the first user may switch the video image of the small window of the area 20 to be displayed in the area 18 in a full screen manner by double clicking the small window of the area 20, and the video image displayed in the area 18 in a full screen manner is switched to be displayed in the small window of the area 20, and the specific triggering manner is not limited specifically. The embodiment of the application does not specifically limit which area the front-mounted camera of the mobile phone A shoots one video picture, the rear-mounted camera of the mobile phone A shoots one video picture or the mobile phone B shoots one video picture.
In the embodiment of the present application, the sizes and positions of the regions 19 and 20 are not particularly limited. The size of the region 19 may be the same as the region 20 or may be different from the region 20.
In yet another possible implementation, as shown in fig. 13B, the video frames are all displayed in the form of separate portlets, and the display areas of the video frames are area 21, area 22 and area 23, and there is no cross coverage area between area 21, area 22 and area 23. For example, the area 21 may display a video shot by a front camera of the mobile phone a, the area 22 may display a video shot by a mobile phone B, and the area 23 may display a video shot by a rear camera of the mobile phone a.
For example, the first user may switch the display areas of one video frame shot by the front camera of the mobile phone a, one video frame shot by the rear camera of the mobile phone a, and one video frame shot by the mobile phone B, for example, by dragging the video frame displayed in the area 21 to the area 23, the first user may move the video frame displayed in the area 21 to be displayed in the area 23, and the video frame displayed in the area 23 to be displayed in the area 21, and the specific triggering mode is not limited specifically. The embodiment of the application does not specifically limit which area the front-mounted camera of the mobile phone A shoots one video picture, the rear-mounted camera of the mobile phone A shoots one video picture or the mobile phone B shoots one video picture.
In the embodiment of the present application, the sizes and positions of the regions 21, 22, and 23 are not particularly limited. The dimensions of the region 21, the region 22 and the region 23 may be the same or different.
In one possible implementation, after the mobile phone a invokes the camera and microphone of the smart screen, the camera of the mobile phone a may be further added. For example, in the interface shown in a in fig. 14, the video call interface of the mobile phone a displays the area 24, the area 25 and the area 26, where the area 24, the area 25 and the area 26 are all independent small window display areas, and no cross coverage area exists between the area 24, the area 25 and the area 26. The area 24 displays one video picture shot by the front camera of the mobile phone a, the area 25 displays one video picture shot by the mobile phone B, and the area 25 displays one video picture shot by the smart screen. In the interface shown in b-d in fig. 14, the first user acquires the camera selection list 1201 by clicking the "multiple cameras" button 303 and the "add cameras" button 306 in sequence, and the first user acquires another one or more video pictures of the mobile phone a by clicking the cameras in the camera selection list 1201.
Illustratively, as shown in d in fig. 14, the first user clicks the main camera in the camera selection list 1201 to obtain a video picture of one path shot by the main camera behind the mobile phone a, so as to obtain an interface shown as e in fig. 14. One path of video picture shot by the rear main camera of the mobile phone A is displayed in an area 27, the area 27 is also an independent small window display area, and no cross coverage area exists among the area 24, the area 25, the area 26 and the area 27.
For example, as shown in fig. 15, after the mobile phone a invokes the camera and the microphone of the smart screen and adds the camera of the mobile phone a, the camera of the mobile phone B is added to obtain 5 display areas by the above method. As shown in d in fig. 15, the 5 display areas may be an area 28, an area 29, an area 30, an area 31 and an area 32, where the area 28 displays a video image captured by a front camera of the mobile phone a, the area 29 displays a video image captured by a front camera of the mobile phone B, the area 30 displays a video image captured by a smart screen, the area 31 displays a video image captured by a rear main camera of the mobile phone a, and the area 32 displays a video image captured by a rear main camera of the mobile phone B, and the specific process is not repeated herein.
The embodiment of the application provides a video call system, in the video call system, multiple paths of video pictures shot by a mobile phone A can be acquired by adding a camera of the mobile phone A, so that the limitation of the video pictures acquired in the video call is reduced, and the user experience is improved.
The embodiment of the application provides a video call system, in which video pictures can be switched, as shown in fig. 16. For example, as shown in a in fig. 16, when the mobile phone a is in a video call, the opened camera may be preset as a front camera, the first user's picture shot by the front camera of the mobile phone a is located in the area 33, the second user's video picture is located in the area 34, the area 33 is a full-screen display area, and the area 34 is an independent small window display area. Illustratively, the first user gets an interface as shown by b in fig. 16 by clicking the "switch camera" button 307. As shown in b in fig. 16, a camera selection list 1201 is popped up above the "switch camera" button 307, and a main camera, a wide-angle camera, a telephoto camera, and the like may be included in the camera selection list 1201. The position and size of the camera selection list 1201 are not particularly limited in the embodiment of the present application. The embodiment of the application does not specifically limit whether the mobile phone a is preset to be started with the front camera or the rear camera.
Illustratively, as shown in b in fig. 16, the first user switches the camera of the handset a from the front camera to the rear main camera by clicking on the main camera in the camera selection list 1201, resulting in an interface as shown in c in fig. 16. As shown in c of fig. 16, the picture shot by the rear camera of the mobile phone a may be located in the area 33, and the picture shot by the mobile phone B may be located in the area 34.
The embodiment of the application provides a video call system, in the video call system, the front camera and a plurality of rear cameras of a mobile phone A can be switched to obtain video pictures with different visual angles, so that different requirements of users can be met, and user experience is improved.
For example, in the process of making a video call between the mobile phone a and the mobile phone B, an interaction diagram between the mobile phone a and the mobile phone B is shown in fig. 17. After video communication connection is established between the mobile phone A and the mobile phone B, a first path of video stream and a first path of audio stream are added into the mobile phone A, after the video communication connection is established, a session 1 is established between the mobile phone A and the mobile phone B, and video call connection is completed between the mobile phone A and the mobile phone B. If another camera is to be added in the video call process of the mobile phone A and the mobile phone B, the mobile phone A adds a second path of video stream on the basis of adding the first path of video stream, establishes a session 2 with the mobile phone B, and completes the video call connection between the mobile phone A and the mobile phone B.
In the session process, the server sends the session ID to the mobile phone a, and the mobile phone a sends the session ID to the mobile phone B through the session, where the session ID is associated with the first path of video stream, the first path of audio stream, and the second path of video stream, so as to implement video call connection between the mobile phone a and the mobile phone B.
It can be understood that the mobile phone a in the embodiment of the present application may be replaced by a first terminal in any form, and similarly, the mobile phone B may be replaced by a second terminal in any form.
It is to be understood that the interfaces provided in the embodiments of the present application are merely examples and are not to be construed as limiting the embodiments of the present application.
On the basis of the above embodiments, the embodiments of the present application provide a video call system, which includes a first terminal, a second terminal, and a third terminal.
The first terminal is configured to establish a video call based on the first application and the second terminal, and display a first video call interface.
In the embodiment of the application, the first terminal comprises a first mobile phone, and the second terminal comprises a second mobile phone. The first video call interface displays first video information collected by a camera of the first terminal and second video information collected by a camera of the second terminal.
It can be understood that the first terminal may be the mobile phone a in fig. 3-6, the second terminal may be the mobile phone B in fig. 3-6 and fig. 8A-9B, and the first application may be a system application or a third party application. The first video interface may be an interface shown as B in fig. 3, the first video information may be a video picture shot by the mobile phone a in fig. 3-6 and fig. 8A-8B, and the second video information may be a video picture shot by the mobile phone B in fig. 3-6 and fig. 8A-9B.
And the second terminal is configured to establish a video call based on the first application and the first terminal and display a second video call interface.
In the embodiment of the application, the second video call interface displays the first video information and the second video information.
It is understood that the second video interface may refer to the first video interface.
The first terminal is further configured to receive a first operation, and, in response to the first operation, display a third video call interface.
In the embodiment of the application, the first operation is configured to select a third terminal, and the third terminal and the first terminal log in the same account in the first application; the third terminal and the first terminal are positioned in the same local area network and/or positioned in the same Bluetooth coverage area; the third video call interface displays first video information, second video information and third video information, and the third video information is video information collected by a camera of the third terminal.
It will be appreciated that the third terminal may be the smart screen of fig. 5A-9B and the first operation may be clicking on the smart screen in the selection device list 401 as shown by B in fig. 4. The third video call interface may be an interface as shown in fig. 5A and fig. 5B, and the third video information may be a video frame shot by the smart screen in fig. 5A to fig. 6 and fig. 8A to fig. 9B.
The second terminal is further configured to display a fourth video call interface.
In the embodiment of the present application, the fourth video call interface displays the first video information, the second video information, and the third video information.
And the third terminal is configured to display a prompt interface when the application running in the third terminal is a preset application and/or the service running in the third terminal is a preset service.
In the embodiment of the application, the prompt interface comprises prompt information for prompting whether to enter the video call, a first button for indicating that the video call is agreed, and a second button for indicating that the video call is not agreed; the preset application comprises an application for playing video, and the preset service comprises a video playing service.
It will be appreciated that the alert interface may be an interface as shown in fig. 7, the first button may be the "yes" button 701 in fig. 7, and the second button may be the "no" button 702 in fig. 7.
The third terminal is further configured to receive a second operation for the first button, and display a fifth video call interface in response to the second operation.
In this embodiment of the present application, the fifth video call interface displays the first video information, the second video information, and the third video information, or the fifth video call interface displays the second video information and the third video information.
It will be appreciated that the second operation may be clicking on the "yes" button 701 as shown in fig. 7. The fifth video call interface may be an interface as shown in fig. 8A to 9B, wherein when the fifth video call interface displays the first video information, the second video information, and the third video information, the fifth video call interface may be an interface as shown in fig. 8A and 8B; when the fifth video call interface displays the second video information and the third video information, the fifth video call interface may be an interface as shown in fig. 9A and 9B.
In the embodiment of the application, when the priority of the application running in the third terminal is higher or the video played in the third terminal is important, whether the user agrees to enter the video call or not can be determined through the prompt interface, negative influence on the user caused by directly entering the video interface is reduced, and user experience is improved.
For example, if the user is participating in a video conference through the third terminal and the third terminal directly enters the video call interface when receiving the video call invitation of the first terminal, the user can influence the ongoing video conference, exit the video conference or miss important information, and the like, thereby influencing the user and influencing the user experience.
And the third terminal is further configured to respond to the second operation, further open the microphone and the camera and acquire third video information comprising voice and pictures.
In the embodiment of the application, the third terminal can open the camera and simultaneously open the microphone when agreeing to enter the video call, so that not only can video pictures be acquired, but also voice information can be acquired, and user experience is improved.
And the third terminal is configured to display a sixth video call interface or continue displaying the interface of the application running in the third terminal when the application running in the third terminal is not a preset application and/or the service running in the third terminal is not a preset service.
The sixth video call interface displays the first video information, the second video information and the third video information; or the sixth video call interface displays the second video information and the third video information.
It is understood that the sixth video call interface may be an interface as shown in fig. 8A to 9B, wherein when the sixth video call interface displays the first video information, the second video information, and the third video information, the sixth video call interface may be an interface as shown in fig. 8A and 8B; when the sixth video call interface displays the second video information and the third video information, the sixth video call interface may be an interface as shown in fig. 9A and 9B. When the third terminal continues to display the interface of the application running in the third terminal, the interface may be an interface as shown in fig. 10.
In the embodiment of the application, when the priority of the application running in the third terminal is lower, or the video played in the third terminal is unimportant video such as advertisement video, the video interface can be directly accessed, whether the user agrees to access the video call or not is not required to be determined through the prompt interface, the operation is reduced, and the user experience is improved.
When the third terminal continues to display the interface of the application running in the third terminal, if the microphone of the third terminal is occupied, the third terminal does not collect audio information when collecting the third video information; and if the microphone of the third terminal is unoccupied, acquiring audio information when the third terminal acquires the third video information.
In the embodiment of the application, when the third terminal continues to display the interface of the application running in the third terminal, whether the third terminal collects the audio information when collecting the third video information is controlled by determining whether the microphone of the third terminal is occupied, so that the interference of sound in the application running in the third terminal to the video call can be reduced, and the user experience is improved.
In the system, the communication relationship among the first terminal, the second terminal and the third terminal may be:
in one possible implementation, the first terminal is specifically configured to join a path of video stream and/or audio stream after establishing video communication with the second terminal, to obtain first video information, and to establish a first session, and to send the first video information to the second terminal through the first session.
And the third terminal is configured to join one path of video stream and/or audio stream after communication connection is established with the first terminal, obtain third video information and send the third video information to the server.
And the server is configured to send third video information to the first terminal according to the relation that the first terminal and the third terminal log in the same account in the first application.
The first terminal is further configured to receive third video information from the server, establish a second session, and send the third video information to the second terminal over the second session.
In another possible implementation, the first terminal is specifically configured to join a path of video stream and/or audio stream after establishing video communication with the second terminal, to obtain first video information, and to establish a first session, and to send the first video information to the second terminal through the first session.
And the third terminal is configured to join one path of video stream and/or audio stream after communication connection is established with the first terminal, obtain third video information and send the third video information to the first terminal.
The first terminal is further configured to receive third video information from the third terminal, establish a second session, and send the third video information to the second terminal over the second session.
In yet another possible implementation, the third terminal is configured to send the third video information to the first terminal and to send the third video information to the second terminal.
In the embodiment of the application, through the data interaction among the first terminal, the second terminal, the third terminal and the server, the video call among the first terminal, the second terminal and the third terminal can be realized.
The first terminal is specifically configured to receive a sliding operation on a preset area, display a calling device button in response to the sliding operation, display a device list in response to a triggering operation on the calling device button, and receive a first operation in the device list, and display a third video call interface in response to the first operation.
The device list comprises at least one terminal identifier, wherein the terminal identifier is the identifier of the terminal discovered by the first terminal based on the local area network and/or Bluetooth technology, and the terminal corresponding to the terminal identifier comprises a tablet personal computer, a notebook computer, a smart screen and/or a smart watch.
It will be appreciated that the sliding operation on the preset area may be the lower left corner of the screen of the up-drawing handset a as shown in b in fig. 3, the call device button may be the "call device" button 308 in the video call interface as shown in e in fig. 3, and the device list may be the device list 401 as shown in b in fig. 4.
In the embodiment of the application, the nearby available equipment can be selected through the equipment list, and the camera and the microphone of the selected terminal equipment are called, so that the video picture in the area which the user wants to acquire is acquired, the nearby available equipment can be conveniently added into the video call, and the user experience is improved.
The first terminal is specifically configured to include a small horn button in the area where the third video information is displayed when the third terminal continues to display the interface of the application running in the third terminal; and receiving a third operation for the small horn button, and controlling a microphone of the third terminal to be turned on or off in response to the third operation.
It may be understood that the area where the third video information is displayed may be an area where a video screen shot by the smart screen is displayed as shown in fig. 6, the small horn button may be a "small horn" button 601 as shown in fig. 6, and the third operation may be clicking the "small horn" button 601 as shown in fig. 6.
In the embodiment of the application, the microphone of the third terminal is controlled by the first terminal, so that the sound of the external environment where the third terminal is located or the sound of the video played by the third terminal can be reduced, the interference to the video call is reduced, and the user experience is improved.
The first terminal is further configured to receive a fourth operation for adding a camera button, display a camera selection list in response to the fourth operation, receive a fifth operation in the camera selection list, the fifth operation configured to select other cameras of the first terminal, and display a sixth video call interface in response to the fifth operation.
The sixth video call interface displays first video information, second video information, third video information and fourth video information, wherein the fourth video information is video information collected by other cameras of the first terminal; the camera selection list comprises at least one camera type, and the camera type comprises a main camera, a wide-angle camera and a tele camera.
It will be appreciated that the add camera button may be the "add camera" button 306 shown as c in fig. 14, the fourth operation may be clicking the "add camera" button 306 shown as c in fig. 14, the camera selection list may be the camera selection list 1201 shown as d in fig. 14, and the fifth operation may be clicking the master camera in the camera selection list 1201 shown as d in fig. 14.
The second terminal is further configured to display a seventh video call interface, and the seventh video call interface displays the first video information, the second video information, the third video information and the fourth video information.
It may be understood that the first video information may also be one video picture shot by the front camera of the mobile phone a as shown in fig. 14, and the fourth video information may be one video picture shot by the rear camera of the mobile phone a as shown in d in fig. 14.
In the embodiment of the application, the multiple paths of video pictures shot by the first terminal can be acquired by adding the first terminal camera, so that the limitation of the video pictures acquired in the video call is reduced, and the user experience is improved.
The second terminal is specifically configured to receive a sixth operation for adding the camera button, display a camera selection list in response to the sixth operation, receive the sixth operation in the camera selection list, the sixth operation configured to select other cameras of the second terminal, and display an eighth video call interface in response to the sixth operation.
It will be appreciated that the add camera button may be the "add camera" button 306 shown as b in fig. 15, the fourth operation may be clicking the "add camera" button 306 shown as b in fig. 15, the camera selection list may be the camera selection list 1201 shown as c in fig. 15, and the fifth operation may be clicking the master camera in the camera selection list 1201 shown as c in fig. 15.
The eighth video call interface displays first video information, second video information, third video information, fourth video information and fifth video information, and the fifth video information is video information collected by other cameras of the second terminal.
The first terminal is further configured to display a ninth video call interface, and the ninth video call interface displays the first video information, the second video information, the third video information, the fourth video information and the fifth video information.
It may be understood that the ninth video call interface may be an interface shown as d in fig. 15, and the fifth video information may be a video frame shot by a rear camera of the mobile phone B shown as d in fig. 15.
In the embodiment of the application, the multiple paths of video pictures shot by the second terminal can be acquired by adding the second terminal camera, so that the limitation of the video pictures acquired in the video call is reduced, and the user experience is improved.
In a possible implementation, the ninth video call interface displays a first area, a second area, a third area, a fourth area and a fifth area, where the first area displays first video information, the second area displays second video information, the third area displays third video information, the fourth area displays fourth video information, and the fifth area displays fifth video information; the first area, the second area, the third area and the fourth area do not have cross coverage areas, the fifth area is a full-screen display area, and the first area, the second area, the third area and the fourth area can move in an upper layer in the fifth area based on user triggering.
It will be appreciated that as shown by d in fig. 15, the first region may be region 28, the second region may be region 29, the third region may be region 30, the fourth region may be region 31, and the fifth region may be region 32.
In another possible implementation, the ninth video call interface displays a sixth area, a seventh area, an eighth area, a ninth area, and a tenth area, where the sixth area displays the first video information, the seventh area displays the second video information, the eighth area displays the third video information, the ninth area displays the fourth video information, and the tenth area displays the fifth video information; the sixth, seventh, eighth, ninth and tenth areas have no cross-coverage areas.
It is understood that the display cases of the sixth area, the seventh area, the eighth area, the ninth area and the tenth area are similar to the display cases of the first area, the second area, the third area, the fourth area and the fifth area, and will not be described herein.
In the embodiment of the application, the video pictures shot by each terminal are displayed through a plurality of independent areas without cross coverage, so that a user can see a clearer and comprehensive video picture, the user can adjust the position of the area, the operation is convenient, and the user experience is improved.
The embodiment of the application provides a video call system, which comprises a first terminal, a second terminal and a third terminal; the first terminal is configured to establish a video call based on the first application and the second terminal, and display a first video call interface, wherein the first video call interface displays first video information collected by a camera of the first terminal and second video information collected by a camera of the second terminal; the second terminal is configured to establish a video call based on the first application and the first terminal, and display a second video call interface, wherein the second video call interface displays first video information and second video information; the first terminal is further configured to receive a first operation, the first operation is configured to select a third terminal, and the third terminal and the first terminal are logged in the same account in the first application; the third terminal and the first terminal are positioned in the same local area network and/or positioned in the same Bluetooth coverage area; and responding to the first operation, displaying a third video call interface, wherein the third video call interface displays first video information, second video information and third video information, and the third video information is video information collected by a camera of a third terminal; the second terminal is further configured to display a fourth video call interface, and the fourth video call interface displays the first video information, the second video information and the third video information. In the video call system, the first terminal can acquire video pictures in other areas by calling the cameras and the microphones of nearby available equipment, so that the nearby available equipment can be conveniently added into the video call, the limitation of user addition and video pictures in the video call is reduced, and the user experience is improved.
On the basis of the above embodiments, the embodiments of the present application provide a video call method, which is applied to a video call system, where the video call system includes a first terminal, a second terminal, and a third terminal. Fig. 18 is a schematic flow chart of a video call method according to an embodiment of the present application.
As shown in fig. 18, the video call method may include the steps of:
s1801, the first terminal establishes a video call based on the first application and the second terminal, and displays a first video call interface, and the second terminal displays a second video call interface.
In the embodiment of the application, the first video call interface displays first video information collected by the camera of the first terminal and second video information collected by the camera of the second terminal, and the second video call interface displays the first video information and the second video information.
S1802, the first terminal receives a first operation.
In this embodiment of the present application, the first operation is to select a third terminal, where the third terminal and the first terminal log in to the same account in the first application, and the third terminal and the first terminal are located in the same local area network and/or are located in the same bluetooth coverage area.
S1803, the first terminal responds to the first operation and displays a third video call interface, and the second terminal displays a fourth video call interface.
In this embodiment of the present application, the third video call interface displays first video information, second video information, and third video information, where the third video information is video information collected by a camera of the third terminal, and the fourth video call interface displays first video information, second video information, and third video information.
Optionally, S1802 and S1803 may include: the first terminal receives a sliding operation on the preset area, displays a calling device button in response to the sliding operation, displays a device list in response to a triggering operation on the calling device button, receives a first operation in the device list, and displays a third video call interface in response to the first operation.
The device list comprises at least one terminal identifier, wherein the terminal identifier is the identifier of the terminal discovered by the first terminal based on the local area network and/or Bluetooth technology, and the terminal corresponding to the terminal identifier comprises a tablet personal computer, a notebook computer, a smart screen and/or a smart watch.
In the embodiment of the application, the nearby available equipment can be selected through the equipment list, and the camera and the microphone of the selected terminal equipment are called, so that the video picture in the area which the user wants to acquire is acquired, the nearby available equipment can be conveniently added into the video call, and the user experience is improved.
Optionally, the method may further include: and when the application running in the third terminal is a preset application and/or the service running in the third terminal is a preset service, the third terminal displays a prompt interface.
In the embodiment of the application, the prompt interface comprises prompt information for prompting whether to enter the video call, a first button for indicating that the video call is agreed, and a second button for indicating that the video call is not agreed. The preset application comprises an application for playing video, and the preset service comprises a video playing service.
The third terminal receives a second operation for the first button after displaying the prompt interface, and displays a fifth video call interface in response to the second operation.
The fifth video call interface displays the first video information, the second video information and the third video information; or the fifth video call interface displays the second video information and the third video information.
In the embodiment of the application, when the priority of the application running in the third terminal is higher or the video played in the third terminal is important, whether the user agrees to enter the video call or not can be determined through the prompt interface, negative influence on the user caused by directly entering the video interface is reduced, and user experience is improved.
Optionally, the method further comprises: and the third terminal responds to the second operation, and also opens the microphone and the camera to acquire third video information comprising voice and pictures.
In the embodiment of the application, the third terminal can open the camera and simultaneously open the microphone when agreeing to enter the video call, so that not only can video pictures be acquired, but also voice information can be acquired, and user experience is improved.
Optionally, the method may further include: and when the application running in the third terminal is not the preset application and/or the service running in the third terminal is not the preset service, the third terminal displays a sixth video call interface or continuously displays the interface of the application running in the third terminal.
The sixth video call interface displays the first video information, the second video information and the third video information; or the sixth video call interface displays the second video information and the third video information.
For example, when the third terminal continues to display the interface of the application running in the third terminal, if the microphone of the third terminal is occupied, the third terminal does not collect audio information when collecting the third video information, and if the microphone of the third terminal is unoccupied, the third terminal collects audio information when collecting the third video information.
In the embodiment of the application, when the priority of the application running in the third terminal is lower, or the video played in the third terminal is unimportant video such as advertisement video, the video interface can be directly accessed, whether the user agrees to access the video call or not is not required to be determined through the prompt interface, the operation is reduced, and the user experience is improved.
Optionally, the method may further include a communication relationship between the first terminal, the second terminal, and the third terminal, and the specific implementation may be:
in one possible implementation, after the first terminal establishes video communication with the second terminal, adding a path of video stream and/or audio stream to obtain first video information, and establishing a first session, and sending the first video information to the second terminal through the first session; after the third terminal establishes communication connection with the first terminal, adding one path of video stream and/or audio stream to obtain third video information, and sending the third video information to the server; the server sends third video information to the first terminal according to the relation that the first terminal and the third terminal log in the same account in the first application; the first terminal receives the third video information from the server, establishes a second session, and transmits the third video information to the second terminal through the second session.
In another possible implementation, after the first terminal establishes video communication with the second terminal, adding a path of video stream and/or audio stream to obtain first video information, and establishing a first session, and sending the first video information to the second terminal through the first session; after the third terminal establishes communication connection with the first terminal, adding one path of video stream and/or audio stream to obtain third video information, and sending the third video information to the first terminal; the first terminal receives the third video information from the third terminal, establishes a second session, and transmits the third video information to the second terminal through the second session.
In yet another possible implementation, the third terminal sends third video information to the first terminal and sends third video information to the second terminal.
In the embodiment of the application, through the data interaction among the first terminal, the second terminal, the third terminal and the server, the video call among the first terminal, the second terminal and the third terminal can be realized.
Optionally, the method may further include: when the third terminal continues to display the interface of the application running in the third terminal, the area, in which the third video information is displayed, in the first terminal comprises a small horn button; and receiving a third operation for the small horn button, and controlling a microphone of the third terminal to be turned on or off in response to the third operation.
In the embodiment of the application, the microphone of the third terminal is controlled by the first terminal, so that the sound of the external environment where the third terminal is located or the sound of the video played by the third terminal can be reduced, the interference to the video call is reduced, and the user experience is improved.
Optionally, the method may further include: the first terminal receiving a fourth operation for adding a camera button, displaying a camera selection list in response to the fourth operation, receiving a fifth operation in the camera selection list, the fifth operation configured to select other cameras of the first terminal, and displaying a sixth video call interface in response to the fifth operation; the second terminal displays a seventh video call interface.
In the embodiment of the application, the sixth video call interface displays first video information, second video information, third video information and fourth video information, where the fourth video information is video information collected by other cameras of the first terminal; the seventh video call interface displays the first video information, the second video information, the third video information and the fourth video information. The camera selection list comprises at least one camera type, and the camera type comprises a main camera, a wide-angle camera and a tele camera.
In the embodiment of the application, the multiple paths of video pictures shot by the first terminal can be acquired by adding the first terminal camera, so that the limitation of the video pictures acquired in the video call is reduced, and the user experience is improved.
Optionally, the method may further include: the second terminal receiving a sixth operation for adding the camera button, in response to the sixth operation, displaying a camera selection list, receiving the sixth operation in the camera selection list, the sixth operation configured to select other cameras of the second terminal, and in response to the sixth operation, displaying an eighth video call interface; the first terminal displays a ninth video call interface.
The eighth video call interface displays first video information, second video information, third video information, fourth video information and fifth video information, wherein the fifth video information is video information collected by other cameras of the second terminal; the ninth video call interface displays the first video information, the second video information, the third video information, the fourth video information, and the fifth video information.
In the embodiment of the application, the multiple paths of video pictures shot by the second terminal can be acquired by adding the second terminal camera, so that the limitation of the video pictures acquired in the video call is reduced, and the user experience is improved.
In a possible implementation, the ninth video call interface displays a first area, a second area, a third area, a fourth area and a fifth area, where the first area displays first video information, the second area displays second video information, the third area displays third video information, the fourth area displays fourth video information, and the fifth area displays fifth video information; the first area, the second area, the third area and the fourth area do not have cross coverage areas, the fifth area is a full-screen display area, and the first area, the second area, the third area and the fourth area can move in an upper layer in the fifth area based on user triggering.
In another possible implementation, the ninth video call interface displays a sixth area, a seventh area, an eighth area, a ninth area, and a tenth area, where the sixth area displays the first video information, the seventh area displays the second video information, the eighth area displays the third video information, the ninth area displays the fourth video information, and the tenth area displays the fifth video information; the sixth, seventh, eighth, ninth and tenth areas have no cross-coverage areas.
In the embodiment of the application, the video pictures shot by each terminal are displayed through a plurality of independent areas without cross coverage, so that a user can see a clearer and comprehensive video picture, the user can adjust the position of the area, the operation is convenient, and the user experience is improved.
The first terminal may include a first mobile phone, and the second terminal may include a second mobile phone, for example.
The embodiment of the application provides a video call method, which comprises the following steps: the method comprises the steps that a first terminal establishes video call based on a first application and a second terminal, a first video call interface is displayed, and the second terminal displays a second video call interface; the first video call interface displays first video information collected by a camera of the first terminal and second video information collected by a camera of the second terminal, and the second video call interface displays the first video information and the second video information; the first terminal receives a first operation; the first operation is to select a third terminal, wherein the third terminal and the first terminal are logged in the same account number in the first application, and the third terminal and the first terminal are located in the same local area network and/or the same Bluetooth coverage area; the first terminal responds to the first operation and displays a third video call interface, and the second terminal displays a fourth video call interface; the third video call interface displays first video information, second video information and third video information, the third video information is video information collected by a camera of the third terminal, and the fourth video call interface displays the first video information, the second video information and the third video information. In the video call method, the first terminal can acquire video pictures in other areas by calling the cameras and the microphones of nearby available equipment, so that the nearby available equipment can be conveniently added into the video call, the limitation of user addition and video pictures in the video call is reduced, and the user experience is improved.
Fig. 19 is a schematic hardware structure of a video call system according to an embodiment of the present application. Referring to fig. 19, the system includes: a memory 1901, a processor 1902, and a display 1904. The system may also include an interface circuit 1903 in which the memory 1901, the processor 1902, the interface circuit 1003, and the display 1904 may communicate; by way of example, the memory 1901, the processor 1902, the interface circuit 1903, and the display screen 1904 may communicate via a communication bus, and the memory 1901 is configured to store computer-executable instructions, which are controlled by the processor 1902 to be executed, and to be displayed by the display screen 1904, thereby implementing the video call method provided in the embodiments described below.
In a possible implementation manner, the computer-executed instructions in the embodiments of the present application may also be referred to as application program code, which is not specifically limited in this embodiment of the present application.
Optionally, the interface circuit 1903 may also include a transmitter and/or a receiver. Alternatively, the processor 1902 may include one or more CPUs, but may be other general purpose processors, digital signal processors (digital signal processor, DSP), application specific integrated circuits (application specific integrated circuit, ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor or in a combination of hardware and software modules within a processor.
Embodiments of the present application also provide a computer-readable storage medium. The methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. Computer readable media can include computer storage media and communication media and can include any medium that can transfer a computer program from one place to another. The storage media may be any target media that is accessible by a computer.
As one possible design, the computer-readable medium may include compact disk read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disk memory; the computer readable medium may include disk storage or other disk storage devices. Moreover, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, digital versatile disc (digital versatile disc, DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers.
Embodiments of the present application also provide a computer program product comprising one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL), or wireless (e.g., infrared, wireless, microwave, etc.), or semiconductor medium (e.g., solid state disk, SSD)) or the like.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing detailed description of the invention has been presented for purposes of illustration and description, and it should be understood that the foregoing is by way of illustration and description only, and is not intended to limit the scope of the invention.

Claims (16)

1. A video call system, comprising a first terminal of a first user, a second terminal of a second user, and a third terminal;
the first terminal is configured to establish a video call based on a first application and the second terminal, and display a first video call interface, wherein the first video call interface displays first video information acquired by a camera of the first terminal and second video information acquired by a camera of the second terminal;
the second terminal is configured to establish the video call based on the first application and the first terminal, and display a second video call interface, wherein the second video call interface displays the first video information and the second video information;
the first terminal is further configured to receive a first operation, and the first operation is configured to select a third terminal, and the third terminal and the first terminal log in the same account in the first application; the third terminal and the first terminal are positioned in the same local area network and/or positioned in the same Bluetooth coverage area; the first operation is responded, a third video call interface is displayed, the first video information, the second video information and third video information are displayed on the third video call interface, the third video information is video information collected by a camera of the third terminal, and the third video information is used for representing that a third user joins the video call;
The second terminal is further configured to display a fourth video call interface, where the fourth video call interface displays the first video information, the second video information, and the third video information.
2. The system of claim 1, wherein the system further comprises a controller configured to control the controller,
the third terminal is configured to display a prompt interface when the application running in the third terminal is a preset application and/or the service running in the third terminal is a preset service, wherein the prompt interface comprises prompt information for prompting whether to enter a video call, a first button for indicating that the video call is agreed, and a second button for indicating that the video call is not agreed; the preset application comprises an application for playing video, and the preset service comprises a video playing service;
the third terminal is further configured to receive a second operation for the first button, and respond to the second operation to display a fifth video call interface; the fifth video call interface displays the first video information, the second video information and the third video information; or the fifth video call interface displays the second video information and the third video information.
3. The system of claim 2, wherein the system further comprises a controller configured to control the controller,
the third terminal is further configured to respond to the second operation, further open a microphone and a camera, and collect the third video information including voice and pictures.
4. The system of claim 1, wherein the system further comprises a controller configured to control the controller,
the third terminal is configured to display a sixth video call interface or continue displaying an interface of the application running in the third terminal when the application running in the third terminal is not a preset application and/or the service running in the third terminal is not a preset service;
the sixth video call interface displays the first video information, the second video information and the third video information; or the sixth video call interface displays the second video information and the third video information;
when the third terminal continues to display the interface of the application running in the third terminal, if the microphone of the third terminal is occupied, the third terminal does not collect audio information when collecting the third video information, and if the microphone of the third terminal is unoccupied, the third terminal collects audio information when collecting the third video information.
5. The system of any one of claims 1-4, wherein,
the first terminal is specifically configured to establish video communication with the second terminal, then join a path of video stream and/or audio stream to obtain the first video information, and establish a first session, and send the first video information to the second terminal through the first session;
the third terminal is configured to join one path of video stream and/or audio stream after establishing communication connection with the first terminal to obtain the third video information, and send the third video information to a server;
the server is configured to send the third video information to the first terminal according to the relationship of the first terminal and the third terminal logging in the same account in the first application;
the first terminal is further configured to receive the third video information from the server, establish a second session, and send the third video information to the second terminal via the second session.
6. The system of any one of claims 1-4, wherein,
the first terminal is specifically configured to establish video communication with the second terminal, then join a path of video stream and/or audio stream to obtain the first video information, and establish a first session, and send the first video information to the second terminal through the first session;
The third terminal is configured to join one path of video stream and/or audio stream after establishing communication connection with the first terminal to obtain the third video information, and send the third video information to the first terminal;
the first terminal is further configured to receive the third video information from the third terminal, establish a second session, and send the third video information to the second terminal via the second session.
7. The system of any one of claims 1-4, wherein,
the third terminal is configured to transmit the third video information to the first terminal and transmit the third video information to the second terminal.
8. The system of any one of claims 1-4, wherein,
the first terminal is specifically configured to receive a sliding operation on a preset area, display a calling device button in response to the sliding operation, display a device list in response to a triggering operation on the calling device button, receive the first operation in the device list, and display the third video call interface in response to the first operation; the device list comprises at least one terminal identifier, wherein the terminal identifier is an identifier of a terminal found by the first terminal based on a local area network and/or Bluetooth technology, and the terminal corresponding to the terminal identifier comprises a tablet personal computer, a notebook personal computer, a smart screen and/or a smart watch.
9. The system of any one of claims 1-4, wherein,
the first terminal is specifically configured to include a small horn button in a region where the third video information is displayed when the third terminal continues to display an interface of an application running in the third terminal; and receiving a third operation for the small horn button, and controlling a microphone of the third terminal to be turned on or off in response to the third operation.
10. The system of claim 1, wherein the system comprises a plurality of sensors,
the first terminal is further configured to receive a fourth operation for adding a camera button, display a camera selection list in response to the fourth operation, receive a fifth operation in the camera selection list, the fifth operation configured to select other cameras of the first terminal, and display a sixth video call interface in response to the fifth operation, the sixth video call interface displaying the first video information, the second video information, the third video information, and fourth video information, the fourth video information being video information collected by other cameras of the first terminal; the camera selection list comprises at least one camera type, wherein the camera type comprises a main camera, a wide-angle camera and a long-focus camera;
The second terminal is further configured to display a seventh video call interface, where the seventh video call interface displays the first video information, the second video information, the third video information, and the fourth video information.
11. The system of claim 10, wherein the system further comprises a controller configured to control the controller,
the second terminal is specifically configured to receive a sixth operation for adding a camera button, display the camera selection list in response to the sixth operation, receive the sixth operation in the camera selection list, the sixth operation being configured to select other cameras of the second terminal, and display an eighth video call interface in response to the sixth operation; the eighth video call interface displays the first video information, the second video information, the third video information, the fourth video information and fifth video information, wherein the fifth video information is video information collected by other cameras of the second terminal;
the first terminal is further configured to display a ninth video call interface, where the ninth video call interface displays the first video information, the second video information, the third video information, the fourth video information, and the fifth video information.
12. The system of claim 11, wherein the system further comprises a controller configured to control the controller,
the ninth video call interface is displayed with a first area, a second area, a third area, a fourth area and a fifth area, wherein the first area is displayed with the first video information, the second area is displayed with the second video information, the third area is displayed with the third video information, the fourth area is displayed with the fourth video information, and the fifth area is displayed with the fifth video information; the first area, the second area, the third area and the fourth area have no cross coverage area, the fifth area is a full-screen display area, and the first area, the second area, the third area and the fourth area can move at the upper layer of the fifth area based on user trigger;
or, the ninth video call interface displays a sixth area, a seventh area, an eighth area, a ninth area and a tenth area, wherein the sixth area displays the first video information, the seventh area displays the second video information, the eighth area displays the third video information, the ninth area displays the fourth video information, and the tenth area displays the fifth video information; the sixth, seventh, eighth, ninth, and tenth regions do not have cross-over coverage areas.
13. The system of any one of claims 1-4, 10-12, wherein,
the first terminal comprises a first mobile phone, and the second terminal comprises a second mobile phone.
14. A video call method, applied to a video call system, the video call system including a first terminal of a first user, a second terminal of a second user, and a third terminal, the method comprising:
the first terminal establishes a video call based on a first application and the second terminal, and displays a first video call interface, wherein the first video call interface displays first video information collected by a camera of the first terminal and second video information collected by a camera of the second terminal; the second terminal displays a second video call interface, wherein the second video call interface displays the first video information and the second video information;
the first terminal receives a first operation, wherein the first operation is to select a third terminal, and the third terminal and the first terminal are logged in with the same account in the first application; the third terminal and the first terminal are positioned in the same local area network and/or positioned in the same Bluetooth coverage area;
The first terminal responds to the first operation, a third video call interface is displayed, the third video call interface displays the first video information, the second video information and third video information, the third video information is video information collected by a camera of the third terminal, and the third video information is used for representing a third user to join the video call; the second terminal displays a fourth video call interface, and the fourth video call interface displays the first video information, the second video information and the third video information.
15. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, causes the electronic device to perform the method performed by the first terminal, or the method performed by the second terminal, or the method performed by the third terminal as claimed in claim 14.
16. A computer readable storage medium storing a computer program, wherein the computer program, when executed by a processor, causes the computer to perform the method performed by the first terminal, or the method performed by the second terminal, or the method performed by the third terminal as claimed in claim 14.
CN202210655605.9A 2022-06-10 2022-06-10 Video call system, method and device Active CN115242994B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210655605.9A CN115242994B (en) 2022-06-10 2022-06-10 Video call system, method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210655605.9A CN115242994B (en) 2022-06-10 2022-06-10 Video call system, method and device

Publications (2)

Publication Number Publication Date
CN115242994A CN115242994A (en) 2022-10-25
CN115242994B true CN115242994B (en) 2023-07-18

Family

ID=83669364

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210655605.9A Active CN115242994B (en) 2022-06-10 2022-06-10 Video call system, method and device

Country Status (1)

Country Link
CN (1) CN115242994B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117156091A (en) * 2023-03-27 2023-12-01 荣耀终端有限公司 Video call method and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102572365A (en) * 2010-12-22 2012-07-11 深圳市同洲软件有限公司 Video call switching method, mobile terminal and system
CN109660750A (en) * 2019-01-18 2019-04-19 维沃移动通信有限公司 A kind of video call method and terminal
CN113824918A (en) * 2021-10-08 2021-12-21 中移(杭州)信息技术有限公司 Video call method, device, system and storage medium
CN114071423A (en) * 2019-09-18 2022-02-18 华为技术有限公司 Video call method and electronic equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104270595B (en) * 2014-09-29 2018-11-30 江苏金中微智慧科技有限公司 A kind of video calling client video speech switching system and its switching method
CN112261339B (en) * 2020-10-15 2023-04-11 Oppo广东移动通信有限公司 Video communication method, video communication device, electronic equipment and computer-readable storage medium
CN114040144A (en) * 2021-12-01 2022-02-11 展讯通信(天津)有限公司 Video call method and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102572365A (en) * 2010-12-22 2012-07-11 深圳市同洲软件有限公司 Video call switching method, mobile terminal and system
CN109660750A (en) * 2019-01-18 2019-04-19 维沃移动通信有限公司 A kind of video call method and terminal
CN114071423A (en) * 2019-09-18 2022-02-18 华为技术有限公司 Video call method and electronic equipment
CN113824918A (en) * 2021-10-08 2021-12-21 中移(杭州)信息技术有限公司 Video call method, device, system and storage medium

Also Published As

Publication number Publication date
CN115242994A (en) 2022-10-25

Similar Documents

Publication Publication Date Title
US11385857B2 (en) Method for displaying UI component and electronic device
US20230046708A1 (en) Application Interface Interaction Method, Electronic Device, and Computer-Readable Storage Medium
EP4113415A1 (en) Service recommending method, electronic device, and system
WO2019072178A1 (en) Method for processing notification, and electronic device
US20230216990A1 (en) Device Interaction Method and Electronic Device
CN114040242B (en) Screen projection method, electronic equipment and storage medium
CN113272745A (en) Smart home equipment sharing system and method and electronic equipment
US20230189366A1 (en) Bluetooth Communication Method, Terminal Device, and Computer-Readable Storage Medium
WO2020253754A1 (en) Multi-terminal multimedia data communication method and system
CN116360725B (en) Display interaction system, display method and device
CN114115770B (en) Display control method and related device
WO2020024108A1 (en) Application icon display method and terminal
US20210377642A1 (en) Method and Apparatus for Implementing Automatic Translation by Using a Plurality of TWS Headsets Connected in Forwarding Mode
CN117014859A (en) Address book-based device discovery method, audio and video communication method and electronic device
WO2024045801A1 (en) Method for screenshotting, and electronic device, medium and program product
WO2023088209A1 (en) Cross-device audio data transmission method and electronic devices
WO2022127670A1 (en) Call method and system, and related device
EP4209890A1 (en) File transmission method and related device
CN115242994B (en) Video call system, method and device
CN114201738B (en) Unlocking method and electronic equipment
US20230350629A1 (en) Double-Channel Screen Mirroring Method and Electronic Device
CN116095219B (en) Notification display method and terminal device
EP4339770A1 (en) Screen sharing method and related device
CN116708674B (en) Communication method and electronic equipment
CN112882823B (en) Screen display method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant