WO2022135291A1 - 视频通话处理方法、装置和电子设备 - Google Patents

视频通话处理方法、装置和电子设备 Download PDF

Info

Publication number
WO2022135291A1
WO2022135291A1 PCT/CN2021/139091 CN2021139091W WO2022135291A1 WO 2022135291 A1 WO2022135291 A1 WO 2022135291A1 CN 2021139091 W CN2021139091 W CN 2021139091W WO 2022135291 A1 WO2022135291 A1 WO 2022135291A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
video call
information
real
video
Prior art date
Application number
PCT/CN2021/139091
Other languages
English (en)
French (fr)
Inventor
孙启明
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2022135291A1 publication Critical patent/WO2022135291A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS

Definitions

  • the present application belongs to the field of communication technologies, and in particular relates to a video call processing method, apparatus and electronic device.
  • electronic devices can use more and more call methods to establish calls with other electronic devices through the network, for example, send instant voice messages or text messages through the network, or make voice calls through the network , or, make a video call over the web.
  • the smooth call process can be guaranteed, otherwise the call cannot be maintained. quality.
  • the video call as an example, in the process of electronic device 1 using the network to make a video call with electronic device 2, if the data transmission speed of the network is low, the video screen may freeze, and electronic device 2 cannot receive it in time. The video information of the user of the electronic device 1 and the voice information in the video information even cause the video call to be interrupted.
  • the purpose of the embodiments of the present application is to provide a video call processing method, device and electronic device, which can solve the problem that the existing video communication technology will affect the user's call process when the network quality is not good, therefore, it will reduce the user's use of electronic The efficiency of the device for video communication.
  • an embodiment of the present application provides a video call processing method, which is applied to a first electronic device.
  • the method includes: the first electronic device performs a video call between the first electronic device and the second electronic device. , if the network connection parameters of the first electronic device satisfy the first condition, stop sending the video content of the first electronic device, and send the first information to the second electronic device; wherein, the first information is related to the video The real-time voice content matching information collected by the first electronic device during the call.
  • an embodiment of the present application provides a video call processing apparatus, the apparatus includes: a sending module; the sending module is configured to perform a video call between the first electronic device and the second electronic device, if the above The network connection parameters of the first electronic device satisfy the first condition, stop sending the video screen content of the first electronic device, and send the first information to the second electronic device; wherein, the first information is with the video call in the video call.
  • the real-time voice content matching information collected by the first electronic device.
  • embodiments of the present application provide an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction being The processor implements the steps of the method according to the first aspect when executed.
  • an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the steps of the method according to the first aspect are implemented .
  • an embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction, and implement the first aspect the method described.
  • the first electronic device in the case of a video call between the first electronic device and the second electronic device, if the network connection parameter of the first electronic device satisfies the first condition, the first electronic device stops sending the above-mentioned first electronic device.
  • the video image content of an electronic device is sent to the second electronic device, and information matching the real-time voice content collected by the first electronic device in the video call (ie, the first information) is sent to the second electronic device.
  • the video call can be maintained first, and the first information matching the real-time voice content in the video call can be simultaneously sent by stopping sending the video content.
  • the connection problem can help improve the efficiency of video calls, improve the information transmission efficiency, use fluency and user experience of users using video calls.
  • FIG. 1 is a schematic diagram of a communication system of a first electronic device and a second electronic device provided by an embodiment of the present application;
  • FIG. 2 is a schematic structural diagram of a first electronic device provided by an embodiment of the present application.
  • FIG. 3 is a schematic flowchart of a video call processing method provided by an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of a video call processing apparatus provided by an embodiment of the present application.
  • FIG. 5 is one of the schematic structural diagrams of an electronic device provided by an embodiment of the present application.
  • FIG. 6 is a second schematic structural diagram of an electronic device according to an embodiment of the present application.
  • first, second and the like in the description and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the present application can be practiced in sequences other than those illustrated or described herein, and distinguish between “first”, “second”, etc.
  • the objects are usually of one type, and the number of objects is not limited.
  • the first object may be one or more than one.
  • “and/or” in the description and claims indicates at least one of the connected objects, and the character “/" generally indicates that the associated objects are in an "or” relationship.
  • the electronic devices when the electronic devices are in the process of making a video call, they need to be connected to the server respectively, and then the video content to be sent is respectively sent through the base station, and then sent by the base station to other electronic devices. , and receive the video content sent by other electronic devices from the base station, so as to view the video content sent by other electronic devices.
  • the electronic equipment includes electronic equipment 1 and electronic equipment
  • electronic equipment 1 is within the signal coverage of base station A and is connected to base station A
  • electronic equipment 2 is within the signal coverage of base station B.
  • the connecting electronic device 2 needs to be connected to the base station B, and the base station A and the base station B can transmit communication data to each other.
  • the process of connecting the electronic device 1 to the base station A includes an uplink transmission link 11 (hereinafter referred to as "link 11") and a downlink transmission link 12 (hereinafter referred to as "link 12").
  • the process of connecting the base station B includes an uplink transmission link 13 (hereinafter referred to as "link 13") and a downlink transmission link 14 (hereinafter referred to as "link 14").
  • any link is not smooth, for example, when the network transmission speed drops and link 11 cannot upload enough video data per unit time, it will cause the electronic device 1 base station A to receive If the complete video data is not available, the base station B and the electronic device 2 cannot receive the complete video data either. That is, only when the data transmission process of the above-mentioned link 11, link 12, link 13 and link 14 is smooth and no abnormality can the video call between the electronic device 1 and the electronic device 2 be guaranteed to be continuous.
  • the above-mentioned base station A and base station B may be different base stations.
  • the above-mentioned base station A and base station B can also be the same base station.
  • the electronic device 1 and the electronic device 2 are close to each other, and when they are covered by the same base station, video data can be transmitted through the same base station.
  • the default network connection between base stations is normal, that is, data information between base stations can be For normal transmission, there will be no abnormality. For example, the data information cannot be transmitted due to the slow network speed.
  • Electronic equipment including a first screen and a second screen
  • the embodiments of the present application are applied to an electronic device including a first screen and a second screen.
  • the above-mentioned two screens may be two screens formed by a foldable electronic device.
  • the above-mentioned foldable electronic device may be a foldable electronic device composed of two electronic devices by means of hinges, or may be a foldable electronic device including a foldable display screen.
  • Foldable electronic device may also be two screens included in an electronic device with dual screens, specifically, the above dual screens may be two screens located on the same side of the electronic device, or may be located on the front of the electronic device respectively
  • the two screens on the reverse side can also be two screens, one located on the front of the electronic device, and the other embedded in the electronic device and can be telescopically displayed relative to the electronic device.
  • the electronic device may include a first screen 21 and a retractable screen 22 disposed at the back of the first screen, and the retractable screen 22 may have the function of extending and retracting from the electronic device.
  • a telescopic motor and a telescopic slide rail can be set in the above electronic device.
  • the telescopic screen 22 can be controlled to follow the trajectory of the telescopic slide rail to complete the extension. action and retraction.
  • the electronic device can send an extension command to the retractable screen to control the retractable screen 22 to rise, can also send a retraction command to the retractable screen 22 to control the retractable screen to retract back to the electronic device, and can also send an opening command to the retractable screen 22 to control
  • the above-mentioned telescopic screen 22 enables the display function, and a display command can also be sent to the above-mentioned telescopic screen 22 to control the above-mentioned telescopic screen 22 to display specific display content.
  • RTS and CTS are two signals in MODEM hardware flow control, RTS and CTS are independent signals.
  • RTS is the input terminal of the module, which is used by the Microcontroller Unit (MCU) to notify the module whether the MCU is ready and whether the module can send information to the MCU.
  • MCU Microcontroller Unit
  • the effective level of RTS is low
  • CTS is the output terminal of the module. , for the module to notify the MCU whether the module is ready, whether the MCU can send information to the module, and the effective level of CTS is low.
  • the video call processing method provided by the embodiment of the present application may be applied to a scenario in which a video call is performed between the first electronic device and other electronic devices.
  • the network connection parameters of the electronic device 1 that is, the network transmission speed is lower than the minimum transmission speed required for transmitting the video content, because it cannot continuously upload the video content to the server, nor can it continuously receive the electronic device transmitted from the server to it.
  • the video content of the device 2 therefore, in the display screen of the electronic device 1, the video content is stuck, and the video connection with the electronic device 2 is forced to be interrupted. In this way, when the network connection parameters do not satisfy the transmission of the complete video content, the video call using the electronic device is discontinuous, the efficiency is low, and the user experience is poor.
  • the electronic device 1 stops sending the video content of the electronic device 1, and sends to the electronic device 2 information (ie, first information) matching the real-time voice content collected by the electronic device 1 during the video call.
  • the network connection parameters of the electronic device 1 are not sufficient to support the transmission of video content, the video call can be maintained first, and information that matches the real-time voice content in the video call can be sent by stopping the transmission of the video content (i.e.
  • the first information method to ensure the continuous transmission of the content of the call information during the video call, thereby improving the user's video call due to poor network quality. Hang up the problem of needing to reconnect, assist to improve the efficiency of video calls, improve the information transmission efficiency, use fluency and user experience of users using video calls.
  • This embodiment provides a video call processing method. As shown in FIG. 3 , this embodiment is applied to a first electronic device, and the electronic device positioning method includes the following steps 201:
  • Step 201 when the video call processing apparatus performs a video call between the first electronic device and the second electronic device, if the network connection parameter of the first electronic device satisfies the first condition, stop sending the video picture of the first electronic device content, and send the first information to the above-mentioned second electronic device.
  • the above-mentioned first information is information that matches the real-time voice content collected by the above-mentioned first electronic device in the above-mentioned video call.
  • the above-mentioned first information may be text information or voice information, wherein the above-mentioned voice information may be real-time voice information.
  • the above-mentioned video call may be a video call between the first electronic device and the second electronic device using any application.
  • the application of the above video call can transmit the video call content of the user of the first electronic device and the user of the second electronic device in real time, wherein the video call content includes real-time voice call content and real-time video image content, and the electronic device can transmit real-time voice synchronously.
  • Call content and real-time video picture content the above-mentioned real-time voice call content is collected by the electronic device through a microphone, and the above-mentioned real-time video picture content is collected by the electronic device through a camera.
  • the above-mentioned network connection parameters may be parameters that can affect video data transmission after the first electronic device and the second electronic device establish a network connection.
  • the above-mentioned network connection parameters may be network transmission speed, network stability, network bandwidth, and the like.
  • the above-mentioned first condition may be a condition that the network connection parameter of the first electronic device is insufficient to support video data transmission.
  • the above-mentioned first condition may be a preset threshold.
  • the preset threshold may be preset by the electronic device, or may be user-defined, which is not limited in this embodiment of the present application.
  • the above-mentioned preset threshold can be directly set in the electronic device when the electronic device is shipped from the factory after being obtained through a data simulation experiment in the laboratory.
  • the network connection parameter is the network transmission speed
  • the network transmission speed of the first electronic device is lower than the preset network transmission speed threshold, the above-mentioned first condition is satisfied, and the electronic device is triggered to stop sending the first electronic device and send the first information to the above-mentioned second electronic device.
  • the network connection parameter is network stability
  • the network stability of the first electronic device is lower than the preset stability threshold, the above-mentioned first condition is satisfied, and the electronic device is triggered to stop sending the first electronic device's network stability. video image content, and send the first information to the above-mentioned second electronic device.
  • the network connection parameter is the network bandwidth
  • the network bandwidth of the first electronic device is lower than the preset network bandwidth threshold, the above-mentioned first condition is satisfied, and the electronic device is triggered to stop sending video images of the first electronic device content, and send the first information to the above-mentioned second electronic device.
  • the first electronic device if any one of the network connection parameters satisfies the first condition, the first electronic device will be triggered to stop sending the video screen content of the first electronic device, and will be sent to the above-mentioned second electronic device. Send the first message.
  • the above-mentioned first electronic device may stop sending the video image content of the first electronic device by not collecting video images.
  • the first electronic device when the network connection parameter of the first electronic device satisfies the first condition, the first electronic device will be triggered to stop capturing video images through the camera while maintaining the current video call connection.
  • a still image captured by the last frame of the first electronic device before stopping capturing the video image may be displayed on the display interface of the first electronic device. It is understandable that the user can perform the same part of the operation on the interface where the still picture is located as the calling interface of the video call, for example, drag the interface where the still picture is located to move to any position on the display interface of the electronic device, and The interface where it is located is scaled down or scaled up.
  • the first electronic device stops sending the video content of the first electronic device, its network connection parameters may not be able to receive the video content of the second electronic device transmitted to it by the base station. In this case, the first electronic device will be forced to stop receiving the video content at the same time. At the same time, there is also a situation where the network connection parameters can only be used to support one-way transmission of video content. In this case, the first electronic device chooses to stop sending the video content of the first electronic device and only receives the second electronic device. The content of the video screen sent.
  • the above-mentioned first electronic device may send the first information to the second electronic device in real time, or may send the first information in non-real time.
  • the above-mentioned manner of sending the first information depends on the specific situation of the network connection.
  • the specific situation of the network connection can be determined by using the network connection parameter. For example, when the network connection parameter is lower than the first threshold set by the user, the first information is not sent in real time, and when the network connection parameter is lower than the first threshold set by the user and higher than the second threshold set by the user, the first information is sent in real time. Send the first message.
  • Example 1 Assuming that the first electronic device is electronic device 1 and the second electronic device is electronic device 2, in the case of electronic device 1 and electronic device 2 making a video call, if the network transmission speed of electronic device 1 is lower than the default network Transmission speed threshold, electronic device 1 will stop capturing and sending video content, maintain the current video call, keep the last frame of the image on the display interface before it stops capturing video content, and send it to the second electronic device Real-time voice content of the first electronic device.
  • the video call processing in the case of a video call between the video call processing apparatus and the second electronic device, if the network connection parameter of the video call processing apparatus satisfies the first condition, the video call processing is performed.
  • the apparatus stops sending the video picture content of the above-mentioned video call processing apparatus, and sends the first information for indicating the real-time voice content collected by the video call processing apparatus in the video call to the second electronic device.
  • the video call can be maintained first, and information that matches the real-time voice content in the video call (i.e., by stopping the sending of the video content)
  • the first information) method to ensure the continuous transmission of the content of the call information during the video call, thereby improving the user's video call due to poor network quality. Hang up the problem of needing to reconnect, assist to improve the efficiency of video calls, improve the information transmission efficiency, use fluency and user experience of users using video calls.
  • the video call processing method provided in the embodiment of the present application may further include the following step 202:
  • Step 202 The video call processing apparatus stops receiving the video image content of the second electronic device, and/or stops transmitting the real-time voice content in the video call between the first electronic device and the second electronic device.
  • the first electronic device may stop receiving the video content of the second electronic device, and/or stop transmitting the first electronic device and the first electronic device. Real-time voice content in a video call between second electronic devices.
  • the network connection parameters of the first electronic device can support the transmission of real-time voice content between the first electronic device and the second electronic device, but cannot transmit video picture content, stop receiving the data from the second electronic device.
  • Video content transmit real-time voice content with the second electronic device; stop the transmission if the network connection parameters of the first electronic device can support the transmission between the first electronic device and the second electronic device is real-time voice content
  • other methods may be used to transmit the video call content.
  • the video call processing apparatus may determine that the first electronic device stops receiving the video image content of the second electronic device by setting different preset thresholds for network connection parameters, and/or stops transmitting the first electronic device. Real-time voice content in a video call between an electronic device and a second electronic device.
  • the video call processing apparatus determines that the first electronic device stops sending the video picture content of the second electronic device, stops receiving the video picture content of the second electronic device, and/or stops transmitting the first electronic device and the video picture content.
  • the first electronic device can control the serial port and traffic priority according to the result determined by the video call processing device, formulate a priority policy according to traffic characteristics, and send a request ( Require To Send (RTS) and Clear To Send (Clear To Send, CTS) implement hardware flow control, thereby controlling the content sent by the first electronic device in the video call.
  • RTS Require To Send
  • CTS Clear To Send
  • the first electronic device may, according to the determined result, control the serial port and the traffic priority, and formulate the priority of transmitting the real-time voice according to the traffic characteristics of the real-time voice. Then, the hardware flow control is realized through RTS and CTS, and finally only the real-time voice content in the video content is transmitted during the video call.
  • Example 1 when the network connection parameter is the network transmission speed, a first threshold and a second threshold can be set for the network transmission speed, where the first threshold is greater than the second threshold, and the first threshold is the minimum network transmission that satisfies the transmission of real-time video content.
  • the second threshold is the minimum network transmission speed that satisfies the transmission of real-time voice content.
  • Screen content keep the video call state, and only transmit real-time voice content to the second electronic device; when the first electronic device detects that the network transmission speed between the first electronic device and the base station is lower than the second threshold, it stops transmitting real-time video screen content and real-time voice content content, maintain the video call state, and only transmit the first information for indicating the real-time voice content to the second electronic device.
  • network connection parameters such as network stability and network bandwidth
  • the video call processing device can set the network stability and network bandwidth to respectively satisfy the transmission of real-time video content.
  • the two preset thresholds that satisfy the minimum network transmission speed for transmitting real-time voice content, in the case that the network connection parameters of the first electronic device meet the above-mentioned first conditions, according to the network connection parameters and preset thresholds The relationship between the thresholds determines how the video call processing device handles the video call.
  • the first electronic device and the second electronic device can timely detect and trigger the first electronic device and the second electronic device to maintain the video call through other information transmission methods when the network connection parameters are abnormal. Carry out information transmission, thereby improving the user experience and efficiency of video calls.
  • the video call processing method provided in the embodiment of the present application may further include the following steps 203 and 204:
  • Step 203 The video call processing apparatus acquires the real-time voice content in the video call.
  • Step 204 The video call processing apparatus converts the real-time voice content into the first target text information.
  • the above-mentioned first information is the above-mentioned first target text information.
  • the video call processing device can convert the acquired real-time voice content into the first target by converting the acquired real-time voice content.
  • the text message is sent to the second electronic device.
  • the video call processing apparatus may collect real-time voice content through a microphone in the electronic device, and then convert the real-time voice content into data information, so that the video call processing apparatus obtains the real-time voice content in the video call.
  • the real-time voice content may be converted into the first target text information by using a voice recognition technology.
  • a voice database and semantic grammar rules corresponding to the voice recognition technology may be pre-stored in the electronic device, and after obtaining the above-mentioned real-time voice content, the video call processing apparatus may obtain the text corresponding to the voice content in its voice database The obtained text information is processed according to the semantic grammar rules, and finally the first target text information corresponding to the real-time voice content is formed.
  • the video call processing method provided by this embodiment of the present application may further include the following step 204a:
  • Step 204a The video call processing apparatus displays a text window on the current display interface.
  • the above-mentioned text window is used to display the first target text information.
  • Example 2 Combined with the above example 1, in the case of electronic device 1 and electronic device 2 making a video call, if the network transmission speed of electronic device 1 is lower than the network that can support real-time transmission of real-time voice content but can support the transmission of real-time text information In the case of the transmission speed threshold, the electronic device 1 will stop collecting the video image content and stop sending the video image content, so as to maintain the current video call. At the same time, the electronic device 1 will collect the real-time voice content of the user of the electronic device 1 under the video call through the microphone, convert the real-time voice content into the first target text information corresponding to the real-time voice content, and hover on the current display interface. A text window for displaying text is displayed, and the first target text information sent to the electronic device 2 in real time is displayed in the text window.
  • the user's real-time voice can be converted into real-time text and sent to the second electronic device through speech recognition technology. , so as to ensure the uninterrupted real-time transmission of information while keeping the video call without hanging up, and improve the efficiency of the user using the video call.
  • the video call processing method provided in this embodiment of the present application may further include step 205:
  • Step 205 The video call processing apparatus caches the above-mentioned first target text information.
  • the above-mentioned video call processing apparatus in step 201 sending the first information to the second electronic device may further include the following step 201a :
  • Step 201a The video call processing apparatus sends the first target text information to the second electronic device.
  • the video call processing apparatus sends the first target text information to the second electronic device.
  • the above-mentioned video processing apparatus may send the above-mentioned first target text information to the above-mentioned second electronic device under the condition that the second condition is satisfied and the first condition is not satisfied.
  • the above-mentioned first condition is: the network connection parameters can support real-time voice transmission and meet real-time text transmission;
  • the above-mentioned second condition is: the above-mentioned second condition can be that the network connection parameters can support sending real-time text information.
  • the above-mentioned first target text information can be sent to the above-mentioned second electronic device.
  • the network connection parameter is the network transmission speed
  • the network transmission speed can only satisfy the transmission of real-time text information, but cannot transmit real-time voice information
  • the first information is the first target text information corresponding to the real-time voice content.
  • the video call processing device can convert the acquired real-time voice content into the first target text information, and temporarily cache it in the first target text information.
  • the network connection parameters can support the sending of real-time text information
  • the cached first target text information is sent to the second electronic device, thereby assisting in improving the efficiency of video calls and ensuring the continuity of video calls and information transmission.
  • step 201a the same steps as step 204a in the foregoing content may be included.
  • Example 3 In combination with the above example 2, in the case of a video call between electronic device 1 and electronic device 2, if the network transmission speed of electronic device 1 is lower than the network transmission speed threshold capable of supporting the transmission of real-time text information, the electronic device 1 After the real-time voice content is converted into the first target text information corresponding to the real-time voice content, it will be cached in the electronic device 1, and when the network transmission speed is restored to the network transmission speed threshold that can support the transmission of real-time text information, in the On the current display interface, a text window for displaying text is displayed floatingly, and the first target text information sent to the electronic device 2 is displayed in the text window.
  • the video call can be held first, and the real-time voice content of the user can be recorded at the same time. All converted into text information and cached in the electronic device. After the network is restored, the above text information can be sent, so that the video call can be maintained and the video call does not need to be hung up. At the same time, the user does not need to repeat the content that has been described, and the efficiency of the video call is improved. , to improve the user experience of using video calls.
  • the video call processing method provided in this embodiment of the present application may further include the following step 206:
  • Step 206 The video call processing apparatus receives the second information sent by the second electronic device.
  • the above-mentioned second information is used to indicate the real-time voice content collected by the above-mentioned second electronic device in the above-mentioned video call.
  • the foregoing second information may be text information or voice information, which is not limited in this embodiment of the present application.
  • the video call processing method provided in this embodiment of the present application may further include the following step 207:
  • Step 207 The video call processing apparatus receives the second target text information sent by the second electronic device.
  • the above-mentioned second target text information is used to represent the real-time voice content collected by the above-mentioned second electronic device in the above-mentioned video call.
  • the second electronic device when the network connection parameter of the first electronic device satisfies the above-mentioned first condition and sends the first target text information to the second electronic device, the second electronic device also correspondingly switches the video call mode to The same video call mode of the first electronic device is switched to convert the real-time voice content into text information and send it to the first electronic device, and further, the video call processing apparatus receives the second target text information sent by the second electronic device.
  • the above-mentioned first target text information and second target text information may be displayed in a text window on the current display interface for displaying text information.
  • Example 4 Combined with the above example 2, when the electronic device 1 converts the real-time voice content into the first target text information corresponding to the real-time voice content, and displays a text window for displaying text on the current display interface, in the text
  • the first target text information sent to the electronic device 2 in real time is displayed in the window
  • the received second target text information sent by the electronic device 2 will be displayed in the text window at the same time.
  • the information transmission of the video call can be assisted by text information transmission, thereby improving the user experience of using the video call and improving the efficiency of the user using the electronic device.
  • the above-mentioned first electronic device includes a first screen and a second screen
  • the video call processing method provided in the embodiment of the present application may further include the following steps 208 and 209:
  • Step 208 The video call processing apparatus starts the second screen if the network connection parameter of the first electronic device satisfies the first condition when the first screen displays the call interface of the video call.
  • Step 209 The video call processing apparatus displays the above-mentioned first target text information or the above-mentioned second target text information on the above-mentioned second screen.
  • starting the second screen by the video call processing apparatus may be starting the display function of the second screen.
  • the second screen is one of the display screens
  • the second screen is in a screen-off state
  • the second screen is activated to display the first target text information and the second target text information.
  • the first electronic device when the first electronic device includes a first screen on the front and a second screen embedded in the first electronic device, if the network connection parameters of the first electronic device do not meet the first condition, the The second screen is in the state of off-screen and embedded in the electronic device. If the network connection parameters of the first electronic device do not meet the first condition, the second screen is activated, protrudes from the first electronic device, and the first target text is displayed. information or the above-mentioned second target text information.
  • the first electronic device when it satisfies the first condition and cannot send real-time voice content and real-time video image content, it can display text information on the second screen of the first electronic device, so that the user can view the content of the video call.
  • real-time information you can also use the first screen to perform other operations you need to enrich the user experience, thereby better assisting the first electronic device to complete information transmission in the video call.
  • the execution body may be a video call processing apparatus, or a control module in the video call processing apparatus for executing the video call processing method.
  • the video call processing apparatus provided by the embodiments of the present application is described by taking the video call processing apparatus executing the video call processing method as an example.
  • FIG. 4 is a schematic structural diagram of a possible structure for implementing the video call processing apparatus provided by the embodiment of the present application.
  • the above-mentioned apparatus 600 includes: a sending module 601; the above-mentioned sending module 601 is used for performing a video call between the above-mentioned first electronic device and the second electronic device, if the network connection parameter of the above-mentioned first electronic device is Meet the first condition, stop sending the video content of the first electronic device, and send the first information to the second electronic device; wherein, the first information is collected with the first electronic device in the video call. Real-time voice content matching information.
  • the video call processing apparatus in the case of a video call between the video call processing apparatus and the second electronic device, if the network connection parameter of the video call processing apparatus satisfies the first condition, the video call The processing device stops sending the video image content of the video call processing device, and sends information (ie, first information) matching the real-time voice content collected by the video call processing device during the video call to the second electronic device.
  • the video call can be maintained first, and by stopping the sending of the video content, the first video for matching the real-time voice content in the video call is sent simultaneously.
  • the problem that needs to be reconnected can help improve the efficiency of video calls, and improve the information transmission efficiency, use fluency and user experience of users using video calls.
  • the apparatus 600 further includes: an execution module 602; the execution module 602 is configured to stop receiving the second electronic device video image content of the device, and/or stop transmitting the real-time voice content in the video call between the first electronic device and the second electronic device.
  • the above-mentioned apparatus 600 further includes: an acquisition module 603 and a conversion module 604; the above-mentioned acquisition module 603 is used to acquire the real-time voice content in the above-mentioned video call; the above-mentioned conversion module 604 is used to convert the The above-mentioned real-time voice content obtained by the above-mentioned obtaining module 603 is converted into first target text information; wherein, the above-mentioned first information is the above-mentioned first target text information.
  • the above-mentioned apparatus 600 further includes a cache module 605; the above-mentioned cache module 605 is specifically used to cache the above-mentioned first target text information; the above-mentioned sending module 601 is specifically used to send the above-mentioned second electronic device.
  • the first target text information buffered by the above buffering module 605 is sent.
  • the above-mentioned apparatus 600 further includes a receiving module 606, if the network connection parameter of the above-mentioned first electronic device satisfies the above-mentioned first condition; the above-mentioned receiving module 606 is configured to receive the transmission from the above-mentioned second electronic device.
  • the second target text information wherein, the second target text information is used to represent the real-time voice content collected by the second electronic device in the video call.
  • the above-mentioned apparatus 600 further includes a start-up module 607 and a display module 608, the above-mentioned first electronic device includes a first screen and a second screen; the above-mentioned start-up module 607 is used for the above-mentioned first screen.
  • the second screen is activated; the above-mentioned display module 608 is used for the above-mentioned second screen after the above-mentioned activation module 607 is activated.
  • the above-mentioned first target text information or the above-mentioned second target text information is displayed on the screen.
  • the video call processing apparatus in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal.
  • the apparatus may be a mobile electronic device or a non-mobile electronic device.
  • the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant).
  • UMPC ultra-mobile personal computer
  • netbook or a personal digital assistant
  • non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.
  • Network Attached Storage NAS
  • personal computer personal computer, PC
  • television television
  • teller machine or self-service machine etc.
  • the video call processing apparatus in this embodiment of the present application may be an apparatus having an operating system.
  • the operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.
  • the video call processing apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments in FIG. 1 to FIG. 3 , and to avoid repetition, details are not repeated here.
  • the modules that must be included in the video call processing apparatus 600 are indicated by solid line frames, such as the sending module 601 ; the modules that may or may not be included in the video call processing apparatus 600 are indicated by dotted line frames , such as executing module 602 .
  • an embodiment of the present application further provides an electronic device 500, including a processor 501, a memory 502, a program or instruction stored in the memory 502 and executable on the processor 501,
  • an electronic device 500 including a processor 501, a memory 502, a program or instruction stored in the memory 502 and executable on the processor 501,
  • the program or instruction is executed by the processor 501, each process of the foregoing video call processing method embodiment can be implemented, and the same technical effect can be achieved. In order to avoid repetition, details are not repeated here.
  • the electronic devices in the embodiments of the present application include the aforementioned mobile electronic devices and non-mobile electronic devices.
  • FIG. 6 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
  • the electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110, etc. part.
  • the user input unit 107 includes a touch panel 1071 and other input devices 1072
  • the display unit 106 includes a display panel 1061
  • the input unit 104 includes an image processor 1041 and a microphone 1042
  • the memory 109 can be used to store software programs (eg, an operating system). , applications required for at least one function) and various data.
  • the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power management through the power management system. consumption management and other functions.
  • a power source such as a battery
  • the structure of the electronic device shown in FIG. 6 does not constitute a limitation on the electronic device, and the electronic device may include more or less components than those shown in the figure, or combine some components, or arrange different components, which will not be repeated here. .
  • the radio frequency unit 101 is used to perform a video call between the first electronic device 100 and the second electronic device, if the network of the first electronic device 100 The connection parameters satisfy the first condition, stop sending the video content of the first electronic device 100, and send first information to the second electronic device; wherein the first information is used to indicate the first electronic device in the video call.
  • the real-time voice content collected by the device 100 is used to indicate the first electronic device in the video call.
  • the first electronic device in the case of a video call between the first electronic device and the second electronic device, if the network connection parameter of the first electronic device satisfies the first condition, the first electronic device stops sending the above-mentioned first electronic device.
  • the video screen content of an electronic device is sent to the second electronic device, and information (first information) matching the real-time voice content collected by the first electronic device in the video call is sent.
  • the video call can be maintained first, and by stopping sending the video content, the first electronic device that matches the real-time voice content in the video call is sent.
  • the problem of reconnection can help improve the efficiency of video calls, and improve the information transmission efficiency, use fluency and user experience of users using video calls.
  • the processor 110 is configured to stop receiving the video content of the second electronic device, and/or stop transmitting the first electronic device. Real-time voice content in a video call with a second electronic device.
  • the above-mentioned processor 110 is further configured to acquire the real-time voice content in the above-mentioned video call; the processor 110 is further configured to convert the above-mentioned real-time voice content into first target text information; wherein, the above-mentioned first information is the above-mentioned The first target text message.
  • the above-mentioned processor 110 is further configured to cache the above-mentioned first target text information; the radio frequency unit 101 is specifically configured to send to the above-mentioned second electronic device if the network connection parameter of the above-mentioned first electronic device satisfies the second condition The above-mentioned first target text information.
  • the user input unit 107 is configured to receive the second target text information sent by the above-mentioned second electronic device; is used to characterize the real-time voice content collected by the second electronic device in the video call.
  • the above-mentioned first electronic device includes a first screen and a second screen
  • the processor 110 is further configured to display the call interface of the above-mentioned video call on the above-mentioned first screen, if the network of the above-mentioned first electronic equipment is connected. If the parameter satisfies the above-mentioned first condition, the second screen is activated; the display unit 106 is configured to display the above-mentioned first target text information or the above-mentioned second target text information on the above-mentioned second screen.
  • the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042. Such as camera) to obtain still pictures or video image data for processing.
  • the display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • the user input unit 107 includes a touch panel 1071 and other input devices 1072 .
  • the touch panel 1071 is also called a touch screen.
  • the touch panel 1071 may include two parts, a touch detection device and a touch controller.
  • Other input devices 1072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again.
  • Memory 109 may be used to store software programs as well as various data including, but not limited to, application programs and operating systems.
  • the processor 110 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and an application program, and the like, and the modem processor mainly processes wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 110 .
  • Embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium.
  • a program or an instruction is stored on the readable storage medium.
  • the processor is the processor in the electronic device described in the foregoing embodiments.
  • the readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.
  • An embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement the above embodiments of the video call processing method and can achieve the same technical effect, in order to avoid repetition, it will not be repeated here.
  • the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-chip, or a system-on-a-chip, or the like.
  • the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation.
  • the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of this application.
  • a storage medium such as ROM/RAM, magnetic disk, CD-ROM

Abstract

本申请公开了一种视频通话处理方法、装置和电子设备。该方法包括:第一电子设备在第一电子设备与第二电子设备间进行视频通话情况下,若第一电子设备的网络连接参数满足第一条件,停止发送第一电子设备的视频画面内容,并向第二电子设备发送第一信息;其中,第一信息为与视频通话中的第一电子设备采集到的实时语音内容匹配的信息。

Description

视频通话处理方法、装置和电子设备
相关申请的交叉引用
本申请主张在2020年12月24日在中国提交的中国专利申请号202011551485.5的优先权,其全部内容通过引用包含于此。
技术领域
本申请属于通信技术领域,具体涉及一种视频通话处理方法、装置和电子设备。
背景技术
随着电子设备通信技术的发展,电子设备可以通过网络使用越来越多的通话方式与其他电子设备之间建立通话,例如,通过网络发送即时语音消息或者文字消息、或者,通过网络进行语音通话、或者,通过网络进行视频通话。
在电子设备通过网络与其他电子设备建立通话的过程中,只有在网络质量到达预定要求(例如,网络传输速度稳定且网络带宽足够)的情况下,才能够保证通话过程流畅,否则将无法保持通话质量。以通话方式为视频通话为例,在电子设备1利用网络与电子设备2进行视频通话的过程中,若网络的数据传输速度较低,可能会出现视频画面卡顿,电子设备2无法及时接收到电子设备1的用户的视频信息及视频信息中的语音信息,甚至导致视频通话中断。
由上述过程可知,由于现有的视频通话技术在网络质量不好的时候会影响用户的通话过程,因此,会降低用户使用电子设备进行视频通话的效率。
发明内容
本申请实施例的目的是提供一种视频通话处理方法、装置和电子设备,能够解决由于现有的视频通讯技术在网络质量不好的时候会影响用户的通话过程,因此,会降低用户使用电子设备进行视频通讯的效率的问题。
为了解决上述技术问题,本申请是这样实现的:
第一方面,本申请实施例提供了一种视频通话处理方法,应用于第一电子设备,该方法包括:该第一电子设备在上述第一电子设备与第二电子设备间进行视频通话情况下,若上述第一电子设备的网络连接参数满足第一条件,停止发送上述第一电子设备的视频画面内容,并向上述第二电子设备发送第一信 息;其中,上述第一信息为与上述视频通话中的上述第一电子设备采集到的实时语音内容匹配的信息。
第二方面,本申请实施例提供了一种视频通话处理装置,上述装置包括:发送模块;上述发送模块,用于在上述第一电子设备与第二电子设备间进行视频通话情况下,若上述第一电子设备的网络连接参数满足第一条件,停止发送上述第一电子设备的视频画面内容,并向上述第二电子设备发送第一信息;其中,上述第一信息为与上述视频通话中的上述第一电子设备采集到的实时语音内容匹配的信息。
第三方面,本申请实施例提供了一种电子设备,该电子设备包括处理器、存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如第一方面所述的方法的步骤。
第四方面,本申请实施例提供了一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如第一方面所述的方法的步骤。
第五方面,本申请实施例提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如第一方面所述的方法。
在本申请实施例中,在第一电子设备与第二电子设备之间进行视频通话的情况下,若该第一电子设备的网络连接参数满足第一条件,则第一电子设备停止发送上述第一电子设备的视频画面内容,并向第二电子设备发送与该视频通话中的第一电子设备采集到的实时语音内容相匹配信息(即第一信息)。如此,在第一电子设备的网络连接参数不足以支撑传输视频画面内容的情况下,可以先行维持视频通话,并通过停止发送视频画面内容同时发送与该视频通话中实时语音内容匹配的第一信息的方式,来保证在视频通话过程中,通话信息内容的连续传输,进而改善用户视频通话中由于网络质量不好而导致的视频通话信息内容接收延缓、卡顿,以及视频通话自动挂断需要重新连接的问题,辅助提高视频通话效率,提高用户使用视频通话的信息传输效率、使用流畅度以及使用体验。
附图说明
图1是本申请实施例提供的一种第一电子设备和第二电子设备的通信系统 示意图;
图2是本申请实施例提供的一种第一电子设备的结构示意图;
图3是本申请实施例提供的一种视频通话处理方法的流程示意图;
图4是本申请实施例提供的一种视频通话处理装置的结构示意图;
图5为本申请实施例提供的一种电子设备的结构示意图之一;
图6为本申请实施例提供的一种电子设备的结构示意图之二。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施,且“第一”、“第二”等所区分的对象通常为一类,并不限定对象的个数,例如第一对象可以是一个,也可以是多个。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。
下面对本申请实施例中的名词作出如下解释:
1.视频通话
在相关技术中,如图1所示,当电子设备之间在进行视频通话的过程中,需要分别与服务器连接,然后,分别通过基站发送所要发送的视频内容,进而由基站发送至其他电子设备,并从基站接收其他电子设备发送的视频内容,从而查看其他电子设备发送的视频内容。
如图1所示,以电子设备包括电子设备1和电子设备的情况下,电子设备1在基站A的信号覆盖范围内,与基站A相连接,电子设备2在基站B的信号覆盖范围内,连接电子设备2需要与基站B连接,基站A与基站B之间可以相互传输通信数据。电子设备1与基站A相连接的过程中,包含上行传输链路11(以下简称“链路11”)和下行传输链路12(以下简称“链路12”),类似的,电子设备2与基站B相连接的过程中,包含上行传输链路13(以下简 称“链路13”)和下行传输链路14(以下简称“链路14”),在上述链路11,链路12、链路13和链路14的数据传输过程中,若任意链路不通畅,例如,网络传输速度下降导致链路11无法在单位时间内上传足够的视频数据时,将会导致电子设备1基站A接收不到完整的视频数据,则基站B和电子设备2也接收不到完整的视频数据。也即,只有在上述链路11,链路12、链路13和链路14的数据传输过程均通畅无异常的情况下,才能够保证电子设备1和电子设备2之间的视频通话连续。
可以理解的是,上述基站A和基站B可以为不同的基站,例如,在电子设备1和电子设备2之间距离较远的情况下,需要通过不同的基站传输视频数据;上述基站A和基站B也可以为相同的基站,例如,上述电子设备1和电子设备2距离较近,在同一个基站覆盖范围下时,可以通过同一个基站传输视频数据。
需要说明的是,在本申请中的下述实施例中,当电子设备之间通过不同的基站传输数据信息时,默认基站之间网路连接为正常的,也即基站之间的数据信息能够正常传输,不会出现异常,例如,网络速度慢导致数据信息无法传输。
2.包含第一屏和第二屏的电子设备
本申请实施例应用于包含第一屏和第二屏的电子设备。上述两个屏幕可以为可折叠电子设备构成的两个屏幕,具体的,上述可折叠电子设备可以为两个电子设备通过铰接的方式组成的可折叠电子设备,也可以是包含可折叠显示屏的可折叠电子设备;上述两个屏幕也可以是具备双屏的电子设备包含的两个屏幕,具体的,上述双屏可以为位于电子设备同一面的两个屏幕,也可以为分别位于电子设备正面和反面的两个屏幕,还可以为一个位于电子设备正面,一个嵌在电子设备内部可以相对于电子设备伸缩显示的两个屏幕。
示例性的,如图2所示,该电子设备可以包含第一屏幕21和设置在第一屏幕后背的伸缩屏幕22,该伸缩屏幕22可以具备从电子设备中伸出和缩回的功能。在一种示例中,上述电子设备中可以设置伸缩电机和伸缩滑轨,当电子设备需要控制伸缩屏幕22伸出和缩回时,可以控制伸缩屏幕22沿着伸缩滑轨的轨迹,完成伸出动作和缩回动作。
示例性的,电子设备可以向伸缩屏幕发送伸出命令控制伸缩屏幕22升起,还可以向伸缩屏幕22发送缩回命令控制上述伸缩屏幕缩回回电子设备,还可 以向伸缩屏幕22发送开启命令控制上述伸缩屏幕22开启显示功能,还可以向上述伸缩屏幕22发送显示命令控制上述伸缩屏幕22显示特定的显示内容。
3.发送请求(Require To Send,RTS)和发送清除(Clear To Send,CTS)
RTS与CTS为MODEM硬件流控中的两种信号,RTS和CTS是各自独立的信号。其中,RTS是模块的输入端,用于微控制单元(Microcontroller Unit,MCU)通知模块,MCU是否准备好,模块是否可向MCU发送信息,RTS的有效电平为低;CTS是模块的输出端,用于模块通知MCU,模块是否准备好,MCU是否可向模块发送信息,CTS的有效电平为低。
下面结合附图,通过具体的实施例及其应用场景对本申请实施例提供的视频通话处理进行详细地说明。
本申请实施例提供的视频通话处理方法可以应用于第一电子设备和其他电子设备之间进行视频通话的场景。
针对第一电子设备和其他电子设备之间进行视频通话的场景,假设第一电子设备为电子设备1,其他电子设备为电子设备2,则在电子设备1与电子设备2进行视频通话的情况下,若电子设备1的网络连接参数,即网络传输速度低于传输视频内容所需的最低传输速度的情况下,由于其无法将视频内容连续上传至服务器,也无法连续接收服务器向其传输的电子设备2的视频内容,因此,在电子设备1的显示屏中,会出现视频内容卡顿,进而被迫中断与电子设备2进行视频连接的情况。如此,会使得用户在网络连接参数不满足传输视频完整内容的情况下,使用电子设备进行视频通话不连续,效率低,使用感受差的问题。
本申请实施例提供的视频通话处理方法,在电子设备1与电子设备2之间进行视频通话的情况下,若该电子设备1的网络连接参数满足第一条件,例如网络传输速度低于预定阈值,则电子设备1停止发送上述电子设备1的视频画面内容,并向电子设备2发送与该视频通话中的电子设备1采集到的实时语音内容匹配的信息(即第一信息)。如此,在电子设备1的网络连接参数不足以支撑传输视频画面内容的情况下,可以先行维持视频通话,并通过停止发送视频画面内容同时发送与该视频通话中实时语音内容相匹配的信息(即第一信息)的方式,来保证在视频通话过程中,通话信息内容的连续传输,进而改善用户视频通话中由于网络质量不好而导致的视频通话信息内容接收延缓、卡 顿,以及视频通话自动挂断需要重新连接的问题,辅助提高视频通话效率,提高用户使用视频通话的信息传输效率、使用流畅度以及使用体验。
本实施例提供一种视频通话处理方法,如图3所示,本实施例应用于第一电子设备,该电子设备定位方法包括以下步骤201:
步骤201:视频通话处理装置在上述第一电子设备与第二电子设备间进行视频通话情况下,若上述第一电子设备的网络连接参数满足第一条件,停止发送上述第一电子设备的视频画面内容,并向上述第二电子设备发送第一信息。
在本申请实施例中,上述第一信息为与上述视频通话中的上述第一电子设备采集到的实时语音内容匹配的信息。
在本申请实施例中,上述第一信息可以为文字信息,也可以为语音信息,其中,上述语音信息可以为实时语音信息。
在本申请实施例中,上述视频通话可以为第一电子设备和第二电子设备之间使用任意应用进行的视频通话。上述视频通话的应用可以实时传输第一电子设备的用户和第二电子设备的用户的视频通话内容,其中,该视频通话内容包括实时语音通话内容和实时视频画面内容,电子设备可以同步传输实时语音通话内容和实时视频画面内容,上述实时语音通话内容为电子设备通过麦克风采集的,上述实时视频画面内容为电子设备通过摄像头采集的。
在本申请实施例中,上述网络连接参数可以为第一电子设备与第二电子设备建立网络连接后,能够影响视频数据传输的参数。
在一种示例中,上述网络连接参数可以为网络传输速度、网络稳定性、网络带宽等。
在本申请实施例中,上述第一条件可以为第一电子设备的网络连接参数不足以支持视频数据传输的条件。
在本申请实施例中,上述第一条件可以为预设阈值。其中,该预设阈值可以为电子设备预设的,也可以为用户自定义设定的,本申请实施例对此不作限定。
可以理解的是,上述预设阈值可以在实验室中通过数据模拟实验获取后,直接在电子设备出厂时设置在电子设备中。
在一种示例中,当网络连接参数为网络传输速度时,若第一电子设备的网络传输速度低于预设网络传输速度阈值,则满足上述第一条件,触发电子设备 停止发送第一电子设备的视频画面内容,并向上述第二电子设备发送第一信息。
在一种示例中,当网络连接参数为网络稳定性时,若第一电子设备的网络稳定度低于预设稳定度阈值,则满足上述第一条件,触发电子设备停止发送第一电子设备的视频画面内容,并向上述第二电子设备发送第一信息。
在一种示例中,当网络连接参数为网络带宽时,若第一电子设备的网络带宽低于预设网络带宽阈值,则满足上述第一条件,触发电子设备停止发送第一电子设备的视频画面内容,并向上述第二电子设备发送第一信息。
可以理解的是,上述多种网络连接参数中,若有任意一个网络连接参数满足第一条件,则会触发第一电子设备停止发送第一电子设备的视频画面内容,并向上述第二电子设备发送第一信息。
在本申请实施例中,上述第一电子设备可以通过不再采集视频画面,从而停止发送第一电子设备的视频画面内容。
在一种示例中,当第一电子设备的网络连接参数满足第一条件时,将触发第一电子设备在维持当前视频通话连接的情况下,停止通过摄像头采集视频画面。其中,在上述维持视频通话连接的过程中,可以在第一电子设备的显示界面上显示第一电子设备在停止采集视频画面之前最后一帧采集到的静止画面。可以理解的,用户可以对该静止画面的所在界面执行与视频通话的通话界面相同的部分操作,例如,拖动该静止画面的所在界面移动至电子设备显示界面的任意位置,将该静止画面的所在界面等比例缩小或者等比例放大。
可以理解的是,在第一电子设备停止发送第一电子设备的视频画面内容的情况下,其网络连接参数存在无法接收基站向其传输的第二电子设备的视频画面内容的情况,因此,在这种情况下,第一电子设备将会同时被迫停止接收视频画面内容。同时,也存在有网络连接参数仅能用于支撑单向传输视频画面内容的情况,在这种情况下,第一电子设备选择停止发送第一电子设备的视频画面内容,仅接收第二电子设备发送的视频画面内容。
在本申请实施例中,上述第一电子设备可以向第二电子设备实时发送第一信息,也可以非实时发送第一信息。其中,上述发送第一信息的方式取决于网络连接的具体情况,一般的,可以通过网络连接参数判断网络连接的具体情况。例如,在网络连接参数低于用户设定的第一阈值时,非实时发送第一信息,当 网络连接参数低于用户设定的第一阈值且高于用户设定的第二阈值时,实时发送第一信息。
示例1:假设第一电子设备为电子设备1,第二电子设备为电子设备2,在电子设备1与电子设备2进行视频通话的情况下,若电子设备1的网络传输速度低于预设网络传输速度阈值,电子设备1将停止采集视频画面内容并停止发送视频画面内容,维持当前的视频通话,在显示界面上保持停止采集视频画面内容前的最后一帧图像,并向第二电子设备发送第一电子设备的实时语音内容。
在本申请实施例提供的视频通话处理方法,在视频通话处理装置与第二电子设备之间进行视频通话的情况下,若该视频通话处理装置的网络连接参数满足第一条件,则视频通话处理装置停止发送上述视频通话处理装置的视频画面内容,并向第二电子设备发送用于指示该视频通话中的视频通话处理装置采集到的实时语音内容的第一信息。如此,在视频通话处理装置的网络连接参数不足以支撑传输视频画面内容的情况下,可以先行维持视频通话,并通过停止发送视频画面内容同时发送与该视频通话中实时语音内容匹配的信息(即第一信息)的方式,来保证在视频通话过程中,通话信息内容的连续传输,进而改善用户视频通话中由于网络质量不好而导致的视频通话信息内容接收延缓、卡顿,以及视频通话自动挂断需要重新连接的问题,辅助提高视频通话效率,提高用户使用视频通话的信息传输效率、使用流畅度以及使用体验。
可选的,在本申请实施例中,若上述第一电子设备的网络连接参数满足上述第一条件,则本申请实施例提供的视频通话处理方法还可以包括如下步骤202:
步骤202:视频通话处理装置停止接收上述第二电子设备的视频画面内容,和/或,停止传输上述第一电子设备与第二电子设备间的视频通话中的实时语音内容。
示例性的,若上述第一电子设备的网络连接参数满足上述第一条件,则第一电子设备可以停止接收上述第二电子设备的视频画面内容,和/或,停止传输上述第一电子设备与第二电子设备间的视频通话中的实时语音内容。
示例性的,在第一电子设备的网络连接参数能够支持第一电子设备与第二电子设备之间传输是实时语音内容,而不能够传输视频画面内容的情况下,停 止接收第二电子设备的视频内容,与第二电子设备之间传输实时语音内容;在第一电子设备的网络连接参数能够不能够支持第一电子设备与第二电子设备之间传输是实时语音内容的情况下,停止传输上述第一电子设备与第二电子设备间的视频通话中的实时语音内容,可以进一步使用其他方式传输视频通话内容。
在一种示例中,视频通话处理装置可以通过为网络连接参数设定不同的预设阈值,从而确定第一电子设备停止接收上述第二电子设备的视频画面内容,和/或,停止传输上述第一电子设备与第二电子设备间的视频通话中的实时语音内容。
示例性的,视频通话处理装置在确定第一电子设备停止发送上述第二电子设备的视频画面内容、停止接收上述第二电子设备的视频画面内容,和/或,停止传输上述第一电子设备与第二电子设备间的视频通话中的实时语音内容后,第一电子设备可以根据视频通话处理装置上述确定的结果,通过控制串口和流量优先级,根据流量特征制定优先级策略,通过发送请求(Require To Send,RTS)和发送清除(Clear To Send,CTS)实现硬件流控,进而控制第一电子设备在视频通话中发送的内容。例如,当视频通话处理装置确定仅传输视频内容中的实时语音内容,第一电子设备可以根据该确定的结果,通过控制串口和流量优先级,根据实时语音的流量特征制定优先传输实时语音的优先级策略,然后,通过RTS和CTS实现硬件流控,最终实现在视频通话的过程中仅传输视频内容中的实时语音内容。
例1,当网络连接参数为网络传输速度时,可以为网络传输速度设定第一阈值和第二阈值,其中第一阈值大于第二阈值,第一阈值为满足传输实时视频内容的最低网络传输速度,第二阈值为满足传输实时语音内容的最低网络传输速度,则当第一电子设备检测到与基站间的网络传输速度低于第一阈值且高于第二阈值时,则停止传输实时视频画面内容,保持视频通话状态,仅向第二电子设备传输实时语音内容;当第一电子设备检测到与基站间的网络传输速度低于第二阈值时,则停止传输实时视频画面内容和实时语音内容,保持视频通话状态,仅向第二电子设备传输用于指示实时语音内容的第一信息。
可以理解的,其他网络连接参数,例如,网络稳定度、网络带宽与上述例1中的网络传输速度相同,视频通话处理装置可以为网络稳定度、网络带宽设 定划分分别能够满足传输实时视频内容的最低网络传输速度,和满足传输实时语音内容的最低网络传输速度的两个预设阈值,在在第一电子设备的网络连接参数满足上述第一条件的情况下,根据网络连接参数与预设阈值之间的关系,确定视频通话处理装置对视频通话的处理方式。
如此,可以保证第一电子设备和第二电子设备在网络连接参数异常的情况下,及时检测并触发第一电子设备和第二电子设备通过其他信息传输方式在保持视频通话的情况下,能够持续进行信息传输,从而提升用户视频通话的使用体验和使用效率。
可选的,在本申请实施例中,在上述步骤201中的向上述第二电子设备发送第一信息之前,本申请实施例提供的视频通话处理方法还可以包括如下步骤203和步骤204:
步骤203:视频通话处理装置获取上述视频通话中的实时语音内容。
步骤204:视频通话处理装置将上述实时语音内容转换为第一目标文字信息。
示例性的,上述第一信息为上述第一目标文字信息。
示例性的,在视频通话处理装置的网络连接参数不足以支持传输实时语音内容、但能够支持传输实时文字信息的情况下,视频通话处理装置可以通过将获取到的实时语音内容转换为第一目标文字信息,发送至第二电子设备。
示例性的,视频通话处理装置可以通过电子设备中的麦克风,采集实时语音内容,进而将实时语音内容转化为数据信息,以使得视频通话处理装置获取上述视频通话中的实时语音内容。
示例性的,在视频通话处理装置获取上述视频通话中的实时语音内容后,可以通过语音识别技术将上述实时语音内容转换为第一目标文字信息。
在一种示例中,电子设备中可以预存有语音识别技术对应的语音数据库及语义语法规则,在获取上述实时语音内容后,视频通话处理装置可以在其语音数据库中获取与语音内容相对应的文字信息,并根据语义语法规则对获取的文字信息进行处理,最终形成实时语音内容对应的第一目标文字信息。
示例性的,在上述步骤204之后,本申请实施例提供的视频通话处理方法还可以包括如下步骤204a:
步骤204a:视频通话处理装置在当前显示界面上显示文字窗口。
示例性的,上述文字窗口用于显示第一目标文字信息。
示例2:结合上述示例1,在电子设备1与电子设备2进行视频通话的情况下,若电子设备1的网络传输速度低于能够支持实时传输实时语音内容、但能够支持传输实时文字信息的网络传输速度阈值的情况下,电子设备1将停止采集视频画面内容并停止发送视频画面内容,维持当前的视频通话。同时,电子设备1将通过麦克风采集电子设备1的用户在视频通话下的实时语音内容,并将该实时语音内容转化为与实时语音内容对应的第一目标文字信息,并在当前显示界面上悬浮显示用于显示文字的文字窗口,在该文字窗口中显示实时发送至电子设备2的第一目标文字信息。
如此,在第一电子设备的网络连接参数不足以维持视频内容传输,但可以支持文字实时传输的情况下,可以通过语音识别技术,将用户的实时语音转化为实时文字发送至第二电子设备中,从而在保持视频通话无需挂断的同时,保证信息的实时传输不间断,提高用户使用视频通话的效率。
可选的,在本申请实施例中,在上述步骤204之后,本申请实施例提供的视频通话处理方法还可以包括步骤205:
步骤205:视频通话处理装置缓存上述第一目标文字信息。
进一步的,在上述步骤205的基础上,在本申请实施例提供的视频通话处理方法中,步骤201中的上述视频通话处理装置向所述第二电子设备发送第一信息还可以包括如下步骤201a:
步骤201a:视频通话处理装置向上述第二电子设备发送上述第一目标文字信息。
示例性的,若上述第一电子设备的网络连接参数满足第二条件,则视频通话处理装置向上述第二电子设备发送上述第一目标文字信息。
可以理解的是,上述视频处理装置可以在满足第二条件且不满足第一条件的情况下,向上述第二电子设备发送上述第一目标文字信息。其中,上述第一条件为:网络连接参数能够支持实时语音传输且满足实时文字传输;上述第二条件为:上述第二条件可以为网络连接参数能够支持发送实时文字信息。
进一步的,当视频处理装置的网络连接参数仅能够用于支持传输实施文字时,即可向上述第二电子设备发送上述第一目标文字信息。例如,当网络连接参数为网络传输速度,网络传输速度仅能够满足传输实时文字信息,而不能够 传输实时语音信息,第一信息即为与实时语音内容对应的第一目标文字信息。
示例性的,在视频通话处理装置的网络连接参数不足以支持传输实时文字信息的情况下,视频通话处理装置可以将获取到的实时语音内容转换为第一目标文字信息,并暂时缓存在第一电子设备中,待网络连接参数能够支持发送实时文字信息的情况下,再将缓存的第一目标文字信息发送至第二电子设备,从而辅助提高视频通话效率,保证视频通话以及信息传输的连续性。
示例性的,在步骤201a之后,可以包括与前述内容中步骤204a相同的步骤。
示例3:结合上述示例2,在电子设备1与电子设备2进行视频通话的情况下,若电子设备1的网络传输速度低于能够支持传输实时文字信息的网络传输速度阈值的情况下,电子设备1在将该实时语音内容转化为与实时语音内容对应的第一目标文字信息后,将缓存在电子设备1中,待网络传输速度恢复为能够支持传输实时文字信息的网络传输速度阈值时,在当前显示界面上悬浮显示用于显示文字的文字窗口,并在该文字窗口中显示发送至电子设备2的第一目标文字信息。
如此,若用户在使用电子设备进行视频通话的过程中,出现短时间内无法接收到网络的情形(例如,在电梯中进行视频通话),则可以先行保持视频通话,同时将用户的实时语音内容全部转化为文字信息缓存在电子设备中,待网络恢复后发送上述文字信息,从而可以在保持视频通话、无需挂断视频通话的同时,无需用户重复叙述已经叙述过的内容,辅助提高视频通话效率,提升用户使用视频通话的用户体验。
可选的,在本申请实施例中,若上述第一电子设备的网络连接参数满足上述第一条件,本申请实施例提供的视频通话处理方法还可以包括如下步骤206:
步骤206:视频通话处理装置接收上述第二电子设备发送的第二信息。
示例性的,上述第二信息用于指示上述视频通话中的上述第二电子设备采集到的实时语音内容。
示例性的,上述第二信息可以为文字信息,也可以为语音信息,本申请实施例对此不作限定。
可选的,在本申请实施例中,若上述第一电子设备的网络连接参数满足上述第一条件,本申请实施例提供的视频通话处理方法还可以包括如下步骤207:
步骤207:视频通话处理装置接收上述第二电子设备发送的第二目标文字信息。
示例性的,上述第二目标文字信息用于表征上述视频通话中的上述第二电子设备采集到的实时语音内容。
在一种示例中,在第一电子设备的网络连接参数满足上述第一条件并向第二电子设备发送第一目标文字信息的情况下,第二电子设备也相应的将视频通话方式切换为与第一电子设备相同的视频通话方式,也即切换为将实时语音内容转换为文字信息发送至第一电子设备,进而,视频通话处理装置接收第二电子设备发送的第二目标文字信息。
示例性的,上述第一目标文字信息和第二目标文字信息可以显示在当前显示界面上用于显示文字信息的文字窗口中。
示例4:结合上述示例2,当电子设备1将该实时语音内容转化为与实时语音内容对应的第一目标文字信息,并在当前显示界面上悬浮显示用于显示文字的文字窗口,在该文字窗口中显示实时发送至电子设备2的第一目标文字信息的情况下,会同时在该文字窗口中显示接收到的电子设备2发送的第二目标文字信息。
如此,在网络连接参数不足以支持视频内容传输的情况下,可以通过文字信息传输辅助完成视频通话的信息传输,从而提升用户使用视频通话的使用体验,并且提高用户使用电子设备效率。
可选的,在本申请实施例中,上述第一电子设备包含第一屏和第二屏,本申请实施例提供的视频通话处理方法还可以包括如下步骤208和步骤209:
步骤208:视频通话处理装置在上述第一屏显示上述视频通话的通话界面的情况下,若上述第一电子设备的网络连接参数满足上述第一条件,启动第二屏。
步骤209:视频通话处理装置在上述第二屏上显示上述第一目标文字信息或上述第二目标文字信息。
示例性的,上述包含第一屏和第二屏的电子设备的具体描述可以参照前述内容,此处不再赘述。
示例性的,上述:视频通话处理装置启动第二屏可以为启动第二屏的显示功能。
在一种示例中,当第一电子设备包含同一面或者不同面的两个显示屏,上述第二屏为其中一个显示屏时,若上述第一电子设备的网络连接参数未满足上述第一条件,则第二屏幕处于熄屏状态,若上述第一电子设备的网络连接参数未满足上述第一条件,则第二屏幕启动,显示上述第一目标文字信息和上述第二目标文字信息。
在另一种示例中,当第一电子设备包含正面的第一屏以及嵌入在第一电子设备内部的第二屏时,若上述第一电子设备的网络连接参数未满足上述第一条件,第二屏处于熄屏和嵌入电子设备内部状态,若上述第一电子设备的网络连接参数未满足上述第一条件,则第二屏幕启动,从第一电子设备内部伸出,并上述第一目标文字信息或上述第二目标文字信息。
如此,第一电子设备在满足第一条件,无法发送实时语音内容及实时视频画面内容的情况下,可以在第一电子设备的第二屏中显示文字信息,从而在用户可以查看视频通话中的实时信息的情况下,还可以使用第一屏执行自己所需的其他操作,丰富用户的使用体验,从而更好的辅助第一电子设备完成视频通话中的信息传输。
需要说明的是,本申请实施例提供的视频通话处理方法,执行主体可以为视频通话处理装置,或者该视频通话处理装置中的用于执行视频通话处理方法的控制模块。本申请实施例中以视频通话处理装置执行视频通话处理方法为例,说明本申请实施例提供的视频通话处理装置。
图4为实现本申请实施例提供的视频通话处理装置的可能的结构示意图。如图4所示,上述装置600包括:发送模块601;上述发送模块601,用于在上述第一电子设备与第二电子设备间进行视频通话情况下,若上述第一电子设备的网络连接参数满足第一条件,停止发送上述第一电子设备的视频画面内容,并向上述第二电子设备发送第一信息;其中,上述第一信息为与上述视频通话中的上述第一电子设备采集到的实时语音内容匹配的信息。
在本申请实施例提供的视频通话处理装置,在该视频通话处理装置与第二电子设备之间进行视频通话的情况下,若该视频通话处理装置的网络连接参数满足第一条件,则视频通话处理装置停止发送上述视频通话处理装置的视频画面内容,并向第二电子设备发送与该视频通话中的视频通话处理装置采集到的实时语音内容相匹配信息(即第一信息)。如此,在视频通话处理装置的网络 连接参数不足以支撑传输视频画面内容的情况下,可以先行维持视频通话,并通过停止发送视频画面内容同时发送用于与该视频通话中实时语音内容匹配的第一信息的方式,来保证在视频通话过程中,通话信息内容的连续传输,进而改善用户视频通话中由于网络质量不好而导致的视频通话信息内容接收延缓、卡顿,以及视频通话自动挂断需要重新连接的问题,辅助提高视频通话效率,提高用户使用视频通话的信息传输效率、使用流畅度以及使用体验。
可选的,在本申请实施例中,若上述第一电子设备的网络连接参数满足上述第一条件,上述装置600还包括:执行模块602;上述执行模块602,用于停止接收上述第二电子设备的视频画面内容,和/或,停止传输上述第一电子设备与第二电子设备间的视频通话中的实时语音内容。
可选的,在本申请实施例中,上述装置600还包括:获取模块603和转换模块604;上述获取模块603,用于获取上述视频通话中的实时语音内容;上述转换模块604,用于将上述获取模块603获取的上述实时语音内容转换为第一目标文字信息;其中,上述第一信息为上述第一目标文字信息。
可选的,在本申请实施例中,上述装置600还包括缓存模块605;上述缓存模块605,具体用于缓存上述第一目标文字信息;上述发送模块601,具体用于向上述第二电子设备发送上述缓存模块605缓存的第一目标文字信息。
可选的,在本申请实施例中,上述装置600还包括接收模块606,若上述第一电子设备的网络连接参数满足上述第一条件;上述接收模块606,用于接收上述第二电子设备发送的第二目标文字信息;其中,上述第二目标文字信息用于表征上述视频通话中的上述第二电子设备采集到的实时语音内容。
可选的,在本申请实施例中,上述装置600还包括启动模块607和显示模块608,上述第一电子设备包含第一屏和第二屏;上述启动模块607,用于在上述第一屏显示上述视频通话的通话界面的情况下,若上述第一电子设备的网络连接参数满足上述第一条件,启动第二屏;上述显示模块608,用于在上述启动模块607启动后的上述第二屏上显示上述第一目标文字信息或上述第二目标文字信息。
本申请实施例中的视频通话处理装置可以是装置,也可以是终端中的部件、集成电路、或芯片。该装置可以是移动电子设备,也可以为非移动电子设备。示例性的,移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、 车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,非移动电子设备可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。
本申请实施例中的视频通话处理装置可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统,可以为ios操作系统,还可以为其他可能的操作系统,本申请实施例不作具体限定。
本申请实施例提供的视频通话处理装置能够实现图1至图3的方法实施例实现的各个过程,为避免重复,这里不再赘述。
需要说明的是,如图4所示,视频通话处理装置600中一定包括的模块用实线框示意,如发送模块601;视频通话处理装置600中可以包括也可以不包括的模块用虚线框示意,如执行模块602。
可选的,如图5所示,本申请实施例还提供一种电子设备500,包括处理器501,存储器502,存储在存储器502上并可在所述处理器501上运行的程序或指令,该程序或指令被处理器501执行时实现上述视频通话处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
需要说明的是,本申请实施例中的电子设备包括上述所述的移动电子设备和非移动电子设备。
图6为实现本申请实施例的一种电子设备的硬件结构示意图。
该电子设备100包括但不限于:射频单元101、网络模块102、音频输出单元103、输入单元104、传感器105、显示单元106、用户输入单元107、接口单元108、存储器109、以及处理器110等部件。其中,用户输入单元107包括:触控面板1071和其他输入设备1072,显示单元106包含显示面板1061,输入单元104包括图像处理器1041和麦克风1042,存储器109可用于存储软件程序(如,操作系统、至少一个功能所需的应用程序)以及各种数据。
本领域技术人员可以理解,电子设备100还可以包括给各个部件供电的电源(比如电池),电源可以通过电源管理系统与处理器110逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图6中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少 的部件,或者组合某些部件,或者不同的部件布置,在此不再赘述。
其中,在电子设备100为第一电子设备的情况下,上述射频单元101,用于在上述第一电子设备100与第二电子设备间进行视频通话情况下,若上述第一电子设备100的网络连接参数满足第一条件,停止发送上述第一电子设备100的视频画面内容,并向上述第二电子设备发送第一信息;其中,上述第一信息用于指示上述视频通话中的上述第一电子设备100采集到的实时语音内容。
在本申请实施例中,在第一电子设备与第二电子设备之间进行视频通话的情况下,若该第一电子设备的网络连接参数满足第一条件,则第一电子设备停止发送上述第一电子设备的视频画面内容,并向第二电子设备发送与该视频通话中的第一电子设备采集到的实时语音内容相匹配信息(第一信息)。如此,在第一电子设备的网络连接参数不足以支撑传输视频画面内容的情况下,可以先行维持视频通话,并通过停止发送视频画面内容同时发送与指示该视频通话中实时语音内容匹配的第一信息的方式,来保证在视频通话过程中,通话信息内容的连续传输,进而改善用户视频通话中由于网络质量不好而导致的视频通话信息内容接收延缓、卡顿,以及视频通话自动挂断需要重新连接的问题,辅助提高视频通话效率,提高用户使用视频通话的信息传输效率、使用流畅度以及使用体验。
可选的,若上述第一电子设备100的网络连接参数满足上述第一条件,处理器110,用于停止接收上述第二电子设备的视频画面内容,和/或,停止传输上述第一电子设备与第二电子设备间的视频通话中的实时语音内容。
可选的,上述处理器110,还用于获取上述视频通话中的实时语音内容;处理器110,还用于将上述实时语音内容转换为第一目标文字信息;其中,上述第一信息为上述第一目标文字信息。
可选的,上述处理器110,还用于缓存上述第一目标文字信息;射频单元101,具体用于若上述第一电子设备的网络连接参数满足第二条件,则向上述第二电子设备发送上述第一目标文字信息。
可选的,若上述第一电子设备的网络连接参数满足上述第一条件,用户输入单元107,用于接收上述第二电子设备发送的第二目标文字信息;其中,上述第二目标文字信息用于表征上述视频通话中的上述第二电子设备采集到的 实时语音内容。
可选的,上述第一电子设备包含第一屏和第二屏,处理器110,还用于在上述第一屏显示上述视频通话的通话界面的情况下,若上述第一电子设备的网络连接参数满足上述第一条件,启动第二屏;显示单元106,用于在上述第二屏上显示上述第一目标文字信息或上述第二目标文字信息。
应理解的是,本申请实施例中,输入单元104可以包括图形处理器(Graphics Processing Unit,GPU)1041和麦克风1042,图形处理器1041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元106可包括显示面板1061,可以采用液晶显示器、有机发光二极管等形式来配置显示面板1061。用户输入单元107包括触控面板1071以及其他输入设备1072。触控面板1071,也称为触摸屏。触控面板1071可包括触摸检测装置和触摸控制器两个部分。其他输入设备1072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。存储器109可用于存储软件程序以及各种数据,包括但不限于应用程序和操作系统。处理器110可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器110中。
本申请实施例还提供一种可读存储介质,所述可读存储介质上存储有程序或指令,该程序或指令被处理器执行时实现上述视频通话处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
其中,所述处理器为上述实施例中所述的电子设备中的处理器。所述可读存储介质,包括计算机可读存储介质,如计算机只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等。
本申请实施例另提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现上述视频通话处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。
应理解,本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯 片系统或片上系统芯片等。
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。

Claims (15)

  1. 一种视频通话处理方法,应用于第一电子设备,所述方法包括:
    在所述第一电子设备与第二电子设备视频通话情况下,若所述第一电子设备的网络连接参数满足第一条件,停止将所述第一电子设备的视频画面内容发送至第二电子设备,并向所述第二电子设备发送第一信息;
    其中,所述第一信息为与所述视频通话中的所述第一电子设备采集到的实时语音内容匹配的信息。
  2. 根据权利要求1所述的方法,其中,若所述第一电子设备的网络连接参数满足所述第一条件,所述方法还包括:
    停止接收所述第二电子设备的视频画面内容,和/或,停止传输所述第一电子设备与第二电子设备间的视频通话中的实时语音内容。
  3. 根据权利要求1所述的方法,其中,所述向所述第二电子设备发送第一信息之前,所述方法还包括:
    获取所述视频通话中的实时语音内容;
    将所述实时语音内容转换为第一目标文字信息;
    其中,所述第一信息为所述第一目标文字信息。
  4. 根据权利要求3所述的方法,其中,所述将所述实时语音内容转换为第一目标文字信息之后,所述方法还包括:
    缓存所述第一目标文字信息;
    所述向所述第二电子设备发送第一信息,包括:
    向所述第二电子设备发送所述第一目标文字信息。
  5. 根据权利要求1所述的方法,其中,所述方法还包括:
    接收所述第二电子设备发送的第二目标文字信息;
    其中,所述第二目标文字信息用于表征所述视频通话中的所述第二电子设备采集到的实时语音内容。
  6. 根据权利要求3或5所述的方法,其中,所述第一电子设备包含第一屏和第二屏,所述方法还包括:
    在所述第一屏显示所述视频通话的通话界面的情况下,启动第二屏;
    在所述第二屏上显示所述第一目标文字信息或所述第二目标文字信息。
  7. 一种视频通话处理装置,所述装置包括:发送模块;
    所述发送模块,用于在所述第一电子设备与第二电子设备间进行视频通话情况下,若所述第一电子设备的网络连接参数满足第一条件,停止发送所述第一电子设备的视频画面内容,并向所述第二电子设备发送第一信息;
    其中,所述第一信息为与所述视频通话中的所述第一电子设备采集到的实时语音内容匹配的信息。
  8. 根据权利要求7所述的装置,其中,若所述第一电子设备的网络连接参数满足所述第一条件,所述装置还包括:执行模块;
    所述执行模块,用于停止接收所述第二电子设备的视频画面内容,和/或,停止传输所述第一电子设备与第二电子设备间的视频通话中的实时语音内容。
  9. 根据权利要求7所述的装置,其中,所述装置还包括:获取模块和转换模块;
    所述获取模块,用于获取所述视频通话中的实时语音内容;
    所述转换模块,用于将所述获取模块获取的所述实时语音内容转换为第一目标文字信息;
    其中,所述第一信息为所述第一目标文字信息。
  10. 根据权利要求9所述的装置,其中,所述装置还包括缓存模块;
    所述缓存模块,具体用于缓存所述第一目标文字信息;
    所述发送模块,具体用于向所述第二电子设备发送所述缓存模块缓存的所述第一目标文字信息。
  11. 根据权利要求7所述的方法,其中,所述装置还包括接收模块,若所述第一电子设备的网络连接参数满足所述第一条件;
    所述接收模块,用于接收所述第二电子设备发送的第二目标文字信息;
    其中,所述第二目标文字信息用于表征所述视频通话中的所述第二电子设备采集到的实时语音内容。
  12. 根据权利要求9或11所述的装置,其中,所述装置还包括启动模块和显示模块,所述第一电子设备包含第一屏和第二屏;
    所述启动模块,用于在所述第一屏显示所述视频通话的通话界面的情况下,若所述第一电子设备的网络连接参数满足所述第一条件,启动第二屏;
    所述显示模块,用于在所述启动模块启动后的所述第二屏上显示所述第一目标文字信息或所述第二目标文字信息。
  13. 一种电子设备,包括处理器,存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如权利要求1-6任一项所述的视频通话处理方法的步骤。
  14. 一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求1-6任一项所述的视频通话处理方法的步骤。
  15. 一种芯片,包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如权利要求1-6任一项所述的视频通话处理方法的步骤。
PCT/CN2021/139091 2020-12-24 2021-12-17 视频通话处理方法、装置和电子设备 WO2022135291A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011551485.5 2020-12-24
CN202011551485.5A CN112653865A (zh) 2020-12-24 2020-12-24 视频通话处理方法、装置和电子设备

Publications (1)

Publication Number Publication Date
WO2022135291A1 true WO2022135291A1 (zh) 2022-06-30

Family

ID=75360177

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/139091 WO2022135291A1 (zh) 2020-12-24 2021-12-17 视频通话处理方法、装置和电子设备

Country Status (2)

Country Link
CN (1) CN112653865A (zh)
WO (1) WO2022135291A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115134641A (zh) * 2022-07-05 2022-09-30 北京字跳网络技术有限公司 投屏方法、装置和电子设备

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112653865A (zh) * 2020-12-24 2021-04-13 维沃移动通信有限公司 视频通话处理方法、装置和电子设备
CN113286110A (zh) * 2021-05-19 2021-08-20 Oppo广东移动通信有限公司 视频通话方法、装置、电子设备以及存储介质
CN115379283A (zh) * 2022-08-16 2022-11-22 维沃移动通信有限公司 视频通话方法和装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104967810A (zh) * 2015-06-30 2015-10-07 努比亚技术有限公司 一种通话模式的转换方法及终端设备
CN105323529A (zh) * 2015-10-19 2016-02-10 掌赢信息科技(上海)有限公司 一种音频通话与视频通话之间的切换方法和电子设备
CN105872437A (zh) * 2015-12-15 2016-08-17 乐视致新电子科技(天津)有限公司 一种视频通话控制方法、装置及终端
WO2017185995A1 (zh) * 2016-04-28 2017-11-02 中兴通讯股份有限公司 音视频转换方法及装置
CN107396198A (zh) * 2017-07-24 2017-11-24 维沃移动通信有限公司 一种视频通话方法及移动终端
CN111654658A (zh) * 2020-06-17 2020-09-11 平安科技(深圳)有限公司 音视频通话的处理方法、系统、编解码器及存储装置
CN112653865A (zh) * 2020-12-24 2021-04-13 维沃移动通信有限公司 视频通话处理方法、装置和电子设备

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104967810A (zh) * 2015-06-30 2015-10-07 努比亚技术有限公司 一种通话模式的转换方法及终端设备
CN105323529A (zh) * 2015-10-19 2016-02-10 掌赢信息科技(上海)有限公司 一种音频通话与视频通话之间的切换方法和电子设备
CN105872437A (zh) * 2015-12-15 2016-08-17 乐视致新电子科技(天津)有限公司 一种视频通话控制方法、装置及终端
WO2017185995A1 (zh) * 2016-04-28 2017-11-02 中兴通讯股份有限公司 音视频转换方法及装置
CN107396198A (zh) * 2017-07-24 2017-11-24 维沃移动通信有限公司 一种视频通话方法及移动终端
CN111654658A (zh) * 2020-06-17 2020-09-11 平安科技(深圳)有限公司 音视频通话的处理方法、系统、编解码器及存储装置
CN112653865A (zh) * 2020-12-24 2021-04-13 维沃移动通信有限公司 视频通话处理方法、装置和电子设备

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115134641A (zh) * 2022-07-05 2022-09-30 北京字跳网络技术有限公司 投屏方法、装置和电子设备
CN115134641B (zh) * 2022-07-05 2023-10-27 北京字跳网络技术有限公司 投屏方法、装置和电子设备

Also Published As

Publication number Publication date
CN112653865A (zh) 2021-04-13

Similar Documents

Publication Publication Date Title
WO2022135291A1 (zh) 视频通话处理方法、装置和电子设备
US10585637B2 (en) Information processing method and electronic device
WO2019196707A1 (zh) 一种移动终端控制方法及移动终端
WO2017129082A1 (zh) 一种终端控制方法及终端
CN109379497B (zh) 语音信息播放方法、移动终端及计算机可读存储介质
CN110366212B (zh) 一种条件切换结果的检测方法及终端
CN110175062B (zh) 一种移动终端的屏幕刷新帧率方法、移动终端及存储介质
US20210136725A1 (en) Paging indication method, apparatus, and system
WO2019120087A1 (zh) 降低功耗的处理方法及移动终端
WO2019096119A1 (zh) 业务处理方法及移动通信终端
US9922438B2 (en) Method and apparatus for switching real-time image in instant messaging
WO2019210754A1 (zh) 搜网控制方法、装置及移动终端
US20220046502A1 (en) Handover method and terminal
CN110162418B (zh) 应用冷启动方法、移动终端及计算机可读存储介质
CN109195213B (zh) 移动终端屏幕控制方法、移动终端及计算机可读存储介质
WO2023045885A1 (zh) 同步方法和装置
WO2019141173A1 (zh) 业务指示方法和相关设备
US11930410B2 (en) State processing method, user equipment and base station
CN113163460A (zh) 业务处理方法、终端及网络设备
US11304143B2 (en) Terminal device, network device, frame format configuration method, and system
CN114126015A (zh) 功耗控制方法、智能终端及存储介质
KR102520533B1 (ko) 자원 풀을 전환하는 방법, 장치, 이동 단말, 네트워크 측 장치 및 매체
CN110167202B (zh) 会话处理方法、装置、终端及介质
CN109831577B (zh) 网络连接方法、终端以及计算机可读存储介质
AU2019247007B2 (en) Measuring method, terminal and network side device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21909287

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21909287

Country of ref document: EP

Kind code of ref document: A1