CN112601042B - Display device, server and method for video call to be compatible with different protocol signaling - Google Patents

Display device, server and method for video call to be compatible with different protocol signaling Download PDF

Info

Publication number
CN112601042B
CN112601042B CN202011324820.8A CN202011324820A CN112601042B CN 112601042 B CN112601042 B CN 112601042B CN 202011324820 A CN202011324820 A CN 202011324820A CN 112601042 B CN112601042 B CN 112601042B
Authority
CN
China
Prior art keywords
signaling
video communication
communication signaling
display device
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011324820.8A
Other languages
Chinese (zh)
Other versions
CN112601042A (en
Inventor
滕健
任竑烨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Juhaokan Technology Co Ltd
Original Assignee
Juhaokan Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Juhaokan Technology Co Ltd filed Critical Juhaokan Technology Co Ltd
Priority to CN202011324820.8A priority Critical patent/CN112601042B/en
Publication of CN112601042A publication Critical patent/CN112601042A/en
Application granted granted Critical
Publication of CN112601042B publication Critical patent/CN112601042B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/161Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
    • H04L69/162Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields involving adaptations of sockets based mechanisms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/18Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols

Abstract

The present application relates to the field of communications technologies, and in particular, to a display device, a server, and a method for enabling a video call to be compatible with signaling of different protocols. The problem that the signaling server cannot be compatible with the WebSocket protocol and the Http protocol simultaneously in the video call process of the display device can be solved to a certain extent. The server includes: the universal interface receives a first video communication signaling sent by display equipment, comprises a call request from the first display equipment or the second display equipment, is used for establishing communication connection between the first display equipment and the second display equipment, and comprises a first protocol format call request and/or a second protocol format call request; the first controller is configured to: and responding to the first video communication signaling, and generating a second video communication signaling for feeding back information in the signaling interaction process, wherein the second video communication signaling comprises a first protocol format access address and a second protocol format access address and is used for enabling the receiving display equipment to establish video call connection according to the required protocol format access address.

Description

Display device, server and method for video call to be compatible with different protocol signaling
Technical Field
The present application relates to the field of communications technologies, and in particular, to a display device, a server, and a method for enabling a video call to be compatible with signaling of different protocols.
Background
At present, video call functions between terminal devices are very common, different users can carry out video call at any time and any place, and communication efficiency between users is greatly improved. Video call interactive signaling generally has two modes, old version based on Http protocol signaling and new version based on webscolet protocol.
After the calling display device initiates a video call, it is possible that the protocol signaling of the calling and called display devices is both new and old. The WebSocket protocol reduces the delay time of signaling, improves the video call experience, and has a larger user base number in the signaling of the Http protocol. When the signaling server only supports Http protocol signaling, the video call requirement of the old version can be met, but the call with the WebSocket protocol-based display equipment cannot be realized, and the performance and experience cannot be improved; the signaling server based on the WebSocket protocol can meet the call requirement of a new version, reduce the signaling delay time and improve the user experience, but cannot be communicated with http protocol display equipment.
However, for some display devices that simultaneously support Http protocol and WebSocket protocol, when initiating a Http-based call, the display devices are connected to the Http signaling server, and when initiating a WebSocket-based call, the display devices are connected to the WebSocket signaling server, and for the uncertainty of the supported version of the called display device, the problem that the Http-based display device joins a call still cannot be solved.
Disclosure of Invention
In order to solve the problem that a signaling server cannot be compatible with a WebSocket protocol and an Http protocol simultaneously in the video call process of display equipment, the application provides the display equipment, the server and a method for enabling the video call to be compatible with signaling of different protocols.
The embodiment of the application is realized as follows:
a first aspect of an embodiment of the present application provides a server, including: the universal interface receives a first video communication signaling sent by display equipment, wherein the first video communication signaling comprises a call request from the first display equipment or the second display equipment, the first video communication signaling is used for establishing communication connection between the first display equipment and the second display equipment, and the call request comprises a call request in a first protocol format and/or a call request in a second protocol format; a first controller coupled to the generic interface and configured to: and responding to the first video communication signaling, and generating a second video communication signaling used for feeding back information in the signaling interaction process, wherein the second video communication signaling comprises a first protocol format access address and a second protocol format access address, and the second video communication signaling is used for enabling the receiving display equipment to establish video call connection according to the required protocol format access address.
A second aspect of an embodiment of the present application provides a display apparatus, including: a second controller configured to: sending a first video communication signaling containing a call request to a server, wherein the first video communication signaling is used for enabling the server to generate a second video communication signaling used for feeding back information in a signaling interaction process according to the first protocol format call request and/or a second protocol format call request contained in the call request; receiving a second video communication signaling which is sent by the server and contains a first protocol format access address and a second protocol format access address; and establishing communication connection with opposite-end display equipment according to the access address contained in the second video communication signaling.
A third aspect of the embodiments of the present application provides a method for enabling a video call to be compatible with signaling of different protocols, where the method includes: receiving a first video communication signaling sent by a display device, wherein the first video communication signaling comprises a call request from the first display device or a second display device, the first video communication signaling is used for establishing communication connection between the first display device and the second display device, and the call request comprises a first protocol format call request and/or a second protocol format call request; and responding to the first video communication signaling, and generating a second video communication signaling for feeding back information in a signaling interaction process, wherein the second video communication signaling comprises a first protocol format access address and a second protocol format access address, and the second video communication signaling is used for enabling the receiving display equipment to establish video call connection according to the required protocol format access address.
A fourth aspect of the embodiments of the present application provides a method for enabling a video call to be compatible with signaling of different protocols, where the method includes: sending a first video communication signaling containing a call request to a server, wherein the first video communication signaling is used for enabling the server to generate a second video communication signaling used for feeding back information in a signaling interaction process according to the first protocol format call request and/or a second protocol format call request contained in the call request; receiving a second video communication signaling which is sent by the server and contains a first protocol format access address and a second protocol format access address; and establishing communication connection with opposite-end display equipment according to the access address contained in the second video communication signaling.
The beneficial effect of this application: by constructing a universal interface, the server can be compatible with different protocol signaling; further, the server can acquire the signaling by constructing a first video communication signaling; further, by constructing a second video communication signaling, the server can feed back the second video communication signaling according to the first video communication signaling, so that interaction of the segment display equipment and the server in the video call process is realized, the communication state of the video call participant terminal is obtained in real time, and the establishment of video call connection of signaling display equipment with different protocol formats is realized.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and those skilled in the art can obtain other drawings without inventive labor.
Fig. 1 is a schematic view of a usage scenario of a display device according to an embodiment;
fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment;
fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment;
fig. 4 shows a system configuration block diagram of the display device 200 according to the exemplary embodiment;
FIG. 5 illustrates a schematic diagram of an application interface in a display device 200, according to an exemplary embodiment;
FIG. 6A is a diagram illustrating a display device application user interface according to an embodiment of the present application;
FIG. 6B is a diagram illustrating a display device initiating a video call user interface according to an embodiment of the application;
FIG. 7 is a diagram illustrating a plurality of display devices conducting a video call through a server according to an embodiment of the present application;
FIG. 8 is a diagram illustrating server compatible signaling processing according to an embodiment of the present application;
fig. 9 is a timing diagram illustrating a server and a display device processing compatible signaling according to an embodiment of the present application.
Detailed Description
To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all the embodiments.
It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.
The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the functionality associated with that element.
Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user may operate the display apparatus 200 through the smart device 300 or the control device 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.
In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.
In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.
In some embodiments, the smart device 300 and the display device may also be used for communication of data.
In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.
In some embodiments, software steps executed by one step execution agent may migrate to another step execution agent in data communication therewith for execution as needed. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.
Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.
In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.
In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.
Fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.
In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.
In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.
In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.
In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.
In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.
In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. Operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.
In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a ramandom Access Memory, RAM), ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.
A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.
In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.
In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and other video processing according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.
In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.
In some embodiments, the audio processor is configured to receive an external audio signal, perform at least one of decompression and decoding, and denoising, digital-to-analog conversion, and amplification processing according to a standard codec protocol of the input signal, and obtain a sound signal that can be played in the speaker.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.
In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical keys on the body of the display device, or the like).
In some embodiments, the system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signals and inter-process communication (IPC). And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.
Referring to fig. 4, in some embodiments, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (Application Framework) layer (referred to as a "Framework layer"), an Android runtime (Android runtime) layer and a system library layer (referred to as a "system runtime library layer"), and a kernel layer.
In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.
As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.
In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, shaking the display, distorting and deforming the display, and the like).
In some embodiments, the system runtime layer provides support for an upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.
In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..
In some embodiments, the display device may directly enter an interface of a preset video-on-demand program after being started, and the interface of the video-on-demand program may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 5, where content displayed in the content display area may change according to a change of a selected control in the navigation bar. The programs in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can also be further displayed after the application control in the navigation bar is selected.
In some embodiments, the display device may directly enter a display interface of a signal source selected last time after being started, or a signal source selection interface, where the signal source may be a preset video-on-demand program, or may be at least one of an HDMI interface, a live tv interface, and the like, and after a user selects different signal sources, the display may display contents obtained from different signal sources.
The embodiment of the application can be applied to various types of display devices (including but not limited to smart televisions, mobile terminals, tablet computers, set-top boxes and the like). The following description will be given by taking a technical scheme that the smart television and the server are compatible with different protocol signaling in the video call and a user interface as examples, and a method for the display device, the server and the video call to be compatible with different protocol signaling will be described.
FIG. 6A is a diagram illustrating a display device application user interface according to an embodiment of the present application.
The display device provided by the application comprises a display and a second controller. The display is used for displaying a user interface, and the user interface comprises a playing window for video call.
In some embodiments, the application UI interface includes 4 tv-installed applications, news headlines, movie theater on demand, video call, karaoke, etc. By moving the focus on the display screen using a controller such as a remote control, different applications, or other function buttons, may be selected.
In some embodiments, the user interface may also present interactive elements, which may include, for example, television home page controls, search controls, message button controls, mailbox controls, browser controls, favorites controls, signal bar controls, etc., and by moving focus on the display screen using a controller such as a remote control, different applications, function buttons may be selected.
To improve the convenience and the visualization of the television UI, in some embodiments, the first controller of the display device in the embodiments of the present application controls the UI of the television in response to the manipulation of the interactive element. For example, a user clicks the network connection icon through a controller such as a remote controller, so that the network setting interface can be activated, and the UI of the network setting interface is displayed on the top of the global UI, thereby controlling the UI of the application component mapped by the interactive elements to be enlarged or run and displayed in a full screen mode.
In some embodiments, the interactive element may also be operated by a sensor, which may be, but is not limited to, an acoustic input sensor, such as a display device configured microphone, which may detect voice commands including indications of the desired interactive element. For example, a user may identify a desired interactive element, such as a video call application, using "start video call" or any other suitable identification, and may also describe that a desired action associated with the desired interactive element is to be performed. The first controller may recognize the voice command and submit data characterizing the interaction to the UI or its processing component or engine.
Fig. 6B is a schematic diagram illustrating a user interface for a display device to start a video call according to an embodiment of the application.
In some embodiments, a user may control the focus of the display screen via a remote control, selecting a video call application such that its icon is highlighted on the user interface of the television display screen; then, by clicking the highlighted icon, the opening of the icon-mapped application program can be realized.
It should be noted that the icons and the texts of the UI interface in the embodiment of the present application are only used as examples to describe the technical solutions of the display device, the server, and the video call compatible with different protocol signaling, and the icons and the texts of the UI interface in the drawings may also be implemented as other contents, and the drawings of the present application are not specifically limited.
Fig. 7 is a schematic diagram illustrating a plurality of display devices conducting a video call through a server according to an embodiment of the present application.
The display device server provided by the application comprises a general interface and a first controller. The universal interface receives a first video communication signaling sent by display equipment, wherein the first video communication signaling comprises a call request from the first display equipment or the second display equipment, the first video communication signaling is used for establishing communication connection between the first display equipment and the second display equipment, and the call request comprises a call request in a first protocol format and/or a call request in a second protocol format; the first controller coupled to the generic interface and configured to: and responding to the first video communication signaling, and generating a second video communication signaling for feeding back information in a signaling interaction process, wherein the second video communication signaling comprises a first protocol format access address and a second protocol format access address, and the second video communication signaling is used for enabling the receiving display equipment to establish video call connection according to the required protocol format access address. The following will explain the specific process of the display device and the server for realizing the compatibility of the video call with different protocol signaling.
In some embodiments, the Http signaling or the WebSocket signaling or both may be supported in the display device. The video call can be carried out among a plurality of display devices through a signaling server, wherein the signaling server can be implemented as a server provided by the application and is used for transmitting signaling required by the video call communication among the plurality of display devices, the signaling generally needs to be transmitted among different links of a communication network, such as a base station, a mobile control switching center and the like, each link carries out analysis processing and forms a series of operations and controls through interaction, and the function of the links is to ensure the effective and reliable transmission of information among the display devices.
Different types of protocol signaling, such as Http signaling and WebSocket signaling, cannot be directly communicated with each other, and real-time audio and video communication cannot be directly performed between the protocols and the signaling. If the display device D1 uses the Http signaling and the display device D2 uses the WebSocket signaling, real-time audio and video communication between the display device D1 and the display device D2 may not be performed.
Such signaling incompatibility often occurs, for example, http protocol signaling is used on a display device first, but with continuous service expansion and product upgrade, http protocol signaling cannot meet requirements, so developers develop WebSocket protocol signaling with more complete functions and better performance.
However, the Http protocol signaling is already used on a large number of display devices and software of all the display devices cannot be upgraded to the WebSocket protocol signaling in a short time, so that there is a period of time (even a long time because some display devices cannot be upgraded to the WebSocket protocol signaling for any reason), some display devices use the Http protocol signaling, some display devices use the WebSocket protocol signaling, and if it is ensured that each display device can perform real-time audio/video conversation with other display devices, compatible processing needs to be considered.
The audio and video processing signaling subjected to the compatibility processing can be compatible with an Http protocol signaling and a WebSocket protocol signaling at the same time. If the display device D1 upgrades the audio and video processing signaling, the display device D1 is provided with a display device D2 without upgrading software (only provided with an Http protocol signaling and communicating by using the Http protocol signaling) and an upgraded display device D3 (provided with the Http protocol signaling and a WebSocket protocol signaling and preferentially communicating by using the WebSocket protocol signaling), so that the communication between the software upgrading and the display device without software upgrading is ensured.
In some embodiments, the server may implement information transfer between multiple terminal devices through the websocket protocol. The method comprises the following steps that a first display device clicks an HTML5 application icon on a screen to trigger and establish websocket data connection with a built-in server; specifically, the establishing of the websocket data transmission channel between the first display device and the server includes: the method comprises the steps that a first display device sends a websocket handshake request to a built-in server; the first display equipment receives a handshake response returned by the server; the handshake response is a response of the server to a handshake request sent by the first display device.
The method comprises the steps that a first display device sends data information to at least one second display device; specifically, the first display device sends data information to at least one second display device through a websocket data transmission channel and a built-in server. Before the server sends the data information to the at least one second display device, the at least one second display device needs to establish websocket data connection with the built-in server. The push information comprises information resources of local equipment and a public network, and can be in various forms such as pictures, videos, tablets and the like.
And the first display equipment receives data information sent by other terminals. Specifically, the at least one second display device receives data information pushed by the server through a websocket data transmission channel, and browses in a mode of clicking HTML5 application.
The websocket data transmission channel established between the at least one second display device and the built-in server of the first display device is specifically as follows: the at least one second display device sends a websocket handshake request to the server; the at least one second display device receives a handshake response returned by the server; the handshake response is a response of the server to a handshake request sent by the at least second display device.
The at least one second display device sending data information to the other terminal includes: and the at least one second display device sends data information to the first display device through the websocket data transmission channel and the built-in server of the first television terminal. Before sending data information to the first display device through the server, the first display device needs to establish websocket data connection with the built-in server.
And the at least one second display device sends data information to the at least one other second display device which is connected with the server through the websocket data transmission channel and the built-in server of the first display device.
And the at least one second display device sends data information to the first display device and the at least one other second display device which is connected with the server through the websocket data transmission channel and the built-in server of the first display device.
Fig. 8 is a diagram illustrating a server-compatible signaling process according to an embodiment of the present application.
The first display device may be implemented as terminal a in the figure, which supports Http signaling; the second display device may be implemented as terminal B, which supports WebSocket signaling; the server may be implemented as a signaling server.
In some embodiments, the method for receiving a first video communication signaling sent by a display device includes: receiving a first protocol format call request sent by a first display device to a first protocol interface of the server; and/or receiving a second protocol format call request sent by the first display device to the second protocol interface of the server.
For example, the universal interface receives an Http signaling sent by a first display device or a WebSocket signaling sent by a second display device, and specifically includes: receiving an Http signaling sent by a first display device to the Http interface of the server; or receiving a Websocket signaling sent by the second display device to the server Websocket interface.
After the terminal A initiates a video call request, a first controller of the server creates a file session1 in a memory, and the file session1 is used for storing information customerA and customerB of video calls of the terminal A and the terminal B;
after receiving the request of the terminal A, the signaling server sends a push message containing a WebSocket connection address and an Http request address to a called terminal B, and meanwhile, the request return of the terminal A also obtains the address;
after obtaining the connection address, the terminal A and the terminal B can select the Http mode communication or the WebSocket mode communication according to the protocol signaling type supported by the terminals;
the method comprises the steps that a terminal A sends a first video communication signaling containing a Ring signal to a signaling server in the process of waiting for connection, and the signaling server sets the connection attribute of a customerA in a file session1 as Http;
after the terminal B establishes the WebSocket connection, the signaling server respectively establishes a Read Channel and a Write Channel for the connection, so as to realize the safe signaling receiving and sending function and also can be used for receiving and sending signals simultaneously;
after the terminal B sends a Ring Signal Signal to the signaling server, the signaling server sets the connection attribute of the customerB in the file session1 as WebSocket;
and the terminal A and the terminal B respectively send signaling to a signaling server through an Http interface and a WebSocket interface, and then convert the signaling to a Common interface (Common API) to perform Function processing (Function).
In some embodiments, the first controller, in response to the first video communication signaling, feeds back the second video communication signaling in the signaling interaction process, and specifically includes: responding to the first video communication signaling, and sending a second video communication signaling to the first display equipment in a first protocol communication mode; and/or sending the second video communication signaling to the second display device in a second protocol communication mode in response to the first video communication signaling containing the communication state of the first display device.
For example, the first controller sends the second video communication signaling to the first display device in an Http communication manner in response to the first video communication signaling, where the second video communication signaling is Http signaling; or responding to the first video communication signaling containing the communication state of the first display device, and sending the second video communication signaling to the second display device in a WebSocket communication mode, wherein the second video communication signaling is the WebSocket signaling.
For another example, the signaling server only needs to return response as the second video communication signaling for the Http request sent by the terminal a, that is, the first video communication signaling; however, for a video call in which a WebSocket protocol signaling terminal participates, the first controller needs to add broadcast communication.
In some embodiments, the first controller, in response to the first video communication signaling including the communication status of the first display device, sends the second video communication signaling to the second display device in a second protocol communication manner, specifically including: and the first controller responds to a first video communication signaling containing information of answering, hanging up or switching on and off the camera of the first display equipment and sends a second video communication signaling to the second display equipment in a second protocol communication mode.
For example, the first controller responds to a first video communication signaling containing information of answering or hanging up or switching on and off a camera of the first display device, and sends the second video communication signaling to the second display device in a WebSocket communication mode.
For another example, the first video communication signaling triggers the first controller of the signaling server to perform broadcast communication, which includes whether the current call has a change of state, such as an end user answering, hanging up, turning on or off a camera, and the like.
The first controller acquires information of terminals customerA and customerB participating in the video call from a file session1, wherein the connection attribute of the customerA is that Http does not need to broadcast, and the connection attribute of the customerB is that WebSocket needs to broadcast;
the first controller then writes second video communication signaling (body) generated based on the first video communication signaling containing the communication status, and/or the communication content transmitted by the display device into a write channel (write channel), and the signaling server sequentially transmits the second video communication signaling (body) to the terminal B in the order of the write channel. And sending a return result response corresponding to the WebSocket request by writing the return result response into the write channel.
The present application also provides a display device including a second controller configured to: sending a first video communication signaling containing a call request to a server, wherein the first video communication signaling is used for enabling the server to generate a second video communication signaling used for feeding back information in a signaling interaction process according to the first protocol format call request and/or a second protocol format call request contained in the call request; receiving a second video communication signaling which is sent by the server and contains a first protocol format access address and a second protocol format access address; and establishing communication connection with opposite-end display equipment according to the access address contained in the second video communication signaling.
For example, the display device sends a first video communication signaling containing a communication state and/or communication content to the server, the first video communication signaling sent by the display device to the server is used for enabling the server to generate a second video communication signaling used for feeding back information in a video call signaling interaction process according to the communication state and/or the communication content, and the second video communication signaling comprises the communication state and the communication content of the display device participating in the video call.
In some embodiments, second video communication signaling sent by the server and comprising the first protocol format access address and the second protocol format access address is received.
In some embodiments, the display device receives a second video communication signaling sent by the server, where when the first video communication signaling is an Http signaling, the second video communication signaling includes the Http signaling; or when the first video communication signaling is Websocket signaling, the second video communication signaling comprises Websocket signaling.
In some embodiments, the display device of the video call peer receives a second video communication signaling sent by the server, where when the first video communication signaling is an Http signaling, the second video communication signaling includes an Http protocol format access address and a WebSocket protocol format access address, and the display device of the peer participating in the video call selects a corresponding intervention address according to a protocol format supported by the display device to access the video call.
For example, after the first controller of the signaling server processes the WebSocket signaling sent to the terminal B, it is also required to check whether there are other WebSocket version terminals in the video call while updating the cache. Namely, if a terminal C performs a video call, the terminal C also supports a WebSocket protocol signaling terminal, and the first controller also needs to perform broadcast communication on the terminal C; if the terminal C supports Http protocol signaling, the second controller and the first controller of the server still obtain the latest call state by means of periodic request.
Fig. 9 is a timing diagram illustrating a server and a display device processing compatible signaling according to an embodiment of the present application.
In some embodiments, the first display device may be implemented as terminal a in the figure, which supports Http signaling; the second display device may be implemented as a terminal B, which supports WebSocket signaling; the server may be implemented as a signaling server.
A terminal A initiates a video call, a signaling server receives a request of the terminal A and then sends a push message containing a WebSocket connection address and an http request address to a called terminal B, and the request of the terminal A returns to obtain the address; after the terminal A and the terminal B obtain the connection addresses, the http communication mode or the WebSocket communication mode can be selected for video call according to the self-supporting type.
The terminal A periodically sends an http request containing a Ring signal, namely a first video communication signaling, for example, at a frequency of 1 time per second for ringing, and waits for the terminal B to answer; the terminal B supports WebSocket protocol signaling and needs to establish WebSocket connection, and the connection is long connection and can realize full duplex communication.
After the terminal B establishes connection, sending a second video communication signaling containing Ring Signal signals to a signaling server, and binding and caching the signaling server, the terminal B and the connection; when the communication state of the terminal B is not changed, the signaling does not need to be periodically sent to the server, and the signaling interaction is not needed.
When receiving the call, the terminal B sends a first video communication signaling containing a Receive Signal to a signaling server; a calling terminal A acquires the communication state of a terminal B through a first video communication signaling feedback signaling, namely a second video communication signaling, which periodically contains a Ring signal; after the terminal a successfully receives the call, the terminal a periodically sends, for example, 1 time per second, an http request including Talking information, that is, a first video communication signaling, to the signaling server to maintain a call state, and acquires latest information, where the latest information includes a communication state and communication content of the display device participating in the video call.
When the terminal B closes the camera, sending a first video communication signaling containing a Signal for closing the camera to the signaling server, and the terminal A obtaining the communication state of the terminal B closing the camera through a feedback second video communication signaling of the first video communication signaling containing a periodical Signal.
When the camera is closed by the terminal A, a request containing a Talking signal, namely a first video communication signaling is sent to the signaling server, the signaling server obtains a WebSocket connection address of the terminal B through the cache, and the request of the terminal A is broadcasted, so that the terminal B receives the current communication state of the terminal A through a second video communication signaling.
The terminal A sends a request containing a Bye signal, namely a first video communication signaling to the signaling server to end the current call, and the signaling server also acquires the connection of the terminal B and synchronizes the call state of the current terminal A through broadcast communication.
In some embodiments, the display device displays call information of all users in the multi-party call in response to initiation or joining of the multi-party call, the call information of different users corresponding to different display areas in the multi-party call display interface.
The display device responds to the initiation of the multi-party call, namely, the display device responds to a call invitation which is triggered by a user and faces at least one other user, and the multi-party call between the user and the other user is formed. Illustratively, the user 1 sends a call invitation to the user 2 and the user 3 respectively by triggering the display device running in the smart device 1 to form a multi-party call between the users 1-3. It should be noted that the multiparty call between different users is realized through the communication connection between the display device where the user is located and the server.
It should be noted that the call invitation triggered by the user is not limited to the initial initiation of the multi-party call, but may also be an extension to the user already participating in the multi-party call. For example, in the multi-party call formed above, each user may also continue to initiate a call invitation to another user (for example, users 4 and 5), so that users 4 and 5 are newly added to the multi-party call.
The display device responding to the joining of the multi-party call means that the display device responds to the call joining triggered by the user after receiving the call invitation initiated by other display devices to join the multi-party call between the user and the user of the other display devices. That is, the initiation of the multi-party call responded by the display device corresponds to the call invitation actively initiated by the display device, and the joining of the multi-party call responded corresponds to the answering of the call invitation initiated by other users.
Therefore, for different display devices, by responding to the initiation or joining of the multi-party call, the multi-party call between different users corresponding to the display devices is formed.
The call information of all users in the multi-party call corresponds to the call state of the user in the multi-party call, and when the call information corresponding to the user is displayed in the multi-party call display interface, the user is shown as one of the members in the multi-party call. It should be noted that the multi-party call display interface refers to an interface display of the display device for the multi-party call.
The call information corresponding to the user may also be different corresponding to different multi-party call modes. Illustratively, in a multi-party voice call, call information corresponding to a user is a head portrait of the user;
in some embodiments, when a call termination action triggered in the display area is monitored, a call termination request facing a user corresponding to the display area is sent to the server.
The call termination action is a trigger action set by the display device for executing call termination of the user corresponding to the display area, for example, the call termination action may be double-clicking, long-pressing, or dragging the display area, and is not limited here. Therefore, when the display device monitors the call termination action triggered in the display area, the target user needing to execute call termination can be acquired.
As mentioned above, the server is a hub for implementing multi-party call, and multi-party calls between different display devices need to depend on multi-party call connections established by the server. In the multi-party call connection established by the server, each display device establishes call connection with the server respectively, and call acquisition of each user in the multi-party call is realized by the display device through transfer transmission of the call flow by the server.
Therefore, after monitoring the call termination action triggered in the display area, the display device needs to send a call termination request to the server for a target user who needs to perform call termination, so as to request the server to kick the target user out of the multi-party call.
In some embodiments, the server responds to the call termination request according to the call authority of the display device itself and the call states of other display devices.
The communication authority of the display device corresponds to the communication authority of the user where the display device is located. As mentioned above, the call permission of the user of the display device at least includes at least one of a call invitation permission, a call joining permission, and a call termination permission, where the call termination permission refers to a permission that the user of the display device can control to terminate the call connection of some or all users in the multi-party call.
The call state of the other display device means whether the user of the other display device answers the multi-party call invitation. For the server, in the established multi-party call connection, each display device needs to periodically return call state information to the server according to a preset protocol, so that the server can master the call state of the display device in real time. Illustratively, the server is a signaling server, the display device is in a Ring state when not answering the multi-party call invitation, and periodically returns a signaling message "Meeting Ring" to the server; the display device is in an answering state when the multiparty call invitation is answered, and periodically returns a signaling message 'Meeting Talking' to the server.
Based on the above explanation of the server for implementing the video call compatibility of the display device with different protocol signaling schemes, the present application further provides a display device, including a second controller configured to: and sending a first video communication signaling containing a communication state and/or communication content to a server, wherein the first video communication signaling is used for enabling the server to generate a second video communication signaling used for feeding back information in a video call signaling interaction process according to the communication state and/or the communication content, and the second video communication signaling comprises the communication state and the communication content of a display device participating in the video call. Receiving a second video communication signaling sent by the server; when the first video communication signaling is Http signaling, the second video communication signaling is Http signaling; or when the first video communication signaling is Websocket signaling, the second video communication signaling is Websocket signaling. The specific operation method and steps for the video call of the display device to be compatible with different protocol signaling schemes are described in detail in the above implementation scheme of the server, and are not described again here.
Based on the above description of the scheme for realizing the compatibility of the video call of the display device with the signaling of different protocols, the present application also provides a method for realizing the compatibility of the video call of the server side with the signaling of different protocols, the method includes: receiving a first video communication signaling sent by a display device, wherein the first video communication signaling comprises an Http signaling from a first display device or a WebSocket signaling from a second display device, and the first video communication signaling is used for establishing communication connection and interacting communication content between the first display device and the second display device; and responding to the first video communication signaling, and generating a second video communication signaling for feeding back information in the video call signaling interaction process, wherein the second video communication signaling comprises the communication states and the communication contents of the first display equipment and the second display equipment. The specific operation method and steps for implementing the video call compatible with different protocol signaling schemes have been described in detail above for the server implementation scheme, and are not described herein again.
In some embodiments, receiving an Http signaling sent by a first display device or a WebSocket signaling sent by a second display device specifically includes: receiving an Http signaling sent by a first display device to an Http interface; or receiving a WebSocket signaling sent to the WebSocket interface by the second display device. The specific operation method and steps for implementing the video call compatible with different protocol signaling schemes have been described in detail above for the server implementation scheme, and are not described herein again.
In some embodiments, in response to the first video communication signaling, sending a second video communication signaling to the display device in a video call signaling interaction process, specifically including: responding to the first video communication signaling, and sending the second video communication signaling to the first display device in an Http communication manner, wherein the second video communication signaling is Http signaling; or responding to the first video communication signaling containing the communication state of the first display device, and sending the second video communication signaling to the second display device in a WebSocket communication mode, wherein the second video communication signaling is the WebSocket signaling. The specific operation method and steps for implementing the video call compatible with different protocol signaling schemes have been described in detail above for the server implementation scheme, and are not described herein again.
In some embodiments, in response to the first video communication signaling that includes the communication state of the first display device, sending the second video communication signaling to the second display device in a WebSocket communication manner specifically includes: and responding to a first video communication signaling containing information of answering, hanging up or switching on and off a camera of the first display equipment, and sending the second video communication signaling to the second display equipment in a WebSocket communication mode. The specific operation method and steps for implementing the video call compatible with different protocol signaling schemes have been described in detail above for the server implementation scheme, and are not described herein again.
Based on the above description of the scheme for realizing the compatibility of the video call of the display device with the signaling of the different protocols, the application also provides a method for realizing the compatibility of the video call with the signaling of the different protocols, which comprises the step of sending a first video communication signaling containing a communication state and/or communication content to a server, wherein the first video communication signaling is used for enabling the server to generate a second video communication signaling for feeding back information in the video call signaling interaction process according to the communication state and/or the communication content, and the second video communication signaling comprises the communication state and the communication content participating in the video call display device. Receiving a second video communication signaling sent by the server; when the first video communication signaling is Http signaling, the second video communication signaling is Http signaling; or when the first video communication signaling is WebSocket signaling, the second video communication signaling is WebSocket signaling. The specific operation method and steps for the video call compatible with different protocol signaling schemes have been described in detail in the above implementation schemes of the server and the display device, and are not described again here.
The method and the device have the advantages that the server can be compatible with different protocol signaling by constructing the universal interface; further, the server can acquire the signaling by constructing a first video communication signaling; further, by constructing a second video communication signaling, the server can feed back the second video communication signaling according to the first video communication signaling, so that interaction of opposite-end display equipment and the server in the video call process is realized, the communication state of the video call participation terminal is obtained in real time, and the establishment of video call connection of signaling display equipment with different protocol formats is realized.
Moreover, those skilled in the art will appreciate that aspects of the present application may be illustrated and described in terms of several patentable species or situations, including any new and useful combination of processes, machines, manufacture, or materials, or any new and useful improvement thereof. Accordingly, various aspects of the present application may be embodied entirely in hardware, entirely in software (including firmware, resident software, micro-code, etc.) or in a combination of hardware and software. The above hardware or software may be referred to as "data blocks", "controllers", "engines", "units", "components", or "systems". Furthermore, aspects of the present application may be represented as a computer product, including computer readable program code, embodied in one or more computer readable media.
The computer storage medium may comprise a propagated data signal with the computer program code embodied therewith, for example, on baseband or as part of a carrier wave. The propagated signal may take any of a variety of forms, including electromagnetic, optical, etc., or any suitable combination. A computer storage medium may be any computer-readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code located on a computer storage medium may be propagated over any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or any combination of the preceding.
Computer program code required for operation of various portions of the present application may be written in any one or more programming languages, including an object oriented programming language such as Java, scala, smalltalk, eiffel, JADE, emerald, C + +, C #, VB.NET, python, and the like, a conventional programming language such as C, visual Basic, fortran 2003, perl, COBOL 2002, PHP, ABAP, a dynamic programming language such as Python, ruby, and Groovy, or other programming languages, and the like. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any network format, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet), or in a cloud computing environment, or as a service, such as a software as a service (SaaS).
Additionally, the order in which elements and sequences of the processes described herein are processed, the use of alphanumeric characters, or the use of other designations, is not intended to limit the order of the processes and methods described herein, unless explicitly claimed. While certain presently contemplated useful embodiments of the invention have been discussed in the foregoing disclosure by way of various examples, it is to be understood that such detail is solely for that purpose and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements that are within the spirit and scope of the embodiments of the disclosure. For example, although the system components described above may be implemented by hardware devices, they may also be implemented by software-only solutions, such as installing the described system on an existing server or mobile device.
Similarly, it should be noted that in the preceding description of embodiments of the application, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the embodiments. This method of disclosure, however, is not intended to imply that more features are required than are expressly recited in the claims. Indeed, the embodiments may be characterized as having less than all of the features of a single embodiment disclosed above.
The entire contents of each patent, patent application publication, and other material cited in this application, such as articles, books, specifications, publications, documents, and the like, are hereby incorporated by reference into this application. Except where the application is filed in a manner inconsistent or contrary to the present disclosure, and except where the claim is filed in its broadest scope (whether present or later appended to the application) as well. It is noted that the descriptions, definitions and/or use of terms in this application shall control if they are inconsistent or contrary to the statements and/or uses of the present application in the material attached to this application.

Claims (10)

1. A server, comprising:
the universal interface receives a video communication signaling sent by display equipment, wherein the video communication signaling comprises a call request, and the video communication signaling is used for establishing communication connection between the first display equipment and the second display equipment;
a first controller coupled to the generic interface and configured to:
receiving a first video communication signaling which is sent by first display equipment and contains a first protocol format call request;
responding to the first video communication signaling, and generating a second video communication signaling used for feeding back information in a signaling interaction process, wherein the second video communication signaling comprises a first protocol format access address and a second protocol format access address;
sending the second video communication signaling to a second display device, wherein the second video communication signaling is used for enabling the second display device to select a proper protocol format access address according to a required protocol format to establish video call connection with the first display device; the second display device is a display device which is subjected to software upgrading or not subjected to software upgrading.
2. The server according to claim 1, wherein the universal interface receives video communication signaling from a display device, and specifically comprises the universal interface:
and receiving a first protocol format call request sent by the first display device to the first protocol interface of the server.
3. The server according to claim 2, wherein the first controller, in response to the first video communication signaling, feeds back the second video communication signaling in a signaling interaction process, and specifically comprises the first controller:
and responding to the first video communication signaling containing the communication state of the first display equipment, and sending the second video communication signaling to the second display equipment.
4. The server according to claim 3, wherein the first controller, in response to the first video communication signaling including the communication status of the first display device, sends the second video communication signaling to the second display device, specifically comprising:
and the first controller responds to a first video communication signaling containing information of answering, hanging up or switching on and off the camera of the first display equipment and sends a second video communication signaling to the second display equipment.
5. A display device, comprising:
a second controller configured to:
sending a first video communication signaling containing a first protocol format call request to a server, wherein the first video communication signaling is used for enabling the server to generate a second video communication signaling used for feeding back information to receiving end display equipment in a signaling interaction process according to the first video communication signaling, the second video communication signaling comprises a first protocol format access address and a second protocol format access address, and the second video communication signaling is used for enabling the receiving end display equipment to select a proper protocol format access address according to a required protocol format to establish video call connection with initiating end display equipment;
or
Receiving a second video communication signaling which is sent by the server and contains a first protocol format access address and a second protocol format access address; according to the required protocol format, selecting an access address with a proper protocol format contained in the second video communication signaling to establish communication connection with the initiating terminal display equipment;
the receiving end display equipment is display equipment which is subjected to software upgrading or not subjected to software upgrading.
6. A method for video telephony compatible with different protocol signaling, the method comprising:
receiving a first video communication signaling containing a first protocol format call request sent by first display equipment, wherein the first video communication signaling comprises the call request, and the first video communication signaling is used for establishing communication connection between the first display equipment and second display equipment, and the second display equipment is the display equipment with or without software upgrading;
responding to the first video communication signaling, and generating a second video communication signaling used for feeding back information in a signaling interaction process, wherein the second video communication signaling comprises a first protocol format access address and a second protocol format access address;
and sending the second video communication signaling to second display equipment, wherein the second video communication signaling is used for enabling the second display equipment to select a proper protocol format access address according to a required protocol format to establish video call connection with the first display equipment.
7. The method of claim 6, wherein receiving the first video communication signaling from the first display device comprises:
and receiving a first protocol format call request sent by the first display equipment to the first protocol interface.
8. The method according to claim 7, wherein the video call is compatible with different protocol signaling, and the feeding back the second video communication signaling in the signaling interaction process in response to the first video communication signaling specifically comprises:
and responding to the first video communication signaling containing the communication state of the first display equipment, and sending the second video communication signaling to the second display equipment.
9. The method according to claim 8, wherein sending the second video communication signaling to a second display device in response to the first video communication signaling including a communication status of the first display device, comprises:
and responding to a first video communication signaling containing information of answering, hanging up or switching on and off the camera of the first display equipment, and sending a second video communication signaling to the second display equipment.
10. A method for video telephony compatible with signaling of different protocols, the method comprising:
sending a first video communication signaling containing a first protocol format call request to a server, wherein the first video communication signaling is used for enabling the server to generate a second video communication signaling used for feeding back information to a receiving end display device in a signaling interaction process according to the first video communication signaling, the second video communication signaling comprises a first protocol format access address and a second protocol format access address, and the second video communication signaling is used for enabling the receiving end display device to select a proper protocol format access address according to a required protocol format to establish video call connection with an initiating end display device;
or
Receiving a second video communication signaling which is sent by the server and contains a first protocol format access address and a second protocol format access address; according to the required protocol format, selecting an access address with a proper protocol format contained in the second video communication signaling to establish communication connection with the initiating terminal display equipment;
the receiving end display device is a display device which is subjected to software upgrading or not subjected to software upgrading.
CN202011324820.8A 2020-11-23 2020-11-23 Display device, server and method for video call to be compatible with different protocol signaling Active CN112601042B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011324820.8A CN112601042B (en) 2020-11-23 2020-11-23 Display device, server and method for video call to be compatible with different protocol signaling

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011324820.8A CN112601042B (en) 2020-11-23 2020-11-23 Display device, server and method for video call to be compatible with different protocol signaling

Publications (2)

Publication Number Publication Date
CN112601042A CN112601042A (en) 2021-04-02
CN112601042B true CN112601042B (en) 2022-12-09

Family

ID=75184267

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011324820.8A Active CN112601042B (en) 2020-11-23 2020-11-23 Display device, server and method for video call to be compatible with different protocol signaling

Country Status (1)

Country Link
CN (1) CN112601042B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113691531B (en) * 2021-08-24 2023-08-01 深圳市思迪信息技术股份有限公司 WebSocket protocol-based data transmission method, system, equipment and storage medium
CN113993093B (en) * 2021-12-24 2022-03-18 嘉兴域途科技有限公司 Bidirectional calling multi-terminal remote video communication method and system under 4G/5G condition

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101854380A (en) * 2010-04-15 2010-10-06 深圳创维-Rgb电子有限公司 Method for realizing cross-platform point-to-point (P2P) video chat

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10448068B2 (en) * 2015-01-19 2019-10-15 Samsung Electronics Co., Ltd. Method and apparatus for transmitting and receiving signaling information associated with multimedia content
KR20170086869A (en) * 2016-01-19 2017-07-27 삼성전자주식회사 Method and apparatus for transmitting video during voice call

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101854380A (en) * 2010-04-15 2010-10-06 深圳创维-Rgb电子有限公司 Method for realizing cross-platform point-to-point (P2P) video chat

Also Published As

Publication number Publication date
CN112601042A (en) 2021-04-02

Similar Documents

Publication Publication Date Title
CN112653897B (en) Display device, server and control method of online live course
CN114339332B (en) Mobile terminal, display device and cross-network screen projection method
CN112601042B (en) Display device, server and method for video call to be compatible with different protocol signaling
CN114302201B (en) Method for automatically switching on and off screen in sound box mode, intelligent terminal and display device
CN113507638A (en) Display device and screen projection method
CN112601124A (en) Mobile terminal, server, display device and control method for remote timing shutdown
CN114296670A (en) Display equipment and control method for multi-equipment screen projection on same screen display
CN115776585A (en) Display device and content presentation method
CN112911380B (en) Display device and connection method with Bluetooth device
CN112463750B (en) File synchronization method and display device
CN114286137A (en) Mirror image screen projection method, display device and terminal
CN113794914A (en) Display device and startup navigation configuration method
CN113542852B (en) Display device and control method for fast pairing with external device
CN115022688A (en) Display device and media data relay method
CN112363683B (en) Method and display device for supporting multi-layer display by webpage application
CN112653608B (en) Display device, mobile terminal and cross-network data transmission method
CN114302101A (en) Display apparatus and data sharing method
CN111782606A (en) Display device, server, and file management method
CN113490013B (en) Server and data request method
CN112199612B (en) Bookmark adding and combining method and display equipment
CN112887769B (en) Display equipment
CN112835633B (en) Display device and control method of display language
CN113038221B (en) Double-channel video playing method and display equipment
CN112231088B (en) Browser process optimization method and display device
CN112929724B (en) Display device, set top box and far-field pickup awakening control method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant