WO2017020671A1 - Video interaction method and apparatus, and video source device - Google Patents

Video interaction method and apparatus, and video source device Download PDF

Info

Publication number
WO2017020671A1
WO2017020671A1 PCT/CN2016/088000 CN2016088000W WO2017020671A1 WO 2017020671 A1 WO2017020671 A1 WO 2017020671A1 CN 2016088000 W CN2016088000 W CN 2016088000W WO 2017020671 A1 WO2017020671 A1 WO 2017020671A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
terminal
source device
interaction
video source
Prior art date
Application number
PCT/CN2016/088000
Other languages
French (fr)
Chinese (zh)
Inventor
王达峰
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Publication of WO2017020671A1 publication Critical patent/WO2017020671A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home

Definitions

  • the present application relates to the field of Internet of Things application technologies, and in particular, to a video interaction method, device, and video source device.
  • video interaction can be performed between two users through a device with a camera and a display screen.
  • smart phone A and smart phone B simultaneously access the network, and user a initiates video to user b through smart phone A.
  • the interactive request after the user b clicks and accepts in the smart phone B, the smart phone A and the smart phone B respectively collect the video image through the built-in camera and send it to the other party, and simultaneously receive and display the video image sent by the other party in the display screen.
  • two devices performing video interaction need to have a network interface, a camera, and a display screen at the same time, which have high requirements on the device and limit the application scenario of video interaction.
  • the embodiment of the present application provides a video interaction method and device. And video source devices.
  • the technical solution is as follows:
  • a video interaction method for a video source device including a camera, the method comprising:
  • the video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
  • a video source device where the video source device includes a camera, and the video source device includes:
  • One or more processors are One or more processors.
  • the memory stores one or more programs, the one or more programs being configured to be executed by the one or more processors, the one or more programs including instructions for:
  • the video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
  • a video interaction device for use in a video source device including a camera, the device comprising:
  • An instruction receiving module configured to receive an instruction for performing video interaction with at least one terminal
  • a video capture module configured to collect, by using the camera, a video image of the video source device side
  • a video sending module configured to send, by using a video interaction channel between the at least one terminal, a video image of the video source device side to the at least one terminal;
  • the video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
  • the video source device with the camera establishes a video interactive connection with the at least one terminal, and sends the video image of the video source device side to the at least one terminal, thereby expanding the use scenario of the video interaction.
  • FIG. 1 is an implementation environment diagram involved in a video interaction method provided by some embodiments of the present application.
  • FIG. 2 is a block diagram showing the structure of an electronic device according to an embodiment of the present application.
  • FIG. 3 is a flowchart of a video interaction method provided by an embodiment of the present application.
  • FIG. 4 is a flowchart of a video interaction method according to another embodiment of the present application.
  • FIG. 5 is a flowchart of a video interaction method according to another embodiment of the present application.
  • FIG. 6 is a structural diagram of a device of a video interaction apparatus according to an embodiment of the present application.
  • FIG. 7 is a structural diagram of a device of a video interaction apparatus according to another embodiment of the present application.
  • FIG. 1 illustrates an implementation environment diagram involved in a video interaction method provided by some embodiments of the present application.
  • the implementation environment shown in FIG. 1 includes a video source device 110, a playback device 120, at least one terminal 130, and a cloud server 140.
  • the video source device 110 may be a home device without a display screen such as a television set top box, wherein the video source device 110 has built-in or externally connected at least one camera.
  • the playback device 120 can be a home device with a display such as a television or display.
  • the terminal 130 may be a device that has network access, video capture, and video playback functions, and can independently implement video interaction, such as a smart phone, a tablet computer, and an e-book reader.
  • the terminal 130 may be another video source device, which may Connect to another playback device for video playback.
  • the cloud server 140 can be a server, or it can be a service cluster composed of several servers, or it can be a cloud computing center.
  • the video source device 110 and the playback device 120 are connected by a wired or wireless network.
  • the video source device 110 and the at least one terminal 130 and the cloud server 140 are respectively wired or wirelessly The network is connected.
  • FIG. 2 is a structural block diagram of an electronic device according to an embodiment of the present disclosure.
  • the electronic device in the embodiment of the present disclosure may include one or more components for executing computer program instructions to complete various Process and method processor for information and storage program instructions random access memory (RAM) and read only memory (ROM), memory for storing data and information, I/O devices, interfaces, antennas, and the like.
  • RAM random access memory
  • ROM read only memory
  • the electronic device 200 may include an RF (Radio Frequency) circuit 210, a memory 220, an input unit 230, a sensor 250, a WiFi (wireless fidelity) module 270, a processor 280, a power source 282, a camera 290, and the like.
  • RF Radio Frequency
  • FIG. 2 does not constitute a limitation to the electronic device, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements.
  • the RF circuit 210 can be used for transmitting and receiving information or during a call, and receiving and transmitting the signal. Specifically, after receiving the downlink information of the base station, the processor 280 processes the data. In addition, the uplink data is designed to be sent to the base station.
  • RF circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like.
  • RF circuitry 210 can also communicate with the network and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access). , Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.
  • the memory 220 can be used to store software programs and modules, and the processor 280 executes various functional applications and data processing of the electronic device 200 by running software programs and modules stored in the memory 220.
  • the memory 220 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the electronic device 200 (such as audio data, phone book, etc.), and the like.
  • the memory 220 may include a high speed random access memory.
  • Non-volatile memory may also be included, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the input unit 230 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the electronic device 200.
  • the input unit 230 may include a touch panel 231 and other input devices 232.
  • the touch panel 231 also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 231 or near the touch panel 231. Operation), and drive the corresponding connecting device according to a preset program.
  • the touch panel 231 can include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 280 is provided and can receive commands from the processor 280 and execute them.
  • the touch panel 231 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 230 may also include other input devices 232.
  • other input devices 232 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • the electronic device 200 may also include at least one type of sensor 250, such as a gyro sensor, a magnetic induction sensor, a light sensor, a motion sensor, and other sensors.
  • the light sensor can include an ambient light sensor and a proximity sensor.
  • the acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the posture of electronic devices (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the electronic device 200 can also be configured with barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer repeat .
  • WiFi is a short-range wireless transmission technology
  • the electronic device 200 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 270, which provides wireless broadband Internet access for users.
  • FIG. 2 shows the WiFi module 270, it can be understood that it does not belong to the essential configuration of the electronic device 200, and may be omitted as needed within the scope of not changing the essence of the disclosure.
  • the processor 280 is a control center of the electronic device 200 that connects various portions of the entire electronic device using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 220, and recalling stored in the memory 220. Data, performing various functions and functions of the electronic device 200 Data is monitored to provide overall monitoring of electronic devices.
  • the processor 280 may include one or more processing units; preferably, the processor 280 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like.
  • the modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 280.
  • the electronic device 200 also includes a power source 282 (such as a battery) that supplies power to the various components.
  • a power source 282 such as a battery
  • the power source can be logically coupled to the processor 280 through a power management system to manage functions such as charging, discharging, and power management through the power management system. .
  • the camera 290 is generally composed of a lens, an image sensor, an interface, a digital signal processor, a CPU, a display screen, and the like.
  • the lens is fixed above the image sensor, and the focus can be changed by manually adjusting the lens;
  • the image sensor is equivalent to the "film" of the conventional camera, and is the heart of the image captured by the camera;
  • the interface is used to connect the camera with the cable and the board to the board.
  • the device is connected to the electronic device motherboard to send the acquired image to the memory 220.
  • the digital signal processor processes the acquired image through mathematical operations, converts the collected analog image into a digital image and sends the image through the interface. To the memory 220.
  • the electronic device 200 may further include a Bluetooth module or the like, and details are not described herein again.
  • the electronic device 200 includes, in addition to the one or more processors 280, a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors to The video interaction method shown in various embodiments of the present application is implemented.
  • the electronic device 200 can be implemented as the video source device 110 in the implementation environment shown in FIG. 1 above.
  • FIG. 3 is a flowchart of a video interaction method provided by an embodiment of the present application.
  • the video interaction method can be applied to an electronic device including a camera, such as the video source device 110 shown in FIG.
  • the video interaction method can include the following steps:
  • Step 301 Receive an instruction for performing video interaction with at least one terminal.
  • Step 302 Establish a video interaction channel with each of the at least one terminal.
  • Step 303 Collect a video image of the video source device side by using a camera.
  • Step 304 Send the video image of the video source device side to at least one terminal by using a video interaction channel with each of the at least one terminal.
  • the video source device is a device for providing a video picture played in a display screen of the playback device, and the playback device is independent of the video source device.
  • the video interaction method receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal.
  • the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
  • FIG. 4 is a flowchart of a video interaction method provided by another embodiment of the present application.
  • the video interaction method can be applied to an electronic device including a camera, such as the video source device 110 shown in FIG.
  • the video interaction method can include the following steps:
  • Step 401 Project a terminal list in a display screen of the playback device, where the terminal list includes identifiers of the terminals bound to the video source device.
  • the video source device is a device for providing a video picture played in a display screen of the playback device, and the playback device is independent of the video source device.
  • the video source device in the implementation environment shown in FIG. 1 is a TV set top box, and the playback device is a television set or a display.
  • the TV set-top box After the TV set-top box is connected to the TV or the display and turned on, the TV set-top box calls the built-in UI (User Interface) application through the SDK (Software Development Kit) to project on the display of the TV or the display.
  • the main interface wherein the user can establish a binding relationship between the set top box and the plurality of smart phones through the remote controller of the set top box of the television set, and can also initiate a video interaction with the bound smart phone through the remote controller.
  • the binding relationship between the set top box and the smart phone may be established by establishing a binding relationship between the two user accounts.
  • the user may open a pre-installed, specified video interactive application in the set top box through the remote controller.
  • the TV set-top box sends a binding request to the cloud server, and the cloud server sends
  • the second account is used to log in to the smart phone of the video interaction application to send a binding reminder.
  • the cloud server binds the first account and the second account successfully, and the binding relationship is also saved in the cloud server. in.
  • the second account can also be corresponding to another set-top box.
  • the cloud server sends a binding reminder to another set-top box that uses the second account to log in to the video interactive application
  • another set-top box can be tied. The reminder is projected into the display of the corresponding television or display so that the user corresponding to the other set top box can accept or reject the binding through the remote control.
  • the set-top box After the user sends an instruction for video interaction with the smart phone through the remote controller, the set-top box acquires a list of other accounts bound to the first account from the cloud server, and projects the list including the list on the display screen of the television or the display.
  • the selection interface where the other accounts bound to the first account are the identifiers of the terminals bound to the video source device.
  • the above list may include a nickname or a note name of each other account in addition to other accounts bound to the first account, so that the user can distinguish.
  • Step 402 Receive a selection operation performed in the terminal list, the selection operation being an operation performed on the identifier of the at least one terminal.
  • the one or more accounts may be selected in the selection interface by using a remote controller.
  • the set-top box of the television receives the one or more The instruction of the video interaction of the smartphone corresponding to the account.
  • Step 403 Establish a video interaction channel with each of the at least one terminal.
  • the cloud server After the TV set-top box receives the instruction for the video interaction with the smart phone corresponding to the one or more accounts, the cloud server sends a video interaction request to the smart phone corresponding to the one or more accounts, and the cloud server sends the video interaction request to the one or more accounts.
  • the corresponding smart phone sends a video interaction reminder.
  • the cloud server establishes a video interaction channel between the TV set top box and the smart phone corresponding to the one or more accounts.
  • Step 404 Receive, by using a video interaction channel with each of the at least one terminal, a video image of the at least one terminal side, where the video image of the at least one terminal side is sent by the at least one terminal.
  • the video interaction channel between the video source device and the at least one terminal is a channel that is relayed by the cloud server.
  • the terminal When the video source device receives the video image on the terminal side, the terminal first passes between the terminal and the cloud server.
  • the video interaction channel sends the video image of the terminal side to the cloud server, and the cloud server pushes the video image of the terminal side to the video source device through a video interaction channel between the cloud server and the video source device.
  • Step 405 Project the video image of the at least one terminal side into a display screen of the playback device, the playback device being independent of the video source device.
  • the video image of the at least one terminal side is projected into the display screen of the playback device, including: according to the number of the two or more terminals, and Video interaction between the video source device and each of the two or more terminals The order of establishing the tracks, determining the relative positions of the video images of the two or more terminal sides; and according to the relative positions of the video images of the two or more terminal sides, the two or more terminal sides
  • the video image is projected in the display.
  • the set-top box can determine each smart phone side according to the total number of smart phones currently undergoing video interaction and the order in which the video interactive channels are established.
  • the relative positions of the video images, and the video images of the respective smartphone sides are projected onto the display screen of the television or the display according to the determined relative position.
  • the TV set top box currently performs video interaction with two smart phones (smartphone A and smart phone B respectively), and the set top box first establishes a video interaction channel with the smart phone A, and then establishes an interactive channel with the smart phone B.
  • the TV set top box determines two image display positions according to the number of interactive smart phones, respectively located in the upper left corner and the upper right corner of the display screen, and determines the image display position in the upper left corner to first establish the relative position corresponding to the video interactive channel, and
  • the image display position in the upper left corner is determined as the relative position corresponding to the video interactive channel, that is, the video image on the side of the smartphone A is displayed in the upper left corner of the display screen, and the video image on the side of the smart phone A is displayed in the upper right corner of the display screen.
  • the video source device may further receive a specified operation on a video image of each terminal side projected in a display screen of the playback device, and change according to the specified operation.
  • the user can also perform a specified operation on the video image of each smart phone side displayed on the display screen of the television or the display through the remote controller, for example, selecting a video image of any one of the smart phone sides, and magnifying the display area of the video image. Or zoom out, or select two video images on the smartphone side to swap the display areas of the video images on the two smartphones.
  • Step 406 Collect a video image of the video source device side by using the camera.
  • Step 407 Send the video image of the video source device side to the at least one terminal by using a video interaction channel with each of the at least one terminal.
  • the video source device when the video source device sends the video image on the video source device side to the terminal, the video source device sends the video image on the video source device side to the cloud server through the video interaction channel between the video source device and the cloud server.
  • the cloud server further pushes the video image of the video source device side to the terminal through a video interaction channel between the cloud server and the terminal.
  • the camera can also be equipped with a built-in camera.
  • the set-top box collects the local video image through the built-in camera and sends it to the ongoing video interaction.
  • the TV set-top box can also capture the local video image of the TV set-top box through the built-in camera and project it into a designated area in the display screen of the television or the display, and the designated area can be turned on or off by the remote controller.
  • steps 404-405 and steps 406-407 are two processes that are executed synchronously, and the execution order may be performed simultaneously without any order.
  • the video interaction method receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal.
  • the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
  • FIG. 5 is a flowchart of a video interaction method according to another embodiment of the present application.
  • the video interaction method can be applied to an electronic device including a camera, such as the video source device 110 shown in FIG.
  • the video interaction method can include the following steps:
  • Step 501 Receive a video interaction request sent by at least one terminal through a cloud server.
  • the at least one terminal is a terminal that is bound to the playback device.
  • the step of establishing a binding relationship between the terminal and the playback device refer to the description in step 401, and details are not described herein.
  • the user can select the set-top box in the video interactive application installed by the smart phone, and the smart phone sends a video interaction request to the cloud server.
  • the cloud server forwards the video interaction request to the set top box.
  • Step 502 Project interactive query information in a display screen of the playback device, and the interactive query information is used to query whether to accept video interaction with at least one terminal.
  • Step 503 Receive a confirmation operation performed based on the interactive inquiry information, the confirmation operation is an operation of confirming acceptance of a video interaction with at least one terminal.
  • the TV set-top box After the TV set-top box receives the video interaction request sent by the smartphone, on the TV or the display
  • the interactive display information is projected in the display screen to ask whether the user in front of the TV receives the video interaction. If the user in front of the TV selects and accepts through the remote control, the set-top box receives an instruction to perform video interaction with the smart phone.
  • Step 504 Establish a video interaction channel with each of the at least one terminal.
  • the set-top box After receiving the instruction for video interaction with the smart phone corresponding to one or more accounts, the set-top box sends a response to establish a video interaction to the cloud server, and the cloud server establishes the smart phone corresponding to the one or more accounts of the set-top box.
  • Step 505 Receive, by using a video interaction channel with each of the at least one terminal, a video image of the at least one terminal side that is sent by the at least one terminal, where the video image of the at least one terminal side is sent by the at least one terminal.
  • Step 506 Project the video image of the at least one terminal side into a display screen of the playback device, the playback device being independent of the video source device.
  • Step 507 Collect a video image of the video source device side by using the camera.
  • Step 508 Send the video image of the video source device side to the at least one terminal by using a video interaction channel with each of the at least one terminal.
  • steps 505-506 and steps 507-508 are two processes that are executed synchronously, and the execution order may be performed simultaneously without any order.
  • the video interaction method receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal.
  • the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
  • FIG. 6 is a structural diagram of a device of a video interaction apparatus according to an embodiment of the present application.
  • the video interaction device can be implemented as an electronic device that includes a camera, such as all or part of the video source device 110 in the implementation environment shown in FIG.
  • the video interaction device can include:
  • the establishing module 602 is configured to establish a video interaction channel with each of the at least one terminal;
  • a video capture module 603, configured to collect, by using the camera, a video image of the video source device side;
  • a video sending module 604 configured to send, by using a video interaction channel with each of the at least one terminal, a video image of the video source device side to the at least one terminal;
  • the video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
  • the video interaction apparatus receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal.
  • the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
  • FIG. 7 is a structural diagram of a device of a video interaction apparatus according to another embodiment of the present application.
  • the video interaction device can be implemented as an electronic device that includes a camera, such as all or part of the video source device 110 in the implementation environment shown in FIG.
  • the video interaction device can include:
  • the establishing module 602 is configured to establish a video interaction channel with each of the at least one terminal;
  • a video capture module 603, configured to collect, by using the camera, a video image of the video source device side;
  • a video sending module 604 configured to send, by using a video interaction channel with each of the at least one terminal, a video image of the video source device side to the at least one terminal;
  • the video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
  • the device further includes:
  • the video receiving module 605 is configured to receive, by the video interaction channel between the at least one terminal, the video image of the at least one terminal side that is sent by the at least one terminal;
  • the video projection module 606 is configured to project the video image of the at least one terminal side into a display screen of the playback device, the playback device being independent of the video source device.
  • the instruction receiving module 601 includes:
  • a list projection unit 601a configured to project a terminal list in a display screen of the playback device, where the terminal list includes an identifier of each terminal that is bound to the video source device;
  • the first operation receiving unit 601b is configured to receive a selection operation performed on the identifier of the at least one terminal performed in the terminal list.
  • the instruction receiving module 601 includes:
  • the request receiving unit 601c is configured to receive a video interaction request sent by the at least one terminal by using a cloud server;
  • the information projection unit 601d is configured to project interaction query information in a display screen of the playback device, where the interaction query information is used to query whether to accept video interaction with the at least one terminal;
  • the second operation receiving unit 601e is configured to receive, according to the interaction query information, confirm an operation of accepting video interaction with the at least one terminal.
  • the video projection module 606 includes:
  • the relative position determining unit 606a is configured to: when the at least one terminal includes two or more terminals, according to the number of the two or more terminals and the two or more terminals respectively The order in which the video interaction channels are established, determining the relative positions of the video images on the two or more terminal sides;
  • the video projection unit 606b is configured to project the video images of the two or more terminal sides in the display screen according to the relative positions of the video images of the two or more terminal sides.
  • the video source device is a television set top box
  • the playing device is a television set or a display.
  • the video interaction apparatus receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal.
  • the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
  • non-transitory computer readable storage medium comprising instructions, such as a memory comprising instructions executable by a processor of a mobile terminal to complete the present application Please refer to the video interaction method shown in each embodiment.
  • the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
  • the video interaction device provided by the foregoing embodiment is only illustrated by the division of each functional module. In actual applications, the function distribution may be completed by different functional modules as needed. The internal structure of the device is divided into different functional modules to perform all or part of the functions described above.
  • the embodiment of the video interaction device and the video interaction method provided by the foregoing embodiments are in the same concept, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.
  • a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
  • the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

Abstract

A video interaction method and apparatus, and a video source device relate to the technical field of applications of internet of things. The method is applied to a video source device comprising a camera, and comprises: receiving an instruction of performing video interaction with at least one terminal; establishing a video interaction channel to each of the at least one terminal; acquiring a video image on the side of the video source device by using the camera; and sending the video image on the side of the video source device to the at least one terminal by using the video interaction channel to each of the at least one terminal. According to the present invention, a video interaction channel is established between a video source device provided with a camera and each of at least one terminal, and a video image on the side of the video source device is sent to the at least one terminal, for example, video interaction with a smart phone can be performed by means of a combination of a TV set top box and a TV, such that a use scene of the video interaction is expanded, and user experience is improved.

Description

视频交互方法、装置及视频源设备Video interaction method, device and video source device
本申请要求于2015年07月31日提交中国专利局、申请号为201510466181.1、发明名称为“视频交互方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。The present application claims priority to Chinese Patent Application No. 201510466181.1, the entire disclosure of which is incorporated herein in
技术领域Technical field
本申请涉及物联网应用技术领域,特别涉及一种视频交互方法、装置及视频源设备。The present application relates to the field of Internet of Things application technologies, and in particular, to a video interaction method, device, and video source device.
背景技术Background technique
随着网络通信和计算机技术的不断发展,越来越多的用户已经不再满足于文字和语音交互,而是对视频交互的体验提出了更高的要求。With the continuous development of network communication and computer technology, more and more users are no longer satisfied with text and voice interaction, but put forward higher requirements for the experience of video interaction.
在现有技术中,两个用户之间可以通过带有摄像头和显示屏的设备进行视频交互,比如,智能手机A和智能手机B同时接入网络,用户a通过智能手机A向用户b发起视频交互请求,用户b在智能手机B中点击接受后,智能手机A和智能手机B各自通过内置的摄像头采集视频图像并发送给对方,同时接收并在显示屏中显示对方发送的视频图像。In the prior art, video interaction can be performed between two users through a device with a camera and a display screen. For example, smart phone A and smart phone B simultaneously access the network, and user a initiates video to user b through smart phone A. The interactive request, after the user b clicks and accepts in the smart phone B, the smart phone A and the smart phone B respectively collect the video image through the built-in camera and send it to the other party, and simultaneously receive and display the video image sent by the other party in the display screen.
上述视频交互的方法中,进行视频交互的两个设备需要同时具有网络接口、摄像头和显示屏,对设备的要求较高,限制了视频交互的应用场景。In the above video interaction method, two devices performing video interaction need to have a network interface, a camera, and a display screen at the same time, which have high requirements on the device and limit the application scenario of video interaction.
发明内容Summary of the invention
为了解决相关技术中需要进行视频交互的两个设备需要同时具有网络接口、摄像头和显示屏,对设备的要求较高,应用场景有限的问题,本申请实施例提供了一种视频交互方法、装置及视频源设备。所述技术方案如下:In order to solve the problem that the two devices that need to perform video interaction in the related art need to have a network interface, a camera, a display screen, a high requirement on the device, and a limited application scenario, the embodiment of the present application provides a video interaction method and device. And video source devices. The technical solution is as follows:
第一方面,提供了一种视频交互方法,用于包含有摄像头的视频源设备中,所述方法包括:In a first aspect, a video interaction method is provided for a video source device including a camera, the method comprising:
接收与至少一个终端进行视频交互的指令;Receiving an instruction to perform video interaction with at least one terminal;
建立与所述至少一个终端各自之间的视频交互通道;Establishing a video interaction channel with each of the at least one terminal;
通过所述摄像头采集所述视频源设备侧的视频图像; Collecting, by the camera, a video image on the video source device side;
通过与所述至少一个终端各自之间的视频交互通道将所述视频源设备侧的视频图像发送给所述至少一个终端;Transmitting, by the video interaction channel between the at least one terminal, the video image of the video source device side to the at least one terminal;
其中,所述视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且所述播放设备独立于所述视频源设备之外。The video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
第二方面,提供了一种视频源设备,所述视频源设备包含有摄像头,所述视频源设备包括:In a second aspect, a video source device is provided, where the video source device includes a camera, and the video source device includes:
一个或多个处理器;和One or more processors; and
存储器;Memory
所述存储器存储有一个或多个程序,所述一个或多个程序被配置成由所述一个或多个处理器执行,所述一个或多个程序包含用于进行以下操作的指令:The memory stores one or more programs, the one or more programs being configured to be executed by the one or more processors, the one or more programs including instructions for:
接收与至少一个终端进行视频交互的指令;Receiving an instruction to perform video interaction with at least one terminal;
建立与所述至少一个终端各自之间的视频交互通道;Establishing a video interaction channel with each of the at least one terminal;
通过所述摄像头采集所述视频源设备侧的视频图像;Collecting, by the camera, a video image on the video source device side;
通过与所述至少一个终端各自之间的视频交互通道将所述视频源设备侧的视频图像发送给所述至少一个终端;Transmitting, by the video interaction channel between the at least one terminal, the video image of the video source device side to the at least one terminal;
其中,所述视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且所述播放设备独立于所述视频源设备之外。The video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
第三方面,提供了一种视频交互装置,用于包含有摄像头的视频源设备中,所述装置包括:In a third aspect, a video interaction device is provided for use in a video source device including a camera, the device comprising:
指令接收模块,用于接收与至少一个终端进行视频交互的指令;An instruction receiving module, configured to receive an instruction for performing video interaction with at least one terminal;
建立模块,用于建立与所述至少一个终端各自之间的视频交互通道;Establishing a module, configured to establish a video interaction channel with each of the at least one terminal;
视频采集模块,用于通过所述摄像头采集所述视频源设备侧的视频图像;a video capture module, configured to collect, by using the camera, a video image of the video source device side;
视频发送模块,用于通过与所述至少一个终端各自之间的视频交互通道将所述视频源设备侧的视频图像发送给所述至少一个终端;a video sending module, configured to send, by using a video interaction channel between the at least one terminal, a video image of the video source device side to the at least one terminal;
其中,所述视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且所述播放设备独立于所述视频源设备之外。The video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
本申请实施例提供的技术方案带来的有益效果包括:The beneficial effects brought by the technical solutions provided by the embodiments of the present application include:
通过带摄像头的视频源设备与至少一个终端建立视频交互连接,并将视频源设备侧的视频图像发送给至少一个终端,从而扩展视频交互的使用场景。The video source device with the camera establishes a video interactive connection with the at least one terminal, and sends the video image of the video source device side to the at least one terminal, thereby expanding the use scenario of the video interaction.
附图说明 DRAWINGS
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work.
图1是本申请部分实施例提供的视频交互方法所涉及的实施环境图;1 is an implementation environment diagram involved in a video interaction method provided by some embodiments of the present application;
图2是本申请一个实施例提供的电子设备的结构方框图;2 is a block diagram showing the structure of an electronic device according to an embodiment of the present application;
图3是本申请一个实施例提供的视频交互方法的流程图;3 is a flowchart of a video interaction method provided by an embodiment of the present application;
图4是本申请另一实施例提供的视频交互方法的流程图;4 is a flowchart of a video interaction method according to another embodiment of the present application;
图5是本申请又一实施例提供的视频交互方法的流程图;FIG. 5 is a flowchart of a video interaction method according to another embodiment of the present application;
图6是本申请一个实施例提供的视频交互装置的装置结构图;FIG. 6 is a structural diagram of a device of a video interaction apparatus according to an embodiment of the present application; FIG.
图7是本申请另一实施例提供的视频交互装置的装置结构图。FIG. 7 is a structural diagram of a device of a video interaction apparatus according to another embodiment of the present application.
具体实施方式detailed description
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。In order to make the objects, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.
实施环境Implementation environment
请参考图1,其示出了本申请部分实施例提供的视频交互方法所涉及的实施环境图。图1所示的实施环境包括:视频源设备110、播放设备120、至少一个终端130和云端服务器140。Please refer to FIG. 1 , which illustrates an implementation environment diagram involved in a video interaction method provided by some embodiments of the present application. The implementation environment shown in FIG. 1 includes a video source device 110, a playback device 120, at least one terminal 130, and a cloud server 140.
视频源设备110可以是电视机顶盒等不带显示屏的家用设备,其中,视频源设备110内置或外接至少一个摄像头。The video source device 110 may be a home device without a display screen such as a television set top box, wherein the video source device 110 has built-in or externally connected at least one camera.
播放设备120可以是电视机或者显示器等带显示屏的家用设备。The playback device 120 can be a home device with a display such as a television or display.
终端130可以是智能手机、平板电脑以及电子书阅读器等具有网络接入、视频采集以及视频播放功能,能够独立实现视频交互的设备;或者,终端130也可以是另一个视频源设备,其可以与另一个播放设备相连接,以实现视频播放。The terminal 130 may be a device that has network access, video capture, and video playback functions, and can independently implement video interaction, such as a smart phone, a tablet computer, and an e-book reader. Alternatively, the terminal 130 may be another video source device, which may Connect to another playback device for video playback.
云端服务器140可以是一台服务器,或者,也可以是由若干个服务器组成的服务集群,或者,也可以是一个云计算中心。The cloud server 140 can be a server, or it can be a service cluster composed of several servers, or it can be a cloud computing center.
视频源设备110和播放设备120之间通过有线或无线网络进行连接。视频源设备110以及至少一个终端130分别和云端服务器140之间通过有线或无线 网络进行连接。The video source device 110 and the playback device 120 are connected by a wired or wireless network. The video source device 110 and the at least one terminal 130 and the cloud server 140 are respectively wired or wirelessly The network is connected.
计算机架构Computer architecture
请参考图2,其示出了本公开一个实施例提供的电子设备的结构方框图,本公开实施例中的电子设备可以包括一个或多个如下组成部分:用于执行计算机程序指令以完成各种流程和方法的处理器,用于信息和存储程序指令随机接入存储器(RAM)和只读存储器(ROM),用于存储数据和信息的存储器,I/O设备,界面,天线等。具体来讲:Please refer to FIG. 2, which is a structural block diagram of an electronic device according to an embodiment of the present disclosure. The electronic device in the embodiment of the present disclosure may include one or more components for executing computer program instructions to complete various Process and method processor for information and storage program instructions random access memory (RAM) and read only memory (ROM), memory for storing data and information, I/O devices, interfaces, antennas, and the like. Specifically:
电子设备200可以包括RF(Radio Frequency,射频)电路210、存储器220、输入单元230、传感器250、WiFi(wireless fidelity,无线保真)模块270、处理器280、电源282、摄像头290等部件。本领域技术人员可以理解,图2中示出的电子设备结构并不构成对电子设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。The electronic device 200 may include an RF (Radio Frequency) circuit 210, a memory 220, an input unit 230, a sensor 250, a WiFi (wireless fidelity) module 270, a processor 280, a power source 282, a camera 290, and the like. It will be understood by those skilled in the art that the electronic device structure illustrated in FIG. 2 does not constitute a limitation to the electronic device, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements.
下面结合图2对电子设备200的各个构成部件进行具体的介绍:The components of the electronic device 200 will be specifically described below with reference to FIG. 2:
RF电路210可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,给处理器280处理;另外,将设计上行的数据发送给基站。通常,RF电路包括但不限于天线、至少一个放大器、收发信机、耦合器、LNA(Low Noise Amplifier,低噪声放大器)、双工器等。此外,RF电路210还可以通过无线通信与网络和其他设备通信。所述无线通信可以使用任一通信标准或协议,包括但不限于GSM(Global System of Mobile communication,全球移动通讯系统)、GPRS(General Packet Radio Service,通用分组无线服务)、CDMA(Code Division Multiple Access,码分多址)、WCDMA(Wideband Code Division Multiple Access,宽带码分多址)、LTE(Long Term Evolution,长期演进)、电子邮件、SMS(Short Messaging Service,短消息服务)等。The RF circuit 210 can be used for transmitting and receiving information or during a call, and receiving and transmitting the signal. Specifically, after receiving the downlink information of the base station, the processor 280 processes the data. In addition, the uplink data is designed to be sent to the base station. Generally, RF circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, RF circuitry 210 can also communicate with the network and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access). , Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.
存储器220可用于存储软件程序以及模块,处理器280通过运行存储在存储器220的软件程序以及模块,从而执行电子设备200的各种功能应用以及数据处理。存储器220可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据电子设备200的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器220可以包括高速随机存取存储器, 还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 220 can be used to store software programs and modules, and the processor 280 executes various functional applications and data processing of the electronic device 200 by running software programs and modules stored in the memory 220. The memory 220 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the electronic device 200 (such as audio data, phone book, etc.), and the like. In addition, the memory 220 may include a high speed random access memory. Non-volatile memory may also be included, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
输入单元230可用于接收输入的数字或字符信息,以及产生与电子设备200的用户设置以及功能控制有关的键信号输入。具体地,输入单元230可包括触控面板231以及其他输入设备232。触控面板231,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板231上或在触控面板231附近的操作),并根据预先设定的程式驱动相应的连接装置。可选的,触控面板231可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器280,并能接收处理器280发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板231。除了触控面板231,输入单元230还可以包括其他输入设备232。具体地,其他输入设备232可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。The input unit 230 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the electronic device 200. Specifically, the input unit 230 may include a touch panel 231 and other input devices 232. The touch panel 231, also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 231 or near the touch panel 231. Operation), and drive the corresponding connecting device according to a preset program. Optionally, the touch panel 231 can include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 280 is provided and can receive commands from the processor 280 and execute them. In addition, the touch panel 231 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 231, the input unit 230 may also include other input devices 232. Specifically, other input devices 232 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
电子设备200还可包括至少一种传感器250,比如陀螺仪传感器、磁感应传感器、光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器。作为运动传感器的一种,加速度传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别电子设备姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于电子设备200还可配置的气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。The electronic device 200 may also include at least one type of sensor 250, such as a gyro sensor, a magnetic induction sensor, a light sensor, a motion sensor, and other sensors. In particular, the light sensor can include an ambient light sensor and a proximity sensor. As a kind of motion sensor, the acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the posture of electronic devices (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the electronic device 200 can also be configured with barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer repeat .
WiFi属于短距离无线传输技术,电子设备200通过WiFi模块270可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线的宽带互联网访问。虽然图2示出了WiFi模块270,但是可以理解的是,其并不属于电子设备200的必须构成,完全可以根据需要在不改变公开的本质的范围内而省略。WiFi is a short-range wireless transmission technology, and the electronic device 200 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 270, which provides wireless broadband Internet access for users. Although FIG. 2 shows the WiFi module 270, it can be understood that it does not belong to the essential configuration of the electronic device 200, and may be omitted as needed within the scope of not changing the essence of the disclosure.
处理器280是电子设备200的控制中心,利用各种接口和线路连接整个电子设备的各个部分,通过运行或执行存储在存储器220内的软件程序和/或模块,以及调用存储在存储器220内的数据,执行电子设备200的各种功能和处 理数据,从而对电子设备进行整体监控。可选的,处理器280可包括一个或多个处理单元;优选的,处理器280可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器280中。The processor 280 is a control center of the electronic device 200 that connects various portions of the entire electronic device using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 220, and recalling stored in the memory 220. Data, performing various functions and functions of the electronic device 200 Data is monitored to provide overall monitoring of electronic devices. Optionally, the processor 280 may include one or more processing units; preferably, the processor 280 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like. The modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 280.
电子设备200还包括给各个部件供电的电源282(比如电池),优选的,电源可以通过电源管理系统与处理器280逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The electronic device 200 also includes a power source 282 (such as a battery) that supplies power to the various components. Preferably, the power source can be logically coupled to the processor 280 through a power management system to manage functions such as charging, discharging, and power management through the power management system. .
摄像头290一般由镜头、图像传感器、接口、数字信号处理器、CPU、显示屏幕等组成。其中,镜头固定在图像传感器的上方,可以通过手动调节镜头来改变聚焦;图像传感器相当于传统相机的“胶卷”,是摄像头采集图像的心脏;接口用于把摄像头利用排线、板对板连接器、弹簧式连接方式与电子设备主板连接,将采集的图像发送给所述存储器220;数字信号处理器通过数学运算对采集的图像进行处理,将采集的模拟图像转换为数字图像并通过接口发送给存储器220。The camera 290 is generally composed of a lens, an image sensor, an interface, a digital signal processor, a CPU, a display screen, and the like. The lens is fixed above the image sensor, and the focus can be changed by manually adjusting the lens; the image sensor is equivalent to the "film" of the conventional camera, and is the heart of the image captured by the camera; the interface is used to connect the camera with the cable and the board to the board. The device is connected to the electronic device motherboard to send the acquired image to the memory 220. The digital signal processor processes the acquired image through mathematical operations, converts the collected analog image into a digital image and sends the image through the interface. To the memory 220.
尽管未示出,电子设备200还可以包括蓝牙模块等,在此不再赘述。Although not shown, the electronic device 200 may further include a Bluetooth module or the like, and details are not described herein again.
电子设备200除了包括一个或者多个处理器280,还包括有存储器,以及一个或者多个程序,其中一个或者多个程序存储于存储器中,并被配置成由一个或者多个处理器执行,以实现本申请各个实施例所示的视频交互方法。The electronic device 200 includes, in addition to the one or more processors 280, a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors to The video interaction method shown in various embodiments of the present application is implemented.
电子设备200可以实现为上述图1所示实施环境中的视频源设备110。The electronic device 200 can be implemented as the video source device 110 in the implementation environment shown in FIG. 1 above.
请参考图3,其示出了本申请一个实施例提供的视频交互方法的流程图。该视频交互方法可以应用于包含有摄像头的电子设备,比如图1所示的视频源设备110中。该视频交互方法可以包括如下几个步骤:Please refer to FIG. 3, which is a flowchart of a video interaction method provided by an embodiment of the present application. The video interaction method can be applied to an electronic device including a camera, such as the video source device 110 shown in FIG. The video interaction method can include the following steps:
步骤301,接收与至少一个终端进行视频交互的指令。Step 301: Receive an instruction for performing video interaction with at least one terminal.
步骤302,建立与该至少一个终端各自之间的视频交互通道。Step 302: Establish a video interaction channel with each of the at least one terminal.
步骤303,通过摄像头采集该视频源设备侧的视频图像。Step 303: Collect a video image of the video source device side by using a camera.
步骤304,通过与该至少一个终端各自之间的视频交互通道将该视频源设备侧的视频图像发送给至少一个终端。Step 304: Send the video image of the video source device side to at least one terminal by using a video interaction channel with each of the at least one terminal.
其中,视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且播放设备独立于视频源设备之外。 The video source device is a device for providing a video picture played in a display screen of the playback device, and the playback device is independent of the video source device.
综上所述,本申请实施例提供的视频交互方法,接收与至少一个终端进行视频交互的指令,建立与该至少一个终端各自之间的视频交互通道,通过摄像头采集视频源设备侧的视频图像;通过与至少一个终端各自之间的视频交互通道将视频源设备侧的视频图像发送给至少一个终端,通过带摄像头的视频源设备与至少一个终端建立视频交互通道,并将视频源设备侧的视频图像发送给至少一个终端,比如,可以通过电视机顶盒与电视机的组合与智能手机进行视频交互,从而扩展视频交互的使用场景,提高用户体验。In summary, the video interaction method provided by the embodiment of the present application receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal. For example, the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
请参考图4,其示出了本申请另一实施例提供的视频交互方法的流程图。该视频交互方法可以应用于包含有摄像头的电子设备,比如图1所示的视频源设备110中。该视频交互方法可以包括如下几个步骤:Please refer to FIG. 4, which is a flowchart of a video interaction method provided by another embodiment of the present application. The video interaction method can be applied to an electronic device including a camera, such as the video source device 110 shown in FIG. The video interaction method can include the following steps:
步骤401,在播放设备的显示屏中投射终端列表,该终端列表中包含各个与该视频源设备绑定的终端的标识。Step 401: Project a terminal list in a display screen of the playback device, where the terminal list includes identifiers of the terminals bound to the video source device.
其中,视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且播放设备独立于视频源设备之外。The video source device is a device for providing a video picture played in a display screen of the playback device, and the playback device is independent of the video source device.
以图1所示的实施环境中的视频源设备为电视机顶盒,播放设备为电视机或者显示器为例。电视机顶盒与电视机或者显示器建立连接并开机后,电视机顶盒通过SDK(Software Development Kit,软件开发工具包)调用内置的UI(User Interface,用户界面)应用,在电视机或者显示器的显示屏上投射主界面,其中,用户可以通过电视机顶盒的遥控器建立电视机顶盒与若干个智能手机之间的绑定关系,也可以通过遥控器发起与绑定的智能手机之间的视频交互。The video source device in the implementation environment shown in FIG. 1 is a TV set top box, and the playback device is a television set or a display. After the TV set-top box is connected to the TV or the display and turned on, the TV set-top box calls the built-in UI (User Interface) application through the SDK (Software Development Kit) to project on the display of the TV or the display. The main interface, wherein the user can establish a binding relationship between the set top box and the plurality of smart phones through the remote controller of the set top box of the television set, and can also initiate a video interaction with the bound smart phone through the remote controller.
其中,建立电视机顶盒与智能手机之间的绑定关系,可以是建立两个用户账号之间的绑定关系,比如,用户可以通过遥控器打开电视机顶盒中预先安装的,指定的视频交互应用,并使用预先申请的该视频交互应用的第一账号进行登录,在绑定界面中输入待绑定的第二账号并点击请求绑定后,电视机顶盒即向云端服务器发送绑定请求,云端服务器向使用该第二账号登录该视频交互应用的智能手机发送绑定提醒,该智能手机点击接受绑定后,云端服务器即将第一账号和第二账号绑定成功,该绑定关系也保存在云端服务器中。或者,该第二账号也可以对应另一个电视机顶盒,当云端服务器向使用该第二账号登录该视频交互应用的另一电视机顶盒发送绑定提醒时,另一电视机顶盒可以将该绑 定提醒投射到对应的电视机或者显示器的显示屏中,以便另一电视机顶盒对应的用户通过遥控器选择接受或者拒绝该绑定。The binding relationship between the set top box and the smart phone may be established by establishing a binding relationship between the two user accounts. For example, the user may open a pre-installed, specified video interactive application in the set top box through the remote controller. And using the first account of the video interaction application that is applied in advance to log in, after inputting the second account to be bound in the binding interface and clicking the request binding, the TV set-top box sends a binding request to the cloud server, and the cloud server sends The second account is used to log in to the smart phone of the video interaction application to send a binding reminder. After the smart phone clicks and accepts the binding, the cloud server binds the first account and the second account successfully, and the binding relationship is also saved in the cloud server. in. Alternatively, the second account can also be corresponding to another set-top box. When the cloud server sends a binding reminder to another set-top box that uses the second account to log in to the video interactive application, another set-top box can be tied. The reminder is projected into the display of the corresponding television or display so that the user corresponding to the other set top box can accept or reject the binding through the remote control.
用户通过遥控器发出与智能手机进行视频交互的指令后,电视机顶盒从云端服务器获取与第一账号绑定的其它各个账号组成的列表,并在电视机或者显示器的显示屏上投射包含该列表的选择界面,这里与第一账号绑定的其它各个账号就是与视频源设备绑定的各个终端的标识。After the user sends an instruction for video interaction with the smart phone through the remote controller, the set-top box acquires a list of other accounts bound to the first account from the cloud server, and projects the list including the list on the display screen of the television or the display. The selection interface, where the other accounts bound to the first account are the identifiers of the terminals bound to the video source device.
可选的,上述列表除了包含与第一账号绑定的其它账号之外,还可以包含各个其它账号的昵称或者备注名,以便用户进行分辨。Optionally, the above list may include a nickname or a note name of each other account in addition to other accounts bound to the first account, so that the user can distinguish.
步骤402,接收在该终端列表中执行的选择操作,该选择操作是对该至少一个终端的标识执行的操作。Step 402: Receive a selection operation performed in the terminal list, the selection operation being an operation performed on the identifier of the at least one terminal.
当用户想要与某一个或者多个账号对应的用户进行视频交互时,即可以通过遥控器在选择界面中选择该一个或者多个账号,此时,电视机顶盒即接收到与该一个或者多个账号对应的智能手机进行视频交互的指令。When the user wants to perform video interaction with a user corresponding to one or more accounts, the one or more accounts may be selected in the selection interface by using a remote controller. At this time, the set-top box of the television receives the one or more The instruction of the video interaction of the smartphone corresponding to the account.
步骤403,建立与该至少一个终端各自之间的视频交互通道。Step 403: Establish a video interaction channel with each of the at least one terminal.
电视机顶盒接收到与一个或者多个账号对应的智能手机进行视频交互的指令后,即通过云端服务器向该一个或者多个账号对应的智能手机发送视频交互请求,云端服务器向该一个或者多个账号对应的智能手机发送视频交互提醒,这些智能手机对应用户选择接受视频交互的请求后,云端服务器即建立该电视机顶盒与该一个或者多个账号对应的智能手机之间的视频交互通道。After the TV set-top box receives the instruction for the video interaction with the smart phone corresponding to the one or more accounts, the cloud server sends a video interaction request to the smart phone corresponding to the one or more accounts, and the cloud server sends the video interaction request to the one or more accounts. The corresponding smart phone sends a video interaction reminder. After the smart phone corresponds to the user's request to accept the video interaction, the cloud server establishes a video interaction channel between the TV set top box and the smart phone corresponding to the one or more accounts.
步骤404,通过与该至少一个终端各自之间的视频交互通道接收该至少一个终端侧的视频图像,该至少一个终端侧的视频图像由该至少一个终端发送。Step 404: Receive, by using a video interaction channel with each of the at least one terminal, a video image of the at least one terminal side, where the video image of the at least one terminal side is sent by the at least one terminal.
其中,视频源设备与至少一个终端各自之间的视频交互通道是一种以云端服务器为中继的通道,视频源设备在接收终端侧的视频图像时,终端首先通过该终端与云端服务器之间的视频交互通道将终端侧的视频图像发送至云端服务器,云端服务器再通过云端服务器与视频源设备之间的视频交互通道将该终端侧的视频图像推送给视频源设备。The video interaction channel between the video source device and the at least one terminal is a channel that is relayed by the cloud server. When the video source device receives the video image on the terminal side, the terminal first passes between the terminal and the cloud server. The video interaction channel sends the video image of the terminal side to the cloud server, and the cloud server pushes the video image of the terminal side to the video source device through a video interaction channel between the cloud server and the video source device.
步骤405,将该至少一个终端侧的视频图像投射到播放设备的显示屏中,该播放设备独立于该视频源设备之外。Step 405: Project the video image of the at least one terminal side into a display screen of the playback device, the playback device being independent of the video source device.
当该至少一个终端中包含两个或者两个以上终端时,该将该至少一个终端侧的视频图像投射到播放设备的显示屏中,包括:根据该两个或者两个以上终端的数量,以及视频源设备与该两个或者两个以上终端各自之间的视频交互通 道的建立顺序,确定该两个或者两个以上终端侧的视频图像的相对位置;根据该两个或者两个以上终端侧的视频图像的相对位置,将该两个或者两个以上终端侧的视频图像投射在该显示屏中。When the at least one terminal includes two or more terminals, the video image of the at least one terminal side is projected into the display screen of the playback device, including: according to the number of the two or more terminals, and Video interaction between the video source device and each of the two or more terminals The order of establishing the tracks, determining the relative positions of the video images of the two or more terminal sides; and according to the relative positions of the video images of the two or more terminal sides, the two or more terminal sides The video image is projected in the display.
其中,当与电视机顶盒同时进行视频交互的智能手机为两个或者两个以上时,电视机顶盒可以根据当前正在进行视频交互的智能手机的总数,以及视频交互通道建立的顺序确定各个智能手机侧的视频图像的相对位置,并根据确定的相对位置将各个智能手机侧的视频图像投射到电视机或者显示器的显示屏上。Wherein, when there are two or more smart phones for video interaction with the TV set-top box, the set-top box can determine each smart phone side according to the total number of smart phones currently undergoing video interaction and the order in which the video interactive channels are established. The relative positions of the video images, and the video images of the respective smartphone sides are projected onto the display screen of the television or the display according to the determined relative position.
具体例如,电视机顶盒当前与两个智能手机(分别智能手机A和智能手机B)进行视频交互,并且,电视机顶盒先与智能手机A建立视频交互通道,后与智能手机B建立交互通道,此时,电视机顶盒根据交互的智能手机的数量确定两个图像显示位置,分别位于显示屏的左上角和右上角,并将左上角的图像显示位置确定为先建立视频交互通道对应的相对位置,并将左上角的图像显示位置确定为后建立视频交互通道对应的相对位置,即将智能手机A侧的视频图像显示在显示屏的左上角,并将智能手机A侧的视频图像显示在显示屏的右上角。For example, the TV set top box currently performs video interaction with two smart phones (smartphone A and smart phone B respectively), and the set top box first establishes a video interaction channel with the smart phone A, and then establishes an interactive channel with the smart phone B. The TV set top box determines two image display positions according to the number of interactive smart phones, respectively located in the upper left corner and the upper right corner of the display screen, and determines the image display position in the upper left corner to first establish the relative position corresponding to the video interactive channel, and The image display position in the upper left corner is determined as the relative position corresponding to the video interactive channel, that is, the video image on the side of the smartphone A is displayed in the upper left corner of the display screen, and the video image on the side of the smart phone A is displayed in the upper right corner of the display screen. .
可选的,当至少一个终端中包含两个或者两个以上终端时,视频源设备还可以接收对播放设备的显示屏中投射的各个终端侧的视频图像的指定操作,根据该指定操作来改变各个终端侧的视频图像在播放设备的显示屏中的投射位置。Optionally, when at least one terminal includes two or more terminals, the video source device may further receive a specified operation on a video image of each terminal side projected in a display screen of the playback device, and change according to the specified operation. The projection position of the video image on each terminal side in the display screen of the playback device.
用户也可以通过遥控器对电视机或者显示器的显示屏上显示的,各个智能手机侧的视频图像进行指定操作,比如选择任意一个智能手机侧的视频图像,并对该视频图像的显示区域进行放大或缩小等操作,或者,选择两个智能手机侧的视频图像调换这两个智能手机侧的视频图像的显示区域。The user can also perform a specified operation on the video image of each smart phone side displayed on the display screen of the television or the display through the remote controller, for example, selecting a video image of any one of the smart phone sides, and magnifying the display area of the video image. Or zoom out, or select two video images on the smartphone side to swap the display areas of the video images on the two smartphones.
步骤406,通过该摄像头采集该视频源设备侧的视频图像。Step 406: Collect a video image of the video source device side by using the camera.
步骤407,通过与该至少一个终端各自之间的视频交互通道将该视频源设备侧的视频图像发送给该至少一个终端。Step 407: Send the video image of the video source device side to the at least one terminal by using a video interaction channel with each of the at least one terminal.
与步骤404类似的,视频源设备在向终端发送视频源设备侧的视频图像时,首先通过该视频源设备与云端服务器之间的视频交互通道将视频源设备侧的视频图像发送至云端服务器,云端服务器再通过云端服务器与终端之间的视频交互通道将该视频源设备侧的视频图像推送给终端。 Similar to the step 404, when the video source device sends the video image on the video source device side to the terminal, the video source device sends the video image on the video source device side to the cloud server through the video interaction channel between the video source device and the cloud server. The cloud server further pushes the video image of the video source device side to the terminal through a video interaction channel between the cloud server and the terminal.
其中,为了便于智能手机侧也能够看到电视机顶盒侧的视频图像,该电视机顶盒中可以内置摄像头,在进行视频交互时,电视机顶盒通过内置的摄像头采集本地的视频图像并发送给正在进行视频交互的各个智能手机。同时,电视机顶盒也可以将电视机顶盒通过内置的摄像头采集本地的视频图像投射在电视机或者显示器的显示屏中的指定区域,该指定区域可以通过遥控器开启或者关闭。In order to facilitate the video side of the TV set top box, the camera can also be equipped with a built-in camera. During the video interaction, the set-top box collects the local video image through the built-in camera and sends it to the ongoing video interaction. Various smartphones. At the same time, the TV set-top box can also capture the local video image of the TV set-top box through the built-in camera and project it into a designated area in the display screen of the television or the display, and the designated area can be turned on or off by the remote controller.
需要说明的是,上述步骤404~405与步骤406~407是同步执行的两个流程,其执行顺序不分先后,可以同时进行。It should be noted that the above steps 404-405 and steps 406-407 are two processes that are executed synchronously, and the execution order may be performed simultaneously without any order.
综上所述,本申请实施例提供的视频交互方法,接收与至少一个终端进行视频交互的指令,建立与该至少一个终端各自之间的视频交互通道,通过摄像头采集视频源设备侧的视频图像;通过与至少一个终端各自之间的视频交互通道将视频源设备侧的视频图像发送给至少一个终端,通过带摄像头的视频源设备与至少一个终端建立视频交互通道,并将视频源设备侧的视频图像发送给至少一个终端,比如,可以通过电视机顶盒与电视机的组合与智能手机进行视频交互,从而扩展视频交互的使用场景,提高用户体验。In summary, the video interaction method provided by the embodiment of the present application receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal. For example, the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
请参考图5,其示出了本申请又一实施例提供的视频交互方法的流程图。该视频交互方法可以应用于包含有摄像头的电子设备,比如图1所示的视频源设备110中。该视频交互方法可以包括如下几个步骤:Please refer to FIG. 5, which is a flowchart of a video interaction method according to another embodiment of the present application. The video interaction method can be applied to an electronic device including a camera, such as the video source device 110 shown in FIG. The video interaction method can include the following steps:
步骤501,接收至少一个终端通过云端服务器发送的视频交互请求。Step 501: Receive a video interaction request sent by at least one terminal through a cloud server.
其中,该至少一个终端是与播放设备绑定的终端,终端与播放设备建立绑定关系的步骤请参考步骤401下的描述,此处不再赘述。The at least one terminal is a terminal that is bound to the playback device. For the step of establishing a binding relationship between the terminal and the playback device, refer to the description in step 401, and details are not described herein.
当某一个与电视机顶盒绑定的智能手机对应的用户想要与电视机顶盒进行视频交互时,该用户可以在智能手机安装的视频交互应用中选择该电视机顶盒,智能手机向云端服务器发送视频交互请求,云端服务器将该视频交互请求转发给电视机顶盒。When a user corresponding to a smart phone bound to the set-top box wants to perform video interaction with the set-top box, the user can select the set-top box in the video interactive application installed by the smart phone, and the smart phone sends a video interaction request to the cloud server. The cloud server forwards the video interaction request to the set top box.
步骤502,在播放设备的显示屏中投射交互询问信息,交互询问信息用于询问是否接受与至少一个终端的视频交互。Step 502: Project interactive query information in a display screen of the playback device, and the interactive query information is used to query whether to accept video interaction with at least one terminal.
步骤503,接收基于交互询问信息执行的确认操作,该确认操作是确认接受与至少一个终端的视频交互的操作。Step 503: Receive a confirmation operation performed based on the interactive inquiry information, the confirmation operation is an operation of confirming acceptance of a video interaction with at least one terminal.
电视机顶盒接收到智能手机发送的视频交互请求后,在电视机或者显示器 的显示屏中投射交互询问信息,以询问电视机前的用户是否接收视频交互,若电视机前的用户通过遥控器选择接受,则电视机顶盒接收到与智能手机进行视频交互的指令。After the TV set-top box receives the video interaction request sent by the smartphone, on the TV or the display The interactive display information is projected in the display screen to ask whether the user in front of the TV receives the video interaction. If the user in front of the TV selects and accepts through the remote control, the set-top box receives an instruction to perform video interaction with the smart phone.
步骤504,建立与该至少一个终端各自之间的视频交互通道。Step 504: Establish a video interaction channel with each of the at least one terminal.
电视机顶盒接收到与一个或者多个账号对应的智能手机进行视频交互的指令后,即向云端服务器发送建立视频交互的响应,云端服务器即建立该电视机顶盒与该一个或者多个账号对应的智能手机之间的视频交互通道。After receiving the instruction for video interaction with the smart phone corresponding to one or more accounts, the set-top box sends a response to establish a video interaction to the cloud server, and the cloud server establishes the smart phone corresponding to the one or more accounts of the set-top box. The video interaction channel between.
步骤505,通过与该至少一个终端各自之间的视频交互通道接收该至少一个终端发送的至少一个终端侧的视频图像,该至少一个终端侧的视频图像由该至少一个终端发送。Step 505: Receive, by using a video interaction channel with each of the at least one terminal, a video image of the at least one terminal side that is sent by the at least one terminal, where the video image of the at least one terminal side is sent by the at least one terminal.
步骤506,将该至少一个终端侧的视频图像投射到播放设备的显示屏中,该播放设备独立于该视频源设备之外。Step 506: Project the video image of the at least one terminal side into a display screen of the playback device, the playback device being independent of the video source device.
步骤507,通过该摄像头采集该视频源设备侧的视频图像。Step 507: Collect a video image of the video source device side by using the camera.
步骤508,通过与该至少一个终端各自之间的视频交互通道将该视频源设备侧的视频图像发送给该至少一个终端。Step 508: Send the video image of the video source device side to the at least one terminal by using a video interaction channel with each of the at least one terminal.
需要说明的是,上述步骤505~506与步骤507~508是同步执行的两个流程,其执行顺序不分先后,可以同时进行。It should be noted that the above steps 505-506 and steps 507-508 are two processes that are executed synchronously, and the execution order may be performed simultaneously without any order.
综上所述,本申请实施例提供的视频交互方法,接收与至少一个终端进行视频交互的指令,建立与该至少一个终端各自之间的视频交互通道,通过摄像头采集视频源设备侧的视频图像;通过与至少一个终端各自之间的视频交互通道将视频源设备侧的视频图像发送给至少一个终端,通过带摄像头的视频源设备与至少一个终端建立视频交互通道,并将视频源设备侧的视频图像发送给至少一个终端,比如,可以通过电视机顶盒与电视机的组合与智能手机进行视频交互,从而扩展视频交互的使用场景,提高用户体验。In summary, the video interaction method provided by the embodiment of the present application receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal. For example, the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
下述为本申请装置实施例,可以用于执行本申请方法实施例。对于本申请装置实施例中未披露的细节,请参照本申请方法实施例。The following is an embodiment of the apparatus of the present application, which may be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.
请参考图6,其示出了本申请一个实施例提供的视频交互装置的装置结构图。该视频交互装置可以实现为包含有摄像头的电子设备,比如图1所示实施环境中的视频源设备110的全部或者部分。该视频交互装置可以包括:Please refer to FIG. 6 , which is a structural diagram of a device of a video interaction apparatus according to an embodiment of the present application. The video interaction device can be implemented as an electronic device that includes a camera, such as all or part of the video source device 110 in the implementation environment shown in FIG. The video interaction device can include:
指令接收模块601,用于接收与至少一个终端进行视频交互的指令; An instruction receiving module 601, configured to receive an instruction for performing video interaction with at least one terminal;
建立模块602,用于建立与所述至少一个终端各自之间的视频交互通道;The establishing module 602 is configured to establish a video interaction channel with each of the at least one terminal;
视频采集模块603,用于通过所述摄像头采集所述视频源设备侧的视频图像;a video capture module 603, configured to collect, by using the camera, a video image of the video source device side;
视频发送模块604,用于通过与所述至少一个终端各自之间的视频交互通道将所述视频源设备侧的视频图像发送给所述至少一个终端;a video sending module 604, configured to send, by using a video interaction channel with each of the at least one terminal, a video image of the video source device side to the at least one terminal;
其中,所述视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且所述播放设备独立于所述视频源设备之外。The video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
综上所述,本申请实施例提供的视频交互装置,接收与至少一个终端进行视频交互的指令,建立与该至少一个终端各自之间的视频交互通道,通过摄像头采集视频源设备侧的视频图像;通过与至少一个终端各自之间的视频交互通道将视频源设备侧的视频图像发送给至少一个终端,通过带摄像头的视频源设备与至少一个终端建立视频交互通道,并将视频源设备侧的视频图像发送给至少一个终端,比如,可以通过电视机顶盒与电视机的组合与智能手机进行视频交互,从而扩展视频交互的使用场景,提高用户体验。In summary, the video interaction apparatus provided by the embodiment of the present application receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal. For example, the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
请参考图7,其示出了本申请另一实施例提供的视频交互装置的装置结构图。该视频交互装置可以实现为包含有摄像头的电子设备,比如图1所示实施环境中的视频源设备110的全部或者部分。该视频交互装置可以包括:Please refer to FIG. 7, which is a structural diagram of a device of a video interaction apparatus according to another embodiment of the present application. The video interaction device can be implemented as an electronic device that includes a camera, such as all or part of the video source device 110 in the implementation environment shown in FIG. The video interaction device can include:
指令接收模块601,用于接收与至少一个终端进行视频交互的指令;An instruction receiving module 601, configured to receive an instruction for performing video interaction with at least one terminal;
建立模块602,用于建立与所述至少一个终端各自之间的视频交互通道;The establishing module 602 is configured to establish a video interaction channel with each of the at least one terminal;
视频采集模块603,用于通过所述摄像头采集所述视频源设备侧的视频图像;a video capture module 603, configured to collect, by using the camera, a video image of the video source device side;
视频发送模块604,用于通过与所述至少一个终端各自之间的视频交互通道将所述视频源设备侧的视频图像发送给所述至少一个终端;a video sending module 604, configured to send, by using a video interaction channel with each of the at least one terminal, a video image of the video source device side to the at least one terminal;
其中,所述视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且所述播放设备独立于所述视频源设备之外。The video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
可选的,所述装置还包括:Optionally, the device further includes:
视频接收模块605,用于通过与所述至少一个终端各自之间的视频交互通道接收所述至少一个终端发送的,所述至少一个终端侧的视频图像;The video receiving module 605 is configured to receive, by the video interaction channel between the at least one terminal, the video image of the at least one terminal side that is sent by the at least one terminal;
视频投射模块606,用于将所述至少一个终端侧的视频图像投射到播放设备的显示屏中,所述播放设备独立于所述视频源设备之外。 The video projection module 606 is configured to project the video image of the at least one terminal side into a display screen of the playback device, the playback device being independent of the video source device.
可选的,所述指令接收模块601,包括:Optionally, the instruction receiving module 601 includes:
列表投射单元601a,用于在所述播放设备的显示屏中投射终端列表,所述终端列表中包含各个与所述视频源设备绑定的终端的标识;a list projection unit 601a, configured to project a terminal list in a display screen of the playback device, where the terminal list includes an identifier of each terminal that is bound to the video source device;
第一操作接收单元601b,用于接收在所述终端列表中执行的,对所述至少一个终端的标识的选择操作。The first operation receiving unit 601b is configured to receive a selection operation performed on the identifier of the at least one terminal performed in the terminal list.
可选的,所述指令接收模块601,包括:Optionally, the instruction receiving module 601 includes:
请求接收单元601c,用于接收所述至少一个终端通过云端服务器发送的视频交互请求;The request receiving unit 601c is configured to receive a video interaction request sent by the at least one terminal by using a cloud server;
信息投射单元601d,用于在所述播放设备的显示屏中投射交互询问信息,所述交互询问信息用于询问是否接受与所述至少一个终端的视频交互;The information projection unit 601d is configured to project interaction query information in a display screen of the playback device, where the interaction query information is used to query whether to accept video interaction with the at least one terminal;
第二操作接收单元601e,用于接收基于所述交互询问信息执行的,确认接受与所述至少一个终端的视频交互的操作。The second operation receiving unit 601e is configured to receive, according to the interaction query information, confirm an operation of accepting video interaction with the at least one terminal.
可选的,所述视频投射模块606,包括:Optionally, the video projection module 606 includes:
相对位置确定单元606a,用于当所述至少一个终端中包含两个或者两个以上终端时,根据所述两个或者两个以上终端的数量以及与所述两个或者两个以上终端各自之间的视频交互通道的建立顺序,确定所述两个或者两个以上终端侧的视频图像的相对位置;The relative position determining unit 606a is configured to: when the at least one terminal includes two or more terminals, according to the number of the two or more terminals and the two or more terminals respectively The order in which the video interaction channels are established, determining the relative positions of the video images on the two or more terminal sides;
视频投射单元606b,用于根据所述两个或者两个以上终端侧的视频图像的相对位置,将所述两个或者两个以上终端侧的视频图像投射在所述显示屏中。The video projection unit 606b is configured to project the video images of the two or more terminal sides in the display screen according to the relative positions of the video images of the two or more terminal sides.
可选的,所述视频源设备为电视机顶盒,所述播放设备为电视机或者显示器。Optionally, the video source device is a television set top box, and the playing device is a television set or a display.
综上所述,本申请实施例提供的视频交互装置,接收与至少一个终端进行视频交互的指令,建立与该至少一个终端各自之间的视频交互通道,通过摄像头采集视频源设备侧的视频图像;通过与至少一个终端各自之间的视频交互通道将视频源设备侧的视频图像发送给至少一个终端,通过带摄像头的视频源设备与至少一个终端建立视频交互通道,并将视频源设备侧的视频图像发送给至少一个终端,比如,可以通过电视机顶盒与电视机的组合与智能手机进行视频交互,从而扩展视频交互的使用场景,提高用户体验。In summary, the video interaction apparatus provided by the embodiment of the present application receives an instruction for performing video interaction with at least one terminal, establishes a video interaction channel with each of the at least one terminal, and collects a video image of the video source device side through the camera. Transmitting a video image on the video source device side to at least one terminal through a video interaction channel with each of the at least one terminal, establishing a video interaction channel with the at least one terminal through the video source device with the camera, and connecting the video source device side The video image is sent to at least one terminal. For example, the video interaction between the set-top box and the television set can be performed with the smart phone, thereby expanding the use scene of the video interaction and improving the user experience.
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器,上述指令可由移动终端的处理器执行以完成本申 请各个实施例所示的视频交互方法。例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, there is also provided a non-transitory computer readable storage medium comprising instructions, such as a memory comprising instructions executable by a processor of a mobile terminal to complete the present application Please refer to the video interaction method shown in each embodiment. For example, the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
需要说明的是:上述实施例提供的视频交互装置在视频交互时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的视频交互装置和视频交互方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。It should be noted that, in the video interaction, the video interaction device provided by the foregoing embodiment is only illustrated by the division of each functional module. In actual applications, the function distribution may be completed by different functional modules as needed. The internal structure of the device is divided into different functional modules to perform all or part of the functions described above. In addition, the embodiment of the video interaction device and the video interaction method provided by the foregoing embodiments are in the same concept, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.
应当理解的是,在本文中使用的,除非上下文清楚地支持例外情况,单数形式“一个”(“a”、“an”、“the”)旨在也包括复数形式。还应当理解的是,在本文中使用的“和/或”是指包括一个或者一个以上相关联地列出的项目的任意和所有可能组合。It is to be understood that the singular forms "a", "the", "the" It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the embodiments of the present application are merely for the description, and do not represent the advantages and disadvantages of the embodiments.
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。A person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium. The storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.
以上所述仅为本申请的较佳实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。 The above is only the preferred embodiment of the present application, and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application are included in the protection of the present application. Within the scope.

Claims (18)

  1. 一种视频交互方法,其特征在于,用于包含有摄像头的视频源设备中,所述方法包括:A video interaction method, in a video source device including a camera, the method includes:
    接收与至少一个终端进行视频交互的指令;Receiving an instruction to perform video interaction with at least one terminal;
    建立与所述至少一个终端各自之间的视频交互通道;Establishing a video interaction channel with each of the at least one terminal;
    通过所述摄像头采集所述视频源设备侧的视频图像;Collecting, by the camera, a video image on the video source device side;
    通过与所述至少一个终端各自之间的视频交互通道将所述视频源设备侧的视频图像发送给所述至少一个终端;Transmitting, by the video interaction channel between the at least one terminal, the video image of the video source device side to the at least one terminal;
    其中,所述视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且所述播放设备独立于所述视频源设备之外。The video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
  2. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1 further comprising:
    通过与所述至少一个终端各自之间的视频交互通道接收所述至少一个终端侧的视频图像,所述至少一个终端侧的视频图像由所述至少一个终端发送;Receiving, by the video interaction channel between the at least one terminal, the video image of the at least one terminal side, where the video image of the at least one terminal side is sent by the at least one terminal;
    将所述至少一个终端侧的视频图像投射到播放设备的显示屏中。The at least one terminal side video image is projected into a display screen of the playback device.
  3. 根据权利要求1所述的方法,其特征在于,所述接收与至少一个终端进行视频交互的指令,包括:The method of claim 1, wherein the receiving an instruction to perform video interaction with the at least one terminal comprises:
    在所述播放设备的显示屏中投射终端列表,所述终端列表中包含各个与所述视频源设备绑定的终端的标识;A terminal list is projected in a display screen of the playback device, where the terminal list includes identifiers of terminals that are bound to the video source device;
    接收在所述终端列表中执行的选择操作,所述选择操作是对所述至少一个终端的标识执行的操作。Receiving a selection operation performed in the terminal list, the selection operation being an operation performed on an identification of the at least one terminal.
  4. 根据权利要求1所述的方法,其特征在于,所述接收与至少一个终端进行视频交互的指令,包括:The method of claim 1, wherein the receiving an instruction to perform video interaction with the at least one terminal comprises:
    接收所述至少一个终端通过云端服务器发送的视频交互请求;Receiving a video interaction request sent by the at least one terminal through the cloud server;
    在所述播放设备的显示屏中投射交互询问信息,所述交互询问信息用于询问是否接受与所述至少一个终端的视频交互;Transmitting interactive query information in a display screen of the playback device, the interaction query information being used to query whether to accept video interaction with the at least one terminal;
    接收基于所述交互询问信息执行的确认操作,所述确认操作是确认接受与所述至少一个终端的视频交互的操作。 Receiving a confirmation operation performed based on the interactive inquiry information, the confirmation operation is an operation of confirming acceptance of a video interaction with the at least one terminal.
  5. 根据权利要求1所述的方法,其特征在于,当所述至少一个终端中包含两个或者两个以上终端时,所述将所述至少一个终端侧的视频图像投射到播放设备的显示屏中,包括:The method according to claim 1, wherein when the at least one terminal comprises two or more terminals, the video image of the at least one terminal side is projected into a display screen of the playback device. ,include:
    根据所述两个或者两个以上终端的数量,以及所述视频源设备与所述两个或者两个以上终端各自之间的视频交互通道的建立顺序,确定所述两个或者两个以上终端侧的视频图像的相对位置;Determining the two or more terminals according to the number of the two or more terminals and the order of establishing the video interaction channel between the video source device and the two or more terminals The relative position of the video image on the side;
    根据所述两个或者两个以上终端侧的视频图像的相对位置,将所述两个或者两个以上终端侧的视频图像投射在所述显示屏中。The video images of the two or more terminal sides are projected in the display screen according to the relative positions of the video images of the two or more terminal sides.
  6. 根据权利要求1所述的方法,其特征在于,所述视频源设备为电视机顶盒,所述播放设备为电视机或者显示器。The method according to claim 1, wherein the video source device is a television set top box, and the playback device is a television set or a display.
  7. 一种视频源设备,其特征在于,所述视频源设备包含有摄像头,所述视频源设备包括:A video source device, wherein the video source device includes a camera, and the video source device includes:
    一个或多个处理器;和One or more processors; and
    存储器;Memory
    所述存储器存储有一个或多个程序,所述一个或多个程序被配置成由所述一个或多个处理器执行,所述一个或多个程序包含用于进行以下操作的指令:The memory stores one or more programs, the one or more programs being configured to be executed by the one or more processors, the one or more programs including instructions for:
    接收与至少一个终端进行视频交互的指令;Receiving an instruction to perform video interaction with at least one terminal;
    建立与所述至少一个终端各自之间的视频交互通道;Establishing a video interaction channel with each of the at least one terminal;
    通过所述摄像头采集所述视频源设备侧的视频图像;Collecting, by the camera, a video image on the video source device side;
    通过与所述至少一个终端各自之间的视频交互通道将所述视频源设备侧的视频图像发送给所述至少一个终端;Transmitting, by the video interaction channel between the at least one terminal, the video image of the video source device side to the at least one terminal;
    其中,所述视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且所述播放设备独立于所述视频源设备之外。The video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
  8. 根据权利要求7所述的视频源设备,其特征在于,所述一个或多个程序还包含用于进行以下操作的指令:The video source device of claim 7, wherein the one or more programs further comprise instructions for:
    通过与所述至少一个终端各自之间的视频交互通道接收所述至少一个终端侧的视频图像,所述至少一个终端侧的视频图像由所述至少一个终端发送; Receiving, by the video interaction channel between the at least one terminal, the video image of the at least one terminal side, where the video image of the at least one terminal side is sent by the at least one terminal;
    将所述至少一个终端侧的视频图像投射到播放设备的显示屏中。The at least one terminal side video image is projected into a display screen of the playback device.
  9. 根据权利要求7所述的视频源设备,其特征在于,所述一个或多个程序还包含用于进行以下操作的指令:The video source device of claim 7, wherein the one or more programs further comprise instructions for:
    在所述播放设备的显示屏中投射终端列表,所述终端列表中包含各个与所述视频源设备绑定的终端的标识;A terminal list is projected in a display screen of the playback device, where the terminal list includes identifiers of terminals that are bound to the video source device;
    接收在所述终端列表中执行的选择操作,所述选择操作是对所述至少一个终端的标识执行的操作。Receiving a selection operation performed in the terminal list, the selection operation being an operation performed on an identification of the at least one terminal.
  10. 根据权利要求7所述的视频源设备,其特征在于,所述一个或多个程序还包含用于进行以下操作的指令:The video source device of claim 7, wherein the one or more programs further comprise instructions for:
    接收所述至少一个终端通过云端服务器发送的视频交互请求;Receiving a video interaction request sent by the at least one terminal through the cloud server;
    在所述播放设备的显示屏中投射交互询问信息,所述交互询问信息用于询问是否接受与所述至少一个终端的视频交互;Transmitting interactive query information in a display screen of the playback device, the interaction query information being used to query whether to accept video interaction with the at least one terminal;
    接收基于所述交互询问信息执行的确认操作,所述确认操作是确认接受与所述至少一个终端的视频交互的操作。Receiving a confirmation operation performed based on the interactive inquiry information, the confirmation operation is an operation of confirming acceptance of a video interaction with the at least one terminal.
  11. 根据权利要求7所述的视频源设备,其特征在于,所述一个或多个程序还包含用于进行以下操作的指令:The video source device of claim 7, wherein the one or more programs further comprise instructions for:
    当所述至少一个终端中包含两个或者两个以上终端时,根据所述两个或者两个以上终端的数量,以及所述视频源设备与所述两个或者两个以上终端各自之间的视频交互通道的建立顺序,确定所述两个或者两个以上终端侧的视频图像的相对位置;When the at least one terminal includes two or more terminals, according to the number of the two or more terminals, and between the video source device and the two or more terminals Determining a sequence of video interaction channels, determining relative positions of video images of the two or more terminal sides;
    视频投射单元,用于根据所述两个或者两个以上终端侧的视频图像的相对位置,将所述两个或者两个以上终端侧的视频图像投射在所述显示屏中。And a video projection unit, configured to project the video images of the two or more terminal sides in the display screen according to the relative positions of the video images of the two or more terminal sides.
  12. 根据权利要求7所述的视频源设备,其特征在于,所述视频源设备为电视机顶盒,所述播放设备为电视机或者显示器。The video source device according to claim 7, wherein the video source device is a television set top box, and the playback device is a television set or a display.
  13. 一种视频交互装置,其特征在于,用于包含有摄像头的视频源设备中,所述装置包括: A video interaction device, characterized in that, in a video source device including a camera, the device includes:
    指令接收模块,用于接收与至少一个终端进行视频交互的指令;An instruction receiving module, configured to receive an instruction for performing video interaction with at least one terminal;
    建立模块,用于建立与所述至少一个终端各自之间的视频交互通道;Establishing a module, configured to establish a video interaction channel with each of the at least one terminal;
    视频采集模块,用于通过所述摄像头采集所述视频源设备侧的视频图像;a video capture module, configured to collect, by using the camera, a video image of the video source device side;
    视频发送模块,用于通过与所述至少一个终端各自之间的视频交互通道将所述视频源设备侧的视频图像发送给所述至少一个终端;a video sending module, configured to send, by using a video interaction channel between the at least one terminal, a video image of the video source device side to the at least one terminal;
    其中,所述视频源设备是播放设备的显示屏中所播放的视频画面的提供设备,且所述播放设备独立于所述视频源设备之外。The video source device is a providing device for a video screen played in a display screen of the playback device, and the playback device is independent of the video source device.
  14. 根据权利要求13所述的装置,其特征在于,所述视频源设备中包含有摄像头,所述装置还包括:The device according to claim 13, wherein the video source device comprises a camera, and the device further comprises:
    视频接收模块,用于通过与所述至少一个终端各自之间的视频交互通道接收所述至少一个终端侧的视频图像,所述至少一个终端侧的视频图像由所述至少一个终端发送;a video receiving module, configured to receive, by using a video interaction channel between the at least one terminal, a video image of the at least one terminal side, where the video image of the at least one terminal side is sent by the at least one terminal;
    视频投射模块,用于将所述至少一个终端侧的视频图像投射到播放设备的显示屏中。a video projection module, configured to project the video image of the at least one terminal side into a display screen of the playback device.
  15. 根据权利要求13所述的装置,其特征在于,所述指令接收模块,包括:The apparatus according to claim 13, wherein the instruction receiving module comprises:
    列表投射单元,用于在所述播放设备的显示屏中投射终端列表,所述终端列表中包含各个与所述视频源设备绑定的终端的标识;a list projection unit, configured to project a terminal list in a display screen of the playback device, where the terminal list includes an identifier of each terminal that is bound to the video source device;
    第一操作接收单元,用于接收在所述终端列表中执行的选择操作,所述选择操作是对所述至少一个终端的标识执行的操作。And a first operation receiving unit, configured to receive a selection operation performed in the terminal list, where the selection operation is an operation performed on an identifier of the at least one terminal.
  16. 根据权利要求13所述的装置,其特征在于,所述指令接收模块,包括:The apparatus according to claim 13, wherein the instruction receiving module comprises:
    请求接收单元,用于接收所述至少一个终端通过云端服务器发送的视频交互请求;a request receiving unit, configured to receive a video interaction request sent by the at least one terminal by using a cloud server;
    信息投射单元,用于在所述播放设备的显示屏中投射交互询问信息,所述交互询问信息用于询问是否接受与所述至少一个终端的视频交互;An information projection unit, configured to project interaction query information in a display screen of the playback device, where the interaction query information is used to query whether to accept video interaction with the at least one terminal;
    第二操作接收单元,用于接收基于所述交互询问信息执行的确认操作,所述确认操作是确认接受与所述至少一个终端的视频交互的操作。And a second operation receiving unit, configured to receive a confirmation operation performed based on the interaction query information, where the confirmation operation is an operation of confirming acceptance of a video interaction with the at least one terminal.
  17. 根据权利要求13所述的装置,其特征在于,所述视频投射模块,包括: The device according to claim 13, wherein the video projection module comprises:
    相对位置确定单元,用于当所述至少一个终端中包含两个或者两个以上终端时,根据所述两个或者两个以上终端的数量,以及所述视频源设备与所述两个或者两个以上终端各自之间的视频交互通道的建立顺序,确定所述两个或者两个以上终端侧的视频图像的相对位置;a relative position determining unit, configured to: when the at least one terminal includes two or more terminals, according to the number of the two or more terminals, and the video source device and the two or two Determining the relative positions of the video images of the two or more terminal sides by establishing a sequence of video interaction channels between the respective terminals;
    视频投射单元,用于根据所述两个或者两个以上终端侧的视频图像的相对位置,将所述两个或者两个以上终端侧的视频图像投射在所述显示屏中。And a video projection unit, configured to project the video images of the two or more terminal sides in the display screen according to the relative positions of the video images of the two or more terminal sides.
  18. 根据权利要求13所述的装置,其特征在于,所述视频源设备为电视机顶盒,所述播放设备为电视机或者显示器。 The apparatus according to claim 13, wherein said video source device is a television set top box, and said playback device is a television set or a display.
PCT/CN2016/088000 2015-07-31 2016-06-30 Video interaction method and apparatus, and video source device WO2017020671A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510466181.1A CN106412648A (en) 2015-07-31 2015-07-31 Video interaction method and device
CN201510466181.1 2015-07-31

Publications (1)

Publication Number Publication Date
WO2017020671A1 true WO2017020671A1 (en) 2017-02-09

Family

ID=57942411

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088000 WO2017020671A1 (en) 2015-07-31 2016-06-30 Video interaction method and apparatus, and video source device

Country Status (2)

Country Link
CN (1) CN106412648A (en)
WO (1) WO2017020671A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114531954A (en) * 2020-09-08 2022-05-24 海信视像科技股份有限公司 Television gateway

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109246381A (en) * 2018-10-09 2019-01-18 深圳市亿联智能有限公司 A kind of sound screen interactive mode based on network machine top box
CN111078901A (en) * 2019-12-25 2020-04-28 北京字节跳动网络技术有限公司 Video-based interaction implementation method, device, equipment and medium
CN113905263B (en) * 2021-10-28 2024-03-26 深圳小湃科技有限公司 Set top box control method, equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070070188A1 (en) * 2005-05-05 2007-03-29 Amtran Technology Co., Ltd Method of audio-visual communication using a television and television using the same
CN101860494A (en) * 2010-04-15 2010-10-13 深圳创维-Rgb电子有限公司 Instant messaging method of network television and network television system
CN102611871A (en) * 2012-01-13 2012-07-25 深圳市同洲电子股份有限公司 Method, system and mobile terminal for video communication and digital television receiving terminal
CN103024590A (en) * 2012-12-11 2013-04-03 四川长虹电器股份有限公司 Method and system for video call between smart terminal and smart TV (television)
CN103634629A (en) * 2013-11-07 2014-03-12 康佳集团股份有限公司 Method and device for sharing camera of mobile terminal by set-top box
CN103686328A (en) * 2013-12-23 2014-03-26 乐视致新电子科技(天津)有限公司 Method and device for adding camera to smart television
CN104427288A (en) * 2013-08-26 2015-03-18 联想(北京)有限公司 Information processing method and server

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201717984U (en) * 2010-06-30 2011-01-19 山东盛华视讯信息有限公司 TV and mobile-phone video call system
CN102857729B (en) * 2012-08-08 2015-07-15 青岛海信宽带多媒体技术有限公司 Set top box based video conversation method and system
CN202918417U (en) * 2012-11-28 2013-05-01 青岛海信宽带多媒体技术有限公司 Video conversation system based on Android set top box
CN103813211B (en) * 2013-07-26 2017-02-15 上海帕科软件科技股份有限公司 IPTV-based video communication system
CN104348989B (en) * 2013-08-05 2017-11-21 中国移动通信集团公司 The method and application server of set top box and call terminal handoff calls
CN103595950A (en) * 2013-11-21 2014-02-19 东方有线网络有限公司 Method for carrying out video communication based on cable digital television set top box
CN104506916A (en) * 2014-12-12 2015-04-08 深圳市天威视讯股份有限公司 Interaction method and device for set-top box and intelligent mobile terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070070188A1 (en) * 2005-05-05 2007-03-29 Amtran Technology Co., Ltd Method of audio-visual communication using a television and television using the same
CN101860494A (en) * 2010-04-15 2010-10-13 深圳创维-Rgb电子有限公司 Instant messaging method of network television and network television system
CN102611871A (en) * 2012-01-13 2012-07-25 深圳市同洲电子股份有限公司 Method, system and mobile terminal for video communication and digital television receiving terminal
CN103024590A (en) * 2012-12-11 2013-04-03 四川长虹电器股份有限公司 Method and system for video call between smart terminal and smart TV (television)
CN104427288A (en) * 2013-08-26 2015-03-18 联想(北京)有限公司 Information processing method and server
CN103634629A (en) * 2013-11-07 2014-03-12 康佳集团股份有限公司 Method and device for sharing camera of mobile terminal by set-top box
CN103686328A (en) * 2013-12-23 2014-03-26 乐视致新电子科技(天津)有限公司 Method and device for adding camera to smart television

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114531954A (en) * 2020-09-08 2022-05-24 海信视像科技股份有限公司 Television gateway

Also Published As

Publication number Publication date
CN106412648A (en) 2017-02-15

Similar Documents

Publication Publication Date Title
US11846877B2 (en) Method and terminal for acquiring panoramic image
WO2017020663A1 (en) Live-comment video live broadcast method and apparatus, video source device, and network access device
US20180139252A1 (en) Network call method and apparatus, terminal, and server
CN106973330B (en) Screen live broadcasting method, device and system
CN104780155A (en) Method and device for binding equipment
WO2016019926A1 (en) Photo shooting method, device, and mobile terminal
TWI612500B (en) A projection device control method, a projection device and a smart terminal
CN109697008B (en) Content sharing method, terminal and computer readable storage medium
CN110210007B (en) Document processing method, terminal and computer equipment
WO2015131768A1 (en) Video processing method, apparatus and system
WO2017215661A1 (en) Scenario-based sound effect control method and electronic device
WO2017020671A1 (en) Video interaction method and apparatus, and video source device
WO2021078215A1 (en) Method for cross-terminal switching of cloud game and related device
CN106791916B (en) Method, device and system for recommending audio data
WO2021190373A1 (en) Interaction method, interaction system, and display device
CN111966254A (en) Image shooting method and device, storage medium and terminal
CN106358064A (en) Method and equipment for controlling television
WO2021052333A1 (en) Message reply method, device, and mobile terminal
CN105376318A (en) File transmission method, device and system
US9007312B2 (en) Device and method for transmitting data in portable terminal
CN108811177B (en) Communication method and terminal
CN107479811A (en) The method and mobile terminal with managing meeting, recording meeting are established in ession for telecommunication
WO2015018211A1 (en) Cooperative playing method, apparatus, device and system
CN110996003B (en) Photographing positioning method and device and mobile terminal
CN114126083A (en) Cross-network-segment wireless screen projection method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16832159

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10.07.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16832159

Country of ref document: EP

Kind code of ref document: A1