WO2018059352A1 - Remote control method and apparatus for live video stream - Google Patents

Remote control method and apparatus for live video stream Download PDF

Info

Publication number
WO2018059352A1
WO2018059352A1 PCT/CN2017/103189 CN2017103189W WO2018059352A1 WO 2018059352 A1 WO2018059352 A1 WO 2018059352A1 CN 2017103189 W CN2017103189 W CN 2017103189W WO 2018059352 A1 WO2018059352 A1 WO 2018059352A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
video stream
live video
field control
anchor
Prior art date
Application number
PCT/CN2017/103189
Other languages
French (fr)
Chinese (zh)
Inventor
曹雨
Original Assignee
广州华多网络科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州华多网络科技有限公司 filed Critical 广州华多网络科技有限公司
Publication of WO2018059352A1 publication Critical patent/WO2018059352A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44222Analytics of user selections, e.g. selection of programs or purchase activity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server

Definitions

  • the present invention relates to the field of multimedia data processing technologies, and in particular, to a method and device for remote control of a live video stream.
  • the viewing user can only see the face of the anchor and cannot see the overall effect.
  • the zoom function of the mobile phone is already available, the current mobile phone broadcast does not support zooming, and the adjustment of the focal length of the camera when the anchor is shooting is undoubtedly extremely inconvenient and affects the shooting effect.
  • the existing live broadcast platform does not have the focus adjustment function, and the limitation of the focus adjustment by the anchor operation is urgently needed for the expansion of the live broadcast zoom function of the mobile phone.
  • An object of the present invention is to provide a method and a device for remote control of a live video stream, which at least solves the problem that the live platform cannot adjust the shooting focal length in the related art.
  • a live video stream remote control method includes the following steps: establishing an authorized connection with an anchor user, obtaining a focus adjustment authority of the anchor user, and acquiring and displaying a live video stream of the anchor user; Receiving a focus adjustment control instruction for the live video stream, and transmitting a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
  • the establishing an authorized connection with the anchor user includes: establishing, by the server, a channel for forwarding data with the anchor user.
  • the method further includes the steps of: responding to the request command of the anchor user to call the field control user control issued by the server; and/or issuing a request to the server to open the focus adjustment authority of the anchor user.
  • the request receives information that the anchor user feedbacks to the field control user.
  • the obtaining and displaying the live video stream of the anchor user includes the steps of: parsing the obtained video stream, and displaying the parsed video stream on a screen.
  • the step further includes: displaying a focus adjustment control interface in the live video stream display area.
  • the operation of the focus instruction includes one or more of a voice operation, a gesture touch operation, and a key operation.
  • a live video stream remote control method includes: establishing an authorized connection with a field control user, opening a focus adjustment authority to the field control user; providing the field control user with a live video stream formed by the camera device; and responding to the received field
  • the user's focus adjustment command is controlled to change the shooting focal length of the camera device to change the image effect of the live video stream provided to the field control user.
  • a live video stream remote control device includes: a first connection establishing module, configured to establish an authorized connection with an anchor user, and obtain a focus adjustment permission of the anchor user; and a display module, configured to acquire and display a live video stream of the anchor user;
  • the transceiver module is configured to receive a focus adjustment control instruction for the live video stream, and send a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
  • a live video stream remote control device includes: a second establishing connection module, configured to establish an authorized connection with the field control user, and open a focus adjustment authority to the field control user; and a sending module, configured to provide the field control user with the camera device Shooting a formed live video stream; the response module is configured to change a shooting focal length of the camera device in response to the received focus command of the field control user to change an image effect of the live video stream provided to the field control user .
  • a terminal device for implementing remote control of a live video stream comprising: a touch sensitive display; one or more processors; a memory; the one or more processors configured to perform The steps of any of the methods described above. .
  • the present invention has the following advantages:
  • the anchor user is authorized by the anchor user to remotely control the focal length of the camera at the anchor site, and the field control user controls the focal length of the camera at the anchor site according to actual needs, thereby changing the display on the field control user ( That is to say, the image effect exhibited by the video stream on the side of the user is viewed; the limitation problem of the operation of the anchor itself is solved, and the focal length of the shooting is adjusted from the viewer side to better combine the visual needs of the anchor user and the viewing user. Improve the user experience.
  • the field control user controls the shooting focal length, that is, after the anchor user receives the corresponding focusing operation command from the field control user, the bottom layer API interface provided by the camera is called to realize the zoom function, which is not the original image after the recording. Zooming in, you can maintain the original quality of the recording (its definition depends on the camera), and can maximize the adaptation to the scene information.
  • FIG. 1 is a flowchart of a method for remote control of a live video stream according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of a method for remote control of a live video stream according to another embodiment of the present invention.
  • FIG. 3 is a block diagram of a live video stream remote control apparatus according to an embodiment of the present invention.
  • FIG. 4 is a block diagram of a live video stream remote control apparatus according to another embodiment of the present invention.
  • FIG. 5 is a block diagram of a terminal device according to an embodiment of the present invention.
  • terminal and terminal device used herein include both a wireless signal receiver device, a device having only a wireless signal receiver without a transmitting capability, and a receiving and transmitting hardware.
  • Such devices may include cellular or other communication devices having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data Processing, fax, and/or data communication capabilities; PDA (Personal Digital Assistant), which can include radio frequency receivers, pagers, Internet/Intranet access, web browsers, notepads, calendars, and/or GPS (Global Positioning System (Global Positioning System) receiver; conventional laptop and/or palmtop computer or other device having a conventional laptop and/or palmtop computer or other device that includes and/or includes a radio frequency receiver.
  • PCS Personal Communications Service
  • PDA Personal Digital Assistant
  • terminal may be portable, transportable, installed in a vehicle (aviation, sea and/or land), or adapted and/or configured to operate locally, and/or Run in any other location on the Earth and/or space in a distributed form.
  • the "terminal” and “terminal device” used herein may also be a communication terminal, an internet terminal, a music/video playing terminal, and may be, for example, a PDA, a MID (Mobile Internet Device), and/or have a music/video playback.
  • Functional mobile phones can also be smart TVs, set-top boxes and other devices.
  • Live broadcast platform The live webcast is aimed at real-time social needs, using the Internet and multimedia communication technology to build a multi-functional webcast platform, enterprise or individual that integrates audio, video, desktop sharing, document sharing and interactive links on the network. You can use this live platform to go online Comprehensive communication and interaction of voice, video and data.
  • the webcast room is a virtual space (or virtual room) created based on the webcast platform.
  • the live broadcast room is usually created by the anchor client and connected to multiple viewing clients.
  • the live broadcast room includes the anchor and multiple viewers.
  • the viewing client located in the virtual space can watch the live content of the anchor client, and the interaction between the user of the anchor client and the user who views the client, the user who views the client, and the user who views the client can also perform voice, picture or text interaction.
  • the anchor is mainly responsible for participating in a program or event on the Internet, from planning, editing, recording, production, audience interaction, etc., and acting as the host.
  • Field control refers to the scene controller (administrator), for example, in the YY voice and toot voice platform, the field control is the administrator of the channel guild, that is, the short name of the field controller.
  • the field control is mainly a friend who broadcasts an invitation or a call to adjust the shooting focal length of the shooting device at the scene of the anchor or a viewer who watches the live broadcast.
  • a computer that manages resources and provides services to users.
  • it can record an authorization relationship corresponding to an anchor user and a field control user, and forward data information between each other.
  • the terminal to which the method of the present invention is applied is not limited to the type of its operating system, and may be an operating system such as Android, iOS, or Symbian.
  • an operating system such as Android, iOS, or Symbian.
  • S11 establishes an authorized connection with the anchor user, and obtains a focus adjustment permission of the anchor user
  • the field control user can establish a channel for forwarding data with the anchor user through the server when establishing an authorized connection with the anchor user. After the two parties are connected, it is possible to start the control of the focus adjustment remote assistance between the users.
  • the field control user before the field control user establishes a focus adjustment remote assistance authorization connection with the anchor user, the field control user can know that the anchor user needs focus adjustment remote assistance by: the field control user receiving server sends the The call request of the anchor user; determining whether the anchor user initiating the call is a user in the remote assistance list of the field control user; if the determination result is yes, initiating a request for the focus adjustment remote assistance anchor user to the server.
  • related controls for remote assistance can be installed in the anchor user, and the control is used to initiate the field control user. The call is requested, and the call is terminated within a short time after the field control user connects the call, and the call can be terminated in one second.
  • the user can receive the short message to know that the anchor user needs to perform remote assistance, so that the anchor user can timely respond to the anchor when the remote user needs remote assistance.
  • the user performs remote assistance.
  • the manner in which the field control user establishes an authorized connection with the anchor user also includes the field control user actively requesting the anchor user to open the focus adjustment authority: the field control user according to the remote assistance habit of controlling the focus adjustment with the anchor user (the server record has The authorization control relationship and information between the field control user and the anchor user) actively initiates a request for open focus adjustment authority to the anchor user at a required time or in a specific environment, and the anchor user makes the open request forwarded by the server according to actual needs.
  • the field control user can remotely control the focus adjustment of the anchor user.
  • S12 acquires and displays a live video stream of the anchor user
  • the live video stream sent by the anchor user may be obtained.
  • the field control user will parse the obtained video stream. Processing, and displaying the parsed video stream on the field control user screen.
  • S13 receives a focus adjustment control instruction for the live video stream, and sends a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
  • the field control user After the field control user enters the live broadcast room where the anchor user is located, after receiving the video stream sent by the anchor user and the focus adjustment control instruction of the live video stream of the anchor user, the field control user according to the display
  • the video content on the screen such as the distance of the anchor from the camera, the attitude of the anchor, the environment change between the anchors, and the like, determine whether to adjust the shooting focal length of the video stream.
  • the focal length adjustment control button of the camera device on the field control user end or the focus adjustment control interface displayed in the video stream display area is controlled.
  • the anchor user will be sent a corresponding focusing instruction, and when the anchor user receives an operation instruction of the field control user to adjust the focus of the camera, the anchor user is Zooming is achieved by calling the corresponding API interface.
  • the operation mode of the focus adjustment instruction on the side of the field control user includes one or more of a voice operation, a gesture touch operation, and a key operation.
  • the image effect of the frequency stream; wherein the image effect finally presented is the better scene information that the anchor user can obtain according to actual needs after adjusting the focal length of the camera according to the received operation instruction. Problems such as the sharpness of the image effect will depend entirely on the hardware capabilities of the anchor user's camera. Further, in the embodiment, the adjustment of the focal length of the camera device is only the content of the screen displayed on the screen, and has no influence on the parameters, codec, uplink, and downlink of the video stream itself.
  • FIG. 2 Please refer to FIG. 2,
  • S21 establishes an authorized connection with the field control user, and opens the focus adjustment authority to the field control user;
  • the anchor user can establish a channel for forwarding data with the field control user through the server when establishing an authorized connection with the field control user. After the two parties are connected, it is possible to start the control of the focus adjustment remote assistance between the users.
  • the anchor user before the anchor user establishes a focus adjustment remote control authorization connection with the field control user, the anchor user can know that the field control user needs to assist the anchor user to perform focus adjustment remote control by: The user sends a call request to the server to request the remote control of the field control user, and the initiation of the call request may be related to installing the remote assistance in the anchor user, or sending a short message to the field control user to make the field control user Know that remote assistance is required for the anchor user.
  • the manner in which the anchor user establishes an authorized connection with the field control user further includes the field control user actively requesting the anchor user to open the focus adjustment authority: the remote control habit of the field control user according to the focus adjustment control with the anchor user (the server record has The authorization control relationship and information between the field control user and the anchor user) actively initiates a request for open focus adjustment authority to the anchor user at a required time or in a specific environment, and the anchor user makes the open request forwarded by the server according to actual needs.
  • the field control user can remotely control the focus adjustment of the anchor user.
  • S22 provides the field control user with a live video stream formed by the camera device
  • the anchor user When the field control user enters the live broadcast room where the anchor user is located, the anchor user will send a live video stream formed by the camera device to the field control user. When the field control is used After receiving the live video stream, the user will parse the obtained video stream, and display the parsed video stream on the field control user screen.
  • S23 is responsive to the received focus command of the field control user, according to which the shooting focal length of the camera device is changed to change the image effect of the live video stream provided to the field control user.
  • the field control user determines whether to adjust the shooting focal length of the video stream according to various factors such as the distance of the video displayed on the screen, such as the distance of the anchor from the camera, the attitude of the anchor, and the environment change between the anchors.
  • the focal length adjustment control button of the camera device on the field control user end or the focus adjustment control interface displayed in the video stream display area is controlled.
  • the anchor user will receive a corresponding focusing instruction issued by the field control user, and in response to the focusing instruction, the anchor user invokes the corresponding API.
  • the interface achieves zooming.
  • the operation mode of the focus instruction on the side of the field control user includes one or more of a voice operation, a gesture touch operation, and a key operation.
  • the image effect finally presented is a problem that the anchor user can obtain the better scene information according to actual needs after adjusting the focal length of the camera according to the received operation instruction, and the image effect is clear. It will depend entirely on the hardware capabilities of the anchor user's camera. Further, in the embodiment, the adjustment of the focal length of the camera device is only the content of the screen displayed on the screen, and has no influence on the parameters, codec, uplink, and downlink of the video stream itself.
  • the embodiment applied to the side of the field control user includes the following modules. Please refer to FIG. 3:
  • the first connection module 11, the display module 12, and the transceiver module 13 are established.
  • the first establishing connection module 11 is configured to establish an authorized connection with the anchor user, and obtain a focus adjustment authority of the anchor user;
  • the display module 12 is configured to acquire and display a live video stream of the anchor user.
  • the transceiver module 13 is configured to receive a focus adjustment control instruction for the live video stream, and send a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
  • the embodiment applied to the side of the anchor user includes the following modules. Please refer to FIG. 4:
  • the second connection module 21, the sending module 22, and the response module 23 are established.
  • the second establishing connection module 21 is configured to establish an authorized connection with the field control user, and open the focus adjustment authority to the field control user;
  • the sending module 22 is configured to provide the field control user with a live video stream formed by the camera device;
  • the response module 23 is configured to change the shooting focal length of the camera device in response to the received focus command of the field control user to change the image effect of the live video stream provided to the field control user.
  • the present invention also provides a terminal device. As shown in FIG. 5, for the convenience of description, only parts related to the embodiment of the present invention are shown. For details that are not disclosed, refer to the method part of the embodiment of the present invention.
  • the terminal may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), an in-vehicle computer, and the terminal is a mobile phone as an example:
  • FIG. 5 is a block diagram showing a partial structure of a mobile phone related to a terminal provided by an embodiment of the present invention.
  • the mobile phone includes: a radio frequency (RF) circuit 510, a memory 520, an input unit 530, a display unit 540, a sensor 550, an audio circuit 560, a wireless fidelity (WiFi) module 570, and a processor 580. And power supply 590 and other components.
  • RF radio frequency
  • the RF circuit 510 can be used for receiving and transmitting signals during the transmission or reception of information or during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 580. In addition, the uplink data is designed to be sent to the base station.
  • RF circuit 510 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. This In addition, RF circuitry 510 can also communicate with the network and other devices via wireless communication.
  • the above wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division). Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), and the like.
  • GSM Global System of Mobile communication
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • E-mail Short Messaging Service
  • the memory 520 can be used to store software programs and modules, and the processor 580 executes various functional applications and data processing of the mobile phone by running software programs and modules stored in the memory 520.
  • the memory 520 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.).
  • memory 520 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the input unit 530 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the handset.
  • the input unit 530 may include a touch panel 531 and other input devices 532.
  • the touch panel 531 also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 531 or near the touch panel 531. Operation), and drive the corresponding connecting device according to a preset program.
  • the touch panel 531 can include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 580 is provided and can receive commands from the processor 580 and execute them.
  • the touch panel 531 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 530 may also include other input devices 532. Specifically, other input devices 532 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • the display unit 540 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone.
  • the display unit 540 can include a display panel 541. Alternatively, a liquid crystal can be used.
  • the display panel 541 is configured in the form of a display (LCD), an organic light-emitting diode (OLED), or the like.
  • the touch panel 531 can cover the display panel 541. When the touch panel 531 detects a touch operation on or near it, the touch panel 531 transmits to the processor 580 to determine the type of the touch event, and then the processor 580 according to the touch event. The type provides a corresponding visual output on display panel 541.
  • touch panel 531 and the display panel 541 are used as two independent components to implement the input and input functions of the mobile phone in FIG. 5, in some embodiments, the touch panel 531 and the display panel 541 may be integrated. Realize the input and output functions of the phone.
  • the handset may also include at least one type of sensor 550, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 541 according to the brightness of the ambient light, and the proximity sensor may close the display panel 541 and/or when the mobile phone moves to the ear. Or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the mobile phone can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
  • the gesture of the mobile phone such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration
  • vibration recognition related functions such as pedometer, tapping
  • the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
  • Audio circuit 560, speaker 561, and microphone 562 provide an audio interface between the user and the handset.
  • the audio circuit 560 can transmit the converted electrical data of the received audio data to the speaker 561, and convert it into a sound signal output by the speaker 561.
  • the microphone 562 converts the collected sound signal into an electrical signal, and the audio circuit 560 is used by the audio circuit 560. After receiving, it is converted into audio data, and then processed by the audio data output processor 580, sent to the other mobile phone via the RF circuit 510, or outputted to the memory 520 for further processing.
  • WiFi is a short-range wireless transmission technology
  • the mobile phone can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 570, which provides users with wireless broadband Internet access.
  • FIG. 5 shows the WiFi module 570, it can be understood that it does not belong to the essential configuration of the mobile phone, and may be omitted as needed within the scope of not changing the essence of the invention.
  • the processor 580 is the control center of the handset, and connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in the memory 520, and invoking data stored in the memory 520, executing The phone's various functions and processing data, so that the overall monitoring of the phone.
  • the processor 580 can include one or more processing units; preferably, The processor 580 can integrate an application processor and a modem processor, wherein the application processor primarily processes an operating system, a user interface, an application, etc., and the modem processor primarily processes wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 580.
  • the handset also includes a power source 590 (such as a battery) that supplies power to the various components.
  • a power source 590 such as a battery
  • the power source can be logically coupled to the processor 580 via a power management system to manage functions such as charging, discharging, and power management through the power management system.
  • the mobile phone may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
  • the processor 580 included in the terminal is further configured to perform the steps of the method as described in Embodiments 1 and 2.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the program may be stored in a computer readable storage medium, and the storage medium may include: Read Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.
  • ROM Read Only Memory
  • RAM Random Access Memory
  • Embodiment 5 (Application Example)
  • the anchor user makes a request for the remote control call to the field control user: Assume that the anchor wants to broadcast a dance choreography video, but since the current live broadcast platform does not support focus adjustment, and the anchor is in the process of dancing, it is impossible to real-time on its own camera device.
  • the focal length is adjusted so that when the different dance movements are beating, the details of the dance posture are actually displayed.
  • the anchor can remotely control the shooting focal length of its own camera by calling a friend or watching the viewer. After the friend user or the viewing user accepts the remote control request from the anchor user, the user will become the field control user. When they enter the live broadcast room of the live broadcast choreography video, they can receive the video sent by the anchor.
  • the focal length of the shooting of the anchor shooting device can be changed by controlling the shooting device of the field control itself or the focus adjustment interface displayed in the video playing area, thereby realizing that the main body exhibits different dancing postures. According to the actual adjustment of the focal length of the shooting device on the anchor site, a better viewing picture is obtained.
  • the field control changes the focal length of the photographing device to operate by a gesture recognition operation or a focus adjustment button of a specific photographing device.

Abstract

Provided by the present invention is a remote control method for a live video stream, comprising the following steps: establishing an authorized connection to an anchor user, and acquiring a focus adjustment permission of the anchor user; acquiring and displaying a live video stream of the anchor user; receiving a focus adjustment control instruction for the live video stream, and sending a corresponding focus instruction to the anchor user so as to change the shooting focus of the live video stream. Also provided is an apparatus, comprising: a first connection-establishing module, a display module and a transceiver module. By means of said technical solution, the present invention may adjust the shooting focus of a live video stream using a remote control mode.

Description

直播视频流远程控制方法及装置Live video stream remote control method and device 【技术领域】[Technical Field]
本发明涉及多媒体数据处理技术领域,具体涉及一种直播视频流远程控制方法及装置。The present invention relates to the field of multimedia data processing technologies, and in particular, to a method and device for remote control of a live video stream.
【背景技术】【Background technique】
随着手机直播平台的趋势化,其节目形式也越来越丰富。用户可以通过手机直播应用程序将手机拍摄的视频内容实时上传到平台,通过视频直播的形式与朋友和家人即时分享身边发生的每一个精彩瞬间。当用户与好友分享新的视频时,可以通过短信提醒的方式给好友发送提示,好友可以通过电脑登录观看,也可以直接从手机上点击观看视频,从而轻松地与好友保持动态联系。然而,当用户打开程序,对准目标进行拍摄时,特别是对于主播距离摄像头比较远的节目,常常会出现观看用户只能看到整体的效果而无法看清主播的面部或者是主播距离摄像头太近,观看用户仅能看到主播的面部而无法观看整体效果。于此,对于形式丰富的节目类,需要在直播过程中调节摄像头的焦距,在不同的时刻拍摄不同的场景细节。然而,虽然手机拍摄时的变焦功能是已有的,但是目前的手机直播不支持变焦,且让主播在拍摄视频时进行摄像头焦距的调节无疑是极为不方便且影响拍摄效果的。With the trend of mobile live broadcast platforms, the form of its programs is becoming more and more abundant. Users can upload the video content captured by the mobile phone to the platform in real time through the mobile phone live application, and instantly share every wonderful moment happening with friends and family through live video. When a user shares a new video with a friend, the user can send a prompt by means of a short message reminder, the friend can log in through the computer to watch, or directly click on the video from the mobile phone to easily maintain dynamic contact with the friend. However, when the user opens the program and shoots at the target, especially for programs whose anchor distance is far from the camera, it is often seen that the user can only see the overall effect and cannot see the anchor's face or the anchor distance from the camera. Nearly, the viewing user can only see the face of the anchor and cannot see the overall effect. Here, for a richly-formed program class, it is necessary to adjust the focal length of the camera during the live broadcast, and take different scene details at different times. However, although the zoom function of the mobile phone is already available, the current mobile phone broadcast does not support zooming, and the adjustment of the focal length of the camera when the anchor is shooting is undoubtedly extremely inconvenient and affects the shooting effect.
介于现有直播平台不具备焦距调节功能,且主播操作调节焦距的局限性,对于手机直播变焦功能的扩展是急需的。The existing live broadcast platform does not have the focus adjustment function, and the limitation of the focus adjustment by the anchor operation is urgently needed for the expansion of the live broadcast zoom function of the mobile phone.
【发明内容】[Summary of the Invention]
本发明的目的在于提供一种直播视频流远程控制方法及装置,其至少解决了相关技术中直播平台无法调节拍摄焦距的问题。An object of the present invention is to provide a method and a device for remote control of a live video stream, which at least solves the problem that the live platform cannot adjust the shooting focal length in the related art.
为实现该目的,本发明采用如下技术方案:To achieve this, the present invention adopts the following technical solutions:
一种直播视频流远程控制方法,包括以下步骤:建立与主播用户的授权连接,获取主播用户的焦距调节权限;获取并显示主播用户的直播视频流; 接收对所述直播视频流的焦距调节控制指令,发送相应的调焦指令给所述主播用户,以改变拍摄所述直播视频流的焦距。A live video stream remote control method includes the following steps: establishing an authorized connection with an anchor user, obtaining a focus adjustment authority of the anchor user, and acquiring and displaying a live video stream of the anchor user; Receiving a focus adjustment control instruction for the live video stream, and transmitting a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
其中,所述建立与主播用户的授权连接包括:通过服务器建立与所述主播用户之间用于转发数据的通道。The establishing an authorized connection with the anchor user includes: establishing, by the server, a channel for forwarding data with the anchor user.
其中,所述建立与主播用户的授权连接之前还包括步骤:应答服务器发出的所述主播用户呼叫场控用户控制的请求指令;和/或,向服务器发出请求所述主播用户开放焦距调节权限的请求;接收服务器反馈的所述主播用户向场控用户开放权限的信息。Before the establishing the authorized connection with the anchor user, the method further includes the steps of: responding to the request command of the anchor user to call the field control user control issued by the server; and/or issuing a request to the server to open the focus adjustment authority of the anchor user. The request receives information that the anchor user feedbacks to the field control user.
其中,所述获取并显示主播用户的直播视频流包括步骤:将获取到的所述视频流进行解析处理,并将解析后的所述视频流显示在屏幕上。The obtaining and displaying the live video stream of the anchor user includes the steps of: parsing the obtained video stream, and displaying the parsed video stream on a screen.
进一步地,所述步骤接收对所述直播视频流的焦距调节控制指令之后还包括:于所述直播视频流显示区域显示焦距调节控制界面。Further, after the step of receiving the focus adjustment control instruction for the live video stream, the step further includes: displaying a focus adjustment control interface in the live video stream display area.
其中,所述调焦指令的操作包括语音操作、手势触控操作和按键操作中的一种或多种。The operation of the focus instruction includes one or more of a voice operation, a gesture touch operation, and a key operation.
一种直播视频流远程控制方法,包括:建立与场控用户的授权连接,向场控用户开放焦距调节权限;向场控用户提供由摄像装置拍摄形成的直播视频流;响应于接收到的场控用户的调焦指令,据之改变摄像装置的拍摄焦距,以改变提供给所述场控用户的直播视频流的图像效果。A live video stream remote control method includes: establishing an authorized connection with a field control user, opening a focus adjustment authority to the field control user; providing the field control user with a live video stream formed by the camera device; and responding to the received field The user's focus adjustment command is controlled to change the shooting focal length of the camera device to change the image effect of the live video stream provided to the field control user.
一种直播视频流远程控制装置,包括:第一建立连接模块,用于建立与主播用户的授权连接,获取主播用户的焦距调节权限;显示模块,用于获取并显示主播用户的直播视频流;收发模块,用于接收对所述直播视频流的焦距调节控制指令,发送相应的调焦指令给所述主播用户,以改变拍摄所述直播视频流的焦距。A live video stream remote control device includes: a first connection establishing module, configured to establish an authorized connection with an anchor user, and obtain a focus adjustment permission of the anchor user; and a display module, configured to acquire and display a live video stream of the anchor user; The transceiver module is configured to receive a focus adjustment control instruction for the live video stream, and send a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
一种直播视频流远程控制装置,包括:第二建立连接模块,用于建立与场控用户的授权连接,向场控用户开放焦距调节权限;发送模块,用于向场控用户提供由摄像装置拍摄形成的直播视频流;响应模块,用于响应于接收到的场控用户的调焦指令,据之改变摄像装置的拍摄焦距,以改变提供给所述场控用户的直播视频流的图像效果。A live video stream remote control device includes: a second establishing connection module, configured to establish an authorized connection with the field control user, and open a focus adjustment authority to the field control user; and a sending module, configured to provide the field control user with the camera device Shooting a formed live video stream; the response module is configured to change a shooting focal length of the camera device in response to the received focus command of the field control user to change an image effect of the live video stream provided to the field control user .
一种终端设备,用于实现直播视频流远程控制,包括:触敏显示器;一个或多个处理器;存储器;所述一个或多个处理器被配置为用于执行如 上所述任意一项所述方法的步骤。。A terminal device for implementing remote control of a live video stream, comprising: a touch sensitive display; one or more processors; a memory; the one or more processors configured to perform The steps of any of the methods described above. .
与现有技术相比,本发明具备如下优点:Compared with the prior art, the present invention has the following advantages:
(1)通过主播用户向场控用户授权对主播现场的拍摄装置的焦距进行远程控制,场控用户根据实际需求,通过远程调节控制主播现场的拍摄装置的焦距,从而改变了显示在场控用户(即观看用户)一侧的视频流所展现的图像效果;解决了主播自身操作的局限性问题,且从观众一侧去调整拍摄的焦距,更好地结合了主播用户和观看用户的视觉需求,提高了用户体验。(1) The anchor user is authorized by the anchor user to remotely control the focal length of the camera at the anchor site, and the field control user controls the focal length of the camera at the anchor site according to actual needs, thereby changing the display on the field control user ( That is to say, the image effect exhibited by the video stream on the side of the user is viewed; the limitation problem of the operation of the anchor itself is solved, and the focal length of the shooting is adjusted from the viewer side to better combine the visual needs of the anchor user and the viewing user. Improve the user experience.
(2)本发明中通过场控用户对拍摄焦距进行控制,即主播用户接收到场控用户发出相应的调焦操作指令后,调用摄像头提供的底层API接口实现变焦功能,并非对录制后的原图进行缩放,可以保持录制的原有画质(其清晰度取决于拍摄装置),并能够最大限度地适应需求获取景物信息。(2) In the present invention, the field control user controls the shooting focal length, that is, after the anchor user receives the corresponding focusing operation command from the field control user, the bottom layer API interface provided by the camera is called to realize the zoom function, which is not the original image after the recording. Zooming in, you can maintain the original quality of the recording (its definition depends on the camera), and can maximize the adaptation to the scene information.
显然,上述有关本发明优点的描述是概括性的,更多的优点描述将体现在后续的实施例揭示中,以及,本领域技术人员也可以本发明所揭示的内容合理地发现本发明的其他诸多优点。It is apparent that the above description of the advantages of the present invention is general, and more advantages will be described in the following embodiments, and those skilled in the art can also reasonably discover other aspects of the present invention. Many advantages.
本发明附加的方面和优点将在下面的描述中部分给出,这些将从下面的描述中变得明显,或通过本发明的实践了解到。The additional aspects and advantages of the invention will be set forth in part in the description which follows.
【附图说明】[Description of the Drawings]
图1为本发明一个实施例的直播视频流远程控制方法的流程图。FIG. 1 is a flowchart of a method for remote control of a live video stream according to an embodiment of the present invention.
图2为本发明另一个实施例的直播视频流远程控制方法的流程图。FIG. 2 is a flowchart of a method for remote control of a live video stream according to another embodiment of the present invention.
图3为本发明一个实施例的直播视频流远程控制装置的框图。FIG. 3 is a block diagram of a live video stream remote control apparatus according to an embodiment of the present invention.
图4为本发明另一个实施例的直播视频流远程控制装置的框图。4 is a block diagram of a live video stream remote control apparatus according to another embodiment of the present invention.
图5为本发明一个实施例的终端设备的框图。FIG. 5 is a block diagram of a terminal device according to an embodiment of the present invention.
【具体实施方式】【detailed description】
在本发明的说明书和权利要求书及上述附图中的描述的一些流程中,包含了按照特定顺序出现的多个操作,但是应该清楚了解,这些操作可以不按照其在本文中出现的顺序来执行或并行执行,操作的序号如101、102等,仅仅是用于区分开各个不同的操作,序号本身不代表任何的执行顺序。另外,这些流程可以包括更多或更少的操作,并且这些操作可以按顺序执行或并行 执行。需要说明的是,本文中的“第一”、“第二”等描述,是用于区分不同的消息、设备、模块等,不代表先后顺序,也不限定“第一”和“第二”是不同的类型。In the flow of the description of the invention and the claims and the above-described figures, a plurality of operations in a particular order are included, but it should be clearly understood that these operations may not follow the order in which they appear in this document. Execution or parallel execution, the serial number of the operation such as 101, 102, etc., is only used to distinguish different operations, and the serial number itself does not represent any execution order. In addition, these processes can include more or fewer operations, and these operations can be performed sequentially or in parallel. carried out. It should be noted that the descriptions of “first” and “second” in this document are used to distinguish different messages, devices, modules, etc., and do not represent the order, nor the “first” and “second”. It is a different type.
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
本技术领域技术人员可以理解,这里所使用的“终端”、“终端设备”既包括无线信号接收器的设备,其仅具备无发射能力的无线信号接收器的设备,又包括接收和发射硬件的设备,其具有能够在双向通信链路上,进行双向通信的接收和发射硬件的设备。这种设备可以包括:蜂窝或其他通信设备,其具有单线路显示器或多线路显示器或没有多线路显示器的蜂窝或其他通信设备;PCS(Personal Communications Service,个人通信系统),其可以组合语音、数据处理、传真和/或数据通信能力;PDA(Personal Digital Assistant,个人数字助理),其可以包括射频接收器、寻呼机、互联网/内联网访问、网络浏览器、记事本、日历和/或GPS(Global Positioning System,全球定位系统)接收器;常规膝上型和/或掌上型计算机或其他设备,其具有和/或包括射频接收器的常规膝上型和/或掌上型计算机或其他设备。这里所使用的“终端”、“终端设备”可以是便携式、可运输、安装在交通工具(航空、海运和/或陆地)中的,或者适合于和/或配置为在本地运行,和/或以分布形式,运行在地球和/或空间的任何其他位置运行。这里所使用的“终端”、“终端设备”还可以是通信终端、上网终端、音乐/视频播放终端,例如可以是PDA、MID(Mobile Internet Device,移动互联网设备)和/或具有音乐/视频播放功能的移动电话,也可以是智能电视、机顶盒等设备。Those skilled in the art can understand that the "terminal" and "terminal device" used herein include both a wireless signal receiver device, a device having only a wireless signal receiver without a transmitting capability, and a receiving and transmitting hardware. A device having a receiving and transmitting hardware capable of two-way communication over a two-way communication link. Such devices may include cellular or other communication devices having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data Processing, fax, and/or data communication capabilities; PDA (Personal Digital Assistant), which can include radio frequency receivers, pagers, Internet/Intranet access, web browsers, notepads, calendars, and/or GPS (Global Positioning System (Global Positioning System) receiver; conventional laptop and/or palmtop computer or other device having a conventional laptop and/or palmtop computer or other device that includes and/or includes a radio frequency receiver. As used herein, "terminal", "terminal device" may be portable, transportable, installed in a vehicle (aviation, sea and/or land), or adapted and/or configured to operate locally, and/or Run in any other location on the Earth and/or space in a distributed form. The "terminal" and "terminal device" used herein may also be a communication terminal, an internet terminal, a music/video playing terminal, and may be, for example, a PDA, a MID (Mobile Internet Device), and/or have a music/video playback. Functional mobile phones can also be smart TVs, set-top boxes and other devices.
本发明所涉及到的名词:The nouns related to the present invention:
直播平台:网络视频直播是针对实时社交需求,利用互联网和多媒体通信技术,通过在网络上构建一个集音频、视频、桌面共享、文档共享、互动环节为一体的多功能网络直播平台,企业或个人可以利用此直播平台在线进 行语音、视频、数据的全面交流与互动。Live broadcast platform: The live webcast is aimed at real-time social needs, using the Internet and multimedia communication technology to build a multi-functional webcast platform, enterprise or individual that integrates audio, video, desktop sharing, document sharing and interactive links on the network. You can use this live platform to go online Comprehensive communication and interaction of voice, video and data.
直播间:网络直播间是基于网络直播平台创建的一个虚拟空间(或虚拟房间),直播间一般由主播客户端创建并连接有多个观看客户端,即直播间中包括了主播及多个观众,位于该虚拟空间内的观看客户端可以观看主播客户端的直播内容,同时主播客户端的用户与观看客户端的用户、观看客户端的用户与观看客户端的用户之间还可以进行语音、图片或文字的互动Live room: The webcast room is a virtual space (or virtual room) created based on the webcast platform. The live broadcast room is usually created by the anchor client and connected to multiple viewing clients. The live broadcast room includes the anchor and multiple viewers. The viewing client located in the virtual space can watch the live content of the anchor client, and the interaction between the user of the anchor client and the user who views the client, the user who views the client, and the user who views the client can also perform voice, picture or text interaction.
主播:主播主要负责参与互联网中的一档节目或活动,从策划、编辑、录制、制作、观众互动等一系列工作,并担当主持工作。Anchor: The anchor is mainly responsible for participating in a program or event on the Internet, from planning, editing, recording, production, audience interaction, etc., and acting as the host.
场控:指场面控制者(管理员),例如在YY语音和嘟嘟语音平台中,场控就是频道公会的管理员,即场控管理员的简称。而在本发明中,场控主要为主播邀请或呼叫对其主播现场的拍摄装置的拍摄焦距进行调节的好友或观看直播的观众。Field control: refers to the scene controller (administrator), for example, in the YY voice and toot voice platform, the field control is the administrator of the channel guild, that is, the short name of the field controller. In the present invention, the field control is mainly a friend who broadcasts an invitation or a call to adjust the shooting focal length of the shooting device at the scene of the anchor or a viewer who watches the live broadcast.
服务器:一个管理资源并为用户提供服务的计算机,本发明中其可记录对应于主播用户及场控用户间的授权关系,及转发相互间的数据信息。Server: A computer that manages resources and provides services to users. In the present invention, it can record an authorization relationship corresponding to an anchor user and a field control user, and forward data information between each other.
实施例一Embodiment 1
适用本发明所述方法的终端不限制于其操作系统的类型,可以是Android、iOS、塞班等操作系统。为了说明本发明的直播视频流远程控制方法的详细实现过程,请参阅图1,该方法包括如下步骤:The terminal to which the method of the present invention is applied is not limited to the type of its operating system, and may be an operating system such as Android, iOS, or Symbian. To illustrate the detailed implementation process of the live video stream remote control method of the present invention, please refer to FIG. 1, which includes the following steps:
S11建立与主播用户的授权连接,获取主播用户的焦距调节权限;S11 establishes an authorized connection with the anchor user, and obtains a focus adjustment permission of the anchor user;
优选的,场控用户在建立与主播用户的授权连接时可以通过服务器建立与主播用户之间的用于转发数据的通道。在双方连接之后,便可以开始进行用户之间的焦距调节远程协助的控制。Preferably, the field control user can establish a channel for forwarding data with the anchor user through the server when establishing an authorized connection with the anchor user. After the two parties are connected, it is possible to start the control of the focus adjustment remote assistance between the users.
在一个可选的实施例中,在场控用户建立与主播用户之间的焦距调节远程协助授权连接之前,场控用户可以通过如下方式获知主播用户需要焦距调节远程协助:场控用户接收服务器发送的主播用户的呼叫请求;判断发起呼叫的主播用户是否为场控用户远程协助列表中的用户;在判断结果为是的情况下,向服务器发起焦距调节远程协助主播用户的请求。在该实施例中,可以在主播用户中安装进行远程协助的相关控件,利用该控件向场控用户发起 呼叫请求,并在场控用户接通该呼叫后的短时间内终止通话,可以在一秒终止通话。当然也可以利用其他的方式来获知主播用户需要进行焦距调节远程协助,例如也可以通过接收短信的方式来获知主播用户需要进行远程协助,从而实现在主播用户需要远程协助的时候能够及时的对主播用户进行远程协助。In an optional embodiment, before the field control user establishes a focus adjustment remote assistance authorization connection with the anchor user, the field control user can know that the anchor user needs focus adjustment remote assistance by: the field control user receiving server sends the The call request of the anchor user; determining whether the anchor user initiating the call is a user in the remote assistance list of the field control user; if the determination result is yes, initiating a request for the focus adjustment remote assistance anchor user to the server. In this embodiment, related controls for remote assistance can be installed in the anchor user, and the control is used to initiate the field control user. The call is requested, and the call is terminated within a short time after the field control user connects the call, and the call can be terminated in one second. Of course, other methods can also be used to know that the anchor user needs to perform remote adjustment of the focus adjustment. For example, the user can receive the short message to know that the anchor user needs to perform remote assistance, so that the anchor user can timely respond to the anchor when the remote user needs remote assistance. The user performs remote assistance.
更多的,场控用户与主播用户建立授权连接的方式还包括场控用户主动请求主播用户开放焦距调节权限:场控用户根据与主播用户的焦距调节控制的远程协助习惯(所述服务器记录有场控用户与主播用户的授权控制关系及信息),在需要的时间或特定的环境下,主动向主播用户发起开放焦距调节权限的请求,主播用户根据实际需求对服务器转发的所述开放请求作出应答,一旦主播用户开放权限,场控用户即可对主播用户的进行焦距调节远程控制。Further, the manner in which the field control user establishes an authorized connection with the anchor user also includes the field control user actively requesting the anchor user to open the focus adjustment authority: the field control user according to the remote assistance habit of controlling the focus adjustment with the anchor user (the server record has The authorization control relationship and information between the field control user and the anchor user) actively initiates a request for open focus adjustment authority to the anchor user at a required time or in a specific environment, and the anchor user makes the open request forwarded by the server according to actual needs. In response, once the anchor user has open access, the field control user can remotely control the focus adjustment of the anchor user.
S12获取并显示主播用户的直播视频流;S12 acquires and displays a live video stream of the anchor user;
当所述场控用户进入所述主播用户所在的直播间时,即可获取到所述主播用户发出的直播视频流,此时,所述场控用户将对获取到的所述视频流进行解析处理,并将解析后的所述视频流显示在所述场控用户屏幕上。When the field control user enters the live broadcast room where the anchor user is located, the live video stream sent by the anchor user may be obtained. At this time, the field control user will parse the obtained video stream. Processing, and displaying the parsed video stream on the field control user screen.
S13接收对所述直播视频流的焦距调节控制指令,发送相应的调焦指令给所述主播用户,以改变拍摄所述直播视频流的焦距。S13 receives a focus adjustment control instruction for the live video stream, and sends a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
当所述场控用户进入所述主播用户所在的直播间,接收到所述主播用户发出的视频流以及对所述主播用户的直播视频流的焦距调节控制指令后,所述场控用户根据显示在屏幕上的视频内容,如主播距离摄像头的距离、主播的姿态、主播间的环境变换等各种因素,决定是否对所述视频流的拍摄焦距进行调节。当所述场控用户判断为需要对所述视频流的拍摄焦距进行调节时,将通过控制场控用户端上的摄像装置的焦距调节控制键或显示在视频流显示区域中的焦距调节控制界面来改变所述视频流的拍摄焦距;此时,将给所述主播用户发送相应的调焦指令,当所述主播用户接收到场控用户对摄像装置焦距调节的操作指令后,所述主播用户即通过调用相应的API接口实现变焦。其中,所述场控用户一侧的调焦指令的操作方式包括语音操作、手势触控操作和按键操作中的一种或多种。After the field control user enters the live broadcast room where the anchor user is located, after receiving the video stream sent by the anchor user and the focus adjustment control instruction of the live video stream of the anchor user, the field control user according to the display The video content on the screen, such as the distance of the anchor from the camera, the attitude of the anchor, the environment change between the anchors, and the like, determine whether to adjust the shooting focal length of the video stream. When the field control user determines that the shooting focal length of the video stream needs to be adjusted, the focal length adjustment control button of the camera device on the field control user end or the focus adjustment control interface displayed in the video stream display area is controlled. To change the shooting focal length of the video stream; at this time, the anchor user will be sent a corresponding focusing instruction, and when the anchor user receives an operation instruction of the field control user to adjust the focus of the camera, the anchor user is Zooming is achieved by calling the corresponding API interface. The operation mode of the focus adjustment instruction on the side of the field control user includes one or more of a voice operation, a gesture touch operation, and a key operation.
上述场控用户对所述主播用户的摄像装置的焦距进行调节,将改变所述主播用户的摄像装置的拍摄焦距,以及显示在所述场控用户屏幕上的所述视 频流的图像效果;其中,最终呈现出的图像效果为所述主播用户根据接收到的操作指令对摄像装置的焦距进行调节后,能够根据实际需要获取到的较佳的景物信息,而所述图像效果的清晰度等问题将完全取决于所述主播用户摄像装置的硬件能力。更多的是,本实施例中对摄像装置的焦距进行调节改变的仅仅为显示在屏幕上的画面内容,对于所述视频流本身的参数、编解码、上行、下行无任何影响。Adjusting, by the above-mentioned field control user, the focal length of the camera device of the anchor user, changing the shooting focal length of the camera device of the anchor user, and displaying the view on the screen of the field control user The image effect of the frequency stream; wherein the image effect finally presented is the better scene information that the anchor user can obtain according to actual needs after adjusting the focal length of the camera according to the received operation instruction. Problems such as the sharpness of the image effect will depend entirely on the hardware capabilities of the anchor user's camera. Further, in the embodiment, the adjustment of the focal length of the camera device is only the content of the screen displayed on the screen, and has no influence on the parameters, codec, uplink, and downlink of the video stream itself.
实施例二Embodiment 2
为了说明本发明的直播视频流远程控制方法的详细实现过程,此处还提供另一种实施例,请参考图2,In order to explain the detailed implementation process of the live video stream remote control method of the present invention, another embodiment is provided herein. Please refer to FIG. 2,
S21建立与场控用户的授权连接,向场控用户开放焦距调节权限;S21 establishes an authorized connection with the field control user, and opens the focus adjustment authority to the field control user;
优选的,主播用户在建立与场控用户的授权连接时可以通过服务器建立与场控用户之间的用于转发数据的通道。在双方连接之后,便可以开始进行用户之间的焦距调节远程协助的控制了。Preferably, the anchor user can establish a channel for forwarding data with the field control user through the server when establishing an authorized connection with the field control user. After the two parties are connected, it is possible to start the control of the focus adjustment remote assistance between the users.
在一个可选的实施例中,在主播用户建立与场控用户之间的焦距调节远程控制授权连接之前,主播用户可以通过如下方式使场控用户知悉需要协助主播用户进行焦距调节远程控制:主播用户向服务器发送请求场控用户进行远程控制的呼叫请求,而其中的呼叫请求的发起可以是在主播用户中安装进行远程协助的相关控件,或者向场控用户发送短信的方式来使得场控用户知悉需要对主播用户进行远程协助。In an optional embodiment, before the anchor user establishes a focus adjustment remote control authorization connection with the field control user, the anchor user can know that the field control user needs to assist the anchor user to perform focus adjustment remote control by: The user sends a call request to the server to request the remote control of the field control user, and the initiation of the call request may be related to installing the remote assistance in the anchor user, or sending a short message to the field control user to make the field control user Know that remote assistance is required for the anchor user.
更多的,主播用户与场控用户建立授权连接的方式还包括场控用户主动请求主播用户开放焦距调节权限:场控用户根据与主播用户的焦距调节控制的远程协助习惯(所述服务器记录有场控用户与主播用户的授权控制关系及信息),在需要的时间或特定的环境下,主动向主播用户发起开放焦距调节权限的请求,主播用户根据实际需求对服务器转发的所述开放请求作出应答,一旦主播用户开放权限,场控用户即可对主播用户的进行焦距调节远程控制。Further, the manner in which the anchor user establishes an authorized connection with the field control user further includes the field control user actively requesting the anchor user to open the focus adjustment authority: the remote control habit of the field control user according to the focus adjustment control with the anchor user (the server record has The authorization control relationship and information between the field control user and the anchor user) actively initiates a request for open focus adjustment authority to the anchor user at a required time or in a specific environment, and the anchor user makes the open request forwarded by the server according to actual needs. In response, once the anchor user has open access, the field control user can remotely control the focus adjustment of the anchor user.
S22向场控用户提供由摄像装置拍摄形成的直播视频流;S22 provides the field control user with a live video stream formed by the camera device;
当所述场控用户进入所述主播用户所在的直播间时,所述主播用户将对所述场控用户发送由其自身摄像装置拍摄形成的直播视频流。当所述场控用 户接收到该直播视频流后,将对获取到的所述视频流进行解析处理,并将解析后的所述视频流显示在所述场控用户屏幕上。When the field control user enters the live broadcast room where the anchor user is located, the anchor user will send a live video stream formed by the camera device to the field control user. When the field control is used After receiving the live video stream, the user will parse the obtained video stream, and display the parsed video stream on the field control user screen.
S23响应于接收到的场控用户的调焦指令,据之改变摄像装置的拍摄焦距,以改变提供给所述场控用户的直播视频流的图像效果。S23 is responsive to the received focus command of the field control user, according to which the shooting focal length of the camera device is changed to change the image effect of the live video stream provided to the field control user.
所述场控用户根据显示在屏幕上的视频内容,如主播距离摄像头的距离、主播的姿态、主播间的环境变换等各种因素,决定是否对所述视频流的拍摄焦距进行调节。当所述场控用户判断为需要对所述视频流的拍摄焦距进行调节时,将通过控制场控用户端上的摄像装置的焦距调节控制键或显示在视频流显示区域中的焦距调节控制界面来改变所述视频流的拍摄焦距;此时,所述主播用户将接收到所述场控用户发出的相应的调焦指令,响应于该调焦指令,所述主播用户即通过调用相应的API接口实现变焦。其中,在所述场控用户一侧的调焦指令的操作方式包括语音操作、手势触控操作和按键操作中的一种或多种。The field control user determines whether to adjust the shooting focal length of the video stream according to various factors such as the distance of the video displayed on the screen, such as the distance of the anchor from the camera, the attitude of the anchor, and the environment change between the anchors. When the field control user determines that the shooting focal length of the video stream needs to be adjusted, the focal length adjustment control button of the camera device on the field control user end or the focus adjustment control interface displayed in the video stream display area is controlled. To change the shooting focal length of the video stream; at this time, the anchor user will receive a corresponding focusing instruction issued by the field control user, and in response to the focusing instruction, the anchor user invokes the corresponding API. The interface achieves zooming. The operation mode of the focus instruction on the side of the field control user includes one or more of a voice operation, a gesture touch operation, and a key operation.
上述场控用户对所述主播用户的摄像装置的焦距进行调节,将改变所述主播用户的摄像装置的拍摄焦距,以及显示在所述场控用户屏幕上的所述视频流的图像效果;其中,最终呈现出的图像效果为所述主播用户根据接收到的操作指令对摄像装置的焦距进行调节后,能够根据实际需要获取到的较佳的景物信息,而所述图像效果的清晰度等问题将完全取决于所述主播用户摄像装置的硬件能力。更多的是,本实施例中对摄像装置的焦距进行调节改变的仅仅为显示在屏幕上的画面内容,对于所述视频流本身的参数、编解码、上行、下行无任何影响。Adjusting the focal length of the camera device of the anchor user by the field control user, the shooting focal length of the camera device of the anchor user, and the image effect of the video stream displayed on the screen of the field control user; The image effect finally presented is a problem that the anchor user can obtain the better scene information according to actual needs after adjusting the focal length of the camera according to the received operation instruction, and the image effect is clear. It will depend entirely on the hardware capabilities of the anchor user's camera. Further, in the embodiment, the adjustment of the focal length of the camera device is only the content of the screen displayed on the screen, and has no influence on the parameters, codec, uplink, and downlink of the video stream itself.
实施例三Embodiment 3
为了进一步对本发明所述的直播视频流远程控制方法进行阐述,对其进行模块化说明,提供直播视频流远程控制装置,In order to further explain the remote control method of the live video stream according to the present invention, a modular description thereof is provided, and a live video stream remote control device is provided.
其中,应用于场控用户一侧的实施例包括以下模块,请参考图3:The embodiment applied to the side of the field control user includes the following modules. Please refer to FIG. 3:
第一建立连接模块11、显示模块12、收发模块13。The first connection module 11, the display module 12, and the transceiver module 13 are established.
其中,第一建立连接模块11用于建立与主播用户的授权连接,获取主播用户的焦距调节权限; The first establishing connection module 11 is configured to establish an authorized connection with the anchor user, and obtain a focus adjustment authority of the anchor user;
其中,显示模块12用于获取并显示主播用户的直播视频流;The display module 12 is configured to acquire and display a live video stream of the anchor user.
其中,收发模块13用于接收对所述直播视频流的焦距调节控制指令,发送相应的调焦指令给所述主播用户,以改变拍摄所述直播视频流的焦距。The transceiver module 13 is configured to receive a focus adjustment control instruction for the live video stream, and send a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
其中,应用于主播用户一侧的实施例包括以下模块,请参考图4:The embodiment applied to the side of the anchor user includes the following modules. Please refer to FIG. 4:
第二建立连接模块21、发送模块22、响应模块23。The second connection module 21, the sending module 22, and the response module 23 are established.
其中,第二建立连接模块21用于建立与场控用户的授权连接,向场控用户开放焦距调节权限;The second establishing connection module 21 is configured to establish an authorized connection with the field control user, and open the focus adjustment authority to the field control user;
其中,发送模块22用于向场控用户提供由摄像装置拍摄形成的直播视频流;The sending module 22 is configured to provide the field control user with a live video stream formed by the camera device;
其中,响应模块23用于响应于接收到的场控用户的调焦指令,据之改变摄像装置的拍摄焦距,以改变提供给所述场控用户的直播视频流的图像效果。The response module 23 is configured to change the shooting focal length of the camera device in response to the received focus command of the field control user to change the image effect of the live video stream provided to the field control user.
实施例四Embodiment 4
本发明还提供了一种终端设备,如图5所示,为了便于说明,仅示出了与本发明实施例相关的部分,具体技术细节未揭示的,请参照本发明实施例方法部分。该终端可以为包括手机、平板电脑、PDA(Personal Digital Assistant,个人数字助理)、POS(Point ofSales,销售终端)、车载电脑等任意终端设备,以终端为手机为例:The present invention also provides a terminal device. As shown in FIG. 5, for the convenience of description, only parts related to the embodiment of the present invention are shown. For details that are not disclosed, refer to the method part of the embodiment of the present invention. The terminal may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), an in-vehicle computer, and the terminal is a mobile phone as an example:
图5示出的是与本发明实施例提供的终端相关的手机的部分结构的框图。参考图5,手机包括:射频(Radio Frequency,RF)电路510、存储器520、输入单元530、显示单元540、传感器550、音频电路560、无线保真(wireless fidelity,WiFi)模块570、处理器580、以及电源590等部件。本领域技术人员可以理解,图5中示出的手机结构并不构成对手机的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。FIG. 5 is a block diagram showing a partial structure of a mobile phone related to a terminal provided by an embodiment of the present invention. Referring to FIG. 5, the mobile phone includes: a radio frequency (RF) circuit 510, a memory 520, an input unit 530, a display unit 540, a sensor 550, an audio circuit 560, a wireless fidelity (WiFi) module 570, and a processor 580. And power supply 590 and other components. It will be understood by those skilled in the art that the structure of the handset shown in FIG. 5 does not constitute a limitation to the handset, and may include more or less components than those illustrated, or some components may be combined, or different components may be arranged.
下面结合图5对手机的各个构成部件进行具体的介绍:The following describes the components of the mobile phone in detail with reference to FIG. 5:
RF电路510可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,给处理器580处理;另外,将设计上行的数据发送给基站。通常,RF电路510包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier,LNA)、双工器等。此 外,RF电路510还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统(Global System of Mobile communication,GSM)、通用分组无线服务(General Packet Radio Service,GPRS)、码分多址(Code Division Multiple Access,CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution,LTE)、电子邮件、短消息服务(Short Messaging Service,SMS)等。The RF circuit 510 can be used for receiving and transmitting signals during the transmission or reception of information or during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 580. In addition, the uplink data is designed to be sent to the base station. Generally, RF circuit 510 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. This In addition, RF circuitry 510 can also communicate with the network and other devices via wireless communication. The above wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division). Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), and the like.
存储器520可用于存储软件程序以及模块,处理器580通过运行存储在存储器520的软件程序以及模块,从而执行手机的各种功能应用以及数据处理。存储器520可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器520可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 520 can be used to store software programs and modules, and the processor 580 executes various functional applications and data processing of the mobile phone by running software programs and modules stored in the memory 520. The memory 520 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.). Moreover, memory 520 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
输入单元530可用于接收输入的数字或字符信息,以及产生与手机的用户设置以及功能控制有关的键信号输入。具体地,输入单元530可包括触控面板531以及其他输入设备532。触控面板531,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板531上或在触控面板531附近的操作),并根据预先设定的程式驱动相应的连接装置。可选的,触控面板531可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器580,并能接收处理器580发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板531。除了触控面板531,输入单元530还可以包括其他输入设备532。具体地,其他输入设备532可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。The input unit 530 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the handset. Specifically, the input unit 530 may include a touch panel 531 and other input devices 532. The touch panel 531, also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 531 or near the touch panel 531. Operation), and drive the corresponding connecting device according to a preset program. Optionally, the touch panel 531 can include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 580 is provided and can receive commands from the processor 580 and execute them. In addition, the touch panel 531 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 531, the input unit 530 may also include other input devices 532. Specifically, other input devices 532 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
显示单元540可用于显示由用户输入的信息或提供给用户的信息以及手机的各种菜单。显示单元540可包括显示面板541,可选的,可以采用液晶 显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板541。进一步的,触控面板531可覆盖显示面板541,当触控面板531检测到在其上或附近的触摸操作后,传送给处理器580以确定触摸事件的类型,随后处理器580根据触摸事件的类型在显示面板541上提供相应的视觉输出。虽然在图5中,触控面板531与显示面板541是作为两个独立的部件来实现手机的输入和输入功能,但是在某些实施例中,可以将触控面板531与显示面板541集成而实现手机的输入和输出功能。The display unit 540 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone. The display unit 540 can include a display panel 541. Alternatively, a liquid crystal can be used. The display panel 541 is configured in the form of a display (LCD), an organic light-emitting diode (OLED), or the like. Further, the touch panel 531 can cover the display panel 541. When the touch panel 531 detects a touch operation on or near it, the touch panel 531 transmits to the processor 580 to determine the type of the touch event, and then the processor 580 according to the touch event. The type provides a corresponding visual output on display panel 541. Although the touch panel 531 and the display panel 541 are used as two independent components to implement the input and input functions of the mobile phone in FIG. 5, in some embodiments, the touch panel 531 and the display panel 541 may be integrated. Realize the input and output functions of the phone.
手机还可包括至少一种传感器550,比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板541的亮度,接近传感器可在手机移动到耳边时,关闭显示面板541和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于手机还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。The handset may also include at least one type of sensor 550, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 541 according to the brightness of the ambient light, and the proximity sensor may close the display panel 541 and/or when the mobile phone moves to the ear. Or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
音频电路560、扬声器561,传声器562可提供用户与手机之间的音频接口。音频电路560可将接收到的音频数据转换后的电信号,传输到扬声器561,由扬声器561转换为声音信号输出;另一方面,传声器562将收集的声音信号转换为电信号,由音频电路560接收后转换为音频数据,再将音频数据输出处理器580处理后,经RF电路510以发送给比如另一手机,或者将音频数据输出至存储器520以便进一步处理。Audio circuit 560, speaker 561, and microphone 562 provide an audio interface between the user and the handset. The audio circuit 560 can transmit the converted electrical data of the received audio data to the speaker 561, and convert it into a sound signal output by the speaker 561. On the other hand, the microphone 562 converts the collected sound signal into an electrical signal, and the audio circuit 560 is used by the audio circuit 560. After receiving, it is converted into audio data, and then processed by the audio data output processor 580, sent to the other mobile phone via the RF circuit 510, or outputted to the memory 520 for further processing.
WiFi属于短距离无线传输技术,手机通过WiFi模块570可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线的宽带互联网访问。虽然图5示出了WiFi模块570,但是可以理解的是,其并不属于手机的必须构成,完全可以根据需要在不改变发明的本质的范围内而省略。WiFi is a short-range wireless transmission technology, and the mobile phone can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 570, which provides users with wireless broadband Internet access. Although FIG. 5 shows the WiFi module 570, it can be understood that it does not belong to the essential configuration of the mobile phone, and may be omitted as needed within the scope of not changing the essence of the invention.
处理器580是手机的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器520内的软件程序和/或模块,以及调用存储在存储器520内的数据,执行手机的各种功能和处理数据,从而对手机进行整体监控。可选的,处理器580可包括一个或多个处理单元;优选的, 处理器580可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器580中。The processor 580 is the control center of the handset, and connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in the memory 520, and invoking data stored in the memory 520, executing The phone's various functions and processing data, so that the overall monitoring of the phone. Optionally, the processor 580 can include one or more processing units; preferably, The processor 580 can integrate an application processor and a modem processor, wherein the application processor primarily processes an operating system, a user interface, an application, etc., and the modem processor primarily processes wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 580.
手机还包括给各个部件供电的电源590(比如电池),优选的,电源可以通过电源管理系统与处理器580逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The handset also includes a power source 590 (such as a battery) that supplies power to the various components. Preferably, the power source can be logically coupled to the processor 580 via a power management system to manage functions such as charging, discharging, and power management through the power management system.
尽管未示出,手机还可以包括摄像头、蓝牙模块等,在此不再赘述。Although not shown, the mobile phone may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
在本发明实施例中,该终端所包括的处理器580还用于执行如实施例一、二所述方法的步骤。In the embodiment of the present invention, the processor 580 included in the terminal is further configured to perform the steps of the method as described in Embodiments 1 and 2.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:只读存储器(ROM,Read Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁盘或光盘等。 A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Read Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be performed by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, the above mentioned storage. The medium can be a read only memory, a magnetic disk or an optical disk or the like.
以上对本发明所提供的一种终端设备进行了详细介绍,对于本领域的一般技术人员,依据本发明实施例的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。The above is a detailed description of a terminal device provided by the present invention. For those skilled in the art, according to the idea of the embodiment of the present invention, there are changes in specific implementation manners and application scopes. The contents of this specification are not to be construed as limiting the invention.
实施例五(应用例)Embodiment 5 (Application Example)
以下根据实际的应用场景对本发明一种可能的实施情况进行说明:The following describes a possible implementation of the present invention according to an actual application scenario:
主播用户对场控用户发出请求远程协助呼叫:假设主播想直播一场舞蹈编排视频,但由于现在的直播平台上不支持进行焦距调节,且主播在跳舞过程中,无法实时对自身的摄像装置的焦距进行调节,使其在跳动不同的舞蹈动作时,根据实际展现舞蹈姿态的细节。于是,主播可通过呼叫好友或观看的观众对其自身的拍摄装置的拍摄焦距进行远程控制。好友用户或观看用户接受主播用户发出的远程控制请求后,将成为场控用户,当其进入主播进行直播舞蹈编排视频的直播间时,即可收看到主播发出的视频。当场控觉得此时主播的拍摄画面不理想时,可通过控制场控自身的拍摄装置或显示在视频播放区域的焦距调节界面改变主播拍摄装置的拍摄的焦距,从而实现在主播展现不同的舞姿时,根据实际对主播现场的拍摄装置进行焦距的调节,获得更好的观赏画面。而其中,场控改变拍摄装置的焦距可通过手势识别操作或具体拍摄装置的焦距调节按键进行操作。The anchor user makes a request for the remote control call to the field control user: Assume that the anchor wants to broadcast a dance choreography video, but since the current live broadcast platform does not support focus adjustment, and the anchor is in the process of dancing, it is impossible to real-time on its own camera device. The focal length is adjusted so that when the different dance movements are beating, the details of the dance posture are actually displayed. Thus, the anchor can remotely control the shooting focal length of its own camera by calling a friend or watching the viewer. After the friend user or the viewing user accepts the remote control request from the anchor user, the user will become the field control user. When they enter the live broadcast room of the live broadcast choreography video, they can receive the video sent by the anchor. When the field control feels that the shooting picture of the anchor is not ideal at this time, the focal length of the shooting of the anchor shooting device can be changed by controlling the shooting device of the field control itself or the focus adjustment interface displayed in the video playing area, thereby realizing that the main body exhibits different dancing postures. According to the actual adjustment of the focal length of the shooting device on the anchor site, a better viewing picture is obtained. Wherein, the field control changes the focal length of the photographing device to operate by a gesture recognition operation or a focus adjustment button of a specific photographing device.
虽然上面已经示出了本发明的一些示例性实施例,但是本领域的技术人员将理解,在不脱离本发明的原理或精神的情况下,可以对这些示例性实施例做出改变,本发明的范围由权利要求及其等同物限定。 While some exemplary embodiments of the invention have been shown in the foregoing, the embodiments of the invention may The scope is defined by the claims and their equivalents.

Claims (10)

  1. 一种直播视频流远程控制方法,其特征在于,包括以下步骤:A live video stream remote control method, comprising the following steps:
    建立与主播用户的授权连接,获取主播用户的焦距调节权限;Establish an authorized connection with the anchor user to obtain the focus adjustment authority of the anchor user;
    获取并显示主播用户的直播视频流;Obtain and display the live video stream of the anchor user;
    接收对所述直播视频流的焦距调节控制指令,发送相应的调焦指令给所述主播用户,以改变拍摄所述直播视频流的焦距。Receiving a focus adjustment control instruction for the live video stream, and transmitting a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
  2. 根据权利要求1所述的直播视频流远程控制方法,其特征在于,所述建立与主播用户的授权连接包括:The live video stream remote control method according to claim 1, wherein the establishing an authorized connection with the anchor user comprises:
    通过服务器建立与所述主播用户之间用于转发数据的通道。A channel for forwarding data with the anchor user is established by the server.
  3. 根据权利要求1所述的直播视频流远程控制方法,其特征在于,所述建立与主播用户的授权连接之前还包括步骤:The method for remote control of a live video stream according to claim 1, wherein the step of establishing an authorized connection with the anchor user further comprises the steps of:
    应答服务器发出的所述主播用户呼叫场控用户控制的请求指令;Answering, by the response server, the request command of the anchor user to call the field control user control;
    和/或,and / or,
    向服务器发出请求所述主播用户开放焦距调节权限的请求;Sending a request to the server to request the anchor user to open the focus adjustment authority;
    接收服务器反馈的所述主播用户向场控用户开放权限的信息。Receiving, by the server, the information that the anchor user opens the authority to the field control user.
  4. 根据权利要求1所述的直播视频流远程控制方法,其特征在于,所述获取并显示主播用户的直播视频流包括步骤:将获取到的所述视频流进行解析处理,并将解析后的所述视频流显示在屏幕上。The live video stream remote control method according to claim 1, wherein the obtaining and displaying the live video stream of the anchor user comprises the steps of: parsing the obtained video stream, and parsing the The video stream is displayed on the screen.
  5. 根据权利要求1所述的直播视频流远程控制方法,其特征在于,所述步骤接收对所述直播视频流的焦距调节控制指令之后还包括:The live broadcast video stream remote control method according to claim 1, wherein the step further comprises: after receiving a focus adjustment control instruction for the live video stream:
    于所述直播视频流显示区域显示焦距调节控制界面。Displaying a focus adjustment control interface in the live video stream display area.
  6. 根据权利要求1所述的直播视频流远程控制方法,其特征在于,所述调焦指令的操作包括语音操作、手势触控操作和按键操作中的一种或多种。The live video stream remote control method according to claim 1, wherein the operation of the focus instruction comprises one or more of a voice operation, a gesture touch operation, and a key operation.
  7. 一种直播视频流远程控制方法,其特征在于,包括:A live video stream remote control method, comprising:
    建立与场控用户的授权连接,向场控用户开放焦距调节权限;Establish an authorized connection with the field control user, and open the focus adjustment authority to the field control user;
    向场控用户提供由摄像装置拍摄形成的直播视频流;Providing the field control user with a live video stream formed by the camera device;
    响应于接收到的场控用户的调焦指令,据之改变摄像装置的拍摄焦距,以改变提供给所述场控用户的直播视频流的图像效果。In response to the received focus command of the field control user, the shooting focal length of the camera device is changed to change the image effect of the live video stream provided to the field control user.
  8. 一种直播视频流远程控制装置,其特征在于,包括: A live video stream remote control device, comprising:
    第一建立连接模块,用于建立与主播用户的授权连接,获取主播用户的焦距调节权限;The first establishing a connection module is configured to establish an authorized connection with the anchor user, and obtain a focus adjustment permission of the anchor user;
    显示模块,用于获取并显示主播用户的直播视频流;所述显示模块包括显示面板;a display module, configured to acquire and display a live video stream of the anchor user; the display module includes a display panel;
    收发模块,用于接收对所述直播视频流的焦距调节控制指令,发送相应的调焦指令给所述主播用户,以改变拍摄所述直播视频流的焦距。The transceiver module is configured to receive a focus adjustment control instruction for the live video stream, and send a corresponding focus instruction to the anchor user to change a focal length of the live video stream.
  9. 一种直播视频流远程控制装置,其特征在于,包括:A live video stream remote control device, comprising:
    第二建立连接模块,用于建立与场控用户的授权连接,向场控用户开放焦距调节权限;The second establishing a connection module is configured to establish an authorized connection with the field control user, and open the focus adjustment authority to the field control user;
    发送模块,用于向场控用户提供由摄像装置拍摄形成的直播视频流;a sending module, configured to provide the field control user with a live video stream formed by the camera device;
    响应模块,用于响应于接收到的场控用户的调焦指令,据之改变摄像装置的拍摄焦距,以改变提供给所述场控用户的直播视频流的图像效果;所述响应模块包括处理器。a response module, configured to change a shooting focal length of the camera device to change an image effect of a live video stream provided to the field control user in response to the received focus command of the field control user; the response module includes processing Device.
  10. 一种终端设备,用于实现直播视频流远程控制,其特征在于,包括:A terminal device is configured to implement remote control of a live video stream, and is characterized in that:
    一个或多个处理器,用于场控用户与主播用户建立授权连接,场控用户获取主播用户的焦距调节权限;场控用户获取主播用户的直播视频流;场控用户接收对所述直播视频流的焦距调节控制指令,发送相应的调焦指令给所述主播用户,以改变拍摄所述直播视频流的焦距;主播用户接收到场控用户的调焦指令,据之改变摄像装置的拍摄焦距,以改变提供给所述场控用户的直播视频流的图像效果;One or more processors for the field control user to establish an authorized connection with the anchor user, the field control user obtains the focus adjustment permission of the anchor user; the field control user obtains the live video stream of the anchor user; the field control user receives the live video a focus adjustment control command of the stream, sending a corresponding focusing instruction to the anchor user to change a focal length of the live video stream; the anchor user receives a focus adjustment command of the field control user, and according to the shooting focal length of the camera device, To change the image effect of the live video stream provided to the field control user;
    触敏显示器,用于场控用户显示主播用户提供的直播视频流;a touch-sensitive display for a field control user to display a live video stream provided by an anchor user;
    存储器。 Memory.
PCT/CN2017/103189 2016-09-29 2017-09-25 Remote control method and apparatus for live video stream WO2018059352A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610870790.8 2016-09-29
CN201610870790.8A CN106470343B (en) 2016-09-29 2016-09-29 Live video stream long-range control method and device

Publications (1)

Publication Number Publication Date
WO2018059352A1 true WO2018059352A1 (en) 2018-04-05

Family

ID=58230846

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/103189 WO2018059352A1 (en) 2016-09-29 2017-09-25 Remote control method and apparatus for live video stream

Country Status (2)

Country Link
CN (1) CN106470343B (en)
WO (1) WO2018059352A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111954078A (en) * 2020-08-24 2020-11-17 上海连尚网络科技有限公司 Video generation method and device for live broadcast
CN113487709A (en) * 2021-07-07 2021-10-08 上海商汤智能科技有限公司 Special effect display method and device, computer equipment and storage medium
CN113542785A (en) * 2021-07-13 2021-10-22 北京字节跳动网络技术有限公司 Switching method of input and output of audio applied to live broadcast and live broadcast equipment
CN113613030A (en) * 2021-08-20 2021-11-05 云南腾云信息产业有限公司 Live broadcast control method and system and computer readable storage medium
CN113992925A (en) * 2021-10-12 2022-01-28 江西创成微电子有限公司 Method and system for notifying operation and maintenance personnel in live broadcast scene and terminal equipment
CN114466207A (en) * 2022-01-18 2022-05-10 阿里巴巴(中国)有限公司 Live broadcast control method and computer storage medium
CN114554129A (en) * 2020-11-25 2022-05-27 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN114827647A (en) * 2022-04-15 2022-07-29 北京百度网讯科技有限公司 Live broadcast data generation method, device, equipment, medium and program product
CN115243059A (en) * 2022-05-31 2022-10-25 广州播丫科技有限公司 Direct broadcast machine for realizing slow direct broadcast through monitoring camera and working method thereof

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106470343B (en) * 2016-09-29 2019-09-17 广州华多网络科技有限公司 Live video stream long-range control method and device
CN108668139B (en) * 2017-03-27 2021-03-19 腾讯科技(深圳)有限公司 Live broadcast interaction system, method and device
CN109120504B (en) * 2017-06-26 2023-05-09 深圳脸网科技有限公司 Image equipment sharing method and social contact method thereof
WO2019014860A1 (en) * 2017-07-18 2019-01-24 Hangzhou Taruo Information Technology Co., Ltd. Controlling camera field-of-vew based on remote viewer voting
CN107948509A (en) * 2017-11-27 2018-04-20 广州华多网络科技有限公司 Adjusting method, storage device and the terminal of live picture focal length
CN108810559A (en) * 2018-05-31 2018-11-13 北京达佳互联信息技术有限公司 Field-of-view mode switching method, the transmission method of device and live data, device
CN111182348B (en) * 2018-11-09 2022-06-14 阿里巴巴集团控股有限公司 Live broadcast picture display method and device, storage device and terminal
CN110493623A (en) * 2019-08-16 2019-11-22 咪咕音乐有限公司 Method, server and the terminal of long-range control video camera
CN113949885B (en) * 2020-07-15 2023-08-15 腾讯科技(深圳)有限公司 Live broadcast processing method and device, electronic equipment and computer readable storage medium
CN111954018B (en) 2020-08-14 2022-03-25 北京达佳互联信息技术有限公司 Live broadcast room management method, system, device, equipment and storage medium
CN113691821A (en) * 2021-07-30 2021-11-23 广州方硅信息技术有限公司 Authority control method, device, server and storage medium
CN115514914A (en) * 2022-09-28 2022-12-23 深圳市拓普智造科技有限公司 Multimedia remote video system, method and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006198241A (en) * 2005-01-21 2006-08-03 Olympus Corp Medical device controller
CN104639901A (en) * 2015-02-03 2015-05-20 广西智询信息科技有限公司 Method for playing wireless monitoring videos live on mobile terminals by scanning two-dimensional codes
CN104639905A (en) * 2015-02-03 2015-05-20 广西智询信息科技有限公司 Wireless video monitoring method suitable for live broadcast on mobile terminal of iOS system
CN105704502A (en) * 2016-01-19 2016-06-22 Live video interactive method and device
CN105704367A (en) * 2016-01-15 2016-06-22 谭圆圆 Camera shooting control method and device of unmanned aerial vehicle
CN205356525U (en) * 2016-01-15 2016-06-29 谭圆圆 Unmanned aerial vehicle
CN105785818A (en) * 2016-03-25 2016-07-20 中国科学技术馆 Remote control system and method of science popularization exhibit
CN105915983A (en) * 2015-12-14 2016-08-31 乐视网信息技术(北京)股份有限公司 Focal length adjusting method and device and intelligent terminal
CN106470343A (en) * 2016-09-29 2017-03-01 广州华多网络科技有限公司 Live video stream long-range control method and device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0704421D0 (en) * 2007-03-08 2007-04-18 Mcintosh John R The fan watch camera
US20140168277A1 (en) * 2011-05-10 2014-06-19 Cisco Technology Inc. Adaptive Presentation of Content
WO2015143173A2 (en) * 2014-03-19 2015-09-24 Neurala, Inc. Methods and apparatus for autonomous robotic control
CN104410918B (en) * 2014-12-09 2019-01-15 广州华多网络科技有限公司 A kind of live video parameter regulation means and device
CN205195868U (en) * 2015-11-26 2016-04-27 珠海天人科技有限公司 Emergent command system of law enforcement based on two -way mobile communication private network

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006198241A (en) * 2005-01-21 2006-08-03 Olympus Corp Medical device controller
CN104639901A (en) * 2015-02-03 2015-05-20 广西智询信息科技有限公司 Method for playing wireless monitoring videos live on mobile terminals by scanning two-dimensional codes
CN104639905A (en) * 2015-02-03 2015-05-20 广西智询信息科技有限公司 Wireless video monitoring method suitable for live broadcast on mobile terminal of iOS system
CN105915983A (en) * 2015-12-14 2016-08-31 乐视网信息技术(北京)股份有限公司 Focal length adjusting method and device and intelligent terminal
CN105704367A (en) * 2016-01-15 2016-06-22 谭圆圆 Camera shooting control method and device of unmanned aerial vehicle
CN205356525U (en) * 2016-01-15 2016-06-29 谭圆圆 Unmanned aerial vehicle
CN105704502A (en) * 2016-01-19 2016-06-22 Live video interactive method and device
CN105785818A (en) * 2016-03-25 2016-07-20 中国科学技术馆 Remote control system and method of science popularization exhibit
CN106470343A (en) * 2016-09-29 2017-03-01 广州华多网络科技有限公司 Live video stream long-range control method and device

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111954078A (en) * 2020-08-24 2020-11-17 上海连尚网络科技有限公司 Video generation method and device for live broadcast
CN114554129A (en) * 2020-11-25 2022-05-27 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN114554129B (en) * 2020-11-25 2023-10-31 北京字节跳动网络技术有限公司 Wheat connecting system, method, device, equipment and storage medium
CN113487709A (en) * 2021-07-07 2021-10-08 上海商汤智能科技有限公司 Special effect display method and device, computer equipment and storage medium
CN113542785A (en) * 2021-07-13 2021-10-22 北京字节跳动网络技术有限公司 Switching method of input and output of audio applied to live broadcast and live broadcast equipment
CN113613030A (en) * 2021-08-20 2021-11-05 云南腾云信息产业有限公司 Live broadcast control method and system and computer readable storage medium
CN113992925A (en) * 2021-10-12 2022-01-28 江西创成微电子有限公司 Method and system for notifying operation and maintenance personnel in live broadcast scene and terminal equipment
CN113992925B (en) * 2021-10-12 2023-11-14 江西创成微电子有限公司 Method and system for notifying operation and maintenance personnel in live broadcast scene and terminal equipment
CN114466207A (en) * 2022-01-18 2022-05-10 阿里巴巴(中国)有限公司 Live broadcast control method and computer storage medium
CN114827647A (en) * 2022-04-15 2022-07-29 北京百度网讯科技有限公司 Live broadcast data generation method, device, equipment, medium and program product
CN114827647B (en) * 2022-04-15 2024-03-19 北京百度网讯科技有限公司 Live broadcast data generation method, device, equipment, medium and program product
CN115243059A (en) * 2022-05-31 2022-10-25 广州播丫科技有限公司 Direct broadcast machine for realizing slow direct broadcast through monitoring camera and working method thereof

Also Published As

Publication number Publication date
CN106470343A (en) 2017-03-01
CN106470343B (en) 2019-09-17

Similar Documents

Publication Publication Date Title
WO2018059352A1 (en) Remote control method and apparatus for live video stream
WO2021098678A1 (en) Screencast control method and electronic device
WO2019149049A1 (en) Service processing method, terminal, server, and related product
US11616990B2 (en) Method for controlling delivery of a video stream of a live-stream room, and corresponding server and mobile terminal
WO2021109926A1 (en) Application sharing method, electronic device and computer-readable storage medium
WO2019137248A1 (en) Video frame interpolation method, storage medium and terminal
WO2021159998A1 (en) Information display method and apparatus, and electronic device
JP6430656B2 (en) System, method and apparatus for displaying content items
WO2017008627A1 (en) Multimedia live broadcast method, apparatus and system
WO2017020663A1 (en) Live-comment video live broadcast method and apparatus, video source device, and network access device
WO2017202348A1 (en) Video playing method and device, and computer storage medium
WO2019036942A1 (en) Display method and device
EP2326136A2 (en) Method and apparatus for remote controlling bluetooth device
WO2017219347A1 (en) Live broadcast display method, device and system
CN109246123B (en) Media stream acquisition method and device
WO2021083168A1 (en) Video sharing method and electronic device
WO2019196691A1 (en) Keyboard interface display method and mobile terminal
WO2021104230A1 (en) Synchronization method and electronic device
WO2019196929A1 (en) Video data processing method and mobile terminal
WO2021143362A1 (en) Resource transmission method and terminal
CN109194972B (en) Live stream acquisition method and device, computer equipment and storage medium
CN107948562B (en) Video recording method and video recording terminal
CN110366027B (en) Video management method and terminal equipment
WO2021143386A1 (en) Resource transmission method and terminal
CN107896337B (en) Information popularization method and device and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17854802

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17854802

Country of ref document: EP

Kind code of ref document: A1