WO2017161777A1 - 全景直播方法及装置 - Google Patents

全景直播方法及装置 Download PDF

Info

Publication number
WO2017161777A1
WO2017161777A1 PCT/CN2016/089347 CN2016089347W WO2017161777A1 WO 2017161777 A1 WO2017161777 A1 WO 2017161777A1 CN 2016089347 W CN2016089347 W CN 2016089347W WO 2017161777 A1 WO2017161777 A1 WO 2017161777A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
live broadcast
angle
change
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/089347
Other languages
English (en)
French (fr)
Inventor
李亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
LeTV Information Technology Beijing Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
LeTV Information Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, LeTV Information Technology Beijing Co Ltd filed Critical Le Holdings Beijing Co Ltd
Priority to US15/245,976 priority Critical patent/US20170280054A1/en
Publication of WO2017161777A1 publication Critical patent/WO2017161777A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/21805Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed

Definitions

  • the present invention relates to the field of data processing and control technologies, and in particular to a panoramic live broadcast method and apparatus.
  • the current live broadcast program usually collects pictures through live broadcasts of different perspectives on the spot, and then the unified live broadcast server is responsible for switching between screens, and then these pictures are sent to the terminal for direct viewing. This effect is too singular, users can not operate the live video according to the perspective they want to watch, and can only passively accept the live video provided by the server.
  • the purpose of the embodiments of the present invention is to provide a method and a device for performing a live broadcast, which can adjust the live view of the live video.
  • the panoramic live broadcast method provided by the embodiment of the present invention, which is applied to the mobile terminal, includes:
  • a picture corresponding to the new live view angle is selected as a new live picture.
  • the live broadcast location of the different perspectives includes a primary live broadcast location
  • the method further includes:
  • the acquisition screen of the primary live broadcast location is used as the initial live broadcast screen.
  • the step of receiving the terminal posture change data further includes:
  • the preset posture change data threshold is associated with returning to the main live broadcast position acquisition screen instruction
  • the current live broadcast screen is switched to the acquisition screen of the primary live broadcast position.
  • the method further includes:
  • the preset touch gesture data threshold is associated with a zoom live view instruction
  • the terminal touch gesture data is in the preset touch gesture data threshold, calculating a zoom ratio and a trigger position of the terminal touch gesture data according to the terminal touch gesture data;
  • the current live video is scaled centering on the trigger position.
  • the step of receiving the terminal posture change data further includes:
  • the step of analyzing the terminal change angle according to the terminal posture change data includes:
  • the terminal change angle is calculated.
  • FIG. 1 Another aspect of the embodiments of the present invention further provides a panoramic broadcast device, including:
  • the collection picture receiving module is configured to continuously receive the collection pictures of the live broadcast positions of different viewing angles
  • a panoramic picture synthesis module configured to synthesize each frame of the live broadcast position of the different perspective into a panoramic picture
  • An attitude data receiving module configured to receive terminal posture change data
  • a change angle analysis module configured to analyze and obtain a terminal change angle according to the terminal posture change data
  • a viewing angle calculation module configured to calculate a new live view angle according to a current live view angle and a change angle of the terminal
  • the live video selection module is configured to select, from the panoramic screen, a screen corresponding to the new live view angle as a new live broadcast screen.
  • the live broadcast location of the different perspectives includes a primary live broadcast location
  • the device further includes: an initial screen selection module, configured to use an acquisition screen of the primary live broadcast location as an initial live broadcast screen in an initial state.
  • the apparatus further includes a home screen return module, configured to:
  • the preset posture change data threshold is associated with returning to the main live broadcast position acquisition screen instruction
  • the current live broadcast screen is switched to the acquisition screen of the primary live broadcast position.
  • the apparatus further includes a picture scaling module, configured to:
  • the preset touch gesture data threshold is associated with a zoom live view instruction
  • the terminal touch gesture data is in the preset touch gesture data threshold, calculating a zoom ratio and a trigger position of the terminal touch gesture data according to the terminal touch gesture data;
  • the current live video is scaled centering on the trigger position.
  • the apparatus further includes an angle change multiple acquisition module, configured to:
  • the change angle analysis module is used to:
  • the terminal change angle is calculated.
  • the panoramic live broadcast method and apparatus provided by the embodiments of the present invention continuously receive the acquisition pictures of the live broadcast positions of different viewing angles and combine each frame picture into a panoramic picture, thereby receiving the terminal posture change data. And calculating the terminal change angle correspondingly, the new live view angle can be calculated according to the current live view angle and the terminal change angle, and the corresponding picture is selected from the panoramic picture as a new live picture.
  • the method enables the user to obtain the corresponding viewing angle by changing the posture of the terminal.
  • it is not limited to the live view provided by the live server.
  • the adjustment mode can select any viewing angle, and is not limited to the live broadcast position. Fixed viewing angles for a better user experience.
  • FIG. 1 is a schematic flowchart diagram of an embodiment of a panoramic live broadcast method according to the present invention
  • FIG. 2 is a schematic flowchart of another embodiment of a panoramic live broadcast method provided by the present invention.
  • FIG. 3 is a schematic structural diagram of a module of an embodiment of a panoramic live broadcast device according to the present invention.
  • FIG. 4 is a schematic structural diagram of an embodiment of a mobile terminal provided by the present invention.
  • FIG. 1 is a schematic flowchart diagram of an embodiment of a panoramic live broadcast method provided by the present invention.
  • the panoramic live broadcast method is applied to a mobile terminal, and includes the following steps:
  • Step 101 Continuously receiving an acquisition screen of a live broadcast position of different viewing angles
  • the live broadcast location is a camera for collecting live scenes set at a live broadcast site;
  • the live broadcast locations of different perspectives herein refer to cameras for collecting live scenes from different perspectives set at different locations on the live broadcast site.
  • the number of the live broadcast positions of the different viewing angles is continuously collected continuously and sent to the live broadcast server by the live broadcast site, and the live broadcast server receives the live broadcast positions of different perspectives.
  • the collected images are sent to different mobile terminals requesting the live broadcast service.
  • the mobile terminal continuously receives the collected images of the live broadcast positions of different viewing angles, that is, the live broadcast scenes forwarded by the live broadcast server. Collection screen of live broadcast positions from different perspectives;
  • Step 102 Synthesize each frame of the live broadcast position of the different perspective into a panoramic picture
  • one frame of the live broadcast positions of the different perspectives corresponding to the same time point is correspondingly combined into one frame panoramic picture;
  • a method for synthesizing a panoramic picture in the prior art which includes an overlap of an acquisition picture of each live broadcast location at an edge portion and corresponding pixel fusion processing, and the like;
  • Step 103 Receive terminal posture change data.
  • the terminal posture change data refers to data generated when the posture of the terminal changes, that is, when the terminal posture change data is received, the posture of the terminal is changed;
  • the posture change data of the terminal may be induced by The sensor of the terminal acceleration, such as a gravity sensor, a gyroscope, etc., when the sensor data changes, that indicates that the attitude of the terminal has changed;
  • Step 104 Analyze the terminal change angle according to the terminal posture change data.
  • the terminal attitude change data For example, if the terminal is a smart phone, the current posture is that the plane of the screen is perpendicular to the ground and the screen is placed horizontally.
  • the sensor data collected by the gyroscope is used as the terminal attitude change data
  • the sensor data can be analyzed. Knowing the current attitude change mode and degree of the terminal, for example, the current terminal takes the central axis of the gyroscope as the axis, and when viewed from the top to the clockwise rotation, the current terminal rotation angle can be calculated from the data collected by the sensor data, that is, Calculate the angle of change of the terminal, for example, by calculation, the smartphone rotates 15° clockwise (from top to bottom);
  • Step 105 Calculate a new live view angle according to the current live view and the change angle of the terminal;
  • the panoramic picture corresponds to an angle of 360°, so that a new live view angle can be calculated according to the calculated change angle of the terminal and the perspective of the current live broadcast picture.
  • the current live view angle is the screen corresponding to the clockwise rotation of 45° of the preset reference 0° line, and the terminal change angle is 15° clockwise, and the new live view angle is the preset reference 0° line.
  • the hour hand rotates 60°;
  • Step 106 Select, from the panoramic screen, a screen corresponding to the new live view angle as a new live broadcast screen;
  • the panoramic picture is a 360° picture obtained by pre-processing
  • the calculated new live picture view angle may be any view
  • the corresponding new live picture is centered on the new live view angle and projected to
  • the size of the picture can be corresponding to the full screen size of the terminal screen, that is, the size of the new live picture is the size of the picture corresponding to the angle that can be collected by a live broadcast unit.
  • the specific selection method may be based on a The live broadcast position can be selected from the panoramic view; therefore, it can be seen that the new live broadcast screen may be a picture collected by a live broadcast station, or may be a live broadcast of two or more. The intersection of the pictures captured by the station.
  • the panoramic live broadcast method provided by the embodiment of the present invention continuously receives the collected pictures of the live broadcast positions of different viewing angles and combines each frame of the pictures into a panoramic picture, thereby receiving the terminal posture change data and correspondingly
  • the new live view angle can be calculated according to the current live view angle and the terminal change angle, and the corresponding picture is selected from the panoramic picture as a new live picture.
  • the user can obtain the corresponding viewing angle by changing the posture of the terminal.
  • it is not limited to the live view provided by the live server.
  • the adjustment mode can select any viewing angle, and is not limited to the fixed viewing angle of the live broadcast position. , thus providing a better user experience.
  • the above-mentioned panoramic picture may be a circular 360° picture, or a hemispherical picture obtained according to the acquisition picture of the live broadcast position of different elevation and depression angles.
  • the angle includes three axes of x, y, and z, and the calculation is performed. The manner is similar to the above-exemplified manner, but further corrections and more calculation steps are needed, and details are not described herein again.
  • the live broadcast location of the different perspectives includes a primary live broadcast location
  • the method further includes:
  • the acquisition screen of the primary live broadcast location is used as the initial live broadcast screen.
  • the initial live broadcast screen in the initial state By setting the initial live broadcast screen in the initial state to be the acquisition screen of the main live broadcast position, the user is guided to watch and give the user a better viewing experience.
  • the step 103 of receiving the terminal posture change data may further include the following steps:
  • the preset posture change data threshold is associated with returning to the main live broadcast position acquisition screen instruction; the preset time interval may be a default
  • the set value can also be a user-defined value, for example, 2 to 5 seconds;
  • the current live broadcast screen is switched to the collection screen of the primary live broadcast position
  • the preset posture change data threshold is a threshold value that needs to be generated by the terminal posture change data correspondingly generated by the user according to the posture change excited by the user according to the specified action, and within the threshold value, the user is determined to be excited from the external posture change.
  • the corresponding command is generated; here, the specified action can be set to, for example, left and right or up and down repeatedly shaking one or more times, and the corresponding terminal is generated within the preset time interval by the occurrence of the specified action.
  • the posture change data when the terminal posture change data falls within the preset posture change data threshold, it is determined that the specified action occurs, and the corresponding instruction is triggered. In this embodiment, the return to the main live broadcast machine is triggered. The bit captures the picture command, thereby returning to the acquisition screen of the primary live broadcast location.
  • the user may continuously switch the viewing angle, and the viewing angle may be less suitable for viewing. According to the foregoing embodiment, it can be seen that, by the occurrence of the specified action, the live video can be switched back to the collecting screen of the main live broadcast position, thereby The user can easily return to the viewing angle that is more suitable for viewing.
  • the initial posture of the user terminal can also be adjusted in this manner.
  • the posture of the terminal is correspondingly the screen.
  • the sensor's acquisition base point can be corrected, so that the user can shake the terminal in the sitting state, and the angle of view can be adjusted accordingly to obtain the desired angle of view.
  • the step 104 of analyzing the terminal change angle according to the terminal posture change data needs to be further refined to distinguish whether the terminal posture change data is a terminal angle change or a return to the main live broadcast.
  • the change of the position of the machine to collect the picture optionally, by distinguishing the rate and direction of the change of the acceleration, can distinguish whether the terminal is rotated back to the original position after rotating to an angle, or is reciprocating, that is, the attitude change of the terminal.
  • the data is not in the preset attitude change data threshold, it is determined that it needs to calculate the terminal change angle according to the terminal posture change data, and the corresponding change is straight.
  • the terminal posture change data is in the preset posture change data threshold, the live broadcast screen is switched to the main live broadcast position acquisition screen.
  • the method further includes the following steps:
  • the terminal touch gesture data is data generated on the terminal due to the touch gesture
  • the preset touch gesture data threshold is associated with a zoom live view instruction; where the preset touch gesture data threshold is associated with the zoom live view instruction, That is, when the monitored terminal touch gesture data is in the preset touch gesture data threshold, it is determined that the zoom live view command is currently generated;
  • the terminal touch gesture data is in the preset touch gesture data threshold, calculating, according to the terminal touch gesture data, a zoom ratio and a trigger position of the terminal touch gesture data; where, according to the terminal touch gesture data, Alternatively, if the terminal touch gesture is that two fingers click on the screen and slide in the opposite direction, it is determined that the instruction to enlarge the live broadcast screen is received, and according to the length of the finger sliding, the corresponding enlargement ratio is calculated, and if the terminal touches The gesture is that two fingers click on the screen and slide in the opposite direction, and then it is determined that the instruction to reduce the live broadcast screen is received, and the corresponding reduction ratio is calculated according to the length of the finger sliding;
  • the current live video is scaled centering on the trigger position.
  • the user can operate the live video screen in real time according to his own needs, thereby obtaining the zoom ratio that he wants, and can also obtain a close-up picture of the person or scene he is interested in through this function.
  • the step 103 of receiving the terminal posture change data further includes the following steps:
  • the angle multiple change command may be an instruction that is triggered by a preset angle multiple icon (such as 0.5 times, 2 times, 4 times, etc.) in the screen, or may be a touch gesture
  • the angle multiplier change command issued, such as single point and up to double, single point and slide down to double, and so on;
  • the angle change multiple is analyzed; if the angle multiple icon is clicked, the multiple corresponding to the corresponding icon is the angle change multiple. If the single point sliding adjustment is used, the sliding length can be used according to the sliding length. Calculate the angle change multiple;
  • the step of analyzing the terminal change angle according to the terminal posture change data includes:
  • the terminal change angle is calculated.
  • the user can adjust the angle multiplier change according to the need, that is, the angle change of the angle when the user rotates the terminal, and the corresponding change of the angle of view is a multiple of the rotation angle, thereby adapting to different users.
  • Operating habits that is, the angle change of the angle when the user rotates the terminal, and the corresponding change of the angle of view is a multiple of the rotation angle, thereby adapting to different users.
  • FIG. 2 is a schematic flowchart diagram of another embodiment of a panoramic live broadcast method provided by the present invention.
  • the panoramic live broadcast method includes the following steps:
  • Step 201 continuously receive an acquisition screen of a live broadcast position of different viewing angles
  • Step 202 In the initial state, the collection screen of the primary live broadcast location is used as an initial live broadcast screen;
  • Step 203 Synthesize each frame of the live broadcast position of the different perspective into a panoramic picture.
  • Step 204 Receive an angle multiple change instruction
  • Step 205 Analyze an angle change multiple according to the angle multiple change instruction.
  • Step 206 Receive terminal posture change data.
  • Step 207 Analyze an original change angle according to the terminal posture change data.
  • Step 208 Combine the angle change multiple and the original change angle to calculate a terminal change angle.
  • Step 209 Calculate a new live view angle according to the current live view and the change angle of the terminal;
  • Step 210 Select, from the panoramic screen, a screen corresponding to the new live view angle as a new live broadcast screen.
  • Step 211 Receive terminal touch gesture data.
  • Step 212 Determine whether the terminal touch gesture data is in a preset touch gesture data threshold; the preset touch gesture data threshold is associated with a zoom live video command;
  • Step 213 If the terminal touch gesture data is in the preset touch gesture data threshold, calculate a zoom ratio and a trigger position of the terminal touch gesture data according to the terminal touch gesture data;
  • Step 214 According to the scaling ratio, zooming on the current live broadcast screen centering on the trigger position;
  • Step 215 If the terminal touch gesture data is in the preset touch gesture data threshold, no processing is performed.
  • the panoramic live broadcast method provided by the embodiment of the present invention is continuously connected.
  • the collection picture of the live broadcast position of different viewing angles is combined and each frame picture is synthesized into a panoramic picture, so that when the terminal posture change data is received and the terminal change angle is calculated correspondingly, the angle of view of the current live picture and the change angle of the terminal can be
  • the new live view angle is calculated and the corresponding picture is selected from the panoramic picture as a new live picture.
  • the user can obtain the corresponding viewing angle by changing the terminal posture, and is not limited to live broadcast.
  • this adjustment method can select any view without being limited to the fixed view of the live broadcast, thus providing a better user experience.
  • FIG. 3 is a schematic structural diagram of a module of an embodiment of a panoramic live broadcast device 300 according to the present invention.
  • the panoramic live broadcast device 300 includes an acquisition screen receiving module 301, a panoramic screen synthesis module 302, an attitude data receiving module 303, a change angle analysis module 304, a perspective calculation module 305, and a live screen selection module 306.
  • the collection picture receiving module 301 is configured to continuously receive the collection pictures of the live broadcast positions of different viewing angles.
  • the live broadcast location is a camera for collecting live scenes set at a live broadcast site; the live broadcast locations of different perspectives herein refer to cameras for collecting live scenes from different perspectives set at different locations on the live broadcast site.
  • the number of the live broadcast positions of the different viewing angles is continuously collected continuously and sent to the live broadcast server by the live broadcast site, and the live broadcast server receives the live broadcast positions of different perspectives.
  • the collected images are sent to different mobile terminals requesting the live broadcast service.
  • the mobile terminal continuously receives the collected images of the live broadcast positions of different viewing angles, that is, the live broadcast scenes forwarded by the live broadcast server. Collection screen of live broadcast positions from different perspectives.
  • the panoramic picture synthesizing module 302 is configured to synthesize each frame of the live broadcast positions of the different viewing angles into a panoramic picture.
  • one frame of the live broadcast positions of the different perspectives corresponding to the same time point is correspondingly combined into one frame panoramic picture;
  • a method for synthesizing a panoramic picture in the prior art which includes an overlap of an acquisition picture of each live broadcast location at an edge portion and a corresponding pixel fusion processing, and the like.
  • the attitude data receiving module 303 is configured to receive terminal posture change data.
  • the terminal posture change data refers to data generated when the posture of the terminal is changed, that is, when the terminal posture change data is received, the posture of the terminal is changed;
  • the terminal posture The change data may be acquired by a sensor capable of sensing the acceleration of the terminal, such as a gravity sensor, a gyroscope, etc., and when the sensor data changes, the posture of the terminal is changed.
  • the change angle analysis module 304 is configured to analyze and obtain a terminal change angle according to the terminal posture change data.
  • the terminal attitude change data For example, if the terminal is a smart phone, the current posture is that the plane of the screen is perpendicular to the ground and the screen is placed horizontally.
  • the sensor data collected by the gyroscope is used as the terminal attitude change data
  • the sensor data can be analyzed. Knowing the current attitude change mode and degree of the terminal, for example, the current terminal takes the central axis of the gyroscope as the axis, and when viewed from the top to the clockwise rotation, the current terminal rotation angle can be calculated from the data collected by the sensor data, that is,
  • the terminal change angle is calculated, for example, by calculation, the smartphone is rotated 15 degrees clockwise (viewed from top to bottom).
  • the view calculation module 305 is configured to calculate a new live view angle according to the current live view and the change angle of the terminal.
  • the panoramic picture corresponds to an angle of 360°, so that a new live view angle can be calculated according to the calculated change angle of the terminal and the perspective of the current live broadcast picture.
  • the current live view angle is the screen corresponding to the clockwise rotation of 45° of the preset reference 0° line, and the terminal change angle is 15° clockwise, and the new live view angle is the preset reference 0° line.
  • the hour hand rotates 60°.
  • the live video selection module 306 is configured to select, from the panoramic screen, a screen corresponding to the new live view angle as a new live broadcast screen.
  • the panoramic picture is a 360° picture obtained by pre-processing
  • the calculated new live picture view angle may be any view
  • the corresponding new live picture is centered on the new live view angle and projected to
  • the size of the picture can be corresponding to the full screen size of the terminal screen, that is, the size of the new live picture is the size of the picture corresponding to the angle that can be collected by a live broadcast unit.
  • the specific selection method may be based on a The live broadcast position can be selected from the panoramic view; therefore, it can be seen that the new live broadcast screen may be a picture collected by a live broadcast station, or may be a live broadcast of two or more. The intersection of the pictures captured by the station.
  • the panoramic live broadcast device 300 provided by the embodiment of the present invention continuously receives the collected images of the live broadcast positions of different viewing angles and combines each frame of the screen into a panoramic image, thereby receiving the terminal posture change data and
  • the new live view angle can be calculated according to the current live view angle and the terminal change angle, and the corresponding picture is selected from the panoramic picture as a new live picture.
  • the terminal posture is obtained to obtain a corresponding viewing angle.
  • the adjustment mode can select any viewing angle, and is not limited to the fixed viewing angle of the live broadcast position, thereby providing a more Good user experience.
  • the above-mentioned panoramic picture may be a circular 360° picture, or a hemispherical picture obtained according to the acquisition picture of the live broadcast position of different elevation and depression angles.
  • the angle includes three axes of x, y, and z, and the calculation is performed. The manner is similar to the above-exemplified manner, but further corrections and more calculation steps are needed, and details are not described herein again.
  • the live broadcast location of the different perspectives includes a primary live broadcast location
  • the panoramic live broadcast device 300 further includes: an initial screen selection module 307, configured to use an acquisition screen of the primary live broadcast location as an initial live broadcast screen in an initial state.
  • the initial live broadcast screen in the initial state By setting the initial live broadcast screen in the initial state to be the acquisition screen of the main live broadcast position, the user is guided to watch and give the user a better viewing experience.
  • the panoramic broadcast device 300 further includes a main screen returning module 308, configured to:
  • the preset posture change data threshold is associated with returning to the main live broadcast position acquisition screen instruction; and the preset posture change data threshold value is Returning to the main live broadcast position acquisition screen instruction;
  • the preset time interval may be a default setting value, or may be a user-defined value, for example, 2 to 5 seconds;
  • the current live broadcast screen is switched to the collection screen of the primary live broadcast position
  • the preset posture change data threshold is a threshold value that needs to be generated by the terminal posture change data correspondingly generated by the user according to the posture change excited by the user according to the specified action, and within the threshold value, the user is determined to be excited from the external posture change.
  • the corresponding command is generated; here, the specified action can be set to, for example, left and right or up and down repeatedly shaking one or more times, and the corresponding terminal is generated within the preset time interval by the occurrence of the specified action.
  • the posture change data when the terminal posture change data falls within the preset posture change data threshold, it is determined that the specified action occurs, and the corresponding instruction is triggered. In this embodiment, the return to the main live broadcast machine is triggered. The bit captures the picture command, thereby returning to the acquisition screen of the primary live broadcast location.
  • the user may continuously switch the viewing angle, and the viewing angle may be less suitable for viewing. According to the foregoing embodiment, it can be seen that, by the occurrence of the specified action, the live video can be switched back to the collecting screen of the main live broadcast position, thereby Users can easily return to a more suitable viewing angle to continue Watch it.
  • the initial posture of the user terminal can also be adjusted in this manner.
  • the posture of the terminal is correspondingly the screen.
  • the sensor's acquisition base point can be corrected, so that the user can shake the terminal in the sitting state, and the angle of view can be adjusted accordingly to obtain the desired angle of view.
  • the step 104 of analyzing the terminal change angle according to the terminal posture change data needs to be further refined to distinguish whether the terminal posture change data is a terminal angle change or a return to the main live broadcast.
  • the change of the position of the machine to collect the picture optionally, by distinguishing the rate and direction of the change of the acceleration, can distinguish whether the terminal is rotated back to the original position after rotating to an angle, or is reciprocating, that is, the attitude change of the terminal.
  • the data is not in the preset posture change data threshold, it is determined that it needs to calculate the terminal change angle according to the terminal posture change data, and change the live view angle accordingly.
  • the terminal posture change data is in the preset posture change data threshold, the live broadcast will be performed. The screen is switched to the main live location acquisition screen.
  • the panoramic broadcast device 300 further includes a screen scaling module 309, configured to:
  • the terminal touch gesture data is data generated on the terminal due to the touch gesture
  • the preset touch gesture data threshold is associated with a zoom live view instruction; where the preset touch gesture data threshold is associated with the zoom live view instruction, That is, when the monitored terminal touch gesture data is in the preset touch gesture data threshold, it is determined that the zoom live view command is currently generated;
  • the terminal touch gesture data is in the preset touch gesture data threshold, calculating, according to the terminal touch gesture data, a zoom ratio and a trigger position of the terminal touch gesture data; where, according to the terminal touch gesture data, Alternatively, if the terminal touch gesture is that two fingers click on the screen and slide in the opposite direction, it is determined that the instruction to enlarge the live broadcast screen is received, and according to the length of the finger sliding, the corresponding enlargement ratio is calculated, and if the terminal touches The gesture is that two fingers click on the screen and slide in the opposite direction, and then it is determined that the instruction to reduce the live broadcast screen is received, and the corresponding reduction ratio is calculated according to the length of the finger sliding;
  • the current live video is scaled centering on the trigger position.
  • the user can operate the live video screen in real time according to his own needs, thereby obtaining the zoom ratio that he wants, and can also obtain a close-up picture of the person or scene he is interested in through this function.
  • the panoramic broadcast device 300 further includes an angle change multiple acquisition module 310, configured to:
  • the angle multiple change command may be an instruction that is triggered by a preset angle multiple icon (such as 0.5 times, 2 times, 4 times, etc.) in the screen, or may be a touch gesture
  • the angle multiplier change command is issued, such as single point and slide up to double, single point and slide down to double, and so on.
  • the angle change multiple is analyzed; if the angle multiple icon is clicked, the multiple corresponding to the corresponding icon is the angle change multiple. If the single point sliding adjustment is used, the sliding length can be used according to the sliding length. Calculate the angle change multiple.
  • the change angle analysis module 305 is specifically configured to:
  • the terminal change angle is calculated.
  • the user can adjust the angle multiplier change according to the need, that is, the angle change of the angle when the user rotates the terminal, and the corresponding change of the angle of view is a multiple of the rotation angle, thereby adapting to different users.
  • Operating habits that is, the angle change of the angle when the user rotates the terminal, and the corresponding change of the angle of view is a multiple of the rotation angle, thereby adapting to different users.
  • FIG. 4 is a schematic structural diagram of an embodiment of a mobile terminal 400 provided by the present invention.
  • the mobile terminal 400 includes a processor 402, a memory 404, and a bus system 406.
  • the processor 402 and the memory 404 are connected by a bus system 406 for storing instructions for executing instructions stored by the memory 404.
  • the memory 404 can be a non-transitory computer readable storage medium for storing computer-executable instructions, when executed by one or more processors 402, for example, can cause processor 402 to perform Figure 1 described above
  • the method steps 101 to 106 in the method may also cause the processor 402 to perform the method steps 201 to 215 in FIG. 2 described above.
  • the computer executable instructions may also be stored and/or transferred in any non-transitory computer readable storage medium for use by or in connection with an instruction execution system, apparatus, or device, where the instructions are executed.
  • a system, apparatus, or device such as a computer-based system, a system containing a processor, or other system that can obtain instructions from, and execute instructions from, an instruction execution system, apparatus, or device.
  • non- Volatile computer readable storage medium can be any medium that tangibly embody or store computer-executable instructions, which can be used by or in connection with an instruction execution system, apparatus, or system.
  • Non-volatile computer readable storage media may include, but are not limited to, magnetic, optical, and/or semiconductor storage devices. Examples of such storage devices include magnetic disks, CD-ROM, DVD- or Blu-ray-based optical disks, and persistent solid-state memories. (such as flash memory, solid state drives, etc.).
  • the panoramic live broadcast device 300 in FIG. 3 described above is a computer software program device, and the modules 301-310 are computer software program modules stored in the memory 404, and are operated by a processor. Run 402 to implement the functions of each module.
  • the processor 402 may be a central processing unit ("CPU").
  • the processor 404 can also be other general purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), off-the-shelf programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic devices, discrete Hardware components, etc.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the bus system 406 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 406 in the figure.
  • the mobile terminal 400 is not limited to the components and configurations of FIG. 4, and may include other or additional components in various configurations.
  • each step of the above method or each module of the device may be completed by an integrated logic circuit of hardware in the processor 402 or an instruction in the form of software.
  • the modules of the steps or apparatus of the method disclosed in the embodiments of the present application may be directly embodied as hardware processor execution completion. Alternatively, the completion of the combination of hardware and software modules in the processor 402 is performed.
  • the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in memory 404, and processor 402 reads the information in memory 404 and, in conjunction with its hardware, performs the steps of the above method. To avoid repetition, it will not be described in detail here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明公开了一种全景直播方法及装置,包括:持续接收不同视角的直播机位的采集画面;将所述不同视角的直播机位的每一帧采集画面合成为全景画面;接收终端姿态变化数据;根据所述终端姿态变化数据,分析得到终端变化角度;根据当前直播画面的视角和所述终端变化角度,计算得到新的直播画面视角;从所述全景画面中,选取与所述新的直播画面视角对应的画面作为新的直播画面。本发明提出的全景直播方法及装置,能够调整直播画面的直播视角。

Description

全景直播方法及装置
本申请要求于2016年3月22日提交中国专利局,申请号为2016101666451,发明名称为“全景直播方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
【技术领域】
本发明涉及数据处理与控制技术领域,特别是指一种全景直播方法及装置。
【背景技术】
随着网络技术的不断发展,网络技术的应用现已普及到了社会生活的方方面面,曾经只能通过电视观看的直播节目,例如足球、晚会等等,现在已经能够通过网络观看直播,方便了人们的生活。
目前的直播节目通常是通过现场的不同视角的直播机位采集画面,然后由统一的直播服务器负责画面之间的切换,再将这些画面发送给终端直接进行观看。这种效果过于单一,用户不能根据自己所想观看的视角来操作直播画面,只能被动接受服务器所提供的直播画面。
【发明内容】
有鉴于此,本发明实施例的目的在于提出一种全景直播方法及装置,能够调整直播画面的直播视角。
基于上述目的本发明实施例提供的全景直播方法,应用于移动终端,包括:
持续接收不同视角的直播机位的采集画面;
将所述不同视角的直播机位的每一帧采集画面合成为全景画面;
接收终端姿态变化数据;
根据所述终端姿态变化数据,分析得到终端变化角度;
根据当前直播画面的视角和所述终端变化角度,计算得到新的直播画面视 角;
从所述全景画面中,选取与所述新的直播画面视角对应的画面作为新的直播画面。
在一些实施方式中,所述不同视角的直播机位中包括主直播机位;
所述接收不同视角的直播机位的采集画面的步骤之后还包括:
在初始状态下,将主直播机位的采集画面作为初始直播画面。
在一些实施方式中,所述接收终端姿态变化数据的步骤之后还包括:
判断预设时间间隔内的终端姿态变化数据是否处于预设姿态变化数据阈值中;所述预设姿态变化数据阈值与返回主直播机位采集画面指令相关联;
若预设时间间隔内的终端姿态变化数据处于预设姿态变化数据阈值中,则将当前直播画面切换为所述主直播机位的采集画面。
在一些实施方式中,所述将所述不同视角的直播机位的采集画面组成为全景画面的步骤之后还包括:
接收终端触摸手势数据;
判断所述终端触摸手势数据是否处于预设触摸手势数据阈值中;所述预设触摸手势数据阈值与缩放直播画面指令相关联;
若所述终端触摸手势数据处于预设触摸手势数据阈值中,则根据所述终端触摸手势数据,计算得到缩放比例和所述终端触摸手势数据的触发位置;
根据所述缩放比例,以所述触发位置为中心,缩放当前直播画面。
在一些实施方式中,所述接收终端姿态变化数据的步骤之前还包括:
接收角度倍数变化指令;
根据所述角度倍数变化指令,分析得到角度变化倍数;
所述根据所述终端姿态变化数据,分析得到终端变化角度的步骤包括:
根据所述终端姿态变化数据,分析得到原始变化角度;
结合所述角度变化倍数和所述原始变化角度,计算得到终端变化角度。
本发明实施例的另一方面还提供了一种全景直播装置,包括:
采集画面接收模块,用于持续接收不同视角的直播机位的采集画面;
全景画面合成模块,用于将所述不同视角的直播机位的每一帧采集画面合成为全景画面;
姿态数据接收模块,用于接收终端姿态变化数据;
变化角度分析模块,用于根据所述终端姿态变化数据,分析得到终端变化角度;
视角计算模块,用于根据当前直播画面的视角和所述终端变化角度,计算得到新的直播画面视角;
直播画面选取模块,用于从所述全景画面中,选取与所述新的直播画面视角对应的画面作为新的直播画面。
在一些实施方式中,所述不同视角的直播机位中包括主直播机位;
所述装置还包括:初始画面选择模块,用于在初始状态下,将主直播机位的采集画面作为初始直播画面。
在一些实施方式中,所述的装置还包括主画面返回模块,用于:
判断预设时间间隔内的终端姿态变化数据是否处于预设姿态变化数据阈值中;所述预设姿态变化数据阈值与返回主直播机位采集画面指令相关联;
若预设时间间隔内的终端姿态变化数据处于预设姿态变化数据阈值中,则将当前直播画面切换为所述主直播机位的采集画面。
在一些实施方式中,所述的装置还包括画面缩放模块,用于:
接收终端触摸手势数据;
判断所述终端触摸手势数据是否处于预设触摸手势数据阈值中;所述预设触摸手势数据阈值与缩放直播画面指令相关联;
若所述终端触摸手势数据处于预设触摸手势数据阈值中,则根据所述终端触摸手势数据,计算得到缩放比例和所述终端触摸手势数据的触发位置;
根据所述缩放比例,以所述触发位置为中心,缩放当前直播画面。
在一些实施方式中,所述的装置还包括角度变化倍数获取模块,用于:
接收角度倍数变化指令;
根据所述角度倍数变化指令,分析得到角度变化倍数;
所述变化角度分析模块,用于:
根据所述终端姿态变化数据,分析得到原始变化角度;
结合所述角度变化倍数和所述原始变化角度,计算得到终端变化角度。
从上面所述可以看出,本发明实施例提供的全景直播方法及装置,通过持续接收不同视角直播机位的采集画面并将每一帧画面合成为全景画面,从而在接收到终端姿态变化数据并相应计算出终端变化角度时,能够根据当前直播画面的视角和所述终端变化角度计算得到新的直播画面视角并从全景画面中将相对应的画面选取出来作为新的直播画面,通过这种方式,使得用户能够通过改变终端姿态来获得相应的观看视角,一方面不必局限于直播服务器所提供的直播视角,另一方面,这种调节方式可以选取任意视角,而不必局限于直播机位的固定视角,从而提供了更好的用户体验。
【附图说明】
图1为本发明提供的全景直播方法的一个实施例的流程示意图;
图2为本发明提供的全景直播方法的另一个实施例的流程示意图;
图3为本发明提供的全景直播装置实施例的模块结构示意图;
图4为本发明提供的移动终端实施例的结构示意图。
【具体实施方式】
为使本发明的目的、技术方案和优点更加清楚明白,以下结合具体实施例,并参照附图,对本发明进一步详细说明。
需要说明的是,本发明实施例中所有使用“第一”和“第二”的表述均是为了区分两个相同名称非相同的实体或者非相同的参量,可见“第一”“第二”仅为了表述的方便,不应理解为对本发明实施例的限定,后续实施例对此不再一一说明。
本发明的第一个方面,提出了一种能够调整直播画面的直播视角的全景直 播方法。如图1所示,为本发明提供的全景直播方法的一个实施例的流程示意图。
所述全景直播方法,应用于移动终端,包括以下步骤:
步骤101:持续接收不同视角的直播机位的采集画面;
通常,所述直播机位是设置在直播现场的用于采集现场画面的摄像机;这里的不同视角的直播机位是指在直播现场的不同位置设置的、用于从不同视角采集现场画面的摄像机,其数量可根据需要进行设置;所述不同视角的直播机位的采集画面是连续不断地持续采集并由直播现场发送到直播服务器上的,而直播服务器在接收到不同视角的直播机位的采集画面之后,又将这些采集画面发送到不同的请求该现场直播服务的移动终端中,这里,移动终端所持续接收不同视角的直播机位的采集画面,即为由直播服务器转发的直播现场的不同视角的直播机位的采集画面;
步骤102:将所述不同视角的直播机位的每一帧采集画面合成为全景画面;
在持续接收不同视角的直播机位的采集画面的过程中,同一时间点对应的各个不同视角的直播机位的一帧采集画面被相应地合成为一帧全景画面;全景画面的合成方式可采用现有技术中的全景图片合成方式,其中包含有各直播机位的采集画面在边缘部分的重叠和相应地像素融合处理,等等;
步骤103:接收终端姿态变化数据;
这里,所述终端姿态变化数据是指终端的姿态发生了变化而产生的数据,即当接收到终端姿态变化数据时,说明终端的姿态发生了变化;所述终端姿态变化数据可以是通过能够感应终端加速度的传感器采集的,例如重力传感器、陀螺仪等等,当传感器数据发生变化时,即说明终端的姿态发生了变化;
步骤104:根据所述终端姿态变化数据,分析得到终端变化角度;
举例来说,假设终端为智能手机,其当前的姿态为屏幕所在平面垂直于地面且屏幕为横向摆放,当由陀螺仪采集到的传感器数据作为终端姿态变化数据时,可以通过分析该传感器数据得知终端当前的姿态变化方式和程度,例如当前终端以陀螺仪的中心轴线为轴,从上往下看为顺时针旋转时,则可通过传感器数据采集到的数据算出当前终端旋转角度,即计算出终端变化角度,例如通过计算,智能手机为顺时针(从上往下看)旋转了15°;
步骤105:根据当前直播画面的视角和所述终端变化角度,计算得到新的直播画面视角;
由于直播现场的采集画面被预先处理为了全景画面,所述全景画面对应了360°的角度,因此,可以根据已经计算得到的终端变化角度,以及当前直播画面的视角,计算得到新的直播画面视角,例如,当前直播画面视角为预设基准0°线的顺时针旋转45°所对应的画面,终端变化角度为顺时针旋转15°,则新的直播画面视角为预设基准0°线的顺时针旋转60°;
步骤106:从所述全景画面中,选取与所述新的直播画面视角对应的画面作为新的直播画面;
这里,所述全景画面是通过预处理得到的360°画面,而计算得到新的直播画面视角可以是任意视角,其所对应的新的直播画面为以该新的直播画面视角为中心,投射到全景画面上所得到的能够对应为终端屏幕尺寸全副画面,即所述新的直播画面的大小为一部直播机位所能采集的角度所对应的画面的大小,具体的选取方式可以是根据一部直播机位能够采集的角度来从全景画面中进行选取;因此,可以看出,所述新的直播画面可以是正好一部直播机位所采集的画面,也可以是两部及以上的直播机位所采集的画面的交集。
从上述实施例可以看出,本发明实施例提供的全景直播方法,通过持续接收不同视角直播机位的采集画面并将每一帧画面合成为全景画面,从而在接收到终端姿态变化数据并相应计算出终端变化角度时,能够根据当前直播画面的视角和所述终端变化角度计算得到新的直播画面视角并从全景画面中将相对应的画面选取出来作为新的直播画面,通过这种方式,使得用户能够通过改变终端姿态来获得相应的观看视角,一方面不必局限于直播服务器所提供的直播视角,另一方面,这种调节方式可以选取任意视角,而不必局限于直播机位的固定视角,从而提供了更好的用户体验。
此外,上述全景画面可以是环形的360°画面,也可以根据不同仰俯角的直播机位的采集画面而得到的半球形的画面,此时,角度则包含x、y、z三个轴,计算方式与上述例举的方式类似,不过需要进一步修正和更多的计算步骤,在此不再赘述。
可选的,在一些实施方式中,所述不同视角的直播机位中包括主直播机位;
所述接收不同视角的直播机位的采集画面的步骤101之后还包括:
在初始状态下,将主直播机位的采集画面作为初始直播画面。
通过设置初始状态下初始直播画面为主直播机位的采集画面,引导用户的观看,并给予用户较好的观看体验。
进一步的,在一些可选实施方式中,所述接收终端姿态变化数据的步骤103之后还可包括以下步骤:
判断预设时间间隔内的终端姿态变化数据是否处于预设姿态变化数据阈值中;所述预设姿态变化数据阈值与返回主直播机位采集画面指令相关联;所述预设时间间隔可以是默认设置的值,也可以是用户自定义的值,例如2~5秒;
若预设时间间隔内的终端姿态变化数据处于预设姿态变化数据阈值中,则将当前直播画面切换为所述主直播机位的采集画面;
其中,所述预设姿态变化数据阈值是需要被用户根据指定动作从外部激发的姿态变化而相应产生的终端姿态变化数据所需要处于的阈值,在阈值内,则认定用户从外部激发的姿态变化符合了指定动作,从而产生了相应的指令;这里,可以将指定动作设置为,例如左右或上下反复摇晃1次或多次,通过指定动作的发生而在预设时间间隔内产生了相应的终端姿态变化数据,该终端姿态变化数据落入所述预设姿态变化数据阈值内时,则认定为发生了指定动作,则触发相应的指令,在本实施例中,即为触发了返回主直播机位采集画面指令,从而返回所述主直播机位的采集画面。
由于用户的不断切换视角,可能会出现视角较为不适合观看的状况,通过上述实施例,可以看出,通过指定动作的发生,可以将直播画面再切换回主直播机位的采集画面,从而使用户能够很方便地回到较为适合观看的视角继续进行观看。
此外,通过上述返回主直播机位的采集画面的方式,还可以通过这种方式调整用户终端的初始姿态,例如,一开始用户采用躺着的姿势观看直播时,终端的姿态也相应地为屏幕相对于地面平行的姿态,而当用户需要坐起时,这时会被误以为用户需要调整角度,从而切换了视角,此时用户只需再通过指定动作将其切换回主直播机位的视角,就可纠正传感器的采集基点,从而使得用户在坐姿状态下晃动终端,能够相应地调整视角从而得到自己想要的视角。
这里,当增加了上述实施例后,所述根据所述终端姿态变化数据,分析得到终端变化角度的步骤104则需要进一步细化,以区分终端姿态变化数据是终端角度变化,还是为了返回主直播机位采集画面而发生的变化,可选的,通过区分加速度的变化速率和方向,能够区分出终端是向某个角度旋转后回到原位,还是进行了往复运动,亦即,终端姿态变化数据不处于预设姿态变化数据阈值中时,则判定其需要根据终端姿态变化数据计算终端变化角度,并相应改变直 播视角,当终端姿态变化数据处于预设姿态变化数据阈值中时,则将直播画面切换为主直播机位采集画面。
可选的,在一些实施方式中,所述将所述不同视角的直播机位的采集画面组成为全景画面的步骤102之后还可进一步包括以下步骤:
接收终端触摸手势数据;所述终端触摸手势数据为,在终端上发生的因为触摸手势而产生的数据;
判断所述终端触摸手势数据是否处于预设触摸手势数据阈值中;所述预设触摸手势数据阈值与缩放直播画面指令相关联;这里,预设触摸手势数据阈值与缩放直播画面指令相关联,亦即,当监测到的终端触摸手势数据处于预设触摸手势数据阈值中时,则判定当前产生了缩放直播画面指令;
若所述终端触摸手势数据处于预设触摸手势数据阈值中,则根据所述终端触摸手势数据,计算得到缩放比例和所述终端触摸手势数据的触发位置;这里,根据所述终端触摸手势数据的可选方式为:例如终端触摸手势为两只手指点击屏幕并向相反方向滑动,则判定为接收到放大直播画面指令,根据手指滑动的长度,计算得到相应的放大比例,相反的,若终端触摸手势为两只手指点击屏幕并向相向方向滑动,则判定为接收到缩小直播画面指令,根据手指滑动的长度,计算得到相应的缩小比例;
根据所述缩放比例,以所述触发位置为中心,缩放当前直播画面。
通过上述实施例,用户可以根据自己的需要实时操作直播画面,从而得到自己想要的缩放比例,并且还能通过此功能得到自己感兴趣的人物或场景的特写画面。
较佳的,在一些可选实施方式中,所述接收终端姿态变化数据的步骤103之前还进一步包括以下步骤:
接收角度倍数变化指令;这里,所述角度倍数变化指令可以是屏幕中预设的角度倍数图标(如0.5倍,2倍,4倍等)被点击而发出的指令,也可以是通过触摸手势而发出的角度倍数变化指令,例如单点并向上滑动为加倍,单点并向下滑动为减倍,等等;
根据所述角度倍数变化指令,分析得到角度变化倍数;若为角度倍数图标被点击而发出,相应图标对应的倍数即为角度变化倍数,若采用单点滑动的方式调节,则可根据滑动长度来计算角度变化倍数;
所述根据所述终端姿态变化数据,分析得到终端变化角度的步骤包括:
根据所述终端姿态变化数据,分析得到原始变化角度;
结合所述角度变化倍数和所述原始变化角度,计算得到终端变化角度。
通过上述实施例,使得用户可以根据需要调节其角度倍数变化,即通过不同的角度倍数变化,使得用户在旋转终端时的角度而对应的视角变化为旋转角度的呈倍数变化,从而适应不同用户的操作习惯。
本发明还提供了所述全景直播方法的另一个实施例。如图2所示,为本发明提供的全景直播方法的另一个实施例的流程示意图。
所述全景直播方法,包括以下步骤:
步骤201:持续接收不同视角的直播机位的采集画面;
步骤202:在初始状态下,将主直播机位的采集画面作为初始直播画面;
步骤203:将所述不同视角的直播机位的每一帧采集画面合成为全景画面;
步骤204:接收角度倍数变化指令;
步骤205:根据所述角度倍数变化指令,分析得到角度变化倍数;
步骤206:接收终端姿态变化数据;
步骤207:根据所述终端姿态变化数据,分析得到原始变化角度;
步骤208:结合所述角度变化倍数和所述原始变化角度,计算得到终端变化角度;
步骤209:根据当前直播画面的视角和所述终端变化角度,计算得到新的直播画面视角;
步骤210:从所述全景画面中,选取与所述新的直播画面视角对应的画面作为新的直播画面;
步骤211:接收终端触摸手势数据;
步骤212:判断所述终端触摸手势数据是否处于预设触摸手势数据阈值中;所述预设触摸手势数据阈值与缩放直播画面指令相关联;
步骤213:若所述终端触摸手势数据处于预设触摸手势数据阈值中,则根据所述终端触摸手势数据,计算得到缩放比例和所述终端触摸手势数据的触发位置;
步骤214:根据所述缩放比例,以所述触发位置为中心,缩放当前直播画面;
步骤215:若所述终端触摸手势数据处于预设触摸手势数据阈值中,则不做处理。
从上述实施例可以看出,本发明实施例提供的全景直播方法,通过持续接 收不同视角直播机位的采集画面并将每一帧画面合成为全景画面,从而在接收到终端姿态变化数据并相应计算出终端变化角度时,能够根据当前直播画面的视角和所述终端变化角度计算得到新的直播画面视角并从全景画面中将相对应的画面选取出来作为新的直播画面,通过这种方式,使得用户能够通过改变终端姿态来获得相应的观看视角,一方面不必局限于直播服务器所提供的直播视角,另一方面,这种调节方式可以选取任意视角,而不必局限于直播机位的固定视角,从而提供了更好的用户体验。
本发明的第二个方面,提出了一种能够调整直播画面的直播视角的全景直播装置。如图3所示,为本发明提供的全景直播装置300实施例的模块结构示意图。
所述全景直播装置300,包括:采集画面接收模块301,全景画面合成模块302,姿态数据接收模块303,变化角度分析模块304,视角计算模块305,以及直播画面选取模块306。
采集画面接收模块301,用于持续接收不同视角的直播机位的采集画面。
通常,所述直播机位是设置在直播现场的用于采集现场画面的摄像机;这里的不同视角的直播机位是指在直播现场的不同位置设置的、用于从不同视角采集现场画面的摄像机,其数量可根据需要进行设置;所述不同视角的直播机位的采集画面是连续不断地持续采集并由直播现场发送到直播服务器上的,而直播服务器在接收到不同视角的直播机位的采集画面之后,又将这些采集画面发送到不同的请求该现场直播服务的移动终端中,这里,移动终端所持续接收不同视角的直播机位的采集画面,即为由直播服务器转发的直播现场的不同视角的直播机位的采集画面。
全景画面合成模块302,用于将所述不同视角的直播机位的每一帧采集画面合成为全景画面。
在持续接收不同视角的直播机位的采集画面的过程中,同一时间点对应的各个不同视角的直播机位的一帧采集画面被相应地合成为一帧全景画面;全景画面的合成方式可采用现有技术中的全景图片合成方式,其中包含有各直播机位的采集画面在边缘部分的重叠和相应地像素融合处理,等等。
姿态数据接收模块303,用于接收终端姿态变化数据。
这里,所述终端姿态变化数据是指终端的姿态发生了变化而产生的数据,即当接收到终端姿态变化数据时,说明终端的姿态发生了变化;所述终端姿态 变化数据可以是通过能够感应终端加速度的传感器采集的,例如重力传感器、陀螺仪等等,当传感器数据发生变化时,即说明终端的姿态发生了变化。
变化角度分析模块304,用于根据所述终端姿态变化数据,分析得到终端变化角度。
举例来说,假设终端为智能手机,其当前的姿态为屏幕所在平面垂直于地面且屏幕为横向摆放,当由陀螺仪采集到的传感器数据作为终端姿态变化数据时,可以通过分析该传感器数据得知终端当前的姿态变化方式和程度,例如当前终端以陀螺仪的中心轴线为轴,从上往下看为顺时针旋转时,则可通过传感器数据采集到的数据算出当前终端旋转角度,即计算出终端变化角度,例如通过计算,智能手机为顺时针(从上往下看)旋转了15度。
视角计算模块305,用于根据当前直播画面的视角和所述终端变化角度,计算得到新的直播画面视角。
由于直播现场的采集画面被预先处理为了全景画面,所述全景画面对应了360°的角度,因此,可以根据已经计算得到的终端变化角度,以及当前直播画面的视角,计算得到新的直播画面视角,例如,当前直播画面视角为预设基准0°线的顺时针旋转45°所对应的画面,终端变化角度为顺时针旋转15°,则新的直播画面视角为预设基准0°线的顺时针旋转60°。
直播画面选取模块306,用于从所述全景画面中,选取与所述新的直播画面视角对应的画面作为新的直播画面。
这里,所述全景画面是通过预处理得到的360°画面,而计算得到新的直播画面视角可以是任意视角,其所对应的新的直播画面为以该新的直播画面视角为中心,投射到全景画面上所得到的能够对应为终端屏幕尺寸全副画面,即所述新的直播画面的大小为一部直播机位所能采集的角度所对应的画面的大小,具体的选取方式可以是根据一部直播机位能够采集的角度来从全景画面中进行选取;因此,可以看出,所述新的直播画面可以是正好一部直播机位所采集的画面,也可以是两部及以上的直播机位所采集的画面的交集。
从上述实施例可以看出,本发明实施例提供的全景直播装置300,通过持续接收不同视角直播机位的采集画面并将每一帧画面合成为全景画面,从而在接收到终端姿态变化数据并相应计算出终端变化角度时,能够根据当前直播画面的视角和所述终端变化角度计算得到新的直播画面视角并从全景画面中将相对应的画面选取出来作为新的直播画面,通过这种方式,使得用户能够通过改变 终端姿态来获得相应的观看视角,一方面不必局限于直播服务器所提供的直播视角,另一方面,这种调节方式可以选取任意视角,而不必局限于直播机位的固定视角,从而提供了更好的用户体验。
此外,上述全景画面可以是环形的360°画面,也可以根据不同仰俯角的直播机位的采集画面而得到的半球形的画面,此时,角度则包含x、y、z三个轴,计算方式与上述例举的方式类似,不过需要进一步修正和更多的计算步骤,在此不再赘述。
可选的,在一些实施方式中,所述不同视角的直播机位中包括主直播机位;
所述全景直播装置300还包括:初始画面选择模块307,用于在初始状态下,将主直播机位的采集画面作为初始直播画面。
通过设置初始状态下初始直播画面为主直播机位的采集画面,引导用户的观看,并给予用户较好的观看体验。
进一步的,在一些可选实施方式中,所述全景直播装置300,还包括主画面返回模块308,用于:
判断预设时间间隔内的终端姿态变化数据是否处于预设姿态变化数据阈值中;所述预设姿态变化数据阈值与返回主直播机位采集画面指令相关联;所述预设姿态变化数据阈值与返回主直播机位采集画面指令相关联;所述预设时间间隔可以是默认设置的值,也可以是用户自定义的值,例如2~5秒;
若预设时间间隔内的终端姿态变化数据处于预设姿态变化数据阈值中,则将当前直播画面切换为所述主直播机位的采集画面;
其中,所述预设姿态变化数据阈值是需要被用户根据指定动作从外部激发的姿态变化而相应产生的终端姿态变化数据所需要处于的阈值,在阈值内,则认定用户从外部激发的姿态变化符合了指定动作,从而产生了相应的指令;这里,可以将指定动作设置为,例如左右或上下反复摇晃1次或多次,通过指定动作的发生而在预设时间间隔内产生了相应的终端姿态变化数据,该终端姿态变化数据落入所述预设姿态变化数据阈值内时,则认定为发生了指定动作,则触发相应的指令,在本实施例中,即为触发了返回主直播机位采集画面指令,从而返回所述主直播机位的采集画面。
由于用户的不断切换视角,可能会出现视角较为不适合观看的状况,通过上述实施例,可以看出,通过指定动作的发生,可以将直播画面再切换回主直播机位的采集画面,从而使用户能够很方便地回到较为适合观看的视角继续进 行观看。
此外,通过上述返回主直播机位的采集画面的方式,还可以通过这种方式调整用户终端的初始姿态,例如,一开始用户采用躺着的姿势观看直播时,终端的姿态也相应地为屏幕相对于地面平行的姿态,而当用户需要坐起时,这时会被误以为用户需要调整角度,从而切换了视角,此时用户只需再通过指定动作将其切换回主直播机位的视角,就可纠正传感器的采集基点,从而使得用户在坐姿状态下晃动终端,能够相应地调整视角从而得到自己想要的视角。
这里,当增加了上述实施例后,所述根据所述终端姿态变化数据,分析得到终端变化角度的步骤104则需要进一步细化,以区分终端姿态变化数据是终端角度变化,还是为了返回主直播机位采集画面而发生的变化,可选的,通过区分加速度的变化速率和方向,能够区分出终端是向某个角度旋转后回到原位,还是进行了往复运动,亦即,终端姿态变化数据不处于预设姿态变化数据阈值中时,则判定其需要根据终端姿态变化数据计算终端变化角度,并相应改变直播视角,当终端姿态变化数据处于预设姿态变化数据阈值中时,则将直播画面切换为主直播机位采集画面。
可选的,在一些实施方式中,所述全景直播装置300,还包括画面缩放模块309,用于:
接收终端触摸手势数据;所述终端触摸手势数据为,在终端上发生的因为触摸手势而产生的数据;
判断所述终端触摸手势数据是否处于预设触摸手势数据阈值中;所述预设触摸手势数据阈值与缩放直播画面指令相关联;这里,预设触摸手势数据阈值与缩放直播画面指令相关联,亦即,当监测到的终端触摸手势数据处于预设触摸手势数据阈值中时,则判定当前产生了缩放直播画面指令;
若所述终端触摸手势数据处于预设触摸手势数据阈值中,则根据所述终端触摸手势数据,计算得到缩放比例和所述终端触摸手势数据的触发位置;这里,根据所述终端触摸手势数据的可选方式为:例如终端触摸手势为两只手指点击屏幕并向相反方向滑动,则判定为接收到放大直播画面指令,根据手指滑动的长度,计算得到相应的放大比例,相反的,若终端触摸手势为两只手指点击屏幕并向相向方向滑动,则判定为接收到缩小直播画面指令,根据手指滑动的长度,计算得到相应的缩小比例;
根据所述缩放比例,以所述触发位置为中心,缩放当前直播画面。
通过上述实施例,用户可以根据自己的需要实时操作直播画面,从而得到自己想要的缩放比例,并且还能通过此功能得到自己感兴趣的人物或场景的特写画面。
较佳的,在一些可选实施方式中,所述全景直播装置300,还包括角度变化倍数获取模块310,用于:
接收角度倍数变化指令;这里,所述角度倍数变化指令可以是屏幕中预设的角度倍数图标(如0.5倍,2倍,4倍等)被点击而发出的指令,也可以是通过触摸手势而发出的角度倍数变化指令,例如单点并向上滑动为加倍,单点并向下滑动为减倍,等等。
根据所述角度倍数变化指令,分析得到角度变化倍数;若为角度倍数图标被点击而发出,相应图标对应的倍数即为角度变化倍数,若采用单点滑动的方式调节,则可根据滑动长度来计算角度变化倍数。
所述变化角度分析模块305,具体用于:
根据所述终端姿态变化数据,分析得到原始变化角度;
结合所述角度变化倍数和所述原始变化角度,计算得到终端变化角度。
通过上述实施例,使得用户可以根据需要调节其角度倍数变化,即通过不同的角度倍数变化,使得用户在旋转终端时的角度而对应的视角变化为旋转角度的呈倍数变化,从而适应不同用户的操作习惯。
本发明的第三个方面,提出了一种移动终端400。如图4所示,为本发明提供的移动终端400实施例的结构示意图。所述移动终端400,包括包括处理器402,存储器404,以及总线系统406。其中,处理器402和存储器404通过总线系统406相连,该存储器404用于存储指令,该处理器402用于执行该存储器404存储的指令。
所述存储器404可以是非易失性计算机可读存储介质,以用于存储计算机可执行指令,该指令当由一个或多个处理器402执行时,例如可以使得处理器402执行以上描述的图1中的方法步骤101至步骤106,也可以使得处理器402执行以上描述的图2中的方法步骤201至步骤215。计算机可执行指令也可以在任何非易失性计算机可读存储介质内存储和/或传输,以便由指令执行系统、装置或设备使用,或者结合指令执行系统、装置或设备使用,其中该指令执行系统、装置或设备诸如基于计算机的系统、包含处理器的系统或可以从指令执行系统、装置或设备获取指令并执行该指令的其他系统。出于本文档的目的,“非 易失性计算机可读存储介质”可以是有形地包含或存储计算机可执行指令的任何介质,该计算机可执行指令可以用于由指令执行系统、设备或系统使用或者结合指令执行系统、装置或设备使用。非易失性计算机可读存储介质可以包括但不限于磁的、光的和/或半导体存储装置。这些存储装置的示例包括磁盘、基于CD、DVD或蓝光技术的光盘以及持久性固态存储器(诸如,闪存、固态驱动器等)。
作为本发明实施例的一方面,上述描述的图3中的全景直播装置300为计算机软件程序装置,所述模块301-310为计算机软件程序模块,存储于所述存储器404,工作时由处理器402运行,实现各模块的功能。
应当理解,在本申请实施例中,该处理器402可以是中央处理单元(Central Processing Unit,简称为“CPU”)。该处理器404还可以是其他通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
所述总线系统406除包括数据总线之外,还可以包括电源总线、控制总线和状态信号总线等。但是为了清楚说明起见,在图中将各种总线都标为总线系统406。
在本发明实施例中,所述移动终端400不限于图4的部件和配置,还可以包括以多种配置形式的其他或附加部件。
在实现过程中,上述方法的各步骤或装置的各模块可以通过处理器402中的硬件的集成逻辑电路或者软件形式的指令完成。结合本申请实施例所公开的方法的步骤或装置的各模块可以直接体现为硬件处理器执行完成。或者用处理器402中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器404,处理器402读取存储器404中的信息,结合其硬件完成上述方法的步骤。为避免重复,这里不再详细描述。
所属领域的普通技术人员应当理解:以上任何实施例的讨论仅为示例性的,并非旨在暗示本公开的范围(包括权利要求)被限于这些例子;在本发明的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上所述的本发明的不同方面的许多其它变化,为 了简明它们没有在细节中提供。
本发明的实施例旨在涵盖落入所附权利要求的宽泛范围之内的所有这样的替换、修改和变型。因此,凡在本发明的精神和原则之内,所做的任何省略、修改、等同替换、改进等,均应包含在本发明的保护范围之内。

Claims (10)

  1. 一种全景直播方法,其特征在于,应用于移动终端,包括:
    持续接收不同视角的直播机位的采集画面;
    将所述不同视角的直播机位的每一帧采集画面合成为全景画面;
    接收终端姿态变化数据;
    根据所述终端姿态变化数据,分析得到终端变化角度;
    根据当前直播画面的视角和所述终端变化角度,计算得到新的直播画面视角;
    从所述全景画面中,选取与所述新的直播画面视角对应的画面作为新的直播画面。
  2. 根据权利要求1所述的方法,其特征在于,所述不同视角的直播机位中包括主直播机位;
    所述接收不同视角的直播机位的采集画面的步骤之后还包括:
    在初始状态下,将主直播机位的采集画面作为初始直播画面。
  3. 根据权利要求2所述的方法,其特征在于,所述接收终端姿态变化数据的步骤之后还包括:
    判断预设时间间隔内的终端姿态变化数据是否处于预设姿态变化数据阈值中;所述预设姿态变化数据阈值与返回主直播机位采集画面指令相关联;
    若预设时间间隔内的终端姿态变化数据处于预设姿态变化数据阈值中,则将当前直播画面切换为所述主直播机位的采集画面。
  4. 根据权利要求1所述的方法,其特征在于,所述将所述不同视角的直播机位的采集画面组成为全景画面的步骤之后还包括:
    接收终端触摸手势数据;
    判断所述终端触摸手势数据是否处于预设触摸手势数据阈值中;所述预设触摸手势数据阈值与缩放直播画面指令相关联;
    若所述终端触摸手势数据处于预设触摸手势数据阈值中,则根据所述终端触摸手势数据,计算得到缩放比例和所述终端触摸手势数据的触发位置;
    根据所述缩放比例,以所述触发位置为中心,缩放当前直播画面。
  5. 根据权利要求1所述的方法,其特征在于,所述接收终端姿态变化数据的步骤之前还包括:
    接收角度倍数变化指令;
    根据所述角度倍数变化指令,分析得到角度变化倍数;
    所述根据所述终端姿态变化数据,分析得到终端变化角度的步骤包括:
    根据所述终端姿态变化数据,分析得到原始变化角度;
    结合所述角度变化倍数和所述原始变化角度,计算得到终端变化角度。
  6. 一种全景直播装置,其特征在于,包括:
    采集画面接收模块,用于持续接收不同视角的直播机位的采集画面;
    全景画面合成模块,用于将所述不同视角的直播机位的每一帧采集画面合成为全景画面;
    姿态数据接收模块,用于接收终端姿态变化数据;
    变化角度分析模块,用于根据所述终端姿态变化数据,分析得到终端变化角度;
    视角计算模块,用于根据当前直播画面的视角和所述终端变化角度,计算得到新的直播画面视角;
    直播画面选取模块,用于从所述全景画面中,选取与所述新的直播画面视角对应的画面作为新的直播画面。
  7. 根据权利要求6所述的装置,其特征在于,所述不同视角的直播机位中包括主直播机位;
    所述装置还包括:初始画面选择模块,用于在初始状态下,将主直播机位的采集画面作为初始直播画面。
  8. 根据权利要求7所述的装置,其特征在于,还包括主画面返回模块,用于:
    判断预设时间间隔内的终端姿态变化数据是否处于预设姿态变化数据阈值中;所述预设姿态变化数据阈值与返回主直播机位采集画面指令相关联;
    若预设时间间隔内的终端姿态变化数据处于预设姿态变化数据阈值中,则将当前直播画面切换为所述主直播机位的采集画面。
  9. 根据权利要求6所述的装置,其特征在于,还包括画面缩放模块,用于:
    接收终端触摸手势数据;
    判断所述终端触摸手势数据是否处于预设触摸手势数据阈值中;所述预设触摸手势数据阈值与缩放直播画面指令相关联;
    若所述终端触摸手势数据处于预设触摸手势数据阈值中,则根据所述终端 触摸手势数据,计算得到缩放比例和所述终端触摸手势数据的触发位置;
    根据所述缩放比例,以所述触发位置为中心,缩放当前直播画面。
  10. 根据权利要求6所述的装置,其特征在于,还包括角度变化倍数获取模块,用于:
    接收角度倍数变化指令;
    根据所述角度倍数变化指令,分析得到角度变化倍数;
    所述变化角度分析模块,用于:
    根据所述终端姿态变化数据,分析得到原始变化角度;
    结合所述角度变化倍数和所述原始变化角度,计算得到终端变化角度。
PCT/CN2016/089347 2016-03-22 2016-07-08 全景直播方法及装置 Ceased WO2017161777A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/245,976 US20170280054A1 (en) 2016-03-22 2016-08-24 Method and electronic device for panoramic live broadcast

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610166645.1 2016-03-22
CN201610166645.1A CN105828090A (zh) 2016-03-22 2016-03-22 全景直播方法及装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/245,976 Continuation US20170280054A1 (en) 2016-03-22 2016-08-24 Method and electronic device for panoramic live broadcast

Publications (1)

Publication Number Publication Date
WO2017161777A1 true WO2017161777A1 (zh) 2017-09-28

Family

ID=56524695

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/089347 Ceased WO2017161777A1 (zh) 2016-03-22 2016-07-08 全景直播方法及装置

Country Status (2)

Country Link
CN (1) CN105828090A (zh)
WO (1) WO2017161777A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10045686B2 (en) 2008-11-12 2018-08-14 Trice Medical, Inc. Tissue visualization and modification device
US10342579B2 (en) 2014-01-13 2019-07-09 Trice Medical, Inc. Fully integrated, disposable tissue visualization device
CN115209170A (zh) * 2022-06-28 2022-10-18 联通沃音乐文化有限公司 一种基于用户行为的直播视频彩铃视角切换播放方法
US11547446B2 (en) 2014-01-13 2023-01-10 Trice Medical, Inc. Fully integrated, disposable tissue visualization device
US11622753B2 (en) 2018-03-29 2023-04-11 Trice Medical, Inc. Fully integrated endoscope with biopsy capabilities and methods of use
US12035889B2 (en) 2008-07-22 2024-07-16 Trice Medical, Inc. Tissue modification devices and methods of using the same

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107800946A (zh) * 2016-09-02 2018-03-13 丰唐物联技术(深圳)有限公司 一种直播方法及系统
CN106383655A (zh) * 2016-09-19 2017-02-08 北京小度互娱科技有限公司 在全景播放过程中控制视角转换的交互控制方法及装置
CN106559663B (zh) * 2016-10-31 2019-07-26 努比亚技术有限公司 图像显示装置和方法
CN106569696B (zh) * 2016-11-08 2021-04-06 影石创新科技股份有限公司 一种渲染输出全景影像的方法、系统及便携式终端
CN108616557B (zh) * 2016-12-13 2022-01-25 中兴通讯股份有限公司 一种全景视频传输方法、装置、终端、服务器及系统
WO2018112898A1 (zh) * 2016-12-23 2018-06-28 深圳前海达闼云端智能科技有限公司 一种投影方法、装置及机器人
CN107135207A (zh) * 2017-04-19 2017-09-05 中国电子科技集团公司电子科学研究院 一种全景会议直播方法及系统
CN109960546B (zh) * 2017-12-14 2021-09-10 腾讯科技(深圳)有限公司 虚拟资源交互方法和装置、存储介质及电子装置
CN108093300B (zh) * 2017-12-28 2020-09-18 上海东方传媒技术有限公司 动画捕捉管理系统
CN108495148B (zh) * 2018-04-02 2021-07-20 四川隧唐科技股份有限公司 图像数据加载方法及装置
CN108898548B (zh) * 2018-06-27 2022-09-02 维沃移动通信有限公司 一种全景图的显示方法和移动终端
JP7341685B2 (ja) * 2019-03-19 2023-09-11 キヤノン株式会社 電子機器、電子機器の制御方法、プログラム、及び、記憶媒体
CN110689570B (zh) 2019-09-29 2020-11-27 北京达佳互联信息技术有限公司 虚拟形象直播方法、装置、电子设备及存储介质
CN111147883A (zh) * 2019-12-31 2020-05-12 歌尔科技有限公司 直播方法、装置、头戴显示设备和可读存储介质
CN111355966A (zh) * 2020-03-05 2020-06-30 上海乐杉信息技术有限公司 环绕自由视角直播方法及系统
CN111586465B (zh) * 2020-04-30 2022-10-04 广州方硅信息技术有限公司 直播间的操作交互方法、装置、设备及存储介质
CN111447462B (zh) * 2020-05-20 2022-07-05 上海科技大学 基于视角切换的视频直播方法、系统、存储介质及终端
CN112533005B (zh) * 2020-09-24 2022-10-04 深圳市佳创视讯技术股份有限公司 一种vr视频慢直播的交互方法及系统
CN112261424B (zh) * 2020-10-19 2022-11-18 北京字节跳动网络技术有限公司 图像处理方法、装置、电子设备及计算机可读存储介质
CN115134506A (zh) * 2021-03-26 2022-09-30 阿里巴巴新加坡控股有限公司 摄像画面调整方法、视频画面处理方法以及装置和系统
CN113891044B (zh) * 2021-09-29 2023-03-24 天翼物联科技有限公司 视频直播方法、装置、计算机设备及计算机可读存储介质
CN114191823B (zh) * 2021-12-07 2022-11-04 广州博冠信息科技有限公司 多视角的游戏直播方法及装置、电子设备
CN114286121A (zh) * 2021-12-22 2022-04-05 天翼视讯传媒有限公司 一种基于全景相机实现画面导播直播的方法和系统
CN114786061B (zh) * 2022-04-12 2023-08-22 杭州当虹科技股份有限公司 一种基于vr设备的画面视角修正方法
CN118968936B (zh) * 2024-07-25 2025-06-17 优创光电科技(盐城)有限公司 一种液晶显示屏的画面调整方法及系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102141846A (zh) * 2011-03-09 2011-08-03 中兴通讯股份有限公司 一种直觉式浏览内容的方法及移动终端
CN102902468A (zh) * 2012-10-23 2013-01-30 陈婉莹 移动终端地图浏览方法和装置
US20130083055A1 (en) * 2011-09-30 2013-04-04 Apple Inc. 3D Position Tracking for Panoramic Imagery Navigation
CN103116444A (zh) * 2013-02-07 2013-05-22 腾讯科技(深圳)有限公司 电子地图控制方法及电子地图装置
CN104010225A (zh) * 2014-06-20 2014-08-27 合一网络技术(北京)有限公司 显示全景视频的方法和系统
CN105187753A (zh) * 2015-08-06 2015-12-23 佛山六滴电子科技有限公司 一种录制全景视频的系统
CN105208368A (zh) * 2015-09-23 2015-12-30 北京奇虎科技有限公司 显示全景数据的方法及装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7812856B2 (en) * 2000-10-26 2010-10-12 Front Row Technologies, Llc Providing multiple perspectives of a venue activity to electronic wireless hand held devices
US10222975B2 (en) * 2012-08-27 2019-03-05 Apple Inc. Single contact scaling gesture
CN110650241B (zh) * 2014-06-16 2021-01-29 华为技术有限公司 移动终端中呈现全景照片的方法和移动终端

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102141846A (zh) * 2011-03-09 2011-08-03 中兴通讯股份有限公司 一种直觉式浏览内容的方法及移动终端
US20130083055A1 (en) * 2011-09-30 2013-04-04 Apple Inc. 3D Position Tracking for Panoramic Imagery Navigation
CN102902468A (zh) * 2012-10-23 2013-01-30 陈婉莹 移动终端地图浏览方法和装置
CN103116444A (zh) * 2013-02-07 2013-05-22 腾讯科技(深圳)有限公司 电子地图控制方法及电子地图装置
CN104010225A (zh) * 2014-06-20 2014-08-27 合一网络技术(北京)有限公司 显示全景视频的方法和系统
CN105187753A (zh) * 2015-08-06 2015-12-23 佛山六滴电子科技有限公司 一种录制全景视频的系统
CN105208368A (zh) * 2015-09-23 2015-12-30 北京奇虎科技有限公司 显示全景数据的方法及装置

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12035889B2 (en) 2008-07-22 2024-07-16 Trice Medical, Inc. Tissue modification devices and methods of using the same
US10045686B2 (en) 2008-11-12 2018-08-14 Trice Medical, Inc. Tissue visualization and modification device
US10342579B2 (en) 2014-01-13 2019-07-09 Trice Medical, Inc. Fully integrated, disposable tissue visualization device
US11547446B2 (en) 2014-01-13 2023-01-10 Trice Medical, Inc. Fully integrated, disposable tissue visualization device
US11622753B2 (en) 2018-03-29 2023-04-11 Trice Medical, Inc. Fully integrated endoscope with biopsy capabilities and methods of use
CN115209170A (zh) * 2022-06-28 2022-10-18 联通沃音乐文化有限公司 一种基于用户行为的直播视频彩铃视角切换播放方法
CN115209170B (zh) * 2022-06-28 2023-12-26 联通沃音乐文化有限公司 一种基于用户行为的直播视频彩铃视角切换播放方法

Also Published As

Publication number Publication date
CN105828090A (zh) 2016-08-03

Similar Documents

Publication Publication Date Title
WO2017161777A1 (zh) 全景直播方法及装置
CN104184985B (zh) 图像获取的方法及装置
JP6044328B2 (ja) 画像処理システム、画像処理方法およびプログラム
CN107580178B (zh) 一种图像处理方法及装置
US10547825B2 (en) Transmission of three-dimensional video
US9742995B2 (en) Receiver-controlled panoramic view video share
CN104902170B (zh) 一种拍照方法及终端
CN113301351B (zh) 视频播放方法、装置、电子设备及计算机存储介质
US20170280054A1 (en) Method and electronic device for panoramic live broadcast
JP5743016B2 (ja) 画像を生成する装置および方法
JP2024506639A (ja) 画像表示方法、装置、機器及び媒体
CN104735355A (zh) 一种智能终端的摄像方法及装置
CN104102421B (zh) 使用截屏内容代替拍摄内容的方法和系统
CN106231175A (zh) 一种终端手势拍照的方法
CN106162150B (zh) 一种拍照方法及移动终端
WO2019227309A1 (zh) 一种跟踪拍摄方法、设备及存储介质
CN113438550B (zh) 一种视频播放方法、视频会议方法、直播方法及相关装置
US10009550B1 (en) Synthetic imaging
CN105025209B (zh) 一种图像预览方法和装置
CN111277750A (zh) 拍摄控制方法、装置、电子设备及计算机存储介质
JP6394682B2 (ja) 方法および画像処理装置
TWI704408B (zh) 全景照相裝置及其影像映射結合方法
WO2023174009A1 (zh) 基于虚拟现实的拍摄处理方法、装置及电子设备
JP2020080194A (ja) 画像処理システム、画像処理方法およびプログラム
CN110875998A (zh) 全景照相装置及其影像映射结合方法

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16895127

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16895127

Country of ref document: EP

Kind code of ref document: A1