WO2018177314A1 - 全景图像的展示控制方法、装置及存储介质 - Google Patents

全景图像的展示控制方法、装置及存储介质 Download PDF

Info

Publication number
WO2018177314A1
WO2018177314A1 PCT/CN2018/080819 CN2018080819W WO2018177314A1 WO 2018177314 A1 WO2018177314 A1 WO 2018177314A1 CN 2018080819 W CN2018080819 W CN 2018080819W WO 2018177314 A1 WO2018177314 A1 WO 2018177314A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
panoramic image
parameter
adjustment parameter
panoramic
Prior art date
Application number
PCT/CN2018/080819
Other languages
English (en)
French (fr)
Inventor
阳丹
王贤骏
周莜
谢奕
徐刚
瞿佳
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Priority to EP18776100.2A priority Critical patent/EP3525473A4/en
Priority to JP2019520848A priority patent/JP6798019B2/ja
Priority to KR1020197017921A priority patent/KR102184586B1/ko
Publication of WO2018177314A1 publication Critical patent/WO2018177314A1/zh
Priority to US16/390,171 priority patent/US10764626B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222—Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42208—Display device provided on the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42222—Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data

Definitions

  • the present application relates to the field of computer technology, and in particular, to a display method, apparatus, and storage medium for panoramic images.
  • the panorama refers to an image with a horizontal viewing angle of 360 degrees and a vertical viewing angle of 180 degrees.
  • the panoramic image is full of three-dimensionality and realism, and it is a cost-effective virtual reality solution.
  • the panoramic technology can fully display the relationship between the whole movement of the character and the character.
  • the character and the environment are often integrated into one, which can create a vivid picture of the scene.
  • the application example of the present application provides a method for controlling display of a panoramic image, which is applied to a media content server, including:
  • the application example further provides a display control method for a panoramic image, which is applied to a mobile terminal, and includes:
  • the present application example also provides a display control device for panoramic images, including one or more processors and one or more memories, the one or more memories including computer readable instructions configured by the one or one
  • the above processor executes to implement:
  • the present application example also provides a display control device for panoramic images, including one or more processors and one or more memories, the one or more memories including computer readable instructions configured by the one or one
  • the above processor executes to implement:
  • the application also provides a non-transitory computer readable storage medium, wherein the storage medium stores machine readable instructions that are executable by a processor to perform the methods described above.
  • the adjustment of the panoramic image is more flexible.
  • FIG. 1 is a system architecture diagram related to an example of the present application
  • FIG. 2 is a flowchart of a display control method applied to a server side panoramic image according to an example of the present application
  • FIG. 3 is a diagram showing a thumbnail image triggering option page in a mobile terminal according to an example of the present application
  • FIG. 4 is a schematic diagram of a panoramic image before a smart TV display in an example of the present application.
  • FIG. 5 is a schematic diagram of panning a panoramic image in an example of the present application.
  • FIG. 6 is a schematic diagram of magnifying a panoramic image in an example of the present application.
  • FIG. 7 is a schematic flowchart of matching a spatial coordinate system with a panoramic coordinate system in an example of the present application
  • FIG. 8 is a schematic diagram of a space coordinate system and a panoramic space coordinate system in an example of the present application
  • FIG. 9 is a schematic diagram of a smart television display image identification code in an example of the present application.
  • FIG. 10 is a schematic diagram showing a panoramic image displayed by a mobile terminal and a smart TV in synchronization with an example of the present application;
  • FIG. 11 is a schematic diagram showing a prompt information displayed by a mobile terminal simultaneously displaying a panoramic image in an example of the present application
  • FIG. 12 is a schematic diagram of a target object found after the user adjusts the mobile terminal according to the prompt information in an example of the present application
  • FIG. 13 is a flowchart of a display control method applied to a panoramic image of a mobile terminal according to an example of the present application
  • FIG. 14 is a schematic structural diagram of a display control apparatus applied to a server side panoramic image in an example of the present application
  • 15 is a schematic structural diagram of a display control apparatus applied to a panoramic image of a mobile terminal side in an example of the present application;
  • FIG. 16 is a schematic structural diagram of a computing device in an example of the present application.
  • the present application provides a panoramic image viewing angle adjustment method and apparatus, and the system architecture applied by the method is as shown in FIG. 1 .
  • the system architecture includes a mobile terminal 101, a smart TV 102, a media content server 103, and an Internet 104.
  • the mobile terminal 101 and the smart TV 102 are connected to the media content server 103 via the Internet 104.
  • the mobile terminal 101 may be a user's smart phone or PDA or other user portable device, on which client software of various application software is installed, and the user can log in and use the client of various application software through the client device 101.
  • the client of the application can be a video playback client.
  • the above Internet 104 may include a wired network and a wireless network.
  • the smart TV 102 is equipped with a video playing application client, which can be used to play online video resources or local video resources.
  • the present application provides a display control method for a panoramic image, which is applied to the media content server 103. As shown in FIG. 2, the method mainly includes the following steps:
  • Step 201 Receive a panoramic image triggering instruction sent by the mobile terminal.
  • the panoramic image can be a panoramic picture or a panoramic video.
  • the mobile terminal 101 is bound to the smart TV 102, and the panoramic image triggering instruction may be a binding confirmation instruction sent by the mobile terminal 101 to the media content server 103 after the mobile terminal 101 and the smart television 102 are successfully bound.
  • the mobile terminal performs binding of the mobile terminal and the smart TV by scanning the graphic identification code displayed on the smart TV.
  • the panoramic image triggering instruction is sent to the media content server.
  • the media content server 103 sends a panoramic image display instruction to the smart television 102, and the smart television displays the panoramic image.
  • a webpage of a panoramic image is automatically opened on the mobile terminal, and the panoramic image is displayed on the webpage of the panoramic image in synchronization with the smart television.
  • the panoramic image triggering instruction may also adopt other manners, for example, the smart TV 102 sends a panoramic image playing request to the media content server 103, and the media content server sends the playing request to the mobile terminal, and determines whether to display the panoramic view according to the user's selection. image.
  • the smart TV 102 sends a panoramic image playing request to the media content server 103
  • the media content server sends the playing request to the mobile terminal, and determines whether to display the panoramic view according to the user's selection. image.
  • the panoramic image display of the advertisement when the advertisement is displayed on the smart TV 102, the smart TV 102 transmits a panoramic image display request to the media content server 103, and the media content server 103 transmits the prompt information of whether to display the panoramic image to the mobile terminal 101, such as As shown in FIG. 3, the mobile terminal 101 displays the prompt information 301 on the video APP installed thereon, and at the same time, the option 302 and the option 303 are displayed.
  • the mobile terminal 101 sends an impression confirmation message to the media content server 103, and the media content server 103 sends the display confirmation message to the smart TV 102, so that the smart television displays a panoramic image of the advertisement, and the panoramic image may be a panoramic image.
  • the picture can also be a panoramic video.
  • the mobile terminal 101 does not send an impression confirmation message to the media content server 103, and the panoramic image is not displayed on the corresponding smart television 102.
  • Step 202 Send, according to the received panoramic image triggering instruction, the panoramic image triggering instruction to a smart TV bound to the mobile terminal, so that the smart television displays a panoramic view corresponding to the currently displayed media content. image.
  • the smart television After receiving the panoramic image triggering command, the smart television displays a panoramic image corresponding to the currently displayed media content, wherein the panoramic image data may be sent to the smart television 102 before the media content server 103.
  • the video carries an advertisement
  • the media content server sends the video data to the smart TV, and also sends the material corresponding to the advertisement to the smart TV.
  • the output corresponding to the advertisement may include a panoramic image or a panoramic video corresponding to the advertisement.
  • Step 203 Receive a description parameter of the mobile terminal sent by the mobile terminal in a stereo space.
  • the description parameter may include a position change parameter and a posture change parameter.
  • the mobile terminal 101 acquires the location change parameter to obtain the location change parameter of the mobile terminal 101 by using the indoor location, and specifically, the Wi-Fi indoor location or the Bluetooth indoor location may be employed.
  • the mobile terminal can be located by the wireless signal strength of the wireless network access point received by the mobile terminal. Knowing the coordinates of a Wi-Fi hotspot, the mobile terminal receives the signal of the Wi-Fi hotspot, and the strength of the signal has a certain relationship with the distance from the Wi-Fi hotspot to the mobile terminal, so that the mobile terminal can obtain the mobile terminal through the signal strength. The distance from the Wi-Fi hotspot.
  • the coordinates of the mobile terminal can be obtained from the coordinates of the Wi-Fi hotspots according to the distance of the mobile terminal to more than three Wi-Fi hotspots.
  • Another way of Wi-Fi indoor positioning is similar to fingerprint recognition, defining multiple semantic locations. For each semantic location, a Wi-Fi signal is acquired to form a "fingerprint library.” During positioning, the Wi-Fi signal measured by the mobile terminal is compared with the Wi-Fi signal in the existing "fingerprint library" to see which location of the "fingerprint library" matches the Wi-Fi signal. I think that the mobile terminal is most likely to be in that location.
  • Bluetooth indoor positioning is to install several Bluetooth LAN access points indoors, maintain the network as a multi-user based network connection mode, and ensure that the Bluetooth LAN access point is always the master device of the piconet, and then receive the mobile terminal by measuring The signal strength of the incoming Bluetooth signal triangulates the location of the mobile terminal.
  • the user can move the mobile terminal up, down, left, and down, or the like, or rotate, push, and zoom in, or on the top, bottom, left, right, top left, bottom left, top right, bottom right, etc.
  • the position change parameter of the mobile terminal 101 can be determined by the position coordinates before the mobile terminal and the current position coordinates, wherein the previous position coordinates of the mobile terminal and the current position coordinates can be obtained through Wi-Fi indoor positioning or Bluetooth indoor positioning. And determining a position change parameter of the mobile terminal in the stereo space according to the reference point position coordinate of the mobile terminal 101 and the current position coordinate.
  • the mobile terminal 101 For the mobile terminal to acquire the attitude change parameter, the mobile terminal 101 is provided with a gyroscope, and the gyroscope can give the direction of gravity, that is, the vertical direction. Determining, according to the sensor parameters obtained from the gyroscope, the deflection angle of the mobile terminal at the reference point and the deflection angle at the current position; determining the deflection angle of the mobile terminal 101 at the reference point and the deflection angle at the current position The attitude change parameter of the mobile terminal 101.
  • the mobile terminal may display its own position change parameter and/or posture change parameter after determining the position change parameter and/or the posture change parameter. According to the operation behaviors such as rotation and movement, the mobile terminal displays change data such as a change in the deflection angle and a change in position.
  • Step 204 Determine an adjustment parameter of the panoramic image in the panoramic space according to the description parameter.
  • the adjustment parameter may include a view adjustment parameter and a view adjustment parameter, and the view adjustment parameter may be determined according to the position change parameter in the description parameter, and the view adjustment parameter may be determined according to the posture change parameter in the description parameter.
  • a 360-degree panoramic image or a 720-degree panoramic image is captured at different shooting points, and different shooting points correspond to different viewpoints, and the viewpoint coordinates are recorded at the same time.
  • a 360-degree panoramic image or a 720-degree panoramic image is taken, and different angles correspond to different viewing angles.
  • the first reference point of the mobile terminal in the stereoscopic space corresponds to the second reference point in the panoramic space, and the coordinates and posture of the mobile terminal in the stereoscopic space correspond to the viewpoint coordinates and the angle of view in the panoramic coordinate library.
  • Step 205 Send the adjustment parameter to the smart TV, so that the smart TV adjusts the panoramic image according to the adjustment parameter.
  • the media content server obtains the viewpoint change angle parameter and the view angle change parameter of the panoramic image corresponding to the current location of the mobile terminal, and sends the view adjustment parameter and/or the view adjustment parameter to the smart TV after the viewpoint change parameter and the view change parameter of the second reference point of the panoramic space.
  • the television determines the viewpoint and the angle of view of the panoramic image corresponding to the current position of the mobile terminal according to the viewing angle adjustment parameter and/or the viewpoint adjustment parameter, and then displays the panoramic image of the viewpoint and the perspective.
  • a smart television displays an advertisement for a tourist destination, and a panoramic image of the advertisement is displayed on the smart television.
  • the media content server determines the left viewpoint X1 of the panoramic image according to the data matching, moves up Y1, and transmits the viewpoint adjustment parameter to the smart TV.
  • the smart TV shifts the viewpoint to the left by X1, and moves the panoramic image of the corresponding viewpoint after moving up Y1 to display.
  • the media content server determines the viewpoint backward Z1 of the panoramic image according to the data matching, and transmits the viewpoint adjustment parameter to the smart TV.
  • the smart TV displays the panoramic image of the viewpoint after the viewpoint is moved backward by Z1 according to the viewpoint adjustment parameter.
  • the movement of the viewpoint of the panoramic image in the front-rear direction has a visual effect of enlarging and reducing the image in the user's vision.
  • the panoramic image is enlarged by a corresponding multiple and displayed, and after the viewpoint is moved forward by Z1, the panoramic image is reduced correspondingly. Display after multiples.
  • the position and the angle of view of the panoramic image on the smart television are controlled by the position change and the posture change of the mobile terminal in the three-dimensional space, and the adjustment dimension of the panoramic image is more flexible and more flexible.
  • the user can be as natural as moving the video in any direction with the camera.
  • the display control method of the panoramic image provided by the present application can be applied to, for example, panoramic image display control of an advertisement.
  • a panoramic video display for car interior advertising displaying panoramic video on a smart TV
  • users can connect to a smart TV through a mobile phone, and control the rotation and movement of the mobile phone (using the mobile phone as a camera to adjust different positions) to view different angles of the car interior.
  • the display control method for panoramic images provided by the present application can be applied not only to advertisements but also to the field of games, for example, to shooting games. Can be used to achieve auxiliary role positioning, looking for red envelopes, treasures, equipment, etc. in the space.
  • the mobile terminal can also replace the gamepad, and control the movement of the game character through the mobile phone.
  • the adjustment parameter includes a view angle adjustment parameter and a view point adjustment parameter
  • the determining, by the description parameter, the adjustment parameter of the panoramic image in the panoramic space includes:
  • the adjusting the parameter to the smart TV, so that the smart TV adjusts the panoramic image according to the adjustment parameter includes:
  • Transmitting the view adjustment parameter and the view adjustment parameter to the smart TV so that the smart TV adjusts a viewpoint of the panoramic image according to the view adjustment parameter, and adjusts the panoramic image according to the view adjustment parameter Perspective.
  • the description parameter of the mobile terminal in the stereo space includes a position change parameter and a posture change parameter
  • the mobile terminal sends the position change parameter and the posture change parameter to the media content server.
  • the media content server determines the view adjustment parameter according to the position change parameter, determines the view adjustment parameter according to the posture change parameter, and transmits the view adjustment parameter and the view adjustment parameter to the smart TV.
  • the smart TV adjusts the viewpoint of the panoramic image according to the viewpoint adjustment parameter, and adjusts the angle of view of the parameter condition panoramic image according to the angle of view.
  • the method for controlling display of a panoramic image proposed by the present application further includes matching a coordinate system of the mobile terminal in the stereoscopic space with a panoramic coordinate system in the panoramic space, thereby determining a position change parameter in the three-dimensional space of the mobile terminal. And/or a mapping relationship of the attitude change parameter to the angle of view adjustment parameter and/or the viewpoint adjustment parameter of the panoramic image.
  • the main steps are as follows:
  • Step 701 Receive first coordinate system data of the mobile terminal sent by the mobile terminal, and use the parameter acquired by the first coordinate system to represent position coordinates and a posture angle of the mobile terminal in a stereo space.
  • a first coordinate system is established in a stereo space where the mobile terminal is located, and the first coordinate system includes three coordinate axes, that is, an X axis, a Y axis, and a Z axis, and a rotation axis of the mobile terminal is selected at the same time.
  • the mobile terminal adjusts the smart TV
  • the mobile terminal is placed in parallel with the smart TV.
  • a gyroscope is disposed on the mobile terminal, and the direction of gravity can be known according to the gyroscope. As shown in FIG. 8, the axis of the gravity direction is defined as the Y axis, and the surface perpendicular to the Y axis is the horizontal plane, and the smart TV screen is on the horizontal surface.
  • the parallel axes are defined as the X axis, and the axis perpendicular to the X axis and pointing to the plane of the TV is defined as the Z axis.
  • the X axis represents the moving distance of the mobile terminal in the left and right direction
  • the Y axis represents the moving distance of the mobile terminal in the up and down direction
  • the Z axis represents the moving distance of the mobile terminal in the front and rear direction
  • the first reference point is determined at the same time
  • the position change parameter of the mobile terminal is a position change parameter of the position coordinate of the mobile terminal relative to the first reference point.
  • the first reference point is an initial position before the mobile terminal starts to adjust the smart TV.
  • the coordinate origin of the first coordinate system may be defined as the first reference point, so that when determining the position change parameter of the mobile terminal, The position coordinate parameter of the mobile terminal is directly used as the position change parameter, thereby reducing the amount of calculation.
  • the mobile terminal adjusts the panoramic image on the smart TV, at a certain fixed position, the mobile terminal can control the posture of the mobile terminal by rotation, and control the angle of view of the panoramic image at a certain viewpoint according to the change of the posture.
  • the panoramic image is a 360-degree panoramic image
  • the different angles of the panoramic image can be controlled by the rotation of the mobile terminal in one plane.
  • the panoramic image is a 720-degree panoramic image
  • the mobile terminal can be rotated in two planes. Control different angles of view of the panoramic image.
  • any one of the above X-axis, Y-axis, and Z-axis may be used as the rotation axis.
  • the rotation angle of the mobile terminal at the first reference point is set to 0 degrees, and when the posture change parameter is determined, the rotation angle at the position of the mobile terminal is directly used as the posture change parameter, thereby reducing the calculation amount.
  • the first coordinate system data mainly includes three coordinate axes, a coordinate origin, a first reference point, and a rotation axis of the mobile terminal.
  • Step 702 Receive second coordinate system data in the panoramic space sent by the smart television, and the parameters acquired by the second coordinate system are used to represent the viewpoint and the angle of view of the panoramic image.
  • a second coordinate system in the panoramic space defining a shooting start point of the panoramic image as a second reference point, and in some examples, defining an origin of the panoramic space coordinate system as the second reference point (second reference point and second The origin of the coordinate system coincides).
  • the default is on the vertical plane of the screen of the TV
  • the X axis is parallel to the horizontal plane
  • the Y axis is perpendicular to the horizontal plane
  • the Z axis is perpendicular to the plane of the TV screen.
  • the X axis represents the distance in which the viewpoint moves in the left and right direction
  • the Y axis represents the distance in which the viewpoint moves in the up and down direction
  • the Z axis represents the moving distance of the viewpoint in the front and rear direction.
  • the angle of view is represented by an angle parameter
  • the angle of view is represented by two angle parameters.
  • the second coordinate system data includes three coordinate axes of the second coordinate system, a coordinate origin, a second reference point, and an angle representing the angle of view.
  • Step 703 Determine a mapping relationship between the description parameter in the first coordinate system and the adjustment parameter in the second coordinate system according to the first coordinate system data and the second coordinate system data.
  • the description parameter includes a position change parameter and/or a posture change parameter
  • the condition parameter includes a view adjustment parameter and/or a view adjustment parameter.
  • the media content server receives the panoramic space coordinate system data sent by the smart TV and the stereo space coordinate system data of the mobile terminal, and matches the second coordinate system of the panoramic space with the first coordinate system of the mobile terminal.
  • the first reference point of the first coordinate system and the second reference point of the second coordinate system respectively, corresponding to the X, Y, and Z axes of the first coordinate system and the X, Y, and Z axes of the second coordinate system
  • the movement of the mobile terminal in the left-right direction corresponds to the movement of the viewpoint in the left-right direction
  • the movement of the mobile terminal in the up-and-down direction corresponds to the movement of the viewpoint in the up-and-down direction
  • the movement of the mobile terminal in the front-rear direction and the movement of the viewpoint in the front-rear direction corresponds to the forward and backward movement of the viewpoint has a visual effect of zooming in and out of the panoramic image on the viewing visual effect.
  • the rotation angle of the mobile terminal in one plane corresponds to the angle of view of the panoramic image within 360 degrees
  • the rotation angle of the mobile terminal in the stereoscopic space is decomposed into rotation angles on the two planes, and the rotation angles on the two planes correspond to the angle of view of the panoramic image in the range of 720 degrees.
  • the mapping relationship further includes a correspondence between the first coordinate system and the second coordinate system scale, and the user arm rotates the rotatable angle of the mobile terminal 101 according to the distance that the user's arm moves the mobile terminal in the up, down, left, and right directions.
  • a range of the movable distance in the left and right direction, the up and down direction, the front and rear direction, and the range of the angle of view of the viewpoint of the panoramic image, and the correspondence between the scale of the space coordinate system and the scale of the coordinates in the panoramic space is determined.
  • the mobile terminal 101 moves the distance a in the up and down direction, and the panoramic image correspondingly moves a1 in the up and down direction, and a is linearly proportional to a1.
  • the magnitude of the ratio depends on the movable distance range and the panoramic image of the user's arm in the up and down direction.
  • the viewpoint moves up and down the distance range.
  • the mobile terminal 101 moves the distance b in the left-right direction, and the viewpoint of the panoramic image correspondingly moves b1 in the left-right direction, and b is linearly proportional to b1.
  • the magnitude of the ratio depends on the movable distance range and the panoramic image in the left-right direction of the user's arm. The range of movement distance of the viewpoint in the left and right direction.
  • the mobile terminal 101 moves the distance c in the front-rear direction, and the viewpoint of the panoramic image moves c1 in the front-back direction, and c is linearly proportional to c1.
  • the magnitude of the ratio depends on the range of the movable distance of the user's arm in the front-rear direction and the viewpoint of the panoramic image. Move the distance range in the front and rear direction.
  • the rotation angle ⁇ of the mobile terminal, the angle of view of the panoramic image changes ⁇ 1, and ⁇ is linearly proportional to ⁇ 1, and the magnitude of the ratio depends on the range of the angle of rotation of the user's arm and the range of the angle of view of the panoramic image.
  • determining, according to the description parameter, determining the adjustment parameter of the panoramic image in the panoramic space comprises: determining the adjustment parameter according to the mapping relationship and the description parameter.
  • the mobile terminal 101 transmits the obtained position change parameter and posture change parameter to the media content server 103.
  • the media content server 103 according to the obtained position change parameter and posture change parameter of the mobile terminal 101 in the space coordinate system, according to the position parameter and/or the attitude parameter in the first coordinate system in the aforementioned determined stereo space to the panorama
  • the mapping relationship of the angle of view adjustment parameter and/or the viewpoint adjustment parameter in the space determines the adjustment parameter for the panoramic image.
  • the rotation angle at the initial posture of the mobile terminal is defined as 0 degrees, for example, as shown in FIG. 8, the posture of the mobile terminal in FIG.
  • the angle of rotation is defined as 0 degrees.
  • the second reference point may be defined as the coordinate origin of the second coordinate system (the second reference point coincides with the coordinate origin of the second coordinate system), and the initial viewing angle of the panoramic image displayed on the smart television is defined as 0 degrees.
  • the position change parameter and the attitude change parameter are the position coordinates and the rotation angle of the current position of the mobile terminal.
  • the viewing angle adjustment parameter and the viewpoint adjustment parameter are the angle of view and the viewpoint of the panoramic image.
  • the media content server sends the determined viewpoint and perspective to the smart television, and the smart television displays the panoramic image of the determined viewpoint and perspective.
  • the method for displaying a panoramic image further includes binding the mobile terminal to the smart television, and binding the mobile terminal to the smart television by using an image identification code, and scanning the smart through the mobile terminal.
  • the image identification code of the television establishes a binding, which specifically includes the following steps:
  • Step S11 Generate a graphic identification code carrying the identifier of the smart television, and send the graphic identification code to the smart television, so that the smart television displays the graphic identification code.
  • the media content server 103 generates a graphic identification code carrying the smart television identification and transmits the graphic identification code to the smart television to cause the smart television to display the graphic identification code.
  • the graphic identification code may be a two-dimensional code carrying a smart television identifier, and the smart television identifier may be a GUID of the network television.
  • the smart television can display the graphical identification code on its display device, such as a display screen.
  • Step S12 Receive a binding request message sent by the mobile terminal after identifying the graphic identification code, where the binding request message carries an identifier of the mobile terminal and an identifier of the smart television.
  • the mobile terminal scans the image identification code of the smart TV for identification, and the mobile terminal can scan the graphic identification code by using the scanning function of the mobile terminal itself, or scan the graphic identification code by using a scanning function carried by the client.
  • the mobile terminal sends a binding request message to the media content server 103, where the binding request message includes an identifier of the mobile terminal and an identifier of the smart television.
  • Step S13 Establish a correspondence between the identifier of the mobile terminal and the identifier of the smart TV.
  • the media content server 103 After receiving the binding request message, the media content server 103 establishes a correspondence between the mobile terminal identifier and the smart TV identifier, and saves the correspondence. At the same time, the media content server 103 sends a binding success message to the smart TV and displays a binding success message on the smart TV.
  • the binding identification message is sent to the media content server 103, and the media content server 103 sends the binding identification message to the smart television display, and the smart television refreshes the graphic identification code and displays the rescan code. Tip message.
  • transmitting the panoramic image triggering instruction to the smart TV bound to the mobile terminal includes the following steps:
  • Step S21 Determine an identifier of the smart TV corresponding to the identifier of the mobile terminal according to the correspondence.
  • the media content server 103 has established a correspondence between the mobile terminal 101 identification and the smart television 102 identification and saved.
  • the panoramic image triggering instruction includes an identifier of the mobile terminal that sends the instruction, and the media content server searches for the mobile terminal identifier in the saved correspondence according to the identifier of the mobile terminal. Corresponding smart TV logo.
  • Step S22 Send the panoramic image triggering instruction to the smart TV corresponding to the identifier of the smart television.
  • the media content server 103 After finding the identity of the smart TV, the media content server 103 transmits a panoramic image triggering instruction to the smart television corresponding to the smart television identification, so that the smart television displays a panoramic image corresponding to the currently displayed media content.
  • the method for displaying a panoramic image according to the present application further includes displaying a panoramic image synchronously with the smart television on the mobile terminal, and displaying the mobile terminal as a secondary screen for the user to view. It mainly includes the following steps:
  • Step S31 Receive the currently displayed panoramic image data sent by the smart TV.
  • the mobile terminal simultaneously displays the panoramic image with the smart TV, and the smart TV can send the currently displayed panoramic image to the media content server in real time, and the media content server sends the received panoramic image to the mobile terminal, so that the mobile terminal and the smart TV simultaneously display the panoramic view. image.
  • Step S32 Send the currently displayed panoramic image data to the mobile terminal, so that the mobile terminal displays the panoramic image in synchronization with the smart television.
  • the mobile terminal synchronously displays the panoramic image with the smart TV, and simultaneously displays the panoramic image on the mobile terminal.
  • the display device on the mobile terminal can be used as a double screen, and on the other hand, some interaction is facilitated, for example, when the panoramic image is used.
  • panoramic video you can control the progress bar of panoramic video playback on the mobile terminal.
  • the method for controlling display of panoramic images proposed by the present application further includes independently adjusting, by the mobile terminal, the panoramic image displayed thereon, instead of receiving the adjusted panoramic image transmitted by the smart television in real time. Mainly after the above step 204, further comprising transmitting the adjustment parameter of the panoramic image to the mobile terminal, so that the mobile terminal adjusts a perspective and/or a viewpoint of the panoramic image according to the adjustment parameter.
  • the smart TV can also send the panoramic image data to the media content server after receiving the panoramic image confirmation message sent by the media content server, and the media content server sends it to the mobile terminal, and the APP on the mobile terminal displays the initial panoramic image.
  • the panoramic image may also be displayed on a panoramic image web page (such as an H5 page) displayed on the mobile terminal in some instances, which may be a panoramic image that has not been adjusted.
  • the mobile terminal After receiving the trigger request of the separately adjusted panoramic image sent by the mobile terminal, the mobile terminal adjusts the panoramic image independently for the current panoramic image displayed by the received smart TV in the subsequent adjustment.
  • the mobile terminal 101 may adjust the panoramic image displayed thereon according to the adjustment parameter, and the application server may also determine the panoramic image according to the adjustment parameter. Send to mobile device display.
  • the mobile terminal 101 displays the panoramic image in synchronization with the smart TV while simultaneously adjusting the panoramic image.
  • the method for displaying a panoramic image according to the present application wherein the panoramic image includes a target object, which may be a coupon in an advertisement image, and an enemy in the panoramic image in the game. , keys, props, etc.
  • the method further includes:
  • Step S41 Determine prompt information according to the adjustment parameter and the location of the target object; the prompt information is used to remind the mobile terminal to operate.
  • determining prompt information is performed according to the viewing angle adjustment parameter and/or the viewpoint adjustment parameter and the position of the target object, the prompt information being used to remind the mobile terminal to perform a moving and/or rotating operation.
  • the provider of the panoramic image can set a target object in the panoramic image.
  • the media content server determines prompt information according to the location of the target object and the panoramic image currently displayed by the smart TV, and the prompt information is used to help the user find the target object from the panoramic image.
  • the mobile terminal displays the panoramic image synchronously with the smart TV. If the current panoramic image is doubled again, the user can find the target object, and the video server sends the doubled prompt information to the mobile terminal.
  • a panoramic image of the advertisement is displayed on the mobile terminal, wherein the advertisement is a tourist attraction advertisement.
  • the prompt information 1101 is displayed on the mobile terminal, and the prompt information 1101 is used to remind the user that if the zoom is doubled, there will be a surprise.
  • Step S42 Send the prompt information to the mobile terminal for display. Thereby the user moves and/or rotates the mobile terminal according to the prompt information.
  • the prompt information is displayed on the mobile terminal, and the prompt information is: double zooming in and there will be a surprise.
  • the user brings the mobile terminal closer to the smart TV.
  • the coupon 1202 is found on the smart TV 102, and the coupon 1202 is synchronously displayed on the mobile terminal, and the prompt information 1201 for discovering the coupon is displayed.
  • the user can click the button 1203 on the mobile terminal, that is, the "open Greece trip" button (control) in Fig. 12 to purchase the preferential ticket, and also can share and other interactions.
  • the present application further provides a display control method for a panoramic image, which is applied to the mobile terminal 101.
  • the method mainly includes the following steps:
  • Step 1301 Send a panoramic image triggering instruction to the media content server, in response to the panoramic image triggering operation, to cause the media content server to send the panoramic image triggering instruction to the smart television bound to the mobile terminal, so as to enable The smart TV displays a panoramic image corresponding to the currently displayed media content.
  • Step 1302 Acquire a description parameter of the mobile terminal in a stereo space in response to an operation on the mobile terminal, and send the description parameter to the media content server, so that the media content server determines according to the description parameter. Adjusting parameters of the panoramic image in the panoramic space and transmitting the same to the smart television to cause the smart television to adjust the panoramic image according to the adjustment parameter.
  • the viewpoint and the angle of view of the panoramic image on the smart TV are controlled by the position change and the posture change of the mobile terminal in the three-dimensional space.
  • the adjustment of the panoramic image is more dimensional and more flexible.
  • the user views the panoramic image it is as natural as moving the video in any direction with the camera.
  • the adjustment parameter includes a view angle adjustment parameter and a view point adjustment parameter
  • the obtaining the description parameters of the mobile terminal in the stereo space in response to the operation on the mobile terminal includes:
  • the adjusting, by the smart television, the panoramic image according to the adjustment parameter comprises:
  • Transmitting the position change parameter and the posture change parameter to the media content server so that the media content server determines a view adjustment parameter of the panoramic image in the panoramic space according to the position change parameter, according to the
  • the attitude change parameter determines a view adjustment parameter of the panoramic image in the panoramic space, and sends the view adjustment parameter and the view adjustment parameter to the smart TV, so that the smart TV adjusts according to the view adjustment parameter a viewpoint of the panoramic image, and adjusting a viewing angle of the panoramic image according to the viewing angle adjustment parameter.
  • the panning operation in response to the user's panoramic image includes responding to the user's selection of the display panoramic image option, and may also include identifying a graphical identification code on the smart television to which it is bound.
  • the mobile terminal 101 is bound to the smart TV 102, and the panoramic image triggering instruction may be a binding confirmation command sent by the mobile terminal 101 to the media content server 103 after the mobile terminal 101 and the smart television 102 are successfully bound.
  • the mobile terminal performs binding of the mobile terminal and the smart TV by scanning the graphic identification code displayed on the smart TV.
  • the panoramic image triggering instruction is sent to the media content server.
  • the media content server 103 After receiving the panoramic image triggering instruction, the media content server 103 sends a panoramic image display instruction to the smart television 102, and the smart television displays the panoramic image.
  • a webpage of a panoramic image is automatically opened on the mobile terminal, and the panoramic image is displayed on the webpage of the panoramic image in synchronization with the smart television.
  • the panoramic image triggering instruction may also adopt other manners, for example, the smart TV 102 sends a panoramic image playing request to the media content server 103, and the media content server sends the playing request to the mobile terminal, and determines whether to display the panoramic view according to the user's selection. image.
  • the smart TV 102 sends a panoramic image playing request to the media content server 103
  • the media content server sends the playing request to the mobile terminal, and determines whether to display the panoramic view according to the user's selection. image.
  • the panoramic image display of the advertisement when the advertisement is displayed on the smart TV 102, the smart TV 102 transmits a panoramic image display request to the media content server 103, and the media content server 103 transmits the prompt information of whether to display the panoramic image to the mobile terminal 101, such as As shown in FIG. 3, the mobile terminal 101 displays the prompt information 301 on the video APP installed thereon, and at the same time, the option 302 and the option 303 are displayed.
  • the mobile terminal 101 sends an impression confirmation message to the media content server 103, and the media content server 103 sends the display confirmation message to the smart TV 102, so that the smart television displays a panoramic image of the advertisement, and the panoramic image may be a panoramic image.
  • the picture can also be a panoramic video.
  • the mobile terminal 101 does not send an impression confirmation message to the media content server 103, and the panoramic image is not displayed on the corresponding smart television 102.
  • the mobile terminal 101 acquiring the location change parameter may obtain the location change parameter of the mobile terminal 101 by using the indoor location.
  • Wi-Fi indoor positioning or Bluetooth indoor positioning may be employed to obtain the position change parameter.
  • the mobile terminal can be located by the wireless signal strength of the wireless network access point received by the mobile terminal. Knowing the coordinates of a Wi-Fi hotspot, the mobile terminal receives the signal strength of the Wi-Fi hotspot, and the signal strength has a certain relationship with the distance from the Wi-Fi hotspot to the mobile device, so that the mobile terminal can obtain the mobile terminal through the signal strength.
  • the distance from the Wi-Fi hotspot The distance from the Wi-Fi hotspot.
  • the coordinates of the mobile terminal can be determined according to the distance of the obtained mobile device to more than three Wi-Fi hotspots.
  • three network access points are arranged in the three-dimensional space, wherein M is greater than or equal to 3.
  • the network space is provided with M network access points, where M is greater than or equal to 3;
  • the obtaining the description parameter of the mobile terminal in the stereo space includes the following steps
  • Step S51 Set M network access points, where M is greater than or equal to 3.
  • the M network access points are set in a stereoscopic space. Set M network access points in the stereo space.
  • Step S52 determining, according to the M wireless signal strengths of the M network access points respectively received by the mobile terminal at the reference point position and the current location, the reference point position coordinates and the current position coordinates respectively;
  • the M wireless signal strengths of the M network access points received by the mobile terminal at the reference point position and the M wireless signal strengths of the M network access points received at the current location respectively determine the reference Point position coordinates and the current position coordinates.
  • Step S53 Determine a position change parameter of the mobile terminal in the stereo space according to the reference point position coordinate and the current position coordinate.
  • the mobile terminal 101 when performing the acquiring the location change parameter of the mobile terminal in the stereo space, acquires the location change parameter and may adopt another method of Wi-Fi indoor positioning, similar to the fingerprint. Identify, define multiple semantic locations, and for each semantic location, collect Wi-Fi signals to form a "fingerprint library.” During positioning, the Wi-Fi signal measured by the mobile terminal is compared with the Wi-Fi signal in the existing "fingerprint library" to see which location in the library matches the Wi-Fi signal in the library, and the mobile terminal is considered to be the mobile terminal. Most likely located at this location. Specifically, it mainly includes the following steps:
  • Step S61 Determine a wireless signal strength of the network access point received by the mobile terminal at a plurality of location points, and store the location point coordinates in association with the corresponding wireless signal strength.
  • Step S62 determining a first wireless signal strength and a second wireless signal strength of the network access point respectively received by the mobile terminal at the reference point location and the current location, and searching and storing the stored wireless signal strength respectively. a wireless signal strength and a wireless signal strength closest to the second wireless signal strength, and the locations of the found location points corresponding to the wireless signal strengths closest to the first wireless signal strength and the second wireless signal strength respectively The coordinates are used as the reference point position coordinates and the current position coordinates.
  • Step S63 Determine a position change parameter of the mobile terminal in the stereo space according to the reference point position coordinate and the current position coordinate.
  • Bluetooth indoor positioning can also be used. Bluetooth indoor positioning is to install several Bluetooth local area network access points indoors, maintain the network as a multi-user based basic network connection mode, and ensure that the Bluetooth local area network access point is always this. The master device of the microgrid then triangulates the newly added blind nodes by measuring the signal strength.
  • the user can move the mobile terminal up, down, left, and down, or the like, or rotate, push, and zoom in, or on the top, bottom, left, right, top left, bottom left, top right, bottom right, etc.
  • the position change parameter of the mobile terminal 101 can be determined by the position coordinates before the mobile terminal and the current position coordinates, wherein the previous position coordinates of the mobile terminal and the current position coordinates can be obtained through Wi-Fi indoor positioning or Bluetooth indoor positioning. And determining a position change parameter of the mobile terminal in the stereo space according to the reference point position coordinate of the mobile terminal 101 and the current position coordinate.
  • the mobile terminal 101 when performing the acquiring the posture change parameter of the mobile terminal in the stereoscopic space, the mobile terminal 101 is provided with a gyroscope, and the gyroscope can give the direction of gravity, that is, the vertical direction. . Determining the reference point deflection angle and the current deflection angle of the mobile terminal according to the sensor parameters acquired from the gyroscope; determining the attitude change parameter of the mobile terminal 101 according to the reference point deflection angle of the mobile terminal 101 and the current deflection angle. Specifically, it mainly includes the following steps:
  • Step S71 Determine the reference point deflection angle and the current deflection angle of the mobile terminal according to the sensor parameters acquired from the gyroscope.
  • Step S72 Determine an attitude change parameter of the mobile terminal according to a reference point deflection angle of the mobile terminal and a current deflection angle.
  • the mobile terminal may display its own position change parameter and/or posture change parameter after determining the position change parameter and/or the posture change parameter.
  • the mobile terminal interface presents change data such as angle and position. For example, rotating the mobile terminal 30 degrees counterclockwise, correspondingly displaying the number -30 degrees; the distance of the mobile terminal 101 shifting X to the left, the corresponding phone displays -X; if moving directly to the upper left, it is decomposed into the left shift X distance + up shift Y, corresponding display data (-X, Y); movement in other directions in the stereo space and so on.
  • the method for displaying a panoramic image according to the present application further includes displaying a panoramic image synchronously with the smart TV on the mobile terminal, and the display device of the mobile terminal serves as a secondary screen for the user to view.
  • the method mainly includes: receiving panoramic image data currently displayed by the smart TV sent by the media content server, and displaying the panoramic image.
  • the mobile terminal simultaneously displays the panoramic image with the smart TV, and the smart TV can send the currently displayed panoramic image to the media content server in real time, and the media content server sends the received panoramic image to the mobile terminal, so that the mobile terminal and the smart TV simultaneously display the panoramic view. image.
  • the mobile terminal synchronously displays the panoramic image with the smart TV, and simultaneously displays the panoramic image on the mobile terminal.
  • the display device on the mobile terminal can be used as a double screen, and on the other hand, some interaction is facilitated, for example, when the panoramic image is used. For panoramic video, you can control the progress bar of panoramic video playback on the mobile terminal.
  • the method for controlling display of a panoramic image proposed by the present application further includes independently adjusting, by the mobile terminal, the panoramic image displayed thereon, instead of receiving the adjusted panoramic image transmitted by the smart television in real time.
  • the following steps are further included:
  • Step S81 Receive an adjustment parameter sent by the media content server.
  • the smart TV can also send the panoramic image data to the media content server after receiving the panoramic image confirmation message sent by the media content server, and the media content server sends it to the mobile terminal, and the APP on the mobile terminal displays the initial panoramic image.
  • the panoramic image may also be displayed on a panoramic image web page on the mobile terminal, which is an adjusted panoramic image, in some examples.
  • the mobile terminal may independently adjust the panoramic image in the subsequent adjustment for the current panoramic image displayed by the received smart TV.
  • Step S82 Adjust the panoramic image according to the adjustment parameter. That is, the viewpoint of the panoramic image is adjusted according to the viewing angle condition, and the viewpoint of the panoramic image is adjusted according to the viewpoint adjustment parameter.
  • the adjustment parameter is also sent to the mobile terminal at the same time, and the mobile terminal adjusts the viewpoint and the angle of view of the panoramic image displayed thereon according to the adjustment parameter.
  • the mobile terminal 101 displays the panoramic image in synchronization with the smart TV while simultaneously adjusting the panoramic image.
  • the method for displaying a panoramic image according to the present application further includes: receiving and displaying the prompt information sent by the media content server, where the prompt information is used to remind the user of the mobile terminal to operate (move or rotate) The mobile terminal. So that the user moves or rotates the mobile terminal according to the prompt information.
  • the mobile terminal displays the panoramic image synchronously with the smart TV, and the prompt information is displayed on the mobile terminal, and the prompt information reminds the user that it is surprising to zoom in twice.
  • the user brings the mobile terminal closer to the smart TV.
  • the panoramic image is doubled, as shown in FIG. 12, the coupon is found on the smart TV 102, and the coupon is synchronously displayed on the mobile terminal, and the user can click the button on the mobile terminal.
  • the trip to Greece "buy a discount ticket, you can also share and other interactions.
  • the present application also provides a display control device 1400 for panoramic images, which is applied to the media content server 103, as shown in FIG. 14, including:
  • the trigger instruction receiving unit 1401 is configured to receive a panoramic image triggering instruction sent by the mobile terminal;
  • the triggering instruction sending unit 1402 is configured to send the panoramic image triggering instruction to the smart TV bound to the mobile terminal to enable the smart television to display the currently displayed media in response to the received panoramic image triggering instruction. a panoramic image corresponding to the content;
  • a position and posture change parameter receiving unit 1403, configured to receive a position change parameter and/or a posture change parameter of the mobile terminal in the stereo space sent by the mobile terminal;
  • the adjustment parameter determining unit 1404 is configured to determine a viewing angle adjustment parameter and/or a viewpoint adjustment parameter of the panoramic image in the panoramic space according to the position change parameter and/or the posture change parameter;
  • An adjustment parameter sending unit 1405, configured to send the view adjustment parameter and/or the view adjustment parameter to the smart TV, so that the smart TV adjusts the panoramic image according to the view adjustment parameter and/or the view adjustment parameter Perspective and / or viewpoint.
  • the viewpoint and the angle of view of the panoramic image on the smart television can be controlled by the position change and the posture change of the mobile terminal in the three-dimensional space, and the viewpoint and the angle of view of the panoramic image can be simultaneously adjusted.
  • the adjustment dimension of the panoramic image is more and more flexible.
  • the user views the panoramic image it is as natural as moving the video in any direction with the camera.
  • the apparatus 1400 further includes:
  • a coordinate system parameter receiving unit 1406, configured to receive first coordinate system data of the mobile terminal that is sent by the mobile terminal, where the first coordinate system is used to represent position coordinates and a posture angle of the mobile terminal in a stereo space; Receiving a second coordinate system data in the panoramic space sent by the smart television, where the second coordinate system is used to represent a viewpoint and a viewing angle of the panoramic image, and different viewpoints and viewing angles correspond to different panoramic images;
  • a mapping relationship determining unit 1407 configured to determine, according to the first coordinate system data and the second coordinate system data, a position change parameter and/or a posture change parameter in the first coordinate system to the second coordinate system a mapping relationship between the angle of view adjustment parameter and/or the viewpoint adjustment parameter;
  • the adjustment parameter determining unit 1404 is configured to determine the viewing angle adjustment parameter and/or the viewpoint adjustment parameter according to the mapping relationship and the position change parameter and/or the posture change parameter.
  • the present application also provides a display control device 1500 for a panoramic image, which is applied to the mobile terminal 101, as shown in FIG.
  • the triggering instruction sending unit 1501 is configured to send a panoramic image triggering instruction to the media content server in response to the panoramic image triggering operation of the user, so that the media content server sends the panoramic image triggering instruction to the smart television, so that The smart TV displays a panoramic image corresponding to the currently displayed media content;
  • the position and posture change parameter acquisition unit 1502 is configured to acquire a position change parameter and/or a posture change parameter in the stereo space in response to the movement and/or rotation operation of the user, and send the same to the media content server. So that the media content server determines the view adjustment parameter and/or the view adjustment parameter of the panoramic image in the panoramic space according to the position change parameter and/or the posture change parameter, and sends the view adjustment parameter to the smart TV.
  • the smart television is adapted to adjust a viewing angle and/or a viewpoint of the panoramic image according to the viewing angle adjustment parameter and/or the viewpoint adjustment parameter.
  • the viewpoint and the angle of view of the panoramic image on the smart television can be controlled by the position change and the posture change of the mobile terminal in the three-dimensional space, and the viewpoint and the angle of view of the panoramic image can be simultaneously adjusted.
  • the adjustment dimension of the panoramic image is more and more flexible.
  • the user views the panoramic image it is as natural as moving the video in any direction with the camera.
  • the position and posture change parameter acquisition unit 1502 is configured to:
  • the position and posture change parameter acquisition unit 1502 is configured to:
  • the position and posture change parameter acquisition unit 1502 is configured to:
  • FIG. 16 is a view showing the configuration of a computing device in which the panoramic image display control device 1400 and the panoramic image display control device 1500 are located.
  • the computing device includes one or more processors (CPUs) 1602, communication modules 1604, memories 1606, user interfaces 1610, and a communication bus 1608 for interconnecting these components.
  • processors CPUs
  • communication modules 1604
  • memories 1606, user interfaces 1610
  • communication bus 1608 for interconnecting these components.
  • the processor 1602 can receive and transmit data through the communication module 1604 to effect network communication and/or local communication.
  • User interface 1610 includes one or more output devices 1612 that include one or more speakers and/or one or more visual displays.
  • User interface 1610 also includes one or more input devices 1614 including, for example, a keyboard, a mouse, a voice command input unit or loudspeaker, a touch screen display, a touch sensitive tablet, a gesture capture camera or other input button or control, and the like.
  • Memory 1606 can be a high speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid state storage device; or nonvolatile memory such as one or more disk storage devices, optical disk storage devices, flash memory devices, Or other non-volatile solid-state storage devices.
  • DRAM dynamic random access memory
  • SRAM static random access memory
  • DDR RAM dynamic random access memory
  • nonvolatile memory such as one or more disk storage devices, optical disk storage devices, flash memory devices, Or other non-volatile solid-state storage devices.
  • the memory 1606 stores a set of instructions executable by the processor 1602, such as computer readable instructions, to implement the steps in the above-described display control method of the panoramic image in the present application, and also implements each module in the display control device of the panoramic image of the present application.
  • the memory 1606 includes:
  • An operating system 1616 including a program for processing various basic system services and for performing hardware related tasks
  • the application 1618 includes various applications for panoramic image display control, such an application being capable of implementing the processing flow in each of the above examples, such as some or all of the units or panoramic images in the display control device 1400 that may include panoramic images. Some or all of the control device 1500 is shown. At least one of the units in the panoramic image display control device 1400 and the panoramic image display control device 1500 may store the machine executable instructions.
  • the processor 1602 can implement the functions of at least one of the above-described units by executing machine-executable instructions in at least one of the units in the memory 1606.
  • the hardware modules in the embodiments may be implemented in a hardware manner or a hardware platform plus software.
  • the above software includes machine readable instructions stored in a non-volatile storage medium.
  • embodiments can also be embodied as software products.
  • the hardware may be implemented by specialized hardware or hardware that executes machine readable instructions.
  • the hardware can be a specially designed permanent circuit or logic device (such as a dedicated processor such as an FPGA or ASIC) for performing a particular operation.
  • the hardware may also include programmable logic devices or circuits (such as including general purpose processors or other programmable processors) that are temporarily configured by software for performing particular operations.
  • each instance of the present application can be implemented by a data processing program executed by a data processing device such as a computer.
  • the data processing program constitutes the present application.
  • a data processing program usually stored in a storage medium is executed by directly reading a program out of a storage medium or by installing or copying the program to a storage device (such as a hard disk and or a memory) of the data processing device. Therefore, such a storage medium also constitutes the present application, and the present application also provides a non-volatile storage medium in which a data processing program is stored, which can be used to execute any of the above-mentioned method examples of the present application. An example.
  • the machine readable instructions corresponding to the modules of FIG. 16 may cause an operating system or the like operating on a computer to perform some or all of the operations described herein.
  • the non-transitory computer readable storage medium may be inserted into a memory provided in an expansion board within the computer or written to a memory provided in an expansion unit connected to the computer.
  • the CPU or the like installed on the expansion board or the expansion unit can perform part and all of the actual operations according to the instructions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请公开了一种全景图像的展示控制方法，包括：接收移动终端发送的全景图像触发指令；响应于接收到的所述全景图像触发指令，向与所述移动终端绑定的智能电视发送所述全景图像触发指令，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；接收所述移动终端发送的所述移动终端在立体空间中的位置变化参数和/或姿态变化参数；根据所述位置变化参数和/或姿态变化参数确定所述全景图像在全景空间中的视角调节参数和/或视点调节参数；将所述视角调节参数和/或视点调节参数发送给所述智能电视，以使所述智能电视根据所述视角调节参数和/或视点调节参数调整所述全景图像的视角和/或视点。本申请还提出了相应的全景图像的展示控制装置。

Description

全景图像的展示控制方法、装置及存储介质
本申请要求于2017年3月28日提交中国专利局、申请号为201710191254.X、申请名称为“全景图像的展示控制方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及计算机技术领域，尤其涉及全景图像的展示控制方法、装置及存储介质。
背景技术
全景是指水平视角360度，垂直视角180度的图像。全景图像富有立体感和真实感，是一种性价比极高的虚拟现实解决方案。全景技术可以充分展示人物的整个动作和人物的相互关系，在全景中，人物与环境常常融为一体，能创造出有人有景的生动画面。
随着数字电视的普及，越来越多的数字电视终端具备了计算能力，而且数字处理能力越来越高，并出现了诸如网络电视等能够直接链接互联网的智能电视。目前的智能电视播放视频的图像视角范围有限，缺乏立体感，在智能电视上播放全景视频受到越来越多的关注。
技术内容
本申请实例提供了一种全景图像的展示控制方法，应用于媒体内容服务器，包括：
响应于全景图像触发操作，向媒体内容服务器发送全景图像触发指令，以使所述媒体内容服务器将所述全景图像触发指令发送给与所述移动终端绑定的智能电视，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
响应于对所述移动终端的操作，获取所述移动终端在立体空间中的描述参数，并将其发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述描述参数确定所述全景图像在全景空间中的调节参数，并将 其发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
本申请实例还提供了一种全景图像的展示控制方法，应用于移动终端，包括：
接收移动终端发送的全景图像触发指令；
响应于接收到的所述全景图像触发指令，向与所述移动终端绑定的智能电视发送所述全景图像触发指令，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
接收所述移动终端发送的所述移动终端在立体空间中的描述参数；
根据所述描述参数确定所述全景图像在全景空间中的调节参数；
将所述调节参数发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
本申请实例还提供了一种全景图像的展示控制装置，包括一个或一个以上处理器和一个或一个以上存储器，所述一个或一个以上存储器包括计算机可读指令，经配置由所述一个或者一个以上处理器执行以实现：
响应于全景图像触发操作，向媒体内容服务器发送全景图像触发指令，以使所述媒体内容服务器将所述全景图像触发指令发送给与所述移动终端绑定的智能电视，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
响应于对所述移动终端的操作，获取所述移动终端在立体空间中的描述参数，并将其发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述描述参数确定所述全景图像在全景空间中的调节参数，并将其发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
本申请实例还提供了一种全景图像的展示控制装置，包括一个或一个以上处理器和一个或一个以上存储器，所述一个或一个以上存储器包括计算机可读指令，经配置由所述一个或者一个以上处理器执行以实现：
接收移动终端发送的全景图像触发指令；
响应于接收到的所述全景图像触发指令，向与所述移动终端绑定的智能电视发送所述全景图像触发指令，以使所述智能电视展示当前展示 的媒体内容相对应的全景图像；
接收所述移动终端发送的所述移动终端在立体空间中的描述参数；
根据所述描述参数确定所述全景图像在全景空间中的调节参数；
将所述调节参数发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
本申请还提供了一种非易失性计算机可读存储介质，其中所述存储介质中存储有机器可读指令，所述机器可读指令可以由处理器执行以完成上述所述的方法。
采用本申请提供的上述方案，对全景图像的调节更加灵活。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1是本申请实例涉及的系统构架图；
图2为本申请一实例应用于服务器侧全景图像的展示控制方法流程图；
图3为本申请一实例中移动终端中展示全景图像触发选项页面图；
图4为本申请一实例中智能电视展示之前全景图像的示意图；
图5为本申请一实例中将全景图像平移后的示意图；
图6为本申请一实例中将全景图像放大后的示意图；
图7为本申请一实例中将空间坐标系与全景坐标系匹配的流程示意图；
图8为本申请一实例中空间坐标系与全景空间坐标系示意图；
图9为本申请一实例中的智能电视展示图像识别码的示意图；
图10为本申请一实例中移动终端与智能电视同步展示全景图像的示意图；
图11为本申请一实例中移动终端同步展示全景图像的同时展示提示信息的示意图；
图12为将本申请一实例中用户按照提示信息调整移动终端后发现目标对象的示意图；
图13为本申请一实例应用于移动终端侧全景图像的展示控制方法流程图；
图14为本申请一实例中应用于服务器侧全景图像的展示控制装置的结构示意图；
图15为本申请一实例中应用于移动终端侧全景图像的展示控制装置的结构示意图；以及
图16为本申请实例中的计算设备组成结构示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
本申请提供了一种全景图像视角调节方法及装置，该方法所应用的系统构架，如图1所示。该系统构架包括：移动终端101、智能电视102、媒体内容服务器103及互联网104。移动终端101及智能电视102通过互联网104与媒体内容服务器103连接。
上述移动终端101可以是用户的智能手机或PDA或其他用户便携式设备，其上安装有各种应用软件的客户端软件，用户可以通过上述客户端设备101登录并使用各种应用软件的客户端，该应用软件的客户端可以为视频播放客户端。上述互联网104可以包括有线网络和无线网络。智能电视102安装有视频播放应用客户端，可以用来播放在线视频资源或本地视频资源。
本申请提供了一种全景图像的展示控制方法，应用于媒体内容服务器103，如图2所示，主要包括以下步骤：
步骤201：接收移动终端发送的全景图像触发指令。
在这里全景图像可以是全景图片，也可以是全景视频。首先将移动终端101与智能电视102建立绑定，全景图像触发指令可以是在移动终端101与智能电视102绑定成功后，移动终端101向媒体内容服务器103发送的绑定确认指令。例如，移动终端通过扫描智能电视上展示的图形识别码进行移动终端与智能电视的绑定，当移动终端扫描并识别上述图形识别码的同时，向媒体内容服务器发送所述全景图像触发指令。媒体内容服务器103接收到该全景图像触发指令后，向智能电视102发送全景图像展示指令，智能电视展示全景图像。在一些实例中，当移动终端101绑定智能电视102后，在移动终端上自动打开一全景图像的网页，在该全景图像的网页上与智能电视同步展示所述全景图像。
在一些实例中，全景图像触发指令也可以采用其他方式，例如智能电视102向媒体内容服务器103发送全景图像播放请求，媒体内容服务器将该播放请求发送给移动终端，根据用户的选择决定是否展示全景图像。例如对于广告的全景图像展示，当智能电视102上展示广告时，智能电视102向媒体内容服务器103发送全景图像展示请求，媒体内容服务器103将是否展示全景图像的提示信息发送给移动终端101，如图3所示，移动终端101在其上安装的视频APP上展示所述提示信息301，同时展示是选项302及否选项303。当用户选择选项302时，移动终端101向媒体内容服务器103发送展示确认消息，媒体内容服务器103将该展示确认消息发送给智能电视102，从而智能电视展示广告的全景图像，该全景图像可以是全景图片，也可以是全景视频。当用户选择选项303时，移动终端101不向媒体内容服务器103发送展示确认消息，对应的智能电视102上不展示全景图像。
步骤202：响应于接收到的所述全景图像触发指令，向与所述移动终端绑定的智能电视发送所述全景图像触发指令，以使所述智能电视展示当前展示的媒体内容相对应的全景图像。
智能电视接收到全景图像触发指令后，展示与当前展示的媒体内容相对应的全景图像，其中全景图像数据可以是媒体内容服务器103之前就发送给智能电视102的。例如，智能电视向媒体内容服务器103请求一视频时，该视频中携带广告，媒体内容服务器将所述视频数据发送给智能电视的同时，也将广告对应的素材发送给智能电视。其中，广告对 应的输出可以包括广告对应的全景图像或全景视频。
步骤203：接收所述移动终端发送的所述移动终端在立体空间中的描述参数。其中，所述描述参数可以包括位置变化参数及姿态变化参数。
移动终端101获取位置变化参数可以利用室内定位来获得移动终端101的位置变化参数，具体地可采用Wi-Fi室内定位或蓝牙室内定位。具体地，对于Wi-Fi室内定位来说，可以通过移动终端接收的无线网络接入点的无线信号强度对移动终端定位。已知某Wi-Fi热点的坐标，移动终端接收到该Wi-Fi热点的信号，该信号的强度与Wi-Fi热点到移动终端的距离有一定关系，因而可以通过信号强度得到移动终端与该Wi-Fi热点的距离。根据移动终端到3个以上Wi-Fi热点的距离可由这些Wi-Fi热点的坐标获得移动终端的坐标。Wi-Fi室内定位的另一种方式类似指纹识别，定义多个语义位置，对于每个语义位置，采集Wi-Fi信号，形成“指纹库”。定位时，将移动终端测得的Wi-Fi信号与已有的“指纹库”中的Wi-Fi信号对比，看这个新信号与所述“指纹库”中哪个位置的Wi-Fi信号最匹配，则认为移动终端最可能位于该位置。
蓝牙室内定位是在室内安装若干个蓝牙局域网接入点，把网络维持成基于多用户的基础网络连接模式，并保证蓝牙局域网接入点始终是这个微网的主设备，然后通过测量移动终端接收到的蓝牙信号的信号强度对移动终端所在位置进行三角定位。
用户可以任意将移动终端向上下左右、左上、右下等方向移动、也可以旋转、推远、拉近移动终端，也可以在上、下、左、右、左上、左下、右上、右下等方向移动的同时进行推远、拉近和/或旋转的移动。移动终端101的位置变化参数可以通过移动终端之前的位置坐标及当前的位置坐标确定，其中，移动终端的之前的位置坐标及当前的位置坐标可以通过Wi-Fi室内定位或蓝牙室内定位获得。，根据所述移动终端101的基准点位置坐标及当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
对于移动终端获取姿态变化参数，移动终端101上设置有陀螺仪，陀螺仪可以给出重力的方向，即竖直方向。根据从陀螺仪获取到的传感器参数，分别确定所述移动终端在基准点处的偏转角度及当前位置处的偏转角度；根据移动终端101在基准点处的偏转角度及当前位置处的偏转角度确定移动终端101的姿态变化参数。
移动终端确定位置变化参数和/或姿势变化参数后可以展示自身的位置变化参数和/或姿势变化参数。根据旋转、移动等操作行为，移动终端展示偏转角度变化、位置变化等变化数据。例如：逆时针旋转移动终端30度，移动终端上相应显示数字-30度；移动终端左移X的距离，移动终端上相应显示-X；如果直接向左上方移动，则分解成左移X距离，上移Y，相应显示数据(-X，Y)；如果直接向左移动X距离，向上移动Y距离，同时向靠近智能电视的方向移动Z距离，则相应显示数据(-X，Y，Z)，在立体空间中的其他方向的移动以此类推。
步骤204：根据所述描述参数确定所述全景图像在全景空间中的调节参数。其中，所述调节参数可以包括视点调节参数及视角调节参数，可以根据描述参数中的位置变化参数来确定视点调节参数，可以根据描述参数中的姿态变化参数确定视角调节参数。
在获取全景图像数据时，在不同的拍摄点拍摄360度全景图像或者720度全景图像，不同的拍摄点对应不同的视点，同时记录该视点坐标。在一个固定的视点，拍摄360度全景图像或者720度全景图像，不同的角度对应不同的视角。从而形成一个视点的三维坐标加上视角的全景坐标库，不同视点及视角对应不同的全景图像。将移动终端在立体空间中的第一基准点与全景空间中的第二基准点相对应，将移动终端在立体空间中的坐标及姿态与全景坐标库中的视点坐标及视角相对应。根据移动终端在立体空间中相对于其基准点的位置变化参数和/或姿态变化参数能够确定移动终端当前位置对应的全景图像的视点及视角相对于全景空间的第二基准点的视点变化参数及视角变化参数。
步骤205：将所述调节参数发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
媒体内容服务器获得移动终端当前位置对应的全景图像的视点及视角相对于全景空间的第二基准点的视点变化参数及视角变化参数后将视角调节参数和/或视点调节参数发送给智能电视，智能电视根据该视角调节参数和/或视点调节参数确定与移动终端当前位置相对应的全景图像的视点及视角，进而将该视点及视角的全景图像进行展示。
如图4所示，智能电视上展示的为一旅游地的广告，智能电视上展示广告的全景图像。如图5所示，当移动终端向左移动X，向上移动Y后，媒体内容服务器根据数据匹配确定全景图像的视点左移X1，上移 Y1，并将该视点调节参数发送给智能电视。智能电视根据该视点调节参数，将视点左移X1，上移Y1后对应的视点的全景图像进行展示。如图6所示，当移动终端向后移动Z后，媒体内容服务器根据数据匹配确定全景图像的视点后移Z1，并将该视点调节参数发送给智能电视。智能电视根据该视点调节参数，将视点后移Z1后的视点的全景图像进行展示。全景图像的视点在前后方向的移动在用户的视觉上具有图像放大、缩小的视觉效果，视点后移Z1后，全景图像放大相应的倍数后进行展示，视点前移Z1后，全景图像缩小相应的倍数后进行展示。
采用本申请提供的全景图像的展示控制方法，通过移动终端在立体空间中的位置变化及姿态变化来控制调节智能电视上的全景图像的视点及视角，对全景图像的调节维度更多，更加灵活。用户观看全景图像时可以像提着摄像机任意方向移动拍摄视频那样自然。
本申请提供的全景图像的展示控制方法，例如，可以应用到广告的全景图像展示控制中。例如汽车内饰广告用全景视频展示，在智能电视上展示全景视频，用户可以通过手机连接智能电视，通过控制手机旋转、移动(将手机当作摄影机，调整不同机位)观看汽车内饰不同角度细节。本申请提供的全景图像的展示控制方法，不仅用于广告，还可以应用在游戏领域中，例如运用于射击类游戏中。能够用于实现辅助角色定位，寻找空间中的红包、宝物、装备等。移动终端也可以替代游戏手柄，通过手机操控游戏角色移动等。
在一些实例中，其中，所述描述参数包括位置变化参数和姿态变化参数，所述调节参数包括视角调节参数和视点调节参数；
其中，所述根据所述描述参数确定所述全景图像在全景空间中的调节参数包括：
根据所述位置变化参数确定所述全景图像在全景空间中的视点调节参数，根据所述姿态变化参数确定所述全景图像在全景空间中的视角调节参数；
其中，所述将所述调节参数发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像包括：
将所述视点调节参数及所述视角调节参数发送给所述智能电视，以使所述智能电视根据所述视点调节参数调整所述全景图像的视点，根据所述视角调节参数调整所述全景图像的视角。
在该实例中，移动终端在立体空间中的描述参数包括位置变化参数及姿态变化参数，移动终端将所述位置变化参数及所述姿态变化参数发送给媒体内容服务器。媒体内容服务器根据位置变化参数确定视点调节参数，根据姿态变化参数确定视角调节参数，将视点调节参数及视角调节参数发送给智能电视。智能电视根据视点调节参数调节全景图像的视点，根据视角调节参数条件全景图像的视角。
在一些实例中，本申请提出的全景图像的展示控制方法，进一步包括将移动终端在立体空间中的坐标系与全景空间中的全景坐标系进行匹配，从而确定移动终端三维空间中的位置变化参数和/或姿态变化参数到所述全景图像的视角调节参数和/或视点调节参数的映射关系。如图7所示，主要包括以下步骤：
步骤701：接收所述移动终端发送的所述移动终端的第一坐标系数据，通过该第一坐标系获取的参数用于表征所述移动终端在立体空间中的位置坐标及姿态角度。
在移动终端所在立体空间建立第一坐标系，该第一坐标系包括3个坐标轴，即X轴、Y轴及Z轴，同时选取一个移动终端的旋转轴。移动终端调节智能电视时，移动终端与智能电视平行放置。移动终端上设置有陀螺仪，根据陀螺仪可以知道重力的方向，如图8所示，将重力方向所在轴定义为Y轴，与Y轴垂直的面为水平面，在该水平面上与智能电视屏幕相平行的轴定义为X轴，与X轴相垂直且指向电视平面的轴定义为Z轴。X轴代表移动终端左右方向的移动距离，Y轴代表移动终端在上下方向的移动距离，Z轴代表移动终端在前后方向上的移动距离，同时也表示移动终端101与智能电视102之间的距离。同时确定第一基准点，移动终端的位置变化参数为移动终端的位置坐标相对于该第一基准点的位置变化参数。第一基准点为移动终端开始调节智能电视前的初始位置，在一些实例中，可以将第一坐标系的坐标原点定义为该第一基准点，从而在确定移动终端的位置变化参数时，可以直接将移动终端的位置坐标参数作为位置变化参数，从而减少计算量。移动终端在调节智能电视上的全景图像时，在某一个固定位置，移动终端可以通过旋转控制移动终端的姿态，根据该姿态的变化控制全景图像在某个视点处的视角。当全景图像为360度全景图像时，可以通过移动终端在一个平面内的旋转来控制全景图像不同的视角，当全景图像为720度全景图像时， 可以通过移动终端在两个平面内的旋转来控制全景图像不同的视角。在一些实例中，可以将上述X轴、Y轴、Z轴中的任一个轴作为旋转轴。在一些实例中，将移动终端在所述第一基准点的旋转角度设置为0度，在确定姿态变化参数时，直接将移动终端所在位置处的旋转角度作为姿态变化参数，从而减小计算量。第一坐标系数据主要包括3个坐标轴、坐标原点、第一基准点及移动终端的旋转轴。
步骤702：接收所述智能电视发送的全景空间中的第二坐标系数据，通过该第二坐标系获取的参数用于表征全景图像的视点及视角。
在全景空间中建立第二坐标系，将全景图像的拍摄起点定义为第二基准点，在一些实例中，将全景空间坐标系的原点定义为该第二基准点(第二基准点与第二坐标系的原点重合)。对于全景图像，默认在电视的屏幕所在竖直平面上，平行于水平面的为X轴，垂直于水平面的为Y轴，垂直于电视屏幕所在平面的为Z轴。X轴表示视点左右方向上移动的距离，Y轴表示视点在上下方向上移动的距离，Z轴表示视点在前后方向的移动距离。如果全景图像为360度全景图像，用一个角度参数表示视角，如果全景图像是720度全景图像，用两个角度参数表示视角。第二坐标系数据包括第二坐标系的三个坐标轴、坐标原点、第二基准点以及表示视角的角度。
步骤703：根据所述第一坐标系数据和所述第二坐标系数据，确定所述第一坐标系中的描述参数到所述第二坐标系中的调节参数的映射关系。其中，描述参数包括位置变化参数和/或姿态变化参数，条件参数包括视点调节参数和/或视角调节参数。
媒体内容服务器接收智能电视发送的全景空间坐标系数据以及移动终端的立体空间坐标系数据，将全景空间的第二坐标系与移动终端的第一坐标系进行匹配。将第一坐标系的第一基准点与第二坐标系的第二基准点相对应；将第一坐标系的X、Y、Z轴分别与第二坐标系的X、Y、Z轴相对应，即将移动终端在左右方向的移动与视点在左右方向的移动相对应，移动终端在上下方向的移动与视点在上下方向的移动相对应，移动终端在前后方向的移动与视点在前后方向的移动相对应，视点的前后移动在观看视觉效果上具有全景图像放大、缩小的视觉效果。将移动终端的旋转角度与全景图像的视角相对应，当全景图像为360度全景图像时，将移动终端在一个平面内的旋转角度与全景图像在360度范围内 的视角相对应，当全景图像为720度全景图像时，将移动终端在立体空间中的旋转角度分解为两个平面上的旋转角度，将该两个平面上的旋转角度与全景图像在720度范围内的视角相对应。此外，所述映射关系还包括第一坐标系及第二坐标系尺度的对应，根据用户手臂移动移动终端在上下、左右、前后方向可移动的距离，用户手臂转动移动终端101的可旋转角度，以及全景图像的视点在左右方向、上下方向、前后方向上的可移动距离范围以及视角范围，确定空间坐标系的尺度与全景空间中的坐标的尺度的对应关系。例如移动终端101在上下方向上移动距离a，全景图像对应地在上下方向上移动a1，a与a1成线性比例关系，比值的大小取决于用户手臂的在上下方向上可移动距离范围与全景图像的视点上下移动距离范围。移动终端101在左右方向上移动距离b，全景图像的视点对应地在左右方向上移动b1，b与b1成线性比例关系，比值的大小取决于用户手臂的左右方向上可移动距离范围与全景图像的视点在左右方向上的移动距离范围。移动终端101在前后方向上移动距离c，全景图像的视点在前后方向移动c1，c与c1成线性比例关系，比值的大小取决于用户手臂在前后方向上可移动距离范围与全景图像的视点在前后方向上移动距离范围。移动终端旋转角度θ，全景图像的视角改变θ1，θ与θ1成线性比例关系，比值的大小取决于用户手臂的可转动角度范围与全景图像的视角范围。
在一些实例中，在上述步骤204中，在执行根据所述描述参数确定所述全景图像在全景空间中的调节参数包括：根据所述映射关系和所述描述参数，确定所述调节参数。
移动终端101将获得的位置变化参数及姿势变化参数发送给媒体内容服务器103。媒体内容服务器103根据获得的移动终端101在空间坐标系中的位置变化参数及姿势变化参数，同时根据前述确定的立体空间中的第一坐标系中的位置参数和/或姿态参数到所述全景空间中的视角调节参数和/或视点调节参数的映射关系，确定针对全景图像的调节参数。在一些实例中，当第一基准点定义为第一坐标系的坐标原点，移动终端初始姿态处的旋转角度定义为0度，例如，如图8所示，移动终端在图8中的姿态的旋转角度定义为0度。第二基准点可以定义为第二坐标系的坐标原点(第二基准点与第二坐标系的坐标原点重合)，智能电视上展示的全景图像的初始视角定义为0度。在将第一基准点设置在 第一坐标系的原点、移动终端初始位置的旋转角度设置为0度的情况下，位置变化参数及姿态变化参数即为移动终端当前位置的位置坐标及旋转角度。当将第二基准点设置为第二坐标系的原点，移动终端上初始展示的全景图像的旋转角度定义为0度的情况下，视角调节参数及视点调节参数即为全景图像的视角及视点。根据上步骤中确定的映射关系，确定移动终端当前位置的坐标对应的视点，同时确定移动终端当前位置的旋转角度对应的全景图像的视角。媒体内容服务器将确定的视点及视角发送给智能电视，智能电视展示所述确定的视点及视角的全景图像。
在一些实例中，本申请提出的全景图像的展示控制方法，进一步包括将移动终端与智能电视进行绑定，可以通过图像识别码的方式将移动终端与智能电视进行绑定，通过移动终端扫描智能电视的图像识别码建立绑定，具体包括以下步骤：
步骤S11：生成携带所述智能电视的标识的图形识别码，并将所述图形识别码发送给该智能电视，以使该智能电视展示所述图形识别码。
媒体内容服务器103生成携带智能电视标识的图形识别码，并将所述图形识别码发送给该智能电视，以使该智能电视展示所述图形识别码。如图9所示。该图形识别码可以是携带智能电视标识的二维码，该智能电视标识可以为网络电视的GUID。智能电视可以在其显示装置上，例如显示屏上显示所述图形识别码。
步骤S12：接收所述移动终端识别所述图形识别码后发送的绑定请求消息，所述绑定请求消息中携带该移动终端的标识及该智能电视的标识。
移动终端扫描上述智能电视的图像识别码进行识别，移动终端可以通过移动终端自身的扫描功能扫描上述图形识别码，也可以通过其上的客户端携带的扫描功能扫描上述图形识别码。当图形识别码识别成功后，移动终端向媒体内容服务器103发送绑定请求消息，该绑定请求消息中包括移动终端的标识以及智能电视的标识。
步骤S13：建立该移动终端的标识及该智能电视的标识之间的对应关系。
媒体内容服务器103接收到上述绑定请求消息后，建立移动终端标识及智能电视标识的对应关系，并将该对应关系保存。同时媒体内容服务器103向智能电视发送绑定成功消息，并在智能电视上展示绑定成功 消息。移动终端识别图形识别码失败的情况下，向媒体内容服务器103发送绑定识别消息，媒体内容服务器103将该绑定识别消息发送给智能电视展示，智能电视刷新图形识别码，同时显示重新扫码的提示信息。
在一些实例中，在上述步骤202中，在执行所述向与所述移动终端绑定的智能电视发送所述全景图像触发指令包括以下步骤：
步骤S21：根据所述对应关系确定与所述移动终端的标识相对应的智能电视的标识。
在上述步骤中，媒体内容服务器103已经建立了移动终端101标识与智能电视102标识之间的对应关系并保存。媒体内容服务器103接收到全景图像触发指令后，全景图像触发指令中包括发送该指令的移动终端的标识，媒体内容服务器根据该移动终端的标识，在保存的对应关系中查找与所述移动终端标识相对应的智能电视标识。
步骤S22：将所述全景图像触发指令发送给与所述智能电视的标识相对应的智能电视。
媒体内容服务器103查找到智能电视的标识后，将全景图像触发指令发送给与该智能电视标识相对应的智能电视，以使得智能电视展示与当前展示的媒体内容相对应的全景图像。
在一些实例中，本申请提出的全景图像的展示控制方法，进一步包括在移动终端上与智能电视上同步展示全景图像，移动终端的展示作为一个副屏，方便用户观看。主要包括以下步骤：
步骤S31：接收所述智能电视发送的当前展示的全景图像数据。
移动终端与智能电视同步展示全景图像，智能电视可以将当前展示的全景图像实时发送给媒体内容服务器，同时媒体内容服务器将接受到的全景图像发送给移动终端，使得移动终端与智能电视同步展示全景图像。
步骤S32：将所述当前展示的全景图像数据发送给所述移动终端，以使所述移动终端与所述智能电视同步展示所述全景图像。
如图10所示，移动终端与智能电视同步显示全景图像，在移动终端上同步展示全景图像，一方面移动终端上的展示装置可以作为一个复屏，另一方面便于一些互动，例如当全景图像为全景视频时，可以在移动终端上控制全景视频播放的进步条。
在一些实例中，本申请提出的全景图像的展示控制方法，进一步包 括移动终端对其上展示的全景图像独立调节，而不是实时接收智能电视发送的调整后的全景图像。主要在上述步骤204之后，还包括将所述全景图像的调节参数发送给所述移动终端，以使所述移动终端根据所述调节参数调整所述全景图像的视角和/或视点。
智能电视也可以在接受到媒体内容服务器发送的播放全景图像确认消息后将全景图像数据发送给媒体内容服务器，媒体内容服务器将其发送到移动终端，在移动终端上的APP展示初始全景图像。在一些实例中也可以在移动终端上展示的全景图像网页(如H5页面)上展示所述全景图像，该全景图像可以是没有经过调整的全景图像。也可以在接收到移动终端发送的单独调整全景图像的触发请求后，移动终端对于接收的智能电视展示的当前全景图像，在后续调节中自己独立对全景图像进行调节。在后续的媒体内容服务器103向智能电视发送全景图像的调节参数时，移动终端101可以根据该调节参数对其上展示的全景图像进行调整，应用服务器也可以将根据所述调节参数确定的全景图像发送给移动设备展示。移动终端101与智能电视同步展示全景图像，同时同步调整全景图像。
在一些实例中，本申请提出的全景图像的展示控制方法，其中，所述全景图像中包括一目标对象，该目标对象可以是广告图像中的一张优惠券，游戏中的全景图像中的敌人、钥匙、道具等。
所述方法进一步包括：
步骤S41：根据所述调节参数及所述目标对象的位置确定提示信息；所述提示信息用于提醒对所述移动终端进行操作。在执行该步骤时，执行根据所述视角调节参数和/或视点调节参数及所述目标对象的位置确定提示信息，所述提示信息用于提醒对所述移动终端进行移动和/或旋转操作。
在移动终端与智能电视同步展示全景图像的情况下，全景图像的提供方可以在全景图像中设置一目标对象。媒体内容服务器根据目标对象所在位置以及智能电视当前展示的全景图像确定提示信息，该提示信息用于帮助用户从全景图像中发现目标对象。例如对于广告全景图像来说，移动终端与智能电视同步展示全景图像，如果将当前的全景图像再放大两倍，用户就可以发现目标对象，则视频服务器将放大两倍的提示信息发送到移动终端上展示，如图11所示，移动终端上展示广告的全 景图像，其中广告为一旅游景点广告。同时移动终端上展示提示信息1101，该提示信息1101用于提醒用户如果再放大两倍会有惊喜，
步骤S42：将所述提示信息发送给所述移动终端展示。从而使用户根据所述提示信息移动和/或旋转所述移动终端。
还如上例所示，移动终端上展示提示信息，该提示信息为：再放大两倍会有惊喜。用户将移动终端靠近智能电视，当放大两倍后，如图12所示，在智能电视102上发现了优惠券1202，移动终端上同步显示优惠券1202，同时展示发现优惠券的提示信息1201。用户可以在移动终端上点击按钮1203，即图12中的“开启希腊之行”按钮(控件)进行购买优惠机票，还可以进行分享等互动。
本申请还提供了一种全景图像的展示控制方法，应用于移动终端101，如图13所示，主要包括以下步骤：
步骤1301：响应于全景图像触发操作，向媒体内容服务器发送全景图像触发指令，以使所述媒体内容服务器将所述全景图像触发指令发送给与所述移动终端绑定的智能电视，以使所述智能电视展示当前展示的媒体内容相对应的全景图像。
步骤1302：响应于对所述移动终端的操作，获取所述移动终端在立体空间中的描述参数，并将其发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述描述参数确定所述全景图像在全景空间中的调节参数，并将其发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
采用本申请提供的全景图像的展示控制方法，通过移动终端在立体空间中的位置变化及姿态变化来控制调节智能电视上的全景图像的视点及视角。对全景图像的调节维度更多，更加灵活。同时用户观看全景图像时可以像提着摄像机任意方向移动拍摄视频那样自然。
在一些实例中，其中，所述描述参数包括位置变化参数和姿态变化参数，所述调节参数包括视角调节参数和视点调节参数；
其中，在执行所述响应于对所述移动终端的操作，获取所述移动终端在立体空间中的描述参数包括：
响应于对所述移动终端的移动操作，获取所述位置变化参数，响应于对所述移动终端的旋转操作，获取所述姿态变化参数；
其中，在执行所述将其发送给所述媒体内容服务器，以使所述媒体 内容服务器根据所述描述参数确定所述全景图像在全景空间中的调节参数，并将其发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像包括：
将所述位置变化参数及所述姿态变化参数发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述位置变化参数确定所述全景图像在全景空间中的视点调节参数，根据所述姿态变化参数确定所述全景图像在全景空间中的视角调节参数，并将所述视点调节参数及所述视角调节参数发送给所述智能电视，以使所述智能电视根据所述视点调节参数调整所述全景图像的视点，根据所述视角调节参数调整所述全景图像的视角。
在一些实例中，在上述步骤1301中，所述响应于用户的全景图像触发操作包括响应于用户对展示全景图像选项的选择操作，也可以包括识别与其绑定的智能电视上的图形识别码。
首先将移动终端101与智能电视102建立绑定，全景图像触发指令可以是在移动终端101与智能电视102绑定成功后，移动终端101向媒体内容服务器103发送的绑定确认指令。例如，移动终端通过扫描智能电视上展示的图形识别码进行移动终端与智能电视的绑定，当移动终端扫描并识别上述图形识别码的同时，向媒体内容服务器发送所述全景图像触发指令。媒体内容服务器103接收到该全景图像触发指令后，向智能电视102发送全景图像展示指令，智能电视展示全景图像。在一些实例中，当移动终端101绑定智能电视102后，在移动终端上自动打开一全景图像的网页，在该全景图像的网页上与智能电视同步展示所述全景图像。
在一些实例中，全景图像触发指令也可以采用其他方式，例如智能电视102向媒体内容服务器103发送全景图像播放请求，媒体内容服务器将该播放请求发送给移动终端，根据用户的选择决定是否展示全景图像。例如对于广告的全景图像展示，当智能电视102上展示广告时，智能电视102向媒体内容服务器103发送全景图像展示请求，媒体内容服务器103将是否展示全景图像的提示信息发送给移动终端101，如图3所示，移动终端101在其上安装的视频APP上展示所述提示信息301，同时展示是选项302及否选项303。当用户选择选项302时，移动终端101向媒体内容服务器103发送展示确认消息，媒体内容服务器103将 该展示确认消息发送给智能电视102，从而智能电视展示广告的全景图像，该全景图像可以是全景图片，也可以是全景视频。当用户选择选项303时，移动终端101不向媒体内容服务器103发送展示确认消息，对应的智能电视102上不展示全景图像。
在一些实例中，在上述步骤1302中，在执行所述获取移动终端在立体空间中的位置变化参数时，移动终端101获取位置变化参数可以利用室内定位来获得移动终端101的位置变化参数。具体地，可采用Wi-Fi室内定位或蓝牙室内定位来获得所述位置变化参数。具体对于Wi-Fi室内定位来说，可以通过移动终端接收的无线网络接入点的无线信号强度对移动终端定位。已知某Wi-Fi热点的坐标，移动终端接收到该Wi-Fi热点的信号强度，这个信号强度与Wi-Fi热点到移动设备的距离有一定关系，因而可以通过信号强度得到移动终端与该Wi-Fi热点的距离。根据获得的移动设备到3个以上Wi-Fi热点的距离，可以确定移动终端的坐标。其中，所述立体空间中设置有M个网络接入点，其中M大于等于3。所述立体空间中设置有M个网络接入点，其中M大于等于3；
所述获取所述移动终端在立体空间中的描述参数包括以下步骤
步骤S51：设置M个网络接入点，其中M大于等于3。在立体空间中设置所述M各个网络接入点。在立体空间中设置M个网络接入点。
步骤S52：根据所述移动终端在基准点位置及当前位置处分别接收的所述M个网络接入点的M个无线信号强度分别确定所述基准点位置坐标及当前位置坐标；即根据所述移动终端在基准点位置处接收到的所述M个网络接入点的M个无线信号强度及当前位置处接收到的所述M个网络接入点的M个无线信号强度分别确定所述基准点位置坐标及所述当前位置坐标。
步骤S53：根据所述基准点位置坐标及所述当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
在一些实例中，在上述步骤1302中，在执行所述获取移动终端在立体空间中的位置变化参数时，移动终端101获取位置变化参数可以采用Wi-Fi室内定位的另外一种方式，类似指纹识别，定义多个语义位置，对于每个语义位置，采集Wi-Fi信号，形成“指纹库”。定位时，将移动终端测得的Wi-Fi信号与已有的“指纹库”中的Wi-Fi信号对比，看这个新信号与库中哪个位置的Wi-Fi信号最匹配，则认为移动终端最可能 位于该位置。具体主要包括以下步骤：
步骤S61：确定所述移动终端在多个位置点处所接收到的网络接入点的无线信号强度，并将到位置点坐标与对应的无线信号强度关联存储。
步骤S62：确定移动终端在基准点位置处及当前位置处分别接收到的网络接入点的第一无线信号强度及第二无线信号强度，并分别在存储的无线信号强度中查找与所述第一无线信号强度及第二无线信号强度最接近的无线信号强度，并将查找到的分别与所述第一无线信号强度及第二无线信号强度最接近的无线信号强度相对应的位置点的位置坐标分别作为基准点位置坐标及当前位置坐标。
步骤S63：根据所述基准点位置坐标及当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
在一些实例中，还可以采用蓝牙室内定位，蓝牙室内定位是在室内安装若干个蓝牙局域网接入点，把网络维持成基于多用户的基础网络连接模式，并保证蓝牙局域网接入点始终是这个微网的主设备，然后通过测量信号强度对新加入的盲节点进行三角定位。
用户可以任意将移动终端向上下左右、左上、右下等方向移动、也可以旋转、推远、拉近移动终端，也可以在上、下、左、右、左上、左下、右上、右下等方向移动的同时进行推远、拉近和/或旋转的移动。移动终端101的位置变化参数可以通过移动终端之前的位置坐标及当前的位置坐标确定，其中，移动终端的之前的位置坐标及当前的位置坐标可以通过Wi-Fi室内定位或蓝牙室内定位获得。，根据所述移动终端101的基准点位置坐标及当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
在一些实例中，在上述步骤1302中，在执行所述获取移动终端在立体空间中的姿态变化参数时，移动终端101上设置有陀螺仪，陀螺仪可以给出重力的方向，即竖直方向。根据从陀螺仪获取到的传感器参数，分别确定所述移动终端的基准点偏转角度及当前偏转角度；根据移动终端101的基准点偏转角度及当前偏转角度确定移动终端101的姿态变化参数。具体主要包括以下步骤：
步骤S71：根据从陀螺仪获取到的传感器参数，分别确定所述移动终端的基准点偏转角度及当前偏转角度。
步骤S72：根据所述移动终端的基准点偏转角度及当前偏转角度确定所述移动终端的姿态变化参数。
此外，在一些实例中，移动终端确定位置变化参数和/或姿势变化参数后可以展示自身的位置变化参数和/或姿势变化参数。根据旋转、移动等操作行为，移动终端界面呈现角度、位置等变化数据。例如：逆时针旋转移动终端30度，相应显示数字-30度；移动终端101左移X的距离，相应手机上显示-X；如果直接向左上方移动，则分解成左移X距离+上移Y，相应显示数据(-X，Y)；在立体空间中的其他方向的移动以此类推。
在一些实例中，本申请提出的全景图像的展示控制方法，进一步包括在移动终端上与智能电视上同步展示全景图像，移动终端的展示设备作为一个副屏，方便用户观看。主要包括：接收媒体内容服务器发送的所述智能电视当前展示的全景图像数据，展示所述全景图像。
移动终端与智能电视同步展示全景图像，智能电视可以将当前展示的全景图像实时发送给媒体内容服务器，同时媒体内容服务器将接受到的全景图像发送给移动终端，使得移动终端与智能电视同步展示全景图像。如图10所示，移动终端与智能电视同步显示全景图像，在移动终端上同步展示全景图像，一方面移动终端上的展示装置可以作为一个复屏，另一方面便于一些互动，例如当全景图像为全景视频时，可以在移动终端上控制全景视频播放的进步条。
在一些实例中，本申请提出的全景图像的展示控制方法，进一步包括移动终端对其上展示的全景图像独立调节，而不是实时接收智能电视发送的调整后的全景图像。主要在上述步骤204之后，还包括以下步骤：
步骤S81：接收媒体内容服务器发送的调节参数。
智能电视也可以在接受到媒体内容服务器发送的播放全景图像确认消息后将全景图像数据发送给媒体内容服务器，媒体内容服务器将其发送到移动终端，在移动终端上的APP展示初始全景图像。在一些实例中也可以在移动终端上的全景图像网页上展示所述全景图像，该全景图像是经过调整的全景图像。在一些实例中，也可以在接收到用户的单独调整全景图像的触发请求后，移动终端对于接收的智能电视展示的当前全景图像，在后续调节中自己独立对全景图像进行调节。
步骤S82：根据所述调节参数调整所述全景图像。即，根据视角调 节参数条件全景图像的视角，根据视点调节参数调整全景图像的视点。
在后续的媒体内容服务器103向智能电视发送调节参数时，也会同时向移动终端发送该调节参数，移动终端根据该调节参数对其上展示的全景图像的视点及视角进行调整。移动终端101与智能电视同步展示全景图像，同时同步调整全景图像。
在一些实例中，本申请提出的全景图像的展示控制方法，还包括：接收媒体内容服务器发送的提示信息并展示，所述提示信息用以提醒所述移动终端的用户操作(移动或转动)所述移动终端。以使用户根据所述提示信息移动或转动所述移动终端。
例如对于广告全景图像来说，移动终端与智能电视同步展示全景图像，移动终端上展示提示信息，提示信息提醒用户，再放大两倍会有惊喜。用户将移动终端靠近智能电视，当全景图像放大两倍后，如图所示12，在智能电视102上发现了优惠券，移动终端上同步显示优惠券，用户可以在移动终端上点击按钮“开启希腊之行”进行购买优惠机票，还可以进行分享等互动。
本申请还提供了一种全景图像的展示控制装置1400，应用于媒体内容服务器103，如图14，包括：
触发指令接收单元1401，用于接收移动终端发送的全景图像触发指令；
触发指令发送单元1402，用于响应于接收到的所述全景图像触发指令，向与所述移动终端绑定的智能电视发送所述全景图像触发指令，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
位置姿态变化参数接收单元1403，用于接收所述移动终端发送的所述移动终端在立体空间中的位置变化参数和/或姿态变化参数；
调节参数确定单元1404，用于根据所述位置变化参数和/或姿态变化参数确定所述全景图像在全景空间中的视角调节参数和/或视点调节参数；
调节参数发送单元1405，用于将所述视角调节参数和/或视点调节参数发送给所述智能电视，以使所述智能电视根据所述视角调节参数和/或视点调节参数调整所述全景图像的视角和/或视点。
采用本申请提供的全景图像的展示控制装置，通过移动终端在立体空间中的位置变化及姿态变化来控制调节智能电视上的全景图像的视 点及视角，可以同时对全景图像的视点及视角进行调节，对全景图像的调节维度更多，更加灵活。同时用户观看全景图像时可以像提着摄像机任意方向移动拍摄视频那样自然。
在一些实例中，所述装置1400进一步包括：
坐标系参数接收单元1406，用于接收所述移动终端发送的所述移动终端的第一坐标系数据，该第一坐标系用于表征所述移动终端在立体空间中的位置坐标及姿态角度；接收所述智能电视发送的全景空间中的第二坐标系数据，该第二坐标系用于表征全景图像的视点及视角，不同视点及视角对应不同的全景图像；
映射关系确定单元1407，用于根据所述第一坐标系数据和所述第二坐标系数据，确定所述第一坐标系中的位置变化参数和/或姿态变化参数到所述第二坐标系中的视角调节参数和/或视点调节参数的映射关系；
所述调节参数确定单元1404，用于根据所述映射关系和所述位置变化参数和/或姿态变化参数，确定所述视角调节参数和/或视点调节参数。
本申请还提供了一种全景图像的展示控制装置1500，应用于移动终端101，如图15，包括：
触发指令发送单元1501，用于响应于用户的全景图像触发操作，向媒体内容服务器发送全景图像触发指令，以使所述媒体内容服务器将所述全景图像触发指令发送给所述智能电视，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
位置姿态变化参数获取单元1502，用于响应于所述用户的移动和/或旋转操作，获取自身在立体空间中的位置变化参数和/或姿态变化参数，并将其发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述位置变化参数和/或姿态变化参数确定所述全景图像在全景空间中的视角调节参数和/或视点调节参数，并将其发送给所述智能电视，以使所述智能电视根据所述视角调节参数和/或视点调节参数调整所述全景图像的视角和/或视点。
采用本申请提供的全景图像的展示控制装置，通过移动终端在立体空间中的位置变化及姿态变化来控制调节智能电视上的全景图像的视点及视角，可以同时对全景图像的视点及视角进行调节，对全景图像的调节维度更多，更加灵活。同时用户观看全景图像时可以像提着摄像机任意方向移动拍摄视频那样自然。
在一些实例中，所述位置姿态变化参数获取单元1502，用于
设置M个网络接入点，其中M大于等于3；
根据所述移动终端在基准点位置及当前位置处分别接收的所述M个网络接入点的M个无线信号强度分别确定所述基准点位置坐标及当前位置坐标；
根据所述基准点位置坐标及当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
在一些实例中，所述位置姿态变化参数获取单元1502，用于
确定多个位置点处所接收的网络接入点的无线信号强度，并将位置点坐标与对应的无线信号强度存储；
确定移动终端在基准点位置处及当前位置处接收的网络接入点的第一无线信号强度及第二无线信号强度，并分别在存储的无线信号强度中查找与所述第一无线信号强度及第二无线信号强度最接近的无线信号强度，并将查找到的分别与所述第一无线信号强度及第二无线信号强度最接近的无线信号强度相对应的位置点的位置坐标作为基准点位置坐标及当前位置坐标；
根据所述基准点位置坐标及当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
在一些实例中，所述位置姿态变化参数获取单元1502，用于
根据从陀螺仪获取到的传感器参数，分别确定所述移动终端的基准点偏转角度及当前偏转角度；
根据所述移动终端的基准点偏转角度及当前偏转角度确定所述移动终端的姿态变化参数。
图16示出了全景图像的展示控制装置1400及全景图像的展示控制装置1500所在的计算设备的组成结构图。如图16所示，该计算设备包括一个或者多个处理器(CPU)1602、通信模块1604、存储器1606、用户接口1610，以及用于互联这些组件的通信总线1608。
处理器1602可通过通信模块1604接收和发送数据以实现网络通信和/或本地通信。
用户接口1610包括一个或多个输出设备1612，其包括一个或多个扬声器和/或一个或多个可视化显示器。用户接口1610也包括一个或多个输入设备1614，其包括诸如，键盘，鼠标，声音命令输入单元或扩音 器，触屏显示器，触敏输入板，姿势捕获摄像机或其他输入按钮或控件等。
存储器1606可以是高速随机存取存储器，诸如DRAM、SRAM、DDR RAM、或其他随机存取固态存储设备；或者非易失性存储器，诸如一个或多个磁盘存储设备、光盘存储设备、闪存设备，或其他非易失性固态存储设备。
存储器1606存储处理器1602可执行的指令集，例如计算机可读指令，以实现上述本申请中的全景图像的展示控制方法中的各步骤，同时还实现本申请全景图像的展示控制装置中各模块的功能。所述存储器1606包括：
操作系统1616，包括用于处理各种基本系统服务和用于执行硬件相关任务的程序；
应用1618，包括用于全景图像展示控制的各种应用程序，这种应用程序能够实现上述各实例中的处理流程，比如可以包括全景图像的展示控制装置1400中的部分或全部单元或者全景图像的展示控制装置1500中的部分或全部。全景图像的展示控制装置1400及全景图像的展示控制装置1500中的各单元中的至少一个单元可以存储有机器可执行指令。处理器1602通过执行存储器1606中各单元中至少一个单元中的机器可执行指令，进而能够实现上述各单元中的至少一个模块的功能。
需要说明的是，上述各流程和各结构图中不是所有的步骤和模块都是必须的，可以根据实际的需要忽略某些步骤或模块。各步骤的执行顺序不是固定的，可以根据需要进行调整。各模块的划分仅仅是为了便于描述采用的功能上的划分，实际实现时，一个模块可以分由多个模块实现，多个模块的功能也可以由同一个模块实现，这些模块可以位于同一个设备中，也可以位于不同的设备中。
各实施例中的硬件模块可以以硬件方式或硬件平台加软件的方式实现。上述软件包括机器可读指令，存储在非易失性存储介质中。因此，各实施例也可以体现为软件产品。
各例中，硬件可以由专门的硬件或执行机器可读指令的硬件实现。例如，硬件可以为专门设计的永久性电路或逻辑器件(如专用处理器，如FPGA或ASIC)用于完成特定的操作。硬件也可以包括由软件临时配置的可编程逻辑器件或电路(如包括通用处理器或其它可编程处理器) 用于执行特定操作。
另外，本申请的每个实例可以通过由数据处理设备如计算机执行的数据处理程序来实现。显然，数据处理程序构成了本申请。此外，通常存储在一个存储介质中的数据处理程序通过直接将程序读取出存储介质或者通过将程序安装或复制到数据处理设备的存储设备(如硬盘和或内存)中执行。因此，这样的存储介质也构成了本申请，本申请还提供了一种非易失性存储介质，其中存储有数据处理程序，这种数据处理程序可用于执行本申请上述方法实例中的任何一种实例。
图16模块对应的机器可读指令可以使计算机上操作的操作系统等来完成这里描述的部分或者全部操作。非易失性计算机可读存储介质可以是插入计算机内的扩展板中所设置的存储器中或者写到与计算机相连接的扩展单元中设置的存储器。安装在扩展板或者扩展单元上的CPU等可以根据指令执行部分和全部实际操作。
以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本发明保护的范围之内。

Claims (25)

  1. 一种全景图像的展示控制方法，应用于移动终端，其特征在于，包括：
    响应于全景图像触发操作，向媒体内容服务器发送全景图像触发指令，以使所述媒体内容服务器将所述全景图像触发指令发送给与所述移动终端绑定的智能电视，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
    响应于对所述移动终端的操作，获取所述移动终端在立体空间中的描述参数，并将其发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述描述参数确定所述全景图像在全景空间中的调节参数，并将其发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
  2. 根据权利要求1所述的方法，其中，所述描述参数包括位置变化参数和姿态变化参数，所述调节参数包括视角调节参数和视点调节参数；
    其中，所述响应于对所述移动终端的操作，获取所述移动终端在立体空间中的描述参数包括：
    响应于对所述移动终端的移动操作，获取所述位置变化参数，响应于对所述移动终端的旋转操作，获取所述姿态变化参数；
    其中，所述将其发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述描述参数确定所述全景图像在全景空间中的调节参数，并将其发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像包括：
    将所述位置变化参数及所述姿态变化参数发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述位置变化参数确定所述全景图像在全景空间中的视点调节参数，根据所述姿态变化参数确定所述全景图像在全景空间中的视角调节参数，并将所述视点调节参数及所述视角调节参数发送给所述智能电视，以使所述智能电视根据所述视点调节参数调整所述全景图像的视点，根据所述视角调节参数调整所述全景图像的视角。
  3. 根据权利要求1所述的方法，其中，所述描述参数包括位置变 化参数，其中，所述立体空间中设置有M个网络接入点，其中M大于等于3；其中，所述获取所述移动终端在立体空间中的描述参数包括：
    根据所述移动终端在基准点位置处接收到的所述M个网络接入点的M个无线信号强度及当前位置处接收到的所述M个网络接入点的M个无线信号强度分别确定所述基准点位置坐标及所述当前位置坐标；
    根据所述基准点位置坐标及所述当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
  4. 根据权利要求1所述的方法，其中，所述描述参数包括位置变化参数，所述获取所述移动终端在立体空间中的描述参数包括：
    确定所述移动终端在多个位置点处所接收到的网络接入点的无线信号强度，并将到位置点坐标与对应的无线信号强度关联存储；
    确定移动终端在基准点位置处及当前位置处分别接收到的网络接入点的第一无线信号强度及第二无线信号强度，并分别在存储的无线信号强度中查找与所述第一无线信号强度及第二无线信号强度最接近的无线信号强度，并将查找到的分别与所述第一无线信号强度及第二无线信号强度最接近的无线信号强度相对应的位置点的位置坐标作为基准点位置坐标及当前位置坐标；
    根据所述基准点位置坐标及当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
  5. 根据权利要求1所述的方法，其中，所述描述参数包括姿态变化参数，所述获取所述移动终端在立体空间中的描述参数包括：
    根据从陀螺仪获取到的传感器参数，分别确定所述移动终端的基准点偏转角度及当前偏转角度；
    根据所述移动终端的基准点偏转角度及当前偏转角度确定所述移动终端的姿态变化参数。
  6. 根据权利要求1所述的方法，所述方法进一步包括：
    接收媒体内容服务器发送的所述智能电视当前展示的全景图像数据，展示所述全景图像。
  7. 根据权利要求6所述的方法，所述方法进一步包括：
    接收媒体内容服务器发送的所述调节参数；
    根据所述调节参数调整所述全景图像。
  8. 根据权利要求6或7所述的方法，所述方法进一步包括：
    接收媒体内容服务器发送的提示信息并展示，所述提示信息用以提醒所述移动终端的用户操作所述移动终端。
  9. 一种全景图像的展示控制方法，应用于媒体内容服务器，其特征在于，包括：
    接收移动终端发送的全景图像触发指令；
    响应于接收到的所述全景图像触发指令，向与所述移动终端绑定的智能电视发送所述全景图像触发指令，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
    接收所述移动终端发送的所述移动终端在立体空间中的描述参数；
    根据所述描述参数确定所述全景图像在全景空间中的调节参数；
    将所述调节参数发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
  10. 根据权利要求9所述的方法，其中，所述描述参数包括位置变化参数和姿态变化参数，所述调节参数包括视角调节参数和视点调节参数；
    其中，所述根据所述描述参数确定所述全景图像在全景空间中的调节参数包括：
    根据所述位置变化参数确定所述全景图像在全景空间中的视点调节参数，根据所述姿态变化参数确定所述全景图像在全景空间中的视角调节参数；
    其中，所述将所述调节参数发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像包括：
    将所述视点调节参数及所述视角调节参数发送给所述智能电视，以使所述智能电视根据所述视点调节参数调整所述全景图像的视点，根据所述视角调节参数调整所述全景图像的视角。
  11. 根据权利要求9所述的方法，其中，进一步包括：
    接收所述移动终端发送的所述移动终端的第一坐标系数据，通过该第一坐标系获取的参数用于表征所述移动终端在立体空间中的位置坐标及姿态角度；
    接收所述智能电视发送的全景空间中的第二坐标系数据，通过该第二坐标系获取的参数用于表征全景图像的视点及视角；
    根据所述第一坐标系数据和所述第二坐标系数据，确定所述第一坐 标系中的描述参数到所述第二坐标系中的调节参数的映射关系；
    其中，所述根据所述描述参数确定所述全景图像在全景空间中的调节参数包括：
    根据所述映射关系和所述描述参数，确定所述调节参数。
  12. 根据权利要求9所述的方法，其中，所述全景图像中包括一目标对象；
    所述方法进一步包括：
    根据所述调节参数及所述目标对象的位置确定提示信息，所述提示信息用于提醒对所述移动终端进行操作；
    将所述提示信息发送给所述移动终端展示。
  13. 一种全景图像的展示控制装置，包括一个或一个以上处理器和一个或一个以上存储器，所述一个或一个以上存储器包括计算机可读指令，经配置由所述一个或者一个以上处理器执行以实现：
    响应于全景图像触发操作，向媒体内容服务器发送全景图像触发指令，以使所述媒体内容服务器将所述全景图像触发指令发送给与所述移动终端绑定的智能电视，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
    响应于对所述移动终端的操作，获取所述移动终端在立体空间中的描述参数，并将其发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述描述参数确定所述全景图像在全景空间中的调节参数，并将其发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
  14. 根据权利要求13所述的装置，其中，所述描述参数包括位置变化参数和姿态变化参数，所述调节参数包括视角调节参数和视点调节参数；所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    响应于对所述移动终端的移动操作，获取所述位置变化参数，响应于对所述移动终端的旋转操作，获取所述姿态变化参数；
    将所述位置变化参数及所述姿态变化参数发送给所述媒体内容服务器，以使所述媒体内容服务器根据所述位置变化参数确定所述全景图像在全景空间中的视点调节参数，根据所述姿态变化参数确定所述全景图像在全景空间中的视角调节参数，并将所述视点调节参数及所述视角调节参数发送给所述智能电视，以使所述智能电视根据所述视点调节参 数调整所述全景图像的视点，根据所述视角调节参数调整所述全景图像的视角。
  15. 根据权利要求13所述的装置，其中，所述描述参数包括位置变化参数，其中，所述立体空间中设置有M个网络接入点，其中M大于等于3；其中，所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    根据所述移动终端在基准点位置处接收到的所述M个网络接入点的M个无线信号强度及当前位置处接收到的所述M个网络接入点的M个无线信号强度分别确定所述基准点位置坐标及所述当前位置坐标；
    根据所述基准点位置坐标及所述当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
  16. 根据权利要求13所述的装置，所述描述参数包括位置变化参数，其中，所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    确定所述移动终端在多个位置点处所接收到的网络接入点的无线信号强度，并将各位置点坐标与对应的无线信号强度关联存储；
    确定移动终端在基准点位置处及当前位置处分别接收到的网络接入点的第一无线信号强度及第二无线信号强度，并分别在存储的无线信号强度中查找与所述第一无线信号强度及第二无线信号强度最接近的无线信号强度，并将查找到的分别与所述第一无线信号强度及第二无线信号强度最接近的无线信号强度相对应的位置点的位置坐标作为基准点位置坐标及当前位置坐标；
    根据所述基准点位置坐标及当前位置坐标确定所述移动终端在立体空间中的位置变化参数。
  17. 根据权利要求13所述的装置，所述描述参数包括姿态变化参数，其中，所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    根据从陀螺仪获取到的传感器参数，分别确定所述移动终端的基准点偏转角度及当前偏转角度；
    根据所述移动终端的基准点偏转角度及当前偏转角度确定所述移动终端的姿态变化参数。
  18. 根据权利要求13所述的装置，其中，所述一个或者一个以上 处理器执行所述计算机可读指令以实现：
    接收媒体内容服务器发送的所述智能电视当前展示的全景图像数据，展示所述全景图像。
  19. 根据权利要求18所述的装置，其中，所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    接收媒体内容服务器发送的所述调节参数；
    根据所述调节参数调整所述全景图像。
  20. 根据权利要求18或19所述的装置，其中，所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    接收媒体内容服务器发送的提示信息并展示，所述提示信息用以提醒所述移动终端的用户操作所述移动终端。
  21. 一种全景图像的展示控制装置，包括一个或一个以上处理器和一个或一个以上存储器，所述一个或一个以上存储器包括计算机可读指令，经配置由所述一个或者一个以上处理器执行以实现：
    接收移动终端发送的全景图像触发指令；
    响应于接收到的所述全景图像触发指令，向与所述移动终端绑定的智能电视发送所述全景图像触发指令，以使所述智能电视展示当前展示的媒体内容相对应的全景图像；
    接收所述移动终端发送的所述移动终端在立体空间中的描述参数；
    根据所述描述参数确定所述全景图像在全景空间中的调节参数；
    将所述调节参数发送给所述智能电视，以使所述智能电视根据所述调节参数调整所述全景图像。
  22. 根据权利要求21所述的装置，其中，所述描述参数包括位置变化参数和姿态变化参数，所述调节参数包括视角调节参数和视点调节参数；所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    根据所述位置变化参数确定所述全景图像在全景空间中的视点调节参数，根据所述姿态变化参数确定所述全景图像在全景空间中的视角调节参数；
    将所述视点调节参数及所述视角调节参数发送给所述智能电视，以使所述智能电视根据所述视点调节参数调整所述全景图像的视点，根据所述视角调节参数调整所述全景图像的视角。
  23. 根据权利要求21所述的装置，其中，所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    接收所述移动终端发送的所述移动终端的第一坐标系数据，通过该第一坐标系获取的参数用于表征所述移动终端在立体空间中的位置坐标及姿态角度；
    接收所述智能电视发送的全景空间中的第二坐标系数据，通过该第二坐标系获取的参数用于表征全景图像的视点及视角；
    根据所述第一坐标系数据和所述第二坐标系数据，确定所述第一坐标系中的描述参数到所述第二坐标系中的调节参数的映射关系；
    其中，所述根据所述描述参数确定所述全景图像在全景空间中的调节参数包括：
    根据所述映射关系和所述描述参数，确定所述调节参数。
  24. 根据权利要求21所述的装置，其中，所述全景图像中包括一目标对象；其中，所述一个或者一个以上处理器执行所述计算机可读指令以实现：
    根据所述调节参数及所述目标对象的位置确定提示信息，所述提示信息用于提醒对所述移动终端进行操作；
    将所述提示信息发送给所述移动终端展示。
  25. 一种非易失性计算机可读存储介质，其中所述存储介质中存储有机器可读指令，所述机器可读指令可以由处理器执行以完成权利要求1-12任一项所述的方法。
PCT/CN2018/080819 2017-03-28 2018-03-28 全景图像的展示控制方法、装置及存储介质 WO2018177314A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP18776100.2A EP3525473A4 (en) 2017-03-28 2018-03-28 METHOD AND DEVICE FOR CONTROLLING A PANORAMIC IMAGE DISPLAY AND STORAGE MEDIUM
JP2019520848A JP6798019B2 (ja) 2017-03-28 2018-03-28 パノラマ画像の表示制御方法、装置及び記憶媒体
KR1020197017921A KR102184586B1 (ko) 2017-03-28 2018-03-28 파노라마 이미지 디스플레이 제어 방법 및 장치 그리고 저장 매체
US16/390,171 US10764626B2 (en) 2017-03-28 2019-04-22 Method and apparatus for presenting and controlling panoramic image, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710191254.X 2017-03-28
CN201710191254.XA CN107659851B (zh) 2017-03-28 2017-03-28 全景图像的展示控制方法及装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/390,171 Continuation US10764626B2 (en) 2017-03-28 2019-04-22 Method and apparatus for presenting and controlling panoramic image, and storage medium

Publications (1)

Publication Number Publication Date
WO2018177314A1 true WO2018177314A1 (zh) 2018-10-04

Family

ID=61127613

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/080819 WO2018177314A1 (zh) 2017-03-28 2018-03-28 全景图像的展示控制方法、装置及存储介质

Country Status (6)

Country Link
US (1) US10764626B2 (zh)
EP (1) EP3525473A4 (zh)
JP (1) JP6798019B2 (zh)
KR (1) KR102184586B1 (zh)
CN (1) CN107659851B (zh)
WO (1) WO2018177314A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111369684A (zh) * 2019-12-10 2020-07-03 杭州海康威视系统技术有限公司 目标跟踪方法、装置、设备及存储介质
CN113297984A (zh) * 2021-05-27 2021-08-24 北京皮尔布莱尼软件有限公司 虚拟现实展馆内展品的展示方法及计算设备

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106570100B (zh) * 2016-10-31 2019-02-26 腾讯科技（深圳）有限公司 信息搜索方法和装置
CN107659851B (zh) 2017-03-28 2019-09-17 腾讯科技（北京）有限公司 全景图像的展示控制方法及装置
WO2019194434A1 (ko) * 2018-04-05 2019-10-10 엘지전자 주식회사 복수의 뷰포인트들에 대한 메타데이터를 송수신하는 방법 및 장치
JP6368881B1 (ja) * 2018-04-09 2018-08-01 チームラボ株式会社 表示制御システム，端末装置，コンピュータプログラム，及び表示制御方法
CN109451139B (zh) * 2018-09-13 2020-11-20 腾讯科技（深圳）有限公司 消息传输方法、终端、装置、电子设备及可读介质
CN111198610B (zh) * 2018-11-16 2021-08-10 北京字节跳动网络技术有限公司 一种全景视频的视场控制方法、装置、设备及存储介质
US10972789B2 (en) * 2019-06-03 2021-04-06 At&T Intellectual Property I, L.P. Methods, systems, and devices for providing service differentiation for different types of frames for video content
CN117635815A (zh) * 2019-06-28 2024-03-01 上海交通大学 基于三维点云的初始视角控制和呈现方法及系统
CN112423108B (zh) * 2019-08-20 2023-06-30 中兴通讯股份有限公司 码流的处理方法、装置、第一终端、第二终端及存储介质
CN110446116B (zh) * 2019-09-05 2021-11-02 青岛一舍科技有限公司 全景视频播放装置和方法
CN111126975A (zh) * 2019-12-11 2020-05-08 中国建设银行股份有限公司 电子红包的处理方法、装置、电子设备及可读存储介质
CN111161144B (zh) * 2019-12-18 2021-07-20 北京城市网邻信息技术有限公司 全景图获取方法、全景图获取装置及存储介质
CN112312227B (zh) * 2020-06-15 2022-09-16 青岛一舍科技有限公司 一种全景交互方法和装置
CN111913645B (zh) * 2020-08-17 2022-04-19 广东申义实业投资有限公司 三维图像展示的方法、装置、电子设备及存储介质
CN112203127A (zh) * 2020-10-12 2021-01-08 广州欢网科技有限责任公司 基于移动终端和智能电视的vr视频交互方法、装置及系统
CN115442644A (zh) * 2021-10-29 2022-12-06 佛山欧神诺云商科技有限公司 一种全景图像的展示角度操控方法、设备、介质及产品
CN114040119A (zh) * 2021-12-27 2022-02-11 未来电视有限公司 全景视频显示方法、装置和计算机设备
CN114691068A (zh) * 2022-03-23 2022-07-01 北京优酷科技有限公司 基于投屏技术的信息显示方法及装置
CN115393380B (zh) * 2022-08-01 2023-07-04 北京城市网邻信息技术有限公司 车内全景图像显示方法、装置、电子设备及存储介质
CN116634207A (zh) * 2022-08-22 2023-08-22 烽火通信科技股份有限公司 一种基于iptv业务的vr全景视频播放方法和系统
CN115512046B (zh) * 2022-09-26 2023-11-03 如你所视(北京)科技有限公司 模型外点位的全景图展示方法和装置、设备、介质
CN117421829A (zh) * 2023-11-21 2024-01-19 深圳市蓝鲸智联科技股份有限公司 一种基于汽车360度全景标定设计方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103051964A (zh) * 2011-10-14 2013-04-17 中国科学院计算技术研究所 基于定位遥控器的智能电视人机交互方法、装置和系统
US20140327666A1 (en) * 2013-05-02 2014-11-06 Nintendo Co., Ltd. Display control system, display control apparatus, storage medium having stored therein display control program, and display control method
CN105898460A (zh) * 2015-12-10 2016-08-24 乐视网信息技术（北京）股份有限公司 调整智能电视的全景视频播放视角的方法和装置
CN106028132A (zh) * 2016-06-30 2016-10-12 四川长虹电器股份有限公司 通过智能移动终端在电视上观看全景视频的系统及方法
CN106296819A (zh) * 2016-08-12 2017-01-04 北京航空航天大学 一种基于智能机顶盒的全景视频播放器
CN107659851A (zh) * 2017-03-28 2018-02-02 腾讯科技（北京）有限公司 全景图像的展示控制方法及装置

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5940785B2 (ja) * 2011-09-14 2016-06-29 株式会社バンダイナムコエンターテインメント プログラムおよびゲーム装置
JP5892797B2 (ja) * 2012-01-20 2016-03-23 日本放送協会 送受信システム及び送受信方法、受信装置及び受信方法
JP6006536B2 (ja) * 2012-06-01 2016-10-12 任天堂株式会社 情報処理プログラム、情報処理装置、情報処理システム、およびパノラマ動画表示方法
JP6181993B2 (ja) * 2012-12-04 2017-08-16 任天堂株式会社 情報処理システム、情報処理装置、情報処理プログラム、および、情報の送受信方法
JP6450064B2 (ja) * 2013-03-18 2019-01-09 任天堂株式会社 情報処理装置、動画データのデータ構造、情報処理システム、動画再生プログラム、および、動画の再生方法。
KR102223732B1 (ko) * 2014-06-26 2021-03-05 엘지전자 주식회사 이동단말기 및 그 제어방법
WO2016003165A1 (ko) * 2014-07-01 2016-01-07 엘지전자 주식회사 외부 장치를 이용한 방송 데이터 처리 방법 및 장치
US20160094866A1 (en) * 2014-09-29 2016-03-31 Amazon Technologies, Inc. User interaction analysis module
KR101909254B1 (ko) * 2015-07-08 2018-10-17 주식회사 케이티 셋톱 박스에서 고화질 파노라마를 제공하는 방법, 디바이스 및 시스템
CN105979242A (zh) * 2015-11-23 2016-09-28 乐视网信息技术（北京）股份有限公司 一种视频的播放方法和装置
CN105913478A (zh) * 2015-12-28 2016-08-31 乐视致新电子科技（天津）有限公司 360度全景显示方法、显示模块及移动终端
CN105847850A (zh) * 2016-03-28 2016-08-10 乐视控股（北京）有限公司 全景视频的实时播放方法及装置
EP3518521B1 (en) * 2016-10-18 2024-04-24 Honor Device Co., Ltd. Method for realizing effect of photo being taken by others through selfie, and photographing device
US10021464B2 (en) * 2016-10-25 2018-07-10 Aether, Inc. Video content switching and synchronization system and method for switching between multiple video formats
CN106454450B (zh) * 2016-10-31 2019-07-12 努比亚技术有限公司 全景视频播放装置及方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103051964A (zh) * 2011-10-14 2013-04-17 中国科学院计算技术研究所 基于定位遥控器的智能电视人机交互方法、装置和系统
US20140327666A1 (en) * 2013-05-02 2014-11-06 Nintendo Co., Ltd. Display control system, display control apparatus, storage medium having stored therein display control program, and display control method
CN105898460A (zh) * 2015-12-10 2016-08-24 乐视网信息技术（北京）股份有限公司 调整智能电视的全景视频播放视角的方法和装置
CN106028132A (zh) * 2016-06-30 2016-10-12 四川长虹电器股份有限公司 通过智能移动终端在电视上观看全景视频的系统及方法
CN106296819A (zh) * 2016-08-12 2017-01-04 北京航空航天大学 一种基于智能机顶盒的全景视频播放器
CN107659851A (zh) * 2017-03-28 2018-02-02 腾讯科技（北京）有限公司 全景图像的展示控制方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3525473A4

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111369684A (zh) * 2019-12-10 2020-07-03 杭州海康威视系统技术有限公司 目标跟踪方法、装置、设备及存储介质
CN111369684B (zh) * 2019-12-10 2023-09-01 杭州海康威视系统技术有限公司 目标跟踪方法、装置、设备及存储介质
CN113297984A (zh) * 2021-05-27 2021-08-24 北京皮尔布莱尼软件有限公司 虚拟现实展馆内展品的展示方法及计算设备
CN113297984B (zh) * 2021-05-27 2024-02-27 北京皮尔布莱尼软件有限公司 虚拟现实展馆内展品的展示方法及计算设备

Also Published As

Publication number Publication date
EP3525473A1 (en) 2019-08-14
CN107659851A (zh) 2018-02-02
US10764626B2 (en) 2020-09-01
JP2019533372A (ja) 2019-11-14
US20190246162A1 (en) 2019-08-08
KR20190087530A (ko) 2019-07-24
CN107659851B (zh) 2019-09-17
JP6798019B2 (ja) 2020-12-09
KR102184586B1 (ko) 2020-11-30
EP3525473A4 (en) 2019-12-18

Similar Documents

Publication Publication Date Title
WO2018177314A1 (zh) 全景图像的展示控制方法、装置及存储介质
US10979751B2 (en) Communication management apparatus, method and computer-readable storage medium for generating image data identification information communication
US11558431B2 (en) Communication terminal, communication system, communication method, and display method
US10721116B2 (en) Communication terminal, method for controlling display of image, and non-transitory computer-readable storage medium
JP7344974B2 (ja) マルチ仮想キャラクターの制御方法、装置、およびコンピュータプログラム
US10554883B2 (en) VR system, communication method, and non-transitory computer-readable medium
CN108932051B (zh) 增强现实图像处理方法、装置及存储介质
JP6348741B2 (ja) 情報処理システム、情報処理装置、情報処理プログラム、および情報処理方法
JP2017212510A (ja) 画像管理装置、プログラム、画像管理システム及び情報端末
CN107851069B (zh) 图像管理系统、图像管理方法及程序
JP2016194783A (ja) 画像管理システム、通信端末、通信システム、画像管理方法、及びプログラム
JP2016194784A (ja) 画像管理システム、通信端末、通信システム、画像管理方法、及びプログラム
JP6617547B2 (ja) 画像管理システム、画像管理方法、プログラム
CN114089836B (zh) 标注方法、终端、服务器和存储介质
JP6711118B2 (ja) 画像管理システム、プログラム及び情報端末
CN115686233A (zh) 一种主动笔与显示设备的交互方法、装置及交互系统
US20240087157A1 (en) Image processing method, recording medium, image processing apparatus, and image processing system
JP2014174643A (ja) 画像処理システム、その制御方法、画像処理装置、及び画像処理方法
US20240214513A1 (en) Method and apparatus for controlling a plurality of virtual characters, device, and storage medium
TWI700588B (zh) 顯示控制系統、終端裝置、電腦程式、控制裝置、以及顯示控制方法
JP2018151793A (ja) プログラム、情報処理装置
JP2003187268A (ja) 画像処理装置
JP2016194782A (ja) 画像管理システム、通信端末、通信システム、画像管理方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18776100

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019520848

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2018776100

Country of ref document: EP

Effective date: 20190507

ENP Entry into the national phase

Ref document number: 20197017921

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE