WO2016045381A1 - 呈现图像的方法、终端设备和服务器 - Google Patents

呈现图像的方法、终端设备和服务器 Download PDF

Info

Publication number
WO2016045381A1
WO2016045381A1 PCT/CN2015/077678 CN2015077678W WO2016045381A1 WO 2016045381 A1 WO2016045381 A1 WO 2016045381A1 CN 2015077678 W CN2015077678 W CN 2015077678W WO 2016045381 A1 WO2016045381 A1 WO 2016045381A1
Authority
WO
WIPO (PCT)
Prior art keywords
panorama
panoramic video
degree panoramic
degree
strip
Prior art date
Application number
PCT/CN2015/077678
Other languages
English (en)
French (fr)
Inventor
邸佩云
刘欣
艾常权
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2016045381A1 publication Critical patent/WO2016045381A1/zh
Priority to US15/467,486 priority Critical patent/US10462518B2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25841Management of client data involving the geographical location of the client
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661Transmitting camera control signals through networks, e.g. control via the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal

Definitions

  • the present invention relates to the field of information technology, and in particular, to a method, a terminal device, and a server for presenting an image.
  • the 360 degree panoramic camera can capture 360 degree panoramic video. Users can watch a 360-degree view around a point by watching a 360-degree panoramic video, or watch a street-side view of a street by watching the street side view. However, the user cannot switch to the street side view on the street side while watching the 360 degree panoramic video, or switch to the 360 degree panoramic video when viewing a certain spot of interest on the street side view.
  • Embodiments of the present invention provide a method for presenting an image, which can be freely switched between a 360-degree panorama and a striped panorama, so that the viewing experience of the user can be enriched.
  • a method for presenting an image comprising: when receiving a switching indication that a first object being displayed is switched to a second object, acquiring identification information of the first object, wherein the first object and One of the second objects is a first 360 degree panorama, and the other of the first object and the second object is a first strip panorama, and the first strip panorama includes a plurality of sub fronts for displaying the first area
  • the i-th sub-frontal image in the multi-sub-frontal image corresponds to a frontal image for displaying the i-th sub-area in the first region in the j-th 360-degree panorama in the plurality of 360-degree panoramic images
  • the first 360 The degree panorama is one of a plurality of 360 degree panoramas, and i and j are positive integers; according to the identification information of the first object, the second object corresponding to the identification information of the first object is obtained, wherein the identification information of the first object is The identification information of the two objects has a corresponding relationship;
  • the method further includes: determining an identifier of the second object corresponding to the identifier information of the first object Sending the first request information to the server, for requesting the second object, the first request information includes the identifier information of the second object, where the second object corresponding to the identifier information of the first object is obtained, including: sending by the receiving server The second object.
  • the method further includes: sending second request information to the server, for requesting the second object, where the second request information includes The identification information of the first object, so that the server determines the identification information of the second object according to the identification information of the first object, and determines the second object according to the identification information of the second object, where the second information corresponding to the identification information of the first object is obtained.
  • the object includes: receiving a second object sent by the server.
  • the acquiring the second object corresponding to the identifier information of the first object according to the identifier information of the first object includes: determining the second object corresponding to the identifier information of the first object The identification information; obtaining the second object according to the identification information of the second object.
  • multiple 360-degree panoramic images are multiple 360-degree panoramic video frames in 360 panoramic video, and 360-degree panoramic video is taken with a 360-degree panoramic camera edge.
  • the method further includes: acquiring a 360-degree panoramic video, in the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames And including a front image for displaying the i-th sub-area in the first area; and extracting a front image for displaying the i-th sub-area in the first area from the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames Forming a front image for displaying a plurality of sub-regions in the first region, which is intercepted from the plurality of 360-degree panoramic video frames, into a first strip panorama; establishing identification information of the first strip panorama and a plurality of 360 The correspondence between the identification information of the
  • the i th sub-area in the first area is intercepted from the j-th 360-degree panoramic video frame of the multiple 360-degree panoramic video frames.
  • the front image includes: determining a first direction along the i-th sub-area in the first area when capturing the j-th 360-degree panoramic video frame in the 360-degree panoramic video; determining a second direction that is 90 degrees from the first direction And capturing, from the j-th 360-degree panoramic video frame of the 360-degree panoramic video, a front image captured in the second direction for displaying the i-th sub-region in the first region.
  • the first object is a first 360 degree panorama
  • the second object For the first strip with a panorama, switch to the first 360 degree panorama that will be displayed
  • the method further includes: obtaining a display resolution of the device for presenting the first stripe panorama; and acquiring, according to the identifier information of the first object, the second corresponding to the identifier information of the first object
  • the object includes: obtaining, according to the identification information of the first 360-degree panoramic image and the display resolution, a continuous plurality of strip panoramas including the first strip panorama, and the plurality of strip panoramas constitute the first region A second strip panorama of the two regions, wherein presenting the second object comprises: presenting a plurality of strip panoramas into a second strip panorama according to the identification information of the plurality of strip panoramas.
  • the identification information of the first object and the identification information of the second object are The time information or geographical location information when the first 360 degree panorama is taken is indicated.
  • a second aspect provides a method for presenting an image, the method comprising: receiving request information for requesting a second object sent by a terminal device, where the request information includes identification information of the first object, where the first object and the second object One of the first 360 degree panoramas, the other of the first object and the second object is a first strip panorama, and the first strip panorama includes a plurality of sub-front images for displaying the first area,
  • the i-th front image in the front image of the web corresponds to a front image for displaying the i-th sub-area in the first region in the j-th 360-degree panorama in the plurality of 360-degree panoramas, the first 360-degree panorama
  • i and j are positive integers
  • determining second according to the identification information of the second object Object sending a second object to the terminal device, so that the terminal device presents the second object.
  • the multiple 360-degree panoramic image is a plurality of 360-degree panoramic video frames in the 360 panoramic video
  • the 360-degree panoramic video is a 360-degree panoramic camera edge
  • the method further includes: acquiring a 360-degree panoramic video, multiple 360 degrees.
  • the j-th 360-degree panoramic video frame in the panoramic video frame includes a front image for displaying the i-th sub-region in the first region; and the first region is intercepted from the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames a frontal image of the i-th sub-region within; a frontal image for displaying a plurality of sub-regions within the first region, taken from a plurality of 360-degree panoramic video frames, to form a first strip panorama; establishing a first strip panorama Correspondence between the identification information of the figure and the identification information of the first 360-degree panoramic video frame in the plurality of 360-degree panoramic video frames.
  • the front image of the i-th sub-region in the first region is intercepted from the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames, including: determining to capture the j-th 360-degree panoramic video in the 360-degree panoramic video. a first direction along the i-th sub-region in the first region; determining a second direction at an angle of 90 degrees with the first direction; intercepting the j-th 360-degree panoramic video frame from the 360-degree panoramic video A frontal image taken in the two directions for displaying the i-th sub-area in the first area.
  • the first object is a first 360 degree panorama
  • the second object is The first one has a panorama
  • the request information further includes a display resolution of the terminal device.
  • the method further includes: determining, according to the display resolution, the inclusion a first plurality of strip panoramas with panoramic views, the plurality of strip panoramas forming a second strip panorama of the second area in which the first area is located, wherein the second object is sent to the terminal device, including Sending a plurality of strip panoramas to the terminal device, so that the terminal device presents a second strip panorama into which the plurality of strip panoramas are stitched.
  • the identifier information of the first object is represented by time information or geographic location information when the first 360 degree panorama is taken.
  • a third aspect provides a terminal device, including: an obtaining module, configured to acquire, when receiving a switching indication that a first object being displayed is switched to a second object, the first object And one of the second objects is a first 360 degree panorama, and the other of the first object and the second object is a first strip panorama, and the first strip panorama includes a plurality of pieces for displaying the first area
  • the front image, the i-th front image in the plurality of sub-front images corresponds to a front image for displaying the i-th sub-area in the first region in the j-th 360-degree panorama in the plurality of 360-degree panoramas, first
  • the 360 degree panorama is one of a plurality of 360 degree panoramas, and i and j are positive integers
  • the obtaining module is further configured to acquire, according to the identification information of the first object, a second object corresponding to the identification information of the first object, where the The identification information of an object has a corresponding relationship with the identification information of the second object
  • the display module is
  • the terminal device further includes: a first determining module, configured to determine, after the acquiring module acquires the identifier information of the first object, the identifier of the first object
  • the first sending module is configured to send the first request information to the server, where the first request information is used to request the second object, where the first request information includes the second object
  • the identification information is specifically configured to receive the second object sent by the server.
  • the method further includes: a second sending module, configured to send the second request information to the server after the acquiring module acquires the identifier information of the first object, The requesting the second object, the second request information includes the identification information of the first object, so that the server determines the identification information of the second object according to the identification information of the first object, and determines the second object according to the identification information of the second object, where The obtaining module is specifically configured to receive the second object sent by the server.
  • a second sending module configured to send the second request information to the server after the acquiring module acquires the identifier information of the first object, The requesting the second object, the second request information includes the identification information of the first object, so that the server determines the identification information of the second object according to the identification information of the first object, and determines the second object according to the identification information of the second object, where The obtaining module is specifically configured to receive the second object sent by the server.
  • the method further includes: a second determining module, configured to determine identifier information of the second object corresponding to the identifier information of the first object, where the acquiring module is specific And acquiring, according to the identification information of the second object, the second object.
  • the multiple 360-degree panoramic image is a plurality of 360-degree panoramic video frames in the 360 panoramic video, and the 360-degree panoramic view The video is captured by the 360-degree panoramic camera along the extending direction of the road in which the first area is located.
  • the acquiring module is further configured to acquire a 360-degree panoramic video and multiple 360-degree panoramic video frames before acquiring the identification information of the first object.
  • the j-th 360-degree panoramic video frame includes a front image for displaying the i-th sub-area in the first area; the terminal device further includes: an intercepting module, configured to obtain the j-th 360-degree panoramic view from the plurality of 360-degree panoramic video frames A front image for displaying an i-th sub-area in the first area is captured in the video frame; a splicing module for displaying a front side of the plurality of sub-areas in the first area that is to be intercepted from the plurality of 360-degree panoramic video frames The image is spliced into a first strip panorama; the relationship module is configured to establish a correspondence between the identifier information of the first strip panorama and the identifier information of the first 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames Department.
  • the second determining module is further configured to: when determining to capture the j-th 360-degree panoramic video frame in the 360-degree panoramic video a first direction along the i-th sub-area in the first area; determining a second direction at an angle of 90 degrees with the first direction, the intercepting module is specifically configured to use the j-th 360-degree panoramic video frame from the 360-degree panoramic video The front image captured in the second direction determined by the second determining module for displaying the i-th sub-area in the first region is intercepted.
  • the first object is the first a 360-degree panoramic view
  • the second object is a first strip panorama
  • the obtaining module is further configured to: after receiving the switching instruction that switches the first 360-degree panorama being displayed to the first strip panorama Taking the display resolution of the device for presenting the first strip panorama, the acquiring module is specifically configured to acquire the continuous multiple of the first strip panorama according to the identification information and the display resolution of the first 360-degree panorama a strip panorama, the plurality of strip panoramas form a second strip panorama of the second area where the first area is located, and the display module is specifically configured to present a plurality of strips according to the identification information of the plurality of strip panoramas A second panorama with a panorama stitched together.
  • the identifier information of the first object is represented by time information or geographic location information when the first 360 degree panorama is taken.
  • a server includes: a receiving module, configured to receive request information for requesting a second object, where the request information includes identifier information of the first object, where the first object and the first object One of the two objects is a first 360 degree panorama, and the other of the first object and the second object is a first strip panorama, and the first strip panorama includes a plurality of sub front images for displaying the first area
  • the i-th front image in the plurality of sub-front images corresponds to a front image for displaying the i-th sub-area in the first region in the j-th 360-degree panorama in the plurality of 360-degree panoramas, the first 360 degrees
  • the panorama is one of a plurality of 360 panoramas, and i and j are positive integers
  • the determining module is configured to determine identification information of the second object corresponding to the identification information of the first object according to the identification information of the first object, and the determining module further And determining, by the second object, the second object, and the sending module, configured
  • the multiple 360-degree panoramic image is a plurality of 360-degree panoramic video frames in the 360 panoramic video
  • the 360-degree panoramic video is a 360-degree panoramic camera edge
  • the server further includes: an obtaining module, configured to acquire a 360-degree panoramic video and multiple 360-degree panoramic images before the determining module determines the second object corresponding to the identification information of the first object.
  • the j-th 360-degree panoramic video frame in the video frame includes a front image for displaying the i-th sub-region in the first region; and an intercepting module for using the j-th 360-degree panoramic video frame from the plurality of 360-degree panoramic video frames Intercepting a front image of the i-th sub-area in the first area; a splicing module, configured to splicing the front image of the plurality of sub-areas in the first area that is intercepted from the plurality of 360-degree panoramic video frames into the first And a relationship module, configured to establish a correspondence between the identification information of the first stripe panorama and the identifier information of the first 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames.
  • the determining module is further configured to: determine a first direction along the i-th sub-area in the first area when capturing the j-th 360-degree panoramic video frame in the 360-degree panoramic video; and determine that the angle with the first direction is 90
  • the second direction of the degree is that the intercepting module is specifically configured to intercept, from the j-th 360-degree panoramic video frame of the 360-degree panoramic video, a front image captured in the second direction for displaying the i-th sub-region in the first region.
  • the first object is a first 360 degree panoramic image
  • the second object is The first one has a panoramic view
  • the request information further includes a display resolution of the terminal device
  • the determining module is further configured to: after the determining module determines the first stripe panorama corresponding to the identifier information of the first strip panorama, according to the display resolution Rate, determining a plurality of consecutive strip panoramas including the first strip panorama, the plurality of strip panoramas forming a second strip panorama of the second area where the first area is located, and the sending module is specifically used for
  • the terminal device transmits a plurality of strip panoramas, so that the terminal device presents a second strip panorama into which the plurality of strip panoramas are stitched.
  • the identifier information of the first object and the second object is represented by time information or geographical location information when the first 360 degree panorama is taken.
  • the 360-degree panorama and the strip panorama can be freely switched, thereby enriching the user's viewing experience. .
  • FIG. 1 is a schematic flow chart of a method of presenting an image in accordance with one embodiment of the present invention.
  • FIG. 2 is a schematic flow chart of a method of presenting an image according to another embodiment of the present invention.
  • 3A and 3B are schematic diagrams of scenes for capturing a 360-degree panoramic view, in accordance with an embodiment of the present invention.
  • FIG. 4 is a schematic flow chart of a method of presenting an image according to another embodiment of the present invention.
  • FIG. 5 is a schematic flowchart of a method of presenting an image according to another embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of a method of presenting an image according to another embodiment of the present invention.
  • FIG. 7 is a schematic flowchart of a method of presenting an image according to another embodiment of the present invention.
  • FIG. 8 is a schematic block diagram of a terminal device according to an embodiment of the present invention.
  • FIG. 9 is a schematic block diagram of a terminal device according to another embodiment of the present invention.
  • FIG. 10 is a schematic block diagram of a terminal device according to another embodiment of the present invention.
  • FIG. 11 is a schematic block diagram of a terminal device according to another embodiment of the present invention.
  • Figure 12 is a schematic block diagram of a server in accordance with one embodiment of the present invention.
  • Figure 13 is a schematic block diagram of a server in accordance with another embodiment of the present invention.
  • FIG. 14 is a schematic block diagram of a terminal device according to another embodiment of the present invention.
  • FIG. 15 is a schematic block diagram of a terminal device according to another embodiment of the present invention.
  • 16 is a schematic block diagram of a server in accordance with another embodiment of the present invention.
  • a 360-degree panorama refers to a 360-degree image around the viewpoint that is obtained around a fixed viewpoint.
  • a strip panorama refers to a wide-view image obtained by splicing a narrow-angle image in which a plurality of viewpoints are continuously captured.
  • FIG. 1 shows a schematic flow diagram of a method 100 of presenting an image in accordance with an embodiment of the present invention.
  • Method 100 can be performed by a terminal device. As shown in FIG. 1, method 100 includes the following.
  • the identifier information of the first object when receiving a handover indication that the first object being displayed is switched to the second object, the identifier information of the first object, where one of the first object and the second object is a first 360-degree panorama, first The other of the object and the second object is a first strip panorama, the first strip panorama includes a plurality of sub-front images for displaying the first region, and the i-th front image corresponding to the plurality of sub-front images corresponds to For displaying a front image of the i-th sub-area in the first area in the j-th 360-degree panorama in the plurality of 360-degree panoramas, the first 360-degree panoramic view is one of the plurality of 360-degree panoramic images, i And j is a positive integer.
  • the first strip panorama may be a panoramic image on one side of the road, in which case the first strip panorama may be referred to as a street side panorama.
  • the strip panorama can be a continuous acquisition of multiple planar image correction spells Alternatively, it may be obtained by splicing a narrow-band image region for displaying a street side region, which is captured from a plurality of 360-degree panoramic images continuously acquired by a 360-degree panoramic camera.
  • i and j may be the same.
  • the plurality of 360-degree panoramic images are in one-to-one correspondence with the plurality of sub-regions in the first region, that is, the plurality of 360-degree panoramic images respectively correspond to different geographical locations.
  • the third 360 degree panorama corresponds to the second sub-area in the first area
  • the first and second 360 degree panoramas correspond to the first sub-area in the first area, which is due to shooting
  • the 360-degree panoramic camera stops moving continuously to capture more than one 360-degree panorama in the same area (such as the first sub-area), or the 360-degree panoramic camera continues to repeat the road when the original path returns during the shooting (eg The first sub-area was taken, resulting in more than one 360 panorama corresponding to the same geographic location.
  • the identification information of the first object and the identification information of the second object can indicate a correspondence between the first object and the second object. They may be stored in respective description files, and the description file of the first object and the description file of the second object may further include respective description information, such as time information when the image is captured, width information of the image, and orientation of the image. Information, etc.
  • the identification information of the first object and the identification information of the second object may also be described in the same file, and the correspondence between them is represented by time or geographical location information in the file, or may be directly in the file. The correspondence between the identification information of the object and the identification information of the second object is described.
  • the method for presenting an image according to an embodiment of the present invention can freely switch between a 360 degree panorama and a strip panorama according to a correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama. Enrich the user's viewing experience.
  • the identification information of the first object and the identification information of the second object may be represented by time information or geographic location information when the first 360 degree panorama is captured.
  • the strip panorama and the 360-degree panorama may be identified by time information recorded in the description file of the 360-degree panorama, or the strip panorama and the 360-degree panorama may adopt a 360-degree panorama.
  • the geographical location information recorded in the description file is identified.
  • the 360-degree panoramic image is a 360-degree panoramic video frame in a 360-degree panoramic video
  • the striped panoramic image may be directly identified by using time information of the corresponding 360-degree panoramic video frame.
  • identification information of the first object and the identification information of the second object may also be represented by the sequence numbers of the first object and the second object.
  • the stripe panorama and the 360-degree panorama may also be identified by a serial number.
  • the stripe panorama and the 360-degree panorama may be respectively identified by using file numbers having corresponding relationships.
  • the method may include: determining identifier information of the second object corresponding to the identifier information of the first object; and acquiring the second object according to the identifier information of the second object.
  • the strip panorama, the 360 degree panorama, and their identification information are all stored on the terminal device. At this time, the switching process between the street side view and the 360 degree panoramic video may be performed by each application or each module local to the terminal device.
  • the multiple 360 degree panorama is a plurality of 360 degree panoramic video frames in the 360 panoramic video
  • the 360 degree panoramic video is an extension of the road along the first area using the 360 degree panoramic camera.
  • the method 100 may further include: acquiring a 360-degree panoramic video, wherein the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames includes a front image for displaying the i-th sub-area in the first region; Obtaining a frontal image for displaying an i-th sub-region within the first region in the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames; and displaying the first from the plurality of 360-degree panoramic video frames
  • the front image of the plurality of sub-areas in the area constitutes a first strip panorama; the correspondence between the identification information of the first strip panorama and the identification information of the first 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames is established relationship.
  • the strip panorama is generated by splicing partial image regions intercepted from a plurality of consecutive frames in the 360-degree panoramic video, each image region in the strip panorama (corresponding to the sub-110)
  • the front image corresponds to a plurality of consecutive frames in the 360-degree panoramic video
  • the time information or the geographical location information of each image region in the striped panorama may be time information or geographic location information corresponding to the 360-degree panoramic video frame.
  • the time information may be the acquisition time of the 360 degree panoramic video frame, such as the relative time or absolute time of the acquisition.
  • the geographic location information may be geographic location information of a plurality of 360 degree panoramic video frames. It should be noted that due to the difference in the accuracy of the geographic location information and the sampling accuracy of the video frame, there may be multiple video frames corresponding to the same geographic location information.
  • the first strip panorama may be identified by the geographic location of the corresponding 360-degree panoramic video frame, or may be used.
  • the serial number of the corresponding 360-degree panoramic video frame is identified, or may be identified by time interval information of multiple consecutive frames in the corresponding 360-degree panoramic video, or the corresponding 360-degree panoramic video frame is used in the 360-degree panoramic video stream.
  • the location or indication is identified.
  • the first strip with a panorama can be identified by time. If the acquisition time interval of the 360-degree panoramic frame corresponding to the first strip panorama is [t 1 , t 2 ], the time stamp of the first strip panorama may be t 1 can also be two attributes of t 1 and time interval, and can also be start time t 1 and end time t 2 .
  • the first strip with a panorama may also be identified by a geographic location. For example, the first geographic location of the 360-degree panoramic frame corresponding to the panorama is P 1 , and the identification information of the first panoramic image may be P 1 or Used to indicate other descriptions of P 1 .
  • the first one with a panorama can also be identified by a serial number, such as 1, 2, 3...
  • 360 degree panorama corresponding to the first strip panorama Video frames are also identified by corresponding serial numbers.
  • the first strip panorama can also be identified by the position or indication information of the corresponding 360-degree panoramic video frame in the 360 panoramic video stream, and the description of the corresponding identifier is added in the description file, and the first strip panorama is given.
  • the information of the corresponding 360 panoramic video frame for example, the position of the corresponding 360-degree panoramic video frame in the 360-degree panoramic video stream is indicated by a sequence number or a byte range, and the first strip panorama may be correspondingly used.
  • the serial number or size position of the 360 panoramic video frame is identified.
  • the identification information of the strip panorama and the identification information of the 360 panoramic video may be described in the same file, so that the stripe panorama and the 360-degree panoramic video segment having the corresponding relationship have the same or corresponding identifiers.
  • the information for example, the sequence number of the first strip panorama and the sequence number of the first 360-degree panoramic video segment are the same, then the first strip panorama and the first 360-degree panoramic video segment may be defaulted in time or geographic location. The upper is the same, enabling free switching between the strip panorama and the 360 degree panoramic video segment according to the correspondence.
  • the embodiment of the present invention utilizes the generated stripe panorama of the 360-degree panoramic video, and can establish the correspondence between the stripe panorama and the 360-degree panoramic video frame by using the time characteristic of the 360-degree panoramic video, so that the user can freely according to personal interests. Switch between strip panoramas and 360-degree panoramas to enhance the user experience.
  • the first area may be any area on the road side, and the road side may include a plurality of first areas.
  • the process of generating a stripe panorama by using a 360-degree panoramic video for displaying the strips of other first areas on the road side is described by taking only the first stripe panorama for displaying the first area as an example.
  • the panorama can be obtained by the above method, and will not be described here.
  • the entire strip panorama for displaying the road side in the embodiment of the present invention may include a plurality of first strip panoramas by dividing the entire strip panorama for displaying the road side into the road side for displaying Multiple first panoramas of multiple first areas and will be taken along the entire road
  • the 360-degree panoramic video is divided into a plurality of 360-degree panoramic video segments corresponding to the plurality of first regions, and can be directly switched to a stripe panorama or a 360-degree panoramic video segment corresponding to the region that the user wants to view, without switching To the entire strip panorama or the entire 360-degree panoramic video. This saves lookup overhead and reduces response time.
  • the video since the video will generate random access points during the encoding process, the video can only start playing at the random access point, so that the video cannot be segmented arbitrarily, and must be divided at the random access point, so the whole strip is
  • the panorama is divided into multiple first-band panoramas, it can be divided according to the 360-degree panoramic video segmentation.
  • the time information of the first stripe panorama may be time information of the corresponding 360 degree panoramic video segment.
  • the partition when the entire strip panorama on the road side is divided into multiple first strip panoramas, the partition may be divided according to preset time information or width information, so that each first strip panorama is The time period corresponding to the figure satisfies the preset time period requirement, or the width corresponding to each first strip panorama satisfies the preset width requirement.
  • extracting a front image for displaying an ith sub-region in the first region from the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames may include: determining shooting 360 The first direction of the i-th sub-area in the first area in the j-th 360-degree panoramic video frame in the panoramic video; the second direction in which the angle with the first direction is 90 degrees is determined; from the 360-degree panoramic video The front image of the i-th sub-area in the first area captured in the second direction is intercepted in the 360-degree panoramic video frame. At this time, a front image for displaying a designated area on one side of the road is taken from the 360-degree panoramic video frame.
  • the front image for displaying the street side area is photographed in a direction perpendicular to the moving direction of the 360 panoramic camera.
  • the motion direction of the 360 panoramic camera can be acquired, and the third direction with an angle of 90 degrees with the motion direction of the 360 panoramic camera is determined, and the third party is intercepted from the j-th 360-degree panoramic video frame in the 360-degree panoramic video.
  • the method 100 may further include: determining identifier information of the second object corresponding to the identifier information of the first object; and sending the first request information to the server. And for requesting the second object, the first request information includes the identification information of the second object.
  • the second object sent by the server is received at 120.
  • the second object is stored in the server, and after determining the identifier information of the second object to be switched, the terminal device requests the second object corresponding to the identifier information of the second object.
  • the method 100 may further include: sending second request information to the server, for requesting the second object, where the second request information includes the first The identification information of the object, so that the server determines the identification information of the second object according to the identification information of the first object, and determines the second object according to the identification information of the second object.
  • the second object sent by the server is received at 120.
  • the second object identifier information and the second object are stored in the server, and after receiving the handover indication, the terminal device needs to request the second object corresponding to the identifier information of the first object from the server.
  • the first object is a first 360 degree panorama
  • the second object is a first strip panorama
  • the first 360 degree panorama to be displayed is switched to the first strip.
  • the method 100 may further include: acquiring a display resolution of the device for presenting the image; acquiring the second object corresponding to the identification information of the first object according to the identification information of the first object, including: The identification information and the display resolution of the first 360-degree panoramic image are obtained, and a plurality of consecutive strip panoramas including the first strip panorama are acquired, and the plurality of strip panoramas constitute the second region of the second region where the first region is located
  • the presenting the second object comprises: presenting a second strip panorama formed by stitching the plurality of strip panoramas according to the identification information of the plurality of strip panoramas.
  • a plurality of strip images including the first strip image may be acquired, and multiple strips may be presented.
  • the method for presenting an image according to an embodiment of the present invention can freely switch between a 360 degree panorama and a strip panorama according to a correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama. Thereby enriching the viewing experience of the user.
  • FIG. 2 shows a schematic flow diagram of a method 200 of presenting an image in accordance with another embodiment of the present invention.
  • Method 200 can be performed by a server. As shown in FIG. 2, method 200 includes the following.
  • the terminal device Receive, by the terminal device, request information for requesting a second object, where the request information includes identifier information of the first object, where one of the first object and the second object is a first 360-degree panorama, the first object and The other of the second objects is a first strip panorama, the first strip panorama includes a plurality of sub-front images for displaying the first area, and the i-th front image of the plurality of sub-front images corresponds to more
  • the j-th 360-degree panorama in the 360-degree panorama is used to display the first area
  • the front image of the i-th sub-area, the first 360-degree panorama is one of a plurality of 360 panoramas, and i and j are positive integers.
  • the method for presenting an image according to the embodiment of the present invention sends a 360 degree panorama or a stripe panorama to be switched to the terminal device according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama.
  • the terminal device can be freely switched between the 360 degree panorama and the stripe panorama, thereby enriching the user's viewing experience.
  • the identification information of the first object and the identification information of the second object may be represented by time information or geographic location information when the first 360 degree panorama is captured.
  • time information or geographic location information when the first 360 degree panorama is captured.
  • the multiple 360 degree panorama is a plurality of 360 degree panoramic video frames in the 360 panoramic video
  • the 360 degree panoramic video is an extension of the road along the first area using the 360 degree panoramic camera.
  • the method further includes: acquiring a 360-degree panoramic video, a j-th 360-degree panorama of the plurality of 360-degree panoramic video frames, before the second object corresponding to the identification information of the first object is determined according to the identification information of the first object.
  • the video frame includes a front image for displaying the i-th sub-region in the first region; and the front image of the i-th sub-region in the first region is intercepted from the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames Forming a front image for displaying a plurality of sub-regions in the first region, which is intercepted from the plurality of 360-degree panoramic video frames, into a first strip panorama; establishing identification information of the first strip panorama and a plurality of 360 The correspondence between the identification information of the first 360-degree panoramic video frame in the panoramic video frame.
  • the first area may be any area on the road side, and the road side may include a plurality of first areas.
  • the process of generating a stripe panorama according to a 360-degree panoramic video for displaying the strips of other first regions on the road side is described by taking only the first stripe panorama for displaying the first area as an example.
  • the panorama can be obtained by the above method, and will not be described here.
  • the entire strip panorama on one side of the road is divided into a plurality of first strip panoramas displaying a plurality of first regions on the road side, and the entire 360-degree panoramic video taken along the entire road is taken.
  • the server only needs to be used
  • the stripe panorama or the 360-degree panoramic video segment corresponding to the area that the user wants to view is sent to the terminal device, and the bandwidth cannot be saved without sending the entire stripe panorama or the entire 360 panoramic video.
  • the terminal device receives the object to be switched sent by the server, it is not necessary to find the area to be viewed in the entire stripe panorama or the entire 360-degree panoramic video, which can save the search overhead and reduce the response time.
  • the video since the video will generate random access points during the encoding process, the video can only start playing at the random access point, so that the video cannot be segmented arbitrarily, and must be divided at the random access point, so the whole strip is
  • the panorama is divided into a plurality of first strip panoramas, the 360-degree panoramic video segmentation may be performed. Accordingly, the time information of the first strip panorama may be corresponding to the 360-degree panoramic video segmentation. Time information.
  • extracting a front image of the i-th sub-region in the first region from the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames includes: determining to determine the j-th 360 degree in the 360-degree panoramic video. a panoramic video frame along a first direction of the i-th sub-area in the first region; a second direction that is at an angle of 90 degrees with the first direction; intercepting from the j-th 360-degree panoramic video frame in the 360-degree panoramic video A frontal image taken in the second direction for displaying the i-th sub-area in the first area. At this time, a front image for displaying a designated area on one side of the road is taken from the 360-degree panoramic video frame.
  • the first object is a first 360 degree panorama
  • the second object is a first strip panorama
  • the request information further includes a display resolution of the terminal device, according to the first strip panorama
  • the method further includes: determining, according to the display resolution, a continuous plurality of strip panoramas including the first strip panorama, and the plurality of strip panoramas form a first A second strip panorama of the second area in which the area is located, wherein the sending the second object to the terminal device includes: transmitting the plurality of strip panoramas to the terminal device, so that the terminal device presents the multiple strips of the panorama stitching
  • the second strip is a panorama.
  • the plurality of strip images including the first strip image that meet the resolution of the terminal device may be sent to the terminal device, so that the terminal device presents more
  • the strip image is a front view of the street side area that is stitched into a wider viewing angle.
  • the server may further determine which stripe panoramas are acquired according to the location information of the first stripe panorama sent by the terminal device in the entire stripe panorama. For example, a panoramic view of each of the front and rear strips centered on the first strip panorama can be obtained.
  • the method for presenting an image according to the embodiment of the present invention sends a 360 degree panorama or a stripe panorama to be switched to the terminal device according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama.
  • the terminal device can be freely switched between the 360 degree panorama and the stripe panorama, thereby enriching the user's viewing experience.
  • a method 300 for generating a strip panorama according to an embodiment of the present invention will be described in detail below with reference to FIG. 3, which will be described hereinafter with a specific example of a strip panorama as a street side view, which is composed of a plurality of sub-streets.
  • the picture is spliced together.
  • the method 300 of generating a striped panorama may be performed by a terminal device in the embodiment shown in FIG. 1, or may be performed by a server in the embodiment shown in FIG. 2.
  • Method 300 includes the following.
  • 320 Obtain information about a street where the 360-degree panoramic camera is located when capturing the i-th 360-degree panoramic video frame in the 360-degree panoramic video, such as a navigation image or map information, determine the direction D i of the street side, and then determine the direction of the street side. D i is perpendicular to the direction A i as shown in FIG. 3A.
  • a direction A i perpendicular to the moving direction V of the panoramic camera is determined.
  • the sub-street side view P i of the street side area photographed from the specified direction A i is intercepted from the i-th 360-degree panoramic video frame.
  • the width X of the sub-street side view taken from the 360 panoramic video frame may also be a preset fixed value. This embodiment of the present invention does not limit this.
  • the height of the sub-street side view can be the height of the camera, and can also be a preset fixed value.
  • the time information of the sub-street side view may be the time of the 360-degree panoramic video frame in which it is located, or the relative offset time relative to the initial playing time of the 360-degree panoramic video, or may be the global time.
  • the plurality of sub-street side views are spliced, and a street side view panorama of the street side area can be generated.
  • the multi-street side view is spliced into a plurality of street side maps for displaying a large street side area. Row storage to reduce the cost of image fragment management.
  • the M block sub-street side view in the street side view panorama is divided into N image segments according to time information, M>N, so that the time period corresponding to each image segment satisfies the preset time period requirement.
  • the M-street side view in the street side panorama is divided into N street side maps according to the width information, M>N, so that the width corresponding to each street side segment satisfies the preset width requirement.
  • the plurality of sub-street side maps may be combined into a plurality of street side maps according to the 360-degree panoramic video segmentation manner, so that the start time of each street side map is 360 degrees.
  • the start time of the panoramic video segment that is, the time information of each street side map may be the same as the time information of the corresponding 360 degree panoramic video segment.
  • the time information of the street side map may be the start and end time (t i , t i+k ), may be the start time of the covered sub-street side map, and may be the sub-street side view of the center position of the presented image.
  • the time information or may be an interval period, or may be time information of any of the sub-street maps covered.
  • the description information of the street side map may also be recorded, and the description information of the street side map may include description information of all the sub-street side maps covered by the street side map.
  • the description information of the street side map may also be the description information of the representative sub-street side map.
  • the description information may include: location information, such as position coordinates (x i , y i ), where x i represents position coordinates of the sub-street side view in the horizontal direction of the entire street side view panorama, and y i is the child The height of the street map, or the location information is only x i .
  • the description information may also include location information that may represent the location of the streetside map in the 360 degree panoramic video.
  • the description information of the street side map may further include width information and height information of the street side map.
  • the width information of the street side map may be the sum of the widths of all the sub-street side maps covered by the street side map.
  • the description information of the side view of the street may also include an identifier (such as a serial number) of the sub-street side map.
  • the obtained plurality of street side maps and the description information of the plurality of street side maps are stored. It should be understood that the description information of each of the street side view and the street side view may be separately stored or may be stored together. Multiple street side maps can be stitched into a panorama storage of the street side area, or the multiple street side views can be stored separately.
  • the embodiment of the present invention utilizes the generated street side view of the 360-degree panoramic video, and can establish the correspondence between the street side view and the 360-degree panoramic video frame by using the time characteristic of the 360-degree panoramic video, so that the user can freely follow the personal interest in the street. Switch between the side view and the 360 degree panorama to User experience.
  • a method of presenting an image according to an embodiment of the present invention will be further described below with reference to FIGS. 4 and 5.
  • the street side maps below may be generated in accordance with a method 300 of generating a strip panorama.
  • Figure 4 illustrates a method of presenting an image in accordance with one embodiment of the present invention.
  • the process of switching from 360 degree panoramic video to street side map is taken as an example for description.
  • the terminal device and the server are described as an example in FIG. It should be understood that the actions performed by the terminal device and the server respectively may also be performed by respective applications or modules local to the terminal device.
  • the terminal device presents a 360-degree panoramic video, and receives a switching instruction that the user wants to view the street side map.
  • the terminal device acquires playback time T p 360-degree panoramic video of the current time.
  • the terminal apparatus acquires Street side corresponding to FIG. T p S p of the time information.
  • street-side time information comprises a map S p T p
  • S or street side of FIG time information comprises a time point p, T p and the closest.
  • the terminal device may also acquire the display resolution and street-side position information S in FIG p and S p to FIG street side is the central image, the position information p S according to the display resolution of the terminal and side streets FIG obtain Information of all street side maps S pi ... S p ... S p+i satisfying the terminal playing demand.
  • the terminal device may also acquire the orientation information of the street side view to be viewed by the user in step 420, for example, the position information of the street side view. It can represent one side of the street corresponding to the location selected by the user.
  • the user description information is determined to be viewed street side of the figure, and according to T p, and FIG obtain Street side S T p time information corresponding to the p .
  • the terminal device sends a street side map request information to the server, and requests a street side map corresponding to the currently played 360 degree panoramic video.
  • the street side map request information may include (S p , i) indicating that each of the i street side maps is requested to be centered on Sp.
  • the street side view request information may also be presented in other forms, such as request information for continuously transmitting S pi ...S p ...S p+i , or the street side map request information includes values of S p and 2*i+1 Or contain values for S pi and 2*i+1.
  • the street side map request information may also include information of the terminal device, such as display resolution, terminal model, buffer, and the like. In order for the server to determine a street side map that satisfies the performance of the terminal device.
  • the server receives the request information sent by the terminal device, and sends a corresponding street side map to the terminal device.
  • the terminal device receives the street side view and presents it.
  • the terminal device may transmit after performing step 420 directly to the server side street FIG request information, the request information includes street side in FIG playing time of at least T p 360-degree panoramic video, it should be understood that the The request information may further include display resolution of the terminal device, orientation information of the street side map in the 360 panoramic video, and position information of the street side map in the street side panoramic view. Accordingly, the server may determine the street side corresponding to T p P S in accordance with FIG. T p and orientation information, may also be determined to meet all the needs of the street-side terminal device displays the position information S in FIG display resolution and street-side terminal apparatus of FIG. Pi ...S p ...S p+i .
  • the free switching between the 360-degree panoramic video and the street side map can be realized through the interaction between the terminal device and the server.
  • FIG. 6 illustrates a method of presenting an image in accordance with another embodiment of the present invention.
  • the process of switching from the street side view to the 360 degree panoramic video is described as an example.
  • the terminal device and the server are still taken as an example for description. It should be understood that the actions performed by the terminal device and the server respectively may also be performed by respective applications or modules local to the terminal device.
  • the terminal device presents a street side view, and receives a switching instruction that the user wants to watch 360 panoramic video.
  • street-side terminal apparatus acquires the current time information of FIG timing T p.
  • T p may be the time information of the sub street side of the center position of FIG presented street side of FIG.
  • T p may be any time information of a time point of the current period presented street side cover in FIG.
  • T p can be any time point within the interval [t 1 , t 10 ].
  • the terminal apparatus acquires time information 360-degree panoramic video and T p Q p corresponding to the segment.
  • time information 360-degree panoramic video segments comprises a T p Q p
  • a 360-degree panoramic video segment time information comprises a time Q p T p and the closest.
  • the terminal device may further T p, the time information acquisition start time T p is less than or equal to a random access point 360 corresponding to the panoramic video segments Q p.
  • the terminal device sends request information to the server, requesting a 360-degree panoramic video segment corresponding to the currently played street side map.
  • the request information may include a 360-degree panoramic video segment time information of Q p.
  • the request information may also include information of the terminal device, such as display resolution, terminal model, buffer, and the like. In order for the server to determine a 360 degree panoramic video segment that satisfies the performance of the terminal device.
  • the server receives the terminal device to send the request information, and sends a 360-degree panoramic video segment corresponding to the street side map to the terminal device.
  • the terminal device receives the 360-degree panoramic video segment sent by the server, and presents the segment.
  • the free switching between the 360-degree panoramic video and the street side map can be realized through the interaction between the terminal device and the server.
  • the terminal device directly transmits the request information of the 360-degree panoramic video to the server after performing step 620.
  • the terminal apparatus transmits the request information to the information server comprises at least a time T p of FIG street side, it should be understood that the request information may further include a display resolution of the terminal device.
  • the server may determine T p corresponding to the 360-degree panoramic video segments according to T p Q p.
  • FIG. 8 is a schematic block diagram of a terminal device 800 in accordance with one embodiment of the present invention. As shown in FIG. 8, the terminal device 800 includes an acquisition module 810 and a display module 820.
  • the obtaining module 810 is configured to acquire, after receiving the switching indication that the first object being displayed is switched to the second object, the identifier information of the first object, where the first object and the second object are the first one a 360 degree panorama, the other of the first object and the second object being a first strip panorama, the first strip panorama comprising a plurality of sub-front images for displaying the first area, the plurality of The i-th sub-frontal image in the sub-frontal image corresponds to a frontal image for displaying the i-th sub-area in the first area in the j-th 360-degree panoramic view in the plurality of 360-degree panoramic images, the first 360-degree panoramic view For one of the multiple 360 degree panoramas, i and j are positive integers.
  • the obtaining module 810 is further configured to: acquire, according to the identifier information of the first object, the second object corresponding to the identifier information of the first object, where the identifier information of the first object and the identifier information of the second object have corresponding information relationship.
  • the display module 820 is configured to present the second object.
  • the terminal device can freely switch between the 360 degree panorama and the strip panorama according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama. Enrich the user's viewing experience.
  • the terminal device 800 further includes: a second determining module 830, configured to determine identifier information of the second object corresponding to the identifier information of the first object.
  • the obtaining module 810 is specifically configured to acquire the second object according to the identifier information of the second object.
  • the multiple 360-degree panoramic image is a plurality of 360-degree panoramic video frames in the 360 panoramic video, where the 360-degree panoramic video is located along the first region by using a 360-degree panoramic camera.
  • the direction of the road is taken.
  • the acquiring module 810 is further configured to: before acquiring the identifier information of the first object, acquiring the 360-degree panoramic video, where the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames includes the first A frontal image of the i-th sub-area within the area.
  • the terminal device 800 further includes: an intercepting module 840, configured to intercept, from a j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames, a front image for displaying an i-th sub-region in the first region; a splicing module 850.
  • the front image of the plurality of sub-areas in the first area that is intercepted from the plurality of 360-degree panoramic video frames is spliced into the first stripe panorama.
  • the relationship module 860 is configured to establish the Correspondence between the identification information of the first panoramic image and the identification information of the first 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames.
  • the second determining module 830 is further configured to: determine a first direction along the i-th sub-area in the first area when the j-th 360-degree panoramic video frame in the 360-degree panoramic video is captured; The angle with the first direction is a second direction of 90 degrees.
  • the intercepting module 840 is specifically configured to: capture, from the j-th 360-degree panoramic video frame of the 360-degree panoramic video, the ith photographed in the second direction determined by the second determining module for displaying the first region in the first region A frontal image of the sub-area.
  • the terminal device 800 may further include: a first determining module 870, configured to determine the first object after the acquiring module acquires the identifier information of the first object.
  • the first sending module 880 is configured to send the first request information to the server, where the first request information is used to request the second object, where the first request information includes the identifier information of the second object.
  • the obtaining module 810 is specifically configured to receive the second object sent by the server.
  • the terminal device 800 may further include: a second sending module 890, configured to send a second to the server after the obtaining module acquires the identifier information of the first object
  • the request information is used to request the second object, the second request information includes the identifier information of the first object, so that the server determines the identifier information of the second object according to the identifier information of the first object, and according to the second The identification information of the object determines the second object.
  • the obtaining module 810 is specifically configured to receive the second object sent by the server.
  • the first object is a first 360 degree panorama
  • the second object is a first strip panorama.
  • the obtaining module 810 is further configured to: after receiving the switching indication that the first 360 degree panorama being displayed is switched to the first strip panorama, acquire the device for presenting the first strip panorama display resolution.
  • the obtaining module 810 is specifically configured to acquire, according to the identification information of the first 360-degree panoramic image and the display resolution, a continuous plurality of strip panoramas including the first strip panorama, the multiple strip panoramas
  • the map constitutes a second strip panorama of the second region in which the first region is located.
  • the display module 820 is specifically configured to present the second strip panorama formed by the plurality of strip panoramas according to the identification information of the plurality of strip panoramas.
  • the identification information of the first object and the identification information of the second object may be represented by time information or geographic location information when the first 360 degree panorama is captured.
  • terminal device 800 may correspond to the terminal device in the embodiment of the present invention, and the above and other operations and/or functions of the respective modules in the terminal device 800 are respectively implemented to implement the method 100 of FIG. The corresponding process, for the sake of brevity, will not be described here.
  • the terminal device can freely switch between the 360 degree panorama and the strip panorama according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama. Enrich the user's viewing experience.
  • FIG. 12 shows a schematic block diagram of a server 1200 in accordance with one embodiment of the present invention.
  • the server 1200 includes a receiving module 1210, a determining module 1220, and a sending module 1230.
  • the receiving module 1210 is configured to receive request information for requesting the second object, where the request information includes identification information of the first object, where the first object and the second object are the first 360-degree panoramic view.
  • the first of the first object and the second object is a first strip panorama
  • the first strip panorama includes a plurality of sub-front images for displaying the first region
  • the i-th sub-frontal image corresponds to a front image of the j-th 360-degree panorama in the plurality of 360-degree panoramic views for displaying the i-th sub-area in the first area, the first 360-degree panoramic view being the One of the multiple 360 panoramas, i and j are positive integers.
  • the determining module 1220 is configured to determine, according to the identifier information of the first object, identifier information of the second object corresponding to the identifier information of the first object.
  • the determining module 1220 is further configured to determine the second object according to the identification information of the second object.
  • the sending module 1230 is configured to send the second object to the terminal device, so that the terminal device presents the second object.
  • the server of the embodiment of the present invention sends a 360 degree panorama or a stripe panorama to be switched to the terminal device according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama, so that the terminal The device is free to switch between 360-degree panoramas and strip panoramas to enrich the user's viewing experience.
  • the multiple 360-degree panoramic image is a plurality of 360-degree panoramic video frames in the 360 panoramic video, and the 360-degree panoramic video is along the 360-degree panoramic camera. Photographed in the direction in which the road in which the first area is located.
  • the server 1200 further includes: an obtaining module 1240, configured to acquire the 360-degree panoramic video, the j-th in the plurality of 360-degree panoramic video frames, before the determining module determines the second object corresponding to the identification information of the first object
  • the 360-degree panoramic video frame includes a front image for displaying the i-th sub-region in the first region;
  • the intercepting module 1250 is configured to intercept the j-th 360-degree panoramic video frame from the plurality of 360-degree panoramic video frames a front image of the i-th sub-area in the first area;
  • a splicing module 1260 configured to splicing a front image of the plurality of sub-areas in the first area that is intercepted from the plurality of 360-degree panoramic video frames into the
  • the first one has a panoramic view;
  • the relationship module 1270 is configured to establish a correspondence between the identification information of the first strip panorama and the identifier information of the first 360-degree panoramic video frame of the plurality of 360-degree panoramic video
  • the determining module 1220 is further configured to: determine a first direction along the i-th sub-area in the first area when the j-th 360-degree panoramic video frame in the 360-degree panoramic video is captured; The angle in one direction is the second direction of 90 degrees.
  • the intercepting module 1250 is specifically configured to intercept, from the j-th 360-degree panoramic video frame of the 360-degree panoramic video, a front image captured in the second direction for displaying the i-th sub-region in the first region.
  • the first object is a first 360 degree panorama
  • the second object is a first strip panorama
  • the request information further includes a display resolution of the terminal device.
  • the determining module 1220 is further configured to: after the determining module determines the first stripe panorama corresponding to the identifier information of the first stripe panorama, determine, according to the display resolution, a continuous manner including the first stripe panorama A plurality of strip panoramas, the plurality of strip panoramas forming a second strip panorama of the second region in which the first region is located.
  • the sending module 1230 is specifically configured to send, to the terminal device, the plurality of stripe panoramas, so that the terminal device presents the second stripe panorama into which the plurality of stripe panoramas are stitched.
  • the identification information of the first object and the identification information of the second object may be represented by time information or geographic location information when the first 360 degree panorama is captured.
  • server 1200 may correspond to the server in the embodiment of the present invention, and the foregoing and other operations and/or functions of the respective modules in the server 1200 respectively implement the corresponding processes of the method 200 of FIG. 2, For the sake of brevity, it will not be repeated here.
  • the server of the embodiment of the present invention sends a 360 degree panorama or a stripe panorama to be switched to the terminal device according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama, so that the terminal The device is free to switch between 360-degree panoramas and strip panoramas to enrich the user's viewing experience.
  • FIG. 14 shows a schematic block diagram of a terminal device 1400 according to another embodiment of the present invention.
  • terminal device 1400 includes a processor 1410, a memory 1420, a bus system 1430, and a display 1440.
  • the processor 1410, the memory 1420, and the display 1440 are connected by a bus system 1430 for storing instructions, and the processor 2100 executes the instructions stored in the memory 1420 through the bus system 2300.
  • the processor 1410 is configured to: when receiving the switching indication that the first object being displayed is switched to the second object, acquire the identification information of the first object, where the first object and the second object are the first one a 360 degree panorama, the other of the first object and the second object being a first strip panorama, the first strip panorama comprising a plurality of sub-front images for displaying the first area, the plurality of The i-th sub-frontal image in the sub-frontal image corresponds to a frontal image for displaying the i-th sub-area in the first area in the j-th 360-degree panoramic view in the plurality of 360-degree panoramic images, the first 360-degree panoramic view For one of the multiple 360-degree panoramic views, i and j are positive integers; according to the identification information of the first object, the second object corresponding to the identification information of the first object is obtained, where the identification information of the first object Corresponding to the identification information of the second object.
  • Display 1440 is for presenting the second object.
  • the terminal device can freely switch between the 360 degree panorama and the strip panorama according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama. Enrich the user's viewing experience.
  • the processor 1410 may be a central processing unit (CPU), and the processor 1410 may also be other general-purpose processors, digital signal processors (DSPs), and application specific integrated circuits. (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and more.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 1420 can include a read only memory and a random access memory, and is directed to the processor The 1410 provides instructions and data. A portion of the memory 1420 can also include a non-volatile random access memory. For example, the memory 1420 can also store information of the device type.
  • the bus system 1430 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 1430 in the figure.
  • each step of the above method may be completed by an integrated logic circuit of hardware in the processor 1410 or an instruction in a form of software.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
  • the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 1420, and the processor 1410 reads the information in the memory 1420 and, in conjunction with its hardware, performs the steps of the above method. To avoid repetition, it will not be described in detail here.
  • the processor 1410 is specifically configured to: determine identifier information of the second object corresponding to the identifier information of the first object, and acquire the second object according to the identifier information of the second object.
  • the multiple 360-degree panoramic image is a plurality of 360-degree panoramic video frames in the 360 panoramic video
  • the 360-degree panoramic video is a road along the first region using a 360-degree panoramic camera. The direction of the extension is taken.
  • the processor 1410 is further configured to: acquire the 360-degree panoramic video, where the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames is used to display the first a front image of the i-th sub-area in the region; a front image for displaying the i-th sub-region in the first region is intercepted from the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames; Forming, in a plurality of 360-degree panoramic video frames, a front image for displaying a plurality of sub-areas in the first area into the first strip panorama; establishing identification information of the first strip panorama and the plurality of The correspondence between the identification information of the first 360-degree panoramic video frame in the 360-degree panoramic video frame.
  • the processor 1410 is specifically configured to: determine, according to the first direction of the i-th sub-region in the first region, when capturing the j-th 360-degree panoramic video frame in the 360-degree panoramic video; determining the first a second direction in which the angle of the direction is 90 degrees; and the i-th sub-area captured in the second area for displaying the i-th sub-area in the first area is captured from the j-th 360-degree panoramic video frame in the 360-degree panoramic video Frontal image.
  • the terminal device 1400 further includes a transceiver. 1450.
  • the processor 1410 is further configured to: after acquiring the identifier information of the first object, determine the identifier information of the second object corresponding to the identifier information of the first object.
  • the transceiver 1450 is configured to: send first request information to the server, to request the second object, the first request information includes identification information of the second object, and receive the second object sent by the server.
  • the transceiver 1450 is configured to: after acquiring the identifier information of the first object, send second request information to the server, to request the second object, where the second request information includes the The identification information of the first object, so that the server determines the identification information of the second object according to the identification information of the first object, and determines the second object according to the identification information of the second object; and receives the second sent by the server Object.
  • the first object is a first 360 degree panorama
  • the second object is a first strip panorama.
  • the processor 1410 is further configured to: acquire a display of the device for presenting the first stripe panorama Resolution.
  • the processor 1410 is specifically configured to acquire, according to the identification information of the first 360-degree panoramic image and the display resolution, a continuous plurality of strip panoramas including the first strip panorama, the multiple strip panoramas A second strip panorama that constitutes the second region in which the first region is located.
  • the display 1440 is specifically configured to present the second strip panorama into which the plurality of strip panoramas are stitched.
  • the identification information of the first object and the identification information of the second object may be represented by time information or geographic location information when the first 360 degree panorama is captured.
  • the terminal 1400 may correspond to the terminal device in the method of presenting an image of the embodiment of the present invention and the terminal device 800 according to an embodiment of the present invention, and the above and other of each module in the terminal device 1400
  • the operations and/or functions are respectively implemented in order to implement the corresponding processes of the method 100 of FIG. 1.
  • no further details are provided herein.
  • the terminal device can freely switch between the 360 degree panorama and the strip panorama according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama. Enrich the user's viewing experience.
  • FIG. 16 shows a schematic block diagram of a server 1600 in accordance with another embodiment of the present invention.
  • server 1600 includes a processor 1610, a memory 1620, a bus system 1630, and a transceiver 1640.
  • the processor 1610, the memory 1620 and the transceiver 1640 are connected by a bus system 1630 for storing instructions, and the processor 1610 executes the instructions stored in the memory 1620 through the bus system 1630.
  • the transceiver 1640 is configured to receive, by the terminal device, request information for requesting the second object, where the request information includes the identifier information of the first object, where the first object and the second object are the first 360 degree panorama.
  • the other of the first object and the second object is a first strip panorama
  • the first strip panorama includes a plurality of sub-front images for displaying the first region
  • the i-th sub-frontal image corresponds to a front image of the j-th 360-degree panorama in the plurality of 360-degree panoramic views for displaying the i-th sub-area in the first area, the first 360-degree panoramic view being the plurality of One of the 360 panoramas, i and j are positive integers.
  • the processor 1610 is configured to: determine, according to the identifier information of the first object, identifier information of the second object corresponding to the identifier information of the first object; and determine the second object according to the identifier information of the second object.
  • the transceiver 1640 is further configured to send the second object to the terminal device, so that the terminal device presents the second object.
  • the server of the embodiment of the present invention sends a 360 degree panorama or a stripe panorama to be switched to the terminal device according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama, so that the terminal The device is free to switch between 360-degree panoramas and strip panoramas to enrich the user's viewing experience.
  • the processor 1610 may be a central processing unit (CPU), and the processor 1610 may also be other general-purpose processors, digital signal processors (DSPs), and application specific integrated circuits. (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and more.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 1620 can include read only memory and random access memory and provides instructions and data to the processor 1610. A portion of memory 1620 may also include a non-volatile random access memory. For example, the memory 1620 can also store information of the device type.
  • the bus system 1630 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 1630 in the figure.
  • each step of the above method may be completed by an integrated logic circuit of hardware in the processor 1610 or an instruction in the form of software.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
  • the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 1620, and the processor 1610 reads the information in the memory 1620.
  • the steps of the above method are completed in combination with the hardware. To avoid repetition, it will not be described in detail here.
  • the multiple 360-degree panoramic image is a plurality of 360-degree panoramic video frames in the 360 panoramic video
  • the 360-degree panoramic video is a road along which the 360-degree panoramic camera is located along the first region. Shooting in the extended direction.
  • the processor 1610 is further configured to: acquire the 360-degree panoramic video before determining the second object corresponding to the identifier information of the first object, where the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames is included And displaying a front image of the i-th sub-region in the first region; and extracting, from the j-th 360-degree panoramic video frame of the plurality of 360-degree panoramic video frames, a front image of the i-th sub-region in the first region; And displaying, by the plurality of 360-degree panoramic video frames, a front image for displaying a plurality of sub-regions in the first region to form the first strip panorama; establishing identification information of the first strip panorama and the plurality of The correspondence between the identification information of the first 360-degree panoramic video frame in the 360-degree panoramic video frame.
  • the processor 1610 may be specifically configured to: determine a first direction along an ith sub-region in the first region when the j-th 360-degree panoramic video frame in the 360-degree panoramic video is captured; a second direction in which the angle of the first direction is 90 degrees; and the i-th child captured in the second direction for displaying the i-th child in the first region is captured from the j-th 360-degree panoramic video frame in the 360-degree panoramic video A frontal image of the area.
  • the first object is a first 360 degree panorama
  • the second object is a first strip panorama
  • the request information further includes a display resolution of the terminal device.
  • the processor 1610 is further configured to: after determining the first stripe panorama corresponding to the identifier information of the first stripe panorama, determine, according to the display resolution, a continuous multiple including the first stripe panorama A strip panorama, the plurality of strip panoramas forming a second strip panorama of the second region in which the first region is located.
  • the transceiver 1640 is specifically configured to send, to the terminal device, the plurality of stripe panoramas, so that the terminal device presents the second stripe panorama into which the plurality of stripe panoramas are stitched.
  • the identification information of the first object and the identification information of the second object are represented by time information or geographic location information when the first 360 degree panorama is captured.
  • the server 1600 may correspond to the server in the method of presenting an image of the embodiment of the present invention and the server 1200 according to an embodiment of the present invention, and the above and other operations of the respective modules in the terminal device 1600 and The functions of the method 200 are respectively implemented in order to implement the corresponding process of the method 200 of FIG. 2, and are not described herein again for brevity.
  • the server according to the embodiment of the present invention sends a 360 degree panorama to be switched to the terminal device according to the correspondence between the identification information of the 360 degree panorama and the identification information of the strip panorama.
  • Striped panoramas allow the terminal device to switch between 360-degree panoramas and striped panoramas, enriching the user's viewing experience.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), A variety of media that can store program code, such as random access memory (RAM), disk, or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明公开了一种呈现图像的方法、终端设备和服务器。该方法包括:在接收到将第一对象切换至第二对象的切换指示时,获取第一对象的标识信息,其中第一对象和第二对象之一为第一360度全景图,另一个为第一条带全景图,第一条带全景图包括用于显示第一区域的多幅子正面图像,多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示第一区域内的第i子区域的正面图像,第一360度全景图为多幅360度全景图之一;根据第一对象的标识信息,获取第一对象的标识信息对应的第二对象;呈现第二对象。本发明实施例的呈现图像的方法、终端设备和服务器,能够在360度全景图和条带全景图之间自由切换。

Description

呈现图像的方法、终端设备和服务器
本申请要求于2014年09月24日提交中国专利局、申请号为201410494921.8,发明名称为“呈现图像的方法、终端设备和服务器”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及信息技术领域,尤其涉及一种呈现图像的方法、终端设备和服务器。
背景技术
360度全景相机可以拍摄360度全景视频。用户可以通过观看360度的全景视频观看一个点周围360度的景物,也可以通过观看街侧景图观看一整条街道的街侧景物。但用户无法在观看360度全景视频的时候切换到街道侧的街侧景图,或者在观看街侧景图某个感兴趣的地点时切换到360度全景视频。
发明内容
本发明实施例提供了一种呈现图像的方法,能够在360度全景图和条带全景图之间自由切换,使得能够丰富用户的观看体验。
第一方面,提供了一种呈现图像的方法,该方法包括:在接收到将正在显示的第一对象切换至第二对象的切换指示时,获取第一对象的标识信息,其中第一对象和第二对象之一为第一360度全景图,第一对象和第二对象中的另一个为第一条带全景图,第一条带全景图包括用于显示第一区域的多幅子正面图像,多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示第一区域内的第i子区域的正面图像,第一360度全景图为多幅360度全景图之一,i和j为正整数;根据第一对象的标识信息,获取第一对象的标识信息对应的第二对象,其中第一对象的标识信息与第二对象的标识信息具有对应关系;呈现第二对象。
结合第一方面,在第一种可能的实现方式中,在获取第一对象的标识信息之后,该方法还包括:确定第一对象的标识信息对应的第二对象的标识信 息;向服务器发送第一请求信息,用于请求第二对象,第一请求信息包括第二对象的标识信息,其中,获取第一对象的标识信息对应的第二对象,包括:接收服务器发送的第二对象。
结合第一方面,在第二种可能的实现方式中,在获取第一对象的标识信息之后,该方法还包括:向服务器发送第二请求信息,用于请求第二对象,第二请求信息包括第一对象的标识信息,以便服务器根据第一对象的标识信息确定第二对象的标识信息,并根据第二对象的标识信息确定第二对象,其中,获取第一对象的标识信息对应的第二对象包括:接收服务器发送的第二对象。
结合第一方面,在第三种可能的实现方式中,根据第一对象的标识信息,获取第一对象的标识信息对应的第二对象,包括:确定第一对象的标识信息对应的第二对象的标识信息;根据第二对象的标识信息,获取第二对象。
结合第三种可能的实现方式,在第四种可能的实现方式中,多幅360度全景图为360全景视频中的多个360度全景视频帧,360度全景视频是采用360度全景相机沿着第一区域所在的道路的延伸方向拍摄的,在获取第一对象的标识信息之前,该方法还包括:获取360度全景视频,多个360度全景视频帧中第j 360度全景视频帧中包括用于显示第一区域内的第i子区域的正面图像;从多个360度全景视频帧中第j 360度全景视频帧中截取用于显示第一区域内的第i子区域的正面图像;将从多个360度全景视频帧中截取的用于显示第一区域内的多个子区域的正面图像拼接成第一条带全景图;建立第一条带全景图的标识信息和多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
结合第四种可能的实现方式,在第五种可能的实现方式中,从多个360度全景视频帧中第j 360度全景视频帧中截取用于显示第一区域内的第i子区域的正面图像,包括:确定拍摄360度全景视频中第j 360度全景视频帧时沿第一区域内的第i子区域的第一方向;确定与第一方向的夹角为90度的第二方向;从360度全景视频中第j 360度全景视频帧中截取在第二方向上拍摄的用于显示第一区域内的第i子区域的正面图像。
结合第一方面或第一种至第五种可能的实现方式中的任一种可能的实现方式,在第六种可能的实现方式中,第一对象为第一360度全景图,第二对象为第一条带全景图,在接收到将正在显示的第一360度全景图切换至第 一条带全景图的切换指示之后,该方法还包括:获取用于呈现第一条带全景图的设备的显示分辨率;根据第一对象的标识信息,获取第一对象的标识信息对应的第二对象,包括:根据第一360度全景图的标识信息和显示分辨率,获取包括第一条带全景图的连续的多幅条带全景图,多幅条带全景图组成第一区域所在的第二区域的第二条带全景图,其中,呈现第二对象包括:根据多幅条带全景图的标识信息,呈现多幅条带全景图拼接成的第二条带全景图。
结合第一方面或第一种至第六种可能的实现方式中的任一种可能的实现方式,在第七种可能的实现方式中,第一对象的标识信息和第二对象的标识信息由拍摄第一360度全景图时的时间信息或地理位置信息来表示。
第二方面,提供了一种呈现图像的方法,该方法包括:接收终端设备发送的用于请求第二对象的请求信息,请求信息包括第一对象的标识信息,其中第一对象和第二对象之一为第一360度全景图,第一对象和第二对象中的另一个为第一条带全景图,第一条带全景图包括用于显示第一区域的多幅子正面图像,多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示第一区域内的第i子区域的正面图像,第一360度全景图为多幅360全景图之一,i和j为正整数;根据第一对象的标识信息,确定第一对象的标识信息对应的第二对象的标识信息;根据第二对象的标识信息确定第二对象;向终端设备发送第二对象,以便终端设备呈现第二对象。
结合第二方面,在第二方面的第一种可能的实现方式中,多幅360度全景图为360全景视频中的多个360度全景视频帧,360度全景视频是采用360度全景相机沿着第一区域所在的道路的延伸方向拍摄的,在根据第一对象的标识信息,确定第一对象的标识信息对应的第二对象之前,方法还包括:获取360度全景视频,多个360度全景视频帧中第j 360度全景视频帧中包括用于显示第一区域内的第i子区域的正面图像;从多个360度全景视频帧中第j 360度全景视频帧中截取第一区域内的第i子区域的正面图像;将从多个360度全景视频帧中截取的用于显示第一区域内的多个子区域的正面图像组成第一条带全景图;建立第一条带全景图的标识信息和多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
结合第二方面的第一种可能的实现方式中,在第二方面的第二种可能的 实现方式中,从多个360度全景视频帧中第j 360度全景视频帧中截取第一区域内的第i子区域的正面图像,包括:确定拍摄360度全景视频中第j 360度全景视频帧时沿第一区域内的第i子区域的第一方向;确定与第一方向的夹角为90度的第二方向;从360度全景视频中第j 360度全景视频帧中截取在第二方向上拍摄的用于显示第一区域内的第i子区域的正面图像。
结合第二方面或第二方面的第一种或第二种可能的实现方式,在第二方面的第三种可能的实现方式中,第一对象为第一360度全景图,第二对象为第一条带全景图,请求信息还包括终端设备的显示分辨率,在确定第一条带全景图的标识信息对应的第一条带全景图之后,方法还包括:根据显示分辨率,确定包括第一条带全景图的连续的多幅条带全景图,多幅条带全景图组成第一区域所在的第二区域的第二条带全景图,其中,向终端设备发送第二对象,包括:向终端设备发送包括多幅条带全景图,以便终端设备呈现多幅条带全景图拼接成的第二条带全景图。
结合第二方面或第二方面的第一种至第三种可能的实现方式中的任一种可能的实现方式,在第二方面的第四种可能的实现方式中,第一对象的标识信息和第二对象的标识信息由拍摄第一360度全景图时的时间信息或地理位置信息来表示。
第三方面,提供了一种终端设备,包括:获取模块,用于在接收到将正在显示的第一对象切换至第二对象的切换指示时,获取第一对象的标识信息,其中第一对象和第二对象之一为第一360度全景图,第一对象和第二对象中的另一个为第一条带全景图,第一条带全景图包括用于显示第一区域的多幅子正面图像,多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示第一区域内的第i子区域的正面图像,第一360度全景图为多幅360度全景图之一,i和j为正整数;获取模块还用于,根据第一对象的标识信息,获取第一对象的标识信息对应的第二对象,其中第一对象的标识信息与第二对象的标识信息具有对应关系;显示模块,用于呈现第二对象。
结合第三方面,在第三方面的第一种可能的实现方式中,该终端设备还包括:第一确定模块,用于在获取模块获取第一对象的标识信息之后,确定第一对象的标识信息对应的第二对象的标识信息;第一发送模块,用于向服务器发送第一请求信息,用于请求第二对象,第一请求信息包括第二对象的 标识信息,其中,获取模块具体用于接收服务器发送的第二对象。
结合第三方面,在第三方面的第二种可能的实现方式中,还包括:第二发送模块,用于在获取模块获取第一对象的标识信息之后,向服务器发送第二请求信息,用于请求第二对象,第二请求信息包括第一对象的标识信息,以便服务器根据第一对象的标识信息确定第二对象的标识信息,并根据第二对象的标识信息确定第二对象,其中,获取模块具体用于接收服务器发送的第二对象。
结合第三方面,在第三方面的第三种可能的实现方式中,还包括:第二确定模块,用于确定第一对象的标识信息对应的第二对象的标识信息,其中,获取模块具体用于,根据第二对象的标识信息,获取第二对象。
结合第三方面的第三种可能的实现方式,在第三方面的第四种可能的实现方式中,多幅360度全景图为360全景视频中的多个360度全景视频帧,360度全景视频是采用360度全景相机沿着第一区域所在的道路的延伸方向拍摄的,获取模块还用于,在获取第一对象的标识信息之前,获取360度全景视频,多个360度全景视频帧中第j 360度全景视频帧中包括用于显示第一区域内的第i子区域的正面图像;终端设备还包括:截取模块,用于从多个360度全景视频帧中第j 360度全景视频帧中截取用于显示第一区域内的第i子区域的正面图像;拼接模块,用于将从多个360度全景视频帧中截取的用于显示第一区域内的多个子区域的正面图像拼接成第一条带全景图;关系模块,用于建立第一条带全景图的标识信息和多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
结合第三方面的第四种可能的实现方式,在第三方面的第五种可能的实现方式中,第二确定模块还用于:确定拍摄360度全景视频中第j 360度全景视频帧时沿第一区域内的第i子区域的第一方向;确定与第一方向的夹角为90度的第二方向,截取模块具体用于,从360度全景视频中第j 360度全景视频帧中截取在第二确定模块确定的第二方向上拍摄的用于显示第一区域内的第i子区域的正面图像。
结合第三方面或第三方面的第一种至第五种可能的实现方式中的任一种可能的实现方式,在第三方面的第六种可能的实现方式中,第一对象为第一360度全景图,第二对象为第一条带全景图,获取模块还用于,在接收到将正在显示的第一360度全景图切换至第一条带全景图的切换指示之后,获 取用于呈现第一条带全景图的设备的显示分辨率,获取模块具体用于,根据第一360度全景图的标识信息和显示分辨率,获取包括第一条带全景图的连续的多幅条带全景图,多幅条带全景图组成第一区域所在的第二区域的第二条带全景图,显示模块具体用于,根据多幅条带全景图的标识信息,呈现多幅条带全景图拼接成的第二条带全景图。
结合第三方面或第三方面的第一种至第六种可能的实现方式中的任一种可能的实现方式,在第三方面的第七种可能的实现方式中,第一对象的标识信息和第二对象的标识信息由拍摄第一360度全景图时的时间信息或地理位置信息来表示。
第四方面,提供了一种服务器,该服务器包括:接收模块,用于接收终端设备发送的用于请求第二对象的请求信息,请求信息包括第一对象的标识信息,其中第一对象和第二对象之一为第一360度全景图,第一对象和第二对象中的另一个为第一条带全景图,第一条带全景图包括用于显示第一区域的多幅子正面图像,多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示第一区域内的第i子区域的正面图像,第一360度全景图为多幅360全景图之一,i和j为正整数;确定模块,用于根据第一对象的标识信息,确定第一对象的标识信息对应的第二对象的标识信息,确定模块还用于根据第二对象的标识信息确定第二对象;发送模块,用于向终端设备发送第二对象,以便终端设备呈现第二对象。
结合第四方面,在第四方面的第一种可能的实现方式中,多幅360度全景图为360全景视频中的多个360度全景视频帧,360度全景视频是采用360度全景相机沿着第一区域所在的道路的延伸方向拍摄的,服务器还包括:获取模块,用于在确定模块确定第一对象的标识信息对应的第二对象之前,获取360度全景视频,多个360度全景视频帧中第j 360度全景视频帧中包括用于显示第一区域内的第i子区域的正面图像;截取模块,用于从多个360度全景视频帧中第j 360度全景视频帧中截取第一区域内的第i子区域的正面图像;拼接模块,用于将从多个360度全景视频帧中截取的用于显示第一区域内的多个子区域的正面图像拼接成第一条带全景图;关系模块,用于建立第一条带全景图的标识信息和多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
结合第四方面的第一种可能的实现方式,在第四方面的第二种可能的实 现方式中,确定模块还用于:确定拍摄360度全景视频中第j 360度全景视频帧时沿第一区域内的第i子区域的第一方向;确定与第一方向的夹角为90度的第二方向,截取模块具体用于从360度全景视频中第j 360度全景视频帧中截取在第二方向上拍摄的用于显示第一区域内的第i子区域的正面图像。
结合第四方面或第四方面的第一种或第二种可能的实现方式,在第四方面的第三种可能的实现方式中,第一对象为第一360度全景图,第二对象为第一条带全景图,请求信息还包括终端设备的显示分辨率,确定模块还用于,在确定模块确定第一条带全景图的标识信息对应的第一条带全景图之后,根据显示分辨率,确定包括第一条带全景图的连续的多幅条带全景图,多幅条带全景图组成第一区域所在的第二区域的第二条带全景图,发送模块具体用于,向终端设备发送包括多幅条带全景图,以便终端设备呈现多幅条带全景图拼接成的第二条带全景图。
结合第四方面或第四方面的第一种或第二种或第三种可能的实现方式,在第四方面的第四种可能的实现方式中,第一对象的标识信息和第二对象的标识信息由拍摄第一360度全景图时的时间信息或地理位置信息来表示。
基于上述技术方案,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
附图说明
为了更清楚地说明本发明实施例的技术方案,下面将对本发明实施例中所需要使用的附图作简单地介绍,显而易见地,下面所描述的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是根据本发明一个实施例的呈现图像的方法的示意性流程图。
图2是根据本发明另一实施例的呈现图像的方法的示意性流程图。
图3A和图3B是根据本发明实施例的拍摄360度全景图的场景的示意图。
图4是根据本发明另一实施例的呈现图像的方法的示意性流程图。
图5是根据本发明另一实施例的呈现图像的方法的示意性流程图。
图6是根据本发明另一实施例的呈现图像的方法的示意性流程图。
图7是根据本发明另一实施例的呈现图像的方法的示意性流程图。
图8是根据本发明一个实施例的终端设备的示意性框图。
图9是根据本发明另一实施例的终端设备的示意性框图。
图10是根据本发明另一实施例的终端设备的示意性框图。
图11是根据本发明另一实施例的终端设备的示意性框图。
图12是根据本发明一个实施例的服务器的示意性框图。
图13是根据本发明另一实施例的服务器的示意性框图。
图14是根据本发明另一实施例的终端设备的示意性框图。
图15是根据本发明另一实施例的终端设备的示意性框图。
图16是根据本发明另一实施例的服务器的示意性框图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明的一部分实施例,而不是全部实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例,都应属于本发明保护的范围。
360度全景图指的是围绕一个固定视点,得到的该视点周围360度的图像。条带全景图(strip panorama)指的通过连续拍摄多个视点的窄视角图像进行拼接得到的宽视角图像。
图1示出了根据本发明实施例的呈现图像的方法100的示意性流程图。方法100可以由终端设备执行。如图1所示,方法100包括如下内容。
110,在接收到将正在显示的第一对象切换至第二对象的切换指示时,获取第一对象的标识信息,其中第一对象和第二对象之一为第一360度全景图,第一对象和第二对象中的另一个为第一条带全景图,第一条带全景图包括用于显示第一区域的多幅子正面图像,多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示第一区域内的第i子区域的正面图像,第一360度全景图为该多幅360度全景图之一,i和j为正整数。
第一条带全景图可以是道路一侧的全景图像,此时,第一条带全景图可以称为街侧全景图。该条带全景图可以是连续采集的多张平面图像校正拼 接得到的,还可以是从360度全景相机连续采集的多张360度全景图中截取的用于显示街侧区域的窄带图像区域拼接得到的。
在本发明实施例中,i和j可以相同,此时多幅360度全景图与第一区域内的多个子区域一一对应,即该多幅360度全景图分别对应不同的地理位置。i和j也可以不同,例如,第三360度全景图对应第一区域内的第二子区域,第一和第二360度全景图对应第一区域中的第一子区域,这是由于拍摄过程中360度全景相机停止运动在同一位置对同一区域(如第一子区域)连续拍摄了不只一幅360度全景图,或者360度全景相机在拍摄过程中原路返回时继续对重复路段(如第一子区域)进行了拍摄,导致不只一幅360全景图对应同一个地理位置。
120,根据第一对象的标识信息,获取该第一对象的标识信息对应的第二对象,其中该第一对象的标识信息与该第二对象的标识信息具有对应关系。
第一对象的标识信息和第二对象的标识信息能够指示第一对象和第二对象的之间对应关系。它们可以分别存储在各自的描述文件中,第一对象的描述文件和第二对象的描述文件中还可以包括各自的描述信息,如:拍摄图像时的时间信息、图像的宽度信息、图像的方位信息等。第一对象的标识信息和第二对象的标识信息也可以描述在同一个文件中,在文件中通过时间或者地理位置信息来体现它们之间的对应关系,或者可以在该文件中直接将第一对象的标识信息和第二对象的标识信息的对应关系描述出来。
130,呈现第二对象。
因此,本发明实施例的呈现图像的方法,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,能够在360度全景图和条带全景图之间自由切换,丰富用户的观看体验。
优选地,在本发明实施例中,第一对象的标识信息和第二对象的标识信息可以由拍摄第一360度全景图时的时间信息或地理位置信息来表示。
具体而言,条带全景图和360度全景图可以采用360度全景图的描述文件中记录的拍摄时的时间信息进行标识,或者条带全景图和360度全景图可以采用360度全景图的描述文件中记录的拍摄时所在的地理位置信息进行标识。例如,当360度全景图为360度全景视频中的360度全景视频帧时,条带全景图可以直接采用对应的360度全景视频帧的时间信息进行标识。
应理解,第一对象的标识信息和第二对象的标识信息还可以由第一对象和第二对象的序号来表示。
具体而言,条带全景图和360度全景图也可以采用序号进行标识,例如,可以采用具有对应关系的文件序号分别标识条带全景图和360度全景图。
可替代地,作为另一实施例,在120中可以包括:确定第一对象的标识信息对应的第二对象的标识信息;根据第二对象的标识信息,获取第二对象。在本发明实施例中,条带全景图、360度全景图以及它们的标识信息都存储在终端设备上。此时,街侧图与360度全景视频之间的切换过程可以由终端设备本地的各个应用或者各个模块执行。
可选地,作为另一实施例,多幅360度全景图为360全景视频中的多个360度全景视频帧,360度全景视频是采用360度全景相机沿着第一区域所在的道路的延伸方向拍摄的。在110之前,方法100还可以包括:获取360度全景视频,多个360度全景视频帧中第j 360度全景视频帧中包括用于显示第一区域内的第i子区域的正面图像;从多个360度全景视频帧中第j 360度全景视频帧中截取用于显示第一区域内的第i子区域的正面图像;将从多个360度全景视频帧中截取的用于显示第一区域内的多个子区域的正面图像组成第一条带全景图;建立第一条带全景图的标识信息和多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
在本发明实施例中,条带全景图是通过从360度全景视频中的多个连续帧中截取的局部图像区域拼接产生的,条带全景图中的每个图像区域(对应110中的子正面图像)与360度全景视频中的多个连续帧对应,那么条带全景图中的每个图像区域的时间信息或地理位置信息就可以是360度全景视频帧对应的时间信息或地理位置信息。该时间信息可以是360度全景视频帧的采集时间,如采集的相对时间或者绝对时间。该地理位置信息可以是多个360度全景视频帧的地理位置信息。应注意,由于地理位置信息的精度和视频帧的采样精度不同,可能会有多个视频帧对应同一个地理位置信息。
为了建立第一条带全景图的标识信息和360度全景视频帧的标识信息之间的对应关系,第一条带全景图可以用对应的360度全景视频帧的地理位置进行标识,也可以用对应的360度全景视频帧的序号进行标识,也可以用对应的360度全景视频中的多个连续帧的时间区间信息进行标识,或者用对应的360度全景视频帧在360度全景视频流中的位置或指示信息进行标识。
下面给出具体的例子进行描述。第一条带全景图可以采用时间进行标识,如果第一条带全景图对应的360度全景帧的采集时间区间是[t1,t2],该第一条带全景图的时间标识可以是t1,也可以是t1和时间间隔两个属性,也可以为起始时间t1和结束时间t2。第一条带全景图还可以采用地理位置进行标识,比如第一条带全景图对应的360度全景帧的采集地理位置是P1,那么第一条带全景图的标识信息可以是P1或者用于指示P1的其他描述。第一条带全景图的还可以采用序号进行标识,比如用1,2,3…标识第一条带全景图在条带全景中的位置,与该第一条带全景图对应的360度全景视频帧也采用对应的序号进行标识。第一条带全景图还可以采用对应的360度全景视频帧在360全景视频流中的位置或指示信息进行标识,同时在描述文件中增加对应标识的描述,给出第一条带全景图所对应的360全景视频帧的信息,比如对应的360度全景视频帧在360度全景视频流中的位置是用序号或者大小位置(byte range)进行指示的,则第一条带全景图可以采用对应的360全景视频帧的序号或者大小位置进行标识。再者,还可以将条带全景图的标识信息和360全景视频的标识信息在同一个文件中进行描述,使得具有对应关系的条带全景图和360度全景视频分段具有相同或相应的标识信息,例如在第一条带全景图的序号和第一360度全景视频分段的序号相同,那么就可以默认该第一条带全景图和第一360度全景视频分段在时间或者地理位置上是相同的,使得能够根据该对应关系在该条带全景图和360度全景视频分段之间自由切换。
本发明实施例利用360度全景视频的生成条带全景图,能够利用360度全景视频具有的时间特性建立条带全景图与360度全景视频帧的对应关系,从而使得用户可以根据个人兴趣自由的在条带全景图和360度全景图之间切换,提升用户体验。
第一区域可以为道路侧的任一区域,该道路侧可以包括多个第一区域。在本发明实施例中仅以用于显示第一区域的第一条带全景图为例描述利用360度全景视频生成条带全景图的过程,用于显示该道路侧的其他第一区域的条带全景图可以按照上述的方法得到,在此不再赘述。
在本发明实施例中用于显示道路侧的整幅条带全景图可以包括多幅第一条带全景图,通过将用于显示道路侧的整幅条带全景图划分成用于显示道路侧的多个第一区域的多幅第一条带全景图,并将沿整条道路拍摄的整个 360度全景视频划分成对应多个第一区域的多个360度全景视频分段,能够直接切换至用户想要观看的区域对应的条带全景图或360度全景视频分段,而不会切换至整幅条带全景图或整个360度全景视频。这样能够节省查找开销,减少响应时间。
应注意,由于视频在编码过程中会产生随机接入点,视频只能在随机接入点处开始播放,使得视频不能随意分段,必须在随机接入点处划分,因此在将整幅条带全景图划分成多幅第一条带全景图时可以按照360度全景视频分段的方式进行划分。相应地,第一条带全景图的时间信息可以采用对应的360度全景视频分段的时间信息。
在本发明实施例中将道路侧的整幅条带全景图划分成多幅第一条带全景图时,还可以根据预设的时间信息或宽度信息进行划分,使得每幅第一条带全景图对应的时段满足预设的时段要求,或者每幅第一条带全景图对应的宽度满足预设的宽度要求。
可选地,作为另一实施例,从多个360度全景视频帧中第j 360度全景视频帧中截取用于显示第一区域内的第i子区域的正面图像,可以包括:确定拍摄360度全景视频中第j 360度全景视频帧时沿第一区域内的第i子区域的第一方向;确定与第一方向的夹角为90度的第二方向;从360度全景视频中第j 360度全景视频帧中截取在第二方向上拍摄的用于显示第一区域内的第i子区域的正面图像。此时,从360度全景视频帧中截取的是用于显示道路一侧的指定区域的正面图像。
在本发明实施例中,当360度全景相机沿着街侧方向运行时,用于显示街侧区域的正面图像是在与360全景相机的运动方向垂直的方向上拍摄的。此时,可以获取360全景相机的运动方向,确定与360全景相机的运动方向的夹角为90度的第三方向,从360度全景视频中第j 360度全景视频帧中截取在该第三方向上拍摄的用于显示第一区域内的第i子区域的正面图像。
可选地,作为一个实施例,在110中获取第一对象的标识信息之后,方法100还可以包括:确定第一对象的标识信息对应的第二对象的标识信息;向服务器发送第一请求信息,用于请求第二对象,第一请求信息包括第二对象的标识信息。相应地,在120中接收服务器发送的第二对象。在本发明实施例中,第二对象存储在服务器中,终端设备确定待切换的第二对象的标识信息之后,向服务器请求该第二对象的标识信息对应的第二对象。
可替代地,作为另一实施例,在110中获取第一对象的标识信息之后,方法100还可以包括:向服务器发送第二请求信息,用于请求第二对象,第二请求信息包括第一对象的标识信息,以便服务器根据第一对象的标识信息确定第二对象的标识信息,并根据第二对象的标识信息确定第二对象。相应地,在120中接收服务器发送的第二对象。本发明实施例中,第二对象标识信息和第二对象存储在服务器中,终端设备在接收到切换指示后,需要向服务器请求该第一对象的标识信息对应的第二对象。
可选地,作为另一实施例,第一对象为第一360度全景图,第二对象为第一条带全景图,在接收到将正在显示的第一360度全景图切换至第一条带全景图的切换指示之后,方法100还可以包括:获取用于呈现图像的设备的显示分辨率;根据第一对象的标识信息,获取第一对象的标识信息对应的第二对象,包括:根据第一360度全景图的标识信息和显示分辨率,获取包括第一条带全景图的连续的多幅条带全景图,多幅条带全景图组成第一区域所在的第二区域的第二条带全景图,其中,呈现第二对象包括:根据多幅条带全景图的标识信息,呈现多幅条带全景图拼接成的第二条带全景图。
当呈现图像的设备(如终端设备)的显示分辨率高于第一条带图像的分辨率时,可以获取包括该第一条带图像的多幅条带全景图,此时可以呈现多幅条带全景图拼接成的视角更宽的街侧区域的正面图像。
可选地,还可以根据该第一条带全景图在用于显示整条道路的侧景的整幅条带全景图中的位置信息,确定获取哪几幅条带全景图。例如,可以获取以第一条带全景图为中心的前后各i幅条带全景图。
因此,本发明实施例的呈现图像的方法,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
图2示出了根据本发明另一实施例的呈现图像的方法200的示意性流程图。方法200可以由服务器执行。如图2所示,方法200包括如下内容。
210,接收终端设备发送的用于请求第二对象的请求信息,该请求信息包括第一对象的标识信息,其中第一对象和第二对象之一为第一360度全景图,第一对象和第二对象中的另一个为第一条带全景图,第一条带全景图包括用于显示第一区域的多幅子正面图像,多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示第一区域内的 第i子区域的正面图像,第一360度全景图为多幅360全景图之一,i和j为正整数。
220,根据第一对象的标识信息,确定第一对象的标识信息对应的第二对象的标识信息。
230,根据第二对象的标识信息确定第二对象。
240,向终端设备发送第二对象,以便终端设备呈现第二对象。
因此,本发明实施例的呈现图像的方法,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,向终端设备发送待切换的360度全景图或条带全景图,使得终端设备能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
在本发明实施例中,第一对象的标识信息和第二对象的标识信息可以由拍摄第一360度全景图时的时间信息或地理位置信息来表示。具体可以参考图1的方法100中对第一对象的标识信息和第二对象的标识信息的相应描述,在此不再赘述。
可选地,作为另一实施例,多幅360度全景图为360全景视频中的多个360度全景视频帧,360度全景视频是采用360度全景相机沿着第一区域所在的道路的延伸方向拍摄的,在根据第一对象的标识信息,确定第一对象的标识信息对应的第二对象之前,方法还包括:获取360度全景视频,多个360度全景视频帧中第j 360度全景视频帧中包括用于显示第一区域内的第i子区域的正面图像;从多个360度全景视频帧中第j 360度全景视频帧中截取第一区域内的第i子区域的正面图像;将从多个360度全景视频帧中截取的用于显示第一区域内的多个子区域的正面图像拼接成第一条带全景图;建立第一条带全景图的标识信息和多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
第一区域可以为道路侧的任一区域,该道路侧可以包括多个第一区域。在本发明实施例中仅以用于显示第一区域的第一条带全景图为例描述根据360度全景视频生成条带全景图的过程,用于显示该道路侧的其他第一区域的条带全景图可以按照上述的方法得到,在此不再赘述。
在本发明实施例中将道路一侧的整幅条带全景图划分成显示道路侧的多个第一区域的多幅第一条带全景图,将沿整条道路拍摄的整个360度全景视频划分成对应多个第一区域的多个360度全景视频分段,服务器只需将用 户想要观看的区域对应的条带全景图或360度全景视频分段发送至终端设备,无需发送整幅条带全景图或整个360全景视频,能够节省带宽。同时,能够使得终端设备在接收到服务器发送的待切换对象时,无需在整幅条带全景图或整个360度全景视频中查找想要观看的区域,能够节省查找开销,减少响应时间。
应注意,由于视频在编码过程中会产生随机接入点,视频只能在随机接入点处开始播放,使得视频不能随意分段,必须在随机接入点处划分,因此在将整幅条带全景图划分成多幅第一条带全景图时可以按照360度全景视频分段的方式进行划分,相应地,第一条带全景图的时间信息可以采用对应的360度全景视频分段的时间信息。
作为另一实施例,从多个360度全景视频帧中第j 360度全景视频帧中截取第一区域内的第i子区域的正面图像,包括:确定拍摄360度全景视频中第j 360度全景视频帧时沿第一区域内的第i子区域的第一方向;确定与第一方向的夹角为90度的第二方向;从360度全景视频中第j 360度全景视频帧中截取在第二方向上拍摄的用于显示第一区域内的第i子区域的正面图像。此时,从360度全景视频帧中截取的是用于显示道路一侧的指定区域的正面图像。
可选地,作为另一实施例,第一对象为第一360度全景图,第二对象为第一条带全景图,请求信息还包括终端设备的显示分辨率,在根据第一条带全景图的标识信息确定对应的第一条带全景图之后,方法还包括:根据显示分辨率,确定包括第一条带全景图的连续的多幅条带全景图,多幅条带全景图组成第一区域所在的第二区域的第二条带全景图,其中,向终端设备发送第二对象,包括:向终端设备发送包括多幅条带全景图,以便终端设备呈现多幅条带全景图拼接成的第二条带全景图。
当终端设备发送的请求信息中包括终端设备的显示分辨率时,可以向终端设备发送满足终端设备分辨率的包括该第一条带图像的多幅条带全景图,此时以便终端设备呈现多幅条带全景图拼接成的视角更宽的街侧区域的正面图像。
可选地,服务器还可以根据终端设备发送的该第一条带全景图在整幅条带全景图中的位置信息,确定获取哪几幅条带全景图。例如,可以获取以第一条带全景图为中心的前后各i个条带全景图。
因此,本发明实施例的呈现图像的方法,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,向终端设备发送待切换的360度全景图或条带全景图,使得终端设备能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
下面结合图3详细描述根据本发明实施例的生成条带全景图的方法300,在下文中以街侧图作为的条带全景图的具体例子进行描述,该街侧图是由多幅子街侧图拼接而成的。该生成条带全景图的方法300可以由图1所示实施例中的终端设备执行的,也可以由图2所示实施例中的服务器执行的。方法300包括如下内容。
310,获取沿道路延伸方向拍摄的360度全景视频。
320,获取拍摄360度全景视频中第i 360度全景视频帧时360度全景相机所在的街道的信息,例如导航图像或地图信息,确定该街侧的方向Di,然后确定与该街侧方向Di垂直的方向Ai,如图3A所示。
可选地,当全景相机沿着街侧方向运行时,如图3B所示,确定与全景相机的运动方向V垂直的方向Ai
330,从该第i 360度全景视频帧中截取从该指定方向Ai拍摄的街侧区域的子街侧图Pi
从第i 360全景视频帧中截取的图像的宽度X与该全景相机的运动速度V相关,X=f*V,其中f是系数,与图像分辨率有关。或者,从360全景视频帧中截取的子街侧图的宽度X也可以为预设的固定值。本发明实施例对此不做限定。该子街侧图的高度可以为相机拍摄的高度,还可以为预设的固定值。
340,记录从360度全景视频中截取的多幅子街侧图各自的时间信息,该多幅子街侧图各自的时间信息与多个360度全景视频帧的时间信息具有对应关系。
例如,子街侧图的时间信息可以为其所在的360度全景视频帧的时间,还可以是相对于360度全景视频的起始播放时间的相对偏移时间,还可以是全局时间。
根据该多幅子街侧图各自的时间信息,将该多幅子街侧图进行拼接,能够生成该街侧区域的街侧景全景图。
350,将该多幅子街侧图拼接成用于显示较大街侧区域的多幅街侧图进 行存储,以减少图像碎片管理的成本。
例如,将街侧景全景图中的M块子街侧图根据时间信息划分成N个图像段,M>N,使得每个图像段对应的时段满足预设的时段要求。或者,将街侧景全景图中的M幅子街侧图根据宽度信息划分成N幅街侧图,M>N,使得每幅街侧图段对应的宽度满足预设的宽度要求。
或者,当360度全景视频进行分段存储时,还可以按照360度全景视频的分段方式将多个子街侧图组成多幅街侧图,使得每幅街侧图的起始时间采用360度全景视频分段的起始时间,也就是说,每幅街侧图的时间信息可以与对应的360度全景视频分段的时间信息相同。
360,记录街侧图的时间信息。例如,街侧图的时间信息可以是起止时间(ti,ti+k),可以是所覆盖的子街侧图的起始时间,可以是所呈现的图像的中心位置的子街侧图的时间信息,或者还可以是间隔时段,或者也可以是所覆盖的任一子街侧图的时间信息。
可选地,还可以记录街侧图的描述信息,街侧图的描述信息可以包括该街侧图所覆盖的全部子街侧图的描述信息。或者,街侧图的描述信息也可以为具有代表性的子街侧图的描述信息。该描述信息可以包括:位置信息,例如位置坐标(xi,yi),其中,xi表示该子街侧图在整个街侧景全景图中的水平方向的位置坐标,yi为该子街侧图的高度,或者位置信息仅为xi。该描述信息还可以包括方位信息,该方位信息可以表示街侧图在360度全景视频中的位置。当存在沿街道两侧的街侧图时,能够根据街侧图的方位信息准确切换至用户想要观看的街道一侧的街侧图。街侧图的描述信息还可以包括街侧图的宽度信息和高度信息。街侧图的宽度信息可以是该街侧图所覆盖的所有子街侧图的宽度之和。该街侧图的描述信息还可以包括子街侧图的标识(如序号)。
存储得到的多幅街侧图及该多幅街侧图各自的描述信息。应理解,多幅街侧图和街侧图各自的描述信息可以分开单独存储,也可以放在一起存储。多幅街侧图可以拼接成街侧区域的全景图存储,也可以将该多幅街侧图单独存储。
本发明实施例利用360度全景视频的生成条街侧图,能够利用360度全景视频具有的时间特性建立街侧图与360度全景视频帧的对应关系,使得用户可以根据个人兴趣自由的在街侧图和360度全景图之间切换,从而能够提 升用户体验。
下面将结合图4和图5,对根据本发明实施例的呈现图像的方法进行进一步的说明。下文中的街侧图可以根据生成条带全景图的方法300生成。
图4示出了根据本发明一个实施例的呈现图像的方法。以360度全景视频切换到街侧图的过程为例进行描述。在图4中以终端设备和服务器为例进行描述。应理解,终端设备和服务器分别执行的动作还可以由终端设备本地的各个应用或者模块执行。
410,终端设备呈现360度全景视频,接收到用户要观看街侧图的切换指示。
420,终端设备获取当前时刻的360度全景视频的播放时间Tp
430,终端设备根据Tp,获取与Tp对应的街侧图Sp的时间信息。
例如,街侧图Sp的时间信息包含Tp,或者街侧图Sp的时间信息包含与Tp最接近的时间点。
可选地,终端设备还可以获取显示分辨率以及街侧图Sp的位置信息,并以街侧图Sp为中心图像,根据终端的显示分辨率以及街侧图Sp的位置信息,获取满足终端播放需求的所有街侧图Sp-i…Sp…Sp+i的信息。
还应理解,若待切换的街侧图包括沿街道两侧的街侧图时,在步骤420中终端设备还可以获取用户要观看的街侧图的方位信息,例如该街侧图的方位信息可以表示用户选择的位置对应的街道的一侧。此时在步骤430中终端设备根据待切换的街侧图的方位信息,确定用户要观看的街侧图的描述信息,然后根据Tp,获取与Tp对应的街侧图Sp的时间信息。
440,终端设备向服务器发送街侧图请求信息,请求当前播放的360度全景视频对应的街侧图。
例如,该街侧图请求信息可以包括(Sp,i),表示请求以Sp为中心的前后各i个街侧图。该街侧图请求信息还可以以其他的形式呈现,比如连续发送Sp-i…Sp…Sp+i的请求信息,或者该街侧图请求信息中包含Sp和2*i+1的值或者包含Sp-i和2*i+1的值。
该街侧图请求信息还可以包括终端设备的信息,如显示分辨率、终端型号、缓冲器(buffer)等。以便服务器确定满足终端设备性能的街侧图。
450,服务器接收终端设备发送的请求信息,并向终端设备发送对应的街侧图。
460,终端设备接收该街侧图并呈现出来。
应理解,如图5所示,即终端设备在执行步骤420之后可以直接向服务器发送街侧图请求信息,该街侧图请求信息至少包括360度全景视频的播放时间Tp,应理解,该请求信息还可以包括终端设备的显示分辨率、街侧图在360全景视频中的方位信息和街侧图在街侧景全景图中的位置信息。相应地,服务器可以根据Tp和方位信息确定Tp对应的街侧图Sp,还可以根据终端设备的显示分辨率以及街侧图的位置信息确定满足终端设备播放需求的所有街侧图Sp-i…Sp…Sp+i
本发明实施例中,根据360度全景视频与街侧图之间的对应关系,通过终端设备与服务器之间的交互,能够实现360度全景视频与街侧图之间的自由切换。
图6示出了根据本发明另一实施例的呈现图像的方法。以从街侧图切换到360度全景视频的过程的为例进行描述。在图6中仍以终端设备和服务器为例进行描述。应理解,终端设备和服务器分别执行的动作还可以由终端设备本地的各个应用或者模块执行。
610,终端设备呈现街侧图,接收到用户要观看360全景视频的切换指示。
620,终端设备获取当前时刻的街侧图的时间信息Tp
Tp可以是所呈现的街侧图的中心位置的子街侧图的时间信息。
可替代地,Tp还可以是当前所呈现的街侧图覆盖的时段中的任何一个时间点的时间信息。例如,街侧图所覆盖的时间区间是[t1,t10],则Tp可以是区间[t1,t10]内的任何时间点。
630,终端设备根据Tp,获取与Tp对应的360度全景视频分段Qp的时间信息。
例如,360度全景视频分段Qp的时间信息包含Tp,或者360度全景视频分段Qp的时间信息包含与Tp最接近的时刻。
可替代地,终端设备还可以根据Tp,获取起始时间小于或等于Tp的随机接入点对应的360全景视频分段Qp的时间信息。
640,终端设备向服务器发送请求信息,请求与当前播放的街侧图对应的360度全景视频分段。
该请求信息可以包括360度全景视频分段Qp的时间信息。该请求信息 还可以包括终端设备的信息,如显示分辨率、终端型号、缓冲器(buffer)等。以便服务器确定满足终端设备性能的360度全景视频分段。
650,服务器接收终端设备发送请求信息,并向终端设备发送与街侧图对应的360度全景视频分段。
660,终端设备接收服务器发送的360度全景视频分段,并呈现出来。
本发明实施例中,根据360度全景视频与街侧图之间的对应关系,通过终端设备与服务器之间的交互,能够实现360度全景视频与街侧图之间的自由切换。
应理解,如图7所示,终端设备在执行步骤620之后直接向服务器发送360度全景视频的请求信息。此时,终端设备向服务器发送的请求信息至少包括街侧图的时间信息Tp,应理解,该请求信息还可以包括终端设备的显示分辨率。相应地,在步骤640中,服务器可以根据Tp确定与Tp对应的360度全景视频分段Qp
图8是根据本发明一个实施例的终端设备800的示意性框图。如图8所示,终端设备800包括:获取模块810和显示模块820。
获取模块810,用于在接收到将正在显示的第一对象切换至第二对象的切换指示时,获取该第一对象的标识信息,其中该第一对象和该第二对象之一为第一360度全景图,该第一对象和该第二对象中的另一个为第一条带全景图,该第一条带全景图包括用于显示第一区域的多幅子正面图像,该多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j360度全景图中用于显示该第一区域内的第i子区域的正面图像,该第一360度全景图为该多幅360度全景图之一,i和j为正整数。
该获取模块810还用于,根据该第一对象的标识信息,获取该第一对象的标识信息对应的该第二对象,其中该第一对象的标识信息与该第二对象的标识信息具有对应关系。
显示模块820,用于呈现该第二对象。
因此,本发明实施例的终端设备,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
可选地,作为另一实施例,如图9所示,终端设备800还包括:第二确定模块830,用于确定该第一对象的标识信息对应的该第二对象的标识信息。 其中,该获取模块810具体用于,根据该第二对象的标识信息,获取该第二对象。
可选地,作为另一实施例,该多幅360度全景图为360全景视频中的多个360度全景视频帧,该360度全景视频是采用360度全景相机沿着该第一区域所在的道路的延伸方向拍摄的。该获取模块810还用于,在获取该第一对象的标识信息之前,获取该360度全景视频,该多个360度全景视频帧中第j 360度全景视频帧中包括用于显示该第一区域内的第i子区域的正面图像。终端设备800还包括:截取模块840,用于从该多个360度全景视频帧中第j 360度全景视频帧中截取用于显示该第一区域内的第i子区域的正面图像;拼接模块850,用于将从该多个360度全景视频帧中截取的用于显示该第一区域内的多个子区域的正面图像拼接成该第一条带全景图;关系模块860,用于建立该第一条带全景图的标识信息和该多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
在本发明实施例中,第二确定模块830还可以用于:确定拍摄该360度全景视频中第j 360度全景视频帧时沿该第一区域内的第i子区域的第一方向;确定与该第一方向的夹角为90度的第二方向。截取模块840可以具体用于,从该360度全景视频中第j 360度全景视频帧中截取在该第二确定模块确定的该第二方向上拍摄的用于显示该第一区域内的第i子区域的正面图像。
可选地,作为另一实施例,如图10所示,终端设备800还可以包括:第一确定模块870,用于在该获取模块获取该第一对象的标识信息之后,确定该第一对象的标识信息对应的该第二对象的标识信息;第一发送模块880,用于向服务器发送第一请求信息,用于请求该第二对象,该第一请求信息包括该第二对象的标识信息。其中,该获取模块810具体用于接收该服务器发送的该第二对象。
可选地,作为另一实施例,如图11所示,终端设备800还可以包括:第二发送模块890,用于在该获取模块获取该第一对象的标识信息之后,向服务器发送第二请求信息,用于请求该第二对象,该第二请求信息包括该第一对象的标识信息,以便该服务器根据该第一对象的标识信息确定该第二对象的标识信息,并根据该第二对象的标识信息确定该第二对象。其中,该获取模块810具体用于接收该服务器发送的该第二对象。
可选地,作为另一实施例,该第一对象为第一360度全景图,该第二对象为第一条带全景图。该获取模块810还用于,在接收到将正在显示的该第一360度全景图切换至该第一条带全景图的切换指示之后,获取用于呈现该第一条带全景图的设备的显示分辨率。该获取模块810具体用于,根据该第一360度全景图的标识信息和该显示分辨率,获取包括该第一条带全景图的连续的多幅条带全景图,该多幅条带全景图组成该第一区域所在的第二区域的第二条带全景图。该显示模块820具体用于,根据该多幅条带全景图的标识信息,呈现该多幅条带全景图拼接成的该第二条带全景图。
在本发明实施例中,该第一对象的标识信息和该第二对象的标识信息可以由拍摄该第一360度全景图时的时间信息或地理位置信息来表示。
应理解,根据本发明实施例的终端设备800可对应于本发明实施例中的终端设备,并且终端设备800中的各个模块的上述和其它操作和/或功能分别为了实现图1的方法100的相应流程,为了简洁,在此不再赘述。
因此,本发明实施例的终端设备,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
图12示出了根据本发明一个实施例的服务器1200的示意性结构图。如图12所示,服务器1200包括:接收模块1210、确定模块1220和发送模块1230。
接收模块1210,用于接收终端设备发送的用于请求第二对象的请求信息,该请求信息包括第一对象的标识信息,其中该第一对象和该第二对象之一为第一360度全景图,该第一对象和该第二对象中的另一个为第一条带全景图,该第一条带全景图包括用于显示第一区域的多幅子正面图像,该多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示该第一区域内的第i子区域的正面图像,该第一360度全景图为该多幅360全景图之一,i和j为正整数。
确定模块1220,用于根据该第一对象的标识信息,确定该第一对象的标识信息对应的该第二对象的标识信息。
确定模块1220还用于根据该第二对象的标识信息确定该第二对象。
发送模块1230,用于向该终端设备发送该第二对象,以便该终端设备呈现该第二对象。
因此,本发明实施例的服务器,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,向终端设备发送待切换的360度全景图或条带全景图,使得终端设备能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
可选地,作为另一实施例,如图13所示,多幅360度全景图为360全景视频中的多个360度全景视频帧,该360度全景视频是采用360度全景相机沿着该第一区域所在的道路的延伸方向拍摄的。该服务器1200还包括:获取模块1240,用于在该确定模块确定该第一对象的标识信息对应的该第二对象之前,获取该360度全景视频,该多个360度全景视频帧中第j 360度全景视频帧中包括用于显示该第一区域内的第i子区域的正面图像;截取模块1250,用于从该多个360度全景视频帧中第j 360度全景视频帧中截取该第一区域内的第i子区域的正面图像;拼接模块1260,用于将从该多个360度全景视频帧中截取的用于显示该第一区域内的多个子区域的正面图像拼接成该第一条带全景图;关系模块1270,用于建立该第一条带全景图的标识信息和该多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
在本发明实施例中,确定模块1220还用于:确定拍摄该360度全景视频中第j 360度全景视频帧时沿该第一区域内的第i子区域的第一方向;确定与该第一方向的夹角为90度的第二方向。该截取模块1250具体用于从该360度全景视频中第j 360度全景视频帧中截取在该第二方向上拍摄的用于显示该第一区域内的第i子区域的正面图像。
可选地,作为另一实施例,该第一对象为第一360度全景图,该第二对象为第一条带全景图,该请求信息还包括该终端设备的显示分辨率。确定模块1220还用于,在该确定模块确定该第一条带全景图的标识信息对应的该第一条带全景图之后,根据该显示分辨率,确定包括该第一条带全景图的连续的多幅条带全景图,该多幅条带全景图组成该第一区域所在的第二区域的第二条带全景图。发送模块1230具体用于,向该终端设备发送包括该多幅条带全景图,以便该终端设备呈现该多幅条带全景图拼接成的该第二条带全景图。
在本发明实施例中,该第一对象的标识信息和该第二对象的标识信息可以由拍摄该第一360度全景图时的时间信息或地理位置信息来表示。
应理解,根据本发明实施例的服务器1200可对应于本发明实施例中的服务器,并且服务器1200中的各个模块的上述和其它操作和/或功能分别为了实现图2的方法200的相应流程,为了简洁,在此不再赘述。
因此,本发明实施例的服务器,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,向终端设备发送待切换的360度全景图或条带全景图,使得终端设备能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
图14示出了根据本发明另一实施例的终端设备1400的示意性框图。如图14所述,终端设备1400包括:处理器1410、存储器1420、总线系统1430和显示器1440。其中,处理器1410、存储器1420和显示器1440通过总线系统1430相连,该存储器1420用于存储指令,该处理器2100通过该总线系统2300,执行该存储器1420中存储的该指令。
处理器1410用于:在接收到将正在显示的第一对象切换至第二对象的切换指示时,获取该第一对象的标识信息,其中该第一对象和该第二对象之一为第一360度全景图,该第一对象和该第二对象中的另一个为第一条带全景图,该第一条带全景图包括用于显示第一区域的多幅子正面图像,该多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j360度全景图中用于显示该第一区域内的第i子区域的正面图像,该第一360度全景图为该多幅360度全景图之一,i和j为正整数;根据该第一对象的标识信息,获取该第一对象的标识信息对应的该第二对象,其中该第一对象的标识信息与该第二对象的标识信息具有对应关系。
显示器1440用于呈现该第二对象。
因此,本发明实施例的终端设备,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
应理解,在本发明实施例中,该处理器1410可以是中央处理单元(Central Processing Unit,CPU),该处理器1410还可以是其他通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
该存储器1420可以包括只读存储器和随机存取存储器,并向处理器 1410提供指令和数据。存储器1420的一部分还可以包括非易失性随机存取存储器。例如,存储器1420还可以存储设备类型的信息。
该总线系统1430除包括数据总线之外,还可以包括电源总线、控制总线和状态信号总线等。但是为了清楚说明起见,在图中将各种总线都标为总线系统1430。
在实现过程中,上述方法的各步骤可以通过处理器1410中的硬件的集成逻辑电路或者软件形式的指令完成。结合本发明实施例所公开的方法的步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器1420,处理器1410读取存储器1420中的信息,结合其硬件完成上述方法的步骤。为避免重复,这里不再详细描述。
可选地,作为另一实施例,处理器1410具体用于:确定该第一对象的标识信息对应的该第二对象的标识信息;根据该第二对象的标识信息,获取该第二对象。
可选地,作为另一实施例,多幅360度全景图为360全景视频中的多个360度全景视频帧,该360度全景视频是采用360度全景相机沿着该第一区域所在的道路的延伸方向拍摄的。处理器1410在该获取该第一对象的标识信息之前,还用于:获取该360度全景视频,该多个360度全景视频帧中第j 360度全景视频帧中包括用于显示该第一区域内的第i子区域的正面图像;从该多个360度全景视频帧中第j 360度全景视频帧中截取用于显示该第一区域内的第i子区域的正面图像;将从该多个360度全景视频帧中截取的用于显示该第一区域内的多个子区域的正面图像拼接成该第一条带全景图;建立该第一条带全景图的标识信息和该多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
在本发明实施例中,处理器1410具体用于,确定拍摄360度全景视频中第j 360度全景视频帧时沿该第一区域内的第i子区域的第一方向;确定与该第一方向的夹角为90度的第二方向;从该360度全景视频中第j 360度全景视频帧中截取在该第二方向上拍摄的用于显示该第一区域内的第i子区域的正面图像。
可选地,作为另一实施例,如图15所示,终端设备1400还包括收发器 1450。处理器1410还用于,在获取第一对象的标识信息之后,确定该第一对象的标识信息对应的该第二对象的标识信息。收发器1450用于:向服务器发送第一请求信息,用于请求该第二对象,该第一请求信息包括该第二对象的标识信息;接收该服务器发送的该第二对象。
可选地,作为另一实施例,收发器1450用于:在获取该第一对象的标识信息之后,向服务器发送第二请求信息,用于请求该第二对象,该第二请求信息包括该第一对象的标识信息,以便该服务器根据该第一对象的标识信息确定该第二对象的标识信息,并根据该第二对象的标识信息确定该第二对象;接收该服务器发送的该第二对象。
可选地,作为另一实施例,第一对象为第一360度全景图,第二对象为第一条带全景图。在接收到将正在显示的该第一360度全景图切换至该第一条带全景图的切换指示之后,处理器1410还用于:获取用于呈现该第一条带全景图的设备的显示分辨率。处理器1410具体用于,根据该第一360度全景图的标识信息和该显示分辨率,获取包括该第一条带全景图的连续的多幅条带全景图,该多幅条带全景图组成该第一区域所在的第二区域的第二条带全景图。显示器1440具体用于呈现该多幅条带全景图拼接成的该第二条带全景图。
在本发明实施例中,第一对象的标识信息和第二对象的标识信息可以由拍摄该第一360度全景图时的时间信息或地理位置信息来表示。
应理解,根据本发明实施例的终端1400可对应于本发明实施例的呈现图像的方法中的终端设备以及根据本发明实施例的终端设备800,并且终端设备1400中的各个模块的上述和其它操作和/或功能分别为了实现图1的方法100的相应流程,为了简洁,在此不再赘述。
因此,本发明实施例的终端设备,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
图16示出了根据本发明另一实施例的服务器1600的示意性框图。如图16所示,服务器1600包括:处理器1610、存储器1620、总线系统1630和收发器1640。其中,处理器1610、存储器1620和收发器1640通过总线系统1630相连,该存储器1620用于存储指令,该处理器1610通过该总线系统1630,执行该存储器1620中存储的该指令。
收发器1640用于接收终端设备发送的用于请求第二对象的请求信息,该请求信息包括第一对象的标识信息,其中该第一对象和该第二对象之一为第一360度全景图,该第一对象和该第二对象中的另一个为第一条带全景图,该第一条带全景图包括用于显示第一区域的多幅子正面图像,该多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示该第一区域内的第i子区域的正面图像,该第一360度全景图为该多幅360全景图之一,i和j为正整数。处理器1610用于:根据该第一对象的标识信息,确定该第一对象的标识信息对应的该第二对象的标识信息;根据该第二对象的标识信息确定该第二对象。收发器1640还用于向该终端设备发送该第二对象,以便该终端设备呈现该第二对象。
因此,本发明实施例的服务器,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,向终端设备发送待切换的360度全景图或条带全景图,使得终端设备能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
应理解,在本发明实施例中,该处理器1610可以是中央处理单元(Central Processing Unit,CPU),该处理器1610还可以是其他通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
该存储器1620可以包括只读存储器和随机存取存储器,并向处理器1610提供指令和数据。存储器1620的一部分还可以包括非易失性随机存取存储器。例如,存储器1620还可以存储设备类型的信息。
该总线系统1630除包括数据总线之外,还可以包括电源总线、控制总线和状态信号总线等。但是为了清楚说明起见,在图中将各种总线都标为总线系统1630。
在实现过程中,上述方法的各步骤可以通过处理器1610中的硬件的集成逻辑电路或者软件形式的指令完成。结合本发明实施例所公开的方法的步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器1620,处理器1610读取存储器1620中的信息, 结合其硬件完成上述方法的步骤。为避免重复,这里不再详细描述。
可选地,作为另一实施例,多幅360度全景图为360全景视频中的多个360度全景视频帧,360度全景视频是采用360度全景相机沿着该第一区域所在的道路的延伸方向拍摄的。处理器1610还用于:在确定该第一对象的标识信息对应的该第二对象之前,获取该360度全景视频,该多个360度全景视频帧中第j 360度全景视频帧中包括用于显示该第一区域内的第i子区域的正面图像;从该多个360度全景视频帧中第j 360度全景视频帧中截取该第一区域内的第i子区域的正面图像;将从该多个360度全景视频帧中截取的用于显示该第一区域内的多个子区域的正面图像组成该第一条带全景图;建立该第一条带全景图的标识信息和该多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
在本发明实施例中,处理器1610可以具体用于:确定拍摄该360度全景视频中第j 360度全景视频帧时沿该第一区域内的第i子区域的第一方向;确定与该第一方向的夹角为90度的第二方向;从该360度全景视频中第j 360度全景视频帧中截取在该第二方向上拍摄的用于显示该第一区域内的第i子区域的正面图像。
可选地,作为另一实施例,第一对象为第一360度全景图,第二对象为第一条带全景图,该请求信息还包括该终端设备的显示分辨率。处理器1610还可以用于,在确定该第一条带全景图的标识信息对应的该第一条带全景图之后,根据该显示分辨率,确定包括该第一条带全景图的连续的多幅条带全景图,该多幅条带全景图组成该第一区域所在的第二区域的第二条带全景图。收发器1640具体用于向该终端设备发送包括该多幅条带全景图,以便该终端设备呈现该多幅条带全景图拼接成的该第二条带全景图。
在本发明实施例中,该第一对象的标识信息和该第二对象的标识信息由拍摄该第一360度全景图时的时间信息或地理位置信息来表示。
应理解,根据本发明实施例的服务器1600可对应于本发明实施例的呈现图像的方法中的服务器以及根据本发明实施例的服务器1200,并且终端设备1600中的各个模块的上述和其它操作和/或功能分别为了实现图2的方法200的相应流程,为了简洁,在此不再赘述。
因此,本发明实施例的服务器,根据360度全景图的标识信息和条带全景图的标识信息之间的对应关系,向终端设备发送待切换的360度全景图或 条带全景图,使得终端设备能够在360度全景图和条带全景图之间自由切换,从而能够丰富用户的观看体验。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、 随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准。

Claims (26)

  1. 一种呈现图像的方法,其特征在于,包括:
    在接收到将正在显示的第一对象切换至第二对象的切换指示时,获取所述第一对象的标识信息,其中所述第一对象和所述第二对象之一为第一360度全景图,所述第一对象和所述第二对象中的另一个为第一条带全景图,所述第一条带全景图包括用于显示第一区域的多幅子正面图像,所述多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j360度全景图中用于显示所述第一区域内的第i子区域的正面图像,所述第一360度全景图为所述多幅360度全景图之一,i和j为正整数;
    根据所述第一对象的标识信息,获取所述第一对象的标识信息对应的所述第二对象,其中所述第一对象的标识信息与所述第二对象的标识信息具有对应关系;
    呈现所述第二对象。
  2. 根据权利要求1所述的方法,其特征在于,在所述获取所述第一对象的标识信息之后,所述方法还包括:
    确定所述第一对象的标识信息对应的所述第二对象的标识信息;
    向服务器发送第一请求信息,用于请求所述第二对象,所述第一请求信息包括所述第二对象的标识信息,
    其中,所述获取所述第一对象的标识信息对应的所述第二对象,包括:
    接收所述服务器发送的所述第二对象。
  3. 根据权利要求1所述的方法,其特征在于,在所述获取所述第一对象的标识信息之后,所述方法还包括:
    向服务器发送第二请求信息,用于请求所述第二对象,所述第二请求信息包括所述第一对象的标识信息,以便所述服务器根据所述第一对象的标识信息确定所述第二对象的标识信息,并根据所述第二对象的标识信息确定所述第二对象,
    其中,所述获取所述第一对象的标识信息对应的第二对象包括:
    接收所述服务器发送的所述第二对象。
  4. 根据权利要求1所述的方法,其特征在于,所述根据所述第一对象的标识信息,获取所述第一对象的标识信息对应的所述第二对象,包括:
    确定所述第一对象的标识信息对应的所述第二对象的标识信息;
    根据所述第二对象的标识信息,获取所述第二对象。
  5. 根据权利要求4所述的方法,其特征在于,所述多幅360度全景图为360全景视频中的多个360度全景视频帧,所述360度全景视频是采用360度全景相机沿着所述第一区域所在的道路的延伸方向拍摄的,
    在所述获取所述第一对象的标识信息之前,所述方法还包括:
    获取所述360度全景视频,所述多个360度全景视频帧中第j360度全景视频帧中包括用于显示所述第一区域内的第i子区域的正面图像;
    从所述多个360度全景视频帧中第j360度全景视频帧中截取用于显示所述第一区域内的第i子区域的正面图像;
    将从所述多个360度全景视频帧中截取的用于显示所述第一区域内的多个子区域的正面图像拼接成所述第一条带全景图;
    建立所述第一条带全景图的标识信息和所述多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
  6. 根据权利要求5所述的方法,其特征在于,所述从所述多个360度全景视频帧中第j360度全景视频帧中截取用于显示所述第一区域内的第i子区域的正面图像,包括:
    确定拍摄所述360度全景视频中第j360度全景视频帧时沿所述第一区域内的第i子区域的第一方向;
    确定与所述第一方向的夹角为90度的第二方向;
    从所述360度全景视频中第j360度全景视频帧中截取在所述第二方向上拍摄的用于显示所述第一区域内的第i子区域的正面图像。
  7. 根据权利要求1至6中任一项所述的方法,其特征在于,所述第一对象为第一360度全景图,所述第二对象为第一条带全景图,在所述接收到将正在显示的所述第一360度全景图切换至所述第一条带全景图的切换指示之后,所述方法还包括:
    获取用于呈现所述第一条带全景图的设备的显示分辨率;
    所述根据所述第一对象的标识信息,获取所述第一对象的标识信息对应的所述第二对象,包括:
    根据所述第一360度全景图的标识信息和所述显示分辨率,获取包括所述第一条带全景图的连续的多幅条带全景图,所述多幅条带全景图组成所述 第一区域所在的第二区域的第二条带全景图,
    其中,所述呈现所述第二对象包括:
    根据所述多幅条带全景图的标识信息,呈现所述多幅条带全景图拼接成的所述第二条带全景图。
  8. 根据权利要求1至7中任一项所述的方法,其特征在于,所述第一对象的标识信息和所述第二对象的标识信息由拍摄所述第一360度全景图时的时间信息或地理位置信息来表示。
  9. 一种呈现图像的方法,其特征在于,包括:
    接收终端设备发送的用于请求第二对象的请求信息,所述请求信息包括第一对象的标识信息,其中所述第一对象和所述第二对象之一为第一360度全景图,所述第一对象和所述第二对象中的另一个为第一条带全景图,所述第一条带全景图包括用于显示第一区域的多幅子正面图像,所述多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j360度全景图中用于显示所述第一区域内的第i子区域的正面图像,所述第一360度全景图为所述多幅360全景图之一,i和j为正整数;
    根据所述第一对象的标识信息,确定所述第一对象的标识信息对应的所述第二对象的标识信息;
    根据所述第二对象的标识信息确定所述第二对象;
    向所述终端设备发送所述第二对象,以便所述终端设备呈现所述第二对象。
  10. 根据权利要求9所述的方法,其特征在于,所述多幅360度全景图为360全景视频中的多个360度全景视频帧,所述360度全景视频是采用360度全景相机沿着所述第一区域所在的道路的延伸方向拍摄的,
    在所述根据所述第一对象的标识信息,确定所述第一对象的标识信息对应的所述第二对象之前,所述方法还包括:
    获取所述360度全景视频,所述多个360度全景视频帧中第j360度全景视频帧中包括用于显示所述第一区域内的第i子区域的正面图像;
    从所述多个360度全景视频帧中第j360度全景视频帧中截取所述第一区域内的第i子区域的正面图像;
    将从所述多个360度全景视频帧中截取的用于显示所述第一区域内的多个子区域的正面图像拼接成所述第一条带全景图;
    建立所述第一条带全景图的标识信息和所述多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
  11. 根据权利要求10所述的方法,其特征在于,所述从所述多个360度全景视频帧中第j360度全景视频帧中截取所述第一区域内的第i子区域的正面图像,包括:
    确定拍摄所述360度全景视频中第j360度全景视频帧时沿所述第一区域内的第i子区域的第一方向;
    确定与所述第一方向的夹角为90度的第二方向;
    从所述360度全景视频中第j360度全景视频帧中截取在所述第二方向上拍摄的用于显示所述第一区域内的第i子区域的正面图像。
  12. 根据权利要求9至11中任一项所述的方法,其特征在于,所述第一对象为第一360度全景图,所述第二对象为第一条带全景图,所述请求信息还包括所述终端设备的显示分辨率,
    在确定所述第一条带全景图的标识信息对应的所述第一条带全景图之后,所述方法还包括:
    根据所述显示分辨率,确定包括所述第一条带全景图的连续的多幅条带全景图,所述多幅条带全景图组成所述第一区域所在的第二区域的第二条带全景图,
    其中,所述向所述终端设备发送所述第二对象,包括:
    向所述终端设备发送包括所述多幅条带全景图,以便所述终端设备呈现所述多幅条带全景图拼接成的所述第二条带全景图。
  13. 根据权利要求9至12中任一项所述的方法,其特征在于,所述第一对象的标识信息和所述第二对象的标识信息由拍摄所述第一360度全景图时的时间信息或地理位置信息来表示。
  14. 一种终端设备,其特征在于,包括:
    获取模块,用于在接收到将正在显示的第一对象切换至第二对象的切换指示时,获取所述第一对象的标识信息,其中所述第一对象和所述第二对象之一为第一360度全景图,所述第一对象和所述第二对象中的另一个为第一条带全景图,所述第一条带全景图包括用于显示第一区域的多幅子正面图像,所述多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j360度全景图中用于显示所述第一区域内的第i子区域的正面图 像,所述第一360度全景图为所述多幅360度全景图之一,i和j为正整数;
    所述获取模块还用于,根据所述第一对象的标识信息,获取所述第一对象的标识信息对应的所述第二对象,其中所述第一对象的标识信息与所述第二对象的标识信息具有对应关系;
    显示模块,用于呈现所述第二对象。
  15. 根据权利要求14所述的终端设备,其特征在于,还包括:
    第一确定模块,用于在所述获取模块获取所述第一对象的标识信息之后,确定所述第一对象的标识信息对应的所述第二对象的标识信息;
    第一发送模块,用于向服务器发送第一请求信息,用于请求所述第二对象,所述第一请求信息包括所述第二对象的标识信息,
    其中,所述获取模块具体用于接收所述服务器发送的所述第二对象。
  16. 根据权利要求14所述的终端设备,其特征在于,还包括:
    第二发送模块,用于在所述获取模块获取所述第一对象的标识信息之后,向服务器发送第二请求信息,用于请求所述第二对象,所述第二请求信息包括所述第一对象的标识信息,以便所述服务器根据所述第一对象的标识信息确定所述第二对象的标识信息,并根据所述第二对象的标识信息确定所述第二对象,
    其中,所述获取模块具体用于接收所述服务器发送的所述第二对象。
  17. 根据权利要求14所述的终端设备,其特征在于,还包括:
    第二确定模块,用于确定所述第一对象的标识信息对应的所述第二对象的标识信息,
    其中,所述获取模块具体用于,根据所述第二对象的标识信息,获取所述第二对象。
  18. 根据权利要求17所述的终端设备,其特征在于,所述多幅360度全景图为360全景视频中的多个360度全景视频帧,所述360度全景视频是采用360度全景相机沿着所述第一区域所在的道路的延伸方向拍摄的,
    所述获取模块还用于,在获取所述第一对象的标识信息之前,获取所述360度全景视频,所述多个360度全景视频帧中第j360度全景视频帧中包括用于显示所述第一区域内的第i子区域的正面图像;
    所述终端设备还包括:
    截取模块,用于从所述多个360度全景视频帧中第j360度全景视频帧 中截取用于显示所述第一区域内的第i子区域的正面图像;
    拼接模块,用于将从所述多个360度全景视频帧中截取的用于显示所述第一区域内的多个子区域的正面图像拼接成所述第一条带全景图;
    关系模块,用于建立所述第一条带全景图的标识信息和所述多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
  19. 根据权利要求18所述的终端设备,其特征在于,所述第二确定模块还用于:确定拍摄所述360度全景视频中第j360度全景视频帧时沿所述第一区域内的第i子区域的第一方向;确定与所述第一方向的夹角为90度的第二方向,
    所述截取模块具体用于,从所述360度全景视频中第j360度全景视频帧中截取在所述第二确定模块确定的所述第二方向上拍摄的用于显示所述第一区域内的第i子区域的正面图像。
  20. 根据权利要求14至19中任一项所述的终端设备,其特征在于,所述第一对象为第一360度全景图,所述第二对象为第一条带全景图,
    所述获取模块还用于,在接收到将正在显示的所述第一360度全景图切换至所述第一条带全景图的切换指示之后,获取用于呈现所述第一条带全景图的设备的显示分辨率,
    所述获取模块具体用于,根据所述第一360度全景图的标识信息和所述显示分辨率,获取包括所述第一条带全景图的连续的多幅条带全景图,所述多幅条带全景图组成所述第一区域所在的第二区域的第二条带全景图,
    所述显示模块具体用于,根据所述多幅条带全景图的标识信息,呈现所述多幅条带全景图拼接成的所述第二条带全景图。
  21. 根据权利要求14至20中任一项所述的终端设备,其特征在于,所述第一对象的标识信息和所述第二对象的标识信息由拍摄所述第一360度全景图时的时间信息或地理位置信息来表示。
  22. 一种服务器,其特征在于,包括:
    接收模块,用于接收终端设备发送的用于请求第二对象的请求信息,所述请求信息包括第一对象的标识信息,其中所述第一对象和所述第二对象之一为第一360度全景图,所述第一对象和所述第二对象中的另一个为第一条带全景图,所述第一条带全景图包括用于显示第一区域的多幅子正面图像,所述多幅子正面图像中的第i子正面图像对应于多幅360度全景图中的第j 360度全景图中用于显示所述第一区域内的第i子区域的正面图像,所述第一360度全景图为所述多幅360全景图之一,i和j为正整数;
    确定模块,用于根据所述第一对象的标识信息,确定所述第一对象的标识信息对应的所述第二对象的标识信息,
    所述确定模块还用于根据所述第二对象的标识信息确定所述第二对象;
    发送模块,用于向所述终端设备发送所述第二对象,以便所述终端设备呈现所述第二对象。
  23. 根据权利要求22所述的服务器,其特征在于,所述多幅360度全景图为360全景视频中的多个360度全景视频帧,所述360度全景视频是采用360度全景相机沿着所述第一区域所在的道路的延伸方向拍摄的,
    所述服务器还包括:
    获取模块,用于在所述确定模块确定所述第一对象的标识信息对应的所述第二对象之前,获取所述360度全景视频,所述多个360度全景视频帧中第j360度全景视频帧中包括用于显示所述第一区域内的第i子区域的正面图像;
    截取模块,用于从所述多个360度全景视频帧中第j360度全景视频帧中截取所述第一区域内的第i子区域的正面图像;
    拼接模块,用于将从所述多个360度全景视频帧中截取的用于显示所述第一区域内的多个子区域的正面图像拼接成所述第一条带全景图;
    关系模块,用于建立所述第一条带全景图的标识信息和所述多个360度全景视频帧中第一360度全景视频帧的标识信息之间的对应关系。
  24. 根据权利要求23所述的服务器,其特征在于,所述确定模块还用于:确定拍摄所述360度全景视频中第j360度全景视频帧时沿所述第一区域内的第i子区域的第一方向;确定与所述第一方向的夹角为90度的第二方向,
    所述截取模块具体用于从所述360度全景视频中第j360度全景视频帧中截取在所述第二方向上拍摄的用于显示所述第一区域内的第i子区域的正面图像。
  25. 根据权利要求22至24中任一项所述的服务器,其特征在于,所述第一对象为第一360度全景图,所述第二对象为第一条带全景图,所述请求信息还包括所述终端设备的显示分辨率,
    所述确定模块还用于,在所述确定模块确定所述第一条带全景图的标识信息对应的所述第一条带全景图之后,根据所述显示分辨率,确定包括所述第一条带全景图的连续的多幅条带全景图,所述多幅条带全景图组成所述第一区域所在的第二区域的第二条带全景图,
    所述发送模块具体用于,向所述终端设备发送包括所述多幅条带全景图,以便所述终端设备呈现所述多幅条带全景图拼接成的所述第二条带全景图。
  26. 根据权利要求22至25中任一项所述的方法,其特征在于,所述第一对象的标识信息和所述第二对象的标识信息由拍摄所述第一360度全景图时的时间信息或地理位置信息来表示。
PCT/CN2015/077678 2014-09-24 2015-04-28 呈现图像的方法、终端设备和服务器 WO2016045381A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/467,486 US10462518B2 (en) 2014-09-24 2017-03-23 Image presentation method, terminal device, and server

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410494921.8A CN104301769B (zh) 2014-09-24 2014-09-24 呈现图像的方法、终端设备和服务器
CN201410494921.8 2014-09-24

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/467,486 Continuation US10462518B2 (en) 2014-09-24 2017-03-23 Image presentation method, terminal device, and server

Publications (1)

Publication Number Publication Date
WO2016045381A1 true WO2016045381A1 (zh) 2016-03-31

Family

ID=52321300

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/077678 WO2016045381A1 (zh) 2014-09-24 2015-04-28 呈现图像的方法、终端设备和服务器

Country Status (3)

Country Link
US (1) US10462518B2 (zh)
CN (1) CN104301769B (zh)
WO (1) WO2016045381A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10032248B2 (en) 2015-02-26 2018-07-24 Huawei Technologies Co., Ltd. Image switching method and apparatus

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104301769B (zh) 2014-09-24 2017-12-15 华为技术有限公司 呈现图像的方法、终端设备和服务器
CN106034216A (zh) * 2015-03-10 2016-10-19 北京同步科技有限公司 基于图像识别的摄像机图像定位系统及其方法
JP6503881B2 (ja) * 2015-05-20 2019-04-24 株式会社リコー コンテンツ提供システム、情報処理装置、プログラム、コンテンツ再生方法
KR102536945B1 (ko) * 2016-08-30 2023-05-25 삼성전자주식회사 영상 표시 장치 및 그 동작방법
CN107888987B (zh) 2016-09-29 2019-12-06 华为技术有限公司 一种全景视频播放方法及装置
CN109362242B (zh) 2016-10-10 2021-05-14 华为技术有限公司 一种视频数据的处理方法及装置
CN107959861B (zh) * 2016-10-18 2020-08-25 华为技术有限公司 一种数据处理方法、相关设备及系统
CN108693953A (zh) * 2017-02-28 2018-10-23 华为技术有限公司 一种增强现实ar投影方法及云端服务器
CN108737288A (zh) * 2018-05-23 2018-11-02 深圳市阡丘越科技有限公司 一种轨道交通故障图像传输方法、装置和系统
CN111835998B (zh) * 2019-04-13 2023-06-13 长沙智能驾驶研究院有限公司 超视距全景图像获取方法、装置、介质、设备及系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004297298A (ja) * 2003-03-26 2004-10-21 Fuji Photo Film Co Ltd 画像表示装置
CN101795306A (zh) * 2010-01-06 2010-08-04 青岛海信移动通信技术股份有限公司 一种移动终端全景拍摄方法及移动终端
CN103971399A (zh) * 2013-01-30 2014-08-06 深圳市腾讯计算机系统有限公司 街景图像过渡方法和装置
CN104023203A (zh) * 2014-04-17 2014-09-03 深圳英飞拓科技股份有限公司 一种基于摄像机的图像生成方法和装置
CN104301769A (zh) * 2014-09-24 2015-01-21 华为技术有限公司 呈现图像的方法、终端设备和服务器

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7812856B2 (en) * 2000-10-26 2010-10-12 Front Row Technologies, Llc Providing multiple perspectives of a venue activity to electronic wireless hand held devices
US20120133639A1 (en) 2010-11-30 2012-05-31 Microsoft Corporation Strip panorama
US8600194B2 (en) 2011-05-17 2013-12-03 Apple Inc. Positional sensor-assisted image registration for panoramic photography
US8957944B2 (en) 2011-05-17 2015-02-17 Apple Inc. Positional sensor-assisted motion filtering for panoramic photography
US9762794B2 (en) 2011-05-17 2017-09-12 Apple Inc. Positional sensor-assisted perspective correction for panoramic photography

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004297298A (ja) * 2003-03-26 2004-10-21 Fuji Photo Film Co Ltd 画像表示装置
CN101795306A (zh) * 2010-01-06 2010-08-04 青岛海信移动通信技术股份有限公司 一种移动终端全景拍摄方法及移动终端
CN103971399A (zh) * 2013-01-30 2014-08-06 深圳市腾讯计算机系统有限公司 街景图像过渡方法和装置
CN104023203A (zh) * 2014-04-17 2014-09-03 深圳英飞拓科技股份有限公司 一种基于摄像机的图像生成方法和装置
CN104301769A (zh) * 2014-09-24 2015-01-21 华为技术有限公司 呈现图像的方法、终端设备和服务器

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10032248B2 (en) 2015-02-26 2018-07-24 Huawei Technologies Co., Ltd. Image switching method and apparatus

Also Published As

Publication number Publication date
CN104301769A (zh) 2015-01-21
US20170195727A1 (en) 2017-07-06
US10462518B2 (en) 2019-10-29
CN104301769B (zh) 2017-12-15

Similar Documents

Publication Publication Date Title
WO2016045381A1 (zh) 呈现图像的方法、终端设备和服务器
US11037365B2 (en) Method, apparatus, medium, terminal, and device for processing multi-angle free-perspective data
KR102239530B1 (ko) 복수의 카메라로부터 뷰를 결합하는 방법 및 카메라 시스템
US9564175B2 (en) Clustering crowdsourced videos by line-of-sight
US20180182114A1 (en) Generation apparatus of virtual viewpoint image, generation method, and storage medium
JP2011515760A (ja) カメラフィードの地図上への視覚化
WO2010028559A1 (zh) 图像拼接方法及装置
CN103607568A (zh) 立体街景视频投影方法及系统
CN107084740B (zh) 一种导航方法和装置
WO2017133147A1 (zh) 一种实景地图的生成方法、推送方法及其装置
WO2019218770A1 (zh) 一种同步显示ar信息的视频播放方法
CN109429037A (zh) 一种图像处理方法、装置、设备及系统
US9906769B1 (en) Methods and apparatus for collaborative multi-view augmented reality video
CN112954443A (zh) 全景视频的播放方法、装置、计算机设备和存储介质
KR100926231B1 (ko) 360도 동영상 이미지 기반 공간정보 구축 시스템 및 그구축 방법
JP6952456B2 (ja) 情報処理装置、制御方法、及びプログラム
US11436788B2 (en) File generation apparatus, image generation apparatus, file generation method, and storage medium
CN108391048A (zh) 具有说明功能的数据生成方法及全景拍摄系统
CN113781560B (zh) 视点宽度的确定方法、装置及存储介质
KR101883981B1 (ko) 가상 현실 동영상 제공 장치 및 제공 방법
KR101484314B1 (ko) 동영상 기반 공간정보 구축 시스템 및 방법
CN112672057A (zh) 拍摄方法及装置
CN114157875B (zh) Vr全景视频的预处理方法、设备及存储介质
JP2019174989A (ja) 画像圧縮方法及び画像圧縮装置
JP6619686B2 (ja) 視聴範囲推定方法及び視聴範囲推定装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15844396

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15844396

Country of ref document: EP

Kind code of ref document: A1