CN108702451A - For rendering with the system and method for the spherical video clip of viewing - Google Patents

For rendering with the system and method for the spherical video clip of viewing Download PDF

Info

Publication number
CN108702451A
CN108702451A CN201780012107.XA CN201780012107A CN108702451A CN 108702451 A CN108702451 A CN 108702451A CN 201780012107 A CN201780012107 A CN 201780012107A CN 108702451 A CN108702451 A CN 108702451A
Authority
CN
China
Prior art keywords
video clip
display
visual field
spherical video
spherical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201780012107.XA
Other languages
Chinese (zh)
Inventor
约文·马蒂亚斯
戴维·纽曼
哈·潘
蒂莫西·巴克林
达里尔·斯蒂姆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
High Patrol Co
GoPro Inc
Original Assignee
High Patrol Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/046,344 external-priority patent/US9973746B2/en
Priority claimed from US15/050,275 external-priority patent/US9743060B1/en
Priority claimed from US15/050,297 external-priority patent/US9602795B1/en
Application filed by High Patrol Co filed Critical High Patrol Co
Publication of CN108702451A publication Critical patent/CN108702451A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634Warning indications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

Provide the system and method for rendering with the spherical video clip of viewing.The spherical video clip for including label information associated with events of interest can be obtained.The label information can identify the time point that can watch the events of interest in the spherical video clip and viewing angle.The orientation of two dimensional display can be determined with sensor-based output signal.The display visual field in the spherical video clip can be determined based on the orientation of the display and the display visual field in the spherical video clip is presented on the display.The display visual field can be captured as two-dimensional video segment.If notice can be presented except the display visual field in the viewing angle of events of interest described in the neighbouring time point in the display visual field.

Description

For rendering with the system and method for the spherical video clip of viewing
Technical field
System and method described herein relates in general to be presented and watch spherical (spherical) video clip.
Background technology
The video clip of capture may include the content captured in multiple views with multiple visual angles.If user's energy Enough to select their viewpoint in the video clip captured during playback, then user may miss in the video captured Obtainable content in other views of segment and/or region.And missed content may result in user with unsatisfied body It tests.
Invention content
The present invention herein is related to being presented and watching spherical video clip.Spherical video clip may include being regarded with three-dimensional Scheme the digital content presented, the 3-D view includes 360 degree of horizontal field of view and/or the vertical visual field of 180 degree.It is described herein System and or method can be configured as from the repository of video clip and obtain spherical video clip.System described herein And/or method can determine the orientation of two dimensional display based on the output signal generated by sensor.Output signal can be with Transmission information related with the orientation of display.It can determine the display visual field in spherical video clip.It can be based on display Orientation present over the display display the visual field.For example, based on how keeping display mobile and/or being orientated (for example, if display Device tilts certain number of degrees upwards, then can determine that the display visual field tilts the identical number of degrees upwards), the display visual field can follow A part for 360 degree of horizontal field of view is (for example, 90 degree in 360 degree so that remaining 270 degree of horizontal field of view can not be aobvious Show in the visual field) and 180 degree the vertical visual field a part (for example, 45 degree in 180 degree so that the vertical visual field remaining 135 Degree can not be in the display visual field).In order to user by different directions and/or by angle mobile display in spherical piece of video Any given point in time of section watches different angles and/or visual angle, and the aobvious of spherical video clip can be presented over the display Show the visual field.The 3-D view may include depth information associated with spherical video clip.Zoom control can be provided, it should Zoom control can allow to increase and/or reduce the visual number of degrees in the display visual field of spherical video clip during playback.
In some embodiments, the display visual field can be captured and/or be recorded as two-dimensional video segment.It can be by aobvious Show device and/or application associated with the presentation of spherical video clip on display to provide user control, the user control User can be allowed to watch and/or consume (consume) spherical video clip to record the presented display visual field.For example, working as User's mobile display and/or when display being made to be orientated with different angle in different directions, user can select to regard display Wild two dimension shows that content is recorded.This can be referred to as virtual camera, similarly user can according to the wish of user into The recording of row two dimension display as much as possible.User control can allow user to start, suspend, stop and/or allow other controls Part controls the capture (for example, with slow motion record) in the display visual field of such as two-dimensional video segment.In this way, Yong Huke To capture interested titbit and/or event in spherical video clip with single two-dimensional video segment.It can be by two-dimensional video Segment is stored as the individual video clip different from the spherical video clip.It can be total with other users and/or consumer The two-dimensional video segment is enjoyed to be watched so that the user of spherical video clip and/or two-dimensional video segment and/or other Consumer oneself may not necessarily search for interested titbit and/or event in spherical video clip.
In some embodiments, it in spherical video clip internal labeling and/or can present one or more interested Event.Interested event may include the titbit or climax, the focus (example in addition to spherical video clip of spherical video clip Such as, act) external spherical video clip in certain events for occurring, and/or in spherical video clip it is interested other One or more of event.The system and or method can obtain related to the events of interest in spherical video clip The label information of connection.The information can identify the time point in spherical video clip and the viewing angle in spherical video clip Degree, can watch interested event in spherical video clip with viewing angle at the time point.Ball is being presented by display While shape video clip, the system and or method can the neighbouring time point (proximate to the point In time) determine whether the viewing angle of events of interest is located in the display visual field.If the events of interest is regarded in display (for example, with reference to above-mentioned example, if interested event is located in 270 degree of horizontal field of view without in the display visual field except open country It is interior and/or in 135 degree of the vertical visual field without in the display visual field), then can generate the sense of the spherical video clip of instruction Interesting event is likely located at the warning information except the visual field.Notice can be generated and present in the display visual field, to remind user During spherical video clip at what time toward which direction mobile display and/or make display toward which direction be orientated with Just interested event is watched.The notice can be figure (for example, arrow etc.), sound (for example, oral direction), And/or it is any other form.For the later reference of spherical video clip, user can with wait for by store with share they Oneself interested event to spherical video clip be marked (tag and/or mark) or for user oneself viewing or It is watched for other consumers.
The system for being configured as being presented and watching spherical video clip may include one or more client computing platforms. (one or more) server and (one or more) client computing platform can be led in client/server configuration Believe, and/or is communicated by another configuration.(one or more) the client computing platform may include by machine readable The one or more processors for instructing configuration, to run computer program component (component).The computer program component May include spherical segment component, certified component, be orientated component, visual field component, present component, capture component, notification component and/ Or other components.
The spherical segment component can be configured as the spherical video clip of acquisition.It is described spherical shape video clip can include In the repository of video clip.Image and/or the repository of video clip can be obtained by system.Can by image and/ Or the repository of video clip is stored in electronic memory, one or more server, external resource, cloud and/or any other In storage location.The each image and/or video clip of image and/or the repository of video clip can be stored in different Position.Image and/or the repository of video clip can be associated from different users.The video clip may include regarding Frequently, the compilation of video clip, video clipping and/or static image.
In some embodiments, spherical video clip may include associated with the events of interest in spherical video clip Label information.The label information can identify the time point in spherical video clip and the viewing angle in spherical video clip Degree, can watch the events of interest in spherical video clip with viewing angle at the time point.Interested event can wrap It includes the event of any generation in spherical video clip, notable moment in such as spherical video clip duration and/or has Interesting time point.Interested event can be that user wishes shared with other viewers of spherical video clip and/or consumer At the time of (for example, user and/or other users may be interested in interested moment and/or event).For example, interested Event may include spherical video clip titbit or climax, in addition to spherical video clip focus (for example, action) it is external One of other interested events in certain events and/or spherical video clip occurred in spherical video clip are more Person.
The certified component can be configured as it is pair associated with (one or more) client computing platform, pass through and be The user of the repository of system access images and/or video clip is authenticated.Certified component can manage with the user of system and/ Or the associated account of consumer.User account may include use associated with the user of the user account and/or consumer Family information.User information may include by (one or more) client computing platform, (one or more) server and/or its The information of its storage location storage.
The output for being orientated component and can be configured as the sensor based on (one or more) client computing platform Signal determines the orientation of display.For example, if one of client computing platform is mobile device (for example, intelligent hand Machine), then it is orientated component and can be configured as when user is in one or more directions (for example, upwards, downwards, to the left, to the right Deng) intelligent movable mobile phone when, the orientation of display is determined based on the output signal of client computing device.It can be by one Multiple number of degrees in a or multiple directions carry out the orientation of indication display.For example, the orientation can be in cartesian coordinate system, circle Orientation defined in one of cylindricality and/or polar coordinate system, spherical shape and/or polar coordinate system or more persons.
The visual field component can be configured as the orientation based on display to determine the spherical shape for waiting for presenting over the display The display visual field in video clip.Visual field component can be configured as the orientation based on display determine wait for be in over the display The visual field in existing spherical video clip, including determine the sight corresponding with the orientation of the display in spherical video clip See angle.Visual field component can be configured as the orientation based on display to determine the spherical piece of video for waiting for presenting over the display The visual field in section, including identify the display visual field in the spherical video clip presented at viewing angle.The display visual field can To include horizontal field of view (for example, left and/or right), the vertical visual field (above and/or under for example) and/or other visuals field.
The visual field component can be configured as determines whether the viewing angle of events of interest is located at neighbouring time point It shows in the visual field.The neighbouring time point that can watch events of interest may include the time point that may be viewed by events of interest it The preceding predefined period the predefined period, and/or may be viewed by feeling emerging after the time point that may be viewed by events of interest One or more of the time point of interesting episode part.The visual field is shown as set forth above, it is possible to be determined on the basis of recycling or continuing.Institute Stating the display visual field can indicate to be based on and (one or more) client computing platform phase during the presentation of spherical video clip The present viewing field of the orientation determination of associated display.The display visual field can be in spherical video clip via display Change during now one or many.The display visual field may include visible to user via display in current point in time Viewing angle, can equally obtain current point in time many visuals field sightless to user (for example, except non-display to the left or It moves right, otherwise user possibly can not see 180 degree to the left or to the right the display visual field of 180 degree by the display visual field). Visual field component can be automatically that user changes the display visual field to show that interested event and/or user can be based on automatically The movement of (one or more) client computing platform shows the visual field to change.
The capture component can be configured as is captured as two-dimensional video segment by the display visual field.The display visual field is captured as Two-dimensional video segment may include that will show that the visual field is recorded as two-dimensional video segment so that user will with (one or more) visitor (view finder is to contain in the vision in spherical video clip as view finder for the associated display of family end computing platform Hold) in use, capture component can run through via (one or more) client computing platform spherical video clip recording and/or Capture action and/or the movement (for example, display visual field) of user.For example, when user by with (one or more) client When the associated display of computing platform being held to watch spherical video clip, the display visual field can be recorded (for example, by capturing component The vision content shown on display associated with (one or more) client computing platform), include a times in the display visual field What is mobile, shows that any movement in the visual field includes that user can be will be associated with (one or more) client computing platform The movement in the display visual field of the display to the left, to the right, when moving up and/or down in caused spherical video clip.
The notification component can be configured as in response to the neighbouring time point determine viewing angle the display visual field it Outside, the interested event for generating the spherical video clip of instruction is located at the warning information shown except the visual field.The warning information can To indicate the position of the events of interest in the spherical video clip indicated by label information.The warning information may include and mark Sign the associated viewing angle of information, time point associated with label information, and/or with it is being indicated by label information and/or The relevant other information of events of interest associated with label information.
The notification component can be configured as the presentation that notice is realized based on warning information.The notice may include figure One or more of shape notice, sound notification, sense organ notice and/or other types of notice.For example, the notice can wrap Include the alert message being presented in the display visual field of spherical video clip.The notice for example may include the audible police of user Report sound.Illustrative sense organ notice may include vibration informing and/or light notice.The notice can indicate to the user that user It may miss, having already passed by and/or may will miss in the spherical video clip being likely to occur in except the display visual field Events of interest.
After considering following description and the appended claims with reference to attached drawing, these and other purpose of the invention, spy The combination of the function and component of sign, characteristic and operating method and dependency structure component and manufacture economy will become brighter Aobvious, all attached drawings form part of this specification, wherein in each figure, identical reference numeral refers to corresponding component. However, to be expressly understood that, these attached drawings are merely to illustrate and describe purpose and are not intended to definition any restrictions.Such as this specification and It is used in claims, singulative " one " (" a ", " an ") and "the" (" the ") include plural object, unless up and down Text is otherwise explicitly indicated.
Description of the drawings
Fig. 1 show according to one or more realization methods be configurable for presenting and watch spherical video clip is System.
Fig. 2 shows the exemplary spherical video clips presented by display according to one or more realization methods.
Fig. 3 shows the exemplary ball presented by the display with user control according to one or more realization methods Shape video clip.
Fig. 4 shows that the exemplary display according to the spherical video clip including notice of one or more realization methods regards It is wild.
Fig. 5 shows the method for being configurable for watching spherical video clip according to one or more realization methods.
Fig. 6 show according to one or more realization methods be configurable for presenting it is interested in spherical video clip The method of event.
Specific implementation mode
Fig. 1 shows the exemplary system 100 that is configurable for presenting and watch spherical video clip.Spherical video clip May include the digital content presented with 3-D view, the 3-D view includes 360 degree of horizontal field of view and/or 180 degree The vertical visual field.System described herein and/or method can be configured as from the repository of video clip and obtain spherical piece of video Section.The system and or method can determine the orientation of two dimensional display based on the output signal generated by sensor.It is defeated Information related with the orientation of display can be transmitted by going out signal.It can determine the display visual field in spherical video clip.It can be with The display visual field is presented in orientation based on the display over the display.For example, based on how mobile display and/or making Display, which is orientated, (for example, if display tilts certain number of degrees upwards, it is identical can to determine that the display visual field tilts upwards The number of degrees), the display visual field can follow a part for 360 degree of horizontal field of view (for example, 90 degree in 360 degree so that horizontal field of view Remaining 270 degree can not be in the display visual field) and 180 degree the vertical visual field a part (for example, 45 degree in 180 degree, So that remaining 135 degree of the vertical visual field can not be in the display visual field).In order to user by different directions and/or angle move It moves display and watches different angles and/or visual angle in any given point in time of spherical video clip, it can be in display The upper display visual field that spherical video clip is presented.The 3-D view may include that depth associated with spherical video clip is believed Breath.Zoom control can be provided, which can allow to increase and/or reduce the aobvious of spherical video clip during playback Show the visual number of degrees in the visual field.
In some embodiments, the display visual field can be captured and/or be recorded as two-dimensional video segment.It can be by aobvious Show device and/or application associated with the presentation of spherical video clip on display to provide user control, the user control User can be allowed to watch and/or consume spherical video clip to record the presented display visual field.For example, when user is in difference When moving display on direction and/or display being made to be orientated with different angle, user can select the two dimension to showing the visual field aobvious Show that content is recorded.This can be referred to as virtual camera, and similarly user can carry out as more as possible according to the wish of user Two dimension display recording.User control can allow user to start, suspend, stop and/or allow other controls to control such as The capture (for example, with slow motion recording etc.) in the display visual field of two-dimensional video segment.In this way, user can be with single two It ties up video clip and captures interested titbit and/or event in spherical video clip.Two-dimensional video segment can be stored For the individual video clip different from the spherical video clip.Described two can be shared with other users and/or consumer Video clip is tieed up to be watched so that the user and/or other consumers of spherical video clip and/or two-dimensional video segment can In spherical video clip oneself interested titbit and/or event need not be searched for.
In some embodiments, it in spherical video clip internal labeling and/or can present one or more interested Event.Interested event may include the titbit or climax, the focus (example in addition to spherical video clip of spherical video clip Such as, act) external spherical video clip in certain events for occurring, and/or in spherical video clip it is interested other One or more of event.The system and or method can obtain related to the events of interest in spherical video clip The label information of connection.The information can identify the time point in spherical video clip and the viewing angle in spherical video clip Degree, can watch the events of interest in spherical video clip with viewing angle at the time point.Ball is being presented by display While shape video clip, the system and or method can determine the viewing angle of events of interest the neighbouring time point Whether it is located in the display visual field.If interested event is being shown except the visual field (for example, with reference to above-mentioned example, if sense is emerging The event of interest be located in 270 the degree of horizontal field of view without show in the visual field and/or positioned at 135 degree of the vertical visual field it is interior without Show in the visual field), then the events of interest that can generate the spherical video clip of instruction is likely located at the alarm shown except the visual field Information.Notice can be generated and present in the display visual field, to remind user past at what time during spherical video clip Which direction mobile display and/or display is set to be orientated toward which direction to watch interested event.The notice can To be (for example, oral direction) of figure (for example, arrow etc.), sound, and/or in the form of any other.In order to which spherical shape regards The later reference of frequency segment, user can be with waiting being stored with themselves the interested event shared to spherical video clip (tag and/or mark) is marked or watches for user oneself or is watched for other consumers.
As shown in Figure 1, system 100 may include one or more client computing platforms 102, one or more Server 104, electronic memory 122, be configured as execute machine readable instructions 105 one or more physical processors 124, One or more computer program components, and/or other components.
One or more of physical processors 124 can be configured as execution machine readable instructions.It executes machine readable Instruct 105 presentations that one or more physical processors 124 can be made to realize spherical video clip.Machine readable instructions 105 can To include one or more computer program components, such as spherical segment component 106, certified component 108, it is orientated component 110, the visual field Component 112 is presented component 114, captures component 116, notification component 118, and/or other components.
In some implementations, (one or more) client computing platform 102 can be configured as to one or more A server 104 provides the distance host control (remote hosting) of the feature and/or function of machine readable instructions 105, One or more of servers 104 can be located remotely from (one or more) client computing platform 102.However, at some In realization method, the one or more features of (one or more) client computing platform 102 and/or function can be classified as one The local feature and/or local function of a or multiple servers 104.For example, each clothes in (one or more) server 104 Business device may include machine readable instructions (not shown in figure 1), which includes and (one or more) client The same or analogous component of machine readable instructions of computing platform 102.(one or more) server 104 can be configured as Local runtime can be with 105 same or analogous one or more components of machine readable instructions.It can be by (one or more) visitor The one or more features and/or function of the machine readable instructions 105 of family end computing platform 102 are provided as at least partly can be with The application program executed on given server 104.
(one or more) client computing platform 102 may include cellular phone, smart mobile phone, digital camera, notes In this computer, tablet computer, desktop computer, TV set-top box, smart television, game console and/or other computing platforms One or more.
(one or more) client computing platform 102, (one or more) server 104, and/or external resource 120 It can be operably connected via one or more electronic communication links.For example, this electronic communication link can be at least partly Ground is established by the network and/or other networks of such as internet.It should be appreciated that this be not intended to it is restrictive, and The scope of the present invention includes (one or more) client computing platform 102, (one or more) server 104, and/or outside The realization method that resource 120 can be operably connected via some other communication medias.
Spherical segment component 106 can be configured as the spherical video clip of acquisition.It is described spherical shape video clip can include In the repository of video clip.Image and/or the repository of video clip can be obtained by system 100.It can be by image And/or the repository of video clip is stored in electronic memory 122, one or more servers 104, external resource 120, cloud And/or in any other storage location.It can be by image and/or each image and/or piece of video of the repository of video clip Section is stored in different positions.Image and/or the repository of video clip can be associated from different users.The piece of video Section may include the compilation of video, video clip, video clipping and/or static image.Although the present invention can be directed to previously by The spherical videos of one or more image capture device captures and/or spherical video clip, but system 100, (one or more It is a) one or more realization methods of client computing platform 102 and/or (one or more) server 104 can be configured To be used for other types of media item.Other types of media item may include audio file (for example, music, podcast, audio books And/or other audio files), multimedia presentation, photo, one or more of lantern slide and/or other media files.It can be with It one or more is stored from associated with (one or more) client computing platform 102, (one or more) server 104 Position and/or other storage locations for storing spherical video clip receive the spherical video clip.
Certified component 108 can be configured as it is pair associated with (one or more) client computing platform 102, pass through The user of the repository of 100 access images of system and/or video clip is authenticated.Certified component 108 can manage and system 100 user and/or the associated account of consumer.User account may include and the user of the user account and/or consumption The associated user information of person.User information may include by (one or more) client computing platform 102, (one or more It is a) server 104 and/or other storage locations storage information.
User information may include identity user and/or consumer information (for example, user name or number (handle), Number, identifier and/or other identification informations), secure log information is (for example, log in code or password, User ID and/or use Family accesses (one or more) server 104 required other information), system use information, outside use information (for example, Outside system 100 including one or more online activities such as in social networks one or more application and/or its The use of its applications), subscription information, computing platform associated with user and/or consumer mark, with user and/or The associated telephone number of consumer, privacy settings information and/or with one in user and/or the relevant other information of consumer Person or more persons.
Certified component 108 can be configured as via one or more client computing platforms 102 (for example, via user User's input at interface etc.) obtain user information.If user and/or consumer do not have associated with system 100 advance Existing user account, then user and/or consumer can pass through website, the application based on website, mobile application and/or user Using registration to receive the service provided by system 100.Certified component 108 can be configured as in user and/or consumer's note When volume User ID and/or other identification informations are created for user and/or consumer.The User ID and/or other identification informations The one or more client computing platforms 102 that can be used with user and/or consumer are associated.Certified component 108 can be with It is configured as this association of storage and the user account of user and/or consumer.User and/or consumer can by one or Multiple accounts associated with social networking service, messenger service etc. are associated with the account provided by system 100.
If spherical video clip is stored in the storage location outside (one or more) client computing platform 102 And/or spherical segment component is located in one or more servers 104, then spherical segment component 106 may be implemented to regard spherical shape Frequency fragments for transport extremely (one or more) client computing platform associated with user and/or consumer 102.The spherical shape regards Frequency segment can be transferred to (one or more) client computing platform 102, and user can be in the client computing platform Consume the spherical video clip.Spherical segment component 106 can be configured as the spherical video clip cluster (host) On network.For example, spherical video clip can be clustered on the internet so that user can access described via internet Spherical video clip.May include being uploaded on one or more servers 104 on the internet by spherical video clip cluster And/or the spherical video clip of storage, wherein the server processing requests and/or spherical video clip is transmitted to (one or It is multiple) client computing platform 102.This may include providing individual digital document, stream transmission ball for spherical video clip Shape video clip and/or other transfer mechanisms.Spherical segment component 106 can be configured as by by information from (one or more It is a) server 104 transmit (for example, passing through streaming digital content data and/or other visual informations) arrive (one or more It is a) client computing platform 102 and by spherical video clip be clustered on network for (one or more) client Spherical video clip is presented on the associated one or more displays of computing platform 102.Given client is transferred to calculate The digital content of platform 102 can with the spherical shape consumed in given client computing platform 102 by user is being presented Video clip is corresponding.
User can be by seeing via (one or more) client computing platform 102 and/or associated display equipment Spherical video clip is seen to consume the spherical video clip.(one or more) client computing platform 102 may include one A or multiple display equipment for being configured as showing spherical video clip.(one or more) client computing platform 102 can be with Including being configured as that the two dimensional display of two dimensional image is presented.For example, spherical video clip can be by two dimensional display with two Dimension format rather than 3 dimensional format are presented so that user associated with (one or more) client computing platform 102 can To watch spherical video clip with two-dimensional format.(one or more) client computing platform 102 may include sensor, the biography Sensor is configurable to generate the output signal of the relevant information of orientation of transmission and display.The orientation of display can refer to aobvious The relative position shown.It can be by multiple number of degrees in one or more directions come the orientation of indication display.For example, this takes To can be the institute in one of cartesian coordinate system, cylinder and/or polar coordinate system, spherical shape and/or polar coordinate system or more persons The orientation of definition.
Spherical video clip may include capture can be by the 3 D video segment of viewing, label, editor and/or distribution. For example, spherical video clip may include the video (for example, via video of one or more cameras captures) of real-time capture Playback.Spherical video clip may include multiple views so that at least part of spherical video clip is regarded in the display of user Except open country, the user is at given time point by associated with (one or more) client computing platform 102 aobvious Show the user of the spherical video clip of device viewing.For example, spherical video clip may include 360 degree horizontal field of view, 180 degree it is perpendicular One or more of direct-view open country and/or other visuals field.Display associated with (one or more) client computing platform 102 Device can show a part for only spherical video clip (for example, display can only show a part for 360 degree of horizontal field of view And/or the part in the vertical visual field of 180 degree).In this way, at given time point not via with (one or more) client meter Calculating the other parts for the spherical video clip that 102 associated display of platform is shown can remain able to be watched.
It is orientated component 108 and can be configured as the defeated of the sensor based on (one or more) client computing platform 102 Go out signal to determine the orientation of display.For example, if one of client computing platform 102 is mobile device (for example, intelligence Can mobile phone), then be orientated component 108 can be configured as when user in one or more directions (for example, upwards, downwards, to It is left, to the right etc.) intelligent movable mobile phone when, the orientation of display is determined based on the output signal of client computing device 102.Such as It is upper described, it can be by multiple number of degrees in one or more directions come the orientation of indication display.For example, the orientation can be with It is defined in one of cartesian coordinate system, cylinder and/or polar coordinate system, spherical shape and/or polar coordinate system or more persons It is orientated.
Visual field component 112 can be configured as the orientation based on display to determine that the spherical shape for waiting for presenting over the display regards The display visual field in frequency segment.Visual field component 112, which can be configured as, to be waited for over the display based on the orientation of display to determine The visual field in the spherical video clip of presentation, including determination are corresponding with the orientation of the display in spherical video clip Viewing angle.Visual field component 112 can be configured as the orientation based on display to determine the spherical shape for waiting for presenting over the display The visual field in video clip, including identify the display visual field in the spherical video clip presented at viewing angle.The display The visual field may include horizontal field of view (for example, left and/or right), the vertical visual field (above and/or under for example) and/or other visuals field.
How visual field component 112 is held and/or is moved based on user and (one or more) client if can be configured as Computing platform 102 associated display determines the display visual field in spherical video clip.For example, user can be based on The angle of the orientation of 102 associated display of (one or more) client computing platform and/or direction come move (one or It is multiple) display of client computing platform 102, rotation (one or more) client computing platform 102 display and/or The display of (one or more) client computing platform 102 is set to be orientated to change the his or her visual field.The display takes To the viewing angle that can reflect in spherical video clip.For example, if user holds and (one or more) client always 102 associated display of computing platform so that display associated with (one or more) client computing platform 102 with Relative to level surface (for example, the ground at 0 degree and/or X-axis) at 90 degree vertical angles be orientated, then wait for be in over the display The display visual field in existing spherical video clip can be 90 degree of the vertical display visual field.So, in spherical video clip with The corresponding viewing angle of orientation of the display can be 90 degree of vertical viewing angle.If user makes and (one or more It is a) client computing platform 102 associated display with relative to level surface (for example, the ground at 0 degree and/or X-axis) Be orientated at 75 degree of vertical angles, at the same will display associated with (one or more) client computing platform 102 from first Initial point (for example, initial point can be 0 degree of level) moves right 100 degree, then stays in the spherical video clip presented in display The display visual field can be that 75 degree of vertical angles show the visual field (for example, display the visual field can be tilted down towards level surface) simultaneously And from 100 degree to the right of initial point.So, viewing angle corresponding with the orientation of the display can be in spherical video clip It is 100 degree of 75 degree of the vertical viewing angle of turning right.
The presentation that component 114 can be configured as the display visual field for realizing spherical video clip over the display is presented.With 102 associated user of (one or more) client computing platform can be in (one or more) client computing platform 102 Display on the spherical video clip of viewing.The determination of the orientation of the display and spherical shape for presenting over the display regard The determination in the display visual field in frequency segment can recursively occur during the playback of spherical video clip.In this way, nothing It is moved by (one or more) client computing platform 102 and/or is oriented which direction, component 114 is presented can be by It is arranged for carrying out the real-time presentation of the display visual field of spherical video clip over the display.For example, if entering spherical video At 30 seconds of segment, user associated with (one or more) client computing platform 102 will be with (one or more) client Hold 102 associated display of computing platform relative to display associated with (one or more) client computing platform 102 The initial position of device and/or starting move right 30 degree (for example, moving horizontally 30 degree), then can with (one or more It is a) client computing platform 102 shows on associated display spherical video clip with relative in spherical video clip Spherical video clip is presented with 30 degree to the right (for example, flatly) in initial viewing angle.This can recursively occur so that user Display associated with (one or more) client computing platform 102 can be moved in any direction with any given The spherical video clip of time point viewing different angle and/or visual angle.
The orientation of display and the recurrence in the display visual field in spherical video clip for rendering over the display determine Display can be used as to the view finder of vision content (vision content be included in spherical video clip in) in order to user.With It can indicate that user's movement is associated with (one or more) client computing platform 102 in the view finder of spherical video clip Show that the display of spherical video clip watches difference so as to any given time point during spherical video clip thereon Angle and/or visual angle ability.For example, each time point during spherical video clip, 360 degree of horizontal field of view and The vertical visual field of 180 degree can be used family by various orientations and/or angle is mobile, rotation and (one or more) client meter It calculates 102 associated display of platform and/or makes in other ways associated with (one or more) client computing platform 102 Display be orientated, and regarded by display associated with (one or more) client computing platform 102 to watch spherical shape Different moments in frequency segment and/or event.When user just watches spherical video clip at current location (for example, initial position) When, can moment (for example, entering 25 seconds of spherical video clip) occur to the right side of current location or left side (for example, Flatly) the event of 180 degree.User can move display associated with (one or more) client computing platform 102 To explore in other regions of the spherical video clip of 25 seconds marks of spherical video clip.It such as will be further detailed below Description, user can by one or more user controls at specific time point (for example, entering the 2 of spherical video clip Second) the spherical video clip of pause, so that movement is associated with (one or more) client computing platform 102 in all directions Display to explore in the spherical video clip that specific time point (for example, entering 2 seconds of spherical video clip) captures Part and/or whole vision content.Vision content and/or event in spherical video clip include special object (for example, people, animal, terrestrial reference etc.), action (for example, competitive sports, cycling etc.), landscape (for example, scene) and/or can be with The capture of the other vision contents and/or event that capture.In this way, user can be in order to using display as (for wrapping The vision content and/or event being contained in spherical video clip) view finder use.
As an example, Fig. 2 depicts the display in client computing platform 102 according to one or more realization methods The exemplary spherical video clip 200 presented on 202.Although client computing platform 102 is illustrated as intelligent hand in fig. 2 Machine, but this is not intended to limitation of the present invention, because client computing platform 102 may include any visitor discussed above Family end computing platform 102.Fig. 2 can indicate the single time point 204 in spherical video clip 200 (for example, being regarded into spherical shape 30 seconds of frequency segment 200) at the spherical video that is being presented by display associated with client computing platform 102 202 The example of segment 200.Spherical video clip 200 may include the spherical video clip of three-dimensional presented by two dimensional display 202 (for example, user can watch and/or consume a part for three-dimensional spherical video clip).Although the one of spherical video clip 200 Part is shown as the display visual field by display 202,360 degree of horizontal field of view and/or 180 of spherical video clip 200 The other parts in the vertical visual field of degree are not shown by display 202.In order to watch other portions of spherical video clip 200 Point, if arrow 206 is discribed, display 202 can be orientated with various angles and/or be moved in all directions, so as to Change the display visual field presented by display 202.For example, although can be at single time point 204 in spherical video clip Describe sliders in 200, but if display 202 to the right or is moved to the left 180 degree, user can watch in spherical video The occurent thing in place away from slider's 180 degree in segment 200.Although depicting arrow 206 on four direction, This being given for example only property purpose and be not intended to limitation the present invention, same display 202 can be oriented at any angle and/or It is moved in any direction.
Fig. 1 is returned to, capture component 116 can be configured as is captured as two-dimensional video segment by the display visual field.Display is regarded It may include that will show that the visual field is recorded as two-dimensional video segment that open country, which is captured as two-dimensional video segment, so that user is will be with (one Or it is multiple) client computing platform 102 associated display as view finder (to contain regarding in spherical video clip Feel content) in use, spherical piece of video can be run through via (one or more) client computing platform 102 by capturing component 116 Action and/or the movement (for example, showing the visual field as described above) of user is recorded and/or captured to section.For example, when user is being led to When crossing display viewing spherical shape video clip associated with (one or more) client computing platform 102, component 116 is captured The display visual field can be recorded (for example, being shown on display associated with (one or more) client computing platform 102 Vision content), include any movement in the display visual field, show that any movement in the visual field includes user will be with (one or more It is a) client computing platform 102 associated display to the left, to the right, caused spherical video when moving up and/or down The movement in the display visual field in segment.
Capture component 116 can be configured as captures the single visual field whithin a period of time.For example, even if will with (one or It is multiple) client computing platform 102 associated display move and/or be orientated in different directions, capture component 116 also may be used Only to record and/or capture the single visual field.If the initial vertical visual field is 90 degree of the vertical visual field and the initial level visual field is 0 Degree then captures component 116 and can be configured as the entire time span and/or specific time length for capturing spherical video clip The visual field.As will be described in further detail below, user control can be used to configure recording and/or the volume of two-dimensional video segment Volume and/or two-dimensional video segment rear capture (post-capture).
As described above, spherical video clip can be 3 D video segment, and calculated with (one or more) client flat 102 associated display of platform can be two dimensional display.In this way, capturing component 116 can be configured as capture and/or recording It shows the visual field, and creates the individual video clip as the two-dimensional video segment different from spherical video clip.
It captures component 116 and can be configured as the storage two-dimensional video segment.Electronic memory 122, cloud can be passed through And/or other storage devices associated with system 100 and/or (one or more) server 104 regard to store the two dimension Frequency segment.The two-dimensional video segment may be embodied in the repository of video clip recited above.In this way, described Two-dimensional video segment can be used for playing back so that other users and/or consumer are watched.System 100 can with (one or more It is a) client computing platform 102 realizes on associated display the presentation of two-dimensional video segment for playback.System 100 It may be implemented two-dimensional video fragments for transport to one or more associated with user and/or other viewers and/or consumer A client computing platform 102.In this way, user can by spherical video clip the interested moment and/or thing Part is captured as two-dimensional video segment, and shares the two-dimensional video segment with other viewers and/or consumer.The two-dimensional video piece Section may include interested moment and/or event that user likes, to be easier in future and more efficient way sight See the spherical shape video clip so that user and/or other viewers can need not search for entire spherical video clip (for example, 3 D video segment) and watch these interested moment and/or event in particular point in time.
As described above, display may include the view finder as user (to contain regarding in spherical video clip Feel content) use.The display and/or view finder may include one or more user controls, one or more of User control is configured as controlling the capture in the display visual field for being used as two-dimensional video segment by user's startup.It is one or Multiple user controls may include recording control, stopping control, play control, pause control, be used for through spherical video clip And/or two-dimensional video segment carries out F.F. and/or the control refunded, preserves control and/or can be used for controlling two-dimensional video piece One of other user controls (for example, control etc. for recording two-dimensional video segment with slow motion) of the capture of section are more Person.One or more of user controls may be embodied in display, view finder is (for example, the display with spherical video clip The associated view finder of device) in, in (one or more) client computing platform 102, and/or may be embodied in miscellaneous equipment And/or can show spherical video clip and/or record two-dimensional video segment application in and/or included in miscellaneous equipment and/ Or it can show in the application of spherical video clip and/or recording two-dimensional video segment.One or more of user controls can To include one or more buttons associated with (one or more) client computing platform 102 and/or can show spherical shape The application of video clip, control-rod, switch and/or can by user's startup come control two-dimensional video segment capture it is any Other actuators.
As an example, Fig. 3 is depicted according to one or more realization methods with user control 302, user control 304, the exemplary spherical video clip presented on the display 202 of the client computing platform 102 of user control 306 200.Although user control 302 depicts, recording button, user control 304 depicts stop button, user control 306 depicts Pause button, but these being given for example only property purposes and be not intended to limit the invention because other use can be provided Family control.Fig. 3 shows that user can be allowed to capture and/or record is used as two-dimensional video segment via what display 202 was presented Display the visual field exemplary interfaces.As shown in Fig. 2, arrow 206 can describe direction that display 202 can be oriented and/ Or angle so that user can watch the other parts in the display visual field of presentation by display 202.For example, user can be with Start button 302 captures and/or records the display visual field as two-dimensional video segment presented via display 202 to start, User is at various orientations simultaneously and/or angle (for example, the display visual field is made to follow the direction similar with the orientation of display 202) is come Mobile client computing platform 102 and/or make client computing platform 102 be orientated.For example, when slider continues to slide slope When, user can follow the slider described in spherical video clip 200.User can be on the direction that slider is skiing Slider is maintained at the centre in the display visual field presented via display 202 by mobile display 202.User can start Button 306 stops recording to suspend recording and/or start button 304.
Referring back to Fig. 1, in some embodiments, spherical video clip may include emerging with the sense in spherical video clip The associated label information of interesting episode part.The label information can identify time point and spherical piece of video in spherical video clip Viewing angle in section, can watch interested event in spherical video clip with viewing angle at the time point.It is interested Event may include any generation in spherical video clip event, it is notable in such as spherical video clip duration Moment and/or interesting time point.Interested event can be user wish with other viewers of spherical video clip and/or At the time of consumer shares (for example, user and/or other users may be interested in interested moment and/or event).Example Such as, interested event may include spherical video clip titbit or climax, in addition to spherical video clip focus (for example, Action) external spherical video clip in other interested events in certain events for occurring and/or spherical video clip One or more of.Such as interested event may include the presentation of lower list:The impressive jump of slider Grease it in, the beach volleyball match air exercise of Notable, wild animal video it is unforgettable in capturing at the time of, sport The mark of football fan in race, the crowd reaction in surfing video, the beautiful natural land far from theme wild animal and/or Any other interested event captured in spherical video clip.
The label information may include label including text comment, emoticon, and/or image, and/or with mark Sign one or more of information and/or the associated other information of interested event.In some implementations, Yong Huke To submit label information associated with interested event by pressure sensitivity touch-control and/or other inputs.The label information It can be input into one or more users circle via display associated with (one or more) client computing platform 102 It is entered on face and/or via one or more user interfaces.For example, user can be light while viewing spherical video clip Display associated with (one or more) client computing platform 102 is kowtowed and/or touched to mark (mark and/or tag) The time point of interested event and/or viewing angle (for example, position) in spherical video clip.User can simply tapping Display with mark (mark and/or tag) interested event and/or can use keyboard and/or with (one or more) it is objective Computing platform 102 associated other input equipments in family end input comment associated with (mark and/or tag) is marked.System System 100 can receive the label information from (one or more) client computing platform 102.
The label information can identify the time point in spherical video clip, can watch spherical video at the time point Interested event in segment.System 100 can be from user's receiving time point so that user can select and/or select spherical shape The position that events of interest occurs, starts and/or will start in video clip.For example, user can select spherical piece of video Time point in section so that timestamp can be associated with interested event.The time point may include single time point, when Between range, multiple time points and/or other time point instruction.
The label information can identify the viewing angle in spherical video clip, and ball can be watched under the viewing angle Interested event in shape video clip.The viewing angle can be referred to can watch events of interest in spherical video clip Position.System 100 can receive viewing angle from user so that user can be selected and/or be selected in spherical video clip The position that events of interest occurs, starts and/or will start.For example, user can select the viewing in spherical video clip Angle so that the position in spherical video clip can be associated with interested event.The viewing angle may include water The multiple number of degrees and/or multiple number of degrees in the vertical visual field for looking squarely Yezhong.The viewing angle may include a series of viewing angles Degree, the single viewpoint based on the viewing angle, viewpoint and its near, and/or other viewings associated with events of interest One or more of angle.The viewing angle can be related to the display visual field.
The viewing angle may include one or more dimensions, in the spherical video clip of one or more dimension identification The position and/or which visual field that events of interest is located at will observe that can watching for spherical video clip is interested The part of event.For example, the viewing angle may include horizontal field of view (for example, from left to right), the vertical visual field (for example, high One or more of degree, up and/or down), and/or other positions information.The viewing angle and/or with the viewing The associated information of angle can be by cartesian coordinate system, cylinder and/or polar coordinate system, spherical shape and/or polar coordinate system, other One or more of coordinate system and/or other data define.
Label including time point and viewing angle (can watch interested event with viewing angle at the time point) Information can be stored in electronic memory 122 and/or can be stored in electricity associated with (one or more) server 104 In quantum memory.Spherical segment component 106 can be configured as acquisition label information associated with events of interest.If will Label information is stored on one or more servers 104, then can by the label information by network be sent to one or Multiple client computing platform 102 so that spherical segment component 106 can receive the label information.
When the display visual field of spherical video clip is presented in presentation component 114 over the display, as described above, visual field component 112 can be configured as whether the viewing angle for determining events of interest adjacent to the time point is located in the display visual field.It is adjacent The time point that interested event can closely be watched may include predefined before the time point that may be viewed by events of interest Period, the predefined period after the time point that may be viewed by events of interest, and/or may be viewed by events of interest when Between put one or more of.The visual field is shown as set forth above, it is possible to be determined on the basis of recycling or continuing.The display visual field It can indicate during the presentation of spherical video clip based on associated with (one or more) client computing platform 102 aobvious Show the determining present viewing field of the orientation of device.The display visual field can be via display during the presentation of spherical video clip Change one or many.The display visual field may include via display in current point in time to the visible viewing angle of user Degree, can equally obtain in current point in time many visuals field sightless to user (for example, except non-display is moved to the left or to the right Dynamic, otherwise user possibly can not see the display visual field of 180 degree to the left or right side 180 degree by the display visual field).Visual field component 114 can be automatically user change show the visual field with show automatically interested event and/or user can be based on (one or It is multiple) movement of client computing platform changes the display visual field.
For the time window in spherical video clip, the display visual field may include one or more in spherical video clip The visual range of a viewing angle.It is described spherical shape video clip in time window may include and/or corresponding to it is described when Between put associated neighbouring time point.The time window can correspond to interested event relevant time point and/or Time range.Time window in the spherical shape video clip may include the independent time window of independence or part and label In information associated period, segment durations and/or another time point, time portion and/or spherical video clip Time range.For example, the time window may include the spherical video clip started before the period starts it is lasting when Between a part so that the period for the interested event that viewing angle can be indicated by label information start before for use Family instruction shows the visual field.Time window can be determined by visual field component 112, and/or be selected by user and/or be referred in other ways Show.
Whether visual field component 112 can be configured as determines the visual field associated with label information at the neighbouring time point In the display visual field and/or outside the display visual field.In some implementations, may include fully in the display visual field And/or partly in the display visual field.May include fully and/or partly showing except the visual field outside the display visual field And/or deviate center in the display visual field.In some implementations, whether viewing angle associated with label information is located at Show that the determination in the visual field and/or outside the display visual field can be within the duration of spherical video clip with continual And/or the mode of cycle determines.
Notification component 118 can be configured as, in response to neighbouring time point determine viewing angle be located at the display visual field it Outside, the interested event for generating the spherical video clip of instruction is located at the warning information shown except the visual field.The warning information can To indicate the position by the events of interest in the spherical video clip indicated by label information.The warning information may include with The associated viewing angle of label information, time point associated with label information, and/or by label information indicate and/or with The relevant other information of the associated events of interest of label information.If notification component 118 is in one or more servers 104 On, then notification component 118 can be configured as realization and be sent to warning information by network and spherical shape can be presented on it The associated one or more client computing platforms of the display of video clip 102.
Notification component 118 can be configured as the presentation that notice is realized based on warning information.The notice may include figure One or more of shape notice, sound notification, sense organ notice and/or other types of notice.For example, the notice can wrap Include the alert message presented in the display visual field of spherical video clip.The notice for example may include the audible police of user Report sound.Exemplary sense organ notice may include vibration informing and/or light notice.The notice can indicate to the user that user can It can miss, having already passed by and/or may will miss the sense for the spherical video clip being likely to occur in except the display visual field Interesting event.
It can be regarded in the center for the showing the visual field and/or immediate vicinity for showing the visual field, the periphery in the display visual field and/or spherical shape Visible notice is presented at other positions in the display visual field of frequency segment.Sound notification may include in one or more earphones Notification voice by loud speaker broadcasting and/or other sound notifications in one or both sides interior, in earphone.(one can be passed through Or multiple) client computing platform 102, associated with (one or more) client computing platform 102 one or more aobvious Show equipment, one or more control devices associated with (one or more) client computing platform 102 (for example, user connects Mouthful) and/or miscellaneous equipment come transmit sense organ notice.
The notice may include that the direction for making display be orientated is shown so that viewing angle to be included in the visual field.It is described logical Knowing can indicate occurring in spherical video clip and/or the position of imminent events of interest.The notice can be with Including making the direction that display is orientated so that viewing angle associated with label information to be included in the display visual field.The notice May include multiple number of degrees so that display transformation angle and/or movement so that interested event may be displayed on display and regard In open country.For example, being adjacent to time point associated with label information, graphical notifications may include " eyeing left, looking at very cruel east West!".Graphical notifications may include the arrow in the direction for being directed toward mobile display so that interested event may be displayed on aobvious Show in the visual field.Sound notification for example may include " not miss you the right occurent thing " spoken message and/or can With the sound played in the auris dextra of user to indicate to the user that user should eye right.The sound can be in the left ear of user It plays to indicate to the user that user should eye left.
The notice may include the time point that can watch events of interest.The notice can indicate spherical piece of video The time point for the events of interest for occurring, will occurring and/or having occurred and that in section.For example, graphical notifications may include It " eyes left at 8 seconds at 2 points, looks at very cruel thing!".Graphical notifications may include timer, the timer countdown until The time point.Sound notification for example may include the spoken message of " not miss the thing that your the right will occur in 10 seconds ". Notification component 118 can be configured as the presentation for realizing notice after in the past at time point.As described above, system 100 can carry For being used to allowing associated with (one or more) client computing platform 102 user's F.F., refunding, watched with slow motion User control, and/or display and/or manipulation for controlling spherical video clip other user controls.
As an example, it includes notifying 402 that Fig. 4, which was depicted according to one or more realization methods at time point 404, The exemplary display visual field 400 of spherical video clip 200.In response at neighbouring time point 404 (for example, time point 404 is to enter 60 seconds of spherical video clip 200) it determines, and the associated viewing angle of label information associated with events of interest is located at It shows except the visual field 400, can be generated in the visual field 400 and presentation notifies 402.Spherical video clip can be indicated by notifying 402 Events of interest in 200 will occur and/or just be happened at except the visual field 400.Notifying 402 can indicate that user makes display 202 directions that should be orientated are to observe the part that may include events of interest of spherical video clip 400.For example, perhaps Fig. 2 and figure 3 slider jumps at 67 seconds into spherical video clip 200.When the slider is no longer depicted in the visual field 400 When interior, notify 402 can with indication display 202 to which direction be orientated with again display the visual field 400 in viewing slider and/ Or interested event (for example, jump).Although being depicted with arrow notify 402 in Fig. 4, this being given for example only property purpose It is not intended to limit the present invention, because other notices can be provided.
As described above, system 100 can pass through (one or more) client computing platform associated with display 102 To receive label information associated with interested event so that next user can remind use when watching spherical video clip The interested event in family and/or to allow other viewers and/or consumer not to miss sense in the spherical video clip of viewing emerging The event of interest.When the consumer different from user watches spherical video clip, which may want to above-mentioned similar Mode marks the second events of interest in (mark and/or tag) spherical video clip so that he/her refers to and/or supplies other Viewer and/or consumer's reference.Label information associated with the second events of interest can identify in spherical video clip The second time point and spherical video clip in the second viewing angle, second time point and the second viewing angle can be with The second events of interest in the spherical video clip of viewing.Label information associated with the second events of interest can be stored In electronic memory 122 and/or other storage devices.With similar mode as described above, system 100 may be implemented by with The associated label information of second events of interest is transmitted to the second client computing platform associated with the second consumer, makes Spherical video clip can be watched by display associated with the second client computing platform by obtaining the second consumer.When When two consumers watch the spherical video clip, interested event can be directed to and/or the second interested event is presented Notice.By label information, spherical video clip may include any amount of events of interest, which can be by phase It is received with user and/or other users.Any amount of notice of each events of interest can be presented to spherical piece of video The following viewer of section.
In some implementations, label information can be used for editing spherical video clip.For example, the spherical piece of video of editor Section may include one or more of following item:The two-dimensional video segment of selection and/or the spherical video clip of editor;Increase One of the spherical video clip of (for example, mobile content etc.), enhancing (for example, color correction etc.) and/or in other ways refinement Or multiple portions and/or region (for example, frame, and/or other parts and/or region);And/or editor's spherical shape regards in other ways One or more parts of frequency segment and/or region (for example, frame, and/or other parts and/or region).Spherical video clip Label information can indicate the spherical video clip that edit one or more parts and/or region (for example, frame and/ Or other parts and/or region).The label information can be used for from spherical video clip select the part to be edited and/ Or region.
Fig. 1 is returned to, client computing platform 102, (one or more) server 104 and/or external resource 120 can be through It is operably connected by one or more electronic communication links.For example, this electronic communication link can be at least partially through The network of such as internet and/or other networks are established.It should be appreciated that this is not intended to limit and the scope of the present invention packet Including wherein (one or more) client computing platform 102, (one or more) server 104 and/or external resource 120 can be with The realization method being operably connected via some other communication medias.
External resource 120 may include information source, the host of Virtual Space outside system 100 and/or provider, participation The external entity of system 100, external entity, and/or other resources for digital content and/or digital content platform.One In a little realization methods, the part and/or repertoire that are attributed to external resource 120 herein can be by the moneys that include in system 100 Source provides.
(one or more) client computing platform 102 may include electronic memory 122, one or more processors 124 and/or other components.(one or more) client computing platform 102 may include communication line or port, with can be with Network and/or other servers and/or computing platform carry out information exchange.(one or more) client exemplified in Fig. 1 Computing platform 102 is not intended to limit.(one or more) client computing platform 102 may include being operated together will be attributed to Functions herein is supplied to multiple hardware, software and/or the fastener components of (one or more) client computing platform 102.Example Such as, (one or more) client computing platform 102 can be by grasping together as (one or more) client computing platform 102 The cloud computing platform of work is realized.
One or more servers 104 may include electronic memory, one or more processors, be configured to operating component 106 to component 118 computer-readable instruction.
Electronic memory 122 may include the electronic storage medium that information is stored electronically.The electronics of electronic memory 122 Storage medium may include and integrally (the i.e. substantially immovable) offer of (one or more) client computing platform 102 System storage and/or it is removably couplable to (one or more) client computing platform for example, by port or driver One or both of 102 mobile memory.Port may include USB port, FireWire port port and/or other ports.Driving Device may include disc driver and/or other drivers.Electronic memory 122 may include readable storage media (example Such as, CD etc.), magnetic readable storage medium storing program for executing (for example, tape, magnetic hard drive, floppy disk etc.), based on charge Storage medium (for example, EEPROM, RAM etc.), solid storage medium (for example, flash drive etc.) and/or other electronically readables One or more of storage medium.Electronic memory 122 may include one or more virtual storage resources (for example, cloud is deposited Reservoir, Virtual Private Network and/or other virtual storage resources).Electronic memory 122 can store software algorithm, by (one Or it is multiple) processor 124 determine information, from (one or more) client computing platform 102 reception information, from (one Or multiple) information that receives of server 104, and/or enable (one or more) client computing platform 102 to realize to retouch herein The other information for the function of stating.
(one or more) processor 124 is configured as providing letter in (one or more) client computing platform 102 Cease processing capacity.In this way, (one or more) processor 124 may include digital processing unit, analog processor, be designed as being used for The digital circuit of information is handled, analog circuit for handling information, state machine is designed as, and/or other is located in for electronics Manage one or more of the mechanism of information.Although (one or more) processor 124 is illustrated as single entity in Fig. 1, This being given for example only property purpose.In some implementations, (one or more) processor 124 may include one or more places Manage unit.These processing units may be physically located in same equipment, or (one or more) processor 124 can be shown The processing function of the multiple equipment of cooperating.Processor 124 can be configured as operating component 106 to component 118.Processor 124 can be configured as and pass through software;Hardware;Firmware;Certain combinations of software, hardware, and/or firmware;And/or it is used for The other mechanism for configuring processing capacity on (one or more) processor 124 come operating component 106, component 108, component 110, group Part 111, component 112, component 114, component 116 and/or component 118.
It will be appreciated that though component 106 is illustrated as being located at and/or being co-located at system 100 to component 118 in Fig. 1 Specific components in, but in the realization method of (one or more) physical processor 124 including multiple processing units, component 106 can be located remotely from other components to one or more of component 118.By different components 106 described herein to component The description of 118 functions of providing is for exemplary purposes, and to be not intended to be limited to, because any in component 106 to component 118 Component can provide functions more more or fewer than described function.For example, can remove in component 106 to component 118 One or more, and some or all functions of component 106 to component 118 can be merged, share, be integrated into component 106 Into other components in component 118, and/or by other components in component 106 to component 118 provide it is described some or all Function.It should be noted that (one or more) physical processor 124 can be configured as the one or more add-on assembles of operation, The one or more add-on assemble can execute herein belong to component 106 to one of component 118 some or all Function.
The one or more components of system 100 can be configured as presentation and/or provide user interface to provide system 100 With the interface between user's (for example, controlled entity, and/or using other users of graphic user interface), used by the interface Family can provide information to system 100 and receive information from system 100.This makes it possible to transmit between user and system 100 Data, result, and/or instruction (for example, determining, selection, and/or other instructions) and it is any other be referred to as " information " can Transmit item.The example for the information that can be transmitted by user and/or controlled entity is the instruction of selected time, selected position Instruction, user comment and/or comment information, and/or other information.It is suitable for inclusion in the example of the interface equipment in user interface Including with computing platform, keypad, button, switch, keyboard, knob, control-rod, display screen, touch screen, mouse, loud speaker, wheat One of gram wind, indicator light, voice guard and/or the associated interface of printer or more persons.Can by user interface with The form of graphic user interface provides a user information.
It is to be understood that other communication technologys (hardwired is wireless) are also conceived to be considered user interface herein. For example, in one embodiment, the removable Storage Interface integration that user interface can be provided with electronic memory 122 is one It rises.In this example, information can be added from removable memory (for example, smart card, flash drive, moveable magnetic disc etc.) It is downloaded in system 100, this enables the self-defined system of (one or more) user 100.Suitable for what is be used together with system 100 Other examples input equipment and technology as user interface include but not limited to the ports RS-232, RF links, IR links, adjust Whole demodulator (phone, cable, Ethernet, internet or other).In short, any skill for transmitting information with system 100 Art is all conceived to as user interface.
Fig. 5 and Fig. 6 shows showing with viewing spherical video clip for rendering according to one or more realization methods Example property method 500 and method 600.The operation of method 500 and/or method 600 presented below is it is intended that illustrative and unrestricted The example of property.In some implementations, method 500 and/or method 600 can utilize the additional behaviour of the one or more not described Make and/or is realized without using described one or more operations.In addition, showing in Fig. 5 and/or Fig. 6 and retouching below The sequence of the operation of the method 500 and/or method 600 stated is not intended to limit.
In some implementations, can one or more processing equipments (for example, digital processing unit, analog processor, It is designed as the digital circuit for handling information, is designed as analog circuit for handling information, and/or other for electronically Handle information mechanism) in implementation method 500 and/or method 600.One or more of processing equipments may include in response to The instruction that is stored electronically on electronic storage medium and execute the one of some or all operations of method 500 and/or method 600 A or multiple equipment.One or more of processing equipments may include by hardware, firmware, and/or being specially designed for holding One or more equipment of the software configuration of one or more operations of row method 500.
About method 500 spherical video clip can be obtained at operation 502.In some implementations, Ke Yiyou Behaviour is executed with spherical segment component 106 (be shown in FIG. 1 and be described herein) same or analogous spherical segment component Make 502.
At operation 504, the orientation of two dimensional display can be determined with sensor-based output signal.The two dimension is aobvious Show that device can be configured as presentation two dimensional image.It is related with the orientation of display that the sensor can be configured as generation transmission Information output signal.It in some implementations, can be by (being shown in FIG. 1 and retouching herein with orientation component 108 State) same or analogous orientation component executes operation 504.
At operation 506, the spherical video clip for waiting for presenting over the display can be determined based on the orientation of display The interior display visual field.It in some implementations, can be by (being shown in FIG. 1 and being described herein) with visual field component 112 Same or analogous visual field component executes operation 506.
At operation 508, the display visual field of spherical video clip can be presented over the display.In some realization methods In, it can be by executing behaviour with component 114 (be shown in FIG. 1 and be described herein) same or analogous presentation component is presented Make 508.
At operation 510, the display visual field can be captured as two-dimensional video segment.In some implementations, Ke Yiyou Operation 510 is executed with component 116 (be shown in FIG. 1 and be described herein) same or analogous capture component is captured.
About method 600 spherical video clip can be obtained at operation 602.The spherical shape video clip may include with The associated label information of events of interest in spherical video clip.The label information can identify in spherical video clip Time point and spherical video clip in viewing angle, can be watched in spherical video clip with viewing angle at the time point Events of interest.It in some implementations, can be by (being shown in FIG. 1 and retouching herein with spherical segment component 106 State) same or analogous spherical segment component executes operation 502.
At operation 604, the orientation of two dimensional display can be determined with sensor-based output signal.The two dimension is aobvious Show that device can be configured as presentation two dimensional image.It is related with the orientation of display that the sensor can be configured as generation transmission Information output signal.It in some implementations, can be by (being shown in FIG. 1 and retouching herein with orientation component 108 State) same or analogous orientation component executes operation 604.
At operation 606, the spherical video clip for waiting for presenting over the display can be determined based on the orientation of display The interior display visual field.It in some implementations, can be by (being shown in FIG. 1 and being described herein) with visual field component 112 Same or analogous visual field component executes operation 606.
At operation 608, the display visual field of spherical video clip can be presented over the display.In some realization methods In, it can be by executing behaviour with component 114 (be shown in FIG. 1 and be described herein) same or analogous presentation component is presented Make 608.
At operation 610, it can determine whether viewing angle is located in the display visual field at the neighbouring time point.At some In realization method, can by with visual field component 112 (be shown in FIG. 1 and be described herein) same or analogous visual field component To execute operation 610.
At operation 612, it can be given birth in response to determining viewing angle showing except the visual field at the neighbouring time point Produce warning information.The warning information can indicate that the events of interest of spherical video clip is located at except the display visual field.One In a little realization methods, can by with notification component 118 (be shown in FIG. 1 and be described herein) same or analogous group of notifications Part executes operation 612.
At operation 614, warning information can be based on, notice is presented.The notice may include warning information and can be with It is presented in the display visual field.It in some implementations, can be by (being shown in FIG. 1 and retouching herein with notification component 118 State) same or analogous notification component executes operation 614.
It is retouched in detail although having been based on be presently considered to be most viable and preferred realization method for illustrative purposes Disclosed technology is stated, it is to be understood that such details is only used for above-mentioned purpose and the present invention is not limited to any specific realities Existing mode, but, on the contrary, the present invention is directed to cover modification and equivalent cloth within the spirit and scope of the appended claims It sets.Such as, it is understood that the present invention as much as possible consider any embodiment one or more features can with it is any other The one or more features of embodiment combine.

Claims (20)

1. a kind of system of the events of interest in video clip spherical for rendering, the system comprises:
Two dimensional display, the two dimensional display are configured as that two dimensional image is presented;
Sensor, the sensor are configurable to generate output signal, the orientation of the output signal transmission and the display Related information;
One or more physical computer processors, computer-readable instruction is by one or more of physical computer processors It is configured to:
Obtain the spherical video clip, the spherical shape video clip include with it is described interested in the spherical video clip The associated label information of event, the label information identify time point and the spherical video in the spherical video clip Viewing angle in segment can watch the sense in the spherical video clip at the time point and the viewing angle Interesting event;
The orientation of the display is determined based on the output signal;
The orientation based on the display determines aobvious in the spherical video clip for waiting for presenting on the display Show the visual field;
Realize the presentation of the display visual field of the spherical video clip on the display;
The neighbouring time point determines whether the viewing angle is located in the display visual field;
The viewing angle is determined except the display visual field in response to the neighbouring time point, generates warning information, it is described Warning information indicates that the events of interest of the spherical video clip is located at except the display visual field;And
The presentation of notice is realized based on the warning information, wherein the notice includes the warning information, and described aobvious Show and the notice is presented in the visual field.
2. system according to claim 1, wherein the neighbouring time point that can watch the events of interest includes One or more of below:Time predefined section before it can watch the time point of the events of interest, It time predefined section after the time point that the events of interest can be watched, and/or can watch described interested The time point of event.
3. system according to claim 1, wherein the notice includes the warning information in the display visual field Graphical representation.
4. system according to claim 3, wherein the graphical representation includes that the display is made to be orientated with by the sight See the direction that angle is included in the display visual field.
5. system according to claim 3, wherein the graphical representation includes that can watch the institute of the events of interest State time point.
6. system according to claim 1, wherein the notice includes that the sound of the warning information indicates.
7. system according to claim 6, wherein the sound of the warning information indicates to include making the display It is orientated so that the viewing angle to be included in the audio direction in the display visual field.
8. system according to claim 1, wherein one or more of processors are additionally configured to:
It is received and the second events of interest phase in the spherical video clip from client computing platform associated with the user Associated label information, the label information identify the second time point and the spherical video clip in the spherical video clip The second interior viewing angle can be watched at second time point and second viewing angle in the spherical video clip Second events of interest.
9. system according to claim 8, wherein one or more of processors are additionally configured to:
Storage label information associated with spherical shape second events of interest of video clip.
10. system according to claim 9, wherein one or more of processors are additionally configured to:
It realizes and label information associated with second events of interest is transferred to the second client computing platform.
11. a kind of method of the events of interest in video clip spherical for rendering, the method includes:
Obtain the spherical video clip, the spherical shape video clip include with it is described interested in the spherical video clip The associated label information of event, the label information identify time point and the spherical video in the spherical video clip Viewing angle in segment can watch the sense in the spherical video clip at the time point and the viewing angle Interesting event;
The orientation of two dimensional display is determined based on the output signal generated by sensor, wherein the display be configured as be in Existing two dimensional image and the output signal transmit information related with the orientation of the display;
The orientation based on the display determines aobvious in the spherical video clip for waiting for presenting on the display Show the visual field;
Realize the presentation of the display visual field of the spherical video clip on the display;
The neighbouring time point determines whether the viewing angle is located in the display visual field;
The viewing angle is determined except the display visual field in response to the neighbouring time point, generates warning information, it is described Warning information indicates that the events of interest of the spherical video clip is located at except the display visual field;And
The presentation of notice is realized based on the warning information, wherein the notice includes the warning information, and described aobvious Show and the notice is presented in the visual field.
12. according to the method for claim 11, wherein the neighbouring time point packet that can watch the events of interest It includes one or more of following:Time predefined section before it can watch the time point of the events of interest, Time predefined section after it can watch the time point of the events of interest, and/or can to watch the sense emerging The time point of interesting episode part.
13. according to the method for claim 11, wherein the notice includes the alarm signal in the display visual field The graphical representation of breath.
14. according to the method for claim 13, wherein the graphical representation includes that the display is made to be orientated with will be described Viewing angle is included in the direction in the display visual field.
15. according to the method for claim 13, wherein the graphical representation includes that can watch the events of interest The time point.
16. according to the method for claim 11, wherein the notice includes that the sound of the warning information indicates.
17. according to the method for claim 16, wherein the sound of the warning information indicates to include making the display Device is orientated so that the viewing angle to be included in the audio direction in the display visual field.
18. according to the method for claim 11, wherein one or more of processors are additionally configured to:
It is received and the second events of interest phase in the spherical video clip from client computing platform associated with the user Associated label information, the label information identify the second time point and the spherical video clip in the spherical video clip The second interior viewing angle can be watched at second time point and second viewing angle in the spherical video clip Second events of interest.
19. according to the method for claim 18, wherein one or more of processors are additionally configured to:
Storage label information associated with spherical shape second events of interest of video clip.
20. according to the method for claim 19, wherein one or more of processors are additionally configured to:
It realizes and label information associated with second events of interest is transferred to the second client computing platform.
CN201780012107.XA 2016-02-17 2017-02-17 For rendering with the system and method for the spherical video clip of viewing Pending CN108702451A (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US15/046,344 2016-02-17
US15/046,344 US9973746B2 (en) 2016-02-17 2016-02-17 System and method for presenting and viewing a spherical video segment
US15/050,297 2016-02-22
US15/050,275 2016-02-22
US15/050,275 US9743060B1 (en) 2016-02-22 2016-02-22 System and method for presenting and viewing a spherical video segment
US15/050,297 US9602795B1 (en) 2016-02-22 2016-02-22 System and method for presenting and viewing a spherical video segment
PCT/US2017/018508 WO2017143289A1 (en) 2016-02-17 2017-02-17 System and method for presenting and viewing a spherical video segment

Publications (1)

Publication Number Publication Date
CN108702451A true CN108702451A (en) 2018-10-23

Family

ID=59625526

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780012107.XA Pending CN108702451A (en) 2016-02-17 2017-02-17 For rendering with the system and method for the spherical video clip of viewing

Country Status (3)

Country Link
EP (1) EP3417609A4 (en)
CN (1) CN108702451A (en)
WO (1) WO2017143289A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10721510B2 (en) 2018-05-17 2020-07-21 At&T Intellectual Property I, L.P. Directing user focus in 360 video consumption
US10482653B1 (en) 2018-05-22 2019-11-19 At&T Intellectual Property I, L.P. System for active-focus prediction in 360 video
US10827225B2 (en) 2018-06-01 2020-11-03 AT&T Intellectual Propety I, L.P. Navigation for 360-degree video streaming

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040075738A1 (en) * 1999-05-12 2004-04-22 Sean Burke Spherical surveillance system architecture
CN103608716A (en) * 2011-06-17 2014-02-26 微软公司 Volumetric video presentation
US20140184821A1 (en) * 2012-12-28 2014-07-03 Satoshi TANEICHI Image management system, image management method, and computer program product
US8896694B2 (en) * 2010-09-13 2014-11-25 Contour, Llc Portable digital video camera configured for remote image acquisition control and viewing
US20150113581A1 (en) * 2011-01-10 2015-04-23 Dropbox, Inc. System and method for sharing virtual and augmented reality scenes between users and viewers
US20150243085A1 (en) * 2014-02-21 2015-08-27 Dropbox, Inc. Techniques for capturing and displaying partial motion in virtual or augmented reality scenes

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000060853A1 (en) * 1999-04-08 2000-10-12 Internet Pictures Corporation Method and apparatus for providing virtual processing effects for wide-angle video images
US10440329B2 (en) * 2009-05-22 2019-10-08 Immersive Media Company Hybrid media viewing application including a region of interest within a wide field of view
US9930225B2 (en) * 2011-02-10 2018-03-27 Villmer Llc Omni-directional camera and related viewing software
US9473758B1 (en) * 2015-12-06 2016-10-18 Sliver VR Technologies, Inc. Methods and systems for game video recording and virtual reality replay

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040075738A1 (en) * 1999-05-12 2004-04-22 Sean Burke Spherical surveillance system architecture
US8896694B2 (en) * 2010-09-13 2014-11-25 Contour, Llc Portable digital video camera configured for remote image acquisition control and viewing
US20150113581A1 (en) * 2011-01-10 2015-04-23 Dropbox, Inc. System and method for sharing virtual and augmented reality scenes between users and viewers
CN103608716A (en) * 2011-06-17 2014-02-26 微软公司 Volumetric video presentation
US20140184821A1 (en) * 2012-12-28 2014-07-03 Satoshi TANEICHI Image management system, image management method, and computer program product
US20150243085A1 (en) * 2014-02-21 2015-08-27 Dropbox, Inc. Techniques for capturing and displaying partial motion in virtual or augmented reality scenes

Also Published As

Publication number Publication date
EP3417609A1 (en) 2018-12-26
WO2017143289A1 (en) 2017-08-24
EP3417609A4 (en) 2019-07-17

Similar Documents

Publication Publication Date Title
US11546566B2 (en) System and method for presenting and viewing a spherical video segment
US9743060B1 (en) System and method for presenting and viewing a spherical video segment
JP6725038B2 (en) Information processing apparatus and method, display control apparatus and method, program, and information processing system
JP6558587B2 (en) Information processing apparatus, display apparatus, information processing method, program, and information processing system
US9026596B2 (en) Sharing of event media streams
US20200359079A1 (en) Augmented reality apparatus and method
TWI526058B (en) Method and system for customising live media content
US9973746B2 (en) System and method for presenting and viewing a spherical video segment
US20180020162A1 (en) System and method for identifying comment clusters for panoramic content segments
US20150242688A1 (en) Augmented reality apparatus and method
CN112261481B (en) Interactive video creating method, device and equipment and readable storage medium
CN107079186A (en) enhanced interactive television experience
US20180124374A1 (en) System and Method for Reducing System Requirements for a Virtual Reality 360 Display
CN113490010B (en) Interaction method, device and equipment based on live video and storage medium
CN108702451A (en) For rendering with the system and method for the spherical video clip of viewing
CN113392690A (en) Video semantic annotation method, device, equipment and storage medium
JP7202935B2 (en) Attention level calculation device, attention level calculation method, and attention level calculation program
KR20190133211A (en) Server device, and computer program used for it
CN112684893A (en) Information display method and device, electronic equipment and storage medium
Bedri Spatial News: exploring augmented reality as a format for content production, organization, and consumption
CN116996734A (en) Live scene-based barrage pushing method, live scene-based barrage pushing device, live scene-based barrage pushing equipment and live scene-based barrage pushing medium
Alfaro Surround vision
Alfaro Bernate Surround vision: a handheld screen for accessing peripheral content around the TV

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20181023

WD01 Invention patent application deemed withdrawn after publication