JP6735358B2 - System and method for presenting content - Google Patents

Description

The present technology relates to the field of content presentation. More specifically, the present technology relates to techniques for presenting content items through a computing device.

Today, people utilize computing devices (or computing systems) for a wide variety of purposes. Users can operate computing devices to interact with each other, create content, share content, and access information, for example. In the conventional approach, content items (eg, images, videos, audio files, etc.) can be made available through the content sharing platform. Users can operate their computing devices to access content items through the platform. Typically, content items can be provided or uploaded by a variety of entities including, for example, content publishers and users of content sharing platforms. In some cases, content items can be categorized and curated or categorized or curated.

Various embodiments of the present disclosure include systems, methods, and non-transitory computer-readable media configured to determine at least one request to access a content item, the requested content item comprising: It is configured with a set of camera feeds that image one or more scenes from a set of different positions. Information describing an auto-view mode for navigating at least some of the one or more scenes in the requested content item is obtained. A viewport interface is provided on the display screen of the computing device where playback of the requested content item is presented. The viewport interface is automatically navigated across at least some of the one or more scenes during playback of the requested content item based at least in part on the auto-viewing mode.

In some embodiments, systems, methods, and non-transitory computer readable media navigate a viewport interface across at least some of one or more scenes during playback of a requested content item. Is configured to obtain information describing at least one trajectory for

In some embodiments, systems, methods, and non-transitory computer-readable media determine a category corresponding to a user operating a computing device based at least in part on one or more attributes of the user. Obtaining at least one trajectory associated with a category, the trajectory being determined to be of interest to at least some of the people in the category. Configured to run.

In some embodiments, systems, methods, and non-transitory computer-readable media obtain information describing at least one point of interest that appears during playback of a requested content item, the requested content item. Capturing information describing at least one trajectory for navigating the viewport interface over at least some of the one or more scenes during playback of the trajectory. , Including at least one point of interest.

In some embodiments, at least one point of interest is defined by the developer of the requested content item.
In some embodiments, systems, methods, and non-transitory computer-readable media determine a category corresponding to a user operating a computing device based at least in part on one or more attributes of the user. And obtaining at least one point of interest associated with the category, the at least one point of interest being determined to be of interest to at least some of the people in the category.

In some embodiments, the systems, methods, and non-transitory computer-readable media provide a computing device during playback of a requested content item for manually navigating the viewport interface to a particular point of interest. Determining that the user operating the one or more actions has been performed, determining that an operation for sharing a particular point of interest has been performed, and information describing the particular point of interest is social To be shared via a networking system.

In some embodiments, the system, method, and non-transitory computer-readable medium provide for manually navigating the viewport interface during playback of a requested content item to generate a customized trajectory. Determining that a user operating a computing device has performed one or more actions, determining that an action has been performed to share a customized trajectory, describing the customized trajectory. Enabling the information to be shared via a social networking system.

In some embodiments, the system, method, and non-transitory computer-readable medium determine that the requested content item includes a first point of interest and a second point of interest. 2 points of interest appearing after the first point of interest during playback of the requested content item, determining, automatically navigating the viewport interface from the first point of interest to the second point of interest Previously causing the directional indicator to be displayed in the viewport interface, the directional indicator points to a direction corresponding to the second point of interest.

In some embodiments, the system, method, and non-transitory computer-readable medium determine that the requested content item includes a first point of interest and a second point of interest. 2 points of interest appearing after the first point of interest during playback of the requested content item, determining that the viewport interface uses the at least one video transition technique from the first point of interest to the second point of interest. Automatically navigated to the point of interest, configured to perform.

It should be understood that many other features, applications, embodiments, and/or variations of the disclosed technology will be apparent from the accompanying drawings and the following detailed description. Employing additional and/or alternative implementations of the structures, systems, non-transitory computer-readable media, and methods described herein without departing from the principles of the disclosed technology. You can

1 illustrates an exemplary system including an exemplary content presentation module according to one embodiment of this disclosure. 1 illustrates an example of an interface module according to an embodiment of the present disclosure. 1 illustrates an example of a content director module according to one embodiment of the present disclosure. 6 illustrates an example viewport interface in which navigation indicators are provided when a content item is accessed, according to one embodiment of the disclosure. 6 illustrates an example viewport interface in which navigation indicators are provided when a content item is accessed, according to one embodiment of the disclosure. 6 illustrates an example viewport interface in which navigation indicators are provided when a content item is accessed, according to one embodiment of the disclosure. 5 illustrates an example of a developer interface for customizing a user experience for a virtual content item according to an embodiment of the disclosure. 6 illustrates an example of navigation indicators that can be provided to a viewport interface when a content item is accessed according to embodiments of the present disclosure. 6 illustrates an exemplary method of navigating a viewport interface according to an embodiment of the disclosure. FIG. 1 is a network diagram of an exemplary system including an exemplary social networking system that can be utilized in various scenarios according to embodiments of the disclosure. FIG. 15 illustrates an example computer system or computing device that may be used in various scenarios according to embodiments of the disclosure.

The figures depict various embodiments of the disclosed technology for purposes of explanation only, and the figures use the same reference numerals to identify similar elements. Those skilled in the art will recognize from the following description that alternative embodiments of the structures and methods shown in the drawings can be used without departing from the principles of the disclosed technology described herein. ..

Approaches for Presenting Content People use computing devices (or computing systems) for a wide variety of purposes. As noted above, conventional approaches allow users to utilize computing devices to share content items (eg, documents, images, videos, audio, etc.) with other users. In conventional approaches, content items (eg, images, videos, audio files, etc.) may be made available through a content sharing platform. Users can operate their computing devices to access content items through the platform. Typically, content items can be provided or uploaded by a variety of entities including, for example, content publishers and users of content sharing platforms.

In some examples, a user may access virtual content via, for example, a display screen of these computing devices, a virtual reality system, and/or a head mounted display. Virtual content may be constructed using one or more videos and/or images that capture multiple scenes, such as, for example, geographic location and/or activity being performed. Such multiple scenes may be imaged from the real world and/or computer generated. In some cases, virtual content is configured to allow a user to navigate within a scene captured by the virtual content. Thus, by accessing the virtual content, the user is captured, for example, as if the user were physically present anywhere and/or physically performing the indicated activity in the scene. You can virtually experience and navigate the different scenes.

The virtual content may be, for example, a spherical video that captures a 360 degree view of the scene. Spherical video stitches various video streams or feeds captured by multiple cameras located at different locations and/or positions to capture a 360 degree view of a scene. Created by Once stitched in, the user can access or play the spherical image and view a portion of the spherical image at an angle. In general, while accessing a spherical image, the user changes the viewport direction (eg, pitch, yaw, roll) to access another portion of the scene captured by the spherical image. You can zoom and change. Given the nature of virtual content, it may be difficult for a user to see changes to the zoom level and/or viewport orientation. Such changes may deviate from the intended zoom level and/or viewport direction specified by the virtual content developer. In some examples, while maneuvering the viewport orientation, the user may miss a portion of the spherical image that includes one or more points of interest. For example, the user can change the direction of the viewport so that the user views one direction when the point of interest is visually recognized by the user if the directions of the viewports face in the opposite directions. Without such points of interest, the overall user experience may be degraded and the user's involvement with virtual content may be adversely affected. Therefore, such conventional approaches may not be effective in addressing these issues and other issues that arise in computer technology.

Improved approaches based on computer technology overcome the aforementioned and other drawbacks associated with conventional approaches that occur particularly in the field of computer technology. In various embodiments, navigational elements or indicators may be provided in the interface or viewport where virtual content is presented. Navigation indicators visually indicate a user interacts with the virtual content to: i) viewport heading in multiple scenes captured by the virtual content; and/or ii) viewport zoom level. Can be updated automatically. In various embodiments, the navigation indicator can also be configured to indicate the direction or orientation of each of the plurality of points of interest present in the virtual content being accessed. The direction of the point of interest may be identified in the navigation indicator in relation to the direction of the viewport, for example. As a result, the user can easily determine when the point of interest can be viewed as well as the relative direction of the point of interest. In some embodiments, the user can automatically engage an automatic mode that guides the user's viewport to multiple points of interest.

FIG. 1 illustrates an exemplary system 100 including an exemplary content presentation module 102 configured to provide a content item to a user, according to embodiments of the disclosure. As shown in the example of FIG. 1, content presentation module 102 may include interface module 104, content module 106, and content director module 108. In some cases, the exemplary system 100 may include at least one data store 110. The components shown in this figure and all figures herein (eg, modules, elements, etc.) are merely exemplary, and any other implementation may include additional, fewer, integrated, or It can include different components. Some components may not be shown in order not to obscure the relevant details.

In some embodiments, content presentation module 102 may be implemented partially or wholly as software, hardware, or any combination thereof. In general, the modules discussed herein can be associated with software, hardware, or any combination thereof. In some implementations, one or more functions, tasks, and/or operations of the modules may be performed or performed by software routines, software processes, hardware, and/or any combination thereof. In some cases, content presentation module 102 may be partially or wholly implemented as software running on one or more computing devices or computing systems, such as on user computing devices or client computing systems. Can be implemented in. For example, does content presentation module 102, or at least a portion thereof, be implemented as an application (eg, app), program, applet, or the like that runs on a user computing device or client computing system, such as user device 810 of FIG. , Or can be implemented within these. Further, the content presentation module 102, or at least a portion thereof, may be implemented using one or more computing devices or systems that include one or more servers such as network servers or cloud servers. In some cases, content presentation module 102 may be implemented partially or entirely within a social networking system (or social networking service), such as social networking system 830 of FIG. 8, or in conjunction therewith. Alternatively, it can be configured to operate as a whole. It should be appreciated that many variations or other possibilities may exist.

In various embodiments, the content presentation module 102 can utilize the interface module 104 and the content module 106 to provide content items to a user. The interface module 104 can be configured to provide a viewport (eg, a graphical user interface) in which content items can be presented (eg, streamed). For example, the viewport may be provided through a software application running on the computing device being operated by the user. The viewport may be presented through the display screen of the computing device. The user can interact with the viewport by, for example, performing an action, such as a gesture (eg, a touch screen gesture, a hand gesture, etc.) through an input device or display screen.

Content module 106 may be configured to provide various types of content items that may be presented via the interface provided by interface module 104. For example, content items may be obtained from a social networking system (eg, social networking system 830 of FIG. 8) or some other content provider system. In various embodiments, the content module 106 may be configured using one or more videos and/or images that image multiple scenes (eg, geographic location and/or activity being performed). Content can be provided. Such multiple scenes may be imaged from the real world and/or computer generated. Virtual content can be any content that images a 360 degree view and/or any three-dimensional (3D) content. Further, virtual content can include content of any size that is larger than the viewport can present at any time. In such an example, when the position of the viewport changes, the viewport can display different portions of the content. In one example, virtual content is a commonly known image that includes, for example, rectilinear stitching, spherical stitching, and cubic stitching, to name a few examples. It can be created using stitching techniques. In another example, the virtual content may be a spherical image capturing a 360 degree view of a scene such as a point of interest. Other examples of virtual content may include video configured using a monoscopic 360-degree view, stereoscopic 180-degree view, and the like. Spherical video is by stitching various video streams or feeds captured by multiple cameras located at different locations and/or positions to capture a 360 degree view of the scene. Can be created. Such multiple video streams may be predetermined at various angles of the spherical image (eg, 0 degrees, 30 degrees, 60 degrees, etc.). Once stitched together, the user can access or view a portion of the spherical image at a certain angle while playing the spherical image. The portion of the spherical image shown to the user may be determined based on the position and orientation of the user's viewport in three-dimensional space.

The content director module 108 can provide content developers with access to various features that allow for customization of the user experience when viewing virtual content. Further details regarding the content director module 108 are provided below with reference to FIG.

In some embodiments, content presentation module 102 can be configured to communicate with or operate with or to communicate with at least one data store 110 in exemplary system 100. At least one data store 110 can be configured to store and maintain various types of data. In various embodiments, at least one data store 110 can store data related to the functionality and operation of content presentation module 102. One example of such data is a content item available for access through an interface provided by the interface module 104. In some implementations, at least one data store 110 can store information associated with a social networking system (eg, social networking system 830 in FIG. 8). Information associated with social networking systems includes users, social connections, social interactions, locations, geo-fenced areas, maps, locations, events, pages, groups, posts, communications, content, feeds, accounts. These include data about settings, privacy settings, social graphs, and a variety of other types of data. In some implementations, at least one data store 110 includes a user identifier, user information, profile information, user-specified settings, content generated or posted by the user, various other types of user data, etc. The information associated with the can be stored. It should be appreciated that many variations or other possibilities may exist.

FIG. 2 illustrates an example interface module 202 200 according to an embodiment of the disclosure. In some embodiments, the interface module 104 of FIG. 1 can be implemented with the interface module 202. As shown in the example of FIG. 2, the interface module 202 includes a view direction module 204, a view zoom level module 206, an indicator module 208, a points of interest module 210, and an automatic mode module 212. , A motion transition module 214.

As mentioned above, the interface module 202 may be configured to provide a viewport (eg, graphical user interface) that can present and access multiple content items (eg, virtual content items). In various embodiments, a user may use a computing device operated by the user to access multiple virtual content items provided via the content module 106 of FIG. The computing device can be any device capable of processing and presenting content including, for example, cell phones, tablets, virtual reality systems, and/or head mounted displays. Once accessed, the interface module 202 can present the virtual content item via the display screen of the computing device.

When the virtual content item is first accessed, the viewport associated with the computing device displays a particular portion of the scene of the virtual content item. The portion displayed can be based on the position and/or orientation (eg, pitch, yaw, roll) of the viewport relative to the scene. In some embodiments, the displayed portion corresponds to the location and/or orientation (eg, pitch, yaw, roll) specified by the developer of the virtual content item. In some embodiments, a user can view different portions of a scene by virtually navigating one or more scenes captured by the virtual content item. For example, if a user is using a mobile device to access a virtual content item, for example, based on multiple touch screen gestures and/or the mobile device has been physically moved in a desired location and/or direction. Based on the presence, one or more scenes can be navigated in the virtual content item by changing the position and/or orientation of the viewport.

Changes in viewport position and/or orientation may be determined in real time by a view direction module 204 when a user interacts with a virtual content item. In another example, the user can change the zoom level of the viewport while accessing any scene. For example, the user may want to increase or decrease the zoom level of the viewport to see a portion of the scene. Changes to such viewport zoom levels can be determined in real time by view zoom level module 206. For example, by performing a touch gesture (swipe gesture, drag gesture, slide gesture, tap gesture, double tap gesture, pinch gesture, spread gesture, rotate gesture, flick gesture, etc.), hand gesture and/or computing device gesture, The user can change the viewport (eg, position, orientation, zoom, etc.). Computer device gestures (eg, tilt) are determined, for example, using one or more sensors (eg, gyroscopes, accelerometers, and/or inertial measurement units) within the computing device. Further, when accessing virtual content items via the virtual reality head mounted display, the user can change the orientation of the viewport by changing the orientation of the user's head. Of course, other techniques may be used to navigate and zoom within the spherical image. Typically, changes or adjustments to the viewport may be monitored in real time (eg, at regular time intervals) by the view direction module 204 and view zoom level module 206. Such changes are used to update the viewport so that the appropriate images and/or streams from the virtual content item can be presented to the user, as determined based on the changes to the viewport. ..

As mentioned above, in some cases, if the user is not aware of changes to the viewport, the user will lose direction with respect to the virtual content being accessed, and loss of such directionality will result in a loss of user experience. May decrease. Thus, in various embodiments, the indicator module 208 may be configured to provide navigation indicators within the viewport where virtual content is presented. In some embodiments, the navigation indicator is provided as an overlay in the viewport. The navigation indicator may visually indicate i) the orientation or direction of the viewport in the scene(s) imaged by the virtual content, and/or ii) the zoom level of the viewport in the scene(s). it can. In some embodiments, the direction indicated by the navigation indicator may be determined based on yaw (ie, viewport movement along the vertical axis). However, depending on the implementation, the navigation indicators may also indicate pitch (ie, viewport movement along the horizontal axis) and/or roll (ie, viewport movement along the vertical axis). The navigation indicator may be automatically updated to reflect the orientation and/or zoom level of the viewport at any time while the user interacts with the virtual content and the virtual content item is being accessed.

In some embodiments, the point of interest module 210 is used to identify various points of interest in the multiple scenes of the virtual content item being accessed. In some embodiments, the point of interest may be defined as a spatial region in one or more scenes at the moment or time corresponding to the video stream being presented via the viewport. In some embodiments, such points of interest may be specified by the developer of the virtual content item, for example. Typically, each point of interest is associated with any location (eg, coordinates) in the scene or scenes captured by the virtual content item. In some embodiments, the navigation indicator can identify multiple points of interest within a threshold distance of the viewport's position in the scene being presented via the viewport. In various embodiments, the navigation indicator can visually indicate the corresponding position or orientation of the point of interest. However, depending on the implementation, other approaches for visually indicating multiple points of interest may be used separately from or in addition to the navigation indicator. For example, in some embodiments, the point of interest is visually indicated using a directional indicator (eg, arrow) that points to the position or direction of the point of interest. In this example, when the point of interest is located to the right of the viewport, an arrow pointing to the right is displayed in the area with the viewport. Similarly, if the point of interest is located behind the direction in which the viewport is facing, an arrow may be displayed instructing the user to turn around. In some embodiments, the points of interest may be labeled with text. For example, points of interest such as landmarks are labeled with descriptive text that includes the name of the point of interest, its location, and/or facts about the point of interest.

In some embodiments, the points of interest of the multiple scenes captured by the virtual content item are defined or labeled by the user while viewing the scene. In one example, a user viewing a scene can tag certain features in the scene as points of interest. The user may also provide a text label or comment to associate with the point of interest. In some embodiments, the user may be able to see the points of interest tagged by the user, along with any text labels or comments provided by the user, so that other users who later access the virtual content item can see it. Multiple points of interest in the definition are saved. Thus, in such an embodiment, while the user is accessing the virtual content item using any of the plurality of approaches described above, including, for example, a navigation indicator, a plurality of user-defined points of interest are visually visible. Identified by. In some embodiments, the user-defined points of interest are not incorporated into the virtual content item. Rather, a copy of the virtual content item that incorporates multiple user-defined points of interest is saved. The user can then share the modified copy of the virtual content item with other users, eg, via a social networking system. In some embodiments, the user-defined multiple points of interest include screenshots and/or information (eg, one or more frames, multiple time stamps, etc.) showing where each point of interest is found in the virtual content item. Multiple time ranges, position data such as coordinates, etc.) are shared.

In some embodiments, a user may record a viewport trajectory while viewing multiple scenes captured by a virtual content item. Thus, in such an embodiment, changes in the position and/or orientation of the viewport created by the user while looking at the scene within the virtual content item may be saved as a trajectory of the user viewport of the virtual content item. Users can share viewport trajectories with other users, for example, via a social networking system. Viewports of different users who access the shared viewport trajectory may include multiple scenes captured by the virtual content item based on changes to the viewport position and/or orientation by the user who shared the viewport trajectory. Will be guided over.

In some embodiments, the multiple points of interest of the virtual content item are automatically determined based on the user viewport data. For example, the trajectory of each of the plurality of user viewports while viewing the virtual content item can be analyzed to determine which scene or region of the scene was viewed by the user. In some embodiments, one or more heat maps are aggregated by aggregating the position and/or orientation of each of the user viewports while viewing the scenes of the virtual content item. Generated for virtual content items. In such an embodiment, heatmaps are used to determine which of the scenes or regions in multiple scenes are more popular or more interesting in aggregation than others. Such heat map information is used to automatically identify multiple specific scenes or regions in multiple scenes as multiple points of interest. In some embodiments, multiple heatmaps are generated for a virtual content item by aggregating viewport trajectories of different sets of users. In such embodiments, the users may be demographics (eg, gender, age range, etc.), interests (eg, birdwatching, snowboarding, etc.), and/or, to name a few. They are classified into different sets based on attributes such as multiple relationships (eg, multiple social connections in a social networking system, or “friends”). By generating separate heatmaps for different sets of users, the point of interest module 210 allows the point of interest of the virtual content item to be most likely to fall into multiple user categories or sets depending on their shared attributes. It can be determined whether it is relevant. In some embodiments, a plurality of automatically generated points of interest for the virtual content item are provided to the developer of the virtual content item as suggestions. The developer may choose to incorporate or qualify the generated attention points into the virtual content item. Once certified, the generated points of interest are visually indicated while the user is accessing the virtual content item using any of the approaches described above, including, for example, navigation indicators.

In some examples, a developer may predefine a viewport trajectory for a user to view a virtual content item as part of an automatic mode. In such a case, the automatic mode module 212 allows the user to use or not use the automatic mode at any time while accessing the virtual content item. In some embodiments, automatic mode may be enabled by default when a virtual content item is accessed. In such an embodiment, while in the automatic mode, the viewport is automatically navigated across one or more scenes of virtual content items based on a predefined viewport trajectory. In some embodiments, the viewport trajectory defines a corresponding position and/or orientation of the viewport during playback of one or more portions of the virtual content item or during playback of the entire virtual content item.

In some embodiments, the developer may specify one or more points of interest in one or more scenes, and when the automatic mode is used, the viewport automatically selects points of interest. Be guided. In such an embodiment, trajectories are automatically generated such that the viewport moves between a plurality of points of interest. In some embodiments, the plurality of points of interest is temporal information indicating the amount of time the viewport should focus on the plurality of points of interest (eg, 3 seconds at the first point of interest, a second point of interest). Points for 5 seconds, etc.). In such an embodiment, the automatic mode module 212 can properly navigate the viewport with respect to such temporal information. In some embodiments, the first color scheme is used for the navigation indicator when the automatic mode is used, and the automatic mode is not used, that is, when the manual mode is in effect. Two color schemes are used for the navigation indicators (eg the color scheme opposite to the first color scheme).

The motion transition module 214 is configured to control the viewport movement while the automatic mode is used. For example, in some embodiments, the viewport is automatically transitioned to display multiple scenes and/or multiple points of interest to appear in automatic mode. When transitioning between multiple scenes and/or multiple points of interest, the motion transition module 214 may apply one or more different film transitioning techniques. In one example, the transition may be performed using a dissolve effect in which there is a gradual transition between scenes and/or points of interest. In another example, the transition is performed using a cut effect. Other examples include wipe transition effects, linear transitions, easing, and hinting (eg, using a directional indicator before performing the transition). In some embodiments, the viewport does not transition automatically in automatic mode. Instead, the point of interest is visually displayed in the viewport using a directional indicator (eg, an arrow) that indicates the position or direction of the point of interest. In such an embodiment, the user has the option of manually manipulating the viewport to correspond to the point of interest. In some embodiments, motion transition module 214 may apply different video transition techniques depending on the type of device used (eg, mobile computing device, virtual reality system, head mounted display, etc.). .. For example, multiple viewport transitions are automatic in mobile computing devices, but not in virtual reality systems and/or head mounted displays. The type of device affects which transition effect is used and how the viewport transitions between scenes and/or points of interest. For example, if the device is a virtual reality head-mounted display, directional indicators and/or dissolve effects can be used to perform viewport transitions. In another example, if the device is a mobile computing device, multiple transition effects are disabled when performing a viewport transition.

FIG. 3 illustrates an example of the content director module 302 according to one embodiment of the present disclosure. In some embodiments, the content director module 108 of FIG. 1 is embodied in the content director module 302. As shown in the example of FIG. 3, the content director module 302 includes an interface module 304, a point of interest module 306, and an automatic mode module 308.

The interface module 304 can provide an interface that includes various options that a developer can use to customize the user experience of a virtual content item. Further details regarding this interface are provided below with reference to FIG. In some embodiments, a point of interest module 306 is used to specify one or more points of interest in the virtual content item. A user viewing a virtual content item is informed of such points of interest using any of the above approaches, including, for example, navigation indicators. In one example, the point of interest is defined by the position (eg, coordinates) and/or time (seconds) that the point of interest appears during playback of the virtual content item. The automatic mode module 308 is utilized to generate one or more viewport trajectories. In some embodiments, the viewport trajectory defines a corresponding position and/or orientation of the viewport during playback of one or more portions of the virtual content item or during playback of the entire virtual content item. For example, the automatic mode module 308 can generate a viewport trajectory for navigating multiple scenes of the virtual content item based on the points of interest specified using the points of interest module 306. In some embodiments, the automatic mode module 308 is based on the specified position and/or orientation of the viewport during playback of one or more portions of the virtual content item or during playback of the entire virtual content item. , Used to generate viewport trajectories for navigating multiple scenes in a virtual content item. For example, the developer may specify the position and/or orientation of the viewport at any time during playback of the virtual content item.

FIG. 4A illustrates an example viewport interface 404 400 in which a navigation indicator 406 is provided while a content item (eg, virtual content item) is being accessed in accordance with an embodiment of the present disclosure. In this example, viewport 404 is presented on the display screen of computing device 402. Further, the viewport 404 may be provided via a software application (eg, web browser, social networking application, etc.) running on the computing device 402. The location and/or size of the navigation indicator 406 shown on the display screen may vary depending on the implementation. In the example of FIG. 4A, viewport 404 is presenting a scene from a virtual content item. In this example, the scene includes two birds 414 and a hang glider 416, among other points of interest. Viewport 404 includes a navigation indicator 406 that includes an orientation indicator 408 to identify the orientation and zoom level of the viewport. The navigation indicator 406 also indicates that the point of interest 410 has been identified and is located east of the viewport direction identified by the orientation indicator 408. A user operating the computing device 402 navigates the scene, for example, by changing the viewport orientation and/or zoom level. For example, the user can change the direction of the viewport to face the direction 410 corresponding to the point of interest. As a result, the viewport may be updated to present content (eg, images and/or video streams) corresponding to direction 410, as shown in the example of FIG. 4B. In some embodiments, navigation indicators 406 may also identify multiple points of interest as well as other types of events that occur within the scene being accessed. For example, the navigation indicator 406 can indicate the direction of the sound generated in the scene.

In some embodiments, the navigation indicator 406 is initially shown as if it is translucent or faded. In such an embodiment, the navigation indicator 406 becomes opaque upon detecting user interaction, for example using the viewport 404 and/or computing device 402. The navigation indicator 406 may be opaque when the user performs a touch gesture on the area of the display screen corresponding to the navigation indicator 406. For example, the navigation indicator 406 can detect user interaction based on sensors in the computing device. In some embodiments, the navigation indicator 406 can return to a semi-transparent state or a blurred color state if no user interaction is detected for a threshold period. In some embodiments, automatic mode may be enabled by default when a virtual content item is accessed. In such an embodiment, in automatic mode, the viewport may be automatically navigated through the scene(s) within the virtual content item. For example, the developer of a virtual content item can specify one or more points of interest in the scene(s), and the viewport is automatically navigated to display the points of interest. obtain. In some embodiments, corresponding trajectories, such as viewport movements between points of interest, may be automatically generated. In some embodiments, the point of interest may be defined as the spatial region within the scene(s) at a time or time corresponding to the video stream being presented via the viewport. In some embodiments, the plurality of points of interest is temporal information that indicates the length of time the viewport should focus on the point of interest (eg, 3 seconds at the first point of interest, 3 seconds at the second point of interest). 5 seconds, etc.).

As mentioned above, in some cases, the developer may define an automatic mode for the user viewing the virtual content item. In such cases, the user may or may not use the automatic mode at any time while accessing the virtual content item. In the example of FIG. 4A, automatic mode is enabled so that viewport 404 is automatically navigated across one or more scenes in a virtual content item based on a predefined viewport trajectory. There is. In some embodiments, automatic mode may be enabled by default when a virtual content item is accessed. A user operating the computing device 402, for example, by manually navigating the viewport 404 or selecting an area within the display screen corresponding to the navigation indicator 406 (eg, performing a tap gesture). Can disable the automatic mode. In some embodiments, the automatic mode is re-enabled if the user does not manually navigate the viewport for a threshold time. In some embodiments, the developer can specify one or more points of interest in one or more scenes, and when the automatic mode is used, the viewport 404 will automatically guide the points of interest. To be done. In the example of FIG. 4A, the viewport 404 is automatically navigated towards the point of interest 410, as shown in the example of FIG. 4B.

FIG. 4B illustrates an example viewport interface 404 in which a navigation indicator 406 is provided while a content item (eg, virtual content item) is being accessed in accordance with an embodiment of the present disclosure. As mentioned above, the viewport 404 is automatically guided to the point of interest while the automatic mode is used. In this example, the orientation of the viewport 404 presented on the display screen of the computing device 402 is modified to point in the direction corresponding to the point of interest 418 shown in the navigation indicator 406 of FIG. 4A as point of interest 410. ing. Thus, in this example, both the intended azimuth 407 and the azimuth indicator 408 that follow the predefined trajectory during automatic mode correspond to the direction in which the point of interest 418 is visible. As a result, the scene presented in viewport 404 has been updated to present content (eg, images and/or video streams) corresponding to the viewport adjustment. In this example, the scene shows a hang glider 416 and a hot air balloon 418 identified by navigation indicator 406 as points of interest 410, among other points of interest. In FIG. 4B, the orientation indicator 408 has been rotated to the right about the point 412 to accommodate changes in the viewport orientation. In some embodiments, a user operating the computing device 402 performs a touch gesture in an area of the display screen corresponding to the navigation indicator 406 to bring the viewport to an initial, defined view of the virtual content item. Alternatively, it can be returned to the intended direction, eg automatic mode. Also, in such an embodiment, the zoom level of the viewport is reset to the default or intended zoom level defined for the virtual content item upon detection of the touch gesture. Orientation indicator 408 can rotate about point 412 in a clockwise or counterclockwise direction, depending on, for example, the direction in which the user navigates the viewport. For example, when the viewport direction is changed from 0 degrees to 180 degrees, the azimuth indicator 408 rotates clockwise around the point 412, and when the viewport direction changes from 180 degrees to 360 degrees, the azimuth indicator 408 changes to a point. It rotates counterclockwise around 412. In the example of FIG. 4B, automatic mode is still in effect, so that viewport 404 is automatically navigated across one or more scenes of virtual content items based on a predefined viewport trajectory. It In this example, the viewport 404 is automatically navigated towards the point of interest 420 shown on the navigation indicator 406.

FIG. 4C illustrates an example viewport interface 404 in which a navigation indicator 406 is provided while a content item (eg, virtual content item) is being accessed, according to one embodiment of the disclosure. As mentioned above, the viewport 404 is automatically guided to the point of interest while the automatic mode is used. In this example, the orientation of the viewport 404 presented on the display screen of the computing device 402 has been changed to face the pair of birds 414 shown in the scene of FIG. 4A. Thus, in this example, the intended heading 407 and heading indicator 408, which follows a predefined trajectory when in automatic mode, corresponds to the direction in which the point of interest 414 is visible. In the example of FIG. 4C, a user operating computing device 402 has the option to manually navigate viewport 404. When navigated manually, the automatic mode is disabled and the viewport 404 is not automatically guided based on the predefined trajectory. The user has the option to re-enable the automatic mode, for example by selecting the area in the display screen corresponding to the navigation indicator 406.

FIG. 5 illustrates an example developer interface 502 for customizing a virtual content item user experience 500 according to an embodiment of the disclosure. The exemplary interface 502 includes a region 504 in which a virtual content item can be played. Any customizations or changes to the virtual content item are reflected during playback of the virtual content item in area 504. A navigator indicator 506 is included in area 504 to allow a developer to visualize the position and/or orientation of the viewport. In some embodiments, the developer can define the initial camera orientation 508 of the viewport used when the virtual content item begins playing. The initial camera direction 508 may be defined, for example, by specifying pitch, yaw, and/or degree-of-view corresponding degree values.

In some embodiments, a developer can enable multiple users viewing a virtual content item to enable an automatic mode that automatically navigates a viewport across one or more scenes in the virtual content item. Mode 510 or "director's cut" can be enabled. In some embodiments, when the automatic mode is used, the user's viewport can automatically transition to multiple points of interest in the virtual content item. Corresponding trajectories of viewports between multiple points of interest may be automatically generated. The developer can use the option 512 to add points of interest while looking at the virtual content item in the region 504. For example, while the virtual content item is playing in area 504, the developer may select option 512 to select and tag points of interest. The tagged points of interest may correspond to features in the scene, regions in the scene, or sets of frames, to name a few. The attention point indicator 514 can count the number of attention points that have been tagged by the developer so far. The developer can, for example, select option 516 to publish the virtual content item to the social networking system. The published virtual content item may include information describing the various specified points of interest along with the specified viewport trajectory. This information is used when the user is accessing the virtual content item so that the points of interest are properly displayed. In some embodiments, a developer automatically navigates a user's viewport across multiple scenes and/or multiple points of a virtual content item as specified by the developer in a “director's cut” video ( For example, a fully automated version of an auto-generated fallback user interface) can be created. Depending on the instantiation, the automatically generated "Director's Cut" video is playing, so the user accessing the video changes the viewport orientation or the viewport zoom level. It is not possible. In some embodiments, different formats of the automatically generated "Director's Cut" video are generated. For example, an automated version of a "Director's Cut" video could be spherical video, regular rectilinear video, two-dimensional (2D) video, or 3 to name a few. Formatted as dimensional (3D) video. In such an embodiment, various attributes are used to determine which format should be provided to the user's computing device for playback. For example, the provided format may be determined based in part on characteristics of the computing device (eg, a format playable on the computing device), user preferences, or both. In some embodiments, some formats of the automatically generated "Director's Cut" video act as a fallback option if the user's computing device cannot play the default or preferred format of the video. can do. For example, the developer may specify that the spherical video version of the "Director's Cut" video is provided to the user by default. If the user's computing device is not able to play the spherical video version of the video, a different version (eg, a two-dimensional version of the video) may be provided instead of the designated video version.

FIG. 6A shows an example 600 of a navigation indicator 602 presented in a viewport interface when a content item (eg, virtual content item) is being accessed. In FIG. 6A, navigation indicator 602 indicates the initial or intended orientation 604 of the viewport while the virtual content item is being accessed. The direction 604 may be specified, for example, by the developer of the virtual content item and may change at different points during playback of the virtual content item. The navigation indicator 602 also includes an orientation indicator 606 that indicates the orientation or orientation of the viewport while accessing one or more scenes captured by the virtual content. In this example, the viewport orientation is indicated by the orientation of the orientation indicator 606. As the viewport orientation changes, the orientation indicator 606 can rotate about the point 608 to point in a direction corresponding to the updated viewport orientation. In some embodiments, the direction indicated by the orientation indicator 606 corresponds to the viewport movement along the vertical axis (ie, yaw). Orientation indicator 606 may also indicate the zoom level of the viewport in the scene or scenes being accessed. In some embodiments, the length or size of the orientation indicator 606 increases or extends around the point 608 to indicate a higher zoom level in the viewport. In such an embodiment, the length or size of the azimuth indicator 606 will shrink or shrink around the point 608 to indicate the reduced zoom level of the viewport. In some embodiments, the virtual content item may be associated with a default zoom level (eg, 60 degrees or other specific zoom level). In some embodiments, the virtual content item developer can specify a minimum and/or maximum zoom level that can be applied through the viewport.

FIG. 6B shows an example 620 of a navigation indicator 622 presented in the viewport interface when a content item (eg, virtual content item) is being accessed. In FIG. 6B, the viewport accessing the virtual content item is zoomed in on the scene. As a result, orientation indicator 626 is shown stretched or enlarged in size around point 628 to indicate the increased zoom level of the viewport.

FIG. 6C illustrates an example navigation indicator 630 that may be presented to the viewport interface when a content item (eg, virtual content item) is being accessed. In FIG. 6C, the orientation of the viewport accessing the virtual content item is west or left with respect to the viewport's initial or intended orientation 634. In addition, the viewport is zoomed out of the scene being viewed. As a result, the orientation indicator 636 is shown rotated to the left about the point 638 to indicate the direction of the viewport. Further, the orientation indicator 636 is shown contracted or reduced in size about the point 638 to indicate the reduced zoom level of the viewport.

FIG. 6D illustrates an example 640 of navigation indicators 642 presented in the viewport interface when a content item (eg, virtual content item) is being accessed. In FIG. 6D, the viewport accessing the virtual content item is zoomed in on the scene of the virtual content item. Furthermore, the orientation of the viewport to access the virtual content item is west or left with respect to the viewport's initial or intended orientation 644. As a result, the orientation indicator 646 is shown stretched or increased in size about the point 648 to indicate the increased zoom level of the viewport. Further, the orientation indicator 646 is shown as rotated to the left about the point 648 to indicate the direction of the viewport.

FIG. 6E illustrates an example navigation indicator 650 that may be presented to the viewport interface when a content item (eg, virtual content item) is being accessed. In FIG. 6E, the viewport's initial or intended orientation 654 has been updated. Changes to the intended direction 654 may occur at different times during playback of the virtual content item, eg, when the viewport accesses a guided scene (eg, a view from a moving vehicle). .. In this example, the viewport accessing the virtual content item is facing away from the viewport's intended orientation 654. As a result, the orientation indicator 656 is shown rotating around point 658 in the opposite direction to the intended direction 654.

FIG. 6F illustrates an example 660 of navigation indicators 662 presented in the viewport interface when a content item (eg, virtual content item) is being accessed. In FIG. 6F, the viewport accessing the virtual content item is zoomed in on the scene of the virtual content item. Further, the viewport orientation for accessing the virtual content item is either westward or leftward with respect to the viewport's initial or intended orientation 664. As a result, the orientation indicator 666 is shown stretched or increased in size around the point 668 to indicate the enlarged zoom level of the viewport. Further, the orientation indicator 666 is shown as rotated to the left about the point 668 to indicate the orientation of the viewport. In some embodiments, the navigation indicators 662 can identify various points of interest in the scene of the virtual content item being accessed. In such an embodiment, the navigation indicator 662 may visually indicate the corresponding direction 670 of the point of interest to the direction 664 and/or the orientation indicator 666, for example. Such a plurality of points of interest may be designated by the developer of the virtual content item, for example. In general, each point of interest can be associated with any location in the scene or scenes captured by the virtual content item for a time point corresponding to the scene (eg, stream or feed) being accessed. In some embodiments, the navigation indicator 662 can identify multiple points of interest within a threshold distance of viewport position in the scene presented through the viewport.

FIG. 7 illustrates an exemplary method 700 for navigating a viewport interface according to one embodiment of this disclosure. Unless stated otherwise, there are additional, fewer, or alternative steps performed in a similar or alternative order or in parallel within the various embodiments described herein. Please understand that you can.

At block 702, at least one request to access the content item is determined. The requested content item is constructed using a set of camera feeds that image one or more scenes from a set of different locations. At block 704, information describing an automatic viewing mode for navigating at least some of the requested content item scenes is obtained. At block 706, a viewport interface is provided on the display screen of the computing device where the playback of the requested content item is presented. At block 708, the viewport interface is automatically navigated over at least some of the scenes during playback of the requested content item based at least in part on the auto-viewing mode.

It is contemplated that there may be many other uses, applications, and/or variations associated with various embodiments of the present disclosure. For example, in some cases, the user may choose whether to utilize the disclosed technology. The disclosed technology can also ensure that various privacy settings and preferences are maintained and personal information is prevented from leaking. In another example, various embodiments of the present disclosure may be learned, improved, and/or improved over time.

Social Networking System-Exemplary Implementation FIG . 8 illustrates a network diagram of an exemplary system 800 that may be utilized in various embodiments for enhanced video coding, according to one embodiment of the disclosure. The system 800 includes one or more user devices 810, one or more external systems 820, a social networking system (social networking service) 830, and a network 850. In one embodiment, the social networking services, providers, and/or systems discussed in connection with the above embodiments may be implemented as social networking system 830. For purposes of illustration, the embodiment of system 800 illustrated by FIG. 8 includes a single external system 820 and a single user device 810. However, in other embodiments, system 800 may include more user devices 810 and/or more external systems 820. In certain embodiments, social networking system 830 is separate from social networking system 830 in that external system 820 may be operated by a different entity, while social networking system 830 is operated by a social network provider. .. However, in various embodiments, the social networking system 830 and the external system 820 work together to provide social networking services to users (or members) of the social networking system 830. In this sense, social networking system 830 provides a platform or backbone that other systems such as external system 820 can use to provide social networking services and functionality to users on the Internet.

User device 810 comprises one or more computing devices (or computing systems) that can receive input from a user and send and receive data over network 850. In one embodiment, the user device 810 is a conventional computer system running, for example, an operating system (OS) compatible with Microsoft Windows®, Apple OS X, and/or a Linux® distribution. Is. In another embodiment, the user device 810 is a smartphone, tablet, personal digital assistant (PDA), mobile phone, laptop computer, wearable device (eg, glasses, watch, bracelet, etc.), camera, device. , Etc. may be a computing device or device having computer functions. User device 810 is configured to communicate over network 850. User device 810 can execute an application, eg, a browser application that allows a user of user device 810 to interact with social networking system 830. In another embodiment, the user device 810 interacts with the social networking system 830 through an application programming interface (API) provided by the native operating system of the user device 810, such as iOS and ANDROID®. User device 810 is configured to communicate with external system 820 and social networking system 830 through network 850. The network 850 may comprise any combination of local area networks and/or wide area networks using wired and/or wireless communication systems.

In one embodiment, the network 850 uses standard communication technologies and protocols. Accordingly, the network 850 includes Ethernet, 802.11, world wide interoperability for microwave access (WiMAX), 3G, 4G, CDMA, GSM (registered trademark), LTE. , Digital subscriber line (DSL) or the like. Similarly, the networking protocols used on the network 850 include multiprotocol label switching (MPLS), transmission control protocol/Internet protocol (TCP/IP), user datagram protocol (UDP), hypertext transfer protocol. (HTTP), simple mail transfer protocol (SMTP), file transfer protocol (FTP), and the like. Data exchanged over the network 850 may be represented using techniques and/or formats including Hypertext Markup Language (HTML) and Extensible Markup Language (XML). Also, all or some links may be encrypted using conventional encryption techniques such as Secure Socket Layer (SSL), Transport Layer Security (TLS), and Internet Protocol Security (IPsec).

In one embodiment, user device 810 processes content from external system 820 by processing markup language documents 814 received from external system 820 and from social networking system 830 using browser application 812. And/or content from the social networking system 830 may be displayed. Markup language document 814 identifies the content and one or more instructions that describe how to format or display the content. By executing the instructions contained within the markup language document 814, the browser application 812 uses the format or display method described by the markup language document 814 to display the identified content. For example, markup language document 814 includes instructions for generating and displaying a web page having a plurality of frames containing text and/or image data obtained from external system 820 and social networking system 830. In various embodiments, the markup language document 814 comprises a data file containing extended markup language (XML) data, extended hypertext markup language (XHTML) data, or other markup language data. Also, the markup language document 814 is a Javascript Object Notation (JSON) data for facilitating data exchange between the external system 820 and the user device 810, and JSON with padding. (JSONP: JSON with padding) data, and Javascript data may be included. The browser application 812 on the user device 810 may use a Javascript compiler to decrypt the markup language document 814.

The markup language document 814 may also include or link to applications or application frameworks, such as FLASH™ applications or Unity™ applications, the SilverLight™ application framework, and the like.

In one embodiment, user device 810 also includes one or more cookies 816 that include data indicating whether the user of user device 810 logged in to social networking system 830. Cookie 816 may enable customization of data communicated from social networking system 830 to user device 810.

External system 820 includes one or more web servers that include one or more web pages 822a, 822b. One or more web pages 822a, 822b are communicated to user device 810 using network 850. External system 820 is separate from social networking system 830. For example, external system 820 is associated with a first domain, while social networking system 830 is associated with a separate social networking domain. Web pages 822a, 822b included in external system 820 include a markup language document 814 that includes instructions that identify content and specify how to format and display the identified content. It should be appreciated that there may be many variations or other possibilities, as mentioned above.

The social networking system 830 includes one or more users, and one or more computing for a social network that provides users of the social network with the ability to communicate and interact with other users of the social network. Including device. As described in further detail, social networks may be represented by graphs, ie, data structures that include edges and nodes. Other data structures, including but not limited to databases, objects, classes, meta-elements, files, or any other data structure may also be used to represent social networks. The social networking system 830 may be supervised, managed, or controlled by an operator. The operator of the social networking system 830 may be a human, an automated application, or a set of applications for managing content, controlling policies, and collecting usage metrics within the social networking system 830. Any type of operator may be used.

A user may subscribe to the social networking system 830 and then add connections to any number of other users of the social networking system 830 that the user wishes to be connected to. As used herein, the term “friend” extends to any other user of social networking system 830 with which the user has connected, formed an association, or relationship through social networking system 830. For example, in one embodiment, when a user in social networking system 830 is represented as a node in a social graph, the term “friend” is formed between two user nodes and It can refer to an edge that connects directly.

The connections may be explicitly added by the user or may be automatically created by the social networking system 830 based on the user's common characteristics (eg, users who are graduates of the same educational institution). For example, the first user specifically selects a specific other user who wants to be a friend. The connections in social networking system 830 are typically bi-directional, but need not be bi-directional, so the terms "user" and "friends" are framework dependent. Connections between users of social networking system 830 are typically bi-directional ("two-way") or "reciprocal", although connections may be unilateral or "one-way." For example, if Bob and Joe are both users of social networking system 830 and are connected to each other, Bob and Joe are connected to each other. On the other hand, if Bob wants to connect with Joe in order to see the data communicated by Joe to the social networking system 830, but Joe does not want to form a reciprocal connection, he is unilaterally connected. Can be established. The connection between the users can be a direct connection. However, some embodiments of social networking system 830 allow connections to be indirect through one or more levels or degrees of connection.

In addition to establishing and maintaining a connection between users and allowing interaction between users, social networking system 830 is for performing actions on various types of items supported by social networking system 830. Providing capabilities to users. Such items may be groups or networks (ie, social networks of people, entities, and concepts) to which a user of the social networking system 830 may belong, events or calendar inputs that the user may be interested in, used by the user through the social networking system 830. Computer-based applications, transactions that allow a user to buy or sell items through the services provided by the social networking system 830, or through the social networking system 830, as well as the user may execute inside or outside the social networking system 830. It may include interaction with advertising. These are just a few examples of items that a user may act on the social networking system 830, and many other examples are possible. A user may be represented in social networking system 830, or in external system 820 separate from social networking system 830 or in external system 820 coupled to social networking system 830 through network 850. You can interact.

The social networking system 830 can also be linked with various entities. For example, social networking system 830 allows users to interact with each other and with external system 820 or other entities through APIs, web services, or other communication channels. The social networking system 830 creates and maintains a "social graph" that comprises multiple nodes interconnected by multiple edges. Each node in the social graph may represent an entity that can act on and/or be acted on by another node. The social graph may include various types of nodes. Examples of node types include users, non-human entities, content items, web pages, groups, activities, messages, concepts, and any others that may be represented by objects within the social networking system 830. An edge between two nodes in a social graph represents a particular type of connection, or association, between two nodes that may result from node relationships or from actions performed by one of the nodes on the other. You can In some cases, the edges between nodes may be weighted. Edge weights may represent attributes associated with that edge, such as the strength of the connection or association between nodes. Different types of edges may be provided with different weights. For example, an edge created when one user likes another user may be given a weight, and an edge created when a user becomes friends with another user. May be given different weights.

As an example, if the first user identifies the second user as a friend, an edge in the social graph connecting the node representing the first user and the second node representing the second user is generated. It As the various nodes relate or interact with each other, the social networking system 830 modifies the edges connecting the various nodes to reflect the relationships and interactions.

Social networking system 830 also includes user-generated content that enhances user interaction with social networking system 830. User generated content may include anything that a user may add to, upload, send, or “post” to social networking system 830. For example, a user communicates a post from user device 810 to social networking system 830. Posts may include data such as status updates or other textual information, location information, images such as photos, videos, links, music, or other similar data and/or media. Content may also be added to social networking system 830 by a third party. The content “item” is represented as an object in the social networking system 830. In this way, users of the social networking system 830 are encouraged to communicate with each other by posting different types of text and content items through different communication channels. Such communication increases interaction between users and increases the frequency with which users interact with social networking system 830.

The social networking system 830 includes a web server 832, an API request server 834, a user profile store 836, a connection store 838, an action logger 840, an activity log 842, and an authentication server 844. In one embodiment of the invention, social networking system 830 may include additional components, fewer components, or different components for various applications. Other components such as network interfaces, security mechanisms, load balancers, failover servers, management and network operations consoles are not shown so as not to obscure the details of the system.

User profile store 836 includes work history, education, hobbies or preferences, biographical information such as addresses, demographic information, and other types of descriptive information declared by the user or inferred by social networking system 830. , Maintain information about user accounts. This information is stored in the user profile store 836 so that each user is uniquely identified. Social networking system 830 also stores data in connection store 838 that describes one or more connections between different users. Connectivity information may indicate users with similar or common work experience, group membership, hobbies, or educational background. The social networking system 830 also includes user-defined connections between different users that allow the user to identify their relationships with other users. For example, a user-defined connection allows a user to create relationships with other users, such as friends, colleagues, partners, etc., that are parallel to the user's real-life relationships. The user may choose from predefined types of connections, or define their own connection type as needed. Connections with other nodes within social networking system 830, such as non-human entities, buckets, cluster centers, images, interests, pages, external systems, concepts, etc., are also stored within connection store 838.

Social networking system 830 maintains data about objects with which the user may interact. To maintain this data, user profile store 836 and connection store 838 store corresponding type instances of objects maintained by social networking system 830. Each object type has an information field suitable for storing information suitable for the type of object. For example, user profile store 836 includes a data structure having fields suitable for describing a user's account and information related to the user's account. When a new object of a particular type is created, the social networking system 830 initializes a new data structure of the corresponding type, assigns a unique object identifier to the new data structure, and optionally , Start adding data to that object. This occurs, for example, when the user becomes a user of the social networking system 830, which creates a new instance of the user profile in the user profile store 836 and is unique to the user account. Assign an identifier and start populating the fields of the user account with the information provided by the user.

The connection store 838 includes data structures suitable for describing a user's connections to other users, connections to external systems 820, or connections to other entities. The connection store 838 may also associate the connection type with the user's connection. The connection type may be used in conjunction with the user's privacy settings to regulate access to information about the user. In one embodiment of the invention, user profile store 836 and connection store 838 may be implemented as a federated database.

The data stored in the connections store 838, the user profile store 836, and the activity log 842 uses nodes to identify the various objects and edges that connect the nodes to social relationships that identify relationships between different objects. Allows the social networking system 830 to generate the graph. For example, if the first user establishes a connection with the second user within the social networking system 830, the user accounts of the first user and the second user from the user profile store 836 may be in the social graph. It can act as a node. The connection between the first user and the second user stored by the connection store 838 is the edge between the nodes associated with the first user and the second user. Continuing with this example, the second user may then send a message within the social networking system 830 to the first user. The action of sending the message is another edge between the two nodes in the social graph representing the first user and the second user, and the action of sending the message may be stored. Also, the message itself may be identified in and included in the social graph as another node connected to the node representing the first user and the node representing the second user.

In another example, the first user is the second user in an image maintained by the social networking system 830 (or, alternatively, in an image maintained by another system external to the social networking system 830). Can be tagged. The image may itself be represented as a node within the social networking system 830. This tagging action not only creates an edge between each of the users and the image, but may also create an edge between the first user and the second user. Images are also nodes in the social graph. In yet another example, if a user confirms to participate in an event, the user and the event are nodes retrieved from the user profile store 836, and participation in the event is obtained from the activity log 842. It is the edge between the obtained nodes. By generating and maintaining a social graph, social networking system 830 allows data that describes many different types of objects, as well as interactions and connections between those objects, to be a rich source of socially relevant information. I will provide a.

Web server 832 links social networking system 830 through network 850 to one or more user devices 810 and/or one or more external systems 820. The web server 832 serves web pages and other web related content such as Java, Javascript, Flash, XML. Web server 832 may include a mail server, or may include other messaging functionality for receiving and routing messages between social networking system 830 and one or more user devices 810. The message may be an instant message, a queue message (eg email), a text and SMS message, or any other suitable messaging format.

API request server 834 enables one or more external systems 820 and user device 810 to call access information from social networking system 830 by calling one or more API functions. API request server 834 may also allow external system 820 to send information to social networking system 830 by calling an API. The external system 820 sends the API request to the social networking system 830 through the network 850, and the API request server 834 receives the API request in one embodiment. API request server 834 processes the request by invoking the API associated with the API request to generate the appropriate response. API request server 834 communicates the appropriate response to external system 820 over network 850. For example, in response to the API request, the API request server 834 collects data associated with the user, such as connections of users who have logged in to the external system 820, and collects the collected data in the external system 820. Communicate to. In another embodiment, the user device 810 communicates with the social networking system 830 through the API in the same manner as the external system 820.

The action logger 840 can receive communications from the web server 832 regarding user actions within the social networking system 830 and/or outside the social networking system 830. The action logger 840 populates the activity log 842 with information about user actions so that the social networking system 830 discovers various actions performed by the user within the social networking system 830 and outside the social networking system 830. To be able to do. Any action that a particular user takes with respect to another node on social networking system 830 is associated with each user's account through information maintained in activity log 842 or in a similar database or other data repository. Can be done. Examples of actions taken by a user within social networking system 830 that are identified and stored are, for example, adding a connection to another user, sending a message to another user, sending a message from another user. Reading, watching content associated with another user, attending an event posted by another user, posting an image, trying to post an image, or another user Or it may include other actions that interact with another object. When a user takes an action within social networking system 830, the action is recorded in activity log 842. In one embodiment, social networking system 830 maintains activity log 842 as a database of entries. If the action takes place within the social networking system 830, an entry for that action is added to the activity log 842. The activity log 842 may be referred to as an action log.

Also, user actions may be associated with concepts and actions that occur within entities external to social networking system 830, such as external system 820 separate from social networking system 830. For example, action logger 840 may receive data from web server 832 that describes a user's interaction with external system 820. In this example, external system 820 reports user interactions according to structured actions and objects in the social graph.

Other examples of actions that a user interacts with with the external system 820 are social networking system 830 where the user expresses an interest in the external system 820 or another entity, discusses with the external system 820 or a web page 822a within the external system 820. The user posts a comment, the user posts a uniform resource locator (URL) to the social networking system 830 or other identifier associated with the external system 820, the user posts the external system 820 Participating in associated events or any other action by the user associated with the external system 820. Accordingly, activity log 842 may include actions that describe interactions between a user of social networking system 830 and an external system 820 that is separate from social networking system 830.

The authentication server 844 enforces one or more privacy settings for the user of the social networking system 830. User privacy settings determine how certain information associated with the user can be shared. Privacy settings comprise specifications for the particular information associated with a user and specifications for one or more entities with which the information may be shared. Examples of entities with which information may be shared may include other users, applications, external systems 820, or any entity that potentially has access to that information. Information that may be shared by a user includes user account information such as profile pictures, phone numbers associated with the user, user connections, actions taken by the user such as adding connections, changing user profile information, etc. Equipped with.

Privacy setting specifications may be provided at different levels of granularity. For example, privacy settings may identify specific information that should be shared with other users. The privacy settings identify a work phone number or a specific set of related information such as profile picture, home phone number, and personal information including status. Alternatively, privacy settings may be applied to all information associated with the user. The specifications for the set of entities that can access particular information can also be specified at various levels of granularity. The various sets of entities with which information may be shared may include, for example, all friends of the user, all friends of friends, all applications, or all external systems 820. One embodiment allows a specification of a set of entities to include a listing of entities. For example, a user may provide a list of external systems 820 that are allowed access to certain information. Another embodiment allows a specification to have a set of entities with exceptions that are not allowed to access the information. For example, a user may specify a list of external systems 820 that all external systems 820 are allowed to access their work information, but are not allowed to access their work information. Certain embodiments refer to a list of exceptions that are not allowed to access certain information as a "block list." The external system 820 belonging to the block list specified by the user is blocked from accessing the information specified in the privacy settings. Various combinations of the granularity of information specifications and the granularity of specifications of entities with which information is shared are possible. For example, all personal information can be shared with friends, while all work information can be shared with friends of friends.

The authentication server 844 includes logic to determine if certain information associated with the user may be accessed by the user's friends, external systems 820, and/or other applications and entities. External system 820 may require authentication from authentication server 844 to access the user's more personal and sensitive information, such as the user's work phone number. Based on the user's privacy settings, the authentication server 844 may access information associated with the user, including information regarding actions taken by the user, external system 820, application, or another entity. Decide what you are allowed to do.

In some embodiments, social networking system 830 may comprise content presentation module 846. Content presentation module 846 may be implemented as content presentation module 102 of FIG. 1, for example. In some embodiments, user device 810 can include a content presentation module 818 that is configured to perform some or all of the functions executable by content presentation module 102 of FIG. It should be appreciated that there may be many variations or other possibilities, as mentioned above.

Hardware Implementation The processes and features described above may be implemented by a wide variety of machine and computer system architectures, and in a wide variety of networks and computing environments. FIG. 9 illustrates an example computer system 900 that may be used to implement one or more embodiments described herein in accordance with the present invention. Computer system 900 includes a set of instructions for causing computer system 900 to perform the processes and features discussed herein. Computer system 900 can be connected (eg, networked) to other machines. In a networked arrangement, computer system 900 may operate in the context of a server machine or client machine in a client/server network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. In one embodiment of the invention, computer system 900 may be social networking system 830, user device 810, external system 920, or components thereof. In one embodiment of the invention, computer system 900 may be one of many servers that may form all or part of social networking system 830.

Computer system 900 includes a processor 902, a cache 904, and one or more executable modules and drivers stored on a computer-readable medium and directed to the processes and features described herein. including. Computer system 900 also includes a high performance input/output (I/O) bus 906 and a standard I/O bus 908. Host bridge 910 couples processor 902 to high performance I/O bus 906, while I/O bus bridge 912 couples two buses 906 and 908 to each other. System memory 914 and one or more network interfaces 916 are coupled to high performance I/O bus 906. Computer system 900 may further include video memory and a display device coupled to the video memory (not shown). Mass storage 918 and I/O port 920 are coupled to standard I/O bus 908. Computer system 900 may optionally include a keyboard and pointing device, a display device, or other input/output device (not shown) coupled to bus 908. Overall, these elements are described by an x86-compatible processor manufactured by Intel Corporation of Santa Clara, Calif., by Advanced Micro Devices, Inc., Sunny Bell, Calif. It is intended to represent a broad category of computer hardware systems, including but not limited to manufactured x86 compatible processors, and any other suitable processor.

The operating system manages and controls the operation of computer system 900, including inputting data to and outputting data from software applications (not shown). The operating system provides the interface between the software applications running on the system and the hardware components of the system. Any suitable operating system, such as the LINUX operating system, Apple Macintosh operating system, UNIX operating system, Microsoft® available from Apple Computer, Inc. of Cupertino, Calif. Windows operating system, BSD operating system, etc. may be used. Other implementations are possible.

The elements of computer system 900 are described in more detail below. Specifically, network interface 916 provides communication between computer system 900 and any of a wide variety of networks, such as Ethernet (eg, IEEE 802.3) networks, backplanes, and the like. The mass storage 918 provides persistent storage for data and programming instructions for performing the processes and features described above implemented by the respective computing systems identified above, whereas the system Memory 914 (eg, DRAM) provides temporary storage for data and programming instructions when executed by processor 902. I/O port 920 can be one or more serial and/or parallel communication ports that provide communication between additional peripheral devices that can be coupled to computer system 900.

Computer system 900 can include a variety of system architectures, and various components of computer system 900 may be rearranged. For example, the cache 904 may be implemented on-chip with the processor 902. Alternatively, cache 904 and processor 902 may be grouped together as a "processor module," with processor 902 referred to as a "processor core." Moreover, certain embodiments of the invention may not require or include all of the above components. For example, a peripheral device coupled to standard I/O bus 908 may be coupled to high performance I/O bus 906. Also, in some embodiments, there may be only a single bus and the components of computer system 900 may be coupled to that single bus. Further, computer system 900 may include additional components such as additional processors, storage devices, or memory.

In general, the processes and features described herein may be implemented as part of an operating system or a particular application, component, program, object, module, or series of instructions called a "program." For example, one or more programs may be used to carry out the specific processes described herein. A program, when read and executed by one or more processors, typically performs operations on computer system 900 to perform the processes and features described herein. The one or more instructions to cause are included in various memory and storage devices in computer system 900. The processes and features described herein may be implemented in software, firmware, hardware (eg, application specific integrated circuits), or any combination thereof.

In one embodiment, the processes and features described herein are implemented in a distributed computing environment, individually or collectively, as a series of executable modules executed by computer system 900. The aforementioned modules may be implemented in hardware, executable modules stored on a computer-readable medium (or machine-readable medium), or a combination of both. For example, a module may comprise multiple instructions or series of instructions to be executed by a processor in a hardware system, such as processor 902. First, the series of instructions may be stored on a storage device such as mass storage 918. However, the series of instructions may be stored on any suitable computer-readable storage medium. Furthermore, the series of instructions need not be stored locally, but may be received through a network interface 916 from a remote storage device such as a server on a network. Instructions are copied from a storage device, such as mass storage 918, into system memory 914 and then accessed and executed by processor 902. In various embodiments, one or more modules may be executed by one or more processors at one or more locations, such as servers in a parallel processing environment.

Examples of computer readable media include recordable types of media such as volatile and non-volatile memory devices, solid state memory, floppy disks and other removable disks, hard disk drives, magnetic media. , An optical disc (eg, compact disc read only memory (CD ROMS), digital versatile disc (DVD)), other similar non-transitory (or temporary), tangible (or intangible) storage medium, or , Suitable for storing, encoding, or carrying a set of instructions for execution by computer system 900 to perform any one or more of the processes and features described herein. It includes, but is not limited to, any type of medium.

For purposes of explanation, many specific details are set forth in order to provide a thorough understanding of the present description. However, it will be apparent to one skilled in the art that embodiments of the present disclosure may be practiced without these specific details. In some examples, modules, structures, processes, features, and devices are shown in block diagram form in order to avoid obscuring the present description. In another example, functional block diagrams and flow diagrams are presented to represent data and logical flows. The components of the block and flow diagrams (eg, modules, blocks, structures, devices, features, etc.) may be combined and separated in various ways other than as explicitly described and illustrated herein. , Removed, reordered, and replaced.

References herein to "one embodiment," "one embodiment," "other embodiment," "series of embodiments," "some embodiments," "various embodiments," etc. Means that a particular feature, design, structure, or characteristic described in connection with an embodiment is included in at least one embodiment of the present disclosure. The appearances of the phrases "in one embodiment" or "another embodiment" in various parts of this specification are not necessarily all referring to the same embodiment, but separate or alternative embodiments. Embodiments are not mutually exclusive with other embodiments. Further, various features are described in the presence or absence of explicit reference to "an embodiment" or the like, and the various features may be combined and included in various manners in some embodiments. However, it may be variously omitted in other embodiments. Similarly, various features are described that may be a preference or requirement for some embodiments, but not for other embodiments.

The language used herein is primarily chosen for readability and educational purposes, and not to delineate or delineate the subject matter of the invention. As such, the scope of the present invention is not intended to be limited by this detailed description, but rather by any claims issued for applications herein. Accordingly, the disclosure of the embodiments of the present invention is intended to be illustrative of, but not limiting of, the scope of the invention, which scope is set forth in the following claims.

Claims (20)

A method performed by a computer,
A computing device determining at least one request to access a content item, the requested content item being a set of cameras that image one or more scenes from a set of different locations. Determining the at least one request configured with a feed;
The computing device obtaining information describing an automatic viewing mode for navigating at least some of the one or more scenes in the requested content item;
The computing device providing a viewport interface on a display screen of the computing device on which a playback of the requested content item is presented.
The viewport interface automatically causes the computing device to perform at least some of the one or more scenes during playback of the requested content item based at least in part on the automatic viewing mode. To be able to navigate ,
A navigation indicator (602) is presented in the viewport interface when a content item is accessed, and the navigation indicator (602) is the initial orientation or intent of the viewport while the content item is being accessed. Direction (604), wherein the direction (604) is specified by the developer of the content item, and the direction (604) changes at different points during the playback of the content item,
The navigation indicator (602) also includes an orientation indicator (606) that indicates the direction or orientation of the viewport while accessing one or more scenes imaged by the content, where the viewport orientation is , Indicated by the direction of said azimuth indicator (606),
As the viewport orientation changes, the orientation indicator (606) rotates about a point (608) to point in a direction corresponding to the updated viewport orientation, as indicated by the orientation indicator (606). The direction that corresponds to the movement of the viewport along the vertical axis,
The orientation indicator (606) also indicates the zoom level of the viewport in the accessed scene or scenes,
The length or size of the orientation indicator (606) increases or extends around the point (608) to indicate a higher zoom level of the viewport, and the length or size of the orientation indicator (606) is , Decreasing or contracting around the point (608) to indicate a reduced zoom level of the viewport,
The method wherein the content item is associated with a default zoom level, and a developer of the content item can specify a minimum and/or maximum zoom level applied through the viewport . Acquiring information describing the automatic viewing mode is
The computing device obtains information describing at least one trajectory for navigating the viewport interface over at least some of the one or more scenes during playback of the requested content item. The method of claim 1, comprising: Obtaining information describing the at least one trajectory is
The computing device determining a category corresponding to a user operating the computing device based at least in part on one or more attributes of the user;
Said computing device obtaining at least one trajectory associated with said category, said trajectory being determined to be of interest to at least some of the users included in said category. The method of claim 2 , comprising obtaining at least one trajectory. Acquiring information describing the automatic viewing mode is
The computing device obtaining information describing at least one point of interest that appears during playback of the requested content item;
Information that describes at least one trajectory for the computing device to navigate the viewport interface over at least some of the one or more scenes during playback of the requested content item; Further comprising:
The method of claim 1, wherein the trajectory includes the at least one point of interest. The method of claim 4, wherein the at least one point of interest is defined by a developer of the requested content item. Obtaining information describing the at least one point of interest is
The computing device determining a category corresponding to a user operating the computing device based at least in part on one or more attributes of the user;
The computing device obtaining at least one point of interest associated with the category,
The method of claim 4, wherein the at least one point of interest has been determined to be of interest to at least some users included in the category. In order for the computing device to manually navigate the viewport interface to a particular point of interest, a user operating the computing device may perform one or more actions during playback of the requested content item. To determine what has been done,
The computing device determining that an operation has been performed to share the particular point of interest,
The method of claim 1, further comprising causing the computing device to share information describing the particular point of interest via a social networking system. One or more users interact with the computing device during playback of the requested content item in order for the computing device to manually navigate the viewport interface to generate a customized trajectory. To determine that the action of
The computing device determining that an operation for sharing the customized trajectory has been performed,
The method of claim 1, further comprising the computing device causing information describing the customized trajectory to be shared via a social networking system. Having the viewport interface automatically navigated is
The computing device determines that the requested content item includes a first point of interest and a second point of interest, the second point of interest being a reproduction of the requested content item. Appearing after the first point of interest in
Causing the computing device to display a directional indicator on the viewport interface before automatically navigating the viewport interface from the first point of interest to the second point of interest; In addition,
The method of claim 1, wherein the direction indicator points in a direction corresponding to the second point of interest. Having the viewport interface automatically navigated is
The computing device determines that the requested content item includes a first point of interest and a second point of interest, the second point of interest being a reproduction of the requested content item. Appearing after the first point of interest in
Further comprising causing the computing device to automatically navigate the viewport interface from the first point of interest to the second point of interest using at least one video transition technique. The method of claim 1. A system,
At least one processor,
A memory for storing a plurality of instructions,
The plurality of instructions, when executed by the at least one processor,
In the system,
Determining at least one request to access a content item, wherein the requested content item is configured with a set of camera feeds that image one or more scenes from a set of different locations. Determining the at least one requirement,
Obtaining information describing an automatic viewing mode for navigating at least some of the one or more scenes in the requested content item;
Providing a viewport interface on a display screen of a computing device on which playback of the requested content item is presented.
Causing the viewport interface to be automatically navigated across at least some of the one or more scenes during playback of the requested content item based at least in part on the automatic viewing mode. Do what you do ,
A navigation indicator (602) is presented to the viewport interface when a content item is accessed, and the navigation indicator (602) is the initial orientation or intent of the viewport while the content item is being accessed. Direction (604), wherein the direction (604) is specified by the developer of the content item, and the direction (604) changes at different points during playback of the content item,
The navigation indicator (602) also includes an orientation indicator (606) that indicates the direction or orientation of the viewport while accessing one or more scenes imaged by the content, the viewport orientation being , Indicated by the direction of the azimuth indicator (606),
As the orientation of the viewport changes, the orientation indicator (606) rotates around a point (608) to point in a direction corresponding to the updated viewport orientation, as indicated by the orientation indicator (606). The direction that corresponds to the movement of the viewport along the vertical axis,
The orientation indicator (606) also indicates the zoom level of the viewport in the accessed scene or scenes,
The length or size of the orientation indicator (606) increases or extends around the point (608) to indicate a higher zoom level of the viewport, and the length or size of the orientation indicator (606) is Reducing or contracting around the point (608) to indicate a reduced zoom level of the viewport,
The system wherein the content item is associated with a default zoom level and a developer of the content item can specify a minimum and/or maximum zoom level applied through the viewport . Acquiring information describing the automatic viewing mode is
Obtaining information describing at least one trajectory for navigating the viewport interface over at least some of the one or more scenes during playback of the requested content item. The system of claim 11, further comprising: Obtaining information describing the at least one trajectory is
Determining a category corresponding to a user operating the computing device based at least in part on one or more attributes of the user;
Obtaining at least one trajectory associated with the category, wherein the trajectory is determined to be of interest to at least some of the users included in the category. 13. The system of claim 12 , further comprising: Acquiring information describing the automatic viewing mode is
Obtaining information describing at least one point of interest that appears during playback of the requested content item,
Obtaining information describing at least one trajectory for navigating the viewport interface over at least some of the one or more scenes during playback of the requested content item. The system of claim 11, further comprising: the trajectory including the at least one point of interest, the obtaining. 15. The system of claim 14, wherein the at least one point of interest is defined by a developer of the requested content item. A non-transitory computer-readable storage medium comprising a plurality of instructions,
The plurality of instructions when executed by at least one processor of a computing system,
In the computing system,
Determining at least one request to access a content item, wherein the requested content item is configured with a set of camera feeds that image one or more scenes from a set of different locations. Determining the at least one requirement,
Obtaining information describing an automatic viewing mode for navigating at least some of the one or more scenes in the requested content item;
Providing a viewport interface on a display screen of a computing device on which playback of the requested content item is presented.
Causing the viewport interface to be automatically navigated across at least some of the one or more scenes during playback of the requested content item based at least in part on the automatic viewing mode. To do the method , including
A navigation indicator (602) is presented in the viewport interface when a content item is accessed, and the navigation indicator (602) is the initial orientation or intent of the viewport while the content item is being accessed. Direction (604), wherein the direction (604) is specified by the developer of the content item, and the direction (604) changes at different points during the playback of the content item,
The navigation indicator (602) also includes an orientation indicator (606) that indicates the direction or orientation of the viewport while accessing one or more scenes imaged by the content, where the viewport orientation is , Indicated by the direction of said azimuth indicator (606),
When the orientation of the viewport changes, the orientation indicator (606) rotates around a point (608) to point in a direction corresponding to the updated viewport orientation, as indicated by the orientation indicator (606). The direction that corresponds to the movement of the viewport along the vertical axis,
The orientation indicator (606) also indicates the zoom level of the viewport in the accessed scene or scenes,
The length or size of the orientation indicator (606) increases or extends around the point (608) to indicate a higher zoom level of the viewport, and the length or size of the orientation indicator (606) is , Decreasing or contracting around the point (608) to indicate a reduced zoom level of the viewport,
The content item is associated with a default zoom level, and the developer of the content item can specify a minimum and/or maximum zoom level applied through the viewport, a non-transitory computer-readable Storage medium. Acquiring information describing the automatic viewing mode is
Obtaining information describing at least one trajectory for navigating the viewport interface over at least some of the one or more scenes during playback of the requested content item. 17. The non-transitory computer readable storage medium of claim 16, further causing the writing system to perform the operation. Obtaining information describing the at least one trajectory is
Determining a category corresponding to a user operating the computing device based at least in part on one or more attributes of the user;
Obtaining at least one trajectory associated with the category, wherein the trajectory is determined to be of interest to at least some of the users included in the category. 18. The non-transitory computer-readable storage medium of claim 17 , further causing the computing system to: Acquiring information describing the automatic viewing mode is
Obtaining information describing at least one point of interest that appears during playback of the requested content item,
Obtaining information describing at least one trajectory for navigating the viewport interface over at least some of the one or more scenes during playback of the requested content item. The non-transitory computer readable storage medium of claim 16, further comprising: the trajectory including the at least one point of interest, the obtaining further. 20. The non-transitory computer-readable storage medium of claim 19, wherein the at least one point of interest is defined by a developer of the requested content item.