WO2020131059A1 - Systèmes et procédés de recommandation d'agencement d'une pluralité de dispositifs formant un affichage unifié - Google Patents

Systèmes et procédés de recommandation d'agencement d'une pluralité de dispositifs formant un affichage unifié Download PDF

Info

Publication number
WO2020131059A1
WO2020131059A1 PCT/US2018/066720 US2018066720W WO2020131059A1 WO 2020131059 A1 WO2020131059 A1 WO 2020131059A1 US 2018066720 W US2018066720 W US 2018066720W WO 2020131059 A1 WO2020131059 A1 WO 2020131059A1
Authority
WO
WIPO (PCT)
Prior art keywords
display area
display
devices
determining
layout
Prior art date
Application number
PCT/US2018/066720
Other languages
English (en)
Inventor
Gabriel C. DALBEC
Jean Michelle SOMLO
Todd M. Kulick
Scott D. Redman
Alan Waterman
Original Assignee
Rovi Guides, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rovi Guides, Inc. filed Critical Rovi Guides, Inc.
Priority to PCT/US2018/066720 priority Critical patent/WO2020131059A1/fr
Publication of WO2020131059A1 publication Critical patent/WO2020131059A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2356/00—Detection of the display position w.r.t. other display screens

Definitions

  • the present disclosure is directed to systems that combine multiple displays to form large visuals (referred to as display combining systems hereinafter).
  • display combining systems that recommend device layouts to form a unified display.
  • a display combining application identifies a media asset that is to be displayed on the plurality of devices.
  • the media asset includes various display areas that, when combined, form the visual frame of the media asset.
  • the display combining application identifies content within each display area of the media asset and uses the identified content to determine and select a subset of display areas which must be displayed (e g., as the subset may contain important information or contain certain visual attributes).
  • the display combining application determines a layout of the plurality of devices that maximizes the number of devices in the plurality of devices that display the selected display area(s). Specifically, the display combining application determines a layout that displays the selected display area across the plurality of devices without disproportional aspect ratios and/or loss of visual information of the selected display area(s). As such, display real estate is not wasted on display areas that do not need to be displayed and the user can appreciate the media asset in a layout that best accentuates the selected display area (i.e., greater real estate is devoted to the selected display area). The display combining application outputs the layout to the user so that the user may then rearrange the devices.
  • the display combining application may determine a content type of the media asset.
  • the content type may be“side-scroller video game.”
  • the display combining application queries a database that specifies an appropriate aspect ratio for each content type in order to adjust the current aspect ratio of the media asset to the appropriate aspect ratio.
  • the adjustment of the aspect ratio may uncover additional display areas that the display combining application can identify content within.
  • the display combining application determines, for a plurality of frames in the media asset, the amount of visual changes within the display area. In particular, for each respective frame, the display combining application determines an amount of difference between pixels within the display area of the respective frame and pixels within the display area of a consecutive frame. From this, the display combining application determines the display area(s) of the media asset that are busy (e.g., possess changing images, movement and interesting content). Display areas that do not have much change over several frames (e.g., they remain the same color) may not be important.
  • the display combining application determines the total difference in a display area across multiple frames and compares the difference to a minimum change value. If the total difference is greater than the minimum change value, the display area can be deemed to include important content and the display combining application may select the display area.
  • the display combining application determines, in some embodiments, whether there is an object of interest in the display area when selecting the display area.
  • a user profile may indicate objects of interest such as people, places, items, etc.
  • the display combining application scans the frames of the media to identify display areas featuring the objects of interest. In response to determining that the obj ect of interest appears within a display area in at least one frame of the plurality of frames, the display combining application selects the display area.
  • the display combining application when determining the layout of the plurality of devices forming the unified display, the display combining application, in some embodiments, will determine a display area size of the selected display area and respective display dimensions of each device in the plurality of devices. Based on these determined values, the display combining application determines a combination of display dimensions within which the selected display area can fit. In particular, the display combining application determines a combination of the display dimensions that displays the selected display area while ensuring that the selected display area covers all displays of the plurality of devices. The display combining application adjusts an aspect ratio of the selected display area to equal an aspect ratio of the combination. From here, the display combining application determines relative positions of each device in the plurality of devices to provide the layout information to the user (i.e., information on where to place the devices relative to one another).
  • the display combining application may select multiple display areas. For example, the display combining application may select a display area on one side of the media asset and a second display area on the opposite side and these two display areas may not be connected.
  • the display combining application identifies a larger display area that contains both the first display area and the second display area.
  • the display combining application determines a layout within which the larger display area can be displayed across all of the displays in the plurality of devices.
  • the display combining application divides the selected display area based on respective display dimensions of each device.
  • the display combining application assigns and generates the respective divided portion of the selected display area on each device of the plurality of devices.
  • the devices may still be physically unarranged.
  • the user has to arrange the devices based on the layout.
  • the display combining application generates, on each respective device, a visual indicator for alignment with another device in the plurality of devices.
  • FIG. 1 shows an illustrative example of a scenario for determining a layout of a plurality of devices forming a unified display, in accordance with some embodiments of the disclosure
  • FIG. 2 shows an illustrative example of a scenario for determining a layout of a plurality of devices forming a unified display, in accordance with some embodiments of the disclosure
  • FIG. 3 shows an illustrative example of a scenario for arranging a plurality of devices based on visual indicators, in accordance with some embodiments of the disclosure
  • FIG. 4 is a diagram of an illustrative user equipment device in accordance with some embodiments of the disclosure.
  • FIG. 5 is a diagram of an illustrative media system in accordance with some embodiments of the disclosure.
  • FIG. 6 is a flowchart of a detailed illustrative process for determining a layout of a plurality of devices forming a unified display, in accordance with some embodiments of the disclosure;
  • FIG. 7 is a flowchart of an illustrative process for identifying additional display areas based on a content type of the media asset, in accordance with some embodiments of the disclosure;
  • FIG. 8 is a flowchart of an illustrative process for selecting a display area based on the amount of visual changes in the display area, in accordance with some embodiments of the disclosure
  • FIG. 9 is a flowchart of an illustrative process for determining a total difference in pixel changes over a plurality of frames in a display area, in accordance with some embodiments of the disclosure.
  • FIG. 10 is a flowchart of an illustrative process for selecting a display area based on an object of interest in the display area, in accordance with some embodiments of the disclosure
  • FIG. 11 is a flowchart of an illustrative process for determining a combination of displays within which a selected display area fits, in accordance with some embodiments of the disclosure
  • FIG. 12 is a flowchart of an illustrative process for determining a combination of displays within which multiple display areas fit, in accordance with some embodiments of the disclosure
  • FIG. 13 is a flowchart of an illustrative process for determining a relative placement of devices such that the number of devices displaying the selected display area is maximized, in accordance with some embodiments of the disclosure.
  • FIG. 14 is a flowchart of an illustrative process for outputting visual indicators on the respective devices in the plurality of devices, in accordance with some embodiments of the disclosure.
  • FIG. 1 shows an illustrative example of scenario 100 for determining a layout of a plurality of devices forming a unified display, in accordance with some embodiments of the disclosure.
  • Initial arrangement 100 includes four smartphones that a user may be interested in combining to form a unified display.
  • “combining” refers to synchronizing multiple devices, wherein each device displays a portion of a complete image, such that the complete image is visible when the multiple devices are arranged in a specific layout.
  • a unified display refers to a body of multiple synchronized displays that, in combination, form the complete image. It should be noted that the systems and methods described herein are applicable to any type of display device that is capable of receiving and implementing display configuration instructions.
  • initial arrangement 102 may include various types of devices.
  • device 1 of initial arrangement 102 may be a smartphone (e.g., iPhone XTM)
  • device 2 may be a tablet (e.g., Microsoft Surface ProTM)
  • device 3 may be a smart assistant display (e.g., Echo ShowTM)
  • device 4 may be a smart television.
  • scenario 100 presents four identical smartphones (i.e., the hardware attributes and software features of each smartphone are the same).
  • the terms “media asset” and “content” should be understood to mean an electronically consumable user asset, such as television programming, as well as pay-per-view programs, on-demand programs (as in video-on-demand (VOD) systems), Internet content (e.g., streaming content, downloadable content, Webcasts, etc.), video clips, images, websites, electronic books, applications, games, and/or any other media or multimedia and/or combination of the same.
  • VOD video-on-demand
  • video clips e.g., streaming content, downloadable content, Webcasts, etc.
  • images e.g., images, websites, electronic books, applications, games, and/or any other media or multimedia and/or combination of the same.
  • media asset 104 may be the side-scroller video game Super Mario WorldTM.
  • a user may arrange the smartphones in a 2x2 grid.
  • the 2x2 grid may output the video game in the center of the unified display with large parts of the 4 individual screens being unutilized (e.g., large black bands on the top and bottom of the unified display).
  • the display areas on each device may be visually stretched or zoomed into, causing loss of information (e.g., parts of the display areas are clipped off) or disproportionality (e.g., the aspect ratio of the game is changed significantly causing Mario to appear abnormally tall and slim). In either case, the user is left dissatisfied.
  • the game may involve touchscreen input and the visual disproportionality across the different screens may cause the game to be unplayable. The systems and methods described herein thus attempt to provide a layout to the user that emphasizes certain display areas of the content and presents the certain display areas without these issues.
  • a display combining application combines multiple devices to form large images on a unified display. More specifically, a display combining application orchestrates the “combining” by determining how to divide the large image amongst the multiple devices, assigning portions of the large image to the devices, and exchanging information with each device to ensure that the visuals in each display are synchronized (e g., the devices are each showing the same temporal point of a media asset at any given time).
  • the display combining application may be installed on all devices that are to be combined or may be present on an external device that simply communicates with each device. In the case of scenario 100, the display combining application may be on installed on device 1 of initial arrangement 102. Accordingly, device 1 will establish a network that devices 2, 3, and 4 may join. Over the network, the display combining application on device 1 may send display configuration instructions to devices 2, 3, and 4. This will be further explained in the descriptions of FIGS.
  • Any of the device(s) in initial arrangement 102 may have access to or may be the source of media asset 104.
  • the display combining application identifies media asset 104 in order to analyze content and determine how media asset 104 should be displayed.
  • Media asset 104 may have several display areas. The display areas may be specified in the metadata of media asset 104, which the display combining application can also retrieve from the source of media asset 104.
  • a visual frame of the media asset comprises all of the visual information that can be displayed at a given time on a device. In the case of a video, the visual frame refers to the frames of the video. In the case of a video game, the visual frame may refer to a camera angle in the video game, a full render of a game level, or a frame of a game menu.
  • the visual frame consists of display areas that are portions of the visual frame.
  • the display areas can be overlapping or non-overlapping and can vary in shapes and sizes.
  • a display area may be a rectangle that splits the screen in half, or a shape of a person on the screen (e.g., Mario).
  • the display combining application may use an image recognition technique such as segmentation to determine the display areas.
  • An example of a display area in media asset 104 is display area 106 in FIG. 1.
  • Display area 106 is depicted as a rectangular portion that is bounded by a dotted line.
  • Display area 106 includes Mario, Mario’s enemies, obstacles, the landscape, etc.
  • the portions of the visual frame of media asset 104, as depicted, that are not part of display area 106 may be different display areas.
  • the display combining application identifies content within each display area of the visual frame in Super Mario World.
  • the video game in this case is a two-dimensional side- scroller, indicating that a character travels linearly from one side of a level to another.
  • display area 106 may actually span from the starting point of a level (e.g., where Mario spawns) to the endpoint (e.g., where Mario exits).
  • the display combining application may determine that the top display of the video game features background visuals that are not incorporated in the game physics associated with Mario. More specifically, Mario may never enter the top portion of the screen.
  • the display combining application selects display area 106 as its selected display area because the bottom half includes Mario, Mario’ s enemies, in-game obstacles, etc. In this case, the aspect ratio of display area 106 may be heavily skewed towards width (e.g., 10x1).
  • the display combining application determines that the ideal layout for displaying display area 106 and utilizing the full displays of the plurality of devices requires maximizing the width and minimizing the height of the unified display.
  • the display combining application may use an optimization algorithm to determine the layout that maximizes the number of devices in the plurality of devices (e.g., shown in initial arrangement 102) that output display area 106.
  • the optimization algorithm may specifically determine an aspect ratio of the unified display that is closest to the aspect ratio of the selected display area, given the display dimensions of the individual devices in the unified display.
  • the display combining application may determine layout 108, which depicts the four smartphones each connected by its smaller edge to a neighboring
  • the aspect ratio of layout 108 may be 10x1, which matches the aspect ratio of display area 106.
  • unified display 110 portions of media asset 104 are displayed on the devices placed in layout 108.
  • the display combining application assigns each device a portion of the selected display area to output.
  • the display combining application may send a copy of media asset 104 to each device in unified display 110, along with coordinates (e.g., 600 px by 300 px rectangle centered around point (40 px, 40 px)) indicating which portion of the visual frame to generate.
  • the display combining application may exchange timestamp information with each device in unified display 110 in order to synchronize the visuals shown. In the case of a movie for example, the timestamps may indicate playback positions.
  • Each device in the unified display 110 may send a playback position to the display combining application and in response, the display combining application may determine whether the output of a movie on a certain device needs to be delayed.
  • the display combining application will delay the output of device 1 by 10 seconds to synchronize all devices.
  • the timestamp information may indicate when a command was received from the user by each device. For example, a user may move Mario to the right one second after the game is rendered. Because the game is a side scroller, the landscape may shift as Mario moves, unravelling more parts of the level. Accordingly, the display combining application instructs each device to generate for display the movement and its effects in a synchronous manner (i.e., at the same time) in response to receiving the user command.
  • FIG. 2 shows an illustrative example of scenario 200 for determining a layout of a plurality of devices forming a unified display, in accordance with some embodiments of the disclosure.
  • the display combining application may determine layout 108, but a user must physically move the devices from initial arrangement 102 to unified display 110.
  • the display combining application generates visual indicators on each device of the plurality of devices.
  • the visual indicators may be any visual, such as a mark, a shape, text, etc.
  • the visual indicators are used to align two or more displays.
  • display device 202 and display device 204 are to be combined. Each device may be outputting a portion of the unified display.
  • the display combining application generates visual indicators, referred to as merge point indicators 206 in FIG. 2, on each display device.
  • the respective merge point indicators are displayed at positions on the respective displays where the respective displays are to be physically aligned.
  • Unified display 208 is the result when a user successfully aligns merge point indicators 206 of each display device. As shown in FIG. 2, the merge point indicators are of equal size.
  • the user can align merge point indicators 206 by relying on the dimensions of the respective merge point indicators.
  • FIG. 3 shows an illustrative example of scenario 300 for arranging a plurality of devices based on visual indicators, in accordance with some embodiments of the disclosure.
  • Scenario 300 follows the same example as scenario 100 and thus, initial arrangement 302 is the equivalent of initial arrangement 102.
  • the display combining application In response to determining layout 108, the display combining application generates for output the assigned portions of display area 106 over the four smartphone devices in 304. In terms of outputting the layout, the display combining application generates for display on each device of initial arrangement 302, merge point indicators 306.
  • device 1 displays merge point indicator 306 that matches (e.g., same featured pattern, color, size, or any combination thereof) merge point indicator 306 on device 2.
  • Device 1 and device 2 should be physically aligned such that device 1 and device 2 are touching and such that merge point indicators 306 on device 1 and device 2 run in parallel to each other.
  • device 2 has another visual indicator on the right edge of the display. That visual indicator matches the visual indicator generated for display on the left edge of device 3. Accordingly, the user should align device 3 to device 2 based on the matching visual indicators.
  • Display arrangement 308 is the equivalent of unified display 110 (i.e., the result when all devices of initial arrangement 302 are aligned according to the visual indicator placement).
  • the display combining application may continue to generate the visual indicators until a command is received to cease the display of the visual indicators.
  • the display combining application may generate for display the visual indicators for a period of time before ceasing the display of the visual indicators.
  • the display combining application may also receive instructions to regenerate for display the visual indicators after ceasing the display of the visual indicators. In response, the display combining application may generate for display the visual indicators.
  • FIG. 4 shows a generalized embodiment of illustrative media device 400.
  • media device should be understood to mean any device for accessing the content described above, such as a television, a tablet computer, a personal digital assistant (PDA), a portable video player, a portable gaming machine, a smartphone, or any other television equipment, computing equipment, or wireless device, and/or combination of the same that can display content.
  • PDA personal digital assistant
  • media device 400 is a smartphone.
  • media device 400 may be any media device described above.
  • media device 400 of FIG. 4 can be implemented in system 500 of FIG. 5 as media device 502 (e.g., a tablet such as an iPadTM), media device 504 (e.g., a smartphone such as a Samsung GalaxyTM), and media device 506 (e.g., a smart assistant display such as an Echo ShowTM).
  • media device 502 e.g., a tablet such as an iPadTM
  • media device 504 e.g., a smartphone such as a Samsung GalaxyTM
  • media device 506 e.g., a smart assistant display such as an Echo ShowTM.
  • Media device 400 may receive content and data via input/output (hereinafter "I/O") path 402.
  • EO path 402 may provide content (e.g., broadcast programming, on-demand programming, Internet content, content available over a local area network (LAN) or wide area network (WAN), and/or other content) and data to control circuitry 404, which includes processing circuitry 406 and storage 408.
  • Control circuitry 404 may be used to send and receive commands, requests, and other suitable data using EO path 402.
  • EO path 402 may connect control circuitry 404 (and specifically processing circuitry 406) to one or more communications paths (described below). EO functions may be provided by one or more of these communications paths, but are shown as a single path in FIG. 4 to avoid
  • Control circuitry 404 may be based on any suitable processing circuitry such as processing circuitry 406.
  • processing circuitry should be understood to mean circuitry based on one or more microprocessors, microcontrollers, digital signal processors, programmable logic devices, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), etc., and may include a multi-core processor (e.g., dual-core, quad-core, hexa-core, or any suitable number of cores) or supercomputer.
  • processing circuitry may be distributed across multiple separate processors or processing units, for example, multiple of the same type of processing units (e.g., two Intel Core i7 processors) or multiple different processors (e.g., an Intel Core i5 processor and an Intel Core i7 processor).
  • control circuitry 404 executes instructions for a display combining application stored in memory (i.e., storage 408).
  • a display combining application may be a stand-alone application implemented on a media device or a server.
  • the display combining application may be implemented as software or a set of executable instructions.
  • the instructions for performing any of the embodiments discussed herein of the display combining application may be encoded on non- transitory computer readable media (e.g., a hard drive, random-access memory on a DRAM integrated circuit, read-only memory on a BLU-RAY disk, etc.) or transitory computer readable media (e.g., propagating signals carrying data and/or instructions).
  • the instructions may be stored in storage 408, and executed by control circuitry 404 of a media device 400.
  • a display combining application may be a client-server application where only the client application resides on media device 400 (e.g., media device 502, 504, 506), and a server application resides on an external server (e.g., server 512).
  • a display combining application may be implemented partially as a client application on control circuitry 404 of media device 400 and partially on server 512 as a server application running on control circuitry of server 512.
  • Server 512 may be a part of a local area network with media devices 502, 504, DDD06, or may be part of a cloud computing environment accessed via the Internet.
  • Control circuitry 404 may include communications circuitry suitable for
  • Communications circuitry may include a cable modem, an integrated services digital network (ISDN) modem, a digital subscriber line (DSL) modem, a telephone modem, Ethernet card, or a wireless modem for communications with other equipment, or any other suitable communications circuitry. Such communications may involve the Internet or any other suitable communications networks or paths.
  • communications circuitry may include circuitry that enables peer-to-peer communication of media devices, or communication of media devices in locations remote from each other.
  • Memory may be an electronic storage device provided as storage 408 that is part of control circuitry 404.
  • the phrase "electronic storage device” or “storage device” should be understood to mean any device for storing electronic data, computer software, or firmware, such as random-access memory, read-only memory, hard drives, optical drives, solid state devices, quantum storage devices, gaming consoles, or any other suitable fixed or removable storage devices, and/or any combination of the same.
  • Nonvolatile memory may also be used (e g., to launch a boot-up routine and other instructions).
  • Cloud- based storage described in relation to FIG. 5, may be used to supplement storage 408 or instead of storage 408.
  • a user may send instructions to control circuitry 404 using user input interface 410 of media device 400.
  • User input interface 410 may be any suitable user interface touch screen, touchpad, stylus and may be responsive to external device add-ons such as a remote control, mouse, trackball, keypad, keyboard, joystick, voice recognition interface, or other user input interfaces.
  • Display 410 may be a touchscreen or touch-sensitive display. In such circumstances, user input interface 410 may be integrated with or combined with display 412.
  • Display 412 may be one or more of a monitor, a television, a liquid crystal display (LCD) for a mobile device, amorphous silicon display, low temperature poly silicon display, electronic ink display, electrophoretic display, active matrix display, electro-wetting display, electro- fluidic display, cathode ray tube display, light-emitting diode display, electroluminescent display, plasma display panel, high-performance addressing display, thin-film transistor display, organic light-emitting diode display, surface-conduction electron-emitter display (SED), laser television, carbon nanotubes, quantum dot display, interferometric modulator display, or any other suitable equipment for displaying visual images.
  • a video card or graphics card may generate the output to the display 412.
  • the video card may offer various functions such as accelerated rendering of 3D scenes and 2D graphics, MPEG-2/MPEG-4 decoding, TV output, or the ability to connect multiple monitors.
  • the video card may be any processing circuitry described above in relation to control circuitry 404.
  • the video card may be integrated with the control circuitry 404.
  • Speakers 414 may be provided as integrated with other elements of user equipment device 400 or may be stand-alone units.
  • the audio component of videos and other content displayed on display 412 may be played through speakers 414. In some embodiments, the audio may be distributed to a receiver (not shown), which processes and outputs the audio via speakers 414.
  • Control circuitry 404 may allow a user to provide user profile information or may automatically compile user profile information. For example, control circuitry 404 may monitor the content the user accesses and/or other interactions the user may have across various media devices the user accesses. Additionally, control circuitry 404 may obtain all or part of other user profiles that are related to a particular user (e g., via social media networks), and/or obtain information about the user from other sources that control circuitry 404 may access. As a result, a user can be provided with a unified experience across the user's different media devices.
  • media devices 502, 504, and 506 may be coupled to communication network 508.
  • Communication network 508 may be one or more networks including the Internet, a mobile phone network, mobile voice or data network (e.g., a 4G or LTE network), cable network, public switched telephone network, Bluetooth, or other types of communications network or combinations of communications networks.
  • media devices 502, 504 and 506 may communicate with each other over communication network 508 via communications circuitry described above.
  • Media source 510 and server 512 may communicate with media device 502 via communication network 508 as well, or a different network (e g., media devices 502, 504, 506 may be connected via a Bluetooth network and media device 502 may be connected to media source 510 and server 512 via the Internet).
  • media source 510 and server 512 are not shown to be connected to media devices 504 or 506. However, all media devices 502, 504, and 506 may individually connect to media source 510 and server 512.
  • the arrows connecting the respective devices, sources and servers represent communication paths, which may include a satellite path, a fiber-optic path, a cable path, a path that supports Internet communications (e.g., IPTV), free-space connections (e.g., for broadcast or other wireless signals), or any other suitable wired or wireless communications path or combination of such paths.
  • System 500 includes media source 510 coupled to media device 502 via communication network 508. There may be more than one of media source 510, but only one is shown in FIG. 5 to avoid overcomplicating the drawing.
  • Media source 510 may include one or more types of content distribution equipment including a television distribution facility, cable system headend, satellite distribution facility, programming sources (e.g., television broadcasters, etc.), intermediate distribution facilities and/or servers, Internet providers, on-demand media servers, and other content providers.
  • Media source 510 may be the originator of content (e.g., a television broadcaster, a Webcast provider, etc.) or may not be the originator of content (e.g., an on-demand content provider, an Internet provider of content of broadcast programs for downloading, etc ).
  • Media source 510 may include cable sources, satellite providers, on-demand providers, Internet providers, over-the-top content providers, or other providers of content.
  • Media source 510 may also include a remote media server used to store different types of content (including video content selected by a user), in a location remote from any of the media devices.
  • Media source 510 may also provide metadata. Metadata may include program information, display combining application settings, user preferences, user profile information, media-related information (e.g., broadcast times, broadcast channels, titles, descriptions, ratings information (e.g., parental control ratings, critic's ratings, etc.), genre or category information, actor information, logo data for broadcasters' or providers' logos, etc.), media format (e.g., standard definition, high definition, 3D, etc.), and on-demand
  • FIG. 6 is a flowchart of process 600 for determining a layout of a plurality of devices forming a unified display, in accordance with some embodiments of the disclosure.
  • control circuitry 404 identifies a media asset (e.g., media asset 104 of FIG. 1), wherein the media asset comprises a plurality of display areas. It should be noted that control circuitry 404 may refer to control circuitry on server 512, media device 502, 504, 506, or any combination thereof. Control circuitry 404 retrieves the media asset and the metadata associated with media asset from media source 510. Based on the metadata, control circuitry 404 identifies the plurality of display areas. In some embodiments, control circuitry 404 determines the plurality of display areas by using image processing techniques such as segmentation. Additional embodiments of 602 are described in FIG. 7.
  • control circuitry 404 identifies content within each display area.
  • Control circuitry 404 employs various image processing techniques such as edge detection, segmentation, keypoint detection, etc., in order to analyze the content in each display area and use the analysis to select a display area. For example, control circuitry 404 may determine the amount of change in visual attributes across frames (further described in FIG.
  • Control circuitry 404 may also determine whether there is an object of interest in a display area at any frame of the media asset (further described in FIG. 10). This information culminates into a decision of whether to select a display area and accordingly at 606, control circuitry 404 selects a display area (e.g., display area 106 of FIG. 1) of the plurality of display areas based on the identified content of the display area. In some embodiments, control circuitry 404 receives a selection of the display area from a user via input interface 410.
  • control circuitry 404 may detect user contact on input interface 410, wherein the user contact provides an outline (e g., the user makes a rectangle (dotted line of display area 106) on media device 502) to specify which display area to display on the unified display.
  • outline e g., the user makes a rectangle (dotted line of display area 106) on media device 502
  • control circuitry 404 determines a layout of the plurality of devices forming the unified display, wherein the layout maximizes a number of devices in the plurality of devices that display the selected display area. In order to maximize the number of devices that output the selected display area, control circuitry 404 determines a layout for the unified display such that the aspect ratio of the unified display matches the aspect ratio of the selected display area. Control circuitry 404 determines various combinations of the devices in the plurality of devices and employs an optimization algorithm (e.g., gradient descent) to iteratively determine a layout of the devices that brings the aspect ratio of the unified display closer to the aspect ratio of the selected display area. This is further discussed in FIG. 13.
  • an optimization algorithm e.g., gradient descent
  • control circuitry 404 In response to determining that layout with an aspect ratio that is closest to the aspect ratio of the selected display area, at 610, control circuitry 404 outputs the layout. In particular, control circuitry 404 generates, for display, portions of the selected display area on display 412 of all media devices in the plurality of devices. Some embodiments of 610 are described in FIG. 14.
  • FIG. 7 is a flowchart of process 700 for identifying additional display areas based on a content type of the media asset, in accordance with some embodiments of the disclosure.
  • control circuitry 404 determines a content type of the media asset.
  • Control circuitry 404 communicates with media source 510 via I/O Path 402 to retrieve the metadata of the media asset.
  • the content type of the media asset may be listed in the metadata.
  • the metadata of media asset 104 of FIG. 1 may indicate the content type“side-scroller video game.”
  • Other examples of content type include, but are not limited to,“widescreen video,” “photo,”“3D video,” etc.
  • control circuitry 404 retrieves, from a database (e g., in storage 408 of a media device and/or server 512), a predetermined aspect ratio for the content type.
  • control circuitry 404 queries the database for a predetermined aspect ratio associated with“side-scroller video game” and determine the predetermined aspect ratio to be 90x9 (i.e., 10x1).
  • control circuitry 404 adjusts a current aspect ratio of the media asset to the predetermined aspect ratio.
  • the current aspect ratio of the media asset may also be determined by control circuitry 404 from the metadata of the media asset. In the case of media asset 104, the current aspect ratio may be 16x9. Accordingly, control circuitry 404 expands the width of the video game to reveal parts of the level in Super Mario World that are ordinarily hidden in standard 16x9 aspect ratio displays until the user moves Mario to the hidden part. Control circuitry 404 expands the width until the aspect ratio of the media asset becomes 90x9. At 708, control circuitry 404 determines whether the current aspect ratio matches the predetermined aspect ratio.
  • process 700 returns to 706 and control circuitry 404 continues to expand/compress the display width of the media asset. If the current aspect ratio does match, at 710, control circuitry 404 identifies additional display areas based on the predetermined aspect ratio, wherein the plurality of display areas comprises the additional display areas.
  • process 700 is to maximize the aspect ratio of the media asset so that control circuitry 404 can determine all display areas of the media asset. For example, a user watching a widescreen version (e.g., 16x9 aspect ratio) of a movie and a standard version (e.g., 4:3 aspect ratio) of the same movie will notice that the widescreen version covers less height than the standard version and covers more width. Thus, visual information on the top and bottom portion may be clipped in the widescreen version but may appear in the standard version.
  • control circuitry 404 may execute process 700 to adjust the aspect ratio of the media asset and reveal display areas that may be hidden in the current aspect ratio.
  • FIG. 8 is a flowchart of process 800 for selecting a display area based on the amount of visual changes in the display area, in accordance with some embodiments of the disclosure.
  • control circuitry 404 retrieves, from memory (e.g., storage 408 of media device or server 512), a minimum amount of visual changes for a display area.
  • a visual change accounts for changes in a visual attribute such as color, brightness, contrast, saturation, or any combination thereof.
  • control circuitry 404 will analyze the changes in brightness in a display area.
  • the brightness of a media asset may range from a dark shot in a first frame to a bright shot in a second frame
  • the control circuitry 404 assigns, for example, minimum and maximum percentages to the darkest portion in all frames of the media asset (e.g., 0%) and to the lightest portion (e.g., 100%), respectively. All other portions may be assigned a percentage relative to these maximum and minimum percentages.
  • the minimum amount of visual changes may be the average difference in percentage values across all frames of the media asset.
  • control circuitry 404 identifies a plurality of frames of the media asset.
  • a frame of the media asset represents an image of the media asset at a given time. For example, a video comprises several images played consecutively at a high rate. A frame is one of the several images.
  • control circuitry 404 identifies a respective display area of the plurality of display areas. For example, control circuitry 404 focuses on one display area (e.g., display area 106 of media asset 104 in FIG. 1). Suppose in this example that media asset 104 is a video of gameplay of Super Mario World.
  • control circuitry 404 determines, for the plurality of frames, the amount of visual changes within the respective display area.
  • control circuitry 404 determines the difference of brightness percentages between each frame and its successive frame within display area 106. The amount of visual changes in this example is thus the average between all differences (e.g., 40%).
  • control circuitry 404 determines the rate at which the frames are depicted (e.g., 60 frames per second) and select one frame of the rate to determine the differences.
  • frame 1 of the plurality of frames may be the first frame of the media asset
  • frame 2 of the plurality of frames may be the 60 th frame of the media asset
  • frame 3 of the plurality of frames may be the 120 th frame of the media asset, etc. This prevents control circuitry 404 from determining several 0% differences because of duplicative frames. Additional embodiments of 808 are described in FIG. 9.
  • control circuitry 404 determines whether the amount of visual changes within the respective display area is greater than the minimum amount of visual changes. For example, the minimum amount of visual changes may be 30% and the amount of visual changes may be 40%. In response to determining that the amount of visual changes is greater than the minimum amount, process 800 advances to 816 where control circuitry 404 selects the respective display area (e.g., display area 1060 of the plurality of display areas. In response to determining that the amount of visual changes is not greater than the minimum amount, at 812, control circuitry 404 determines whether there are additional display areas in the plurality of display areas to consider (e g., the portions not bounded in the dotted lines in media asset 104 of FIG. 1).
  • control circuitry 404 identifies another display area of the plurality of display areas as the respective display area Process 800 then returns to 808, where the amount of visual changes within the another display area are determined. If there no more additional display areas at 812, process 800 advances to 816. In this case, the last analyzed display area (i.e., the display area for which control circuitry 404 just determined the amount of visual changes for) is selected. Once process 800 is complete, control circuitry 404 may execute 1002 of process 1000 or proceed to 608 of process 600.
  • FIG. 9 is a flowchart of process 900 for determining a total difference in pixel changes over a plurality of frames in a display area, in accordance with some embodiments of the disclosure.
  • the visual changes may represent changes in visual attributes of the media asset.
  • process 900 describes changes in pixel values and may be executed by control circuitry 404 at 808 of FIG. 8.
  • control circuitry 404 identifies a respective frame of the plurality of frames.
  • the plurality of frames may have 10 frames.
  • Control circuitry 404 may first consider frame 1 of the plurality of frames.
  • control circuitry 404 identifies a respective pixel within a respective display area of the respective frame.
  • the display area may be display area 106 of FIG.
  • Control circuitry 404 may generate a two-dimensional matrix with all of the pixel values in frame 1 that are within the respective display area. At 906, control circuitry 404 determines whether there is a successive frame after the respective frame. In this example, control circuitry 404 determines that frame 2 is the successive frame of frame 1 (i.e., is generated for display subsequent to when the display of frame 1 ceases).
  • control circuitry 404 determines an amount of difference between the respective pixel in the respective frame and a corresponding pixel in the successive frame. For example, control circuitry 404 may generate a two-dimensional matrix with all of the pixel values in frame 2 that are within the respective display area. Control circuitry 404 can then perform matrix subtraction between the respective matrices of frame 1 and frame 2. If there are no successive frames (e.g., the frame being considered is the final frame), process 900 ends at 916. At 910, control circuitry 404 adds the amount of difference to a counter representing the total difference. At 912, control circuitry 404 determines whether there is another pixel within the display area.
  • process 900 In response to determining that there is another pixel, process 900 returns to process 904. Thus, the another pixel is now the respective pixel. This loop between 904 and 912 continues until all pixels within the display area have been considered for determining the amount of differences.
  • control circuitry 404 may also consider one pixel at a time per frame if it does not rely on matrix subtractions. This may be appropriate if the display area is not a standard shape such as a rectangle. Nonetheless, when using matrix operations, control circuitry 404 may determine a difference matrix between frame 2 and frame 1 with all pixel value differences. Control circuitry 404 may additionally sum the values of the different matrix to determine the value of the counter.
  • process 900 advances to 914 where control circuitry 404 determines whether there is a successive frame after the respective frame. As determined by control circuitry 404, frame 2 is the successive frame of frame 1.
  • process 900 In response to determining that there is a successive frame, process 900 returns to 902 and another loop between 902 and 914 is started.
  • the successive frame e g., frame 2 becomes the respective frame and the pixels from the new respective frame are considered for determining the amount of differences. In other words, the pixel differences between frame 2 and 3 are considered.
  • control circuitry 404 determines that there is no successive frame, process 900 ends at 916.
  • the value of the counter is the total difference of pixel values (i .e., the amount of visual changes in process 800) across all frames in the plurality of frames. Control circuitry 404 may thus advance to 810 of process 800 to determine which display area to select.
  • FIG. 10 is a flowchart of process 1000 for selecting a display area based on an object of interest in the display area, in accordance with some embodiments of the disclosure.
  • Control circuitry 404 may execute process 1000 at 606 of process 600.
  • control circuitry 404 identifies an object of interest.
  • Control circuitry 404 retrieves the object of interest from the metadata of the media asset, or from a user profile stored in memory (e.g., storage 408 of media device and/or server 512).
  • media asset 104 is the video game Super Mario World.
  • the metadata of the media asset may indicate that Mario is the object of interest.
  • control circuitry 404 determines that the user plays several video games featuring Mario. Accordingly, Mario would be identified by control circuitry 404 as the object of interest.
  • control circuitry 404 identifies a plurality of frames of the media asset.
  • control circuitry 404 scans, using object recognition, a respective display area in each frame of the plurality of frames for the object of interest. For example, control circuitry 404 searches, within the respective display area, for a visual of the character Mario. At 1008, control circuitry 404 determines whether the object of interest appears within the respective display area in any frame. In the case of a video game, Mario may move across various parts of the frame. Accordingly, control circuitry 404 determines, based on in-games physics and game-code, the portions of a frame in which Mario can potentially appear.
  • control circuitry 404 selects the respective display area.
  • control circuitry 404 determines whether there is an additional display area to consider.
  • control circuitry 404 identifies the additional display area as the respective display area.
  • process 1000 returns to 1006, where control circuitry 404 determines whether the additional display area has the object of interest within. In some embodiments, control circuitry 404 determines and selects all display areas that the object of interest appears in or can potentially appear in.
  • control circuitry 404 selects all display areas. Specifically, control circuitry 404 selects all display areas of the plurality of display areas because the object of interest appears in none of the display areas, making each display area of equal value (i.e., must be displayed).
  • FIG. 11 is a flowchart of process 1100 for determining a combination of displays within which a selected display area fits, in accordance with some embodiments of the disclosure.
  • Control circuitry 404 may execute process 1100 at 608 of process 600.
  • control circuitry 404 determines a display area size of the selected display area.
  • the display area size may, for example, be a rectangle that is 9000 pixels wide and 900 pixels high.
  • control circuitry 404 identifies respective display dimensions of each device in the plurality of devices.
  • the plurality of devices may include four identical smartphones (e.g., depicted as initial arrangement 102 in FIG. 1).
  • the respective display dimensions for each phone may be a rectangle 2250 pixels wide and 900 pixels high.
  • control circuitry 404 determines, based on the respective display dimensions of each device and the display area size, a combination of display dimensions. For example, control circuitry 404 determines a combination of display dimensions in which all displays are arranged forming a straight line and connected by their short edges (e.g., depicted as layout 108 in FIG. 1). Some embodiments of 1106 are described in FIG. 13. At 1108, control circuitry 404 determines whether the selected display area fits in the combination of display dimensions. For example, layout 108 represents a combination of display dimensions that has a combined display dimension of 9000 pixels in width and 900 pixels in height. This combined display dimensions matches the display area size of the selected display area.
  • process 1100 advances to 1112 where control circuitry 404 determines relative positions of each device in the plurality of devices based on the combination, wherein placement of each device based on the relative positions forms the unified display (e g., unified display 110). In response to determining that the selected display area does not fit, before advancing to 1112, control circuitry 404 adjusts an aspect ratio of the selected display area to equal an aspect ratio of the combination at 1110.
  • FIG. 12 is a flowchart of process 1200 for determining a combination of displays within which multiple display areas fit, in accordance with some embodiments of the disclosure.
  • Control circuitry 404 may execute process 1200 at 608 of process 600 when multiple display areas can be selected.
  • control circuitry 404 selects a second display area based on the identified content of the display area (e.g., the second display area may include the object of interest).
  • control circuitry 404 determines a third display area that comprises both the first display area and the second display area.
  • control circuitry 404 identifies a third display area that spans both edges of media asset 104. This ensures that content from both display areas are output on the unified display. It should be noted that multiple display areas may be selected and accordingly control circuitry 404 determines a display area that comprises the multiple display areas.
  • control circuitry 404 determines a display area size of the third display area.
  • control circuitry 404 identifies respective display dimensions of each device in the plurality of devices.
  • control circuitry 404 determines, based on the respective display dimensions of each device and the display area size, a combination of display dimensions. Some embodiments of 1210 are described in FIG. 13.
  • control circuitry 404 determines whether the third display area fits in the combination of display dimensions.
  • control circuitry 404 determines relative positions of each device in the plurality of devices based on the combination, wherein placement of each device based on the relative positions forms the unified display. In response to determining that the third display area does not fit, process 1200 returns to 1210.
  • FIG. 13 is a flowchart of process 1300 for determining a relative placement of devices such that the number of devices displaying the selected display area is maximized, in accordance with some embodiments of the disclosure.
  • control circuitry 404 identifies a first device of the plurality of devices as the unified display. For example, control circuitry 404 identifies the first smartphone (i.e., device 1) of initial arrangement 102 in FIG. 1.
  • control circuitry 404 determines a display dimension of the first device.
  • the display dimension of the first device may be a rectangle that is 2250 pixels wide and 900 pixels high.
  • control circuitry 404 identifies an additional device of the plurality of devices to add to the unified display.
  • control circuitry 404 identifies device 2 of initial arrangement 102.
  • control circuitry 404 determines an additional display dimension of the additional device. As mentioned previously, all smartphones in initial arrangement are identical. Therefore, the display dimensions of device 2 are the same as device 1.
  • control circuitry 404 determines a relative placement of the additional device near the unified display such that the aspect ratio of the unified display matches the aspect ratio of the selected display area, based on the display dimensions.
  • the aspect ratio of the selected display area may be 1x10.
  • Control circuitry 404 determines that placing device 2 next to device 1 such that the combined display dimension is 4500 pixels by 900 pixels, gives an aspect ratio of 5x1. Although the respective aspect ratios do not match, control circuitry 404 determines that 5x1 is the closest aspect ratio that can be achieved based on an optimization algorithm. The optimization algorithm may take the target aspect ratio and the respective display dimensions as inputs and output a combined display dimension that would provide an aspect ratio closest to the aspect ratio.
  • control circuitry 404 determines whether there is an additional device in the plurality of devices. For example, control circuitry 404 identifies device 3 of initial arrangement 102.
  • control circuitry 404 In response to determining that there is an additional device, the additional device is considered the new respective device and process 1300 returns to 1306. In this iteration, control circuitry 404 considers how to place device 3 relative to the unified display (comprising device 1 and 2). Control circuitry 404 determines that the combined display dimension of 6750 px by 900 px gives an aspect ratio of 14x2, which is the closest aspect ratio that can be made by the individual display dimensions. Control circuitry 404 then identifies that device 4 is an addition device of initial arrangement 102 that should be combined. In this iteration, control circuitry 404 determines that the target aspect ratio is met when the phones are aligned in layout 108. Control circuitry 404 then determines whether there is an additional device in the plurality of devices to consider. In response to determining that there is not an additional device in the plurality of devices, process 1300 ends at 1314.
  • FIG. 14 is a flowchart of process 1400 for outputting visual indicators on the respective devices in the plurality of devices, in accordance with some embodiments of the disclosure.
  • control circuitry 404 determines number of devices in the plurality of devices. For example, initial arrangement 102 in FIG. 1 has four devices.
  • control circuitry 404 determines respective display dimensions of each device in the plurality of device.
  • control circuitry 404 divides the selected display area based on respective display dimensions of each device in the plurality of devices. For example, control circuitry 404 divides display area 106 into four parts. If the aspect ratio of display area 106 is 10x1 pixels, control circuitry 404 divides display area 106 into four parts that are each 2250 pixels wide and 900 pixels high.
  • control circuitry 404 identifies a respective device in the plurality of devices.
  • control circuitry 404 assigns a divided portion of the selected display area to the respective device, wherein dimensions of the portion correspond to display dimensions of the respective device. For example, control circuitry 404 assigns the first portion to device 1 of initial arrangement 102 in FIG. 1.
  • control circuitry 404 generates, for display, the assigned portion on the respective device.
  • control circuitry 404 determines whether the respective device is the first device in the plurality of devices. In response to determining that the respective device is the first device, at 1416 control circuitry 404 generates, for display on the respective device, a visual indicator on the display of the first device.
  • control circuitry 404 In response to determining that the respective device is not the first device, at 1418 control circuitry 404 generates, for display on the respective device, a visual indicator for alignment with the visual indicator of the previous respective device in the plurality of devices. At 1420, control circuitry 404 determines whether there is another device in the plurality of devices that has not been assigned a portion. For example, control circuitry 404 determines that device 2 has not been assigned a portion. Control circuitry 404 assigns the second portion of selected display area to device 2. In response to determining that there is another device, at 1422 control circuitry 404 generates, for display on the respective device, another visual indicator for alignment with the another device.
  • control circuitry 404 identifies the another device as the next respective device and process 1400 returns to 1410 where the placement of the visual indicators is determined for the another device. In this case, control circuitry 404 identifies device 2 of FIG. 1. Control circuitry 404 continues the loop until all devices of the plurality of devices are assigned a portion and have a visual indicator that can be used by the user to align the devices. At 1420, in response to determining that there is no another device, process 1400 ends at 1426. Accordingly, the result of process 1400 is depicted in 304 of FIG. 3. A user may then align the visual indicators and form display arrangement 308 of FIG. 3.
  • processes 600-1400 or any step thereof could be performed on, or provided by, any of the devices shown in FIGS. 4-5.
  • the processes may be executed by control circuitry 404 (FIG. 4) as instructed by a display combining application implemented on media devices 502, 504, 506 and/or server 512.
  • one or more steps of a process may be incorporated into or combined with one or more steps of any other process or embodiment (e.g., steps from process 600 may be combined with steps from process 800).
  • steps and descriptions described in relation to FIGS. 6-14 may be done in alternative orders or in parallel to further the purposes of this disclosure. For example, each of these steps may be performed in any order or in parallel or substantially simultaneously to reduce lag or increase the speed of the system or method.

Abstract

L'invention concerne des systèmes et des procédés permettant de déterminer un agencement d'une pluralité de dispositifs formant un affichage unifié. Une application de combinaison d'affichages identifie du contenu dans des zones d'affichage d'un contenu multimédia. En fonction du contenu identifié d'une zone d'affichage, l'application de combinaison d'affichages sélectionne la zone d'affichage de la pluralité de zones d'affichage. L'application de combinaison d'affichages détermine et fournit alors un agencement de la pluralité de dispositifs formant l'affichage unifié, de sorte que l'agencement maximise un nombre de dispositifs dans la pluralité de dispositifs qui affichent la zone d'affichage sélectionnée.
PCT/US2018/066720 2018-12-20 2018-12-20 Systèmes et procédés de recommandation d'agencement d'une pluralité de dispositifs formant un affichage unifié WO2020131059A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2018/066720 WO2020131059A1 (fr) 2018-12-20 2018-12-20 Systèmes et procédés de recommandation d'agencement d'une pluralité de dispositifs formant un affichage unifié

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2018/066720 WO2020131059A1 (fr) 2018-12-20 2018-12-20 Systèmes et procédés de recommandation d'agencement d'une pluralité de dispositifs formant un affichage unifié

Publications (1)

Publication Number Publication Date
WO2020131059A1 true WO2020131059A1 (fr) 2020-06-25

Family

ID=65024086

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/066720 WO2020131059A1 (fr) 2018-12-20 2018-12-20 Systèmes et procédés de recommandation d'agencement d'une pluralité de dispositifs formant un affichage unifié

Country Status (1)

Country Link
WO (1) WO2020131059A1 (fr)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011057271A1 (fr) * 2009-11-09 2011-05-12 Qualcomm Incorporated Affichage d'image multi-écrans
US20120249415A1 (en) * 2011-03-29 2012-10-04 Fujitsu Limited Server, terminal device, and grouping method
US20130176255A1 (en) * 2012-01-06 2013-07-11 Samsung Electronics Co., Ltd. Method and apparatus for implementing multi-vision system by using multiple portable terminals
US20130265487A1 (en) * 2012-04-06 2013-10-10 Realtek Semiconductor Corp. Video playback system and related computer program product for jointly displaying video with multiple screens
US20140313103A1 (en) * 2013-04-19 2014-10-23 Qualcomm Incorporated Coordinating a display function between a plurality of proximate client devices
US20150061971A1 (en) * 2013-08-30 2015-03-05 Samsung Electronics Co., Ltd. Method and system for presenting content
US20150091917A1 (en) * 2013-09-27 2015-04-02 Lenovo (Beijing) Limited Information processing methods and electronic devices
US20150268917A1 (en) * 2014-03-20 2015-09-24 Nokia Technologies Oy Apparatus, method, and computer program product for aligning images viewed across multiple displays
US20160162240A1 (en) * 2013-07-29 2016-06-09 Samsung Electronics Co., Ltd. Method and apparatus for constructing multi-screen display
US20180024800A1 (en) * 2016-07-21 2018-01-25 Disney Enterprises, Inc. Display device array
US20180144720A1 (en) * 2016-11-23 2018-05-24 Videri Inc. Orchestrated digital display system

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011057271A1 (fr) * 2009-11-09 2011-05-12 Qualcomm Incorporated Affichage d'image multi-écrans
US20120249415A1 (en) * 2011-03-29 2012-10-04 Fujitsu Limited Server, terminal device, and grouping method
US20130176255A1 (en) * 2012-01-06 2013-07-11 Samsung Electronics Co., Ltd. Method and apparatus for implementing multi-vision system by using multiple portable terminals
US20130265487A1 (en) * 2012-04-06 2013-10-10 Realtek Semiconductor Corp. Video playback system and related computer program product for jointly displaying video with multiple screens
US20140313103A1 (en) * 2013-04-19 2014-10-23 Qualcomm Incorporated Coordinating a display function between a plurality of proximate client devices
US20160162240A1 (en) * 2013-07-29 2016-06-09 Samsung Electronics Co., Ltd. Method and apparatus for constructing multi-screen display
US20150061971A1 (en) * 2013-08-30 2015-03-05 Samsung Electronics Co., Ltd. Method and system for presenting content
US20150091917A1 (en) * 2013-09-27 2015-04-02 Lenovo (Beijing) Limited Information processing methods and electronic devices
US20150268917A1 (en) * 2014-03-20 2015-09-24 Nokia Technologies Oy Apparatus, method, and computer program product for aligning images viewed across multiple displays
US20180024800A1 (en) * 2016-07-21 2018-01-25 Disney Enterprises, Inc. Display device array
US20180144720A1 (en) * 2016-11-23 2018-05-24 Videri Inc. Orchestrated digital display system

Similar Documents

Publication Publication Date Title
US11134314B2 (en) Displaying an actionable element over playing content
US11638045B2 (en) Authorizing devices based on identifying content distributor
US9892324B1 (en) Actor/person centric auto thumbnail
US20160373820A1 (en) Systems and methods for determining reach using truncation and aggregation
KR20120099064A (ko) 멀티스크린 대화형 스크린 아키텍쳐
EP3797522A1 (fr) Systèmes et procédés d'affichage de multiples contenus multimédias pour une pluralité d'utilisateurs
US11514554B2 (en) Method to generate additional level of detail when zooming in on an image
US10163008B2 (en) Systems and methods for recreating a reference image from a media asset
CN109565616B (zh) 在移动电话上的交互式视频多屏体验
US10972809B1 (en) Video transformation service
CN110300118B (zh) 流媒体处理方法、装置及存储介质
US20170142172A1 (en) Video Player for Multiple Cameras, Playing System and Playing Method
US20180167699A1 (en) Collaborative media distribution system and method of using same
WO2020131059A1 (fr) Systèmes et procédés de recommandation d'agencement d'une pluralité de dispositifs formant un affichage unifié
WO2018072184A1 (fr) Génération de canaux mosaïques pour des diffusions en direct ott
US20200366973A1 (en) Automatic Video Preview Creation System
CN113766255A (zh) 视频流合并方法、装置、电子设备及计算机介质
US11902625B2 (en) Systems and methods for providing focused content
WO2020131061A1 (fr) Systèmes et procédés de production de contenu sur une pluralité de dispositifs formant un affichage unifié
JP2017182706A (ja) サーバ装置、情報処理方法およびプログラム
US20160212475A1 (en) Dynamically generated user interface
CN117392244A (zh) 图像处理方法、装置、电子设备和存储介质
KR20160081349A (ko) 디스플레이 제어 방법 및 미디어 재생 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18834204

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18834204

Country of ref document: EP

Kind code of ref document: A1