WO2014094537A1 - 沉浸通信客户端、服务器及获取内容视图的方法 - Google Patents

沉浸通信客户端、服务器及获取内容视图的方法 Download PDF

Info

Publication number
WO2014094537A1
WO2014094537A1 PCT/CN2013/088442 CN2013088442W WO2014094537A1 WO 2014094537 A1 WO2014094537 A1 WO 2014094537A1 CN 2013088442 W CN2013088442 W CN 2013088442W WO 2014094537 A1 WO2014094537 A1 WO 2014094537A1
Authority
WO
WIPO (PCT)
Prior art keywords
content view
content
view
immersive communication
information
Prior art date
Application number
PCT/CN2013/088442
Other languages
English (en)
French (fr)
Inventor
黄成�
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to EP13866256.4A priority Critical patent/EP2938038B1/en
Priority to KR1020157018686A priority patent/KR102069930B1/ko
Publication of WO2014094537A1 publication Critical patent/WO2014094537A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • G06F16/444Spatial browsing, e.g. 2D maps, 3D or virtual spaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1083In-session procedures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/613Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for the control of the source by the destination
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/762Media network packet handling at the source 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661Transmitting camera control signals through networks, e.g. control via the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/30Transforming light or analogous information into electric information
    • H04N5/33Transforming infrared radiation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Definitions

  • the present invention relates to the field of communications, and in particular, to an immersive communication client, a server, and a method for obtaining a content view.
  • Tele-immersion technology is being used by academia and industry by reconstructing physical scenes in a virtual environment, allowing remotely collaborating and interacting among geographically distributed users. s concern. Immersion can increase the level of real-world awareness and help realize the interactivity of many multimedia applications, from video conferencing to entertainment games.
  • a rebuilt virtual environment with an immersive experience provides users with a wide field of view (FOV), enabling users to enjoy an immersive visual experience even in remote locations. The viewing angle of a single camera is limited.
  • FOV wide field of view
  • a well-experienced remote immersive communication system (such as: providing "by-there” and “being-with” immersive experience) should be based on the user's current viewing field, viewing distance, state acquisition (remote control input, attitude detection), and The content view source is updated synchronously to better suit the user's need for an immersive communication experience, which has not been fully researched and solved so far.
  • the present invention provides an immersive communication client, a server, and a method for obtaining a content view, in order to solve at least the above problem, in view of the problem that the user cannot provide a specific content view according to the user's selection.
  • a method for obtaining a content view is provided, including: immersing a communication client to collect content view selection information of a user; and immersing the communication client to send a content view acquisition request to the immersive communication server, where the content The view acquisition request is used to request the immersive communication server to acquire the content view according to the content view selection information.
  • the content view selection information includes at least one of the following: a content view identifier, a content view for indicating a user selection, a view information, a content view viewing angle for indicating a user selection, and distance information, indicating content selected by the user. View viewing distance.
  • the content view obtaining request comprises: a content view update request carrying content view selection information, configured to request the immersive communication server to update the content view according to the content view selection information.
  • the step of collecting the content view selection information by the immersive communication client comprises at least one of the following: immersing the communication client to obtain the content view identifier selected by the user as the content view selection information; and immersing the communication client to obtain the content view selected by the user As the content view selection information; the immersive communication client obtains the content view viewing distance selected by the user as the content view selection information.
  • the step of collecting the content view selection information by the immersive communication client comprises: detecting a control signal input by the user through the input device, acquiring content view selection information according to the control signal; and/or detecting a posture change of the user, and acquiring the content according to the posture change View selection information.
  • the method further includes: the immersive communication client receives the content view update notification sent by the immersive communication server, wherein the content view update notification carries the content view change information of the other immersive communication client.
  • the content view comprises: a separate content view, and/or a continuous content view.
  • the method further includes: the immersive communication client receiving the content view returned by the immersive communication server, and immersing the communication client to display the content view.
  • a method for obtaining a content view including: the immersive communication server receives a content view acquisition request sent by an immersive communication client, where the content view acquisition request carries a content view selection information of the user The immersive communication server acquires the content view according to the content view selection information; the immersive communication server returns the acquired content view to the immersive communication client.
  • the content view selection information includes at least one of the following: a content view identifier, a content view for indicating a user selection, a view information, a content view viewing angle for indicating a user selection, and distance information, indicating content selected by the user. View viewing distance.
  • the content view obtaining request includes: a content view update request carrying the content view selection information, configured to request the immersive communication server to update the content view according to the content view selection information.
  • the step of the immersive communication server acquiring the content view according to the content view selection information includes: the immersive communication server acquires the content view according to the content view identifier in the content view selection information; or the immersive communication server selects according to the content view The view information and/or the distance information in the information acquires the content view.
  • the step of the immersive communication server acquiring the content view according to the content view selection information comprises: immersing the communication server to select the multimedia content source according to the visual field information and/or the distance information in the content view selection information; the immersive communication server generates the multimedia content source Content view.
  • the step of selecting a multimedia content source comprises: determining one or more multimedia content capture devices according to the view information and/or the distance information, using one or more multimedia content capture devices to select the multimedia content source; or, according to the visual field information And/or distance information, adjusting the location of the one or more multimedia content capture devices, and selecting the multimedia content source using one or more multimedia content capture devices.
  • the step of the immersive communication server acquiring the content view according to the content view selection information comprises: generating a content view acquisition control instruction according to the content view selection information; transmitting the content view acquisition control instruction to the multimedia content capture device; receiving the returned by the multimedia content capture device a multimedia content source, wherein the multimedia content source is a multimedia content source selected by the multimedia content capture device according to the content view acquisition control instruction; and the content view is generated by using the multimedia content source.
  • the method further includes: the immersive communication server sends a content view update notification to the other immersive communication client, wherein the content view update notification carries the content view change information of the immersive communication client.
  • an immersive communication client including: a collection module configured to collect content view selection information of a user; and a sending module configured to send a content view acquisition request to the immersive communication server, where The content view obtaining request is used to request the immersive communication server to acquire the content view according to the content view selection information.
  • the client further includes: a display module, configured to receive the content view fed back by the immersive communication server, and display the content view.
  • the client further includes: a receiving module, configured to receive a content view update notification sent by the immersive communication server, where the content view update notification carries content view change information of other immersive communication clients.
  • the collecting module comprises at least one of the following: a first obtaining unit configured to acquire a content view identifier selected by the user as content view selection information, wherein the content view identifier is used to indicate content selected by the user
  • the second obtaining unit is configured to obtain the visual field information selected by the user as the content view selection information, wherein the visual field information is used to indicate the viewing angle of the content view selected by the user
  • the third obtaining unit is configured to obtain the distance information selected by the user.
  • the distance information is used to indicate the content view viewing distance selected by the user.
  • an immersive communication server including: a receiving module, configured to receive a content view obtaining request sent by an immersive communication client, where the content view obtaining request carries a content view selection information of the user
  • the obtaining module is configured to obtain a content view according to the content view selection information
  • the sending module is configured to return the obtained content view to the first immersive communication client.
  • the obtaining module is configured to obtain the content view according to the content view identifier in the content view selection information, wherein the content view identifier is used to indicate the content view selected by the user.
  • the obtaining module comprises: a selecting unit, configured to select a multimedia content source according to the visual field information and/or the distance information in the content view selection information, wherein the visual field information is used to indicate the viewing angle of the content view selected by the user, and the distance information is used The content view viewing distance indicated by the user is selected; the generating unit is configured to generate the content view by using the multimedia content source.
  • the selecting unit is configured to determine one or more multimedia content capturing devices according to the visual field information and/or the distance information, and select the multimedia content source by using one or more multimedia content capturing devices; or, set according to the visual field information and/or Or distance information, adjusting the location of one or more multimedia content capture devices, using one or more multimedia content capture devices to select a multimedia content source.
  • the obtaining module comprises: an instruction generating unit configured to generate a content view obtaining control instruction according to the content view selection information; a sending unit configured to send a content view obtaining control instruction to the multimedia content capturing device; and a receiving unit configured to receive the multimedia content The multimedia content source returned by the capture device, wherein the multimedia content source is a multimedia content source selected by the multimedia content capture device according to the content view acquisition control instruction; and the content view generation unit is configured to generate the content view by using the multimedia content source.
  • the server further includes: a notification module, configured to send a content view update notification to the other immersive communication client, wherein the content view update notification carries the content view change information of the immersive communication client.
  • the immersive communication client collects the content view selection information of the user, and sends a content view acquisition request to the immersive communication server, where the content view acquisition request is used to request the immersive communication server to obtain the content view according to the content view selection information, The content view is provided according to the user's selection.
  • FIG. 2 is a block diagram showing a preferred immersive communication client according to an embodiment of the present invention
  • FIG. 3 is a preferred collection module according to an embodiment of the present invention.
  • 4 is a structural block diagram of an immersive communication server according to an embodiment of the present invention
  • FIG. 5 is a structural block diagram of a preferred acquisition module according to an embodiment of the present invention
  • FIG. 6 is a preferred acquisition module according to an embodiment of the present invention.
  • FIG. 7 is a flowchart 1 of a method for acquiring a content view according to an embodiment of the present invention
  • FIG. 8 is a flowchart 2 of a method for acquiring a content view according to an embodiment of the present invention
  • FIG. 9 is a flowchart according to an embodiment of the present invention.
  • FIG. 1 of a method for acquiring a content view according to an embodiment of the present invention
  • FIG. 8 is a flowchart 2 of a method for acquiring a content view according to an embodiment of the present invention
  • FIG. 9 is
  • FIG. 10 is a flowchart 1 of a content view switching method according to an embodiment of the present invention
  • FIG. 11 is a flowchart 2 of a content view switching method according to an embodiment of the present invention
  • FIG. 13 is a flowchart of a content view zooming method according to an embodiment of the present invention
  • FIG. 14 is a flowchart of a content view update notification method according to an embodiment of the present invention
  • FIG. 15 is a signaling flowchart of a content view update method according to Embodiment 1 of the present invention
  • FIG. 16 is a second embodiment of the present invention.
  • FIG. 11 is a flowchart 2 of a content view switching method according to an embodiment of the present invention
  • FIG. 13 is a flowchart of a content view zooming method according to
  • FIG. 17 is a signaling flowchart of a content view update method according to Embodiment 3 of the present invention.
  • BEST MODE FOR CARRYING OUT THE INVENTION the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
  • an immersive communication client, an immersive communication server, and a method of obtaining a content view are provided.
  • FIG. 1 is a structural block diagram of an immersive communication client according to an embodiment of the present invention. As shown in FIG. 1, the immersive communication client mainly includes: a collection module 10 and a transmission module 12.
  • the collection module 10 is configured to collect content view selection information of the user.
  • the sending module 12 is connected to the collection module 10 and configured to send a content view acquisition request to the immersive communication server, where the content view acquisition request is used to request the immersive communication.
  • the server obtains a content view based on the content view selection information.
  • 2 is a structural block diagram of a preferred immersive communication client according to an embodiment of the present invention. As shown in FIG. 2, the immersive communication client of the embodiment of the present invention may further include: a display module 14 configured to receive a content view fed back by the immersive communication server. And display the received content view.
  • the immersive communication client may further include: a receiving module, configured to receive a content view update notification sent by the immersive communication server, where the content view update notification carries a content view of other immersive communication clients Change information.
  • 3 is a structural block diagram of a preferred collection module according to an embodiment of the present invention.
  • the collection module 10 may include at least one of the following:
  • the first obtaining unit 102 is configured to acquire a content view identifier selected by a user as content.
  • the view selection information is used to indicate the content view selected by the user.
  • the second obtaining unit 104 is configured to obtain the view information selected by the user as the content view selection information, where the view information is used to indicate the content selected by the user.
  • the third viewing unit 106 is configured to acquire the distance information selected by the user as the content view selection information, wherein the distance information is used to indicate the content view viewing distance selected by the user.
  • the collecting module 10 may detect a control signal input by the user through the input device, acquire content view selection information according to the control signal, and/or detect a posture change of the user, and acquire content view selection information according to the posture change.
  • the collection module 10 can receive the content view identifier input by the user, for example, the view identifier input by the input device such as a remote controller, a keyboard, a touch-sensitive display, and the content view viewing angle and/or The view view distance, requesting the content view selected by the user from the immersive communication server.
  • the collection module 10 can also detect changes in the posture of the user, and obtain changes in the viewing angle of the content view and/or the viewing distance of the content view.
  • the immersive communication client can also receive the content view selected by the user fed back by the immersive communication server, and display the content view selected by the user to the user through the display device.
  • the immersive communication server can obtain the content view according to the content view acquisition request of the immersive communication client.
  • the preferred immersive communication server of the embodiment of the present invention will now be described. 4 is a structural block diagram of an immersive communication server according to an embodiment of the present invention. As shown in FIG. 4, the server mainly includes: a receiving module 40, an obtaining module 42, and a sending module 44.
  • the receiving module 40 is configured to receive the content view obtaining request sent by the immersive communication client, where the content view obtaining request carries the content view selection information of the user; the obtaining module 42 is connected to the receiving module 40, and is set according to the content view. The information acquisition content view is selected; the sending module 44 is connected to the obtaining module 42 and configured to return the obtained content view to the immersive communication client.
  • the obtaining module 42 is configured to obtain a content view according to the content view identifier in the content view selection information, where the content view identifier is used to indicate a content view selected by the user.
  • the obtaining module 42 is configured to obtain the content view according to the view information and/or the distance information in the content view selection information.
  • the obtaining module 42 may include: a selecting unit 420 configured to select view information and/or distance information according to the content view selection information.
  • the multimedia content source is selected, wherein the visual field information is used to indicate a viewing view angle of the content view selected by the user, and the distance information is used to indicate a viewing distance of the content view selected by the user; and the generating unit 422 is configured to generate the content view by using the selected multimedia content source.
  • the selecting unit 420 is configured to determine one or more multimedia content capturing devices according to the view information and/or the distance information, by using the determined one or more multimedia content capturing devices.
  • the selecting unit 420 is configured to adjust the position of the one or more multimedia content capturing devices according to the view information and/or the distance information, and select the multimedia content source by using the adjusted one or more multimedia content capturing devices.
  • the multimedia content capture device can be set up at different locations, and the multimedia content source acquired by the multimedia content capture device at different locations generates a view of the content viewed by the user. Whereas only one multimedia content capture device is provided, the content view requested by the user can be obtained by adjusting the location of the multimedia content capture device.
  • 6 is a block diagram of a preferred acquisition module according to an embodiment of the present invention. As shown in FIG.
  • the obtaining module 42 may include: an instruction generating unit 424, configured to generate a content view acquisition control instruction according to the content view selection information; 426, configured to send a content view acquisition control instruction to the multimedia content capture device; the receiving unit 428 is configured to receive the multimedia content source returned by the multimedia content capture device, where the multimedia content source is selected by the multimedia content capture device according to the content view acquisition control instruction The multimedia content source; the content view generating unit 429 is configured to generate the content view using the multimedia content source.
  • the immersive communication server may further include: a notification module, configured to send a content view update notification to the other immersive communication client, where the content view update notification carries the content view change information of the immersive communication client .
  • the other immersive communication client can obtain the updated content view according to the content view update notification.
  • the immersive communication client that sends the content view update notification can be set according to the operation policy, for example, watching the immersive communication of the same pair of media content sources. Clients, etc.
  • the method for obtaining a content view of the embodiment of the present invention is described below.
  • FIG. 7 is a flowchart 1 of a method for obtaining a content view according to an embodiment of the present invention. As shown in FIG. 7, the method mainly includes steps S702 to S704. Step S702, the immersive communication client collects content view selection information of the user.
  • the content view selection information includes, but is not limited to, at least one of the following: a content view identifier, used to indicate a content view selected by the user; and a view information, used to indicate a user view selected content view viewing angle ; Distance information, used to indicate the viewing distance of the content view selected by the user. For example, a correspondence between a content view and a content view identifier may be set, and a corresponding content view is indicated by the content view identifier.
  • the step of collecting the content view selection information by the immersive communication client includes, but is not limited to, at least one of the following: the immersive communication client acquires the content view identifier selected by the user as the content view selection information; and the immersive communication client obtains the content selected by the user The view views the view as the content view selection information; the immersive communication client obtains the content view viewing distance selected by the user as the content view selection information.
  • the immersive communication client may detect a control signal input by the user through the input device, acquire content view selection information according to the control signal, and/or detect a posture change of the user, and acquire content view selection information according to the posture change.
  • the immersive communication client can receive the content view identifier input by the user, for example, the view identifier input by the input device such as a remote controller, a keyboard, a touch-sensitive display, and the content view viewing angle and/or the content view viewing distance. , requesting the content view selected by the user from the immersive communication server.
  • Immersive communication client It is also possible to detect a change in the posture of the user, and obtain a change in the viewing angle of the content view and/or the viewing distance of the content view. Step S702, the immersive communication client sends a content view acquisition request to the immersive communication server, where the content view acquisition request is used to request the immersive communication server to acquire the content view according to the content view selection information.
  • the content view obtaining request includes: a content view update request carrying content view selection information, configured to request the immersive communication server to update the content view according to the content view selection information.
  • the request may be sent to obtain a content view.
  • the content view update request may be sent to update the content view being viewed, for example, the content view switching request or the content view scaling request. Wait.
  • the immersive communication client can also receive the content view fed back by the immersive communication server and display the received content view.
  • the immersive communication client may further receive a content view update notification sent by the immersive communication server, where the content view update notification carries content view change information of other immersive communication clients.
  • the immersive communication client can select whether to obtain the updated content view according to the content view update notification.
  • the content view may include: a separate content view (eg, a video picture in the traditional sense), and/or a continuous content view (eg, a panorama, generated by stitching of multiple individual content views).
  • FIG. 8 is a second flowchart of a method for obtaining a content view according to an embodiment of the present invention. As shown in FIG. 8, the method mainly includes steps S802 to S806.
  • the immersive communication server receives the content view acquisition request sent by the immersive communication client, where the content view acquisition request carries the content view selection information of the user.
  • the content view selection information includes at least one of the following: a content view identifier, configured to indicate a content view selected by the user; a view information, used to indicate a content view viewing angle selected by the user; , used to indicate the content view viewing distance selected by the user.
  • the content view obtaining request includes: a content view update request carrying content view selection information, configured to request the immersive communication server to update the content view according to the content view selection information. In an actual application, when the user initiates the immersive communication, the request may be sent to obtain a content view.
  • the content view update request may be sent to update the content view being viewed, for example, the content view switching request or the content view scaling request. Wait.
  • the immersion communication server acquires the content view according to the content view selection information.
  • the step of the immersive communication server acquiring the content view according to the content view selection information may include: the immersive communication server acquires the content view according to the content view identifier in the content view selection information; or, the immersive communication server is configured according to The content view selects the view information and/or the distance information in the information to obtain a content view.
  • the correspondence between the content view and the content view identifier may be preset, and the immersive communication server acquires the content view corresponding to the content view identifier selected by the user.
  • the step of the immersive communication server acquiring the content view according to the content view selection information may include: the immersive communication server selects the multimedia content source according to the view information and/or the distance information in the content view selection information. , generating a content view using the selected multimedia content source.
  • the step of selecting a multimedia content source may include: determining, according to the view information and/or the distance information, one or more multimedia content capture devices, using the determined one or more multimedia content capture devices to select the multimedia content source; or, according to Vision information and/or distance information, adjusting the location of one or more multimedia content capture devices, and selecting a multimedia content source using the adjusted one or more multimedia content capture devices.
  • the step of the immersive communication server acquiring the content view according to the content view selection information may include: generating a content view acquisition control instruction according to the content view selection information; transmitting the content view acquisition control instruction to the multimedia content capture device; receiving the returned by the multimedia content capture device a multimedia content source, wherein the multimedia content source is a multimedia content source selected by the multimedia content capture device according to the content view acquisition control instruction; and the content view is generated by using the multimedia content source.
  • Step S806 the immersive communication server returns the acquired content view to the immersive communication client.
  • the method may further include: the immersive communication server sends a content view update notification to the other immersive communication client, wherein the content view update notification carries the content view change information of the immersive communication client.
  • the immersive communication system can perform state collection and content source synchronization update corresponding to the current viewing field of the user, and realizes that according to the user's selection
  • the user provides a view of the content.
  • an immersive communication client requests to view a video source.
  • the immersive communication server captures the corresponding camera video, transmits, stitches the video image and displays it on the immersive communication client according to the default view of the video source.
  • the user adjusts the video source observation field according to the interest (remote control input, attitude detection), the immersive communication client collects relevant state parameters, and sends a content view update request to the immersive communication server.
  • Immersive communication server provides based on receiving requests and content
  • the configuration of the quotient (camera position, angle), refresh corresponding video source playback parameters (for example, camera identification, video frame and panorama mapping, etc.), determine the content of the video source corresponding to the content view request.
  • the immersive communication client receives the updated video source content of the View and displays it to the user.
  • the immersive communication system may include: an immersive communication client 100, an immersive communication server 200, and one or more video capture servers.
  • the video capture server 300 and the video capture server 400, and one or more cameras, in the embodiment of the present invention are cameras 310-340 and cameras 410-440.
  • the immersive communication client 100 is configured to provide the immersive communication service terminal side capability, detect the visual field change when the user views the content view, send the content view switching request to the immersive communication server 200, and detect the distance change when the user views the content view, to the immersive communication server 200. Sending a content view zoom request; and receiving a content view returned by the immersive communication server 200, and performing an immersive display.
  • the immersive communication client 100 includes the following functional modules: a visual field detection function module 110, a distance detection function module 120, and an immersive display function module 130.
  • the visual field detecting function module 110 is configured to detect a change of the visual field when the user views the content view, and the visual field refers to the display that the user can view when the position between the user's binocular and the display device (for example, the television screen and the projection screen) is relatively fixed.
  • the visual angle of the content view is being played on the device, that is, the field of view or field of view (FOV), including the horizontal view and the vertical view.
  • FOV field of view
  • the manner in which the visual field detecting function module 110 detects the change of the visual field of the user includes: (1) collecting a remote controller, a keyboard, etc., when the user inputs a field of view of the viewed content view using a remote device, a keyboard, or the like, such as: default view, previous Field of view, next field of view, etc., the field of view detection function module collects such input information as a change in user field of view.
  • the method when the user changes the field of view of the viewed content view using an input device such as a remote controller or a keyboard, the method includes: bidirectional (left to right, up and down) to enlarge or reduce the current field of view, one direction (left, right, up) , Down) Expand or reduce the current field of view, etc.
  • the field of view detection function module collects such input information as the user's field of view changes.
  • the visual field detection function module can track the user (head) posture, and then detect the user's visual field changes.
  • the above function based on user (head) attitude tracking to detect changes in the visual field of the user is initiated only when the system enters a specific business mode (for example, a somatosensory mode).
  • the user visual field change information obtained by the visual field detecting function module 110 at least includes: measuring visual angle information of the current user visual field, such as: horizontal direction angle, vertical direction angle; pre-set information identifying the current user field of view, for example: field of view number 1, field of view number 2 and so on.
  • the distance detecting function module 120 is configured to detect a distance change of a distance when the user views the content view, where the distance is that when the user views the view of the content being played on the display device, the user views the scene in the content view being played on the display device. Far and near.
  • the distance detecting function module 120 can set an upper limit and a lower limit of the distance.
  • the manner in which the distance detecting function module 120 detects the change of the user distance includes:
  • the distance detecting function module 120 collects Such input information varies as a user distance.
  • the distance detecting function module 120 collects such input information as the user distance. Variety.
  • the posture change is equipped with a specific module (for example, an infrared camera, a depth sensor), and the distance detection function module 120 can track the user (body) posture, thereby detecting the user distance change.
  • a specific module for example, an infrared camera, a depth sensor
  • the distance detection function module 120 can track the user (body) posture, thereby detecting the user distance change.
  • the above-described function of detecting user distance change based on user (body) attitude tracking is initiated only when the system enters a specific business mode (eg, a somatosensory mode).
  • the user distance change information obtained by the distance detecting function module 120 at least includes: measuring current user viewing position information, for example: location of the scene in the content view of the user; pre-setting information identifying the current user distance, such as: distance number 1, distance number 2 and so on.
  • the immersive display function module 130 is configured to display a content view received by the immersive communication client 100 to provide an immersive viewing experience for the user.
  • the immersive communication server 200 is configured to provide an immersive communication service network side capability, and the receiving immersive communication client 100 sends a content view switching request, and the video source is captured according to the requested visual field change parameter and generated after the switching
  • the receiving view is responsible for receiving the content view zoom request by the immersive communication client 100, capturing the video source according to the requested view zoom parameter, and generating the scaled content view. And sending a content view update notification to the immersive communication client 100 according to the subscription request.
  • the preferred immersive communication server 200 may include the following functional modules: a content view control function module 210, a video streaming function module 220, a video splicing rendering function module 230, and a communication media control function module 240.
  • the content view control function module 210 is configured to receive the content view switching request sent by the immersive communication client 100, generate a video source capture control instruction according to the requested visual field change parameter, and the content view control function module 210 sends the content view video source capture control request to the video.
  • the capture server 300 or the video capture server 400 processes the returned multi-video source video image to generate a switched content view.
  • the video stream transmission function module 220 is configured to receive the multiple video image media streams sent by the video capture server 300 or the video capture server 400, and aggregate them into one video media stream, and forwarded to the video mosaic rendering function module 230.
  • the video mosaic rendering function module 230 is configured to process a series of captured video streams with a small field of view (FOV), and the stitching produces a panoramic video stream with a large field of view (FOV), that is, a content view.
  • the communication media control function module 240 is configured to manage the content view update notification subscription request, and after the content view control function module 210 completes the content view update, send the content view update notification to the immersive communication client 100.
  • the video capture server 300 and the video capture server 400 are configured to perform multi-video source (camera) parameter calculation, start video capture, video frame encoding, time synchronization, etc. according to the content view video source capture control request.
  • Cameras 310-340 and cameras 410-440 are arranged to capture video images of fixed viewing positions.
  • the content view includes: a separate content view (ie, a video picture in a conventional sense), and a continuous content view (ie, a panoramic view, which is generated by splicing a plurality of separate content views).
  • FIG. 10 is a flowchart 1 of a content view switching method according to an embodiment of the present invention. As shown in FIG.
  • the method includes steps S1002 to S1006.
  • the immersive communication client detects that the visual field of the immersed communication user who is viewing the display device content view changes.
  • the immersive communication client can check the visual field change information by collecting user input such as a remote controller or a keyboard, or the immersive communication client can check the visual field change information by collecting the user (head) posture change.
  • Step S1004 The immersive communication client generates a content view switching request according to the detected user visual field change information, and sends the content view switching request to the immersive communication server.
  • Step S1006 The immersive communication client receives the content view after the change of the visual field returned by the immersive communication server, and performs immersion display.
  • FIG. 11 is a second flowchart of a content view switching method according to an embodiment of the present invention.
  • Step S1102 The immersive communication server receives the content view switching request sent by the immersive communication client.
  • Step S1104 The immersive communication server generates, according to the immersed communication user visual field change information carried in the content view switching request (for example, measuring the current user visual field angle information, or identifying preset information of the current user's visual field), and generating a content view for capturing the switched content. Control instructions for the video source.
  • Step S1106 The immersive communication server sends a content view video source capture control request to the video capture server according to the foregoing control instruction, instructing the video capture server to update the content view video source, and acquiring a video source corresponding to the changed view of the user.
  • the immersive communication server generates a switched content view according to the updated video source.
  • Step S1108, the immersive communication server returns the content view after the visual field change to the immersive communication client.
  • FIG. 12 is a flowchart 1 of a content view scaling method according to an embodiment of the present invention. As shown in FIG. 12, the method includes steps S1202 to S1206.
  • the immersive communication client detects that the distance of the immersed communication user who is viewing the content view of the display device changes.
  • the immersive communication client can check the distance change information by collecting user input such as a remote controller or a keyboard, or the immersive communication client can check the distance change information by collecting the user (body) posture change.
  • Step S1204 the immersive communication client generates a content view zoom request according to the detected user distance change information, and sends the content view zoom request to the immersive communication server.
  • Step S1206 The immersive communication client receives the changed content view returned by the immersive communication server, and performs immersive display.
  • FIG. 13 is a second flowchart of a content view scaling method according to an embodiment of the present invention. As shown in FIG. 13, the method includes steps S1302 to S1308.
  • Step S1302 The immersive communication server receives the content view zoom request sent by the immersive communication client.
  • Step S1304 The immersive communication server generates, according to the immersive communication user distance change information carried in the content view scaling request (for example, the current user viewing position information or the preset information of the current user distance), and generates the captured content view video.
  • Step S1306 The immersive communication server sends a content view video source capture control request to the video capture server according to the foregoing control instruction, instructing the video capture server to update the content view video source, and acquiring the video source corresponding to the changed user distance.
  • the immersive communication server generates a scaled content view based on the updated video source.
  • Step S1308, the immersive communication server returns the content view after the distance change to the immersive communication client.
  • FIG. 14 is a flowchart of a content view update notification method according to an embodiment of the present invention. As shown in FIG. 14, the method includes steps S1402 to S1410. In step S1402, the immersive communication server receives the content view update request sent by the immersive communication client.
  • the content view update request may be a content view switch request or a content view zoom request.
  • the immersive communication server performs content view update (switching or scaling) according to the content view update request. If the update is successful, step S1406 is performed, otherwise, it ends.
  • Step S1406 After the content view is successfully updated, the immersive communication server checks whether there is a subscription request for the immersive communication client content view update notification. It may be a subscription request sent by another immersive communication client of the same user, or may be a subscription request sent by another user immersed communication client, for example, other users located in the same immersed communication group.
  • Step S1408 if there is a subscription request, the immersive communication server sends a content view update notification to the subscribing immersive communication client, otherwise, it ends.
  • Step S1410 the subscriber immersive communication client further requests synchronization of the content view update according to the notification.
  • the above method of the embodiment of the present invention will be described below by way of specific examples.
  • Embodiment 1 The foregoing solution of the embodiment of the present invention is described in detail by taking a continuous content view as an example. In the embodiment of the present invention, the continuous content view switching request is used as a specific implementation manner of the content view update request.
  • FIG. 15 is a signaling flowchart of a content view updating method according to Embodiment 1 of the present invention. In combination with the signaling flow shown in FIG.
  • Step 1 The immersive communication client detects a change in the field of view of the immersive communication user who is viewing the continuous content view of the display device.
  • the immersive communication client generates a continuous content view switching request according to the detected user view change information, and sends it to the immersive communication server.
  • Step 2 The immersive communication server generates, according to the continuous content view switching request, the immersive communication user visual field change information (for example, measuring the current user visual field visual angle information, or identifying the current user visual field preset information), and generating the continuous content view for capturing the switching Control instructions for the video source.
  • the immersive communication server sends a continuous content view video source capture control request to the video capture server.
  • Step 3 The video capture server updates the continuous content view video source according to the continuous content view video source capture control request, and obtains a video image corresponding to the changed visual field of the user, including: video source (camera) parameter calculation, start video capture, video frame Encoding, time synchronization, etc.
  • the video capture server returns a control response response to the immersive communication server.
  • the immersive communication server returns a continuous content view switching response to the immersive communication client.
  • Step 5 The video capture server sends the video source media stream after the visual field change to the immersive communication server, and the immersive communication server performs the splicing of the multiple video source video images to generate the switched continuous content view.
  • the immersive communication server returns the scaled continuous content view to the immersive communication client.
  • FIG. 16 is a signaling flowchart of a content view updating method according to Embodiment 2 of the present invention.
  • the method includes Steps 1 to 6.
  • Step 1 The immersive communication client detects a change in the distance of the immersive communication user who is viewing the continuous content view of the display device.
  • the immersive communication client generates a continuous content view zoom request according to the detected user distance change information, and sends it to the immersive communication server.
  • Step 2 The immersive communication server generates, according to the immersed communication user distance change information carried by the request (for example, measuring current user viewing location information, or identifying current user distance preset information), generating a video content for capturing the scaled continuous content view video source. Control instruction.
  • the immersive communication server sends a continuous content view video source capture control request to the video capture server.
  • Step 3 The video capture server updates the continuous content view video source according to the continuous content view video source capture control request, and obtains the video image corresponding to the changed user distance, including: video source (camera) parameter calculation, start video capture, video frame Encoding, time synchronization, etc.
  • the video capture server returns a control response response to the immersive communication server.
  • the immersive communication server returns a continuous content view zoom response to the immersive communication client.
  • Step 5 The video capture server sends the distance-changed video source media stream to the immersive communication server, and the immersive communication server performs multi-video source video image splicing to generate the scaled continuous content view.
  • Step 6 The immersive communication server returns the scaled continuous content view to the immersive communication client.
  • FIG. 17 is a signaling flowchart of a content view updating method according to Embodiment 3 of the present invention. In combination with the signaling flow shown in FIG. 17, the method includes Steps 1 to 6. Step 1.
  • the immersive communication client A detects a change in the field of view or distance of the immersive communication user who is viewing the continuous content view of the display device.
  • the immersive communication client A sends a continuous content view update request (eg, a continuous content view switch request or a zoom request) to the immersive communication server.
  • Step 2 The immersive communication server controls the video capture server to acquire the video source according to the immersive communication user view or distance change information carried in the continuous content view update request, and generates an updated continuous content view.
  • the immersive communication server returns a response to the immersive communication client.
  • step 3 the immersive communication server returns the updated continuous content view, and the immersive communication client performs continuous content view immersive display.
  • the immersive communication server checks whether there is a subscription request for the immersive communication client continuous content view update notification.
  • the immersive communication server sends a continuous content view update notification to the subscriber immersive communication client B and the immersive communication client C.
  • step 5 the immersive communication clients B and C receive the notification and prompt the respective users to immerse the communication client A continuous content view update status. Based on the user selection, the immersive communication clients B and C respectively send a continuous content view synchronization update request to the immersive communication server.
  • step 6 the immersive communication server returns the updated continuous content views to the immersive communication clients B and C, respectively, and each performs immersive display.
  • the computing device may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.
  • an immersive communication client, a server, and a method for obtaining a content view provided by an embodiment of the present invention have the following beneficial effects:
  • the immersive communication client collects content view selection information of a user, and sends the content view information to the immersive communication server.
  • the content view obtaining request is used to request the immersive communication server to obtain the content view according to the content view selection information, so that the content view is provided according to the user's selection.

Abstract

本发明公开了一种沉浸通信客户端、服务器及获取内容视图的方法,其中,获取内容视图的方法包括:沉浸通信服务器接收沉浸通信客户端发送的内容视图获取请求(S802),其中,内容视图获取请求携带用户的内容视图选择信息;沉浸通信服务器根据内容视图选择信息获取内容视图(S804);沉浸通信服务器向沉浸通信客户端返回获取到的内容视图(S806)。通过本发明,实现了根据用户的选择提供内容视图。

Description

沉浸通信客户端、 服务器及获取内容视图的方法 技术领域 本发明涉及通信领域, 具体而言, 涉及一种沉浸通信客户端、 服务器及获取内容 视图的方法。 背景技术 作为下一代社交通信媒介, 远程沉浸(Tele-immersion)技术通过在虚拟环境中重 建物理场景, 允许地理上分布的用户之间远程协作、 交互, 正受到学术界、 工业界越 来越多的关注。 沉浸体验(Immersion)可以增加现实环境感知水平, 帮助实现从视频会议到娱乐 游戏等诸多多媒体应用的交互性。 一个重建的具备沉浸体验的虚拟环境可以为用户提 供宽视场 (FOV), 使得即便身处异地的用户也可以获得身临其境的视觉体验。 单摄像头的观察视角是有限的, 目前已出现基于多摄像头 (4-CCD) 全景图生成 和显示远程实时系统和应用, 提供水平 150°视场, 垂直 110°视场, 一定程度提升了视 频沉浸感。 然而在真实环境中, 用户可以自由变换观看场景(即, 内容视图), 不受固定观察 视野、 观察距离的局限。 一个体验良好的远程沉浸通信系统(譬如: 提供" being-there" and "being-with"沉浸体验) 应针对用户当前观察视野、 观察距离, 进行状态采集 (遥 控器输入、姿态检测), 并进行内容视图源同步更新, 以更好适应用户对于沉浸式通信 体验的需求, 而迄今该问题并没有得到充分研究和解决。 发明内容 针对相关技术中无法根据用户的选择, 为用户提供特定内容视图的问题, 本发明 实施例提供了一种沉浸通信客户端、 服务器及获取内容视图的方法, 以至少解决上述 问题。 根据本发明实施例的一个方面, 提供了一种获取内容视图的方法, 包括: 沉浸通 信客户端收集用户的内容视图选择信息; 沉浸通信客户端向沉浸通信服务器发送内容 视图获取请求, 其中, 内容视图获取请求用于请求沉浸通信服务器根据内容视图选择 信息获取内容视图。 优选地, 内容视图选择信息包括以下至少之一: 内容视图标识, 用于指示用户选 择的内容视图; 视野信息, 用于指示用户选择的内容视图观看角度; 距离信息, 用于 指示用户选择的内容视图观看距离。 优选地, 内容视图获取请求包括: 携带内容视图选择信息的内容视图更新请求, 用于请求沉浸通信服务器根据内容视图选择信息更新内容视图。 优选地, 沉浸通信客户端收集内容视图选择信息的步骤包括以下至少之一: 沉浸 通信客户端获取用户选择的内容视图标识, 作为内容视图选择信息; 沉浸通信客户端 获取用户选择的内容视图观看视野, 作为内容视图选择信息; 沉浸通信客户端获取用 户选择的内容视图观看距离, 作为内容视图选择信息。 优选地, 沉浸通信客户端收集内容视图选择信息的步骤包括: 检测用户通过输入 设备输入的控制信号, 根据控制信号获取内容视图选择信息; 和 /或, 检测用户的姿态 变化, 根据姿态变化获取内容视图选择信息。 优选地, 上述方法还包括: 沉浸通信客户端接收沉浸通信服务器发送的内容视图 更新通知, 其中, 内容视图更新通知携带其他沉浸通信客户端的内容视图变化信息。 优选地, 内容视图包括: 单独内容视图, 和 /或连续内容视图。 优选地,沉浸通信客户端向沉浸通信服务器发送内容视图获取请求之后,还包括: 所述沉浸通信客户端接收沉浸通信服务器返回的内容视图, 沉浸通信客户端显示内容 视图。 根据本发明实施例的另一个方面, 提供了一种获取内容视图的方法, 包括: 沉浸 通信服务器接收沉浸通信客户端发送的内容视图获取请求, 其中, 内容视图获取请求 携带用户的内容视图选择信息;沉浸通信服务器根据内容视图选择信息获取内容视图; 沉浸通信服务器向沉浸通信客户端返回获取到的内容视图。 优选地, 内容视图选择信息包括以下至少之一: 内容视图标识, 用于指示用户选 择的内容视图; 视野信息, 用于指示用户选择的内容视图观看角度; 距离信息, 用于 指示用户选择的内容视图观看距离。 优选地, 内容视图获取请求包括: 携带所述内容视图选择信息的内容视图更新请 求, 用于请求所述沉浸通信服务器根据所述内容视图选择信息更新所述内容视图。 优选地, 沉浸通信服务器根据内容视图选择信息获取内容视图的步骤, 包括: 沉 浸通信服务器根据内容视图选择信息中的内容视图标识, 获取内容视图; 或者, 所述 沉浸通信服务器根据所述内容视图选择信息中的视野信息和 /或距离信息, 获取所述内 容视图。 优选地, 沉浸通信服务器根据内容视图选择信息获取内容视图的步骤, 包括: 沉 浸通信服务器根据内容视图选择信息中的视野信息和 /或距离信息, 选择多媒体内容 源; 沉浸通信服务器利用多媒体内容源生成内容视图。 优选地, 选择多媒体内容源的步骤, 包括: 根据视野信息和 /或距离信息, 确定一 个或多个多媒体内容捕获装置, 利用一个或多个多媒体内容捕获装置选择多媒体内容 源; 或者,根据视野信息和 /或距离信息,调整一个或多个多媒体内容捕获装置的位置, 利用一个或多个多媒体内容捕获装置选择多媒体内容源。 优选地, 沉浸通信服务器根据内容视图选择信息获取内容视图的步骤, 包括: 根 据内容视图选择信息生成内容视图获取控制指令; 向多媒体内容捕获装置发送内容视 图获取控制指令; 接收多媒体内容捕获装置返回的多媒体内容源, 其中, 多媒体内容 源为多媒体内容捕获装置根据内容视图获取控制指令选择的多媒体内容源; 利用多媒 体内容源生成内容视图。 优选地, 上述方法还包括: 沉浸通信服务器向其他沉浸通信客户端发送内容视图 更新通知, 其中, 内容视图更新通知携带沉浸通信客户端的内容视图变化信息。 根据本发明实施例的又一个方面, 提供了一种沉浸通信客户端, 包括: 收集模块, 设置为收集用户的内容视图选择信息; 发送模块, 设置为向沉浸通信服务器发送内容 视图获取请求, 其中, 内容视图获取请求用于请求沉浸通信服务器根据内容视图选择 信息获取内容视图。 优选地, 上述客户端还包括: 显示模块, 设置为接收所述沉浸通信服务器反馈的 所述内容视图, 并显示所述内容视图。 优选地, 上述客户端还包括: 接收模块, 设置为接收沉浸通信服务器发送的内容 视图更新通知, 其中, 内容视图更新通知携带其他沉浸通信客户端的内容视图变化信 息。 优选地, 收集模块包括以下至少之一: 第一获取单元, 设置为获取用户选择的内 容视图标识, 作为内容视图选择信息, 其中, 内容视图标识用于指示用户选择的内容 视图; 第二获取单元, 设置为获取用户选择的视野信息, 作为内容视图选择信息, 其 中, 视野信息用于指示用户选择的内容视图观看角度; 第三获取单元, 设置为获取用 户选择的距离信息, 作为内容视图选择信息, 其中, 距离信息用于指示用户选择的内 容视图观看距离。 根据本发明实施例的又一个方面, 提供了一种沉浸通信服务器, 包括: 接收模块, 设置为接收沉浸通信客户端发送的内容视图获取请求, 其中, 内容视图获取请求携带 用户的内容视图选择信息; 获取模块, 设置为根据内容视图选择信息获取内容视图; 发送模块, 设置为向第一沉浸通信客户端返回获取到的内容视图。 优选地, 获取模块, 设置为根据内容视图选择信息中的内容视图标识获取内容视 图, 其中, 内容视图标识用于指示用户选择的内容视图。 优选地, 获取模块包括: 选择单元, 设置为根据内容视图选择信息中的视野信息 和 /或距离信息, 选择多媒体内容源, 其中, 视野信息用于指示用户选择的内容视图观 看角度, 距离信息用于指示用户选择的内容视图观看距离; 生成单元, 设置为利用多 媒体内容源生成内容视图。 优选地, 选择单元, 设置为根据视野信息和 /或距离信息, 确定一个或多个多媒体 内容捕获装置, 利用一个或多个多媒体内容捕获装置选择多媒体内容源; 或者, 设置 为根据视野信息和 /或距离信息, 调整一个或多个多媒体内容捕获装置的位置, 利用一 个或多个多媒体内容捕获装置选择多媒体内容源。 优选地, 获取模块包括: 指令生成单元, 设置为根据内容视图选择信息生成内容 视图获取控制指令; 发送单元, 设置为向多媒体内容捕获装置发送内容视图获取控制 指令; 接收单元, 设置为接收多媒体内容捕获装置返回的多媒体内容源, 其中, 多媒 体内容源为多媒体内容捕获装置根据内容视图获取控制指令选择的多媒体内容源; 内 容视图生成单元, 设置为利用多媒体内容源生成内容视图。 优选地, 上述服务器还包括: 通知模块, 设置为向其他沉浸通信客户端发送内容 视图更新通知, 其中, 内容视图更新通知携带上述沉浸通信客户端的内容视图变化信 息。 通过本发明实施例, 沉浸通信客户端收集用户的内容视图选择信息, 并向沉浸通 信服务器发送内容视图获取请求, 该内容视图获取请求用于请求沉浸通信服务器根据 内容视图选择信息获取内容视图, 实现了根据用户的选择提供内容视图。 附图说明 此处所说明的附图用来提供对本发明的进一步理解, 构成本申请的一部分, 本发 明的示意性实施例及其说明用于解释本发明, 并不构成对本发明的不当限定。 在附图 中- 图 1是根据本发明实施例的沉浸通信客户端的结构框图; 图 2是根据本发明实施例优选的沉浸通信客户端的结构框图; 图 3是根据本发明实施例优选的收集模块的结构框图; 图 4是根据本发明实施例的沉浸通信服务器的结构框图; 图 5是根据本发明实施例优选的获取模块的结构框图一; 图 6是根据本发明实施例优选的获取模块的结构框图二; 图 7是根据本发明实施例的获取内容视图的方法的流程图一; 图 8是根据本发明实施例的获取内容视图的方法的流程图二; 图 9是根据本发明实施例优选的沉浸式通信系统的示意图; 图 10是根据本发明实施例的内容视图切换方法的流程图一; 图 11是根据本发明实施例的内容视图切换方法的流程图二; 图 12是根据本发明实施例的内容视图缩放方法的流程图一; 图 13是根据本发明实施例的内容视图缩放方法的流程图二; 图 14是根据本发明实施例的内容视图更新通知方法的流程图; 图 15是根据本发明实施例一的内容视图更新方法的信令流程图; 图 16是根据本发明实施例二的内容视图更新方法的信令流程图; 以及 图 17是根据本发明实施例三的内容视图更新方法的信令流程图。 具体实施方式 下文中将参考附图并结合实施例来详细说明本发明。 需要说明的是, 在不冲突的 情况下, 本申请中的实施例及实施例中的特征可以相互组合。 根据本发明实施例, 提供了一种沉浸通信客户端、 沉浸通信服务器, 以及获取内 容视图的方法。 下面分别对本发明实施例的各个方面进行描述。 图 1是根据本发明实施例的沉浸通信客户端的结构框图, 如图 1所示, 该沉浸通 信客户端主要包括: 收集模块 10和发送模块 12。 其中, 收集模块 10, 设置为收集用 户的内容视图选择信息; 发送模块 12, 与收集模块 10相连接, 设置为向沉浸通信服 务器发送内容视图获取请求, 其中, 内容视图获取请求用于请求沉浸通信服务器根据 内容视图选择信息获取内容视图。 图 2是根据本发明实施例优选的沉浸通信客户端的结构框图, 如图 2所示, 本发 明实施例的沉浸通信客户端还可以包括: 显示模块 14, 设置为接收沉浸通信服务器反 馈的内容视图, 并显示接收到的内容视图。 在本发明实施例的一个实施方式中, 上述沉浸通信客户端还可以包括: 接收模块, 设置为接收沉浸通信服务器发送的内容视图更新通知, 其中, 内容视图更新通知携带 其他沉浸通信客户端的内容视图变化信息。 图 3是根据本发明实施例优选的收集模块的结构框图, 如图 3所示, 收集模块 10 可以包括以下至少之一: 第一获取单元 102, 设置为获取用户选择的内容视图标识, 作为内容视图选择信息, 其中, 内容视图标识用于指示用户选择的内容视图; 第二获 取单元 104, 设置为获取用户选择的视野信息, 作为内容视图选择信息, 其中, 视野 信息用于指示用户选择的内容视图观看角度; 第三获取单元 106, 设置为获取用户选 择的距离信息, 作为内容视图选择信息, 其中, 距离信息用于指示用户选择的内容视 图观看距离。 在本发明实施例中, 收集模块 10可以检测用户通过输入设备输入的控制信号,根 据控制信号获取内容视图选择信息; 和 /或, 检测用户的姿态变化, 根据姿态变化获取 内容视图选择信息。 在本发明实施例中, 收集模块 10可以接收用户输入的内容视图标识, 例如, 通过 遥控器、 键盘、 触敏显示器等输入设备输入的视图标识以及内容视图观看角度和 /或内 容视图观看距离, 向沉浸通信服务器请求用户选择的内容视图。收集模块 10还可以检 测用户的姿态变化, 获取到内容视图观看角度和 /或内容视图观看距离的变化。 沉浸通信客户端还可以接收沉浸通信服务器反馈的用户选择的内容视图, 通过显 示设备向用户显示用户选择的内容视图。 当然, 沉浸通信服务器可以根据沉浸通信客 户端的内容视图获取请求获取内容视图。 下面对本发明实施例优选的沉浸通信服务器 进行描述。 图 4是根据本发明实施例的沉浸通信服务器的结构框图, 如图 4所示, 该服务器 主要包括: 接收模块 40、 获取模块 42和发送模块 44。 其中, 接收模块 40, 设置为接 收沉浸通信客户端发送的内容视图获取请求, 其中, 内容视图获取请求携带用户的内 容视图选择信息; 获取模块 42, 与接收模块 40相连接, 设置为根据内容视图选择信 息获取内容视图; 发送模块 44, 与获取模块 42相连接, 设置为向沉浸通信客户端返 回获取到的内容视图。 在本发明实施例的一个实施方式中, 获取模块 42, 设置为根据内容视图选择信息 中的内容视图标识获取内容视图,其中, 内容视图标识用于指示用户选择的内容视图。 或者, 获取模块 42, 设置为根据内容视图选择信息中的视野信息和 /或距离信息, 获取 内容视图。 图 5是根据本发明实施例优选的获取模块的结构框图一, 如图 5所示, 获取模块 42可以包括: 选择单元 420, 设置为根据内容视图选择信息中的视野信息和 /或距离信 息, 选择多媒体内容源, 其中, 视野信息用于指示用户选择的内容视图观看角度, 距 离信息用于指示用户选择的内容视图观看距离; 生成单元 422, 设置为利用选择的多 媒体内容源生成内容视图。 优选的, 在本发明实施例的一个实施方式中, 选择单元 420, 设置为根据视野信 息和 /或距离信息, 确定一个或多个多媒体内容捕获装置, 利用确定的一个或多个多媒 体内容捕获装置选择多媒体内容源。 或者, 选择单元 420, 设置为根据视野信息和 /或 距离信息, 调整一个或多个多媒体内容捕获装置的位置, 利用调整后的一个或多个多 媒体内容捕获装置选择多媒体内容源。 例如, 可以在不同的位置设置多媒体内容捕获装置, 由不同位置的多媒体内容捕 获装置获取的多媒体内容源生成用户观看的内容视图。 而在仅设置一个多媒体内容捕 获装置的情况下, 则可以通过调整多媒体内容捕获装置的位置来获取用户请求的内容 视图。 图 6是根据本发明实施例优选的获取模块的结构框图二, 如图 6所示, 获取模块 42可以包括: 指令生成单元 424, 设置为根据内容视图选择信息生成内容视图获取控 制指令; 发送单元 426, 设置为向多媒体内容捕获装置发送内容视图获取控制指令; 接收单元 428, 设置为接收多媒体内容捕获装置返回的多媒体内容源, 其中, 多媒体 内容源为多媒体内容捕获装置根据内容视图获取控制指令选择的多媒体内容源; 内容 视图生成单元 429, 设置为利用多媒体内容源生成内容视图。 在本发明实施例的一个实施方式中, 沉浸通信服务器还可以包括: 通知模块, 设 置为向其他沉浸通信客户端发送内容视图更新通知, 其中, 内容视图更新通知携带沉 浸通信客户端的内容视图变化信息。 其他沉浸通信客户端可以根据内容视图更新通知 获取更新后的内容视图, 在实际应用中, 可以根据运营策略设置发送内容视图更新通 知的沉浸通信客户端, 例如, 观看同一对媒体内容源的沉浸通信客户端等。 下面对本发明实施例的获取内容视图的方法进行描述。 图 7是根据本发明实施例的获取内容视图的方法的流程图一, 如图 7所示, 该方 法主要包括步骤 S702至步骤 S704。 步骤 S702, 沉浸通信客户端收集用户的内容视图选择信息。 在本发明实施例的一个实施方式中, 内容视图选择信息包括但不限于以下至少之 一: 内容视图标识, 用于指示用户选择的内容视图; 视野信息, 用于指示用户选择的 内容视图观看角度; 距离信息, 用于指示用户选择的内容视图观看距离。 例如, 可以 设置内容视图与内容视图标识的对应关系, 通过内容视图标识指示相应的内容视图。 优选的, 沉浸通信客户端收集内容视图选择信息的步骤包括但不限于以下至少之 一: 沉浸通信客户端获取用户选择的内容视图标识, 作为内容视图选择信息; 沉浸通 信客户端获取用户选择的内容视图观看视野, 作为内容视图选择信息; 沉浸通信客户 端获取用户选择的内容视图观看距离, 作为内容视图选择信息。 在本发明实施例中,沉浸通信客户端可以检测用户通过输入设备输入的控制信号, 根据控制信号获取内容视图选择信息; 和 /或, 检测用户的姿态变化, 根据姿态变化获 取内容视图选择信息。 在本发明实施例中, 沉浸通信客户端可以接收用户输入的内容视图标识, 例如, 通过遥控器、 键盘、 触敏显示器等输入设备输入的视图标识以及内容视图观看角度和 / 或内容视图观看距离, 向沉浸通信服务器请求用户选择的内容视图。 沉浸通信客户端 还可以检测用户的姿态变化, 获取到内容视图观看角度和 /或内容视图观看距离的变 化。 步骤 S702, 沉浸通信客户端向沉浸通信服务器发送内容视图获取请求, 其中, 内 容视图获取请求用于请求沉浸通信服务器根据内容视图选择信息获取内容视图。 在本发明实施例的一个实施方式中, 内容视图获取请求包括: 携带内容视图选择 信息的内容视图更新请求, 用于请求沉浸通信服务器根据内容视图选择信息更新内容 视图。 在实际应用中, 在用户发起沉浸通信时, 可以发送请求获取内容视图, 在沉浸 通信过程中, 可以发送内容视图更新请求, 更新正在观看的内容视图, 例如, 内容视 图切换请求或内容视图缩放请求等。 在本发明实施例的一个优选实施方式中, 沉浸通信客户端还可以接收沉浸通信服 务器反馈的内容视图, 并显示接收到的内容视图。 在本发明实施例的一个优选实施方式中, 沉浸通信客户端还可以接收沉浸通信服 务器发送的内容视图更新通知, 其中, 内容视图更新通知携带其他沉浸通信客户端的 内容视图变化信息。 沉浸通信客户端可以根据内容视图更新通知选择是否获取更新后 的内容视图。 在实际应用中, 内容视图可以包括: 单独内容视图 (例如, 传统意义上的视频画 面)、 和 /或连续内容视图 (例如, 全景图, 由多个单独内容视图拼接生成)。 图 8是根据本发明实施例的获取内容视图的方法的流程图二, 如图 8所示, 该方 法主要包括步骤 S802至步骤 S806。 步骤 S802,沉浸通信服务器接收沉浸通信客户端发送的内容视图获取请求,其中, 内容视图获取请求携带用户的内容视图选择信息。 在本发明实施例的一个实施方式中, 内容视图选择信息包括以下至少之一: 内容 视图标识, 用于指示用户选择的内容视图; 视野信息, 用于指示用户选择的内容视图 观看角度; 距离信息, 用于指示用户选择的内容视图观看距离。 在本发明实施例的一个实施方式中, 内容视图获取请求包括: 携带内容视图选择 信息的内容视图更新请求, 用于请求沉浸通信服务器根据内容视图选择信息更新内容 视图。 在实际应用中, 在用户发起沉浸通信时, 可以发送请求获取内容视图, 在沉浸 通信过程中, 可以发送内容视图更新请求, 更新正在观看的内容视图, 例如, 内容视 图切换请求或内容视图缩放请求等。 步骤 S804, 沉浸通信服务器根据内容视图选择信息获取内容视图。 在本发明实施例的一个实施方式中, 沉浸通信服务器根据内容视图选择信息获取 内容视图的步骤可以包括: 沉浸通信服务器根据内容视图选择信息中的内容视图标识 获取内容视图; 或者, 沉浸通信服务器根据内容视图选择信息中的视野信息和 /或距离 信息, 获取内容视图。 例如, 可以预先设置内容视图与内容视图标识的对应关系, 沉 浸通信服务器获取与用户选择的内容视图标识对应的内容视图。 在本发明实施例的另一个实施方式中, 沉浸通信服务器根据内容视图选择信息获 取内容视图的步骤可以包括: 沉浸通信服务器根据内容视图选择信息中的视野信息和 / 或距离信息, 选择多媒体内容源, 利用选择的多媒体内容源生成内容视图。 优选的, 选择多媒体内容源的步骤可以包括: 根据视野信息和 /或距离信息, 确定 一个或多个多媒体内容捕获装置, 利用确定的一个或多个多媒体内容捕获装置选择多 媒体内容源; 或者, 根据视野信息和 /或距离信息, 调整一个或多个多媒体内容捕获装 置的位置, 利用调整后的一个或多个多媒体内容捕获装置选择多媒体内容源。 优选地, 沉浸通信服务器根据内容视图选择信息获取内容视图的步骤可以包括: 根据内容视图选择信息生成内容视图获取控制指令; 向多媒体内容捕获装置发送内容 视图获取控制指令; 接收多媒体内容捕获装置返回的多媒体内容源, 其中, 多媒体内 容源为多媒体内容捕获装置根据内容视图获取控制指令选择的多媒体内容源; 利用多 媒体内容源生成内容视图。 步骤 S806, 沉浸通信服务器向沉浸通信客户端返回获取到的内容视图。 在本发明实施例的一个实施方式中, 上述方法还可以包括: 沉浸通信服务器向其 他沉浸通信客户端发送内容视图更新通知, 其中, 内容视图更新通知携带沉浸通信客 户端的内容视图变化信息。 通过应用本发明实施例, 沉浸通信系统(例如, 提供" being-there" and "being-with" 沉浸体验) 可以对应用户当前观察视野进行状态采集和内容源同步更新, 实现了根据 用户的选择为用户提供内容视图。 例如,沉浸通信客户端请求观看视频源。沉浸通信服务器根据该视频源默认视图, 捕获对应摄像头视频, 传输、 拼接视频图像并在沉浸通信客户端显示。 用户根据兴趣 调整视频源观察视野 (遥控器输入、 姿态检测), 沉浸通信客户端收集相关状态参数, 发送内容视图更新请求至沉浸通信服务器。 沉浸通信服务器根据接收请求和内容提供 商的配置 (摄像机位置、 角度), 刷新对应视频源播放参数(例如, 摄像机标识、 视频 帧与全景图映射等),确定内容视图请求对应的视频源内容。沉浸通信客户端接收 View 更新后的视频源内容, 并显示给用户。 下面对本发明实施例的上述方案进行详细描述。 图 9是根据本发明实施例优选的沉浸式通信系统的示意图, 如图 9所示, 该沉浸 式通信系统可以包括: 沉浸通信客户端 100、 沉浸通信服务器 200和一个或多个视频 捕获服务器, 在本发明实施例中为视频捕获服务器 300和视频捕获服务器 400, 以及 一个或多个摄像机, 在本发明实施例中为摄像机 310-340和摄像机 410-440。 沉浸通信客户端 100, 设置为提供沉浸通信业务终端侧能力, 检测用户观看内容 视图时视野变化, 向沉浸通信服务器 200发送内容视图切换请求; 检测用户观看内容 视图时距离变化, 向沉浸通信服务器 200发送内容视图缩放请求; 以及接收沉浸通信 服务器 200返回的内容视图, 并进行沉浸显示。 优选的, 沉浸通信客户端 100包括以下功能模块: 视野检测功能模块 110、 距离 检测功能模块 120和沉浸显示功能模块 130。 视野检测功能模块 110, 设置为检测用户观看内容视图时视野的变化, 视野是指 用户双目与显示设备 (譬如: 电视机屏幕、 投影屏幕) 之间位置相对固定时, 用户可 以观看到的显示设备上正在播放内容视图的视觉角度, 即视野或视场 (Field ofView, 简称为 FOV), 包括水平方向视野和垂直方向视野。 视野检测功能模块 110检测用户视野变化的方式包括: ( 1 ) 采集遥控器、 键盘等用户输入 用户使用遥控器、 键盘等输入设备选择其所观看内容视图的视野时, 譬如: 默认 视野、 上一个视野、 下一个视野等, 视野检测功能模块采集此类输入信息作为用户视 野变化。 或者, 用户使用遥控器、 键盘等输入设备改变其所观看内容视图的视野时, 包括: 双向 (向左向右, 向上向下)扩大或缩小当前视野、 单向 (向左, 向右, 向上, 向下) 扩大或缩小当前视野等, 视野检测功能模块采集此类输入信息作为用户视野变 化。
(2) 采集用户 (头部) 姿态变化 配备特定模块(譬如: 红外摄像头、 深度传感器), 视野检测功能模块可以跟踪用 户 (头部) 姿态, 进而检测用户视野变化。 优选的, 仅在系统进入特定业务模式 (譬 如: 体感模式) 时启动上述基于用户 (头部) 姿态跟踪检测用户视野变化的功能。 视野检测功能模块 110所获得的用户视野变化信息至少包括: 衡量当前用户视野 视觉角度信息, 譬如: 水平方向角度、 垂直方向角度; 标识当前用户视野的预先设置 信息, 譬如: 视野编号 1、 视野编号 2等。 距离检测功能模块 120, 设置为检测用户观看内容视图时距离的远近变化, 该距 离是指用户观看显示设备上正在播放内容视图的视野相对固定时, 用户观看显示设备 上正在播放内容视图中场景的远近程度。 优选地, 距离检测功能模块 120可以设置距 离上限和下限。 距离检测功能模块 120检测用户距离变化的方式包括:
( 1 ) 采集遥控器、 键盘等用户输入 用户使用遥控器、 键盘等输入设备选择其所观看内容视图的距离时, 譬如: 默认 距离、 上一个距离、 下一个距离等, 距离检测功能模块 120采集此类输入信息作为用 户距离变化。 或者, 用户使用遥控器、 键盘等输入设备改变其所观看内容视图的距离 时, 包括向前减小观看距离、 向后增大观看距离等, 距离检测功能模块 120采集此类 输入信息作为用户距离变化。
(2) 采集用户 (身体) 姿态变化 配备特定模块(譬如: 红外摄像头、 深度传感器), 距离检测功能模块 120可以跟 踪用户 (身体) 姿态, 进而检测用户距离变化。 优选地, 仅在系统进入特定业务模式 (譬如: 体感模式)时启动上述基于用户 (身体)姿态跟踪检测用户距离变化的功能。 距离检测功能模块 120所获得的用户距离变化信息至少包括: 衡量当前用户观看 位置信息, 譬如: 用户在内容视图中场景的位置; 标识当前用户距离的预先设置信息, 譬如: 距离编号 1、 距离编号 2等。 沉浸显示功能模块 130, 设置为显示沉浸通信客户端 100接收到的内容视图, 为 用户提供沉浸式观赏体验。 沉浸通信服务器 200, 设置为提供沉浸通信业务网络侧能力, 接收沉浸通信客户 端 100发送内容视图切换请求, 根据请求中视野变化参数捕获视频源并生成切换后内 容视图; 负责接收沉浸通信客户端 100发送内容视图缩放请求, 根据请求中视图缩放 参数捕获视频源并生成缩放后内容视图。 以及根据订阅请求, 发送内容视图更新通知 至沉浸通信客户端 100。 优选的沉浸通信服务器 200可以包括以下功能模块: 内容视图控制功能模块 210、 视频流传输功能模块 220、 视频拼接渲染功能模块 230和通信媒体控制功能模块 240。 内容视图控制功能模块 210, 设置为接收沉浸通信客户端 100发送内容视图切换 请求,根据请求中视野变化参数生成视频源捕获控制指令,内容视图控制功能模块 210 发送内容视图视频源捕获控制请求至视频捕获服务器 300或视频捕获服务器 400, 并 处理返回的多视频源视频图像生成切换后内容视图。 视频流传输功能模块 220,设置为接收视频捕获服务器 300或视频捕获服务器 400 发送的多路视频图像媒体流, 汇聚成一路视频媒体流, 转发至视频拼接渲染功能模块 230。 视频拼接渲染功能模块 230, 设置为处理一系列捕获到的具有较小视野 (FOV) 的视频流, 拼接产生一个的具有较大视野 (FOV) 的全景视频流, 即内容视图。 通信媒体控制功能模块 240, 设置为管理内容视图更新通知订阅请求, 并在内容 视图控制功能模块 210完成内容视图更新后, 发送内容视图更新通知至沉浸通信客户 端 100。 视频捕获服务器 300和视频捕获服务器 400, 设置为根据内容视图视频源捕获控 制请求, 进行多视频源 (摄像机) 参数计算, 启动视频捕获, 视频帧编码、 时间同步 等。 摄像机 310-340和摄像机 410-440, 设置为采集固定观察位置的视频图像。 在本发明实施例中, 内容视图包括:单独内容视图(即,传统意义上的视频画面)、 连续内容视图 (即, 全景图, 由多个单独内容视图拼接生成)。 下面对本发明实施例的方法进行详细描述。 图 10是根据本发明实施例的内容视图切换方法的流程图一, 如图 10所示, 该方 法包括步骤 S1002至步骤 S1006。 步骤 S1002, 沉浸通信客户端检测到正在观看显示设备内容视图的沉浸通信用户 的视野发生变化。 沉浸通信客户端可以通过采集遥控器、 键盘等用户输入检查到视野变化信息, 或 者, 沉浸通信客户端可以通过采集用户 (头部) 姿态变化检查视野变化信息。 步骤 S1004, 沉浸通信客户端根据检测到的用户视野变化信息, 生成内容视图切 换请求, 发送至沉浸通信服务器。 步骤 S1006,沉浸通信客户端接收沉浸通信服务器返回的视野变化后的内容视图, 并进行沉浸显示。 图 11是根据本发明实施例的内容视图切换方法的流程图二, 如图 11所示, 该方 法包括步骤 S1102至步骤 S1108。 步骤 S1102, 沉浸通信服务器接收沉浸通信客户端发送的内容视图切换请求。 步骤 S1104, 沉浸通信服务器根据内容视图切换请求中携带的沉浸通信用户视野 变化信息 (例如, 衡量当前用户视野视觉角度信息, 或者标识当前用户视野的预先设 置信息), 生成用于捕获切换后内容视图视频源的控制指令。 步骤 S1106, 沉浸通信服务器根据上述控制指令, 向视频捕获服务器发送内容视 图视频源捕获控制请求, 指示视频捕获服务器更新内容视图视频源, 获取对应于用户 视野变化后的视频源。 沉浸通信服务器根据更新后视频源生成切换后的内容视图。 步骤 S1108, 沉浸通信服务器向沉浸通信客户端返回视野变化后的内容视图。 图 12是根据本发明实施例的内容视图缩放方法的流程图一, 如图 12所示, 该方 法包括步骤 S1202至步骤 S1206。 步骤 S1202, 沉浸通信客户端检测到正在观看显示设备内容视图的沉浸通信用户 的距离发生变化。 沉浸通信客户端可以通过采集遥控器、键盘等用户输入检查距离变化信息, 或者, 沉浸通信客户端可以通过采集用户 (身体) 姿态变化检查距离变化信息。 步骤 S1204, 沉浸通信客户端根据检测到的用户距离变化信息, 生成内容视图缩 放请求, 发送至沉浸通信服务器。 步骤 S1206,沉浸通信客户端接收沉浸通信服务器返回的距离变化后的内容视图, 并进行沉浸显示。 图 13是根据本发明实施例的内容视图缩放方法的流程图二, 如图 13所示, 该方 法包括步骤 S1302至步骤 S1308。 步骤 S1302, 沉浸通信服务器接收沉浸通信客户端发送的内容视图缩放请求。 步骤 S1304, 沉浸通信服务器根据内容视图缩放请求中携带的沉浸通信用户距离 变化信息 (例如, 衡量当前用户观看位置信息, 或者标识当前用户距离的预先设置信 息), 生成用于捕获缩放后内容视图视频源的控制指令。 步骤 S1306, 沉浸通信服务器根据上述控制指令, 向视频捕获服务器发送内容视 图视频源捕获控制请求, 指示视频捕获服务器更新内容视图视频源, 获取对应于用户 距离变化后的视频源。 沉浸通信服务器根据更新后视频源生成缩放后的内容视图。 步骤 S1308, 沉浸通信服务器向沉浸通信客户端返回距离变化后的内容视图。 图 14是根据本发明实施例的内容视图更新通知方法的流程图, 如图 14所示, 该 方法包括步骤 S1402至步骤 S1410。 步骤 S1402, 沉浸通信服务器接收沉浸通信客户端发送的内容视图更新请求, 在 本发明实施例中,内容视图更新请求可以是内容视图切换请求或者内容视图缩放请求。 步骤 S1404, 沉浸通信服务器根据内容视图更新请求进行内容视图更新 (切换或 者缩放), 如果更新成功, 执行步骤 S1406, 否则, 结束。 步骤 S1406, 内容视图更新成功后, 沉浸通信服务器检查是否存在针对沉浸通信 客户端内容视图更新通知的订阅请求。 可以是同一位用户其他沉浸通信客户端发送的 订阅请求, 也可以是其他用户沉浸通信客户端发送的订阅请求, 例如, 位于同一沉浸 通信群组中其他用户。 步骤 S1408, 如果存在订阅请求, 则沉浸通信服务器向订阅方沉浸通信客户端发 送内容视图更新通知, 否则, 结束。 步骤 S1410, 订阅方沉浸通信客户端根据通知进一步请求同步内容视图更新。 下面通过具体实例对本发明实施例的上述方法进行描述。 实施例一 根据本发明实施例, 以连续内容视图为例对本发明实施例的上述方案进行详细描 述。 在本发明实施例中, 连续内容视图切换请求作为内容视图更新请求的一种具体实 施方式。 图 15是根据本发明实施例一的内容视图更新方法的信令流程图, 结合图 15所示 的信令流程, 该方法包括步骤 1至步骤 6。 步骤 1, 沉浸通信客户端检测到正在观看显示设备连续内容视图的沉浸通信用户 的视野发生变化。 沉浸通信客户端根据检测到的用户视野变化信息, 生成连续内容视 图切换请求, 发送至沉浸通信服务器。 步骤 2, 沉浸通信服务器根据连续内容视图切换请求携带的沉浸通信用户视野变 化信息 (例如, 衡量当前用户视野视觉角度信息, 或者标识当前用户视野预先设置信 息), 生成用于捕获切换后连续内容视图视频源的控制指令。沉浸通信服务器向视频捕 获服务器发送连续内容视图视频源捕获控制请求。 步骤 3, 视频捕获服务器根据连续内容视图视频源捕获控制请求, 更新连续内容 视图视频源, 获取对应于用户视野变化后的视频图像, 包括: 视频源 (摄像机) 参数 计算、 启动视频捕获, 视频帧编码、 时间同步等。 视频捕获服务器向沉浸通信服务器 返回控制响应应答。 步骤 4, 沉浸通信服务器向沉浸通信客户端返回连续内容视图切换应答。 步骤 5, 视频捕获服务器向沉浸通信服务器发送视野变化后视频源媒体流, 沉浸 通信服务器进行多视频源视频图像拼接生成切换后的连续内容视图。 步骤 6, 沉浸通信服务器向沉浸通信客户端返回缩放后连续内容视图。 实施例二 根据本发明实施例, 以连续内容视图为例对本发明实施例的上述方案进行详细描 述。 在本发明实施例中, 连续内容视图缩放请求作为内容视图更新请求的一种具体实 施方式。 图 16是根据本发明实施例二的内容视图更新方法的信令流程图, 结合图 16所示 的信令流程, 该方法包括步骤 1至步骤 6。 步骤 1, 沉浸通信客户端检测到正在观看显示设备连续内容视图的沉浸通信用户 的距离发生变化。 沉浸通信客户端根据检测到的用户距离变化信息, 生成连续内容视 图缩放请求, 发送至沉浸通信服务器。 步骤 2, 沉浸通信服务器根据所述请求携带的沉浸通信用户距离变化信息(例如, 衡量当前用户观看位置信息, 或者标识当前用户距离预先设置信息), 生成用于捕获缩 放后连续内容视图视频源的控制指令。 沉浸通信服务器向视频捕获服务器发送连续内 容视图视频源捕获控制请求。 步骤 3, 视频捕获服务器根据连续内容视图视频源捕获控制请求, 更新连续内容 视图视频源, 获取对应于用户距离变化后的视频图像, 包括: 视频源 (摄像机) 参数 计算、 启动视频捕获, 视频帧编码、 时间同步等。 视频捕获服务器向沉浸通信服务器 返回控制响应应答。 步骤 4, 沉浸通信服务器向沉浸通信客户端返回连续内容视图缩放应答。 步骤 5, 视频捕获服务器向沉浸通信服务器发送距离变化后视频源媒体流, 沉浸 通信服务器进行多视频源视频图像拼接生成缩放后的连续内容视图。 步骤 6, 沉浸通信服务器向沉浸通信客户端返回缩放后连续内容视图。 实施例三 图 17是根据本发明实施例三的内容视图更新方法的信令流程图, 结合图 17所示 的信令流程, 该方法包括步骤 1至步骤 6。 步骤 1, 沉浸通信客户端 A检测到正在观看显示设备连续内容视图的沉浸通信用 户的视野或者距离发生变化。 沉浸通信客户端 A发送连续内容视图更新请求 (例如, 连续内容视图切换请求或者缩放请求) 至沉浸通信服务器。 步骤 2, 沉浸通信服务器根据连续内容视图更新请求携带的沉浸通信用户视野或 者距离变化信息, 控制视频捕获服务器获取视频源, 生成更新后连续内容视图。 沉浸 通信服务器返回响应至沉浸通信客户端。 步骤 3, 沉浸通信服务器返回更新后连续内容视图, 沉浸通信客户端进行连续内 容视图沉浸显示。 步骤 4, 沉浸通信服务器检查是否存在针对沉浸通信客户端连续内容视图更新通 知的订阅请求。沉浸通信服务器向订阅方沉浸通信客户端 B和沉浸通信客户端 C发送 连续内容视图更新通知。 步骤 5, 沉浸通信客户端 B和 C接收通知, 并向各自用户提示沉浸通信客户端 A 连续内容视图更新状态。根据用户选择, 沉浸通信客户端 B和 C分别向沉浸通信服务 器发送连续内容视图同步更新请求。 步骤 6,沉浸通信服务器分别向沉浸通信客户端 B和 C返回更新后连续内容视图, 各自进行沉浸显示。 显然, 本领域的技术人员应该明白, 上述的本发明的各模块或各步骤可以用通用 的计算装置来实现, 它们可以集中在单个的计算装置上, 或者分布在多个计算装置所 组成的网络上, 可选地, 它们可以用计算装置可执行的程序代码来实现, 从而, 可以 将它们存储在存储装置中由计算装置来执行, 并且在某些情况下, 可以以不同于此处 的顺序执行所示出或描述的步骤, 或者将它们分别制作成各个集成电路模块, 或者将 它们中的多个模块或步骤制作成单个集成电路模块来实现。 这样, 本发明不限制于任 何特定的硬件和软件结合。 以上所述仅为本发明的优选实施例而已, 并不用于限制本发明, 对于本领域的技 术人员来说, 本发明可以有各种更改和变化。 凡在本发明的精神和原则之内, 所作的 任何修改、 等同替换、 改进等, 均应包含在本发明的保护范围之内。
工业实用性 如上所述, 本发明实施例提供的一种沉浸通信客户端、 服务器及获取内容视 图的方法具有以下有益效果: 沉浸通信客户端收集用户的内容视图选择信息, 并向 沉浸通信服务器发送内容视图获取请求, 该内容视图获取请求用于请求沉浸通信服 务器根据内容视图选择信息获取内容视图, 实现了根据用户的选择提供内容视图。

Claims

权 利 要 求 书
1. 一种获取内容视图的方法, 包括:
沉浸通信客户端收集用户的内容视图选择信息;
所述沉浸通信客户端向沉浸通信服务器发送内容视图获取请求, 其中, 所 述内容视图获取请求用于请求所述沉浸通信服务器根据所述内容视图选择信息 获取内容视图。
2. 根据权利要求 1所述的方法,其中,所述内容视图选择信息包括以下至少之一:
内容视图标识, 用于指示所述用户选择的内容视图;
视野信息, 用于指示所述用户选择的内容视图观看角度;
距离信息, 用于指示所述用户选择的内容视图观看距离。
3. 根据权利要求 2所述的方法, 其中, 所述内容视图获取请求包括: 携带所述内 容视图选择信息的内容视图更新请求, 用于请求所述沉浸通信服务器根据所述 内容视图选择信息更新所述内容视图。
4. 根据权利要求 1至 3中任一项所述的方法, 其中, 所述沉浸通信客户端收集所 述内容视图选择信息的步骤包括以下至少之一:
所述沉浸通信客户端获取所述用户选择的内容视图标识, 作为所述内容视 图选择信息;
所述沉浸通信客户端获取所述用户选择的内容视图观看视野, 作为所述内 容视图选择信息;
所述沉浸通信客户端获取所述用户选择的内容视图观看距离, 作为所述内 容视图选择信息。
5. 根据权利要求 1至 3中任一项所述的方法, 其中, 所述沉浸通信客户端收集所 述内容视图选择信息的步骤包括:
检测所述用户通过输入设备输入的控制信号, 根据所述控制信号获取所述 内容视图选择信息; 和 /或
检测所述用户的姿态变化,根据所述姿态变化获取所述内容视图选择信息。
6. 根据权利要求 1至 3中任一项所述的方法, 其中, 还包括:
所述沉浸通信客户端接收所述沉浸通信服务器发送的内容视图更新通知, 其中, 所述内容视图更新通知携带其他沉浸通信客户端的内容视图变化信息。
7. 根据权利要求 1至 3中任一项所述的方法, 其中, 所述内容视图包括: 单独内 容视图, 和 /或连续内容视图。
8. 根据权利要求 1至 4中任一项所述的方法, 其中, 所述沉浸通信客户端向沉浸 通信服务器发送内容视图获取请求之后, 还包括:
所述沉浸通信客户端接收所述沉浸通信服务器返回的所述内容视图; 所述沉浸通信客户端显示所述内容视图。
9. 一种获取内容视图的方法, 包括:
沉浸通信服务器接收沉浸通信客户端发送的内容视图获取请求, 其中, 所 述内容视图获取请求携带用户的内容视图选择信息;
所述沉浸通信服务器根据所述内容视图选择信息获取内容视图; 所述沉浸通信服务器向所述沉浸通信客户端返回获取到的所述内容视图。
10. 根据权利要求 9所述的方法,其中,所述内容视图选择信息包括以下至少之一:
内容视图标识, 用于指示所述用户选择的内容视图;
视野信息, 用于指示所述用户选择的内容视图观看角度;
距离信息, 用于指示所述用户选择的内容视图观看距离。
11. 根据权利要求 10所述的方法, 其中, 所述内容视图获取请求包括: 携带所述内 容视图选择信息的内容视图更新请求, 用于请求所述沉浸通信服务器根据所述 内容视图选择信息更新所述内容视图。
12. 根据权利要求 9至 11中任一项所述的方法,其中,所述沉浸通信服务器根据所 述内容视图选择信息获取内容视图的步骤, 包括:
所述沉浸通信服务器根据所述内容视图选择信息中的内容视图标识, 获取 所述内容视图; 或者
所述沉浸通信服务器根据所述内容视图选择信息中的视野信息和 /或距离 信息, 获取所述内容视图。
13. 根据权利要求 9至 11中任一项所述的方法,其中,所述沉浸通信服务器根据所 述内容视图选择信息获取内容视图的步骤, 包括:
所述沉浸通信服务器根据所述内容视图选择信息中的视野信息和 /或距离 信息, 选择多媒体内容源;
所述沉浸通信服务器利用所述多媒体内容源生成所述内容视图。
14. 根据权利要求 13所述的方法, 其中, 选择多媒体内容源的步骤, 包括:
根据所述视野信息和 /或所述距离信息,确定一个或多个多媒体内容捕获装 置, 利用所述一个或多个多媒体内容捕获装置选择所述多媒体内容源; 或者 根据所述视野信息和 /或所述距离信息,调整所述一个或多个多媒体内容捕 获装置的位置, 利用所述一个或多个多媒体内容捕获装置选择所述多媒体内容 源。
15. 根据权利要求 9至 11中任一项所述的方法,其中,所述沉浸通信服务器根据所 述内容视图选择信息获取内容视图的步骤, 包括:
根据所述内容视图选择信息生成内容视图获取控制指令;
向所述多媒体内容捕获装置发送所述内容视图获取控制指令; 接收所述多媒体内容捕获装置返回的多媒体内容源, 其中, 所述多媒体内 容源为所述多媒体内容捕获装置根据所述内容视图获取控制指令选择的多媒体 内容源;
利用所述多媒体内容源生成所述内容视图。
16. 根据权利要求 9至 11中任一项所述的方法, 其中, 还包括: 所述沉浸通信服务器向其他沉浸通信客户端发送内容视图更新通知,其中, 所述内容视图更新通知携带所述沉浸通信客户端的内容视图变化信息。
17. 一种沉浸通信客户端, 包括:
收集模块, 设置为收集用户的内容视图选择信息;
发送模块, 设置为向沉浸通信服务器发送内容视图获取请求, 其中, 所述 内容视图获取请求用于请求所述沉浸通信服务器根据所述内容视图选择信息获 取内容视图。
18. 根据权利要求 17所述的客户端, 其中, 还包括: 显示模块, 设置为接收所述沉浸通信服务器反馈的所述内容视图, 并显示 所述内容视图。
19. 根据权利要求 17或 18所述的客户端, 其中, 还包括: 接收模块, 设置为接收所述沉浸通信服务器发送的内容视图更新通知, 其 中, 所述内容视图更新通知携带其他沉浸通信客户端的内容视图变化信息。
20. 根据权利要求 17或 18所述的客户端,其中,所述收集模块包括以下至少之一:
第一获取单元, 设置为获取所述用户选择的内容视图标识, 作为所述内容 视图选择信息, 其中, 所述内容视图标识用于指示所述用户选择的内容视图; 第二获取单元, 设置为获取所述用户选择的视野信息, 作为所述内容视图 选择信息, 其中, 所述视野信息用于指示所述用户选择的内容视图观看角度; 第三获取单元, 设置为获取所述用户选择的距离信息, 作为所述内容视图 选择信息, 其中, 所述距离信息用于指示所述用户选择的内容视图观看距离。
21. 一种沉浸通信服务器, 包括:
接收模块, 设置为接收沉浸通信客户端发送的内容视图获取请求, 其中, 所述内容视图获取请求携带用户的内容视图选择信息;
获取模块, 设置为根据所述内容视图选择信息获取内容视图; 发送模块, 设置为向所述沉浸通信客户端返回获取到的所述内容视图。
22. 根据权利要求 21所述的服务器, 其中, 所述获取模块, 设置为根据所述内容视 图选择信息中的内容视图标识获取所述内容视图, 其中, 所述内容视图标识用 于指示所述用户选择的内容视图。
23. 根据权利要求 21所述的服务器, 其中, 所述获取模块包括:
选择单元, 设置为根据所述内容视图选择信息中的视野信息和 /或距离信 息, 选择多媒体内容源, 其中, 所述视野信息用于指示所述用户选择的内容视 图观看角度, 所述距离信息用于指示所述用户选择的内容视图观看距离;
生成单元, 设置为利用所述多媒体内容源生成所述内容视图。 根据权利要求 23所述的服务器, 其中, 所述选择单元, 设置为根据所述视野信息和 /或所述距离信息,确定一个或多个多媒体内容 捕获装置, 利用所述一个或多个多媒体内容捕获装置选择所述多媒体内容源; 或者
设置为根据所述视野信息和 /或所述距离信息,调整所述一个或多个多媒体 内容捕获装置的位置, 利用所述一个或多个多媒体内容捕获装置选择所述多媒 体内容源。
25. 根据权利要求 21所述的服务器, 其中, 所述获取模块包括: 指令生成单元, 设置为根据所述内容视图选择信息生成内容视图获取控制 指令;
发送单元, 设置为向所述多媒体内容捕获装置发送所述内容视图获取控制 指令;
接收单元, 设置为接收所述多媒体内容捕获装置返回的多媒体内容源, 其 中, 所述多媒体内容源为所述多媒体内容捕获装置根据所述内容视图获取控制 指令选择的多媒体内容源;
内容视图生成单元, 设置为利用所述多媒体内容源生成所述内容视图。
26. 根据权利要求 21至 25中任一项所述的服务器, 其中, 还包括:
通知模块, 设置为向其他沉浸通信客户端发送内容视图更新通知, 其中, 所述内容视图更新通知携带所述沉浸通信客户端的内容视图变化信息。
PCT/CN2013/088442 2012-12-18 2013-12-03 沉浸通信客户端、服务器及获取内容视图的方法 WO2014094537A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP13866256.4A EP2938038B1 (en) 2012-12-18 2013-12-03 Immersion communication client and server, and method for obtaining content view
KR1020157018686A KR102069930B1 (ko) 2012-12-18 2013-12-03 이머전 통신 클라이언트, 서버 및 컨텐츠 뷰를 획득하는 방법

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210551314.1A CN103873453B (zh) 2012-12-18 2012-12-18 沉浸通信客户端、服务器及获取内容视图的方法
CN201210551314.1 2012-12-18

Publications (1)

Publication Number Publication Date
WO2014094537A1 true WO2014094537A1 (zh) 2014-06-26

Family

ID=50911582

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/088442 WO2014094537A1 (zh) 2012-12-18 2013-12-03 沉浸通信客户端、服务器及获取内容视图的方法

Country Status (4)

Country Link
EP (1) EP2938038B1 (zh)
KR (1) KR102069930B1 (zh)
CN (1) CN103873453B (zh)
WO (1) WO2014094537A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10574975B1 (en) 2018-08-08 2020-02-25 At&T Intellectual Property I, L.P. Method and apparatus for navigating through panoramic content

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9530197B2 (en) * 2015-04-30 2016-12-27 Microsoft Technology Licensing, Llc Digital signage for immersive views
CN106303404A (zh) * 2015-06-29 2017-01-04 北京智谷睿拓技术服务有限公司 可视化内容传输控制方法、发送方法、及其装置
CN106293043B (zh) * 2015-06-29 2023-11-10 北京智谷睿拓技术服务有限公司 可视化内容传输控制方法、发送方法、及其装置
US20180034906A1 (en) * 2016-07-29 2018-02-01 Wipro Limited Method and System for Synchronizing Content Between User Devices in an Established Session
CN106385587B (zh) * 2016-09-14 2019-08-02 三星电子(中国)研发中心 分享虚拟现实视角的方法、装置及系统
CN108616751B (zh) 2016-12-12 2023-05-12 上海交通大学 媒体信息的处理方法、装置及系统
CN110324554B (zh) * 2018-03-28 2021-08-13 北京富纳特创新科技有限公司 视频通信装置及方法
CN113453083B (zh) * 2020-03-24 2022-06-28 腾讯科技(深圳)有限公司 多自由度场景下的沉浸式媒体获取方法、设备及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN200953070Y (zh) * 2006-09-08 2007-09-26 北京水晶石数字科技有限公司 一种多屏折幕投影系统
CN101375599A (zh) * 2004-06-01 2009-02-25 L-3通信公司 用于执行视频监视的方法和系统
CN102339629A (zh) * 2011-05-26 2012-02-01 上海德理孚自动化系统有限公司 一种沉浸式隧道型多媒体交互展示系统及方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10440329B2 (en) * 2009-05-22 2019-10-08 Immersive Media Company Hybrid media viewing application including a region of interest within a wide field of view
US9955209B2 (en) * 2010-04-14 2018-04-24 Alcatel-Lucent Usa Inc. Immersive viewer, a method of providing scenes on a display and an immersive viewing system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101375599A (zh) * 2004-06-01 2009-02-25 L-3通信公司 用于执行视频监视的方法和系统
CN200953070Y (zh) * 2006-09-08 2007-09-26 北京水晶石数字科技有限公司 一种多屏折幕投影系统
CN102339629A (zh) * 2011-05-26 2012-02-01 上海德理孚自动化系统有限公司 一种沉浸式隧道型多媒体交互展示系统及方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2938038A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10574975B1 (en) 2018-08-08 2020-02-25 At&T Intellectual Property I, L.P. Method and apparatus for navigating through panoramic content
US11178390B2 (en) 2018-08-08 2021-11-16 At&T Intellectual Property I, L.P. Method and apparatus for navigating through panoramic content
US11611739B2 (en) 2018-08-08 2023-03-21 At&T Intellectual Property I, L.P. Method and apparatus for navigating through panoramic content

Also Published As

Publication number Publication date
KR102069930B1 (ko) 2020-01-23
EP2938038B1 (en) 2017-11-22
EP2938038A4 (en) 2016-01-20
KR20150097609A (ko) 2015-08-26
CN103873453A (zh) 2014-06-18
CN103873453B (zh) 2019-05-24
EP2938038A1 (en) 2015-10-28

Similar Documents

Publication Publication Date Title
WO2014094537A1 (zh) 沉浸通信客户端、服务器及获取内容视图的方法
US9965026B2 (en) Interactive video display method, device, and system
EP3238445B1 (en) Interactive binocular video display
JP6432029B2 (ja) 低コストでテレビ番組を制作する方法及びシステム
CN104012106B (zh) 使表示不同视点的视频对准
US9955147B2 (en) Zoom related methods and apparatus
US8970704B2 (en) Network synchronized camera settings
US20150358539A1 (en) Mobile Virtual Reality Camera, Method, And System
KR20190031504A (ko) 파노라마 비디오의 상호작용적 전송을 위한 방법 및 시스템
JP7111288B2 (ja) ビデオ処理方法、装置および記憶媒体
WO2018103233A1 (zh) 基于虚拟现实技术的观景方法、装置及系统
JP6241802B1 (ja) 映像配信システム、ユーザ端末装置および映像配信方法
KR20180004068A (ko) 가상 카메라를 이용한 개인화된 쇼핑몰 시스템
JP2022536182A (ja) データストリームを同期させるシステム及び方法
JP2003299069A5 (zh)
EP2852149A1 (en) Method and apparatus for generation, processing and delivery of 3D video
KR20140111324A (ko) 비디오 감시 방법, 관련 시스템, 관련 감시 서버, 및 관련 감시 카메라
JP2010147911A (ja) 画像配信装置、画像配信システム、画像配信方法、およびプログラム
Seo et al. Immersive panorama TV service system
JP3229221U (ja) 全景リアリティシミュレーションシステム
CN217034780U (zh) 一种互动式全景系统
JPWO2019038885A1 (ja) 情報処理装置および画像出力方法
WO2021179102A1 (zh) 实境仿真全景系统及其使用方法
JP2007243367A (ja) 動画配信システム
WO2023081755A1 (en) Systems and methods for providing rapid content switching in media assets featuring multiple content streams that are delivered over computer networks

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13866256

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20157018686

Country of ref document: KR

Kind code of ref document: A

REEP Request for entry into the european phase

Ref document number: 2013866256

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2013866256

Country of ref document: EP