WO2022100308A1 - 信息处理方法及相关装置 - Google Patents
信息处理方法及相关装置 Download PDFInfo
- Publication number
- WO2022100308A1 WO2022100308A1 PCT/CN2021/121290 CN2021121290W WO2022100308A1 WO 2022100308 A1 WO2022100308 A1 WO 2022100308A1 CN 2021121290 W CN2021121290 W CN 2021121290W WO 2022100308 A1 WO2022100308 A1 WO 2022100308A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- target content
- target
- application
- information
- Prior art date
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 72
- 238000003672 processing method Methods 0.000 title claims abstract description 17
- 238000000034 method Methods 0.000 claims abstract description 64
- 238000004891 communication Methods 0.000 claims description 30
- 230000009471 action Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 11
- 238000001514 detection method Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 26
- 230000006870 function Effects 0.000 description 22
- 238000012545 processing Methods 0.000 description 19
- 230000008569 process Effects 0.000 description 11
- 230000005540 biological transmission Effects 0.000 description 9
- 239000000243 solution Substances 0.000 description 7
- 239000003999 initiator Substances 0.000 description 6
- 238000009877 rendering Methods 0.000 description 6
- 230000003993 interaction Effects 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4438—Window management, e.g. event handling following interaction with the user interface
Definitions
- the present application relates to the technical field of information processing, and in particular, to an information processing method and a related device.
- multiple devices are generally based on the screen projection mechanism to display the same content.
- the mobile phone uses the screen projection service to realize the streaming media information from the mobile phone is projected to the TV for playback.
- Such a screen projection service with a single function has become increasingly difficult to meet the diversified usage needs of users.
- an embodiment of the present application provides an information processing method, including:
- the first electronic device receives the updated target content from the second electronic device, and the updated target content is obtained by the second electronic device by performing the following operation: receiving the target content from the target device; For the control information of the target content, update the target content according to the control information, and send the updated target content to the first electronic device;
- the first electronic device outputs the updated target content.
- the first electronic device can display the target content of the second electronic device, it can dynamically follow and display the target content updated by the second electronic device according to the control information for the target content, and enter the control information.
- the target device can be the first electronic device itself or other devices, so that the process of displaying the target content by the first electronic device is more consistent in effect with the process of the first electronic device running a local application to display the content, thereby ensuring that While improving user experience, improve the comprehensiveness and flexibility of content display and control in multi-device interconnection scenarios.
- the embodiments of the present application provide an information processing method, including:
- the first electronic device can display the information that the second electronic device does not actually output when the target application is running, that is, although the target application is not installed on the local end, the first electronic device can display the information through the display screen and other capable devices Output the perceptible target content that the target application needs to output externally in the running state, so as to realize the cross-end use of the target application and improve the flexibility and comprehensiveness of application data display in the multi-device interconnection scenario.
- the first electronic device detects a trigger operation for transferring target content to the second electronic device, where the target content is application data generated by the target application in a running state;
- an information processing apparatus including:
- a receiving unit configured to receive the updated target content from the second electronic device, where the updated target content is obtained by the second electronic device by performing the following operations: receiving a target content from the target device the control information of the target content, updating the target content according to the control information, and sending the updated target content to the first electronic device;
- An output unit configured to output the updated target content.
- the output unit is configured to output target content from the second electronic device, where the target content is information that is not actually output by the second electronic device in the state of running the target application.
- an information processing device including:
- a detection unit configured to detect a trigger operation for transferring target content to the second electronic device, where the target content is application data generated by the target application in a running state;
- a sending unit configured to send the target content to the second electronic device, where the target content is used for the second electronic device to output the target content.
- embodiments of the present application provide an electronic device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured by Executed by the processor, the program includes instructions for executing steps in any of the methods in the first to third aspects of the embodiments of the present application.
- an embodiment of the present application provides a chip, including: a processor for calling and running a computer program from a memory, so that a device installed with the chip executes the first to third aspects of the embodiment of the present application Some or all of the steps described in any method.
- an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program causes a computer to execute the implementation of the present application Examples include some or all of the steps described in any of the methods of the first to third aspects.
- the embodiments of the present application provide a computer program, wherein the computer program is operable to cause the computer to execute some or all of the steps described in any of the methods in the first to third aspects of the embodiments of the present application.
- the computer program may be a software installation package.
- FIG. 1A is a schematic flowchart of an information processing method provided by an embodiment of the present application.
- FIG. 1B is a schematic diagram of the architecture of a multi-device unified management system provided by an embodiment of the present application
- FIG. 1C is a schematic diagram of using the same application collaboratively by multiple devices in a one-to-one mode provided by an embodiment of the present application;
- FIG. 1D is a schematic diagram of another one-to-one mode of multiple devices using the same application collaboratively according to an embodiment of the present application;
- 1F is a schematic diagram of a single device displaying an interface for multiple devices running the same type of application in a many-to-one mode provided by an embodiment of the present application;
- 1G is a schematic diagram of multiple devices displaying an application interface of the same device in a one-to-many mode provided by an embodiment of the present application;
- FIG. 1H is a schematic diagram of multiple devices cooperatively running the same application in an MVC mode provided by an embodiment of the present application
- FIG. 2A is a schematic flowchart of an information processing method provided by an embodiment of the present application.
- 2B is a schematic diagram showing an application interface of a single application running in the background of the current device through another device provided by an embodiment of the present application;
- 2C is a schematic diagram of an application interface for displaying multiple applications running on the current device through other devices, provided by an embodiment of the present application;
- 3A is a schematic flowchart of an information processing method provided by an embodiment of the present application.
- 3C is a schematic diagram of an application layer streaming media redirection architecture provided by an embodiment of the present application.
- 3D is a data flow diagram of application-layer streaming media redirection provided by an embodiment of the present application.
- FIG. 4 is a block diagram of a functional unit composition of an information processing provided by an embodiment of the present application.
- FIG. 5 is a schematic structural diagram of an information processing provided by an embodiment of the present application.
- FIG. 6 is a block diagram of a functional unit composition of another information processing provided by an embodiment of the present application.
- FIG. 7 is a schematic structural diagram of another information processing provided by an embodiment of the present application.
- an end-to-end P2P network is constructed through the wireless high-fidelity Wi-Fi equipment inside the TV, and the TV is defined as the management end of the P2P device group, and the mobile terminal is defined as the client of the P2P device group;
- the screen projection request is made by one or more mobile terminals, the screen contents of one or more mobile terminals are all projected to the display screen of the TV.
- This method can only meet the requirements of one-way screen projection and playback at the display level, and is difficult to meet the increasingly rich application requirements of users.
- FIG. 1A is a schematic flowchart of an information processing method provided by an embodiment of the present application, which is applied to any electronic device supporting a display function in a target device set, where the target device set is under the same user account.
- a device set composed of one or more devices, as shown in the figure, the method includes:
- Step 101 the first electronic device outputs the target content from the second electronic device.
- the target content may be data of a specific file type in the second electronic device, such as documents, photos, videos, music, etc., and the first electronic device may output the corresponding content through an application that can read these files locally, For example, a video file that is read exclusively by a video player is used for video playback, and for example, a corresponding music file is read by a music player for music playback.
- the target content can also be the application data of the target application in the second electronic device in the running state, such as UI data, audio data, vibration data, etc. of the game application.
- the first electronic device can use the distributed application mechanism, local Compatible application mechanism, redirection application mechanism (specifically, it is divided into redirection based on control binding, redirection based on partial screen projection, redirection from large screen to small screen, and general screen projection method). Realize the output of content.
- a unified desktop is displayed on the first electronic device, the existing metadata on the unified desktop is unified, and the metadata is associated with the data of the same file type of the device or the application of the associated device, and these metadata are realized by the multi-device management system of the server + terminal .
- a metadata consists of the following:
- the unique path has a unique device identification ID, and a unique path to the metadata under this device.
- Metadata category file type (for example: music, video, document, photo, etc. metadata), application type (for example: device-level metadata, aggregate application-level metadata, independent application-level metadata).
- Each kind of data has its own properties, such as the size of the picture, the duration of the video, etc.
- These attributes of metadata can make the unified desktop display these data well, and can find a suitable opening method when the user triggers the use.
- the unified desktop can be specifically realized by means of a server and a terminal.
- the server (the cloud system shown in the figure) is mainly responsible for the management of devices under the user's name and the management of applications and data. Specifically, it may include a device management module, an application management module, a user management module, a device management module, an application management module, and a user management module. Any two modules in the module are connected in communication with each other.
- the terminal includes a unified desktop system and/or a background support system
- the unified desktop system includes a user interface UI module, a redirected sink module, an application decision module, and its own application.
- the modules, the background support system includes at least one of a connection module, a distributed data service system, a distributed resource system, and a redirection initiator source system.
- the unified desktop system is the main interactive entrance, and the user realizes unified management and use of multiple devices through this system.
- the connection module is used to ensure the connection of multiple devices, and can specifically support various conventional communication technologies, such as mobile communication technology (the fifth generation mobile communication technology 5G, etc.), local area network short-distance wireless communication technology (Bluetooth, ultra-bandwidth UWB, etc. ).
- mobile communication technology the fifth generation mobile communication technology 5G, etc.
- local area network short-distance wireless communication technology Bluetooth, ultra-bandwidth UWB, etc.
- the distributed data service system is used to realize data intercommunication among multiple devices.
- the redirection source system and the distributed resource system are used to realize cross-end use of applications.
- different devices can be provided with a unified desktop system and a background support system at the same time, or only one of them, depending on the capabilities of the devices.
- mobile phones, PCs and other capable devices can have a unified desktop system and a back-end support system at the same time
- customer front-end equipment CPE, routers, etc. can only have the back-end support system
- the web terminal can only have a unified desktop system.
- the target content is at least one of the following information actually output by the second electronic device: audio, video, picture, text, and action information (eg, vibration information).
- action information eg, vibration information
- the target device includes the first electronic device or a third electronic device other than the first electronic device and the second electronic device.
- Step 103 the first electronic device outputs the updated target content.
- M Model-View-Controller
- V refers to user Interface
- C the controller
- MVC Model-View-Controller
- M refers to business model
- V refers to user Interface
- C the controller
- MVC the purpose of using MVC is to separate the implementation codes of M and V, so that the same program can use different forms of representation.
- a batch of statistical data can be represented by a bar chart and a pie chart respectively.
- the purpose of C is to ensure the synchronization of M and V. Once M changes, V should be updated synchronously).
- the PC in the one-to-one mode, assuming that the mobile phone is interconnected with the PC, the mobile phone has a video application running, and the PC is not installed with the video application, the PC can share the display and playback capabilities of the video application on the mobile phone, that is, the mobile phone The game screen and sound stream are transferred to the PC for playback, so that video applications can be used across devices.
- FIG. 1D in the one-to-one mode, couples play the same game cooperatively on two mobile phones, which subverts the gameplay of traditional single-player games.
- Expanded to multiplayer bringing innovations in gameplay and experience. That is, device A runs game application a, and device B streams the screen and sound of game application a running on device A to the local device for playback, and the operation information on device B can be streamed back to device A for response. The picture information and sound information flow back, so as to realize the flow of application data and control information.
- multiple audio and video streams are presented on the same large-screen device.
- the sources of the multiple audio and video streams are not limited here, and may come from different devices, or from multiple devices from the same device.
- the physical screen may also come from multiple virtual screens of the same device, or even from the large-screen device itself.
- FIG. 1E the pictures of the mobile phone 1 , the mobile phone 2 , the mobile phone 3 and the tablet in the illustration are all displayed on the large screen of the TV.
- the multi-person screen projection product from the mobile phone to the TV adopts the many-to-one mode, which supports the simultaneous presentation of up to four channels.
- a dynamic layout is also generated according to the current display state of the input source. The illustration shows that when four users jointly use application 1, the application pictures displayed by each user terminal are presented on the same screen for display.
- the one-to-many mode in the one-to-many mode, it can be subdivided into two dimensions, the device level and the application level.
- the content of the audio and video streams distributed by multiple channels is the same, so in this mode, the collection and encoding of audio and video are multiplexed, but are split into multiple channels during stream distribution.
- the one-to-many mode can be used in video conference scenarios. It can redirect the audio and video information of a certain device (that is, the redirection initiator) to the mobile phone/PC/TV at the same time. Each redirection receiving end can be individually configured for its display. /Reverse control permission.
- the three-participation mode of control, display, and data realizes the separation of display/operation/control, gives full play to the advantages of each device, and cooperates with multiple parties to complete a cross-end task.
- the TV shows the display capability of a large screen
- the PC takes advantage of the control of the keyboard and mouse
- the mobile phone provides applications, data and computing power, bringing users a better cross-end gaming experience.
- peripheral devices such as Bluetooth controllers can also be used.
- This scenario can include the following data interaction steps.
- the PC queries the mobile phone 1 for distribution data.
- the mobile phone 1 provides distribution data to the PC.
- the TV requests the mobile phone 1 for video connection.
- the mobile phone 1 provides a video stream to the TV.
- the PC sends control information to the mobile phone 1 .
- the first electronic device can display the target content of the second electronic device, and at the same time, can dynamically follow and display the target content updated by the second electronic device according to the control information for the target content, and
- the target device for entering the control information can be the first electronic device itself or other devices, so that the process of displaying the target content by the first electronic device is more effective than the process of displaying the content by the first electronic device running a local application. Consistent, thus ensuring user experience while improving the comprehensiveness and flexibility of content display and control in multi-device interconnected scenarios.
- FIG. 2A is a schematic flowchart of an information processing method provided by an embodiment of the present application, which is applied to any electronic device supporting a display function in the target device set. As shown in the figure, the method includes:
- Step 201 The first electronic device outputs target content from the second electronic device, where the target content is information that is not actually output by the second electronic device when the target application is running.
- the target application is an application running in the background.
- the target content includes at least one of the following information: audio, video, picture, text, and action information (eg, vibration information).
- action information eg, vibration information
- the embodiment of the present application proposes the concept of application-level screen projection. Different from traditional mirror projection, this mode supports background multi-channel projection, extending the mobile phone from single-task mode to multi-task mode. And it can adapt to the display resolution of the client and support application-level reverse control.
- the specific implementation mechanism of application-level screen projection is to realize distributed management of applications at the granular level of services (such as display services, sound services, location services, input services, payment services, and other services).
- the background of the game is projected to the PC for display and control, so that the game can be played while swiping WeChat without interfering with each other.
- mobile phone 1 runs application 1 in the foreground as the redirection initiator, displays screen 1 of application 1, runs application 2 in the background, sends audio/video streams to the PC, and the PC, as the redirection receiver, displays screen 2 of application 2 on the screen. And can send control flow to mobile phone 1.
- the mobile phone 1 runs application 1, application 2, and application 3 as the redirection initiator, and the PC side, as the redirection receiver, simultaneously presents the application 1 screen, the application 2 screen, and the application 3 screen on the screen.
- the support for various complex intelligent interconnection scenarios reflects the flexibility of the solution in this embodiment. For end users or upper-layer application developers, it is easy to assemble customized interconnection scenarios through configuration and secondary development.
- the first electronic device can display information that is not actually output by the second electronic device when the target application is running, that is, although the target application is not installed on the local end, the first electronic device can display information that is not actually output by the second electronic device.
- Capable devices such as screens output the perceptible target content that the target application needs to output externally in the running state, so as to realize the cross-end use of the target application and improve the flexibility and comprehensiveness of application data display in the multi-device interconnection scenario.
- the target application includes multiple applications; the output of the target content from the second electronic device by the first electronic device includes: the first electronic device displays the multiple applications in a multi-window manner UI data for the app.
- the multiple applications may be applications of the same type or different types, which are not uniquely limited here.
- the first electronic device can display the interfaces of multiple applications running on other devices, so as to realize the use of multiple applications across terminals, and to improve the convenience and flexibility of application use in the multi-device interconnection scenario.
- FIG. 3A is a schematic flowchart of an information processing method provided by an embodiment of the present application, which is applied to any electronic device supporting a display function in the target device set. As shown in the figure, the method includes:
- Step 301 the first electronic device detects a triggering operation to transfer target content to the second electronic device, where the target content is application data generated by the target application in a running state;
- the trigger operation includes any one of the following: touch operation, gesture operation, voice operation, short-range wireless communication (for example: near field communication NFC communication, ultra-wideband UWB communication);
- the target content includes at least one of the following Information: audio, video, picture, text, motion information (for example: vibration information).
- Step 302 the first electronic device sends the target content to the second electronic device, where the target content is used for the second electronic device to output the target content.
- the target content is a video
- the triggering methods of the flow include but are not limited to NFC, UWB, gesture, voice, etc.
- the method further includes: canceling, by the first electronic device, displaying the target content.
- the mobile phone 1 is the redirection initiator, the screen 1 of the application 1 is running, the PC and the TV are both target devices, the screen 1 of the mobile phone 1 is transferred to the PC, the application interface of the mobile phone 1 is maintained, and the PC is transferred to the TV.
- the screen is displayed, after the TV successfully receives and displays the screen of application 1, the screen on the PC side can no longer be displayed.
- the electronic device can switch the application data generated by the target application in the running state among multiple devices in a streaming manner, so as to realize the cross-end output of the application data in the multi-device interconnection scenario. , to improve the flexibility and comprehensiveness of application data in multi-device interconnection scenarios.
- the sending, by the first electronic device, the target content to the second electronic device includes: the first electronic device indirectly sending the second electronic device the target content through a multi-device management server target content; or, the first electronic device directly sends the target content to the second electronic device through a preset communication network.
- the first electronic device when used as the source device for the transfer, it can directly or indirectly transmit data with the target device for the transfer to realize the cross-device output of the content, and improve the flexibility and convenience of the content usage in the multi-device interconnection scenario. .
- the target content is application data generated by a target application running by a third electronic device in a running state; the first electronic device sends the target content to the second electronic device, including : the first electronic device sends a streaming request to the third electronic device, the streaming request includes device information of the second electronic device serving as a content receiving device, and the streaming request is for the third electronic device
- the following operations are performed: indirectly send the target content to the second electronic device through a multi-device management server; or directly send the target content to the second electronic device through a preset communication network.
- the first electronic device when the first electronic device acts as a stream forwarding device and is not the source device of the target content, it can transmit data with the content receiving device through server transfer or direct communication to realize cross-device output of content and improve multi-device interconnection. Flexibility and ease of use of content in the scene.
- the hierarchical model specifically includes:
- Application layer Responsible for providing external redirection services, UI interaction and screen projection effect presentation.
- Service layer encapsulates and combines lower-level functional modules to provide various services of higher abstraction for the application layer.
- Redirection layer responsible for the collection and playback of audio and video data, as well as the capture, processing and reverse control of control data.
- Codec layer responsible for the codec of streaming media data.
- Data channel layer Provides service data channel upward, and encapsulates binary data stream into data frames with service logic, such as video frames, audio frames and control signaling.
- Transport layer based on standard or custom network communication protocol for binary data stream transmission.
- the core functional modules include:
- Redirect Manager used to provide various redirection services.
- Connection Manager (Connection Manager, shown as connection management): It is used to establish a connection channel and supports a variety of connection methods and transmission protocols.
- Device Manager used to manage device information and used for software and hardware capability negotiation.
- Status Manager used to monitor and synchronize various normal and abnormal states of screen projection.
- Scene Manager (Scene Manager, not shown in the figure): used for scene management in two dimensions.
- Deployment layer Configure and deploy various interconnected screen projection scenarios;
- Application layer Adopt customized startup strategies for different applications.
- Video capture redirection (Video Sampler&Redirector, shown as video capture redirection): used for video stream capture, screen recording at the device level, and display redirection at the application level.
- Video rendering Video Renderer, shown as video rendering: video rendering display module, used for preprocessing and combined rendering with OpenGL primitives in multi-channel rendering.
- Control acquisition and transmission (Control Sampler & Handler, shown as control transmission and control acquisition): It is used for collection, operation mapping and distribution execution of reverse control, which also includes application level and device level.
- Video encoding and decoding (Video Encoder&Decoder, the picture shows video encoding and video decoding): the video encoding and decoding module is responsible for video encoding and decoding related work.
- the video encoding format mainly adopts AVC (H264) and HEVC (H265).
- Audio encoding and decoding (Audio Encoder&Decoder, the picture shows video and audio encoding and audio decoding): the audio encoding and decoding module is responsible for the work related to audio encoding and decoding.
- the audio encoding format mainly adopts PCM original code stream and AAC.
- Video/Audio/Control Channel (Video/Audio/Control Channel, shown as video channel, audio channel, control channel): used for video/audio/control channel, provides business data channel for upward encapsulation, and is responsible for serialization downward /Deserialize the video frame/logical frame/control signaling corresponding to the channel.
- Tcp/Quic/NST channel Tunnel (shown as Tcp channel, Quic channel, NST channel): used for binary data transmission at the network IO layer, providing synchronous/asynchronous read and write capabilities.
- NST Tunnel is a self-designed near-field low-latency custom streaming protocol.
- the redirection initiator notifies the redirection manager to establish one or more application-level redirection services through the ARS initiation module, and each application-level redirection service performs audio Transmission of /video/control information, and response control information, and communicate with the redirection receiver through the connection manager.
- the redirection receiver establishes one or more application-level redirection services through the redirection manager of the local end.
- the application-level redirection service performs video decoding, rendering and display, audio decoding and playback, and reception and return of control information.
- ARS refers to the application-level redirection service, which provides the application screen running on the device to the third-party device in the form of video stream, allowing the third-party device to display and operate the application on the current device. Support multiple applications to run at the same time, consistent with the operating habits on the PC.
- the embodiments of the present application conform to the current development concept of inter-integration of all things, and provide a more unified, flexible and general redirection framework.
- the present invention can build various intelligent interconnection scenarios under the same set of technical solutions, including one-to-one, many-to-one, one-to-many, MVC (operation/display/control separation), application-level screen projection, application flow, and the like.
- MVC operation/display/control separation
- application-level screen projection application flow, and the like.
- Some of the screen projection modes are innovatively proposed in the embodiments of the present application, such as the MVC mode.
- the compatibility of equipment and platforms can be expanded (such as future smart glasses); the intelligent interconnection scene can be expanded; the data channel can be expanded; the transmission protocol can be expanded; the connection method can be expanded; the codec can be expanded.
- An embodiment of the present application provides an information processing apparatus, and the information processing apparatus may be a terminal. Specifically, the information processing apparatus is configured to perform the steps performed by the terminal in the above method for displaying desktop metadata.
- the information processing apparatus provided by the embodiments of the present application may include modules corresponding to corresponding steps.
- the information processing apparatus may be divided into functional modules according to the foregoing method examples.
- each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
- the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.
- the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
- FIG. 4 shows a possible schematic structural diagram of the information processing apparatus involved in the above embodiment.
- the information processing device 4 includes:
- an output unit 40 configured to output the target content from the second electronic device
- the receiving unit 41 is configured to receive the updated target content from the second electronic device, where the updated target content is obtained by the second electronic device by performing the following operations: receiving the target content from the target device. For the control information of the target content, update the target content according to the control information, and send the updated target content to the first electronic device;
- the output unit 42 is configured to output the updated target content.
- the target device includes the first electronic device or a third electronic device other than the first electronic device and the second electronic device.
- the target content is at least one of the following information actually output by the second electronic device: audio, video, picture, text, and action information.
- the information processing apparatus 5 includes: a processing module 50 and a communication module 51 .
- the processing module 50 is used to control and manage the actions of the information processing device, eg, the steps performed by the output unit 40, and/or other processes used to perform the techniques described herein.
- the communication module 51 is used to support the interaction between the information processing apparatus and other devices.
- the information processing apparatus may further include a storage module 52, and the storage module 52 is used for storing program codes and data of the information processing apparatus.
- the processing module 50 may be a processor or a controller, such as a central processing unit (Central Processing Unit, CPU), a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), ASIC, FPGA or other programmable Logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure.
- the processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.
- the communication module 51 may be a transceiver, an RF circuit, a communication interface, or the like.
- the storage module may be a memory.
- the above-mentioned information processing apparatuses can all execute the steps executed by the terminal in the above-mentioned method for displaying desktop metadata shown in FIG. 1A .
- An embodiment of the present application provides an information processing apparatus, and the information processing apparatus may be a terminal. Specifically, the information processing apparatus is configured to perform the steps performed by the terminal in the above method for displaying desktop metadata.
- the information processing apparatus provided by the embodiments of the present application may include modules corresponding to corresponding steps.
- the information processing apparatus may be divided into functional modules according to the foregoing method examples.
- each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
- the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.
- the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
- FIG. 6 shows a possible schematic structural diagram of the information processing apparatus involved in the above embodiment.
- the information processing device 6 includes:
- the output unit 60 is configured to output target content from the second electronic device, where the target content is information that is not actually output by the second electronic device in the state of running the target application.
- the target application is an application running in the background.
- the target application includes multiple applications; in terms of outputting the target content from the second electronic device by the first electronic device, the output unit 60 is specifically configured to: display the target content in a multi-window manner. interface data of multiple applications.
- the target content includes at least one of the following information: audio, video, picture, text, and action information.
- the information processing apparatus 7 includes a processing module 70 and a communication module 71 .
- the processing module 70 is used to control and manage the actions of the information processing device, eg, the steps performed by the output unit 60, and/or other processes used to perform the techniques described herein.
- the communication module 71 is used to support the interaction between the information processing apparatus and other devices.
- the information processing apparatus may further include a storage module 72, and the storage module 72 is used for storing program codes and data of the information processing apparatus.
- the processing module 70 may be a processor or a controller, such as a central processing unit (Central Processing Unit, CPU), a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), ASIC, FPGA or other programmable Logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure.
- the processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.
- the communication module 71 may be a transceiver, an RF circuit, a communication interface, or the like.
- the storage module may be a memory.
- the above-mentioned information processing apparatuses can all execute the steps executed by the terminal in the above-mentioned method for displaying desktop metadata shown in FIG. 2A .
- An embodiment of the present application provides an information processing apparatus, and the information processing apparatus may be a terminal. Specifically, the information processing apparatus is configured to perform the steps performed by the terminal in the above method for displaying desktop metadata.
- the information processing apparatus provided by the embodiments of the present application may include modules corresponding to corresponding steps.
- the information processing apparatus may be divided into functional modules according to the foregoing method examples.
- each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
- the above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.
- the division of modules in the embodiments of the present application is schematic, and is only a logical function division, and there may be other division manners in actual implementation.
- FIG. 8 shows a possible schematic structural diagram of the information processing apparatus involved in the above embodiment.
- the information processing device 8 includes:
- a detection unit 80 configured to detect a trigger operation for transferring target content to the second electronic device, where the target content is application data generated by the target application in a running state;
- the sending unit 81 is configured to send the target content to the second electronic device, where the target content is used for the second electronic device to output the target content.
- the trigger operation includes any one of the following: touch operation, gesture operation, voice operation, and short-range wireless communication;
- the target content includes at least one of the following information: audio, video, picture, text, and action information.
- the sending unit 81 is specifically configured to: indirectly send the target to the second electronic device through a multi-device management server content; or, directly sending the target content to the second electronic device through a preset communication network.
- the target content is application data generated by a target application running by a third electronic device in a running state; in the aspect of sending the target content to the second electronic device, the sending The unit 81 is specifically configured to: send a streaming request to the third electronic device, where the streaming request includes device information of the second electronic device serving as a content receiving device, and the streaming request is for the third electronic device to execute The following operations are performed: indirectly send the target content to the second electronic device through a multi-device management server; or directly send the target content to the second electronic device through a preset communication network.
- the apparatus further includes a display unit configured to cancel the display of the target content.
- the information processing apparatus 9 includes: a processing module 90 and a communication module 91 .
- the processing module 90 is used to control and manage the actions of the information processing device, eg, the steps performed by the display unit 80, and/or other processes used to perform the techniques described herein.
- the communication module 91 is used to support the interaction between the information processing apparatus and other devices.
- the information processing apparatus may further include a storage module 92 for storing program codes and data of the information processing apparatus.
- the processing module 90 may be a processor or a controller, such as a central processing unit (Central Processing Unit, CPU), a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), ASIC, FPGA or other programmable Logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure.
- the processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.
- the communication module 91 may be a transceiver, an RF circuit, a communication interface, or the like.
- the storage module may be a memory.
- the above-mentioned information processing apparatuses can all execute the steps performed by the terminal in the above-mentioned method for displaying desktop metadata shown in FIG. 3A .
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
本申请实施例公开了一种信息处理方法及相关装置,包括:第一电子设备输出来自第二电子设备的目标内容;第一电子设备接收来自第二电子设备的更新后的目标内容,更新后的目标内容是第二电子设备执行以下操作获取的:接收来自目标设备的针对目标内容的控制信息,根据控制信息更新目标内容,并向第一电子设备发送更新后的目标内容;第一电子设备输出更新后的目标内容。本申请实施例有利于提高多设备互联场景中内容显示与控制的全面性和灵活性。
Description
本申请涉及信息处理技术领域,具体涉及一种信息处理方法及相关装置。
目前像智能家居等应用场景中的多设备互联方案中,一般是基于投屏机制实现多个设备显示相同的内容,如手机通过投屏服务实现将手机端的流媒体信息投屏到电视端进行播放。此种功能单一的投屏服务目前已经越来越难以满足用户的多样化使用需求。
发明内容
本申请实施例提供一种信息处理方法及相关装置,以期提高多设备互联场景中内容显示与控制的全面性和灵活性。
第一方面,本申请实施例提供一种信息处理方法,包括:
第一电子设备输出来自第二电子设备的目标内容;
所述第一电子设备接收来自所述第二电子设备的更新后的所述目标内容,所述更新后的所述目标内容是所述第二电子设备执行以下操作获取的:接收来自目标设备的针对所述目标内容的控制信息,根据所述控制信息更新所述目标内容,并向所述第一电子设备发送更新后的所述目标内容;
所述第一电子设备输出更新后的所述目标内容。
可见,本示例中,第一电子设备能够展示第二电子设备的目标内容的同时,能够动态跟随显示由第二电子设备根据针对该目标内容的控制信息更新后的目标内容,且录入该控制信息的目标设备可以是第一电子设备本身也可以是其他设备,如此使得第一电子设备展示目标内容的过程与第一电子设备自身运行本地应用来进行内容展示的过程在效果上较为一致,从而保证用户体验的同时,提高多设备互联场景中内容显示与控制的全面性和灵活性。
第二方面,本申请实施例提供一种信息处理方法,包括:
第一电子设备输出来自第二电子设备的目标内容,所述目标内容为所述第二电子设备在运行目标应用的状态下未实际输出的信息。
可见,本示例中,第一电子设备能够展示第二电子设备在运行目标应用的状态下未实际输出的信息,即虽然本端未安装目标应用,但第一电子设备能够通过显示屏等能力器件输出该目标应用在运行状态需要对外输出的可感知的目标内容,从而实现目标应用的跨端使用,提高多设备互联场景下应用数据展示的灵活性与全面性。
第三方面,本申请实施例提供一种信息处理方法,包括:
第一电子设备检测到将目标内容流转至第二电子设备的触发操作,所述目标内容为目标应用在运行状态下所产生的应用数据;
所述第一电子设备向所述第二电子设备发送所述目标内容,所述目标内容用于所述第二电子设备输出所述目标内容。
可见,本示例中,电子设备能够将目标应用在运行状态下所产生的应用数据以流转的方式在多个设备之间切换,从而实现多设备互联场景下应用数据的跨端输出,提高多设备互联场景下应用数据的使用灵活性和全面性。
第四方面,本申请实施例提供一种信息处理装置,包括:
输出单元,用于输出来自第二电子设备的目标内容;
接收单元,用于接收来自所述第二电子设备的更新后的所述目标内容,所述更新后的所述目标内容是所述第二电子设备执行以下操作获取的:接收来自目标设备的针对所述目标内容的控制信息,根据所述控制信息更新所述目标内容,并向所述第一电子设备发送更新后的所述目标内容;
输出单元,用于输出更新后的所述目标内容。
第五方面,本申请实施例提供一种信息处理装置,包括:
输出单元,用于输出来自第二电子设备的目标内容,所述目标内容为所述第二电子设备在运行目标应用的状态下未实际输出的信息。
第六方面,本申请实施例提供一种信息处理装置,包括:
检测单元,用于检测到将目标内容流转至第二电子设备的触发操作,所述目标内容为目标应用在运行状态下所产生的应用数据;
发送单元,用于向所述第二电子设备发送所述目标内容,所述目标内容用于所述第二电子设备输出所述目标内容。
第七方面,本申请实施例提供一种电子设备,包括处理器、存储器、通信接口以及一个或多个程序,其中,所述一个或多个程序被存储在所述存储器中,并且被配置由所述处理器执行,所述程序包括用于执行本申请实施例第一至第三方面任一方法中的步骤的指令。
第八方面,本申请实施例提供了一种芯片,包括:处理器,用于从存储器中调用并运行计算机程序,使得安装有所述芯片的设备执行如本申请实施例第一至第三方面任一方法中所描述的部分或全部步骤。
第九方面,本申请实施例提供了一种计算机可读存储介质,其中,所述计算机可读存储介质存储用于电子数据交换的计算机程序,其中,所述计算机程序使得计算机执行如本申请实施例第一至第三方面任一方法中所描述的部分或全部步骤。
第十方面,本申请实施例提供了一种计算机程序,其中,所述计算机程序可操作来使计算机执行如本申请实施例第一至第三方面任一方法中所描述的部分或全部步骤。该计算机程序可以为一个软件安装包。
下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍。
图1A是本申请实施例提供的一种信息处理方法的流程示意图;
图1B是本申请实施例提供的一种多设备统一管理系统的架构示意图
图1C是本申请实施例提供的一种一对一模式下多设备协同使用同一个应用的示意图;
图1D是本申请实施例提供的另一种一对一模式下多设备协同使用同一个应用的示意图;
图1E是本申请实施例提供的一种多对一模式下单设备展示多个设备运行不同类型应 用的界面的示意图;
图1F是本申请实施例提供的一种多对一模式下单设备展示多个设备运行同类型应用的界面的示意图;
图1G是本申请实施例提供的一种一对多模式下多个设备展示同一个设备的应用界面的示意图;
图1H是本申请实施例提供的一种MVC模式下多个设备协作运行同一个应用的示意图;
图2A是本申请实施例提供的一种信息处理方法的流程示意图;
图2B是本申请实施例提供的一种通过其他设备展示当前设备的后台运行的单个应用的应用界面的示意图;
图2C是本申请实施例提供的一种通过其他设备展示当前设备运行的多个应用的应用界面的示意图;
图3A是本申请实施例提供的一种信息处理方法的流程示意图;
图3B是本申请实施例提供的一种跨设备流转目标内容的示意图;
图3C是本申请实施例提供的一种应用层流媒体重定向架构的示意图;
图3D是本申请实施例提供的一种应用层流媒体重定向的数据流图;
图4是本申请实施例提供的一种信息处理的功能单元组成框图;
图5是本申请实施例提供的一种信息处理的结构示意图;
图6是本申请实施例提供的另一种信息处理的功能单元组成框图;
图7是本申请实施例提供的另一种信息处理的结构示意图;
图8是本申请实施例提供的另一种信息处理的功能单元组成框图;
图9是本申请实施例提供的另一种信息处理的结构示意图。
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别不同对象,而不是用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其他步骤或单元。
在本文中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本文所描述的实施例可以与其它实施例相结合。
目前,通过电视机内部的无线高保真Wi-Fi设备构建端到端P2P网络,定义电视机为P2P设备组管理端,定义移动终端为P2P设备组客户端;启动miracast协议,当电视机接 收到一个或多个移动终端的投屏请求时,则将一个或多个移动终端的屏幕内容均投放到电视机的显示屏。
此种方式仅能够满足显示层面单向的投屏播放需求,难以满足用户日益丰富化的应用需求。
针对上述问题,本申请实施例提供一种信息处理方法,下面结合附图进行详细说明。
请参阅图1A,图1A是本申请实施例提供的一种信息处理方法的流程示意图,应用于目标设备集合中的任意一个支持显示功能的电子设备,所述目标设备集合为同一个用户账户下的一个或多个设备所组成的设备集合,如图所示,该方法包括:
步骤101,第一电子设备输出来自第二电子设备的目标内容。
其中,所述目标内容可以是第二电子设备中的特定文件类型的数据,如文档、照片、视频、音乐等,第一电子设备可以通过本地能够读取这些文件的应用来输出对应的内容,如通过视频播放器来独权读取的视频文件进行影像播放,又如通过音乐播放器读取对应的音乐文件进行音乐播放等。
此外,所述目标内容还可以第二电子设备中的目标应用在运行状态下的应用数据,例如游戏应用的UI数据、音频数据、振动数据等,第一电子设备可以通过分布式应用机制、本地兼容应用机制、重定向应用机制(具体又分为基于控件绑定的重定向、基于部分投屏的重定向、大屏到小屏的重定向、通用的投屏方式)中的任意一种来实现内容的输出。
具体实现中,第一电子设备上显示统一桌面,统一桌面上现有元数据,元数据关联设备的相同文件类型的数据或者关联设备的应用,这些元数据通过服务器+终端的多设备管理系统实现。
一个元数据由以下内容组成:
1.显示图片,显示在统一桌面上的图标。
2.名称,显示在统一桌面的名称。
3.唯一路径,能访问这个元数据的唯一路径。
唯一路径中有唯一设备身份标识ID,以及在这个设备下元数据的唯一路径。
4.元数据类别:文件类型(例如:音乐、视频、文档、照片等元数据)、应用类型(例如:设备层级的元数据、聚合应用层级的元数据、独立应用层级的元数据)。
5.每种数据自己的一些属性,如图片的大小、视频的时长等。
元数据的这些属性能够让统一桌面很好的展现这些数据,并能在用户触发使用时,找到合适的打开方式。
具体实现中,如图1B所示的多设备统一管理系统的架构示意图,统一桌面具体可以通过服务器和终端的方式实现。
其中,服务器(图示为云端系统)主要负责用户名下设备的管理以及应用和数据的管理,具体可以包括设备管理模块、应用管理模块、用户管理模块,设备管理模块、应用管理模块、用户管理模块中任意两个模块相互通信连接。
其中,终端(图示为设备A、设备B、设备C)包括统一桌面系统和/或后台支撑系统,统一桌面系统包括用户接口UI模块、重定向接收端Sink模块、应用决策模块、自有应用模块中的至少一个,后台支撑系统包括连接模块、分布式数据服务系统、分布式资源系统、重定向发起端source系统中的至少一个。
所述统一桌面系统是主要的交互入口,用户通过这个系统实现对多设备的统一管理和使用。
所述连接模块用于保证多设备的连接,具体可以支持各种常规的通信技术,如移动通信技术(第五代移动通信技术5G等)、局域网短距离无线通信技术(蓝牙、超带宽UWB等)。
所述分布式数据服务系统用于实现数据在多个设备间的互通。
所述重定向source系统和分布式资源系统用于实现应用的跨端使用。
其中,不同的设备可以同时设置有统一桌面系统和后台支撑系统,或者只有其中一个部分,取决于设备的能力。
例如,手机、PC等富能力设备可以同时有统一桌面系统和后台支撑系统,客户前置设备CPE、路由器等可以只有后台支撑系统,web端可以只有统一桌面系统。
其中,所述目标内容为所述第二电子设备实际输出的以下至少一种信息:音频、视频、图片、文字、动作信息(例如:振动信息)。
步骤102,所述第一电子设备接收来自所述第二电子设备的更新后的所述目标内容,所述更新后的所述目标内容是所述第二电子设备执行以下操作获取的:接收来自目标设备的针对所述目标内容的控制信息,根据所述控制信息更新所述目标内容,并向所述第一电子设备发送更新后的所述目标内容;
其中,所述目标设备包括所述第一电子设备或者除所述第一电子设备和所述第二电子设备之外的第三电子设备。
步骤103,所述第一电子设备输出更新后的所述目标内容。
按照流转两侧设备的数量的差异性,可以分为一对一模式、多对一模式、一对多模式、以及MVC模式(模型-视图-控制器,M是指业务模型,V是指用户界面,C则是控制器,使用MVC的目的是将M和V的实现代码分离,从而使同一个程序可以使用不同的表现形式。比如一批统计数据可以分别用柱状图、饼图来表示。C存在的目的则是确保M和V的同步,一旦M改变,V应该同步更新)。
下面结合示例进行说明。
例如,如图1C所示,一对一模式下,假设手机与PC互联,手机上运行有视频应用,PC上未安装视频应用,则PC可以共享手机端视频应用的显示播放能力,即将手机端游戏画面与声音流转到PC端进行播放,从而实现跨设备使用视频应用。
又例如,如图1D所示,一对一模式下,情侣在两个手机上合作玩同一款游戏,颠覆传统单机游戏的玩法,通过本申请实施例提供的多设备协同能力,将单人游戏扩展为多人游戏,从玩法和体验上带来创新。即设备A运行游戏应用a,设备B将设备A运行的游戏应用a的画面和声音流转到本端设备上播放,且设备B上的操作信息可以流转回设备A进行响应,已经将响应后的画面信息和声音信息再流转回来,从而实现应用数据与控制信息流转。
又例如,多对一模式下,多路音视频流共同呈现在同一大屏设备上,这里多路音视频流的来源不做限制,可能来自不同的设备,也可能来自同一个设备的多个物理屏幕,也可能来自同一个设备的多个虚拟屏幕,甚至来自于大屏设备本身。如图1E所示,图例中手机1、手机2、手机3以及平板的画面均呈现到电视的大屏上。
又例如,如图1F所示,多对一模式下,手机到TV的多人投屏产品即采用多对一模式,最多支持四路画面同时呈现。对于多路画面的呈现,还会根据当前的输入源的显示状态来生成动态布局。图例为4用户共同使用应用1时,各个用户终端所显示的应用画面均呈现到同一个屏幕上进行展示。
又例如,如图1G所示,一对多模式下,可以细分到两个维度,设备级和应用级。多路所分发的音视频流内容是相同的,因此在这个模式中,对于音视频的采集以及编码是复用的,只是在流分发时拆分为多路。
一对多模式可用于视频会议类型的场景,可以将某个设备(即重定向发起端)的音视频信息同时重定向到手机/PC/TV多端,每个重定向接收端可以单独配置其显示/反控权限。
又例如,如图1H所示,MVC模式下,控制、显示、数据三方参与的模式,实现显示/运行/控制分离,充分发挥各个设备的优势,多方协同来完成一个跨端任务。图例中,电视展现大屏的显示能力,PC发挥键盘鼠标的控制的优势,手机提供应用、数据和算力,为用户带来更好的跨端游戏体验。(对于控制的注入,还可以使用蓝牙手柄一类的外设)该场景中可以包括如下数据交互步骤。
(1)PC向手机1查询分布数据。
(2)手机1向PC提供分布数据。
(3)PC向电视推送连接配置。
(4)电视向手机1请求影像连接。
(5)手机1向电视提供视频流。
(6)PC向手机1发送控制信息。
可以看出,本申请实施例中,第一电子设备能够展示第二电子设备的目标内容的同时,能够动态跟随显示由第二电子设备根据针对该目标内容的控制信息更新后的目标内容,且录入该控制信息的目标设备可以是第一电子设备本身也可以是其他设备,如此使得第一电子设备展示目标内容的过程与第一电子设备自身运行本地应用来进行内容展示的过程在效果上较为一致,从而保证用户体验的同时,提高多设备互联场景中内容显示与控制的全面性和灵活性。
请参阅图2A,图2A是本申请实施例提供的一种信息处理方法的流程示意图,应用于目标设备集合中的任意一个支持显示功能的电子设备,如图所示,该方法包括:
步骤201,第一电子设备输出来自第二电子设备的目标内容,所述目标内容为所述第二电子设备在运行目标应用的状态下未实际输出的信息。
其中,所述目标应用为后台运行的应用。
其中,所述目标内容包括以下至少一种信息:音频、视频、图片、文字、动作信息(例如:振动信息)。
其中,针对应用级投屏,为了适应PC的操作习惯,也为了手机上应用间数据的传输,以及不影响当前手机使用,本申请实施例提出应用级投屏的概念。区别于传统的镜像投屏,这种模式支持后台多路投屏,将手机从单任务模式扩展为多任务模式。并且能自适应客户端的显示分辨率,支持应用级反向控制。应用级投屏的具体实现机制是实现应用程序在服务(例如:显示服务、声音服务、定位服务、输入服务、支付服务等各类服务)颗粒度层级的分布式管理。
例如,如图2B所示,后台模式下,将游戏后台投屏到PC上进行显示和控制,实现边玩游戏边刷微信,二者互不干扰。图例中手机1作为重定向发起端前台运行应用1,显示应用1的画面1,后台运行应用2,向PC发送音频/视频流,PC作为重定向接收端在屏幕上显示应用2的画面2,并可以向手机1发送控制流。
例如,如图2C所示,多窗口模式下,在大屏设备上以多窗口的方式同时打开多个应用,提高办公效率和娱乐体验。图例中手机1作为重定向发起端运行应用1、应用2和应用3,PC端作为重定向接收端在屏幕上同时呈现应用1画面、应用2画面以及用于3画面。
对各种复杂智能互联场景的支持,体现了本实施例方案的灵活性,对于终端用户或上层应用开发者,很容易通过配置和二次开发组装出定制化的互联场景。
可以看出,本申请实施例中,第一电子设备能够展示第二电子设备在运行目标应用的状态下未实际输出的信息,即虽然本端未安装目标应用,但第一电子设备能够通过显示屏等能力器件输出该目标应用在运行状态需要对外输出的可感知的目标内容,从而实现目标应用的跨端使用,提高多设备互联场景下应用数据展示的灵活性与全面性。
在一个可能的示例中,所述目标应用包括多个应用;所述第一电子设备输出来自第二电子设备的目标内容,包括:所述第一电子设备以多窗口的方式显示所述多个应用的界面数据。
其中,所述多个应用可以是同类型或者不同类型的应用,此处不做唯一限定。
可见,本示例中,第一电子设备能够显示其他设备运行的多个应用的界面,实现跨端多应用的使用,提高多设备互联场景中应用使用的便捷性和灵活性。
请参阅图3A,图3A是本申请实施例提供的一种信息处理方法的流程示意图,应用于目标设备集合中的任意一个支持显示功能的电子设备,如图所示,该方法包括:
步骤301,第一电子设备检测到将目标内容流转至第二电子设备的触发操作,所述目标内容为目标应用在运行状态下所产生的应用数据;
其中,所述触发操作包括以下任意一种:触控操作、手势操作、语音操作、近距离无线通信(例如:近场通信NFC通信、超带宽UWB通信);所述目标内容包括以下至少一种信息:音频、视频、图片、文字、动作信息(例如:振动信息)。
步骤302,所述第一电子设备向所述第二电子设备发送所述目标内容,所述目标内容用于所述第二电子设备输出所述目标内容。
其中,目标内容为视频时,具体是指屏幕画面的流转,设备间流转的模式主要分为两种,一种是应用由源设备流转到目标设备,该过程中应用会保持当前会话状态不中断,另一种为两个目标设备间的流转,该过程中原目标设备的会话状态可以中断,即不再显示应用的界面,流转的触发方式包括但不限于NFC、UWB、手势、语音等。
其中,所述第一电子设备向所述第二电子设备发送所述目标内容之后,所述方法还包括:所述第一电子设备取消显示所述目标内容。
如图3B所示,手机1为重定向发起端,运行应用1的画面1,PC和电视均为目标设备,手机1的画面1流转到PC上,手机1的应用界面保持,PC向电视流转画面时,电视成功接收并显示应用1的画面后,PC端的画面可以不再显示。
可以看出,本申请实施例中,电子设备能够将目标应用在运行状态下所产生的应用数 据以流转的方式在多个设备之间切换,从而实现多设备互联场景下应用数据的跨端输出,提高多设备互联场景下应用数据的使用灵活性和全面性。
在一个可能的示例中,所述第一电子设备向所述第二电子设备发送所述目标内容,包括:所述第一电子设备通过多设备管理服务器间接向所述第二电子设备发送所述目标内容;或者,所述第一电子设备通过预设通信网络直接向所述第二电子设备发送所述目标内容。
可见,本示例中,第一电子设备作为流转源设备时,可以通过直接或者间接方式与流转目标设备传输数据以实现内容的跨设备输出,提高多设备互联场景中内容使用的灵活性和便捷性。
在一个可能的示例中,所述目标内容为第三电子设备运行的目标应用在运行状态下所产生的应用数据;所述第一电子设备向所述第二电子设备发送所述目标内容,包括:所述第一电子设备向所述第三电子设备发送流转请求,所述流转请求包括作为内容接收设备的所述第二电子设备的设备信息,所述流转请求用于所述第三电子设备执行以下操作:通过多设备管理服务器间接向所述第二电子设备发送所述目标内容;或者,通过预设通信网络直接向所述第二电子设备发送所述目标内容。
可见,本示例中,第一电子设备作为流转发起设备且本身不是目标内容的源设备时,可以通过服务器中转或者直接通信方式与内容接收设备传输数据以实现内容的跨设备输出,提高多设备互联场景中内容使用的灵活性和便捷性。
下面对支撑前述方法实施例的技术原理进行说明。
如图3C所示,分层模型具体包括:
1.应用层:负责对外提供重定向服务、UI交互以及投屏效果呈现。
2.服务层:封装和组合下层功能模块,为应用层提供更高抽象的各类服务。
3.重定向层:负责音视频数据的采集和播放,以及控制数据的捕获、处理和反向控制。
4.编解码层:负责流媒体数据的编解码。
5.数据通道层:向上提供业务数据通道,将二进制数据流封装成具有业务逻辑的数据帧,如视频帧、音频帧和控制信令。
6.传输层:基于标准或自定义的网络通信协议进行二进制数据流的传输。
核心功能模块具体包括:
1.重定向管理器(Redirect Manager,图示为重定向管理):用于提供各种重定向服务。
2.连接管理器(Connection Manager,图示为连接管理):用于建立连接通道,支持多种连接方式和传输协议。
3.设备管理器(Device Manager,图示为设备管理):用于管理设备信息,用于软硬件能力协商。
4.状态管理器(Status Manager,图中未示出):用于监控并同步投屏的各种正常与异常状态。
5.场景管理器(Scene Manager,图中未示出):用于负责两个维度的场景管理。部署层:配置部署各种互联投屏场景;应用层:针对不同的应用采用定制化的启动策略。
6.视频采集重定向(Video Sampler&Redirector,图示为视频采集重定向):用于负责视频流采集,设备级采用屏幕录制,应用级显示重定向。
7.视频渲染(Video Renderer,图示为视频渲染):视频渲染显示模块,用于在多路呈现 时使用OpenGL图元预处理及合并渲染。
8.控制采集、传输(Control Sampler&Handler,图示为控制传输和控制采集):用于负责反向控制的采集、操作映射及分发执行,同样包含应用级和设备级两个层级。
9.视频编码、解码(Video Encoder&Decoder,图示为视频编码和视频解码):视频编解码模块,用于负责视频编解码相关工作,视频编码格式主要采用AVC(H264)和HEVC(H265)。
10.音频编码、解码(Audio Encoder&Decoder,图示为视音频频编码和音频解码):音频编解码模块,用于负责音频编解码相关工作,音频编码格式主要采用PCM原始码流和AAC。
11.视频/音频/控制通道(Video/Audio/Control Channel,图示为视频通道、音频通道、控制通道):用于视频/音频/控制通道,向上封装提供业务数据通道,向下负责序列化/反序列化通道所对应的视频帧/逻辑帧/控制信令。
12.Tcp/Quic/NST通道Tunnel(图示为Tcp通道、Quic通道、NST通道):用于负责网络IO层的二进制数据传输,提供同步/异步读写能力。NST Tunnel是自主设计的近场低延时定制流媒体协议。
如图3D所示的运行时的数据流图,图3D中,重定向发起端通过ARS发起模块通知重定向管理器建立一个或多个应用级重定向服务,每个应用级重定向服务进行音频/视频/控制信息的传输,以及响应控制信息,并通过连接管理器实现与重定向接收端的通信,重定向接收端通过本端的重定向管理器建立一个或多个应用级重定向服务,每个应用级重定向服务进行视频的解码、渲染和显示,以及进行音频的解码和播放,以及进行控制信息的接收与回传等。
其中,ARS是指应用级重定向服务,将设备上运行的应用画面以视频流的形式提供给第三方设备,允许第三方设备展示、操作当前设备上的应用。支持多个应用同时运行,和pc上的操作习惯一致。
本申请实施例顺应当下万物互融的发展理念,提供了一套更加统一灵活通用的重定向框架。支持主流智能终端设备、操作系统、连接方式、数据通道和传输协议,屏蔽其异构性,并在各个层次及模块具有高扩展性,可持续进行扩展和适配。
随着互联互通的需求越来越强,当前的解决方案只能满足用户的部分诉求,用户不得不同时采用多套解决方案才能覆盖。而本发明在同一套技术方案下可以搭建出各种智能互联场景,包括一对一、多对一、一对多、MVC(运行/显示/控制分离)、应用级投屏、应用流转等。其中一些投屏模式是本申请实施例中创新提出的,如MVC模式。
设备与平台兼容性可扩展(如未来的智能眼镜);智能互联场景可扩展;数据通道可扩展;传输协议可扩展;连接方式可扩展;编解码可扩展。
本申请实施例提供一种信息处理装置,该信息处理装置可以为终端。具体的,信息处理装置用于执行以上桌面元数据的显示方法中终端所执行的步骤。本申请实施例提供的信息处理装置可以包括相应步骤所对应的模块。
本申请实施例可以根据上述方法示例对信息处理装置进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。 本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
在采用对应各个功能划分各个功能模块的情况下,图4示出上述实施例中所涉及的信息处理装置的一种可能的结构示意图。如图4所示,信息处理装置4包括:
输出单元40,用于输出来自第二电子设备的目标内容;
接收单元41,用于接收来自所述第二电子设备的更新后的所述目标内容,所述更新后的所述目标内容是所述第二电子设备执行以下操作获取的:接收来自目标设备的针对所述目标内容的控制信息,根据所述控制信息更新所述目标内容,并向所述第一电子设备发送更新后的所述目标内容;
输出单元42,用于输出更新后的所述目标内容。
在一个可能的示例中,所述目标设备包括所述第一电子设备或者除所述第一电子设备和所述第二电子设备之外的第三电子设备。
在一个可能的示例中,所述目标内容为所述第二电子设备实际输出的以下至少一种信息:音频、视频、图片、文字、动作信息。
其中,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。
在采用集成的单元的情况下,本申请实施例提供的信息处理装置的结构示意图如图5所示。在图5中,信息处理装置5包括:处理模块50和通信模块51。处理模块50用于对信息处理装置的动作进行控制管理,例如,输出单元40所执行的步骤,和/或用于执行本文所描述的技术的其它过程。通信模块51用于支持信息处理装置与其他设备之间的交互。如图4所示,信息处理装置还可以包括存储模块52,存储模块52用于存储信息处理装置的程序代码和数据。
其中,处理模块50可以是处理器或控制器,例如可以是中央处理器(Central Processing Unit,CPU),通用处理器,数字信号处理器(Digital Signal Processor,DSP),ASIC,FPGA或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。所述处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。通信模块51可以是收发器、RF电路或通信接口等。存储模块可以是存储器。
其中,上述方法实施例涉及的各场景的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。上述信息处理装置均可执行上述图1A所示的桌面元数据的显示方法中终端所执行的步骤。
本申请实施例提供一种信息处理装置,该信息处理装置可以为终端。具体的,信息处理装置用于执行以上桌面元数据的显示方法中终端所执行的步骤。本申请实施例提供的信息处理装置可以包括相应步骤所对应的模块。
本申请实施例可以根据上述方法示例对信息处理装置进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
在采用对应各个功能划分各个功能模块的情况下,图6示出上述实施例中所涉及的信息处理装置的一种可能的结构示意图。如图6所示,信息处理装置6包括:
输出单元60,用于输出来自第二电子设备的目标内容,所述目标内容为所述第二电子设备在运行目标应用的状态下未实际输出的信息。
在一个可能的示例中,所述目标应用为后台运行的应用。
在一个可能的示例中,所述目标应用包括多个应用;在所述第一电子设备输出来自第二电子设备的目标内容方面,所述输出单元60具体用于:以多窗口的方式显示所述多个应用的界面数据。
在一个可能的示例中,所述目标内容包括以下至少一种信息:音频、视频、图片、文字、动作信息。
其中,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。
在采用集成的单元的情况下,本申请实施例提供的信息处理装置的结构示意图如图7所示。在图7中,信息处理装置7包括:处理模块70和通信模块71。处理模块70用于对信息处理装置的动作进行控制管理,例如,输出单元60所执行的步骤,和/或用于执行本文所描述的技术的其它过程。通信模块71用于支持信息处理装置与其他设备之间的交互。如图6所示,信息处理装置还可以包括存储模块72,存储模块72用于存储信息处理装置的程序代码和数据。
其中,处理模块70可以是处理器或控制器,例如可以是中央处理器(Central Processing Unit,CPU),通用处理器,数字信号处理器(Digital Signal Processor,DSP),ASIC,FPGA或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。所述处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。通信模块71可以是收发器、RF电路或通信接口等。存储模块可以是存储器。
其中,上述方法实施例涉及的各场景的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。上述信息处理装置均可执行上述图2A所示的桌面元数据的显示方法中终端所执行的步骤。
本申请实施例提供一种信息处理装置,该信息处理装置可以为终端。具体的,信息处理装置用于执行以上桌面元数据的显示方法中终端所执行的步骤。本申请实施例提供的信息处理装置可以包括相应步骤所对应的模块。
本申请实施例可以根据上述方法示例对信息处理装置进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
在采用对应各个功能划分各个功能模块的情况下,图8示出上述实施例中所涉及的信息处理装置的一种可能的结构示意图。如图8所示,信息处理装置8包括:
检测单元80,用于检测到将目标内容流转至第二电子设备的触发操作,所述目标内容为目标应用在运行状态下所产生的应用数据;
发送单元81,用于向所述第二电子设备发送所述目标内容,所述目标内容用于所述第二电子设备输出所述目标内容。
在一个可能的示例中,所述触发操作包括以下任意一种:触控操作、手势操作、语音操作、近距离无线通信;
所述目标内容包括以下至少一种信息:音频、视频、图片、文字、动作信息。
在一个可能的示例中,在所述向所述第二电子设备发送所述目标内容方面,所述发送单元81具体用于:通过多设备管理服务器间接向所述第二电子设备发送所述目标内容;或者,通过预设通信网络直接向所述第二电子设备发送所述目标内容。
在一个可能的示例中,所述目标内容为第三电子设备运行的目标应用在运行状态下所产生的应用数据;在所述向所述第二电子设备发送所述目标内容方面,所述发送单元81具体用于:向所述第三电子设备发送流转请求,所述流转请求包括作为内容接收设备的所述第二电子设备的设备信息,所述流转请求用于所述第三电子设备执行以下操作:通过多设备管理服务器间接向所述第二电子设备发送所述目标内容;或者,通过预设通信网络直接向所述第二电子设备发送所述目标内容。
在一个可能的示例中,所述装置还包括显示单元,用于取消显示所述目标内容。
其中,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。
在采用集成的单元的情况下,本申请实施例提供的信息处理装置的结构示意图如图9所示。在图9中,信息处理装置9包括:处理模块90和通信模块91。处理模块90用于对信息处理装置的动作进行控制管理,例如,显示单元80所执行的步骤,和/或用于执行本文所描述的技术的其它过程。通信模块91用于支持信息处理装置与其他设备之间的交互。如图8所示,信息处理装置还可以包括存储模块92,存储模块92用于存储信息处理装置的程序代码和数据。
其中,处理模块90可以是处理器或控制器,例如可以是中央处理器(Central Processing Unit,CPU),通用处理器,数字信号处理器(Digital Signal Processor,DSP),ASIC,FPGA或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。所述处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。通信模块91可以是收发器、RF电路或通信接口等。存储模块可以是存储器。
其中,上述方法实施例涉及的各场景的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。上述信息处理装置均可执行上述图3A所示的桌面元数据的显示方法中终端所执行的步骤。
Claims (20)
- 一种信息处理方法,其特征在于,包括:第一电子设备输出来自第二电子设备的目标内容;所述第一电子设备接收来自所述第二电子设备的更新后的所述目标内容,所述更新后的所述目标内容关联目标设备针对所述目标内容的控制信息;所述第一电子设备输出更新后的所述目标内容。
- 根据权利要求1所述的方法,其特征在于,所述更新后的所述目标内容是所述第二电子设备执行以下操作获取的:接收来自目标设备的针对所述目标内容的控制信息,根据所述控制信息更新所述目标内容,并向所述第一电子设备发送更新后的所述目标内容。
- 根据权利要求1或2所述的方法,其特征在于,所述目标设备包括所述第一电子设备或者除所述第一电子设备和所述第二电子设备之外的第三电子设备。
- 根据权利要求1或2所述的方法,其特征在于,所述目标内容为所述第二电子设备实际输出的以下至少一种信息:音频、视频、图片、文字、动作信息。
- 一种信息处理方法,其特征在于,包括:第一电子设备输出来自第二电子设备的目标内容,所述目标内容为所述第二电子设备在运行目标应用的状态下未实际输出的信息。
- 根据权利要求5所述的方法,其特征在于,所述目标应用为后台运行的应用。
- 根据权利要求5或6所述的方法,其特征在于,所述目标应用包括多个应用;所述第一电子设备输出来自第二电子设备的目标内容,包括:所述第一电子设备以多窗口的方式显示所述多个应用的界面数据。
- 根据权利要求5-7任一项所述的方法,其特征在于,所述目标内容包括以下至少一种信息:音频、视频、图片、文字、动作信息。
- 一种信息处理方法,其特征在于,包括:第一电子设备检测到将目标内容流转至第二电子设备的触发操作,所述目标内容为目标应用在运行状态下所产生的应用数据;所述第一电子设备向所述第二电子设备发送所述目标内容。
- 根据权利要求9所述的方法,其特征在于,所述目标内容用于指示所述第二电子设备输出所述目标内容。
- 根据权利要求9所述的方法,其特征在于,所述触发操作包括以下任意一种:触控操作、手势操作、语音操作、近距离无线通信;所述目标内容包括以下至少一种信息:音频、视频、图片、文字、动作信息。
- 根据权利要求9或10所述的方法,其特征在于,所述第一电子设备向所述第二电子设备发送所述目标内容,包括:所述第一电子设备通过多设备管理服务器间接向所述第二电子设备发送所述目标内容;或者,所述第一电子设备通过预设通信网络直接向所述第二电子设备发送所述目标内容。
- 根据权利要求9或10所述的方法,其特征在于,所述目标内容为第三电子设备运行的目标应用在运行状态下所产生的应用数据;所述第一电子设备向所述第二电子设备发送所述目标内容,包括:所述第一电子设备向所述第三电子设备发送流转请求,所述流转请求包括作为内容接收设备的所述第二电子设备的设备信息,所述流转请求用于所述第三电子设备执行以下操作:通过多设备管理服务器间接向所述第二电子设备发送所述目标内容;或者,通过预设通信网络直接向所述第二电子设备发送所述目标内容。
- 根据权利要求9-13任一项所述的方法,其特征在于,所述第一电子设备向所述第二电子设备发送所述目标内容之后,所述方法还包括:所述第一电子设备取消显示所述目标内容。
- 一种信息处理装置,其特征在于,包括:输出单元,用于输出来自第二电子设备的目标内容;接收单元,用于接收来自所述第二电子设备的更新后的所述目标内容,所述更新后的所述目标内容关联目标设备针对所述目标内容的控制信息;输出单元,用于输出更新后的所述目标内容。
- 一种信息处理装置,其特征在于,包括:输出单元,用于输出来自第二电子设备的目标内容,所述目标内容为所述第二电子设备在运行目标应用的状态下未实际输出的信息。
- 一种信息处理装置,其特征在于,包括:检测单元,用于检测到将目标内容流转至第二电子设备的触发操作,所述目标内容为目标应用在运行状态下所产生的应用数据;发送单元,用于向所述第二电子设备发送所述目标内容。
- 一种电子设备,其特征在于,包括处理器、存储器,以及一个或多个程序,所述一个或多个程序被存储在所述存储器中,并且被配置由所述处理器执行,所述程序包括用于执行如权利要求1-14任一项所述的方法中的步骤的指令。
- 一种计算机可读存储介质,其特征在于,存储用于电子数据交换的计算机程序,其中,所述计算机程序使得计算机执行如权利要求1-14任一项所述的方法。
- 一种计算机程序产品,包括计算机程序或指令,其特征在于,所述计算机程序或指令被处理器执行时实现权利要求1-14任一方法中的步骤。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011281262.1A CN112383803B (zh) | 2020-11-16 | 2020-11-16 | 信息处理方法及相关装置 |
CN202011281262.1 | 2020-11-16 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022100308A1 true WO2022100308A1 (zh) | 2022-05-19 |
Family
ID=74585583
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/121290 WO2022100308A1 (zh) | 2020-11-16 | 2021-09-28 | 信息处理方法及相关装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112383803B (zh) |
WO (1) | WO2022100308A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024114267A1 (zh) * | 2022-11-29 | 2024-06-06 | 华为技术有限公司 | 应用跨设备流转方法、相关装置及通信系统 |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112383803B (zh) * | 2020-11-16 | 2023-04-11 | Oppo广东移动通信有限公司 | 信息处理方法及相关装置 |
CN112860367B (zh) * | 2021-03-04 | 2023-12-12 | 康佳集团股份有限公司 | 设备界面可视化方法、智能终端及计算机可读存储介质 |
CN113676384A (zh) * | 2021-07-26 | 2021-11-19 | 青岛海尔科技有限公司 | 用于设备投屏控制的方法及装置、服务器、存储介质 |
CN114157903A (zh) * | 2021-12-02 | 2022-03-08 | Oppo广东移动通信有限公司 | 重定向方法、装置、设备、存储介质及程序产品 |
CN115729502B (zh) * | 2022-03-23 | 2024-02-27 | 博泰车联网(南京)有限公司 | 投屏端和显示端的响应方法、电子设备及存储介质 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200014986A1 (en) * | 2016-06-02 | 2020-01-09 | John Senew | Apparatus and method for displaying video |
CN111107405A (zh) * | 2019-12-27 | 2020-05-05 | 北京比利信息技术有限公司 | 投屏方法、服务器、投屏系统和存储介质 |
CN111263218A (zh) * | 2020-02-24 | 2020-06-09 | 卓望数码技术(深圳)有限公司 | 一种实现多设备同步交互的方法及系统 |
CN111327769A (zh) * | 2020-02-25 | 2020-06-23 | 北京小米移动软件有限公司 | 多屏互动方法及装置、存储介质 |
CN111510751A (zh) * | 2020-04-26 | 2020-08-07 | 深圳市易平方网络科技有限公司 | 一种跨屏互动的广告投放方法、系统及存储介质 |
CN111752518A (zh) * | 2020-06-19 | 2020-10-09 | 海信视像科技股份有限公司 | 一种显示设备投屏方法及显示设备 |
CN111767012A (zh) * | 2020-05-29 | 2020-10-13 | 维沃移动通信有限公司 | 投屏方法及装置 |
CN112383803A (zh) * | 2020-11-16 | 2021-02-19 | Oppo广东移动通信有限公司 | 信息处理方法及相关装置 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103324457B (zh) * | 2013-06-21 | 2016-09-21 | 东莞宇龙通信科技有限公司 | 终端和多任务数据显示方法 |
DE102014012355A1 (de) * | 2014-08-25 | 2016-02-25 | Unify Gmbh & Co. Kg | Verfahren zur Steuerung einer Multimedia-Anwendung, Softwareprodukt und Vorrichtung |
CN106095084A (zh) * | 2016-06-06 | 2016-11-09 | 乐视控股(北京)有限公司 | 投屏方法及装置 |
CN108958678B (zh) * | 2017-05-25 | 2023-08-29 | 阿里巴巴集团控股有限公司 | 投屏方法、屏幕内容的共享方法及装置 |
CN110381195A (zh) * | 2019-06-05 | 2019-10-25 | 华为技术有限公司 | 一种投屏显示方法及电子设备 |
CN211429437U (zh) * | 2019-10-12 | 2020-09-04 | 中冶赛迪重庆信息技术有限公司 | 一种智能投屏系统 |
CN111314768A (zh) * | 2020-02-24 | 2020-06-19 | 北京小米移动软件有限公司 | 投屏方法、投屏装置、电子设备以及计算机可读存储介质 |
-
2020
- 2020-11-16 CN CN202011281262.1A patent/CN112383803B/zh active Active
-
2021
- 2021-09-28 WO PCT/CN2021/121290 patent/WO2022100308A1/zh active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200014986A1 (en) * | 2016-06-02 | 2020-01-09 | John Senew | Apparatus and method for displaying video |
CN111107405A (zh) * | 2019-12-27 | 2020-05-05 | 北京比利信息技术有限公司 | 投屏方法、服务器、投屏系统和存储介质 |
CN111263218A (zh) * | 2020-02-24 | 2020-06-09 | 卓望数码技术(深圳)有限公司 | 一种实现多设备同步交互的方法及系统 |
CN111327769A (zh) * | 2020-02-25 | 2020-06-23 | 北京小米移动软件有限公司 | 多屏互动方法及装置、存储介质 |
CN111510751A (zh) * | 2020-04-26 | 2020-08-07 | 深圳市易平方网络科技有限公司 | 一种跨屏互动的广告投放方法、系统及存储介质 |
CN111767012A (zh) * | 2020-05-29 | 2020-10-13 | 维沃移动通信有限公司 | 投屏方法及装置 |
CN111752518A (zh) * | 2020-06-19 | 2020-10-09 | 海信视像科技股份有限公司 | 一种显示设备投屏方法及显示设备 |
CN112383803A (zh) * | 2020-11-16 | 2021-02-19 | Oppo广东移动通信有限公司 | 信息处理方法及相关装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024114267A1 (zh) * | 2022-11-29 | 2024-06-06 | 华为技术有限公司 | 应用跨设备流转方法、相关装置及通信系统 |
Also Published As
Publication number | Publication date |
---|---|
CN112383803A (zh) | 2021-02-19 |
CN112383803B (zh) | 2023-04-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022100308A1 (zh) | 信息处理方法及相关装置 | |
CN105656749B (zh) | 分布式无线多屏虚拟pc服务系统 | |
WO2021143182A1 (zh) | 游戏的处理方法、装置、电子设备及计算机可读存储介质 | |
KR102394296B1 (ko) | 다수의 디바이스 상에 컴퓨팅 환경의 제시 | |
US20220239718A1 (en) | Communication Protocol Switching Method, Apparatus, and System | |
JP6492227B2 (ja) | コンテンツ投影のための方法およびモバイル端末 | |
JP2019537158A (ja) | リソース共有方法、装置およびシステム | |
JP2023503679A (ja) | マルチウィンドウ表示方法、電子デバイス及びシステム | |
CN103516882B (zh) | 一种基于多屏互动场景图片播放方法及系统 | |
CN111970546A (zh) | 一种控制终端交互的方法、装置、电子设备和存储介质 | |
WO2018133571A1 (zh) | 一种基于移动智能终端的分布式pc系统 | |
CN103338346A (zh) | 一种实现多媒体数字会议的方法及系统 | |
CN106933523A (zh) | 一种多屏互动方法及装置 | |
CN110448902A (zh) | 对外部设备进行虚拟化映射与控制的方法、装置与系统 | |
WO2022135210A1 (zh) | 一种增强的屏幕共享方法和系统、电子设备 | |
US20240137617A1 (en) | Video playing method and apparatus, and storage medium | |
Lee et al. | FLUID-XP: Flexible user interface distribution for cross-platform experience | |
Ha et al. | N-screen service using I/O virtualization technology | |
US10514959B2 (en) | Distributed virtual local operating system stored in cloud and its method | |
CN116233209A (zh) | 一种gpu云渲染服务远程管理调度方法 | |
WO2016107174A1 (zh) | 多媒体文件数据的处理方法及系统、播放器和客户端 | |
CN116136751B (zh) | 一种用于主屏以及次屏跨操作系统的镜像方法 | |
CN114979756B (zh) | 一种实现一分多的投屏独立显示和交互方法、装置及设备 | |
CN102438176B (zh) | 基于igrs技术的将移动终端内容在电视端显示的方法 | |
JP2024524877A (ja) | 共有に基づく拡張現実コンテンツサービスシステム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21890836 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21890836 Country of ref document: EP Kind code of ref document: A1 |