WO2023046028A1 - 用于分布式显示的屏幕识别方法、介质及电子设备 - Google Patents

用于分布式显示的屏幕识别方法、介质及电子设备 Download PDF

Info

Publication number
WO2023046028A1
WO2023046028A1 PCT/CN2022/120614 CN2022120614W WO2023046028A1 WO 2023046028 A1 WO2023046028 A1 WO 2023046028A1 CN 2022120614 W CN2022120614 W CN 2022120614W WO 2023046028 A1 WO2023046028 A1 WO 2023046028A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
target content
electronic
application
online
Prior art date
Application number
PCT/CN2022/120614
Other languages
English (en)
French (fr)
Inventor
涂林林
周亮
刘辉
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP22872072.8A priority Critical patent/EP4387210A1/en
Publication of WO2023046028A1 publication Critical patent/WO2023046028A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1438Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using more than one graphics controller
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43078Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen for seamlessly watching content streams when changing device, e.g. when watching the same program sequentially on a TV and then on a tablet
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user

Definitions

  • the present application relates to the technical field of terminals, and in particular to a screen identification method, media and electronic equipment for distributed display.
  • a user or family often has multiple electronic devices.
  • the user may need to switch the content currently displayed on one electronic device to another electronic device for continuous display.
  • a user uses a mobile phone to read an e-book on the way home from get off work, and may wish to switch the e-book to a more suitable e-reader to continue reading the e-book after returning home.
  • a user can use a tablet computer to browse web documents at home. When the user leaves home, he may wish to switch the web text on the tablet computer to a more portable mobile phone to continue browsing web text.
  • the user is required to artificially pre-select the electronic device for realizing the continuous display function.
  • the electronic device to be switched needs to passively establish a connection with the electronic device pre-selected by the user to realize the continuous display function under the user's operation, and the user experience is not good.
  • Embodiments of the present application provide a screen recognition method, medium and electronic equipment for distributed display.
  • the first electronic device first determines the target content to be continuously displayed by other electronic devices, and then determines the second target content suitable for continuous display of the aforementioned target content from multiple electronic devices based on the determined target content. the electronic device, and send to the second electronic device the continuation data required for the continuation and display of the target content on the second electronic device. The second electronic device continues to display the target content according to the connection data received from the first electronic device.
  • the target display content determined by the first electronic device is the content currently displayed by the first electronic device
  • the first electronic device can determine the current application scenario according to the currently displayed content, so that according to the current application scenario, automatically select from other Determining a second electronic device suitable for continuing to display the currently displayed content among the electronic devices helps to improve user experience.
  • the embodiment of the present application provides a source display device, including:
  • a first determining unit configured to determine the target content to be continuously displayed on other display devices in the source display device
  • the second determining unit is configured to determine a target display device suitable for successively displaying the target content from a plurality of display devices based on the target content;
  • the sending unit is configured to send to the target display device the connection data required for continuous display of the target content on the target display device.
  • the target content is online web articles, offline web articles, online e-books, offline e-books, videos, games, and so on.
  • the foregoing target content is content currently displayed by a source display device.
  • the current application scenario can be determined according to the content currently displayed by the source display device, so that according to the current application scenario, a target display device suitable for continuing to display the target content is automatically determined from multiple display devices. Help improve user experience.
  • the above-mentioned second determination unit determines a target display device suitable for displaying the target content successively from multiple display devices in the following manner:
  • the second determination unit determines the application scenario corresponding to the target content based on the target content
  • the second determining unit determines a target display device suitable for successively displaying the target content from the plurality of display devices according to the application scenario.
  • the application scenarios can be online web text reading scenarios, offline web text reading scenarios, online e-book reading scenarios, offline e-book reading scenarios, mixed bookshelf cross-device circulation scenarios, and so on.
  • the mixed bookshelf cross-device transfer scenario can be to batch multiple offline e-books, multiple online e-books, or multiple e-books including online e-books and offline e-books in a reading APP of the source display device. Books are managed and/or displayed sequentially by the target application in the target display device.
  • the target application on the target display device can be the same as the application used to open the target content on the source display device, and can also be different from the application used to open the target content on the source display device.
  • the above-mentioned second determination unit determines a target display device suitable for displaying the target content successively from multiple display devices in the following manner:
  • the second determining unit determines, based on the target content, that the application scene corresponding to the target content is the reading scene;
  • the second determination unit determines a target display device suitable for successively displaying the target content in the reading scene from the plurality of display devices according to the reading scene.
  • a target display device suitable for successively displaying the target content in the reading scene can be automatically determined from multiple display devices, which can improve user experience.
  • the above-mentioned second determining unit determines the application scenario corresponding to the target content in the following manner:
  • the second determining unit determines, based on the target content, a first application installed on the source display device for displaying the target content;
  • the second determining unit determines the application scenario corresponding to the target content according to the first application.
  • the application scenarios are uniquely determined. For example, reading APP, users can only read e-books through the reading APP, and cannot chat, video, or read online articles through the reading APP.
  • the source display device stores a whitelist of APPs corresponding to the reading scene, and these whitelists include identification information of various reading APPs, for example, WeChat reading APP, palm reading APP, etc.
  • the source display device obtains through monitoring that the APP corresponding to the current display interface is in the above-mentioned white list, it determines that the current application scene is a reading scene.
  • the application scenarios cannot be determined.
  • WeChat APP there are various views such as the chat session interface, the circle of friends display interface, the web text interface accessed through the network link, etc., and the target content itself needs to be analyzed. , and further determine which one of the above-mentioned chat session interface, Moments display interface, and web text interface is the target content, so as to obtain a uniquely determined application scenario.
  • the above-mentioned sending unit sends to the target display device the connection data required for continuing to display the target content on the target display device in the following manner:
  • the sending unit sends to the target display device via Bluetooth the connection data required for continuing to display the target content on the target display device;
  • the sending unit transmits to the target display device through point-to-point wireless fidelity (Wireless-Fidelity point-to-point, Wi-Fi P2P) to continue displaying the online content on the target display device The required continuation data.
  • point-to-point wireless fidelity Wireless-Fidelity point-to-point, Wi-Fi P2P
  • connection data corresponding to the online web text and the online e-book are sent via bluetooth.
  • Another example is to send the connection data corresponding to offline web texts and offline e-books through Wi-Fi P2P.
  • the above-mentioned continuation data is the online web text continuation data
  • the online web text continuation data includes the uniform resource identifier (UniformResource Identifier, URI); or
  • the continuation data is offline web text continuation data
  • the offline web text continuation data includes a file displaying the offline web text
  • the continuation data is the online e-book continuation data
  • the online e-book continuation data includes the identification of the online e-book and the reading progress
  • the continuation data is the offline electronic book continuation data
  • the offline electronic book continuation data includes files and reading progress of the offline electronic book.
  • the above-mentioned online web document connection data further includes at least one of the title of the online web document, the resolution source, the resolution time, the server source, and the integrity verification identifier.
  • the offline web document connection data further includes at least one of the URI, title, resolution source, resolution time, server source, and integrity verification identifier of the offline web text.
  • the online electronic book continuation data further includes: a chapter structure of the online electronic book.
  • the target display device can synchronize the chapters of the online electronic book according to the chapter structure of the online electronic book.
  • the offline electronic book continuation data further includes: at least one of an online electronic book identifier and a chapter structure.
  • connection data includes an application package name
  • the application package name is used to instruct the target display device to open the target content through the application corresponding to the application package name.
  • the target display device can open the target content through the first application.
  • the target display device can open the target content through the second application.
  • connection data may not include the application package name.
  • the target display device may open the target content through the same application as the first application installed on the source display device for opening the target content.
  • connection data further includes identity authentication information of a first application installed on the source display device for displaying target content, and the identity authentication information is used to enable the target display device to Permissions for the application's server to obtain the targeted content.
  • the server installed on the source display device for displaying the first application of the target content has a relationship with the server installed on the target display device for the second application of the target content to be continuously displayed.
  • the mutual access authority enables the server of the second application to have the authority to access the target content in the server of the first application, wherein the first application of the source display device obtains the target content from the server of the first application.
  • an embodiment of the present application provides a target display device, including:
  • the receiving unit is configured to receive the continuation data sent by the source display device and required for continuous display of the target content on the target display device, wherein the target content is determined by the first determination unit of the source display device to pass through the source display device.
  • the display unit is used to continuously display the target content according to the connection data received from the transmission unit of the source display device.
  • the continuation data is the online web text continuation data
  • the online web text continuation data includes a uniform resource identifier (UniformResource Identifier) of the online web text , URI); or
  • the continuation data is the offline web text continuation data
  • the offline web text continuation data includes the file of the offline web text
  • the continuation data is the online e-book continuation data
  • the online e-book continuation data includes the identification of the online e-book and the reading progress
  • the continuation data is the offline electronic book continuation data
  • the offline electronic book continuation data includes files and reading progress of the offline electronic book.
  • the display unit continues to display the target content in the following manner:
  • the display unit continues to display the online web text according to the URI received from the source display device;
  • the display unit continues to display the offline web text according to the file of the offline web text received from the sending unit of the source display device;
  • the display unit continues to display the online electronic book according to the identification of the online electronic book received from the sending unit of the source display device;
  • the display unit continues to display the offline electronic book according to the file of the online electronic book received from the sending unit of the source display device.
  • the online web document continuation data further includes at least one of the online web document title, resolution source, resolution time, server source, and integrity verification identifier.
  • the offline web document connection data further includes at least one of the URI, title, resolution source, resolution time, server source, and integrity verification identifier of the offline web document.
  • the online electronic book continuation data further includes: a chapter structure of the online electronic book.
  • the offline electronic book continuation data further includes: at least one of an online electronic book identifier and a chapter structure.
  • connection data includes an application package name
  • the application package name is used to instruct the target display device to open the target content through the application corresponding to the application package name.
  • connection data further includes the identity authentication information of the first application installed on the source display device for displaying the target content, and the identity authentication information is used to enable the target display device to have The server's permission to obtain the target content.
  • the server installed on the source display device for displaying the first application of the target content has mutual communication with the server installed on the target display device for displaying the second application of the target content successively.
  • the access authority enables the server of the second application to have the authority to access the target content in the server of the first application, wherein the first application of the source display device obtains the target content from the server of the first application.
  • the target display device is installed with a second application for displaying target content, and the device further includes:
  • the first adding unit is configured to add the target content to the bookshelf of the second application according to the connection data received from the sending unit of the source display device.
  • the above device further includes:
  • the second adding unit is configured to add the target content to the read later card of the second application installed on the target display device according to the connection data received from the sending unit of the source display device.
  • the later reading card is a service card embedded in the second application, which is an interface display form of the meta service (here refers to the later reading service provided by the second application), and the important information of the later reading service Information or operations are front-loaded to the card to achieve direct service and facilitate user operations.
  • the embodiment of the present application provides a source display device, including:
  • memory for storing instructions to be executed by one or more processors of the source display device
  • a processor when the instructions are executed by one or more processors, causes the source display device to determine target content to be displayed sequentially through other display devices, and based on the target content, determine suitable target content for continuous display from a plurality of display devices A target display device for the content, and causing the source display device to send to the target display device the continuation data required for subsequent display of the target content on the target display device.
  • the embodiment of the present application provides a source display device, including:
  • memory for storing instructions to be executed by one or more processors of the target display device
  • a processor when the instructions are executed by one or more processors, causing the target display device to receive the continuation data sent by the source display device for continuing to display the target content on the target display device, wherein the target content is the source display device.
  • the determined content in the source display device to be continuously displayed by other display devices, and making the target display device continue to display the target content according to the connection data received from the source display device.
  • the embodiment of the present application provides a screen recognition method for distributed display, including:
  • the first electronic device determines the target content to be continuously displayed by other electronic devices in the first electronic device
  • the first electronic device determines a second electronic device suitable for continuing to display the target content from multiple electronic devices;
  • the first electronic device sends to the second electronic device the connection data required for continuing to display the target content on the second electronic device;
  • the second electronic device continues to display the target content according to the connection data received from the first electronic device.
  • the foregoing target content is content currently displayed by the first electronic device.
  • the above-mentioned first electronic device determines from a plurality of electronic devices based on the target content a second electronic device that is suitable for continuing to display the target content, including:
  • the first electronic device determines an application scenario corresponding to the target content based on the target content
  • the first electronic device determines a second electronic device suitable for continuing to display the target content from the plurality of electronic devices.
  • the above-mentioned first electronic device determines from a plurality of electronic devices based on the target content a second electronic device that is suitable for continuing to display the target content, including:
  • the first electronic device determines that the application scene corresponding to the target content is the reading scene
  • the first electronic device determines a second electronic device suitable for displaying the target content in the reading scene from among the plurality of electronic devices.
  • the first electronic device determines an application scenario corresponding to the target content based on the target content, including:
  • the first electronic device determines, based on the target content, a first application installed on the first electronic device for displaying the target content;
  • the first electronic device determines an application scenario corresponding to the target content according to the first application.
  • the above-mentioned first electronic device sends to the second electronic device the connection data required for continuing to display the target content on the second electronic device, including:
  • the first electronic device sends to the second electronic device via Bluetooth the connection data required for continuing to display the target content on the second electronic device;
  • the first electronic device transmits to the second electronic device through point-to-point wireless fidelity (Wireless-Fidelity point-to-point, Wi-Fi P2P)
  • point-to-point wireless fidelity Wireless-Fidelity point-to-point, Wi-Fi P2P
  • the continuation data is the online web text continuation data
  • the online web text continuation data includes the Uniform Resource Identifier (URI) of the online web text , URI); or
  • the continuation data is the offline web text continuation data
  • the offline web text continuation data includes the file of the offline web text
  • the continuation data is the online e-book continuation data
  • the online e-book continuation data includes the identification of the online e-book and the reading progress
  • the continuation data is the offline electronic book continuation data
  • the offline electronic book continuation data includes files and reading progress of the offline electronic book.
  • the above-mentioned second electronic device continues to display the target content according to the connection data received from the first electronic device, including:
  • the second electronic device continues to display the online web text according to the URI received from the first electronic device;
  • the second electronic device continues to display the offline web text according to the file of the offline web text received from the first electronic device;
  • the second electronic device continues to display the online electronic book according to the identification of the online electronic book received from the first electronic device;
  • the second electronic device continues to display the offline electronic book according to the file of the online electronic book received from the first electronic device.
  • the above-mentioned online web document connection data further includes at least one of the online web document title, analysis source, analysis time, server source, and integrity check identifier.
  • the offline web document connection data further includes at least one of the URI, title, resolution source, resolution time, server source, and integrity verification identifier of the offline web document.
  • the online electronic book continuation data further includes: a chapter structure of the online electronic book.
  • the offline e-book continuation data further includes: at least one of an online e-book identifier and a chapter structure.
  • the above-mentioned second electronic device is installed with a second application for displaying target content, and the method further includes:
  • the second electronic device adds the target content to the bookshelf of the second application according to the connection data received from the first electronic device.
  • the above method further includes:
  • the second electronic device adds target content to the later reading card of the second application installed on the second electronic device according to the connection data received from the first electronic device.
  • connection data includes an application package name
  • the application package name is used to instruct the second electronic device to open the target content through the application corresponding to the application package name.
  • connection data further includes identity authentication information of the first application installed on the first electronic device for displaying the target content, and the identity authentication information is used to enable the second electronic device to have The server of the first application obtains the permission of the target content.
  • the server of the first application installed on the first electronic device for displaying the target content is connected with the server of the second application installed on the second electronic device for continuing to display the target content
  • the server of the second application has the authority to access the target content in the server of the first application, wherein the first application of the first electronic device obtains the target content from the server of the first application.
  • the embodiment of the present application provides a screen recognition method for distributed display, including:
  • the first electronic device determines the target content to be continuously displayed by other electronic devices in the first electronic device
  • the first electronic device determines a second electronic device suitable for continuing to display the target content from multiple electronic devices;
  • the first electronic device sends to the second electronic device the necessary connection data for continuing to display the target content on the second electronic device.
  • the target content is the content currently displayed by the first electronic device.
  • the first electronic device determines a second electronic device suitable for continuing to display the target content from multiple electronic devices, including:
  • the first electronic device determines an application scenario corresponding to the target content based on the target content
  • the first electronic device determines a second electronic device suitable for continuing to display the target content from the plurality of electronic devices.
  • the first electronic device determines a second electronic device suitable for continuing to display the target content from multiple electronic devices, including:
  • the first electronic device determines that the application scene corresponding to the target content is the reading scene
  • the first electronic device determines a second electronic device suitable for displaying the target content in the reading scene from among the plurality of electronic devices.
  • the first electronic device determines the application scenario corresponding to the target content based on the target content, including:
  • the first electronic device determines, based on the target content, a first application installed on the first electronic device for displaying the target content;
  • the first electronic device determines an application scenario corresponding to the target content according to the first application.
  • the first electronic device sends to the second electronic device the connection data required for continuing to display the target content on the second electronic device, including:
  • the first electronic device sends to the second electronic device via Bluetooth the connection data required for continuing to display the target content on the second electronic device;
  • the first electronic device transmits to the second electronic device through point-to-point wireless fidelity (Wireless-Fidelity point-to-point, Wi-Fi P2P)
  • point-to-point wireless fidelity Wireless-Fidelity point-to-point, Wi-Fi P2P
  • the continuation data is the online web text continuation data
  • the online web text continuation data includes a uniform resource identifier (UniformResource Identifier) of the online web text , URI); or
  • the continuation data is the offline web text continuation data
  • the offline web text continuation data includes the file of the offline web text
  • the continuation data is the online e-book continuation data
  • the online e-book continuation data includes the identification of the online e-book and the reading progress
  • the continuation data is the offline electronic book continuation data
  • the offline electronic book continuation data includes files and reading progress of the offline electronic book.
  • the online web document connection data further includes at least one of the online web document title, analysis source, analysis time, server source, and integrity verification identifier.
  • the offline web document connection data further includes at least one of the URI, title, resolution source, resolution time, server source, and integrity verification identifier of the offline web document.
  • the online electronic book continuation data further includes: a chapter structure of the online electronic book.
  • the offline electronic book continuation data further includes: at least one of an online electronic book identifier and a chapter structure.
  • connection data includes an application package name
  • the application package name is used to instruct the second electronic device to open the target content through the application corresponding to the application package name.
  • connection data further includes identity authentication information of the first application installed on the first electronic device for displaying the target content, and the identity authentication information is used to enable the second electronic device to An application's server obtains the permission of the target content.
  • the server of the first application installed on the first electronic device for displaying the target content is connected with the server of the second application installed on the second electronic device for continuing to display the target content
  • the server of the second application has the authority to access the target content in the server of the first application, wherein the first application of the first electronic device obtains the target content from the server of the first application.
  • the embodiment of the present application provides a screen recognition method for distributed display, including:
  • the second electronic device receives the continuation data sent by the first electronic device for continuing to display the target content on the second electronic device, wherein the target content is the continuation data determined by the first electronic device to be passed through other electronic devices.
  • the second electronic device continues to display the target content according to the connection data received from the first electronic device.
  • the continuation data is the online web text continuation data
  • the online web text continuation data includes a uniform resource identifier (Uniform Resource Identifier) of the online web text Identifier, URI); or
  • the continuation data is the offline web text continuation data
  • the offline web text continuation data includes the file of the offline web text
  • the continuation data is the online e-book continuation data
  • the online e-book continuation data includes the identification of the online e-book and the reading progress
  • the continuation data is the offline electronic book continuation data
  • the offline electronic book continuation data includes files and reading progress of the offline electronic book.
  • the second electronic device continues to display the target content according to the connection data received from the first electronic device, including:
  • the second electronic device continues to display the online web text according to the URI received from the first electronic device;
  • the second electronic device continues to display the offline web text according to the file of the offline web text received from the first electronic device;
  • the second electronic device continues to display the online electronic book according to the identification of the online electronic book received from the first electronic device;
  • the second electronic device continues to display the offline electronic book according to the file of the online electronic book received from the first electronic device.
  • the second electronic device is installed with a second application for displaying target content, and the method further includes:
  • the second electronic device adds the target content to the bookshelf of the second application according to the connection data received from the first electronic device.
  • the above method further includes:
  • the second electronic device adds target content to the later reading card of the second application installed on the second electronic device according to the connection data received from the first electronic device.
  • the embodiment of the present application provides a computer-readable storage medium, and instructions are stored on the computer-readable storage medium, and when the instructions are executed on the electronic device, the electronic device executes any of the above-mentioned sixth aspect and the sixth aspect.
  • the embodiment of the present application provides a computer program product, the computer program product includes instructions, and the instructions are used to implement the above sixth aspect and the method in any possible implementation of the sixth aspect or the above seventh aspect and A screen recognition method for distributed display in any possible implementation of the seventh aspect.
  • the embodiment of the present application provides a chip device, and the chip device includes:
  • a processor configured to execute a computer-executable program, so that the device equipped with the chip device executes the method in the sixth aspect and any one of the possible implementations of the sixth aspect or any one of the seventh aspect and the seventh aspect above Screen recognition method for distributed display in possible implementation.
  • the embodiment of the present application provides an electronic device, including:
  • memory for storing instructions to be executed by one or more processors of the electronic device
  • a processor when the instruction is executed by one or more processors, the processor is used to execute the method in the sixth aspect and any one of the possible implementations of the sixth aspect or any one of the seventh aspect and the seventh aspect above Screen recognition method for distributed display in possible implementation.
  • Fig. 1 shows a content continuation system according to some embodiments of the present application
  • FIG. 2A shows a schematic UI diagram of a video connection solution
  • FIG. 2B shows a flowchart of the video splicing scheme shown in FIG. 2A;
  • Fig. 2C shows a schematic diagram of a continuous reading scene across devices according to some embodiments of the present application
  • FIG. 2D shows a UI diagram of cross-device web text connection according to some embodiments of the present application
  • FIG. 2E shows a UI diagram of cross-device e-book connection according to some embodiments of the present application
  • FIG. 2F shows a schematic UI diagram of a web-based bookshelf on an e-reader according to some embodiments of the present application
  • Fig. 2G shows a UI diagram of a reading bookshelf on an electronic reader according to some embodiments of the present application
  • Fig. 3 shows a schematic diagram of a hardware structure of a mobile phone according to some embodiments of the present application
  • Fig. 4 shows a software hierarchical structure diagram of a mobile phone and an electronic reader according to some embodiments of the present application
  • Fig. 5 shows a flowchart of a mobile phone identifying an application scenario and recommending a connection device based on the scenario according to some embodiments of the present application
  • Fig. 6 shows a flow chart of an e-reader receiving connection data from a mobile phone and displaying the connection according to some embodiments of the present application
  • Fig. 7 shows an interaction diagram between a mobile phone and an e-reader for continuous reading of web texts across devices according to some embodiments of the present application
  • Fig. 8A shows a schematic UI diagram of a mobile phone opening a web article in the circle of friends shown in Fig. 8A;
  • Fig. 8B shows a schematic UI diagram of a mobile phone recommending an e-reader as a connection device and prompting according to some embodiments of the present application
  • Fig. 8C shows a UI schematic diagram of a connected e-reader as a connecting device, prompting the user to select different reading service functions, according to some embodiments of the present application;
  • Fig. 8D shows a UI schematic diagram of an electronic reader for later reading according to some embodiments of the present application
  • Fig. 9 shows an interaction diagram of continuous reading of e-books across devices between a mobile phone and an e-reader according to some embodiments of the present application
  • Fig. 10A shows a schematic UI diagram of a mobile phone recommending an e-reader as a connection device and prompting according to some embodiments of the present application
  • Fig. 10B shows a schematic UI diagram of a continuous reading APP in which the user presses and holds the desktop of the e-reader according to some embodiments of the present application;
  • FIG. 10C shows a schematic UI diagram of an e-reader with a card to be read later added on the desktop according to some embodiments of the present application
  • Fig. 10D shows a UI schematic diagram of a user clicking to open the card to be read later shown in Fig. 10C according to some embodiments of the present application;
  • Fig. 11 shows an interactive diagram of batch-connecting e-books on a bookshelf across devices between a mobile phone and an e-reader according to some embodiments of the present application
  • Fig. 12 is a schematic diagram of a UI for batch-connecting e-books on a bookshelf across devices between a mobile phone and an e-reader according to some embodiments of the present application.
  • Fig. 13 shows a structural block diagram of a source display device according to some embodiments of the present application.
  • Fig. 14 shows a structural block diagram of an object display device according to some embodiments of the present application.
  • a screen recognition method for distributed display provided by an embodiment of the present application can be applied to the content continuation system 10 shown in FIG. 1 .
  • the content continuation system 10 includes a plurality of electronic devices, such as a mobile phone 100-1, a tablet computer 100-2, a computer 100-3, a smart watch 100-4, and an electronic reader 100-5.
  • the user may need to switch the display content such as e-books, web articles, games or videos being displayed by one electronic device of the content continuation system 10 to another electronic device for continuation and display.
  • the user uses the reading application program (Application, APP) of the mobile phone 100-1 to read e-books on the way from work, and may wish to switch the e-books read to the e-reader 100- 5, to continue reading the e-book.
  • the user wishes to switch the video played by the video APP of the mobile phone 100-1 to the tablet computer 100-2 with a larger screen for continued broadcasting.
  • the user can use the tablet computer 100-2 to browse the web content of the Weibo APP at home. When the user leaves home, he may wish to switch the web text of the Weibo APP on the tablet computer 100-2 to the mobile phone 100 which is easier to carry. -1 to continue browsing the web.
  • the user in order to enable one electronic device to continue to display the content currently displayed by another electronic device, the user needs to first determine which electronic device to choose as the connecting device, and then the electronic device to be connected will pass through passively under the operation of the user.
  • the "touch and touch” method establishes a communication connection with the user's pre-selected electronic device, so as to carry out content continuation.
  • the user uses the mobile phone 100-1 to watch videos on the way off work, but the user finds that the power of the mobile phone 100-1 is about to run out, and there is no rechargeable device around him at this time, and the mobile phone 100-1 cannot be charged.
  • Switch the video currently played by the mobile phone 100-1 to the portable smart watch 100-4 for continued playback For example, if the TV series A currently played by the mobile phone 100-1 as shown in Figure 2A is switched to the smart watch 100-4 for continued playback, the user first needs to select the smart watch 100-4 as the electronic device for continuing to play the video, and then the user Hold the mobile phone 100-1 and establish a communication connection with the smart watch 100-4 by "touching" to continue video.
  • the mobile phone 100-1 establishes a connection with the smart watch 100-4 through a "touch" method, and the method for realizing continuous playback of videos through the smart watch 100-4 includes the following steps:
  • Step 201 The mobile phone 100-1 "touches" the smart watch 100-4.
  • the mobile phone 100-1 is installed with a "touch" application, and both the mobile phone 100-1 and the smart watch 100-4 are provided with near field communication (near field communication, NFC) tags, such as NFC chips.
  • NFC near field communication
  • the "touch" application is an application program that can run for a long time in the form of a resident process after the mobile phone 100-1 is turned on, and is used to call the mobile phone when it is detected that the user has triggered the touch function of the mobile phone 100-1.
  • 100-1 NFC tags are examples of the mobile phone 100-1 NFC tags.
  • Step 202 The mobile phone 100-1 and the smart watch 100-4 establish a wireless communication connection.
  • the mobile phone 100-1 when the mobile phone 100-1 approaches the smart watch 100-4 under the movement of the user, the mobile phone 100-1 obtains the smart watch 100-100- 4 device information, such as Media Access Control (Media Access Control, MAC) address, etc., and based on the obtained MAC address, establish Bluetooth and point-to-point wireless fidelity (Wireless-Fidelity point-to- point, Wi-Fi P2P) and other wireless communication connections.
  • Media Access Control Media Access Control
  • MAC Media Access Control
  • Wi-Fi P2P wireless-Fidelity point-to- point
  • Step 203 The mobile phone 100-1 acquires the tag of the currently playing content.
  • the mobile phone 100-1 can obtain the tag of the currently displayed content from the application running in the foreground.
  • the label of the displayed content is used to record the user's browsing position of the currently displayed content.
  • the mobile phone 100-1 can request the video APP to query the identifier of the playback page of the TV series A, such as the Uniform Resource Identifier (URI) of the playback page. URI), and the playing progress of TV series A, for example, the playing progress is the 5th minute of episode 11. Furthermore, as shown in FIG. 2A , the mobile phone 100-1 may send the playing progress of TV series A and the identifier of the playing page as tags of the currently displayed content to the smart watch 100-4.
  • URI Uniform Resource Identifier
  • Step 204 The mobile phone 100-1 sends the label of the currently playing content to the smart watch 100-4.
  • the mobile phone 100-1 sends the playback progress and the identifier of the playback page of TV series A as shown in FIG. 2A to the smart watch 100-4 as tags of the currently displayed content via Bluetooth. Based on the label, the smart watch 100-4 can resume the TV series A currently played by the mobile phone 100-1.
  • Step 205 The smart watch 100-4 continues to play TV series A.
  • the smart watch 100-4 receives the above-mentioned tags of the TV drama A shown in Figure 2A
  • the video APP of the smart watch 100-4 can follow the above-mentioned tags.
  • the playing page identifier and playing progress request the corresponding playing page in the server, so as to realize the continuation of TV series A.
  • the mobile phone 100-1 passively establishes a communication connection with the smart watch 100-4 pre-selected by the user through the "touch" method under the operation of the user. , and then use the smart watch 100-4 to realize the continuation of the content currently displayed on the mobile phone 100-1.
  • the smart watch 100-4 selected by the user may cause the electronic device selected by the user to be unsuitable as a continuous device.
  • the smart watch 100-4 selected by the user has a small screen and is not suitable for watching videos, or the electronic device selected by the user may not be able to realize Content continuation function, poor user experience.
  • the screen identification method for distributed display provided by this application, by identifying the current application scene of the electronic device, other electronic devices found in the device network are automatically The electronic devices that are more suitable for continuous display are selected from the devices to improve the user experience.
  • the current display of the electronic device is an electronic book or web text, and then it is determined that the current application scene is a reading scene, so that among the multiple discovered electronic devices, automatically recommend An electronic device with eye protection function is used as an electronic device for continuous reading;
  • the current display of the electronic device is a video, and then the current application scene is determined to be a video playback scene , so that among the multiple discovered electronic devices, an electronic device with a stronger display capability, such as a larger screen and a higher resolution, is automatically recommended as an electronic device for continuing video playback.
  • the electronic device as the connecting device can also read the electronic book or web text sent by other electronic devices.
  • Net texts are classified and managed, corresponding reading bookshelves are generated corresponding to e-books, and corresponding web text bookshelves are generated corresponding to web texts, so as to provide users with better continuous reading services and improve user experience.
  • both the mobile phone 100-1 and the smart watch 100-4 automatically recommend the electronic reader 100-5 as an electronic device for continuous reading, then the mobile phone 100-1 and the smart watch 100-4
  • the smart watch 100-4 can continue to display the currently displayed electronic book or web text through the automatically recommended electronic reader 100-5.
  • the mobile phone 100-1 continues to display the WeChat text 1 displayed on the interface 101 through the e-reader 100-5 automatically recommended by the mobile phone 100-1, and then the electronic reading
  • the content displayed on the interface 102 of the e-reader 100-5 is the content of the WeChat web text 1, that is, the content displayed on the interface 102 of the e-reader 100-5 is consistent with the content displayed on the interface 101 of the mobile phone 100-1.
  • the mobile phone 100-1 continues to display the electronic book 1 displayed on the interface 103 through the electronic reader 100-5 automatically recommended by the mobile phone 100-1, then the electronic reader 100-
  • the content displayed on the interface 104 of 5 is the content of the electronic book 1, that is, the content displayed on the interface 104 of the e-reader 100-5 is consistent with the content displayed on the interface 103 of the mobile phone 100-1.
  • the e-reader 100-5 can also add the web texts and e-books connected from the mobile phone 100-1 to the web text bookshelf and the reading bookshelf built by the e-reader 100-5, so that the user can read them when needed. , select the corresponding web text from the web text bookshelf or select the corresponding e-book from the reading bookshelf to read.
  • the e-reader 100 - 5 adds the WeChat web text 1 connected from the mobile phone 100 - 1 to the web text bookshelf 105 .
  • the electronic reader 100 - 5 adds the electronic book 1 connected from the mobile phone 100 - 1 to the reading shelf 106 .
  • the distributed display solution provided by this application can not only realize the continuous playback of video content, but also realize the continuous display of e-books, web documents, office documents and other content, and has a wide range of applications.
  • the electronic device applicable to the distributed display solution provided by this application can be any electronic device with a display screen, including but not limited to mobile phones, e-readers, tablet computers, smart TVs, notebook computers, super mobile
  • the embodiment of this application does not make any limit.
  • the distributed display solution provided by this application will be described in detail below by taking the content displayed on the mobile phone 100-1 currently used by the user as an example to be continuously displayed on other electronic devices.
  • the mobile phone 100-1 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a subscriber identification module (Subscriber Identification Module, SIM) card Interface 195, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor Module 180, display screen 194, camera 193, indicator 192, buttons 190, etc.
  • a processor 110 an external memory interface 120
  • an internal memory 121 a universal serial bus (universal serial bus, USB) interface 130
  • SIM Subscriber Identification Module
  • SIM Subscriber Identification Module
  • the structure shown in the embodiment of the present application does not constitute a specific limitation on the mobile phone 100-1.
  • the mobile phone 100-1 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.
  • the processor 110 is configured to identify the currently displayed content of the mobile phone 100-1, and based on the identified currently displayed content, match a suitable electronic device as a connecting device, so as to control the current display of the mobile phone 100-1
  • the displayed content is parsed.
  • the wireless communication function of the mobile phone 100-1 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in handset 100-1 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the mobile phone 100-1.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation.
  • the wireless communication module 160 can provide wireless local area network (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • WLAN wireless local area networks
  • WLAN wireless local area networks
  • WLAN wireless local area networks
  • WLAN such as wireless fidelity (wireless fidelity, Wi-Fi) network
  • bluetooth blue, BT
  • global navigation satellite System global navigation satellite system, GNSS
  • frequency modulation frequency modulation, FM
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the mobile phone 100-1 realizes the display function through the GPU, the display screen 194, and the application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos and the like.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrixorganic light-emitting diode) , AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the display screen 194 is used to display the user interface of the foreground application of the mobile phone 100-1.
  • the mobile phone 100-1 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
  • the ISP is used for processing the data fed back by the camera 193 .
  • the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin color.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the external memory interface 120 can be used to connect an external memory card to expand the storage capacity of the mobile phone 100-1.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 121 may be used to store computer-executable program codes including instructions.
  • the processor 110 executes various functional applications and data processing of the mobile phone 100 - 1 by executing instructions stored in the internal memory 121 .
  • the mobile phone 100-1 can realize the audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 170 may also be used to encode and decode audio signals.
  • the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
  • Speaker 170A also referred to as a "horn" is used to convert audio electrical signals into sound signals.
  • Cell phone 100-1 can listen to music through speaker 170A, or listen to hands-free calls.
  • Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the receiver 170B can be placed close to the human ear to receive the voice.
  • the microphone 170C also called “microphone” or “microphone” is used to convert sound signals into electrical signals.
  • the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C.
  • the mobile phone 100-1 can be provided with at least one microphone 170C.
  • the mobile phone 100-1 can be provided with two microphones 170C, which can also implement a noise reduction function in addition to collecting sound signals.
  • the mobile phone 100-1 can also be provided with three, four or more microphones 170C, so as to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.
  • the earphone interface 170D is used for connecting wired earphones.
  • the earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
  • the mobile phone 100-1 may also include a charging management module 140, a power management module 141, a battery 142, a button 190, an indicator 192, and one or more SIM card interfaces, which are not limited in this embodiment of the present application.
  • the software system of the mobile phone 100-1 shown in FIG. 3 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
  • the Android TM operating system with a layered architecture shown in FIG. 4 is taken as an example to illustrate the software structure of the mobile phone 100-1 and the electronic reader 100-5 as a connected device.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the Android TM operating system is divided into an application layer, a framework layer, and a kernel layer from top to bottom.
  • the application layer can include a series of application packages.
  • the mobile phone 100-1 applicable to the content continuation technical solution provided by this application includes a reading application 111, a microblog application 112, a video application 113, a proximity discovery 114a, a smart screen recognition 117, and a control center 115 , intelligent brain 116a, connection service 118a and other applications.
  • the application layer of the mobile phone 100-1 may also include call, memo, browser, contacts, camera, gallery, calendar, map, bluetooth, music, short message and other APPs.
  • the reading application 111 of the mobile phone 100-1 an APP for reading electronic books, providing an information source of book content.
  • Microblog application 112 an APP for browsing web page content of news or Weibo, and provides an information source of web page content.
  • Video application 113 an APP for browsing streaming video content, providing users with functions such as video download and playback.
  • Proximity discovery 114a of the mobile phone 100-1 used to discover other electronic devices around the mobile phone 100-1 that can establish a communication connection in the device network, and obtain information about the discovered electronic device, such as obtaining the name and device name of the discovered electronic device Device information such as capabilities, device types, and MAC addresses. For example, in some embodiments, after the Bluetooth of the mobile phone 100-1 is turned on, basic information of multiple connectable devices is displayed, for example, device models of multiple connectable devices are displayed. The mobile phone 100-1 determines the current application scenario through the smart screen recognition 117, and after the mobile phone 100-1 recommends an electronic device suitable for connection with the determined application scenario through the smart brain 116a, the control center 115 of the mobile phone 100-1 displays The recommended electronic device is for the user to confirm.
  • the proximity discovery 114a of the mobile phone 100-1 After confirming the connection to the recommended electronic device, the proximity discovery 114a of the mobile phone 100-1 directly obtains key information such as the capability and MAC address of the electronic device from the recommended electronic device.
  • the capabilities of the device may include computing capabilities, sound pickup capabilities, security capabilities, display capabilities, playback capabilities, camera capabilities, storage capabilities, and the like.
  • the above device information may also include authentication information used for identity authentication when the device establishes a wireless communication connection with other electronic devices.
  • the authentication information may be a token used when establishing a wireless communication connection with the mobile phone 100-1, a pre-shared key (pre-shared key, PSK) or a device serial number, etc., which is not limited in this embodiment of the present application.
  • the smart recognition screen 117 of the mobile phone 100-1 used to extract the content currently displayed on the mobile phone 100-1 and identify the extracted content. For example, extracting the front-end interface text and content, and intelligently analyzing the text, pictures, and web page information elements, for the smart brain 116a of the mobile phone 100-1 to determine from the discovered devices that it is more suitable for displaying the mobile phone 100-1 based on the analysis results.
  • the docking device for the currently displayed content.
  • the intelligent brain 116a of the mobile phone 100-1 is used to sort the discovered devices based on the identified application scenarios, recommend electronic devices corresponding to the current application scenarios from the discovered devices, and send the finally recommended devices to The control center 115 performs UI presentation.
  • the control center 115 of the mobile phone 100-1 used to display the list of discovered peripheral devices, recommended device information, connection status of the mobile phone 100-1, such as prompt information of connection start and successful connection, etc.
  • the connection service 118a of the mobile phone 100-1 used to establish a service channel for signaling transmission between the mobile phone 100-1 and the recommended connection device, such as a Bluetooth channel and a Wi-Fi P2P channel, and the Bluetooth channel is used to transmit instructions with a small amount of data and content; Wi-Fi P2P channel is used to transfer large files or big data.
  • the connection service 118a of the mobile phone 100-1 is also used to identify the application scene according to the APP corresponding to the front display interface of the mobile phone 100-1. If a unique and clear application scenario can be determined through the APP, the continuation service 118a of the mobile phone 100-1 can send the content currently displayed on the mobile phone 100-1 to a recommended electronic device for continuous display.
  • the reading application 111 of the mobile phone 100-1 registers the monitoring service with the connection service 118a of the mobile phone 100-1, and the connection service 118a of the mobile phone 100-1 detects that the corresponding The APP is the reading application 111, so that it can be determined that the current application scenario is the scenario of reading e-books, and then the content of the e-books displayed on the current interface is encapsulated into data of JSON data (a lightweight data format based on text) ( Hereinafter referred to as the e-book JSON data), send it to the electronic device that recommends the continuation, so that the electronic device requests the corresponding page content from the continuation reading server according to the received e-book JSON data, so as to display the requested page content and realize Continue reading function.
  • JSON data a lightweight data format based on text
  • the electronic book JSON data includes the identification of the electronic book, the progress of reading the electronic book, the chapter identification, the playback progress of the listening book, the chapter identification of the listening book, the file name of the local electronic book, and the name of the target application for continuous transfer etc.
  • e-book JSON data can be defined as a format including a plurality of fields as shown in Table 1 below.
  • some APPs installed on the mobile phone 100-1 can register the connection service capability with the connection service 118a by integrating an open connection transfer engine SDK (Software Development Kit, software development kit), so as to realize the mobile phone 100-1 -The content of the app registered for the connection service in 1 is connected to other electronic devices for connection processing.
  • SDK Software Development Kit, software development kit
  • the application layer of the e-reader 100 - 5 applicable to the content continuation technical solution provided by this application includes applications such as proximity discovery 114 b , smart brain 116 b , continuation service 118 b , and continuation reading 120 .
  • the continuation service 118b of the e-reader 100-5 for receiving continuation data from other electronic devices, and sending the received continuation data to some APPs of the e-reader 100-5 for continuation display.
  • the continuation service 118b of the e-reader 100-5 is used to receive continuation data from other electronic devices, and send the received continuation data to the continuation reading function of the electronic reader 100-5. 120, to classify and manage the e-books or web texts that need to be continuously displayed, and continuously display the e-books or web texts.
  • connection service 118b of the e-reader 100-5 is used to receive connection data from other electronic devices and send the received connection data to a video application (not shown) of the e-reader 100-5, thereby Continue playing the video.
  • the connection service 118b of the e-reader 100-5 is also used to send the device information of the e-reader 100-5 to recommend and select the e-reader 100-5 via the smart brain 116b and the proximity discovery 114b in sequence Electronic equipment connected to the device.
  • Proximity discovery 114b of the e-reader 100-5 used to send the device information of the e-reader 100-5 to an electronic device that uses the e-reader 100-5 as a connected device, or to receive from other electronic devices device information.
  • the smart brain 116b of the e-reader 100-5 used to obtain the device information of the e-reader 100-5 from the connection service 118b of the e-reader 100-5, and send it to the recommendation through the proximity discovery 114b of the e-reader 100-5 And select the electronic reader 100-5 as the electronic device of the connecting device.
  • the continuous reading 120 of the e-reader 100-5 is an APP capable of realizing the cross-device continuous reading function, and is used to directly read on the electronic reader 100-5 according to the continuous data received from the continuous service 118b of the electronic reader 100-5.
  • a web page or html interface is constructed on the display interface to continuously display e-books or web texts. Or, add the electronic book or web text to the "read later" function menu of the continuous reading 120, so that when needed, the user can click on the read later menu to select the electronic book or web text to be read, so as to realize a little later. post-read function.
  • the continuous reading 120 of the e-reader 100-5 is also used to classify and manage the electronic books or web documents for continuous reading, and build reading bookshelves and web text bookshelves.
  • the reading bookshelf is used for managing electronic books, for example, displaying the covers and titles of the electronic books currently being continued and the electronic books that have been continued in the past.
  • the web text bookshelf is used to manage web texts, for example, to display the titles of the web texts that are currently being continued and the web texts that have been spliced in the past. For the user to conveniently view the e-books or web articles that have been continued.
  • the web document bookshelf and the reading bookshelf are implemented in the continuous reading 120 of the e-reader 100-5 through the RecyclerView control in the Android TM operating system.
  • the continuous reading 120 of the e-reader 100-5 can also provide functions such as page scrolling, catalog display, progress switching, font size adjustment and theme switching, text selection and copying, and the like.
  • the continuous reading 120 is only an exemplary name of an APP that can realize the functions of continuous reading, later reading, and bookshelf management described above. In some other embodiments, the continuous reading 120 also It may be called a distributed bookshelf, which is not limited in this application.
  • SDK interface 119a an application programming interface (application programming interface, API) for the framework layer of the mobile phone 100-1 application layer APP and connection service 118a control and management. It may include obtaining the identification (such as the application package name) of the foreground application of the mobile phone 100-1, the API interface of Bluetooth and Wi-Fi P2P connection, and the like.
  • SDK interface 119b an application programming interface (application programming interface, API) for the framework layer of the e-reader 100-5 application layer APP and the connection service 118b control management, similar to the SDK interface 119a, and will not be described again.
  • the framework layer provides and programs the framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the framework layer of the mobile phone 100-1 includes an intelligent AI framework 121a, a minimal protocol communication service 122a, a WiFi service 123a, an NFC service 125a, a Bluetooth service 124a, a soft bus 126a, and the like.
  • the intelligent AI framework 121a of the mobile phone 100-1 is used to provide computing services for the intelligent screen recognition 117 and the intelligent brain 116a of the application layer, for example, to provide the recognition service of the application scene for the intelligent screen recognition 117; Set up rules to make decisions, so as to recommend suitable services for connecting devices based on application scenarios.
  • Minimalist protocol communication service 122a used to provide a custom simplified protocol interface to quickly and efficiently transmit instructions and data, and is the basic application layer protocol and capability provider of the connection (transfer) service.
  • WiFi service 123a used to provide WiFi 131a with WiFi configuration information such as IP/group/channel/SSID for networking and connecting to Wi-Fi P2P.
  • NFC service 125a used to provide NFC133a with configuration information such as networking connection labels.
  • Bluetooth service 124a used to provide Bluetooth 132a with Bluetooth configuration information such as Bluetooth MAC address/session ID for network connection.
  • Soft bus 126a used to realize the unified distributed communication capability among near-field devices, provide a device discovery and transmission interface without distinguishing between links, and can quickly discover and connect devices, and efficiently distribute tasks and transmit data.
  • the framework layer of the e-reader 100-5 includes an intelligent AI framework 121b, a minimal protocol communication service 122b, a WiFi service 123b, an NFC service 125b, a Bluetooth service 124b, and a soft bus 126b.
  • Each module of the frame layer of the e-reader 100-5 is similar to each module of the frame layer of the mobile phone 100-1. For specific meanings, refer to the above description of each module of the frame layer of the mobile phone 100-1, which will not be repeated here.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer of the mobile phone 100-1 includes WiFi131a, Bluetooth132a, and NFC133a.
  • the core layer of the e-reader 100-5 includes WiFi131b, Bluetooth132b, and NFC133b.
  • WiFi131a, WiFi131b refer to the driver of the WiFi chip and the WiFi firmware, which are used to transmit connection data.
  • NFC133a, NFC133b refer to the driver and NFC firmware of the NFC chip, used to transmit the connection data.
  • Bluetooth 132a, Bluetooth 132b refer to the driver and Bluetooth firmware of the Bluetooth chip, used to transmit connection data.
  • the framework layer of the mobile phone 100-1 and the e-reader 100-5 may also include an authentication framework (not shown), which is used for cloud-based and local configuration data, and the authentication framework can provide Pull specific application permission table items from the cloud side to realize the function of identifying whether it has a specific capability permission.
  • the kernels of the mobile phone 100-1 and the e-reader 100-5 may also include a distributed file system (not shown), and the mobile phone 100-1 and the e-reader 100-5 may also use the distributed file system The system transmits data to each other.
  • the mobile phone 100-1 discovers the electronic device, performs scene recognition according to the content currently displayed on the mobile phone 100-1, and recommends a suitable electronic device for connection according to the recognized scene.
  • the process includes the following steps:
  • Step 501 The mobile phone 100-1 identifies the current application scenario.
  • the mobile phone 100-1 may initially identify the current application scenario according to the foreground application. In the case that the mobile phone 100-1 can identify the determined application scenario according to the foreground application, enter step 502; in the case that the mobile phone 100-1 cannot identify the determined application scenario according to the foreground application, perform further processing according to the currently displayed content. For scene recognition, when the mobile phone 100-1 determines the current application scene according to the currently displayed content, go to step 502.
  • the mobile phone 100-1 monitors which APP corresponds to the foreground application through the connection service application 118a of the application layer, and then uses the monitored APP to identify the application scene.
  • the foreground application refers to the application corresponding to the current display interface of the mobile phone 100-1.
  • the mobile phone 100-1 stores a whitelist of APPs corresponding to the reading scene, and these whitelists include identification information of various reading APPs, for example, WeChat reading APPs, palm reading APPs, and the like.
  • the mobile phone 100-1 obtains through monitoring that the APP corresponding to the current display interface is in the white list, it determines that the current application scene is the reading scene.
  • the application scenarios cannot be determined.
  • there are various views such as chat session interface, circle of friends display interface, and web text interface accessed through network links.
  • the displayed content is analyzed, and it is further determined which interface is currently displayed on the mobile phone 100-1, among the above chat session interface, friend circle display interface, web text interface, etc., so as to obtain a uniquely determined application scenario.
  • the intelligent screen recognition 117 of the application layer of the mobile phone 100-1 extracts and analyzes the content of the current display interface by calling the intelligent AI framework of the framework layer, so as to further determine the unique and definite information based on the currently displayed content.
  • the smart screen recognition 117 of the mobile phone 100-1 takes a screenshot of the currently displayed content, and then processes the screenshot to obtain an mht format (a file format) containing all elements in the screenshot. file, and then analyze the file in mht format to further determine the current application scenario.
  • an mht format a file format
  • the APP supports the connection service function.
  • the connection service 118a is enabled, if the mobile phone 100-1 currently displays The display interface of the APP can realize the continuation of the display interface of the APP.
  • the WeChat reading APP has registered the continuation service in the continuation service 118a
  • the WeChat reading APP supports the continuation service function.
  • the continuation service 118a is opened, if the mobile phone 100-1 currently displays the display interface of the WeChat reading APP, then Realize the continuation of the display interface of the WeChat reading APP.
  • Step 502 The mobile phone 100-1 recommends an electronic device suitable for content connection among the discovered devices.
  • an electronic device suitable for content continuation may be recommended in combination with the determined application scenario.
  • the mobile phone 100-1 when the mobile phone 100-1 determines that the current application scenario is video playback, it may recommend an electronic device suitable for continuing to play the video among the discovered devices. As another example, in some embodiments, when the mobile phone 100-1 determines that the current application scenario is reading e-books, it may recommend an electronic device suitable for continuing to display e-books among the discovered devices. Therefore, in different application scenarios, electronic devices that are more suitable for the application scenarios are personalized and recommended, thereby improving user experience.
  • the basic information of a plurality of connectable devices is displayed, such as device name, device model, device capability information, etc., wherein the device capability information is used to characterize the device information such as computing capability, sound pickup capability, security capability, display capability, playback capability, camera capability, storage capability, etc.
  • the mobile phone 100-1 obtains the device capability information of the connectable device, it can determine that the connected device is suitable Application scenarios.
  • the mobile phone 100-1 determines the current application scenario through the smart screen recognition 117, and the mobile phone 100-1 recommends an electronic device suitable for connection through the smart brain 116a in combination with the determined application scenario.
  • the smart brain 116a can make decisions on recommended electronic devices according to preset rules.
  • the pre-equipment rule is: if the current application scenario is a reading scenario, recommend an electronic device suitable for reading among the discovered electronic devices, such as an electronic device with eye protection function, as a connecting electronic device; if the current application scenario If it is a game scene, recommend an electronic device suitable for playing games among the discovered electronic devices, for example, an electronic device with high computing power, as a connecting electronic device; if the current application scene is a video scene, then among the discovered electronic devices An electronic device suitable for playing videos, such as an electronic device with a larger screen, is recommended as a connecting electronic device.
  • Step 503 The mobile phone 100-1 sends the connection data to the recommended electronic device. For the electronic device to continue to display the content currently displayed by the mobile phone 100-1.
  • the control center 115 of the mobile phone 100-1 displays the recommended electronic device for the user to confirm.
  • the control center 115 of the mobile phone 100-1 requests device information from the recommended electronic device via the smart brain 116a and proximity discovery 114a, and obtains the MAC address of the recommended electronic device and uses the command when establishing a wireless communication connection.
  • the control center 115 of the mobile phone 100-1 pulls up the connection service 118a of the mobile phone 100-1, and then sends the connection data to the recommended electronic device, so that the electronic device can continue to display the content currently displayed by the mobile phone 100-1.
  • device information such as token, pre-shared key (PSK), and device serial number
  • the mobile phone 100-1 displays the currently displayed online web text by a recommended electronic device, then the mobile phone 100-1 can display the URI corresponding to the currently displayed online web text, the title of the web text, the analyzed Web text data such as source, analysis time, server source, article integrity verification mark, etc. are also packaged into JSON data (hereinafter referred to as web text JSON data) as connection data, and sent to the electronic device that recommends the connection for the electronic device that recommends the connection. According to the connection data received, the device requests the corresponding web content from the server for the connection display of the connected electronic device.
  • JSON data hereinafter referred to as web text JSON data
  • the mobile phone 100-1 displays the currently displayed offline web text by a recommended electronic device, then the mobile phone 100-1 can display the URI corresponding to the currently displayed offline web text, the title of the web text, and the analyzed Web text JSON data such as source, analysis time, server source, article integrity check mark, and the mht file corresponding to the web text are sent as connection data to the electronic device that recommends the connection, so that the electronic device that recommends the connection based on the received Continue the data and continue to display the offline web text.
  • the URI corresponding to the currently displayed offline web text
  • the title of the web text
  • the analyzed Web text JSON data such as source, analysis time, server source, article integrity check mark
  • the mht file corresponding to the web text are sent as connection data to the electronic device that recommends the connection, so that the electronic device that recommends the connection based on the received Continue the data and continue to display the offline web text.
  • web text JSON data may be defined as a format including various fields as shown in Table 2 below.
  • the mobile phone 100-1 when the content currently displayed by the mobile phone 100-1 is an online electronic book, the mobile phone 100-1 can also package the identification, chapter structure, reading progress, etc. of the currently displayed electronic book into electronic book JSON data, and The JSON data of the electronic book is sent to the recommended electronic device as continuation data, so that the electronic device recommended for continuation is called back to the continuation reading 120 of the continuation electronic device according to the received JSON data, and the continuation reading 120 parses the JSON data and then proceeds to continue reading
  • the server at 120 requests the continuation of the electronic book for the continuation of the electronic device to display.
  • the mobile phone 100-1 when the content currently displayed on the mobile phone 100-1 is an offline e-book, the mobile phone 100-1 needs to package the identification of the currently displayed e-book, chapter structure, reading progress, etc. into e-book JSON data, and The electronic book file downloaded to the mobile phone 100-1 locality is sent to the electronic device recommended to be connected as the continuation data, so that the electronic device can import the electronic book file into the reading shelf of the continuation reading 120, and according to the electronic book JSON data carried The reading progress continuously displays the content of the electronic book currently displayed on the mobile phone 100-1, or adds the progress information to the reading bookshelf.
  • the mobile phone 100-1 when the mobile phone 100-1 is currently displaying downloaded and undownloaded e-books on the bookshelf of a reading app, the mobile phone 100-1 can convert the downloaded multiple e-book files and the corresponding e-book JSON
  • the data is sent as the connection data to the electronic device that recommends the connection; or the e-book JSON data corresponding to multiple e-books that have not been downloaded is used as the connection data and sent to the electronic device that is recommended to be connected;
  • the book file and the corresponding electronic book JSON data, as well as the electronic book JSON data corresponding to multiple electronic books that have not been downloaded, are used as connection data and sent to the electronic device that recommends the connection.
  • the server corresponding to the reading APP currently displayed on the mobile phone 100-1 and the connected electronic device need to be able to access each other, that is, resource sharing.
  • the mobile phone 100-1 may send pictures, videos, audio or files contained in the current application interface to the electronic device that recommends the connection, in addition to sending the data and files in the form of URI and JSON to the electronic device that recommends the connection. text etc. In this way, when the connected electronic device continues to display the corresponding interface, there is no need to additionally download the above-mentioned picture, video, audio or text and other content.
  • connection data may also include the authentication data of the APP corresponding to the currently displayed content, such as account number, password and other data, so that the connected electronic device has the corresponding authority to request the server of the APP corresponding to the aforementioned currently displayed content to continue displaying. content.
  • the server installed on the mobile phone 100-1 for opening the first application of the target content that needs to be continuously displayed has a mutual relationship with the server of the second application installed on the connected electronic device for continuously displaying the aforementioned target content.
  • the access authority enables the second application to have the authority to access the target content in the server of the first application through the server of the second application.
  • the target content may be the content currently displayed by the mobile phone 100-1.
  • the above-mentioned connection data may also include an application package name, which is used to instruct the mobile phone 100-1 to automatically recommend the connected electronic device to use the application corresponding to the application package name to open and continue to display the current display on the mobile phone 100-1.
  • an application package name which is used to instruct the mobile phone 100-1 to automatically recommend the connected electronic device to use the application corresponding to the application package name to open and continue to display the current display on the mobile phone 100-1.
  • Content For example, if the application package name is the package name of the first application installed on the mobile phone 100-1 to open the currently displayed content, then the connected electronic device can open the content currently displayed on the mobile phone 100-1 through the first application. For another example, if the application package name is different from the package name of the first application installed on the mobile phone 100-1 to open the content currently displayed on the mobile phone 100-1, the connected electronic device can pass the second application package name. The app opens the target content.
  • connection data may not include the application package name.
  • the connected electronic device can be opened by the same application as the first application installed on the mobile phone 100-1 to open the content currently displayed on the mobile phone 100-1.
  • the mobile phone 100-1 is an electronic device that needs to be connected, that is, the content currently displayed on the mobile phone 100-1 needs to be connected to other electronic devices for display.
  • the mobile phone 100-1 may also be selected by other electronic devices as a connected electronic device, that is, the content currently displayed by other electronic devices needs to be connected to the mobile phone 100-1 for display.
  • the mobile phone 100-1 sends different connection data to the electronic device that recommends the connection, and the mobile phone 100-1 uses different transmission methods when sending the connection data.
  • the mobile phone 100-1 displays the currently displayed online content by a recommended electronic device, such as online web texts and electronic books. Since the content displayed online by the mobile phone 100-1 is obtained from the server in real time Therefore, the mobile phone 100-1 only needs to send the web text JSON data or e-book JSON data generated for the content currently displayed online to the recommended connecting device. After the connecting device receives the web text JSON data or the e-book JSON data, it can obtain the corresponding web text content or e-book content from the corresponding server and display it. In this case, since the amount of data to be transmitted is small, only a Bluetooth channel needs to be established between the mobile phone 100-1 and the connected device to meet the transmission requirements.
  • a recommended electronic device such as online web texts and electronic books. Since the content displayed online by the mobile phone 100-1 is obtained from the server in real time Therefore, the mobile phone 100-1 only needs to send the web text JSON data or e-book JSON data generated for the content currently displayed online to the recommended connecting device. After the connecting device receives the web text JSON
  • the mobile phone 100-1 displays the currently displayed offline content by the recommended electronic device, for example, offline web texts and e-books. Since the mobile phone 100-1 needs to send the content displayed offline to other When the electronic device continues to display, it is also necessary to send the corresponding file (such as a local web file or electronic book file downloaded to the mobile phone 100-1) to the opposite end. Therefore, in this case, due to the large amount of data in the file, and in order to achieve fast connection, it is necessary to establish a Wi-Fi P2P channel with a large and fast data transmission volume between the mobile phone 100-1 and the connecting device.
  • the corresponding file such as a local web file or electronic book file downloaded to the mobile phone 100-1
  • the mobile phone 100-1 needs to transmit both online and offline files to the connection device for management and/or connection display.
  • the mobile phone 100-1 needs to send both the offline e-books and online e-books on the bookshelf of the WeChat reading APP to the connected electronic device for cross-device connection display or management, and display to the user when the user needs to read.
  • the mobile phone 100-1 needs to establish a Bluetooth channel and a Wi-Fi P2P channel with the connected electronics at the same time, transmit the web text JSON data or e-book JSON data with a small amount of data through the Bluetooth channel, and transmit offline files through the Wi-Fi P2P channel .
  • the connecting device and the mobile phone 100-1 need to start the connection. service function, and is in the state of being able to be connected, that is, transmission channels such as Bluetooth and Wi-Fi P2P have been turned on.
  • transmission channels such as Bluetooth and Wi-Fi P2P have been turned on.
  • the connection device in order to realize the continuation of the video currently played by the mobile phone 100-1, the connection device needs to be equipped with a video player; The continuation of electronic books or web texts requires the continuation device to be equipped with the continuation reading 120.
  • the process includes the following steps:
  • Step 601 The e-reader 100-5 receives the connection data sent by the mobile phone 100-1.
  • the connection service 118b of the e-reader 100-5 receives the web text JSON data or e-book JSON data sent by the mobile phone 100-1 through the bluetooth channel.
  • the e-reader 100-5 receives the web text JSON data and web text files, or the e-book JSON data and e-book files sent by the mobile phone 100-1 through the Wi-Fi P2P channel.
  • Step 602 The e-reader 100-5 identifies the corresponding application scenario based on the connection data.
  • the e-reader 100-5 uses different APPs to continuously display the content displayed by the mobile phone 100-1 according to different application scenarios identified.
  • connection service 118b of the e-reader 100-5 parses the URI of the web text from the connection data received by the mobile phone 100-1, and then can identify that the corresponding application scenario is web text reading.
  • the connection service 118b of the e-reader 100-5 parses the e-book JSON data from the connection data received by the mobile phone 100-1, and can identify that the corresponding application scenario is e-book reading.
  • Step 603 The e-reader 100-5 judges whether it is a reading scene. If so, it indicates that the content displayed next is web text or e-book, that is, the corresponding application scenario is web text reading or e-book reading scene, and enters step 604; otherwise, it is other application scenarios, such as audio-visual playback, games and other application scenarios, Go to step 605.
  • Step 604 The e-reader 100-5 displays the continuation data through the continuation reading 120.
  • the e-reader 100 - 5 determines that the application scene corresponding to the content to be continued is a reading scene, it will display the continued data through the continuing reading 120 .
  • the continuation service 118b of the e-reader 100-5 writes the received continuation data into the continuation reading 120, and the continuation reading 120 directly constructs an html interface on the display interface of the e-reader 100-5, and continues to display electronic books or web texts. .
  • the title, content summary, and reading progress of the e-book or web text are displayed.
  • the continuous reading 120 classifies and manages the e-books or web documents for continuous reading, and builds a reading bookshelf and a web text bookshelf. For the user to conveniently view the e-books or web articles that have been continued.
  • Step 605 The e-reader 100-5 displays the continued data through other APPs.
  • the e-reader 100-5 determines that the application scene corresponding to the content to be continued is not a reading scene, it will display the continued data through other APPs. For example, the e-reader 100-5 determines that the application scene corresponding to the content to be continued is a video playback scene, and then continues to play the video through the installed video player. For another example, the e-reader 100-5 determines that the application scene corresponding to the content to be continued is a game playing scene, and then continues to display the game interface through the installed game APP.
  • Step 701 The smart screen recognition 117 of the mobile phone 100-1 extracts the currently displayed content, and recognizes the scene of web text reading.
  • the mobile phone 100 -1 Invoke the minimal protocol communication service 122a of the framework layer through the connection service application 118a involved in step 501 to monitor which APP corresponds to the foreground application, and for a WeChat APP with multiple views, there are many possible application scenarios, which need to be further judgment.
  • the currently displayed content is extracted through the smart screen 117 of the mobile phone 100-1, and the web text reading scene is identified.
  • FIG. 8A shows the display interface 137 of the user's WeChat circle of friends, which includes a network resource link 138, which displays the title of the WeChat article 1.
  • a network resource link 138 which displays the title of the WeChat article 1.
  • the smart screen recognition 117 of the mobile phone 100-1 takes a screenshot of the content of the interface 101 and analyzes it, and then recognizes that the content displayed on the interface 101 is a web text, and then determines that the mobile phone 100-1 is currently in a web text reading scene.
  • Step 702 The smart recognition screen 117 of the mobile phone 100-1 sends the recognized scene information to the smart brain 116a of the mobile phone 100-1.
  • Step 703 The intelligent brain 116a of the mobile phone 100-1 recommends a connection device suitable for reading web texts among the discovered devices according to the scene information.
  • the mobile phone 100-1 discovers the e-reader 100-5, speakers, and notebook computers through the Bluetooth broadcast, and the smart brain 116a of the mobile phone 100-1 decides that the e-reader 100-5 is more suitable as a continuous reading device through preset rules. Electronic equipment.
  • Step 704 the smart brain 116a of the mobile phone 100-1 sends an instruction to display recommended devices to the control center 115 of the mobile phone 100-1.
  • the control center 115 for the mobile phone 100-1 displays recommended devices.
  • Step 705 The control center 115 of the mobile phone 100-1 displays the recommended device for the user to confirm whether to use the recommended device as an electronic device for continued reading.
  • the mobile phone 100-1 pops up a prompt message 144 as shown in FIG. 8B , “E-reader found, whether to connect to the e-reader to continue reading” 144 for user confirmation.
  • Step 706 The control center 115 of the mobile phone 100-1 determines to select the e-reader 100-5 as the device for continuing to read web texts.
  • control center 115 of the mobile phone 100-1 detects that the user clicks on the "Yes” control 145, it determines that the electronic reader 100-5 is selected as the device for continuing to read the web text. If the control center 115 of the mobile phone 100-1 detects that the user clicks on the "No" control 146, it determines not to select the e-reader 100-5 as the device for continuing web text reading.
  • Step 707 The control center 115 of the mobile phone 100-1 requests device information from the connection service 118b of the e-reader 100-5.
  • device information such as the MAC address of the e-reader 100-5, the token used when establishing a wireless communication connection, the pre-fabricated shared key (pre-shared key, PSK), and the device serial number are requested to establish a wireless communication connection, such as Bluetooth, Wi-Fi P2P, so as to exchange data according to the established wireless communication connection.
  • a wireless communication connection such as Bluetooth, Wi-Fi P2P
  • Step 708 The connection service 118b of the e-reader 100-5 returns the device information to the control center 115 of the mobile phone 100-1.
  • Step 709 the control center 115 of the mobile phone 100-1 sends a connection instruction to the connection service 118a of the mobile phone 100-1. To pull up the connection service 118a of the mobile phone 100-1.
  • Step 710 In response to the connection command, the connection service 118a of the mobile phone 100-1 sends a notification message of ready connection to the connection service 118b of the e-reader 100-5, so as to pull up the connection service 118b of the e-reader 100-5.
  • Step 711 The connection service 118b of the e-reader 100-5 returns a response message indicating that the connection function has been enabled to the connection service 118a of the mobile phone 100-1.
  • Step 712 The connection service 118a of the mobile phone 100-1 requests connection data from the smart screen 117 of the mobile phone 100-1.
  • Step 713 The smart screen recognition 117 of the mobile phone 100-1 returns connection data to the connection service 118a of the mobile phone 100-1.
  • the smart screen recognition 117 of the mobile phone 100-1 returns the web text JSON data defined in Table 2 corresponding to the WeChat web text 1 shown in FIG. 8A to the connection service 118a of the mobile phone 100-1.
  • Step 714 The connection service 118a of the mobile phone 100-1 sends the connection data to the connection service 118b of the e-reader 100-5.
  • the mobile phone 100-1 needs to send the WeChat web text 1 displayed online as shown in Figure 8A to the e-reader 100-5 that recommends the connection for display, then the connection service 118a of the mobile phone 100-1 needs to display the WeChat text 1 as shown in Figure 8A
  • the web text JSON data corresponding to the content of the shown WeChat web text 1 is sent as the connection data to the connection service 118b of the e-reader 100-5 through the bluetooth channel.
  • the mobile phone 100-1 needs to send the WeChat web text 2 (not shown) displayed offline to the e-reader 100-5 recommended for connection display, then the connection service 118a of the mobile phone 100-1 needs to send the mobile phone 100-1 1's smart recognition screen 117 requests the corresponding web text JSON data of WeChat web text 2, and requests the file corresponding to the offline web text from the WeChat APP (not shown), and then uses the above web text JSON data and the file as the continuation data, Send to the connection service 118b of the e-reader 100-5 through Wi-Fi P2P, so that the e-reader 100-5 requests the content of the WeChat web text 2 from the server based on the URI in the web text JSON data.
  • connection service 118a of the mobile phone 100-1 can pass the 100-1’s Smart Screen 117 defines the interface to determine whether the current application scenario is an online web text reading scene or an offline web text reading scene, so as to further determine whether to send and connect via Bluetooth or Wi-Fi P2P data.
  • Step 715 The continuation service 118b of the e-reader 100-5 sends the continuation data and an instruction to start the continuation reading service to the continuation reading 120 of the e-reader 100-5, so that the continuation reading 120 of the e-reader 100-5 starts the continuation reading service, continue to display web content.
  • Step 716 The continuous reading 120 of the e-reader 100-5 starts the continuous reading service, and continuously displays the web content.
  • a dialog box 152 pops up in the interface 151 shown in FIG. 100-1, please select the service you need” text prompt, and "read now” control 153 and “read later” control 154.
  • the continuous reading 120 of the e-reader 100-5 detects the click operation of the user on the "read now" control 153, then the continuous reading operation is performed, and the continuous reading service is started according to the continuous data received from the continuous service 118a of the mobile phone 100-1 , and display the web page interface, that is, display the content of the web text.
  • the reading continuation 120 of the e-reader 100-5 detects the user's click operation on the "Read Now" control 153, it parses the continuation data received from the continuation service 118a of the mobile phone 100-1,
  • the URI corresponding to the WeChat webpage 1 in the interface 101 shown in Figure 8A will be included in the continuation data, and the interface content corresponding to the URI is requested from the server, and the web page interface corresponding to the WeChat webpage 1 is constructed, and the following is displayed:
  • continuation reading 120 of the e-reader 100-5 detects the user's click operation on the "read later" control 154, then according to the continuation data received from the continuation service 118a of the mobile phone 100-1, a corresponding thumbnail or title is generated, adding Go to the later reading menu of the electronic reader 100-5 to continue reading 120, for the user to click on the later reading menu when the user needs to consult the web text, and select the web text of interest therefrom, and then the reading of the web text content can be carried out.
  • reading continuation 120 of e-reader 100-5 detects a user click on "read later" control 154
  • reading continuation 120 responds to the continuation service 118a received from cell phone 100-1.
  • the data is analyzed, and the URI corresponding to the WeChat web text 1 in the interface 101 shown in Figure 8A will be included in the continuation data (this place is an example of an online web text), and the interface content corresponding to the URI is requested from the server, and then According to the requested interface content, information such as the title of the web article is extracted, and added to the later reading 156 as shown in FIG. 8D . If the user clicks on the WeChat web text 1, the e-reader 100-5 jumps to the content display interface 102 of the WeChat web text 1 as shown in FIG. 2D.
  • the continuous reading 120 of the e-reader 100-5 parses the web text files in the received continuation data into html files, and displays the parsed html files as display content.
  • the e-reader 100-5 continuous reading 120 can also add the historically continued web texts to the web text bookshelf, so that the user can click and view the corresponding historically continued web texts when needed. For example, as shown in FIG. 2F , the e-reader 100 - 5 adds the Weibo web article 1 , Jinri Toutiao web article 1 , etc. that have been continued in history to the web article bookshelf 105 .
  • Step 717 The continuation reading 120 of the e-reader 100-5 notifies the continuation service 118 of the e-reader 100-5 that the continuation has been completed.
  • Step 718 The connection service 118 of the e-reader 100-5 is disconnected from the connection service 118a of the mobile phone 100-1.
  • the continuation service 118b of the e-reader 100-5 can be sent to the mobile phone
  • the connection service 118a of 100-1 sends a notification to disconnect the communication connection between the e-reader 100-5 and the mobile phone 100-1.
  • Step 901 The reading application 111 of the mobile phone 100-1 registers the continuation service with the continuation service 118a.
  • the reading application 111 in order to monitor the reading application 111 by the connection service 118a of the mobile phone 100-1, the reading application 111 needs to register with the minimal protocol communication service 122a of the mobile phone 100-1.
  • the mobile phone 100-1 is currently displaying the book interface 103 in the WeChat reading APP.
  • the mobile phone 100-1 can monitor which APP corresponds to the foreground application through the connection service application 118a involved in step 501 in FIG. By monitoring the foreground application and confirming that the foreground application is in the preset white list, it can be determined that the current application scenario is an e-book reading scenario.
  • the mobile phone 100-1 can also take a screenshot of the content of the interface 103 through the smart screen recognition 117 and analyze it, and then recognize that the content displayed on the interface 103 is an electronic book, and then determine that the mobile phone 100-1 is currently in the electronic book. Book reading scene.
  • Step 902 The connection service 118a of the mobile phone 100-1 sends the recognized scene information to the intelligent brain 116a of the mobile phone 100-1.
  • Step 903 The intelligent brain 116a of the mobile phone 100-1 recommends a connection device suitable for reading e-books among the discovered devices according to the scene information.
  • the mobile phone 100-1 discovers the e-reader 100-5, speakers, and notebook computers through the Bluetooth broadcast, and the smart brain 116a of the mobile phone 100-1 decides that the e-reader 100-5 is more suitable as a continuous reading device through preset rules. Electronic equipment.
  • Step 904 the smart brain 116a of the mobile phone 100-1 sends an instruction to display recommended devices to the control center 115 of the mobile phone 100-1.
  • the control center 115 for the mobile phone 100-1 displays recommended devices.
  • Step 905 The control center 115 of the mobile phone 100-1 displays the recommended device for the user to choose to confirm whether to use the recommended device as the electronic device for continued reading.
  • the mobile phone 100-1 pops up a prompt message 162 as shown in FIG. 10A , “E-reader found, whether to connect to the e-reader to continue reading” 162 for user confirmation.
  • Step 906 The control center 115 of the mobile phone 100-1 determines to select the e-reader 100-5 as the device for continuing to read the e-book.
  • control center 115 of the mobile phone 100-1 detects that the user clicks on the "Yes” control 164, it determines that the electronic reader 100-5 is selected as the device for continuing to read the electronic book. If the control center 115 of the mobile phone 100-1 detects that the user clicks on the "No” control 163, it determines not to select the e-reader 100-5 as the device for continuing to read the e-book.
  • Step 907 The control center 115 of the mobile phone 100-1 requests device information from the connection service 118b of the e-reader 100-5.
  • device information such as the MAC address of the electronic reader 100-5, the token used when establishing a wireless communication connection, the pre-fabricated shared key (pre-shared key, PSK), and the device serial number are requested to establish a wireless communication connection, such as Bluetooth, Wi-Fi P2P, so as to exchange data according to the established wireless communication connection.
  • a wireless communication connection such as Bluetooth, Wi-Fi P2P
  • Step 908 The connection service 118b of the e-reader 100-5 returns the device information to the control center 115 of the mobile phone 100-1.
  • Step 909 the control center 115 of the mobile phone 100-1 sends a connection instruction to the connection service 118a of the mobile phone 100-1. To pull up the connection service 118a of the mobile phone 100-1.
  • Step 910 In response to the connection command, the connection service 118a of the mobile phone 100-1 sends a notification message of ready connection to the connection service 118b of the e-reader 100-5, so as to pull up the connection service 118b of the e-reader 100-5.
  • Step 911 The connection service 118b of the e-reader 100-5 returns a response message that the connection function has been enabled to the connection service 118a of the mobile phone 100-1.
  • Step 912 The connection service 118a of the mobile phone 100-1 requests connection data from the smart screen 117 of the mobile phone 100-1.
  • the continuation service 118a of the mobile phone 100-1 may also directly request the JSON data of the currently displayed e-book from the reading application 111 of the mobile phone 100-1.
  • Step 913 The smart screen recognition 117 of the mobile phone 100-1 returns connection data to the connection service 118a of the mobile phone 100-1.
  • the smart screen recognition 117 of the mobile phone 100-1 returns the JSON data corresponding to the WeChat e-book 1 shown in FIG. 2E to the connection service 118a of the mobile phone 100-1.
  • the continuation service 118a of the mobile phone 100-1 directly requests the currently displayed e-book JSON data from the reading application 111 of the mobile phone 100-1, and then the continuation service to the mobile phone 100-1 is provided by the reading application 111 of the mobile phone 100-1. 118a returns the JSON data corresponding to the electronic book 1.
  • Step 914 The connection service 118a of the mobile phone 100-1 sends the connection data to the connection service 118b of the e-reader 100-5.
  • the mobile phone 100-1 needs to send the WeChat e-book 1 displayed online as shown in FIG.
  • the shown JSON data corresponding to the WeChat e-book 1 is sent as the connection data to the connection service 118b of the e-reader 100-5 through the bluetooth channel.
  • the mobile phone 100-1 needs to send the offline displayed WeChat e-book 2 (not shown) to the recommended e-reader 100-5 for continued display, then the continued service 118a of the mobile phone 100-1 needs to send the mobile phone 100-1 1's smart screen recognition 117 requests the JSON data corresponding to the WeChat e-book 2, and requests the file corresponding to the offline e-book from the WeChat APP (not shown), or the connection service 118a of the mobile phone 100-1 directly sends the corresponding file to the mobile phone 100-1.
  • the WeChat APP requests the JSON data and files corresponding to the WeChat e-book 2, and then sends the JSON data and files corresponding to the e-book 2 as connection data to the connection service 118b of the e-reader 100-5 through Wi-Fi P2P.
  • connection service 118a of the mobile phone 100-1 in order to make the connection service 118a of the mobile phone 100-1 determine which wireless communication method is used to transmit the connection data before sending the connection data, it can query the data contained in the above-mentioned e-book JSON data used to represent the current The identification field of the application scenario, such as the "file_path" field, is used to determine the corresponding application scenario. If the connection service 118a of the mobile phone 100-1 determines that the "file_path" field is not included in the e-book JSON data before sending the connection data, then it is determined that the current application scenario is online reading of e-books and the cross-device flow, and the connection data is sent through the Bluetooth channel That's it.
  • connection service 118a of the mobile phone 100-1 determines that the "file_path" field is included in the JSON data of the e-book before sending the connection data, and the length of this field is 1, then it is determined that the current application scenario is to read e-books offline and transfer them across devices. Then send connection data through Wi-Fi P2P.
  • connection service 118a of the mobile phone 100-1 determines that the "file_path" field is included in the e-book JSON data before sending the connection data, and the length of this field is greater than 1, then it is determined that the current application scenario is online and offline mixed bookshelf flow across devices , then the online e-book JSON data needs to be sent via Bluetooth, and the offline e-book file data needs to be sent via Wi-Fi P2P.
  • Step 915 The continuation service 118b of the e-reader 100-5 sends the continuation data and an instruction to start the continuation reading service to the continuation reading 120 of the e-reader 100-5, so that the continuation reading 120 of the e-reader 100-5 starts the continuation reading service, continue to display the content of the e-book.
  • Step 916 The continuous reading 120 of the electronic reader 100-5 starts the continuous reading service, and continuously displays the content of the electronic book.
  • the continuation reading 120 of the e-reader 100-5 requests the corresponding online e-book from the continuation reading 120 server according to the name of the e-book in the JSON data parsed from the continuation data, and the online e-book Books are displayed as display content.
  • the reading continuation 120 of the e-reader 100-5 directly calls the local import and local e-book progress synchronization process according to the name of the e-book in the JSON data parsed from the continuation data and the e-book file. Interface to get the reading progress from the parsed JSON data, and then display the offline e-book content under the corresponding progress.
  • a dialog box 152 pops up in the interface 151 shown in FIG. , please select the service you need” text prompt, and the "read now” control 153 and the “read later” control 154.
  • the e-reader 100-5 detects the user's click operation on the "Read Now" control 153, it will execute the immediate reading operation, and directly pull up from the continuation reading 120 according to the continuation data received from the continuation service 118a of the mobile phone 100-1.
  • the reader module (the module used to realize the function of the reader in the continuation reading 120 ), and displays the current continuation and synchronization of the electronic book pages through the analyzed electronic book data.
  • the e-reader 100-5 after the e-reader 100-5 detects the user's click operation on the "read now" control 153, it parses the connection data received from the connection service 118a of the mobile phone 100-1, and converts the connection data into Include corresponding to the JSON data of WeChat electronic book 1 in the interface 103 as shown in Figure 2E, the reader module in the continuous reading 120 of electronic reader 100-5 according to the JSON data of WeChat electronic book 1, to the continuous reading 120 The server requests the corresponding electronic book content, and displays the corresponding book page as the display content.
  • the electronic reader 100-5 detects the user's click operation on the "read later" control 154, then according to the connection data received from the connection service 118a of the mobile phone 100-1, a corresponding thumbnail or title is generated and added to the electronic reader 100-5 Continue reading 120 for later reading, for users to click on the later reading 156 shown in Figure 8D when they need to consult e-books, and select the e-books they are interested in to read the e-book content. Implement cross-device read later functionality.
  • the continuous reading 120 of the e-reader 100-5 can synchronize the reading progress according to the progress information.
  • the content displayed on the interface 104 of the electronic reader 100-5 as shown in FIG. 2E is consistent with the content displayed on the interface 103 of the mobile phone 100-1 in FIG. 2E, that is, the synchronization of the reading progress is realized.
  • the e-reader 100-5 reading 120 can also add historically continued e-books to the reading bookshelf 106 as shown in FIG. 2G , so that users can click to view the corresponding historically continued e-books when needed.
  • the e-reader 100-5 detects the user's click operation on the "Read Now" control 153 as shown in FIG. -1
  • the continuation data received by the continuation service 118a is analyzed, and the JSON data corresponding to the WeChat electronic book 1 in the interface 103 shown in FIG. 2E is included in the continuation data, and the interface corresponding to the JSON data is requested from the continuation reading server content, and extract information such as the title and reading progress of the electronic book, and generate the electronic book 1 in the reading bookshelf 106 as shown in FIG. 2G .
  • the electronic reader 100-5 jumps to the content display interface 104 of the WeChat electronic book 1 as shown in FIG. 2E.
  • the e-reader 100-5 may perform deduplication judgment before adding an e-book to the bookshelf for reading, for example, for the received
  • the continuation data is analyzed, and according to the e-book file name and file size obtained by the analysis, it is judged whether the e-book is already in the reading shelf.
  • Step 917 The continuation reading 120 of the e-reader 100-5 notifies the continuation service 118 of the e-reader 100-5 that the continuation has been completed.
  • Step 918 The connection service 118 of the e-reader 100-5 is disconnected from the connection service 118a of the mobile phone 100-1.
  • the mobile phone 100- The connection service 118a of 1 sends a notification to disconnect the communication connection between the e-reader 100-5 and the mobile phone 100-1.
  • the WeChat web text currently displayed by the mobile phone 100-1 involved in the first embodiment is connected to the automatically recommended electronic reader 100-5 for continuous display, and the current displayed text on the mobile phone 100-1 is involved in the second embodiment.
  • the electronic book is connected to the automatically recommended electronic reader 100-5 for continuous display as an example, and the distributed display solution provided by the application is introduced in detail.
  • the distributed display solution provided by this application can also send multiple offline or online e-books on the bookshelf of the reading APP currently running on the mobile phone 100-1 to the e-reader 100-5 in batches,
  • the e-reader 100-5 performs continuous management and display of multiple offline or online e-books received in batches on the reading bookshelf or the online bookshelf of the continuous reading 120 . That is to say, the e-reader 100-5 can also play the role of the mobile phone 100-1 and perform reverse connection.
  • a “later reading card” for the later reading function can also be generated in the continuous reading 120 of the electronic reader 100-5.
  • the "later reading card” is a service card embedded in the continuous reading 120, which is an interface display form of the meta-service (Feature Ability, FA) (here refers to the later reading service provided by the continuous reading 120) , forward important information or operations of the later reading service to the card to achieve direct service.
  • FA feature Ability
  • the user long presses the icon 165 of continuing reading on the desktop of the electronic reader 100-5, and the pop-up drop-down menu includes a service card control 166 and an uninstall control 167, when the user clicks the service card After the control 166, a later reading card 168 as shown in FIG. 10C pops up, and the user can freely drag the later reading card 168 to any position on the desktop of the e-reader 100-5. If the user clicks on the card 168 to read later, the interface 169 shown in FIG. 10D is entered, and any web text or electronic book in the user interface 169 can realize the function of reading later.
  • the following will take the flowchart shown in FIG. 11 as an example to exemplarily introduce that the mobile phone 100-1 sends multiple offline or online e-books on the bookshelf of the reading application 111 to the e-reader 100-5 in batches.
  • 100-5 The process of performing continuation management and display on the reading bookshelf of continuation reading 120, hereinafter referred to as the cross-device transfer process of mixed bookshelves.
  • the flow chart shown in FIG. 11 differs only in that step 912', step 913' and step 914' shown in FIG. 11 are different from those shown in FIG.
  • Step 912, step 913, step 914, and step 916 are different, and other steps are all the same as the corresponding steps in the flow chart shown in Figure 9, therefore, only the steps 912', 913', and steps shown in Figure 11 are below 914' and step 916' are introduced in detail. specifically,
  • Step 912' The continuation service 118a of the mobile phone 100-1 requests the continuation data from the reading application 111 of the mobile phone 100-1.
  • the mobile phone 100-1 recommends the e-reader 100-5 as an electronic device suitable for continuing reading from among the discovered electronic devices, and the mobile phone 100-1 responds to the user's request to connect the e-reader 100-5 as the connecting device After the operation, a wireless communication connection is made with the electronic reader 100-5.
  • the mobile phone 100-1 needs to send multiple e-books on the bookshelf of the WeChat reading APP to the e-reader 100-5 for continuous management or display. Then the user can select a plurality of offline and/or online e-books on the WeChat reading APP bookshelf of the mobile phone 100-1, and then send them in batches to the e-reader 100-5 for continuous management or display.
  • the connection service 118a of the mobile phone 100-1 selects the data of a plurality of offline and/or online electronic books to be connected to the reading application 111 user of the mobile phone 100-1.
  • Step 913' The reading application 111 of the mobile phone 100-1 returns the connection data to the connection service 118a of the mobile phone 100-1.
  • Step 914' The connection service 118a of the mobile phone 100-1 sends the connection data to the connection service 118b of the e-reader 100-5.
  • the bookshelf display interface 171 of the mobile phone 100-1 WeChat reading APP is displayed.
  • the mobile phone 100-1 WeChat reading APP bookshelf includes electronic books 1 to electronic books 4, wherein Electronic book 1 is an offline electronic book that has been downloaded to the mobile phone 100-1, and electronic books 2 to 4 are online electronic books.
  • the connection service 118a of the mobile phone 100-1 sends a message to the connection service 118b of the electronic reader 100-5.
  • connection service 118a of mobile phone 100-1 sends the e-book JSON data corresponding to e-book 2 and e-book 3 via Bluetooth; for offline e-book 1, the mobile phone 100-1 The connection service 118a sends the file corresponding to the electronic book 1 to the connection service 118b of the electronic reader 100-5 through Wi-Fi P2P.
  • the data sent by the connection service 118a of the mobile phone 100-1 to the connection service 118b of the e-reader 100-5 via Bluetooth has, for example, the format shown in Table 3 below:
  • Table 3 is only an illustrative example of the data format sent by the connection service 118a of the mobile phone 100-1 to the connection service 118b of the e-reader 100-5 via Bluetooth.
  • the mobile phone 100- The specific format of the data sent by the connection service 118a of 1 to the connection service 118b of the e-reader 100-5 through Bluetooth, and the meaning of each field can be determined according to the actual situation, and this application does not limit it.
  • Step 916' The continuous reading 120 of the e-reader 100-5 starts the continuous reading service according to the received data.
  • the reading module of the continuous reading 120 of the electronic reader 100-5 processes the JSON data of the above-mentioned electronic book 1 received, requests the downloading and viewing information of the electronic book 1 from the server of the continuous reading 120, and displays the information as shown in FIG. 12 on the indicated reading shelf.
  • the continuous reading 120 of electronic reader 100-5 directly invokes the interface of local import and local e-book progress synchronization, imports the files of above-mentioned e-book 2 and e-book 3 received into the reading bookshelf, and displays them on the display as shown in FIG. 12 . Reading bookshelf. In this way, cross-device bookshelf management is realized and user experience is improved.
  • Step 917 The continuation reading 120 of the e-reader 100-5 notifies the continuation service 118 of the e-reader 100-5 that the continuation has been completed.
  • Step 918 The connection service 118 of the e-reader 100-5 is disconnected from the connection service 118a of the mobile phone 100-1.
  • the mobile phone 100-1 can be sent to the mobile phone 100-1
  • the connection service 118a of the e-reader sends a notification to disconnect the communication connection between the e-reader 100-5 and the mobile phone 100-1.
  • the distributed display solution provided by this application identifies the current application scenarios of electronic devices, and automatically selects electronic devices that are more suitable for continuous display from other electronic devices found in the device network according to the identified application scenarios.
  • Non-passively, only the device pre-selected by the user can be used as the connecting device under the user's operation, which can improve the user experience.
  • the distributed display solution provided by this application is in the reading scenario, that is, when the content currently displayed by the electronic device is an electronic book, web text, or the bookshelf of the reading APP, the electronic device as the connecting device can also display the E-books or web texts sent by other electronic devices are classified and managed, and corresponding reading bookshelves are generated corresponding to e-books, and corresponding web text bookshelves are generated corresponding to web texts, so as to provide users with better continuous reading services and further improve users' reading experience.
  • the reading experience in context.
  • Fig. 13 shows a structural block diagram of a source display device 200 according to some embodiments of the present application.
  • the source display apparatus 200 includes a first determining unit 201 , a second determining unit 202 and a sending unit 203 .
  • the first determination unit 201 is used to determine the target content to be continuously displayed on other display devices in the source display device 200;
  • the second determination unit 202 is used to determine the target content suitable for continuous display from multiple display devices based on the target content.
  • the target display device of the content; the sending unit 203 configured to send to the target display device the connection data required for continuous display of the target content on the target display device.
  • the target content is the content currently displayed by the source display device.
  • the second determining unit determines a target display device suitable for successively displaying the target content from multiple display devices in the following manner:
  • the second determination unit determines the application scenario corresponding to the target content based on the target content
  • the second determining unit determines a target display device suitable for successively displaying the target content from the plurality of display devices according to the application scenario.
  • the second determining unit determines a target display device suitable for successively displaying the target content from multiple display devices in the following manner:
  • the second determining unit determines, based on the target content, that the application scene corresponding to the target content is the reading scene;
  • the second determination unit determines a target display device suitable for successively displaying the target content in the reading scene from the plurality of display devices according to the reading scene.
  • the second determination unit determines the application scenario corresponding to the target content in the following manner:
  • the second determining unit determines, based on the target content, a first application installed on the source display device for displaying the target content;
  • the second determining unit determines the application scenario corresponding to the target content according to the first application.
  • the sending unit sends the continuation data required to continue displaying the target content on the target display device to the target display device in the following manner:
  • the sending unit sends to the target display device via bluetooth the connection data required for continuing to display the target content on the target display device; or
  • the sending unit transmits to the target display device through point-to-point wireless fidelity (Wireless-Fidelity point-to-point, Wi-Fi P2P) to continue displaying the online content on the target display device The required continuation data.
  • point-to-point wireless fidelity Wireless-Fidelity point-to-point, Wi-Fi P2P
  • connection data is the online web text connection data
  • online web text connection data includes a uniform resource identifier (Uniform Resource Identifier, URI) of the online web text
  • the continuation data is the offline web text continuation data
  • the offline web text continuation data includes the file of the offline web text
  • the continuation data is the online e-book continuation data
  • the online e-book continuation data includes the identification of the online e-book and the reading progress
  • the continuation data is the offline electronic book continuation data
  • the offline electronic book continuation data includes files and reading progress of the offline electronic book.
  • the online web document continuation data further includes at least one of the online web document title, resolution source, resolution time, server source, and integrity verification identifier.
  • the offline web document connection data further includes at least one of the URI, title, resolution source, resolution time, server source, and integrity check identifier of the offline web text.
  • the online electronic book continuation data further includes: the chapter structure of the online electronic book.
  • the continuation data of the offline electronic book further includes: at least one of an identifier of the online electronic book and a chapter structure.
  • connection data includes an application package name
  • the application package name is used to instruct the target display device to open the target content through the application corresponding to the application package name.
  • connection data further includes the identity authentication information of the first application installed on the source display device for displaying the target content, and the identity authentication information is used to enable the target display device to have the authority to obtain the target content from the server of the first application .
  • the server of the first application installed on the source display device for displaying the target content and the server of the second application installed on the target display device for successively displaying the target content have mutual access rights, so that the second application The server of has the right to access the target content in the server of the first application, wherein the first application of the source display device obtains the target content from the server of the first application.
  • Fig. 14 shows a structural block diagram of an object display device 300 according to some embodiments of the present application.
  • the target display device 300 includes a receiving unit 301 , a display unit 302 , a first adding unit 303 , and a second adding unit 304 .
  • the receiving unit 301 is configured to receive the continuation data sent by the source display device for displaying the target content continuously on the target display device, wherein the target content is the content in the source display device determined by the first determining unit of the source display device.
  • the content to be continuously displayed by other display devices; the display unit 302 configured to continuously display the target content according to the connection data received from the sending unit of the source display device.
  • the first adding unit 303 is configured to add the target content to the bookshelf of the second application according to the connection data received from the sending unit of the source display device; the second adding unit 304 is configured to Add the target content to the later reading card of the second application installed on the target display device.
  • the connection data is an online web text connection data
  • the online web text connection data includes a uniform resource identifier (Uniform Resource Identifier, URI) of the online web text.
  • URI Uniform Resource Identifier
  • the continuation data is offline web text continuation data
  • the offline web text continuation data includes offline web text files
  • the continuation data is the online electronic book continuation data
  • the online electronic book continuation data includes the identification of the online electronic book and the reading progress.
  • the continuation data is offline electronic book continuation data
  • the offline electronic book continuation data includes files and reading progress of the offline electronic book
  • the display unit continues to display the target content by:
  • the display unit continues to display the online web text according to the URI received from the source display device;
  • the display unit continues to display the offline web text according to the file of the offline web text received from the sending unit of the source display device;
  • the display unit continues to display the online electronic book according to the identification of the online electronic book received from the transmitting unit of the source display device;
  • the display unit continues to display the offline electronic book according to the file of the online electronic book received from the sending unit of the source display device.
  • the online web document continuation data further includes at least one of the online web document title, resolution source, resolution time, server source, and integrity verification identifier.
  • the offline web document connection data further includes at least one of the URI, title, resolution source, resolution time, server source, and integrity check identifier of the offline web text.
  • the online electronic book continuation data further includes: the chapter structure of the online electronic book.
  • the continuation data of the offline electronic book further includes: at least one of an identifier of the online electronic book and a chapter structure.
  • connection data includes an application package name
  • the application package name is used to instruct the target display device to open the target content through the application corresponding to the application package name.
  • connection data further includes the identity authentication information of the first application installed on the source display device for displaying the target content, and the identity authentication information is used to enable the target display device to have the authority to obtain the target content from the server of the first application .
  • the server of the first application installed on the source display device for displaying the target content and the server of the second application installed on the target display device for successively displaying the target content have mutual access rights, so that the second application The server of has the right to access the target content in the server of the first application, wherein the first application of the source display device obtains the target content from the server of the first application.
  • Embodiments of the mechanisms disclosed in this application may be implemented in hardware, software, firmware, or a combination of these implementation methods.
  • Embodiments of the present application may be implemented as a computer program or program code executed on a programmable system comprising at least one processor, a storage system (including volatile and non-volatile memory and/or storage elements) , at least one input device, and at least one output device.
  • Program code can be applied to input instructions to perform the functions described herein and to generate output information.
  • the output information may be applied to one or more output devices in known manner.
  • a processing system includes any computer having a processor such as, for example, a Digital Signal Processor (DSP), a microcontroller, an Application Specific Integrated Circuit (ASIC), or a microprocessor. system.
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuit
  • the program code can be implemented in a high-level procedural language or an object-oriented programming language to communicate with the processing system.
  • Program code can also be implemented in assembly or machine language, if desired.
  • the mechanisms described in this application are not limited in scope to any particular programming language. In either case, the language may be a compiled or interpreted language.
  • the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof.
  • the disclosed embodiments can also be implemented as instructions carried by or stored on one or more transitory or non-transitory machine-readable (e.g., computer-readable) storage media, which can be executed by one or more processors read and execute.
  • instructions may be distributed over a network or via other computer-readable media.
  • a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including, but not limited to, floppy disks, optical disks, optical disks, read-only memories (CD-ROMs), magnetic CD-ROM, Read Only Memory (ROM), Random Access Memory (Random Access Memory, RAM), Erasable Programmable Read Only Memory (EPROM), Electrically Erasable Programmable Only Memory Read memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), magnetic card or optical card, flash memory, or use the Internet to transmit information by means of electricity, light, sound or other forms of propagation signals (for example, carrier waves, infrared signals, digital signals etc.) tangible machine-readable storage.
  • a machine-readable medium includes any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).
  • each unit/module mentioned in each device embodiment of this application is a logical unit/module.
  • a logical unit/module can be a physical unit/module, or a physical unit/module.
  • a part of the module can also be realized with a combination of multiple physical units/modules, the physical implementation of these logical units/modules is not the most important, the combination of functions realized by these logical units/modules is the solution The key to the technical issues raised.
  • the above-mentioned device embodiments of this application do not introduce units/modules that are not closely related to solving the technical problems proposed by this application, which does not mean that the above-mentioned device embodiments do not exist other units/modules.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请涉及终端技术领域,特别涉及一种用于分布式显示的屏幕识别方法、介质及电子设备。该方法包括:第一电子设备确定第一电子设备中要通过其他电子设备进行接续显示的目标内容;第一电子设备基于目标内容,从多个电子设备中确定出适合接续显示目标内容的第二电子设备;第一电子设备向第二电子设备发送用于在第二电子设备上接续显示目标内容所需的接续数据;第二电子设备根据从第一电子设备接收的接续数据接续显示目标内容。本申请的技术方案中,第一电子设备可以根据当前显示的内容来确定出当前的应用场景,从而根据当前的应用场景,自动从其他电子设备中确定出适合接续显示该当前显示内容的第二电子设备,有助于提升用户体验。

Description

用于分布式显示的屏幕识别方法、介质及电子设备
本申请要求于2021年09月24日提交中国专利局、申请号为202122327031.6、申请名称为“源显示装置和目标显示装置”,以及2022年04月26日提交中国专利局、申请号为202210454464.4、名称为“用于分布式显示的屏幕识别方法、介质及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域,特别涉及一种用于分布式显示的屏幕识别方法、介质及电子设备。
背景技术
随着智能终端技术的发展,一个用户或家庭中往往具备多个电子设备。在一些场景下,用户可能需要将一个电子设备当前显示的内容,切换至另一个电子设备上接续显示。例如,用户在下班途中使用手机阅读电子书籍,回家后可能希望将阅读的电子书籍切换至更适合阅读的电子阅读器,以继续阅读电子书籍。又例如,用户在家可使用平板电脑浏览网文,当用户离开家时,可能希望将平板电脑上的网文切换至更加容易携带的手机,以继续浏览网文。
然而,在一些将一个电子设备当前显示的内容,切换至另一个电子设备上接续显示的技术方案(以下简称内容接续技术方案)中,需要用户人为地预先选择用以实现接续显示功能的电子设备,待切换的电子设备需要在用户的操作下,被动地与用户预先选择的用以实现接续显示功能的电子设备建立连接,用户体验不佳。
发明内容
本申请实施例提供了一种用于分布式显示的屏幕识别方法、介质及电子设备。
本申请的技术方案中第一电子设备首先确定出要通过其他电子设备进行接续显示的目标内容,然后基于确定出的目标内容,从多个电子设备中确定出适合接续显示前述目标内容的第二电子设备,并且向第二电子设备发送用于在第二电子设备上接续显示该目标内容所需的接续数据。第二电子设备则根据从第一电子设备接收的接续数据接续显示该目标内容。例如,第一电子设备确定出的目标显示内容为第一电子设备当前显示的内容,第一电子设备可以根据当前显示的内容来确定出当前的应用场景,从而根据当前的应用场景,自动从其他电子设备中确定出适合接续显示该当前显示内容的第二电子设备,有助于提升用户体验。
第一方面,本申请实施例提供了一种源显示装置,包括:
第一确定单元,用于确定源显示装置中要通过其他显示装置进行接续显示的目标内容;
第二确定单元,用于基于目标内容,从多个显示装置中确定出适合接续显示目标内容的目标显示装置;
发送单元,用于向目标显示装置发送用于在目标显示装置上接续显示目标内容所需的接续数据。
例如,目标内容为在线网文、离线网文、在线电子书籍、离线电子书籍、视频、游戏等等。
在上述第一方面的一种可能的实现中,上述目标内容为源显示装置当前显示的内容。
如此,可以根据源显示装置当前显示的内容来确定出当前的应用场景,从而根据当前的应用场景,自动从多个显示装置中确定出适合接续显示目标内容的目标显示装置。有助于提升用户体验。
在上述第一方面的一种可能的实现中,上述第二确定单元通过以下方式从多个显示装置中确定出适合接续显示目标内容的目标显示装置:
第二确定单元基于目标内容,确定出与目标内容对应的应用场景;
第二确定单元根据应用场景,从多个显示装置中确定出适合接续显示目标内容的目标显示装置。
例如,应用场景可以为在线网文阅读场景、离线网文阅读场景、在线电子书籍阅读场景、离线电子书籍阅读场景以及混合书架跨设备流转场景等等。其中,混合书架跨设备流转场景可以为批量将源显示装置的某阅读APP中的多本离线的电子书籍、多本在线的电子书籍,或者包括在线电子书籍以及离线电子书籍在内的多本电子书籍,通过目标显示装置中的目标应用进行接续管理和/或接续显示。
其中,目标显示装置中的目标应用即可以与源显示装置中用于打开目标内容的应用相同,又可以与源显示装置中用于打开目标内容的应用不同。
通过对目标内容进行应用场景的识别,根据识别出的应用场景自动筛选出适合作为接续显示的显示装置,可以提升用户体验。
在上述第一方面的一种可能的实现中,上述第二确定单元通过以下方式从多个显示装置中确定出适合接续显示目标内容的目标显示装置:
第二确定单元基于目标内容,确定出与目标内容对应的应用场景为阅读场景;
第二确定单元根据阅读场景,从多个显示装置中确定出适合接续显示阅读场景中的目标内容的目标显示装置。
即在识别出与目标内容对应的应用场景为阅读场景的情况下,可以自动从多个显示装置中确定出适合接续显示阅读场景中的目标内容的目标显示装置,可以提升用户体验。
在上述第一方面的一种可能的实现中,上述第二确定单元通过以下方式确定出与目标内容对应的应用场景:
第二确定单元基于目标内容,确定出源显示装置安装的用于显示目标内容的第一应用;
第二确定单元根据第一应用,确定出与目标内容对应的应用场景。
例如,对于一些APP,应用场景是唯一确定的,例如阅读APP,用户只能通过阅读APP阅读电子书籍,无法通过阅读APP聊天、视频、看网文。假设源显示装置中保存有阅读场景对应的APP的白名单,这些白名单中包含各种阅读APP的标识信息,例如,包含有微信阅读APP、掌上阅读APP等。当源显示装置通过监听得到当前的显示界面对应的APP在上述白名单中时,确定当前的应用场景为阅读场景。
而对于另一些APP,应用场景是无法确定的,例如对于微信APP,具有聊天会话界面、朋友圈展示界面、通过网络链接进入的网文界面等等多种视图,需要通过对目标内容本身进行解析,进一步确定目标内容是以上聊天会话界面、朋友圈展示界面、网文界面等其中的哪一个界面,从而得到唯一确定的应用场景。
在上述第一方面的一种可能的实现中,上述发送单元通过以下方式向目标显示装置发送用于在目标显示装置上接续显示目标内容所需的接续数据:
在目标内容为在线内容的情况下,发送单元通过蓝牙向目标显示装置发送用于在目标显示装置上 接续显示目标内容所需的接续数据;或
在目标内容为离线内容的情况下,发送单元通过点到点无线保真(Wireless-Fidelity point-to-point,Wi-Fi P2P)向目标显示装置发送用于在目标显示装置上接续显示在线内容所需的接续数据。
例如,通过蓝牙发送在线网文和在线电子书籍对应的接续数据。又如,通过Wi-Fi P2P发送离线网文和离线电子书籍对应的接续数据。
根据接续数据类型的不同,或者说根据接续数据的数据量的大小,选择不同的发送方式,可以提升数据发送效率。
在上述第一方面的一种可能的实现中,在目标内容为在线网文的情况下,上述接续数据为在线网文接续数据,在线网文接续数据包括在线网文的统一资源标识符(UniformResource Identifier,URI);或
在目标内容为离线网文的情况下,接续数据为离线网文接续数据,离线网文接续数据包括显示离线网文的文件;或
在目标内容为在线电子书籍的情况下,接续数据为在线电子书籍接续数据,在线电子书籍接续数据包括在线电子书籍的标识以及阅读进度;或
在目标内容为离线电子书籍的情况下,接续数据为离线电子书籍接续数据,离线电子书籍接续数据包括离线电子书籍的文件以及阅读进度。
在上述第一方面的一种可能的实现中,上述在线网文接续数据还包括在线网文的标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在上述第一方面的一种可能的实现中,上述离线网文接续数据还包括离线网文的URI、标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在上述第一方面的一种可能的实现中,上述在线电子书籍接续数据还包括:在线电子书籍的章节结构。
从而使目标显示装置可以根据在线电子书籍的章节结构同步在线电子书籍的章节。
在上述第一方面的一种可能的实现中,上述离线电子书籍接续数据还包括:在线电子书籍的标识以及章节结构中的至少一种。
在上述第一方面的一种可能的实现中,上述接续数据包括应用包名,应用包名用于指示目标显示装置通过应用包名对应的应用打开目标内容。
例如,应用包名为源显示装置安装的用于打开目标内容的第一应用的包名,则目标显示装置可以通过第一应用打开目标内容。又如,应用包名为与源显示装置安装的用于打开目标内容的第一应用的包名不同的第二应用的包名,则目标显示装置可以通过第二应用打开目标内容。
此外,接续数据也可以不包括应用包名,在这种情况下,目标显示装置可以通过与源显示装置安装的用于打开目标内容的第一应用相同的应用打开目标内容。
在上述第一方面的一种可能的实现中,上述接续数据还包括源显示装置安装的用于显示目标内容的第一应用的身份认证信息,身份认证信息用于使目标显示装置具有从第一应用的服务器获取目标内容的权限。
在上述第一方面的一种可能的实现中,上述源显示装置安装的用于显示目标内容的第一应用的服务器,与目标显示装置安装的用于接续显示目标内容的第二应用的服务器具有互相访问权限,使第二应用的服务器具有访问第一应用的服务器中的目标内容的权限,其中,源显示装置的第一应用从第一应用的服务器获取目标内容。
第二方面,本申请实施例提供了一种目标显示装置,包括:
接收单元,用于接收源显示装置发送的用于在目标显示装置上接续显示目标内容所需的接续数据,其中,目标内容为源显示装置的第一确定单元确定出的源显示装置中要通过其他显示装置进行接续显示的内容;
显示单元,用于根据从源显示装置的发送单元接收的接续数据接续显示目标内容。
在上述第二方面的一种可能的实现中,在目标内容为在线网文的情况下,接续数据为在线网文接续数据,在线网文接续数据包括在线网文的统一资源标识符(UniformResource Identifier,URI);或
在目标内容为离线网文的情况下,接续数据为离线网文接续数据,离线网文接续数据包括离线网文的文件;或
在目标内容为在线电子书籍的情况下,接续数据为在线电子书籍接续数据,在线电子书籍接续数据包括在线电子书籍的标识以及阅读进度;或
在目标内容为离线电子书籍的情况下,接续数据为离线电子书籍接续数据,离线电子书籍接续数据包括离线电子书籍的文件以及阅读进度。
在上述第二方面的一种可能的实现中,显示单元通过以下方式接续显示目标内容:
在目标内容为在线网文的情况下,显示单元根据从源显示装置接收的URI,接续显示在线网文;或
在目标内容为离线网文的情况下,显示单元根据从源显示装置的发送单元接收的离线网文的文件,接续显示离线网文;或
在目标内容为在线电子书籍的情况下,显示单元根据从源显示装置的发送单元接收的在线电子书籍的标识,接续显示在线电子书籍;或
在目标内容为离线电子书籍的情况下,显示单元根据从源显示装置的发送单元接收的在线电子书籍的文件,接续显示离线电子书籍。
在上述第二方面的一种可能的实现中,在线网文接续数据还包括在线网文的标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在上述第二方面的一种可能的实现中,离线网文接续数据还包括离线网文的URI、标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在上述第二方面的一种可能的实现中,在线电子书籍接续数据还包括:在线电子书籍的章节结构。
在上述第二方面的一种可能的实现中,离线电子书籍接续数据还包括:在线电子书籍的标识以及章节结构中的至少一种。
在上述第二方面的一种可能的实现中,接续数据包括应用包名,应用包名用于指示目标显示装置通过应用包名对应的应用打开目标内容。
在上述第二方面的一种可能的实现中,接续数据还包括源显示装置安装的用于显示目标内容的第一应用的身份认证信息,身份认证信息用于使目标显示装置具有从第一应用的服务器获取目标内容的权限。
在上述第二方面的一种可能的实现中,源显示装置安装的用于显示目标内容的第一应用的服务器,与目标显示装置安装的用于接续显示目标内容的第二应用的服务器具有互相访问权限,使第二应用的服务器具有访问第一应用的服务器中的目标内容的权限,其中,源显示装置的第一应用从第一应用的服务器获取目标内容。
在上述第二方面的一种可能的实现中,目标显示装置安装有用于显示目标内容的第二应用,装置还包括:
第一添加单元,用于根据从源显示装置的发送单元接收的接续数据,将目标内容添加至第二应用的书架中。
在上述第二方面的一种可能的实现中,上述装置还包括:
第二添加单元,用于根据从源显示装置的发送单元接收的接续数据,在目标显示装置安装的第二应用的稍后阅读卡片中添加目标内容。
其中,稍后阅读卡片为一种嵌入到第二应用中的服务卡片,是元服务(这里是指第二应用提供的稍后阅读服务)的一种界面显示形式,将稍后阅读服务的重要信息或操作前置到卡片,以实现服务直达,方便用户操作。
第三方面,本申请实施例提供了一种源显示装置,包括:
存储器,用于存储由源显示装置的一个或多个处理器执行的指令;
处理器,当指令被一个或多个处理器执行时,使源显示装置确定出要通过其他显示装置进行接续显示的目标内容,并且基于目标内容,从多个显示装置中确定出适合接续显示目标内容的目标显示装置,以及使源显示装置向目标显示装置发送用于在目标显示装置上接续显示目标内容所需的接续数据。
第四方面,本申请实施例提供了一种源显示装置,包括:
存储器,用于存储由目标显示装置的一个或多个处理器执行的指令;
处理器,当指令被一个或多个处理器执行时,使目标显示装置接收源显示装置发送的用于在目标显示装置上接续显示目标内容所需的接续数据,其中,目标内容为源显示装置确定出的源显示装置中要通过其他显示装置进行接续显示的内容,以及使目标显示装置根据从源显示装置接收的接续数据接续显示目标内容。
第五方面,本申请实施例提供了一种用于分布式显示的屏幕识别方法,包括:
第一电子设备确定第一电子设备中要通过其他电子设备进行接续显示的目标内容;
第一电子设备基于目标内容,从多个电子设备中确定出适合接续显示目标内容的第二电子设备;
第一电子设备向第二电子设备发送用于在第二电子设备上接续显示目标内容所需的接续数据;
第二电子设备根据从第一电子设备接收的接续数据接续显示目标内容。
在上述第五方面的一种可能的实现中,上述目标内容为第一电子设备当前显示的内容。
在上述第五方面的一种可能的实现中,上述第一电子设备基于目标内容,从多个电子设备中确定出适合接续显示目标内容的第二电子设备,包括:
第一电子设备基于目标内容,确定出与目标内容对应的应用场景;
第一电子设备根据应用场景,从多个电子设备中确定出适合接续显示目标内容的第二电子设备。
在上述第五方面的一种可能的实现中,上述第一电子设备基于目标内容,从多个电子设备中确定出适合接续显示目标内容的第二电子设备,包括:
第一电子设备基于目标内容,确定出与目标内容对应的应用场景为阅读场景;
第一电子设备根据阅读场景,从多个电子设备中确定出适合接续显示阅读场景中的目标内容的第二电子设备。
在上述第五方面的一种可能的实现中,上述第一电子设备基于目标内容,确定出与目标内容对应的应用场景,包括:
第一电子设备基于目标内容,确定出第一电子设备安装的用于显示目标内容的第一应用;
第一电子设备根据第一应用,确定出与目标内容对应的应用场景。
在上述第五方面的一种可能的实现中,上述第一电子设备向第二电子设备发送用于在第二电子设 备上接续显示目标内容所需的接续数据,包括:
在目标内容为在线内容的情况下,第一电子设备通过蓝牙向第二电子设备发送用于在第二电子设备上接续显示目标内容所需的接续数据;或
在目标内容为离线内容的情况下,第一电子设备通过点到点无线保真(Wireless-Fidelity point-to-point,Wi-Fi P2P)向第二电子设备发送用于在第二电子设备上接续显示在线内容所需的接续数据。
在上述第五方面的一种可能的实现中,在目标内容为在线网文的情况下,接续数据为在线网文接续数据,在线网文接续数据包括在线网文的统一资源标识符(UniformResource Identifier,URI);或
在目标内容为离线网文的情况下,接续数据为离线网文接续数据,离线网文接续数据包括离线网文的文件;或
在目标内容为在线电子书籍的情况下,接续数据为在线电子书籍接续数据,在线电子书籍接续数据包括在线电子书籍的标识以及阅读进度;或
在目标内容为离线电子书籍的情况下,接续数据为离线电子书籍接续数据,离线电子书籍接续数据包括离线电子书籍的文件以及阅读进度。
在上述第五方面的一种可能的实现中,上述第二电子设备根据从第一电子设备接收的接续数据接续显示目标内容,包括:
在目标内容为在线网文的情况下,第二电子设备根据从第一电子设备接收的URI,接续显示在线网文;或
在目标内容为离线网文的情况下,第二电子设备根据从第一电子设备接收的离线网文的文件,接续显示离线网文;或
在目标内容为在线电子书籍的情况下,第二电子设备根据从第一电子设备接收的在线电子书籍的标识,接续显示在线电子书籍;或
在目标内容为离线电子书籍的情况下,第二电子设备根据从第一电子设备接收的在线电子书籍的文件,接续显示离线电子书籍。
在上述第五方面的一种可能的实现中,上述在线网文接续数据还包括在线网文的标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在上述第五方面的一种可能的实现中,上述离线网文接续数据还包括离线网文的URI、标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在上述第五方面的一种可能的实现中,上述在线电子书籍接续数据还包括:在线电子书籍的章节结构。
在上述第五方面的一种可能的实现中,上述离线电子书籍接续数据还包括:在线电子书籍的标识以及章节结构中的至少一种。
在上述第五方面的一种可能的实现中,上述第二电子设备安装有用于显示目标内容的第二应用,方法还包括:
第二电子设备根据从第一电子设备接收的接续数据,将目标内容添加至第二应用的书架中。
在上述第五方面的一种可能的实现中,上述方法还包括:
第二电子设备根据从第一电子设备接收的接续数据,在第二电子设备安装的第二应用的稍后阅读卡片中添加目标内容。
在上述第五方面的一种可能的实现中,上述接续数据包括应用包名,应用包名用于指示第二电子 设备通过应用包名对应的应用打开目标内容。
在上述第五方面的一种可能的实现中,上述接续数据还包括第一电子设备安装的用于显示目标内容的第一应用的身份认证信息,身份认证信息用于使第二电子设备具有从第一应用的服务器获取目标内容的权限。
在上述第五方面的一种可能的实现中,第一电子设备安装的用于显示目标内容的第一应用的服务器,与第二电子设备安装的用于接续显示目标内容的第二应用的服务器具有互相访问权限,使第二应用的服务器具有访问第一应用的服务器中的目标内容的权限,其中,第一电子设备的第一应用从第一应用的服务器获取目标内容。
第六方面,本申请实施例提供了一种用于分布式显示的屏幕识别方法,包括:
第一电子设备确定第一电子设备中要通过其他电子设备进行接续显示的目标内容;
第一电子设备基于目标内容,从多个电子设备中确定出适合接续显示目标内容的第二电子设备;
第一电子设备向第二电子设备发送用于在第二电子设备上接续显示目标内容所需的接续数据。
在上述第六方面的一种可能的实现中,目标内容为第一电子设备当前显示的内容。
在上述第六方面的一种可能的实现中,第一电子设备基于目标内容,从多个电子设备中确定出适合接续显示目标内容的第二电子设备,包括:
第一电子设备基于目标内容,确定出与目标内容对应的应用场景;
第一电子设备根据应用场景,从多个电子设备中确定出适合接续显示目标内容的第二电子设备。
在上述第六方面的一种可能的实现中,第一电子设备基于目标内容,从多个电子设备中确定出适合接续显示目标内容的第二电子设备,包括:
第一电子设备基于目标内容,确定出与目标内容对应的应用场景为阅读场景;
第一电子设备根据阅读场景,从多个电子设备中确定出适合接续显示阅读场景中的目标内容的第二电子设备。
在上述第六方面的一种可能的实现中,第一电子设备基于目标内容,确定出与目标内容对应的应用场景,包括:
第一电子设备基于目标内容,确定出第一电子设备安装的用于显示目标内容的第一应用;
第一电子设备根据第一应用,确定出与目标内容对应的应用场景。
在上述第六方面的一种可能的实现中,第一电子设备向第二电子设备发送用于在第二电子设备上接续显示目标内容所需的接续数据,包括:
在目标内容为在线内容的情况下,第一电子设备通过蓝牙向第二电子设备发送用于在第二电子设备上接续显示目标内容所需的接续数据;或
在目标内容为离线内容的情况下,第一电子设备通过点到点无线保真(Wireless-Fidelity point-to-point,Wi-Fi P2P)向第二电子设备发送用于在第二电子设备上接续显示在线内容所需的接续数据。
在上述第六方面的一种可能的实现中,在目标内容为在线网文的情况下,接续数据为在线网文接续数据,在线网文接续数据包括在线网文的统一资源标识符(UniformResource Identifier,URI);或
在目标内容为离线网文的情况下,接续数据为离线网文接续数据,离线网文接续数据包括离线网文的文件;或
在目标内容为在线电子书籍的情况下,接续数据为在线电子书籍接续数据,在线电子书籍接续数据包括在线电子书籍的标识以及阅读进度;或
在目标内容为离线电子书籍的情况下,接续数据为离线电子书籍接续数据,离线电子书籍接续数据包括离线电子书籍的文件以及阅读进度。
在上述第六方面的一种可能的实现中,在线网文接续数据还包括在线网文的标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在上述第六方面的一种可能的实现中,离线网文接续数据还包括离线网文的URI、标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在上述第六方面的一种可能的实现中,在线电子书籍接续数据还包括:在线电子书籍的章节结构。
在上述第六方面的一种可能的实现中,离线电子书籍接续数据还包括:在线电子书籍的标识以及章节结构中的至少一种。
在上述第六方面的一种可能的实现中,接续数据包括应用包名,应用包名用于指示第二电子设备通过应用包名对应的应用打开目标内容。
在上述第六方面的一种可能的实现中,接续数据还包括第一电子设备安装的用于显示目标内容的第一应用的身份认证信息,身份认证信息用于使第二电子设备具有从第一应用的服务器获取目标内容的权限。
在上述第六方面的一种可能的实现中,第一电子设备安装的用于显示目标内容的第一应用的服务器,与第二电子设备安装的用于接续显示目标内容的第二应用的服务器具有互相访问权限,使第二应用的服务器具有访问第一应用的服务器中的目标内容的权限,其中,第一电子设备的第一应用从第一应用的服务器获取目标内容。
第七方面,本申请实施例提供了一种用于分布式显示的屏幕识别方法,包括:
第二电子设备接收第一电子设备发送的用于在第二电子设备上接续显示目标内容所需的接续数据,其中,目标内容为第一电子设备确定出的第一电子设备中要通过其他电子设备进行接续显示的内容;
第二电子设备根据从第一电子设备接收的接续数据接续显示目标内容。
在上述第七方面的一种可能的实现中,在目标内容为在线网文的情况下,接续数据为在线网文接续数据,在线网文接续数据包括在线网文的统一资源标识符(Uniform Resource Identifier,URI);或
在目标内容为离线网文的情况下,接续数据为离线网文接续数据,离线网文接续数据包括离线网文的文件;或
在目标内容为在线电子书籍的情况下,接续数据为在线电子书籍接续数据,在线电子书籍接续数据包括在线电子书籍的标识以及阅读进度;或
在目标内容为离线电子书籍的情况下,接续数据为离线电子书籍接续数据,离线电子书籍接续数据包括离线电子书籍的文件以及阅读进度。
在上述第七方面的一种可能的实现中,第二电子设备根据从第一电子设备接收的接续数据接续显示目标内容,包括:
在目标内容为在线网文的情况下,第二电子设备根据从第一电子设备接收的URI,接续显示在线网文;或
在目标内容为离线网文的情况下,第二电子设备根据从第一电子设备接收的离线网文的文件,接续显示离线网文;或
在目标内容为在线电子书籍的情况下,第二电子设备根据从第一电子设备接收的在线电子书籍的标识,接续显示在线电子书籍;或
在目标内容为离线电子书籍的情况下,第二电子设备根据从第一电子设备接收的在线电子书籍的 文件,接续显示离线电子书籍。
在上述第七方面的一种可能的实现中,第二电子设备安装有用于显示目标内容的第二应用,方法还包括:
第二电子设备根据从第一电子设备接收的接续数据,将目标内容添加至第二应用的书架中。
在上述第七方面的一种可能的实现中,上述方法还包括:
第二电子设备根据从第一电子设备接收的接续数据,在第二电子设备安装的第二应用的稍后阅读卡片中添加目标内容。
第八方面,本申请实施例提供了一种计算机可读存储介质,计算机可读存储介质上存储有指令,该指令在电子设备上执行时使电子设备执行上述第六方面以及第六方面的任意一种可能的实现中的方法或者上述第七方面以及第七方面的任意一种可能的实现中的用于分布式显示的屏幕识别方法。
第九方面,本申请实施例提供了一种计算机程序产品,计算机程序产品包括指令,指令用于实现上述第六方面以及第六方面的任意一种可能的实现中的方法或者上述第七方面以及第七方面的任意一种可能的实现中的用于分布式显示的屏幕识别方法。
第十方面,本申请实施例提供了一种芯片装置,芯片装置包括:
通信接口,用于输入和/或输出信息;
处理器,用于执行计算机可执行程序,使得安装有芯片装置的设备执行上述第六方面以及第六方面的任意一种可能的实现中的方法或者上述第七方面以及第七方面的任意一种可能的实现中的用于分布式显示的屏幕识别方法。
第十一方面,本申请实施例提供了一种电子设备,包括:
存储器,用于存储由电子设备的一个或多个处理器执行的指令,以及
处理器,当指令被一个或多个处理器执行时,处理器用于执行上述第六方面以及第六方面的任意一种可能的实现中的方法或者上述第七方面以及第七方面的任意一种可能的实现中的用于分布式显示的屏幕识别方法。
附图说明
图1根据本申请的一些实施例,示出了一种内容接续系统;
图2A示出了一种视频接续方案的UI示意图;
图2B示出了图2A所示的视频接续方案的流程图;
图2C根据本申请的一些实施例,示出了一种跨设备的接续阅读场景示意图;
图2D根据本申请的一些实施例,示出了一种跨设备的网文接续的UI示意图;
图2E根据本申请的一些实施例,示出了一种跨设备的电子书籍接续的UI示意图;
图2F根据本申请的一些实施例,示出了一种电子阅读器上的网文书架的UI示意图;
图2G根据本申请的一些实施例,示出了一种电子阅读器上的阅读书架的UI示意图;
图3根据本申请的一些实施例,示出了一种手机的硬件结构示意图;
图4根据本申请的一些实施例,示出了一种手机和电子阅读器的软件分层结构图;
图5根据本申请的一些实施例,示出了一种手机识别应用场景、结合场景推荐接续设备的流程图;
图6根据本申请的一些实施例,示出了一种电子阅读器从手机接收接续数据、接续显示的流程图;
图7根据本申请的一些实施例,示出了一种手机和电子阅读器之间跨设备接续阅读网文的交互图;
图8A根据本申请的一些实施例,示出了一种手机打开了图8A所示的朋友圈中一篇网文的UI示意 图;
图8B根据本申请的一些实施例,示出了一种手机推荐电子阅读器作为接续设备并进行提示的UI示意图;
图8C根据本申请的一些实施例,示出了一种已连接电子阅读器作为接续设备,提示用户选择不同阅读服务功能的UI示意图;
图8D根据本申请的一些实施例,示出了一种电子阅读器的稍后阅读的UI示意图;
图9根据本申请的一些实施例,示出了一种手机和电子阅读器之间跨设备接续阅读电子书籍的交互图;
图10A根据本申请的一些实施例,示出了一种手机推荐电子阅读器作为接续设备并进行提示的UI示意图;
图10B根据本申请的一些实施例,示出了一种用户长按电子阅读器桌面的接续阅读APP的UI示意图;
图10C根据本申请的一些实施例,示出了一种电子阅读器桌面上添加了稍后阅读卡片的UI示意图;
图10D根据本申请的一些实施例,示出了一种用户点击打开图10C所示的稍后阅读卡片的UI示意图;
图11根据本申请的一些实施例,示出了一种手机和电子阅读器之间跨设备批量接续书架上的电子书籍的交互图;
图12根据本申请的一些实施例,示出了一种手机和电子阅读器之间跨设备批量接续书架上的电子书籍的UI示意图。
图13根据本申请的一些实施例,示出了一种源显示装置的结构框图;
图14根据本申请的一些实施例,示出了一种目标显示装置的结构框图。
具体实施方式
下面将结合附图对本实施例的实施方式进行详细描述。
本申请实施例提供的一种用于分布式显示的屏幕识别方法,可应用于图1所示的内容接续系统10中。如图1所示,该内容接续系统10包括多个电子设备,例如手机100-1、平板电脑100-2、计算机100-3、智能手表100-4以及电子阅读器100-5。
在一些场景下,用户可能需要将内容接续系统10其中一个电子设备正在显示的电子书籍、网文、游戏或视频等显示内容,切换至另一电子设备上进行接续显示。例如,用户在下班途中使用手机100-1的阅读应用程序(Application,APP)阅读电子书籍,回家后可能希望将阅读的电子书籍切换至更适合阅读的具有护眼功能的电子阅读器100-5,以继续阅读该电子书籍。或者,用户回家后希望将手机100-1的视频APP播放的视频切换至屏幕更大的平板电脑100-2进行续播。又如,用户在家可使用平板电脑100-2浏览微博APP的网文,当用户离开家时,可能希望将平板电脑100-2上的微博APP的网文切换至更加容易携带的手机100-1,以继续浏览网文。
在一些实施例中,为了实现一电子设备接续显示另一电子设备当前显示的内容,需要用户先确定选择哪一个电子设备作为接续设备,然后待接续的电子设备在用户的操作下,被动地通过“碰一碰”方式与用户预先选择好的电子设备建立通信连接,从而进行内容接续。
在一些实施例中,用户在下班途中使用手机100-1观看视频,但是用户发现手机100-1电量即将耗尽,而此时身边无可充电设备,无法给手机100-1充电,则用户希望将手机100-1当前播放的视频切换 至随身携带的智能手表100-4进行接续播放。例如,将如图2A所示的手机100-1当前播放的电视剧A,切换至智能手表100-4进行接续播放,则需要用户先选择智能手表100-4作为接续播放视频的电子设备,然后用户手持手机100-1,通过“碰一碰”的方式与智能手表100-4建立通信连接,从而进行视频的接续。具体地,如图2B所示,手机100-1通过“碰一碰”的方式与智能手表100-4建立连接,通过智能手表100-4实现对视频的接续播放的方法包括以下步骤:
步骤201:手机100-1“碰一碰”智能手表100-4。
例如,在一些实施例中,手机100-1安装有“碰一碰”应用,手机100-1和智能手表100-4均设置有近场通信(near field communication,NFC)标签,例如NFC芯片。其中,“碰一碰”应用为可在手机100-1开机后以常驻进程的形式长期运行的应用程序,用于在检测到用户触发了手机100-1的碰一碰功能时,调用手机100-1的NFC标签。
步骤202:手机100-1和智能手表100-4建立无线通信连接。
例如,在一些实施例中,当手机100-1在用户的移动下,与智能手表100-4靠近时,手机100-1通过NFC标签从智能手表100-4的NFC标签中获取智能手表100-4的设备信息,例如媒体访问控制(Media Access Control,MAC)地址等,并基于获取的MAC地址,建立和智能手表100-4的蓝牙、点到点无线保真(Wireless-Fidelity point-to-point,Wi-Fi P2P)等无线通信连接。
步骤203:手机100-1获取当前播放内容的标签。
例如,在一些实施例中,当手机100-1和智能手表100-4建立无线通信连接之后,手机100-1可从正在前台运行的应用中获取当前具体显示内容的标签(tag)。该显示内容的标签用于记录用户对当前显示内容的浏览位置。
如图2A所示,以手机100-1的视频APP正在播放电视剧A举例,手机100-1可以请求视频APP查询电视剧A的播放页面的标识,例如播放页面的统一资源标识符(Uniform Resource Identifier,URI),以及电视剧A的播放进度,例如,播放进度为第11集第5分钟。进而,仍如图2A所示,手机100-1可将电视剧A的播放进度和播放页面的标识作为当前显示内容的标签发送给智能手表100-4。
步骤204:手机100-1向智能手表100-4发送当前播放内容的标签。
例如,手机100-1通过蓝牙,将如图2A所示的电视剧A的播放进度和播放页面的标识作为当前显示内容的标签,发送给智能手表100-4。以供智能手表100-4基于该标签实现对手机100-1当前播放的电视剧A的续播。
步骤205:智能手表100-4接续播放电视剧A。
例如,智能手表100-4接收到如图2A所示的电视剧A的上述标签后,如果智能手表100-4安装有相同的视频APP,则智能手表100-4的视频APP可以按照上述标签中包含的播放页面标识和播放进度在服务器中请求相应的播放页面,实现对电视剧A的续播。
然而,在如图2A以及图2B所示的实施例中,手机100-1是在用户的操作下,被动的通过“碰一碰”方式与用户预先选择好的智能手表100-4建立通信连接,然后采用智能手表100-4实现对手机100-1当前显示的内容的接续。作为接续播放的电子设备,有可能造成用户选择的电子设备不适合作为接续设备,例如用户选择的智能手表100-4的屏幕较小,不适合观看视频,或者有可能用户选择的电子设备无法实现内容接续功能,用户体验较差。
为了解决上述技术问题,在本申请提供的用于分布式显示的屏幕识别方法中,通过对电子设备当前的应用场景进行识别,从而根据识别出的应用场景,自动在设备网中发现的其他电子设备中筛选出更加适合作为接续显示的电子设备,以提高用户的使用体验。例如,通过对电子设备当前显示的内容进行 识别,确定出电子设备当前显示的为电子书籍或网文,则确定出当前的应用场景为阅读场景,从而在发现的多个电子设备中,自动推荐出具有护眼功能的电子设备作为接续阅读的电子设备;又如,通过对电子设备当前显示的内容进行识别,确定出电子设备当前显示的为视频,则确定出当前的应用场景为视频播放场景,从而在发现的多个电子设备中,自动推荐出显示能力较强,例如屏幕较大,分辨率较高的电子设备,作为接续视频播放的电子设备。
此外,进一步地,本申请提供的分布式显示方案在阅读场景下,即电子设备当前显示的内容为电子书籍或网文,作为接续设备的电子设备还能够对其他电子设备发来的电子书籍或网文进行分类管理,对应电子书籍生成相应的阅读书架,对应网文生成相应的网文书架,从而为用户提供较好的接续阅读服务,提升用户体验。
例如,在如图2C所示的实施例中,在阅读场景下,手机100-1和智能手表100-4均自动推荐电子阅读器100-5作为接续阅读的电子设备,则手机100-1和智能手表100-4均可以将当前显示的电子书籍或网文,通过自动推荐出的电子阅读器100-5进行接续显示。
具体地,例如,在如图2D所示的实施例中,手机100-1将界面101显示的微信网文1通过手机100-1自动推荐的电子阅读器100-5进行接续显示,则电子阅读器100-5的界面102显示的内容即为微信网文1的内容,也即电子阅读器100-5的界面102显示的内容与手机100-1界面101显示的内容一致。又如,在如图2E所示的实施例中,手机100-1将界面103显示的电子书籍1通过手机100-1自动推荐的电子阅读器100-5进行接续显示,则电子阅读器100-5的界面104显示的内容即为电子书籍1的内容,也即电子阅读器100-5的界面104显示的内容与手机100-1界面103显示的内容一致。
此外,电子阅读器100-5还可以将从手机100-1接续过来的网文和电子书籍分别添加到电子阅读器100-5构建的网文书架以及阅读书架中,以供用户在需要的时候,从网文书架中选择相应的网文或从阅读书架中选择相应的电子书籍进行阅读。
具体地,例如,在如图2F所示的实施例中,电子阅读器100-5将从手机100-1接续过来的微信网文1添加到网文书架105中。又如,在如图2G所示的实施例中,电子阅读器100-5将从手机100-1接续过来的电子书籍1添加到阅读书架106中。以供用户在需要的时候,选择网文或电子书籍进行阅读。关于具体如何接续,将在下文进行详细介绍。
此外,本申请提供的分布式显示方案,不仅能够实现对视频内容的接续播放,还能实现对电子书籍、网文、办公文件等内容的接续显示,应用范围广。
需要说明的是,本申请提供的分布式显示方案适用的电子设备可以为任意一种具有显示屏的电子设备,包括但不限于手机、电子阅读器、平板电脑、智能电视、笔记本电脑、超级移动个人计算机(Ultra-mobile Personal Computer,UMPC)、手持计算机、上网本、个人数字助理(Personal Digital Assistant,PDA)、可穿戴电子设备、车载设备、虚拟现实设备等,本申请实施例对此不做任何限制。
为了方便描述,下面以用户当前使用的手机100-1上显示的内容,在其他电子设备上接续显示为例,对本申请提供的分布式显示方案进行详细介绍。
下面将首先结合图3,介绍能够执行本申请提供的分布式显示方案的手机100-1的硬件结构图。如图3所示,手机100-1可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,用户标识模块(Subscriber Identification Module,SIM)卡接口195、充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180、显示屏194、摄像头193、指示器192、按键190等。
可以理解的是,本申请实施例示意的结构并不构成对手机100-1的具体限定。在本申请另一些实施例中,手机100-1可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110用于对手机100-1当前显示的内容进行识别,并基于识别出的当前显示的内容,匹配出合适的电子设备作为接续设备,以对手机100-1当前显示的内容进行解析。
手机100-1的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。手机100-1中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在手机100-1上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(lownoise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。
无线通信模块160可以提供应用在手机100-1上的包括无线局域网(wireless localarea networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequencymodulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。
手机100-1通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emittingdiode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrixorganic light emitting diode的,AMOLED),柔性发光二极管(flex light-emittingdiode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot lightemitting diodes,QLED)等。在一些实施例中,显示屏194用于显示手机100-1前台应用的用户界面。
手机100-1可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感 光元件上,光信号转换为电信号,摄像头感光元件将电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。
外部存储器接口120可以用于连接外部存储卡,实现扩展手机100-1的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行手机100-1的各种功能应用以及数据处理。
手机100-1可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。手机100-1可以通过扬声器170A收听音乐,或收听免提通话。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当手机100-1接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风170C发声,将声音信号输入到麦克风170C。手机100-1可以设置至少一个麦克风170C。在另一些实施例中,手机100-1可以设置两个麦克风170C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,手机100-1还可以设置三个,四个或更多麦克风170C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
传感器模块180中可以包括压力传感器,陀螺仪传感器,气压传感器,磁传感器,加速度传感器,距离传感器,接近光传感器,指纹传感器,温度传感器,触摸传感器,环境光传感器,骨传导传感器等。
此外,手机100-1还可以包括充电管理模块140、电源管理模块141、电池142、按键190、指示器192以及1个或多个SIM卡接口等,本申请实施例对此不做限定。
如图3所示的手机100-1的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以图4所示的分层架构的安卓 TM操作系统为例,示例性说明手机100-1和作为接续设备的电子阅读器100-5的软件结构。分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。
在如图4所示的实施例中,将安卓 TM操作系统从上至下分为应用层,框架层,以及内核层。
应用层可以包括一系列应用程序包。具体地,如图4所示,适用于本申请提供的内容接续技术方案的手机100-1包括阅读应用111、微博应用112、视频应用113、靠近发现114a、智慧识屏117、控制中心115、智慧大脑116a、接续服务118a等应用。可以理解的是,手机100-1的应用程序层还可以包括通话,备忘录,浏览器,联系人,相机,图库,日历,地图,蓝牙,音乐,短信息等其他APP。
其中,手机100-1的阅读应用111:用于阅读电子书籍的APP,提供书籍内容的信息源。
微博应用112:用于浏览新闻或微博的web网页内容的APP,提供web网页内容的信息源。
视频应用113:用于浏览流媒体视频内容的APP,为用户提供视频下载、播放等功能。
手机100-1的靠近发现114a:用于在设备网中发现手机100-1周围其他可以建立通信连接的其他电子设备,并且获取发现的电子设备的信息,例如获取发现的电子设备的名称、设备的能力、设备类型、MAC地址等设备信息。例如,在一些实施例中,手机100-1的蓝牙被打开之后,显示出多个可连接设备的基本信息,例如显示出可连接的多个设备的设备型号。手机100-1通过智慧识屏117确定出当前的应用场景,并且手机100-1通过智慧大脑116a结合确定出的应用场景推荐出适合接续的电子设备之后,手机100-1的控制中心115显示出推荐的电子设备,供用户确认,在确认连接推荐的电子设备之后,手机100-1的靠近发现114a直接从推荐的电子设备获取该电子设备的能力、MAC地址等关键信息。其中,设备的能力可以包括运算能力、拾音能力、安全能力、显示能力、播放能力、拍照能力、存储能力等。
示例性的,上述设备信息中还可以包括该设备与其他电子设备建立无线通信连接时用于身份鉴权的认证信息。例如,该认证信息可以为和手机100-1建立无线通信连接时使用的token、预制共享密钥(pre-shared key,PSK)或设备序列号等,本申请实施例对此不做任何限制。
手机100-1的智慧识屏117:用于对手机100-1当前显示的内容进行提取并对提取的内容进行识别。例如,提取前台界面文字和内容,智能分析文字和图片和网页信息元,以供手机100-1的智慧大脑116a基于分析结果,从发现的设备中,确定更加适合用来接续展示手机100-1当前显示内容的接续设备。
手机100-1的智慧大脑116a:用于基于识别出的应用场景,对发现的设备进行排序,从发现的设备中推荐出与当前的应用场景相应的电子设备,并将最终推荐的设备发送给控制中心115进行UI呈现。
手机100-1的控制中心115:用于显示发现的周围设备列表、推荐的设备信息、手机100-1接续的状态,例如开始接续、接续成功的提示信息等等。
手机100-1的接续服务118a:用于建立手机100-1和推荐的接续设备之间信令传输的业务通道,例如蓝牙通道和Wi-Fi P2P通道,蓝牙通道用于传输数据量小的指令和内容;Wi-Fi P2P通道用于传输数据量大的文件或大数据。此外,手机100-1的接续服务118a还用于根据手机100-1前台显示界面对应的APP进行应用场景的识别。如果能够通过该APP确定出唯一的明确的应用场景,则手机100-1的接续服务118a可以将手机100-1当前显示的内容发送至推荐的电子设备,进行接续显示。
例如,在一些实施例中,手机100-1的阅读应用111向手机100-1的接续服务118a注册了监听服务,则手机100-1的接续服务118a通过监听到手机100-1前台显示界面对应的APP为阅读应用111,从而可以确定出当前的应用场景为阅读电子书籍的场景,然后将当前界面显示的电子书籍内容封装成JSON数据(一种基于文本的轻量级数据格式)的数据(以下简称电子书籍JSON数据),发送给推荐接续的电子设备,以供该电子设备根据接收到的电子书籍JSON数据从接续阅读服务器请求对应的页面内容,从而将请求到的页面内容显示出来,实现接续阅读功能。
在一些实施例中,电子书籍JSON数据包括电子书籍的标识、阅读电子书籍的进度、章节标识,听书的播放进度、听书的章节标识、本地电子书籍文件名称,以及接续流转的目标应用名等等。
例如,在一些实施例中,电子书籍JSON数据可以被定义为包括如下表1所示的多个字段的格式。
字段名称 描述
"onehop_data_type" 7
“onehop_receive_type” 2
"diff_package_name" 接续流转目标包名,无此字段表示同包名接续
"diff_app_name" 接续流转目标应用名,方便应用市场下载
“file_path” 文件路径:List<Uri>,含多本书籍,在线接续无此字段
"reader_sp" "zhangyue|dianzhong|alibaba|yuewen|huawei"
"reader_book_id" "阅读图书标识"
"reader_chapter_id" "阅读图书章节标识"
"reader_book_file_name" "本地电子书文件名"
"reader_progress" "阅读进度,格式由阅读器定义"
"reader_tts_progress" "tts播放进度,格式由阅读器定义"
"reader_tts_progress" "tts播放进度,格式由阅读器定义"
"player_sp" "zhangyue|dianzhong|alibaba|yuewen|huawei"
"player_book_id" "播放听书标识"
"player_chapter_id" "播放听书章节标识"
"player_progress" "播放进度,单位:秒"
表1
可以理解的是,电子书籍JSON数据的具体格式,以及其中各个字段的含义可以根据实际情况确定,上表1所示的电子书籍JSON数据格式只是一种说明性的示例,本申请对此不作限定。
此外,需要说明的是,手机100-1安装的一些APP可以通过集成了开放接续流转引擎SDK(Software Development Kit,软件开发工具包),向接续服务118a注册接续服务的能力,以实现将手机100-1中注册过接续服务的APP的内容,接续至其他电子设备进行接续处理。
继续参考图4,适用于本申请提供的内容接续技术方案的电子阅读器100-5的应用层包括靠近发现114b、智慧大脑116b、接续服务118b、接续阅读120等应用。
电子阅读器100-5的接续服务118b:用于从其他电子设备接收接续数据,并且将接收到的接续数据发送给电子阅读器100-5的一些APP进行接续显示。例如,在一些实施例中,在阅读场景下,电子阅读器100-5的接续服务118b用于从其他电子设备接收接续数据,并且将接收的接续数据发送给电子阅读器100-5的接续阅读120,以对需要接续显示的电子书籍或网文进行分类管理,并且接续显示电子书籍或网文。在一些实施例中,电子阅读器100-5的接续服务118b用于从其他电子设备接收接续数据,并且将接收的接续数据发送给电子阅读器100-5的视频应用(未示出),从而接续播放视频。在一些实施例中,电子阅读器100-5的接续服务118b还用于将电子阅读器100-5的设备信息依次经由智慧大脑116b以及靠近发现114b发送给推荐并选择电子阅读器100-5作为接续设备的电子设备。
电子阅读器100-5的靠近发现114b:用于将电子阅读器100-5的设备信息发送给将电子阅读器100-5作为接续设备的电子设备,或者从其他电子设备接收由其他电子设备发送的设备信息。
电子阅读器100-5的智慧大脑116b:用于从电子阅读器100-5的接续服务118b获取电子阅读器100-5的设备信息,并通过电子阅读器100-5的靠近发现114b发送给推荐并选择电子阅读器100-5作为接续设备的电子设备。
电子阅读器100-5的接续阅读120:为能够实现跨设备的接续阅读功能的APP,用于根据从电子阅读器100-5的接续服务118b接收的接续数据,直接在电子阅读器100-5的显示界面上构造web网页或者html界面,接续显示电子书籍或网文。或者,将电子书籍或网文添加到接续阅读120的“稍后阅读”功能菜单中,以供用户在需要的时候,点击稍后阅读菜单,从中选择要阅读的电子书籍或网文,实现稍后阅读功能。
此外,电子阅读器100-5的接续阅读120还用于对接续阅读的电子书籍或网文进行分类管理,构建阅读书架以及网文书架。其中,阅读书架用于对电子书籍进行管理,例如,将当前正在接续的电子书籍以及历史接续过的电子书籍的封面、标题进行展示。网文书架用于对网文进行管理,例如,将当前正在接续的网文以及历史接续过的网文的标题进行展示。以供用户可以方便查看接续过的电子书籍或网文。例如,通过安卓 TM操作系统中RecyclerView控件在电子阅读器100-5的接续阅读120中实现网文书架以及阅读书架。
此外,电子阅读器100-5的接续阅读120还可以提供翻页滚动、目录展示、进度切换、调整字号和主题切换、文本选择和复制等功能。
此外,可以理解的是,接续阅读120仅仅是能够实现上述已描述的关于接续阅读、稍后阅读、书架管理等功能的APP的一种示例性名称,在其他一些实施例中,接续阅读120还可以被称为分布式书架,本申请对此不作限定。
SDK接口119a:用于手机100-1应用层APP与接续服务118a控制管理的框架层的应用编程接口(applicationprogramming interface,API)。可以包括获取手机100-1前台应用的标识(例如应用包名)、蓝牙及Wi-Fi P2P连接的API接口等。SDK接口119b:用于电子阅读器100-5应用层APP与接续服务118b控制管理的框架层的应用编程接口(application programming interface,API),与SDK接口119a类似,不再赘述。
框架层为应用层的应用程序提供和编程框架。应用程序框架层包括一些预先定义的函数。例如,手机100-1的框架层包括智能AI框架121a,极简协议通信服务122a、WiFi服务123a、NFC服务125a、蓝牙服务124a、软总线126a等。
其中,手机100-1的智能AI框架121a:用于为应用层的智慧识屏117以及智慧大脑116a提供计算服务,例如为智慧识屏117提供应用场景的识别服务;为智慧大脑116a提供基于预设规则进行决策,从而基于应用场景推荐合适的接续设备的服务。
极简协议通信服务122a:用于提供自定义的极简协议接口,来快速高效传输指令和数据,是接续(流转)服务的基本应用层协议和能力提供方。
WiFi服务123a:用于给WiFi131a提供组网连接Wi-Fi P2P的IP/群组/信道/SSID等WiFi配置信息。
NFC服务125a:用于给NFC133a提供组网连接标签等配置信息。
蓝牙服务124a:用于给蓝牙132a提供组网连接蓝牙MAC地址/会话(Session)ID等蓝牙配置信息。
软总线126a:用于实现近场设备间统一的分布式通信能力,提供不区分链路的设备发现和传输接口,可以快速发现并连接设备,高效分发任务和传输数据。
继续参考图4,电子阅读器100-5的框架层包括智能AI框架121b,极简协议通信服务122b、WiFi服务123b、NFC服务125b、蓝牙服务124b、软总线126b等。电子阅读器100-5框架层的各个模块与手机100-1框架层的各个模块类似,具体含义参见上述关于手机100-1框架层的各个模块的描述,在此不再赘述。
内核层是硬件和软件之间的层。例如,手机100-1的内核层包括WiFi131a、蓝牙132a、NFC133a。电子阅读器100-5的内核层包括WiFi131b、蓝牙132b、NFC133b。
其中,WiFi131a、WiFi131b:指WiFi芯片的驱动和WiFi固件,用于传输接续数据。
NFC133a、NFC133b:指NFC芯片的驱动和NFC固件,用于传输接续数据。
蓝牙132a、蓝牙132b:指蓝牙芯片的驱动和蓝牙固件,用于传输接续数据。
此外,在一些实施例中,手机100-1和电子阅读器100-5的框架层中还可以包括鉴权框架(未图示),用于基于云端和本地的配置数据,鉴权框架能够提供从云侧拉取特定应用权限表项,实现鉴定其是否拥有某个特定能力权限的功能。在一些实施例中,手机100-1和电子阅读器100-5的内核中还可以包括分布式文件系统(未图示),手机100-1和电子阅读器100-5还可以通过分布式文件系统互传数据。
下面以图1所示的内容阅读场景图中的手机100-1发现并筛选出接续设备为例,结合图3所示的手机100-1的硬件结构图,以及图4所示分层的软件架构图,对本申请的技术方案进行详细介绍。
首先以图5所示的流程图为例,介绍手机100-1发现电子设备、根据手机100-1当前显示的内容进行场景识别,从而根据识别出的场景推荐出适合接续的电子设备的具体过程,具体地,如图5所示,该过程包括以下步骤:
步骤501:手机100-1对当前的应用场景进行识别。
在一些实施例中,为了快速确定出当前的应用场景,手机100-1可以根据前台应用对当前的应用场景进行初步的识别。在手机100-1根据前台应用可以识别出确定的应用场景的情况下,进入步骤502;在手机100-1根据前台应用无法识别出确定的应用场景的情况下,根据当前显示的内容进行进一步的场景识别,在手机100-1根据当前显示的内容确定出当前的应用场景的情况下,进入步骤502。
示例性的,手机100-1检测到接续服务118a被打开后,通过应用层的接续服务应用118a来监听前台应用对应哪个APP,然后通过监听到的APP来进行应用场景的识别。其中,前台应用是指手机100-1当前显示界面对应的应用。
可以理解的是,在一些实施例中,当手机100-1的接续服务118a监听到前台应用之后,对于一些APP,应用场景是唯一确定的,例如阅读APP,用户只能通过阅读APP阅读电子书籍,无法通过阅读APP聊天、视频、看网文。在一些实施例中,手机100-1保存有阅读场景对应的APP的白名单,这些白名单中包含各种阅读APP的标识信息,例如,包含有微信阅读APP、掌上阅读APP等。当手机100-1通过监听得到当前的显示界面对应的APP在上述白名单中时,确定当前的应用场景为阅读场景。
而对于另一些APP,应用场景是无法确定的,例如对于微信APP,具有聊天会话界面、朋友圈展示界面、通过网络链接进入的网文界面等等多种视图,需要通过对手机100-1当前显示的内容进行解析,进一步确定手机100-1当前显示的界面是以上聊天会话界面、朋友圈展示界面、网文界面等其中的哪一个界面,从而得到唯一确定的应用场景。
例如,在一些实施例中,手机100-1应用层的智慧识屏117通过调用框架层的智能AI框架提取出当前显示界面的内容并进行解析,从而进一步根据当前显示的内容确定出唯一确定的应用场景。
例如,在一些实施例中,手机100-1的智慧识屏117通过对当前显示的内容进行截图,然后对截图进行处理,得到包含有该截图中所有元素的mht格式(一种文件格式)的文件,然后对该mht格式的文件进行解析,进一步确定出当前的应用场景。
此外,需要说明的是,在一些实施例中,如果一APP已经在接续服务118a中注册过接续服务,则该APP支持接续服务功能,当接续服务118a被开启时,如果手机100-1当前显示该APP的显示界面,则可以实现对该APP的显示界面的接续。例如,如果微信阅读APP已经在接续服务118a中注册过接续服务,则微信阅读APP支持接续服务功能,当接续服务118a被开启时,如果手机100-1当前显示微信阅读APP的显示界面,则可以实现对微信阅读APP的显示界面的接续。
步骤502:手机100-1在发现的设备中推荐出适合内容接续的电子设备。
即在手机100-1确定出当前的应用场景的情况下,可以结合确定出的应用场景推荐出适合内容接续的电子设备。
例如,在一些实施例中,当手机100-1确定出当前的应用场景为视频播放的情况下,可以在发现的设备中推荐出适合接续播放视频的电子设备。又如,在一些实施例中,当手机100-1确定出当前的应用场景为电子书籍阅读的情况下,可以在发现的设备中推荐出适合接续显示电子书籍的电子设备。从而通过在不同的应用场景下,个性化推荐出更加符合应用场景的电子设备,提高用户体验。
在一些实施例中,手机100-1的蓝牙被打开之后,显示出多个可连接设备的基本信息,例如,设备名称、设备型号、设备能力信息等,其中设备能力信息是用于表征该设备的运算能力、拾音能力、安全能力、显示能力、播放能力、拍照能力、存储能力等的信息,手机100-1在获取到可连接设备的设备能力信息之后,可以确定出连接的设备适合的应用场景。手机100-1通过智慧识屏117确定出当前的应用场景,并且手机100-1通过智慧大脑116a结合确定出的应用场景推荐出适合接续的电子设备。其中,智慧大脑116a可以根据预设设定的规则决策出推荐的电子设备。例如,预先设备的规则为:若当前的应用场景为阅读场景,则在发现的电子设备中推荐适合阅读的电子设备,例如有护眼功能的电子设备,作为接续电子设备;若当前的应用场景为游戏场景,则在发现的电子设备中推荐适合玩游戏的电子设备,例如,运算能力较高的电子设备,作为接续电子设备;若当前的应用场景为视频场景,则在发现的电子设备中推荐适合播放视频的电子设备,例如屏幕较大的电子设备,作为接续电子设备。
步骤503:手机100-1将接续数据发送给推荐的电子设备。以供该电子设备接续显示手机100-1当前显示的内容。
在一些实施例中,手机100-1的智慧大脑116a结合当前的应用场景推荐适合接续的电子设备之后,手机100-1的控制中心115显示出推荐的电子设备,供用户确认,在确定了要连接的电子设备之后,手机100-1的控制中心115经由智慧大脑116a、靠近发现114a向推荐的电子设备请求设备信息,在获取到推荐的电子设备的MAC地址、建立无线通信连接时使用的令牌(token)、预制共享密钥(pre-shared key,PSK)、设备序列号等设备信息之后,手机100-1的控制中心115拉起手机100-1的接续服务118a,然后将接续数据发送给推荐的电子设备,以供该电子设备接续显示手机100-1当前显示的内容。
在一些实施例中,手机100-1将当前显示的在线网文由推荐的电子设备进行接续展示,则手机100-1可以将当前显示的在线网文对应的URI、网文的标题、解析的来源、解析的时间、服务器来源、文章完整性校验标识等网文数据也封装成JSON数据(以下简称网文JSON数据)作为接续数据,发送给推荐接续的电子设备,以供推荐接续的电子设备根据接收的接续数据从服务器请求相应的网文内容,以供接续的电子设备进行接续显示。
在一些实施例中,手机100-1将当前显示的离线网文由推荐的电子设备进行接续展示,则手机100-1可以将当前显示的离线网文对应的URI、网文的标题、解析的来源、解析的时间、服务器来源、文章完整性校验标识等网文JSON数据,以及该网文对应的mht文件作为接续数据发送给推荐接续的电子设备,以供推荐接续的电子设备根据接收的接续数据,接续显示该离线网文。
例如,在一些实施例中,网文JSON数据可以被定义为包括如下表2所示的各个字段的格式。
Figure PCTCN2022120614-appb-000001
Figure PCTCN2022120614-appb-000002
表2
可以理解的是,网文JSON数据的具体格式,以及其中各个字段的含义可以根据实际情况确定,上表2所示的网文JSON数据格式只是一种说明性的示例,本申请对此不作限定。
在一些实施例中,手机100-1当前显示的内容是在线的电子书籍时,手机100-1还可以将当前显示的电子书籍的标识、章节结构、阅读进度等封装成电子书籍JSON数据,将电子书籍JSON数据作为接续数据发送给推荐接续的电子设备,以供推荐接续的电子设备根据接收到的JSON数据回调给接续电子设备的接续阅读120,由接续阅读120解析JSON数据后再向接续阅读120的服务器请求到接续的电子书籍,以供接续的电子设备进行接续显示。
在一些实施例中,手机100-1当前显示的内容是离线的电子书籍时,手机100-1需要将当前显示的电子书籍的标识,以及章节结构、阅读进度等封装成电子书籍JSON数据,以及下载到手机100-1本地的电子书籍文件,作为接续数据发送给推荐接续的电子设备,以供接续的电子设备将电子书籍文件导入接续阅读120的阅读书架中,并根据电子书籍JSON数据携带的阅读进度,接续显示手机100-1当前显示的电子书籍内容,或者将进度信息也添加在阅读书架上。
在一些实施例中,手机100-1当前显示的是一阅读APP书架上的已下载和未下载的电子书籍时,手机100-1可以将已下载的多个电子书籍文件以及对应的电子书籍JSON数据作为接续数据,发送给推荐接续的电子设备;或者将未下载的多个电子书籍对应的电子书籍JSON数据作为接续数据,发送给推荐接续的电子设备;又或者同时将已下载的多个电子书籍文件以及对应的电子书籍JSON数据,以及未下载的多个电子书籍对应的电子书籍JSON数据作为接续数据,发送给推荐接续的电子设备。
在一些实施例中,为了使接续的电子设备在接续阅读120的服务器中能够基于接续数据,获取相应的电子书籍或网文,手机100-1当前显示的阅读APP对应的服务器和接续的电子设备的接续阅读120的服务器需要能够互相访问,也即资源共享。
在一些实施例中,手机100-1除了向推荐接续的电子设备发送上述URI、JSON形式的数据、文件以外,还可以向推荐接续的电子设备发送当前应用界面中包含的图片、视频、音频或文字等。如此,接 续的电子设备在接续显示相应的界面时,无需再额外下载上述图片、视频、音频或文字等内容。
此外,上述接续数据还可以包括当前显示内容对应的APP的认证数据,例如账号,密码等数据,以供接续的电子设备具有相应的权限向前述当前显示内容对应的APP的服务器请求需要接续显示的内容。
在一些实施例中,手机100-1安装的用于打开需要接续显示的目标内容的第一应用的服务器,与接续的电子设备安装的用于接续显示前述目标内容的第二应用的服务器具有互相访问权限,使第二应用具有通过第二应用的服务器访问第一应用的服务器中的目标内容的权限。其中,目标内容可以为手机100-1当前显示的内容。
在一些实施例中,上述接续数据还可以包括应用包名,应用包名用于指示手机100-1自动推荐接续的电子设备采用该应用包名对应的应用打开并接续显示手机100-1当前显示的内容。例如,应用包名为手机100-1安装的用于打开当前显示内容的第一应用的包名,则接续的电子设备可以通过第一应用打开手机100-1当前显示的内容。又如,应用包名为与手机100-1安装的用于打开手机100-1当前显示的内容的第一应用的包名不同的第二应用的包名,则接续的电子设备可以通过第二应用打开目标内容。
此外,接续数据也可以不包括应用包名,在这种情况下,接续的电子设备可以通过与手机100-1安装的用于打开手机100-1当前显示的内容的第一应用相同的应用打开前述手机100-1当前显示的内容。
此外,可以理解的是,在一些场景中,手机100-1是需要被接续的电子设备,即需要将手机100-1当前显示的内容接续到其他电子设备上显示。在一些场景中,手机100-1还可以被其他电子设备选择连接的接续电子设备,即需要将其他电子设备当前显示的内容接续到手机100-1上显示。
此外,需要说明的是,在不同的应用场景下,手机100-1向推荐接续的电子设备发送的接续数据不同,手机100-1在发送这些接续数据时所采用的传输方式也不同。
例如,在一些实施例中,手机100-1将当前显示的在线内容由推荐的电子设备进行接续展示,例如,在线网文、电子书籍,由于手机100-1在线显示的内容为实时从服务器获取的内容,因此,手机100-1只需将针对当前在线显示的内容生成的网文JSON数据或者电子书籍JSON数据发送给推荐的接续设备。接续设备在接收网文JSON数据或者电子书籍JSON数据后,即可从相应的服务器获取对应的网文内容或电子书籍内容,并进行显示。在这种情况下,由于传输的数据量较小,因此,只需在手机100-1和接续设备之间建立蓝牙通道即可满足传输需求。
而在一些实施例中,手机100-1将当前显示的离线内容由推荐的电子设备进行接续展示,例如,离线网文、电子书籍,由于手机100-1在需要对离线显示的内容发送给其他电子设备接续显示时,还需要将相应的文件(例如下载到手机100-1本地的网文文件或电子书籍文件)也发送给对端。因此,在这种情况下,由于文件的数据量较大,并且为了实现快速接续,需要在手机100-1和接续设备之间建立数据传输量较大且较快的Wi-Fi P2P通道。
此外,在一些实施例中,手机100-1需要将在线和离线的文件均传输给接续设备进行管理和/或进行接续展示。例如,手机100-1需要将微信阅读APP书架上的离线电子书籍和在线电子书籍均发送给接续的电子设备进行跨设备的接续显示或管理,并且在用户需要阅读的时候展示给用户。则手机100-1需要同时和接续的电子建立蓝牙通道以及Wi-Fi P2P通道,通过蓝牙通道传输数据量较少的网文JSON数据或电子书籍JSON数据,通过Wi-Fi P2P通道传输离线的文件。
可以理解的是,为了实现对手机100-1当前显示内容的接续显示,作为接续设备的电子设备,在和需要被接续的手机100-1建立连接之前,接续设备和手机100-1需要开启接续服务功能,并且处于可被连接的状态,即蓝牙、Wi-Fi P2P等传输通道已开启。例如,在一些实施例中,要实现对手机100-1 当前播放的视频的接续,需要接续设备安装有视频播放器;又如,在一些实施例中,要实现对手机100-1当前显示的电子书籍或网文的接续,需要接续设备安装有接续阅读120。
下面以图6所示的流程图为例,介绍作为接续电子设备的电子阅读器100-5根据从手机100-1接收的接续数据进行接续内容显示的具体过程,具体地,如图6所示,该过程包括以下步骤:
步骤601:电子阅读器100-5接收由手机100-1发来的接续数据。
例如,在一些实施例中,电子阅读器100-5的接续服务118b通过蓝牙通道接收由手机100-1发来的网文JSON数据或电子书籍JSON数据。又如,在一些实施例中,电子阅读器100-5通过Wi-Fi P2P通道接收由手机100-1发来的网文JSON数据以及网文文件,或电子书籍JSON数据以及电子书籍文件。
步骤602:电子阅读器100-5基于接续数据识别出对应的应用场景。以供电子阅读器100-5根据识别出的不同应用场景,采用不同的APP接续显示手机100-1显示的内容。
例如,在一些实施例中,电子阅读器100-5的接续服务118b从手机100-1接收的接续数据中解析出网文的URI,则可以识别出相应的应用场景为网文阅读。又如,在一些实施例中,电子阅读器100-5的接续服务118b从手机100-1接收的接续数据中解析出电子书籍JSON数据,则可以识别出相应的应用场景为电子书籍阅读。
步骤603:电子阅读器100-5判断是否是阅读场景。如果是,则表明接续展示的内容是网文或电子书籍,即相应的应用场景为网文阅读或电子书籍阅读场景,进入步骤604;否则为其他应用场景,例如影音播放、游戏等应用场景,进入步骤605。
步骤604:电子阅读器100-5将接续数据通过接续阅读120进行接续显示。
即当电子阅读器100-5判断出需要接续的内容对应的应用场景为阅读场景的情况下,将接续数据通过接续阅读120进行接续显示。
例如,电子阅读器100-5的接续服务118b将接收的接续数据,写入接续阅读120,接续阅读120直接在电子阅读器100-5的显示界面上构造html界面,接续显示电子书籍或网文。或者,显示出电子书籍或网文的标题、内容概要以及阅读进度等,当用户需要阅读网文或电子书籍的具体内容时,点击相应的控件,接续阅读。又或者,接续阅读120对接续阅读的电子书籍或网文进行分类管理,构建阅读书架以及网文书架。以供用户可以方便查看接续过的电子书籍或网文。
步骤605:电子阅读器100-5将接续数据通过其他APP接续显示。
即当电子阅读器100-5判断出需要接续的内容对应的应用场景不为阅读场景的情况下,将接续数据通过其他APP进行接续显示。例如,电子阅读器100-5判断出需要接续的内容对应的应用场景为视频播放场景,则通过安装的视频播放器接续播放视频。又如,电子阅读器100-5判断出需要接续的内容对应的应用场景为游戏播放场景,则通过安装的游戏APP接续展示游戏界面。
以上对图5涉及的手机100-1发现电子设备、根据当前显示内容识别出应用场景、推荐出接续的电子设备、发送接续数据的过程,以及对以上图6涉及的作为接续设备的电子阅读器100-5接收接续数据并进行接续处理的过程进行了详细介绍。
下面分别以手机100-1将当前显示的微信网文和电子书籍,接续到电子阅读器100-5上进行显示为例,结合图4所示的分层架构图,详细介绍手机100-1和电子阅读器100-5的交互过程。
实施例一
首先介绍手机100-1将当前显示的微信网文接续到电子阅读器100-5上进行显示的详细过程。具体地,如图7所示,包括以下步骤:
步骤701:手机100-1的智慧识屏117提取当前显示的内容,识别出网文阅读场景。
需要说明的是,通过以上对图5中步骤501至步骤504的介绍可知,对于微信APP,具有聊天会话界面、朋友圈展示界面、通过网络链接进入的网文界面等等不同的视图,手机100-1通过步骤501涉及的通过接续服务应用118a调用框架层的极简协议通信服务122a来监听前台应用对应哪个APP,而对于具有多个视图的微信APP,有多种可能的应用场景,需要进行进一步的判断。例如通过手机100-1的智慧识屏117提取当前显示的内容,识别出网文阅读场景,具体请参阅上述关于图5中步骤504的相关描述,不再赘述。
例如,图8A示出了用户微信朋友圈的显示界面137,其中包括网络资源链接138,其中显示出微信网文1的标题,若手机100-1检测到关于网络资源链接138的点击操作后,打开微信网文1,进入如图8A所示的显示界面101。手机100-1的智慧识屏117将界面101的内容进行截屏并解析后,识别出界面101中显示的内容为网文,进而确定出手机100-1当前处于网文阅读场景。
步骤702:手机100-1的智慧识屏117向手机100-1的智慧大脑116a发送识别的场景信息。
步骤703:手机100-1的智慧大脑116a根据场景信息在发现的设备中推荐出适合网文阅读的接续设备。
例如,手机100-1通过蓝牙广播发现了电子阅读器100-5、音响、笔记本电脑,手机100-1的智慧大脑116a通过预设的规则决策出电子阅读器100-5更加适合作为接续阅读的电子设备。
步骤704:手机100-1的智慧大脑116a向手机100-1的控制中心115发送显示推荐设备的指令。以供手机100-1的控制中心115显示出推荐的设备。
步骤705:手机100-1的控制中心115显示出推荐的设备,以供用户确认是否将推荐的设备作为接续阅读的电子设备。
例如,手机100-1弹出如图8B所示的提示信息“发现电子阅读器,是否连接电子阅读器接续阅读”144,供用户确认。
步骤706:手机100-1的控制中心115确定出选择电子阅读器100-5作为接续网文阅读的设备。
当手机100-1的控制中心115检测到用户点击“是”控件145的操作后,确定出选择电子阅读器100-5作为接续网文阅读的设备。若手机100-1的控制中心115检测到用户点击“否”控件146的操作,则确定不选择电子阅读器100-5作为接续网文阅读的设备。
步骤707:手机100-1的控制中心115向电子阅读器100-5的接续服务118b请求设备信息。例如,请求电子阅读器100-5的MAC地址、建立无线通信连接时使用的token、预制共享密钥(pre-sharedkey,PSK)、设备序列号等设备信息,以建立无线通信连接,例如蓝牙、Wi-Fi P2P,从而根据建立的无线通信连接进行数据的交互。
步骤708:电子阅读器100-5的接续服务118b向手机100-1的控制中心115返回设备信息。
步骤709:手机100-1的控制中心115向手机100-1的接续服务118a发送接续指令。以拉起手机100-1的接续服务118a。
步骤710:手机100-1的接续服务118a响应于接续指令,向电子阅读器100-5的接续服务118b发送准备接续的通知消息,以拉起电子阅读器100-5的接续服务118b。
步骤711:电子阅读器100-5的接续服务118b向手机100-1的接续服务118a返回已开启接续功能的应答消息。
步骤712:手机100-1的接续服务118a向手机100-1的智慧识屏117请求接续数据。
步骤713:手机100-1的智慧识屏117向手机100-1的接续服务118a返回接续数据。
例如,手机100-1的智慧识屏117将如图8A所示的微信网文1对应的例如表2所定义的网文JSON 数据返回手机100-1的接续服务118a。
步骤714:手机100-1的接续服务118a向电子阅读器100-5的接续服务118b发送接续数据。
例如,手机100-1需要将在线显示的如图8A所示的微信网文1发送至推荐接续的电子阅读器100-5进行接续显示,则手机100-1的接续服务118a需要将如图8A所示的微信网文1的内容对应的网文JSON数据作为接续数据,通过蓝牙通道发送给电子阅读器100-5的接续服务118b。
又如,手机100-1需要将离线显示的微信网文2(未示出)发送至推荐接续的电子阅读器100-5进行接续显示,则手机100-1的接续服务118a需要向手机100-1的智慧识屏117请求微信网文2对应的网文JSON数据,并且向微信APP(未示出)请求的该离线网文对应的文件,然后将上述网文JSON数据以及文件作为接续数据,通过Wi-Fi P2P发送给电子阅读器100-5的接续服务118b,以供电子阅读器100-5基于网文JSON数据中的URI,向服务器请求微信网文2的内容。
在一些实施例中,为了确定出采用哪一种传输方式传输接续数据,手机100-1的接续服务118a在向电子阅读器100-5的接续服务118b发送接续数据时,可以通过从预先在手机100-1的智慧识屏117定义的接口获取的数据,来判断当前的应用场景为在线网文阅读阅读场景,还是离线网文阅读场景,从而进一步确定是通过蓝牙还是通过Wi-Fi P2P发送接续数据。
步骤715:电子阅读器100-5的接续服务118b向电子阅读器100-5的接续阅读120发送接续数据以及开启接续阅读服务的指令,以供电子阅读器100-5的接续阅读120开启接续阅读服务,接续显示网文内容。
步骤716:电子阅读器100-5的接续阅读120开启接续阅读服务,接续显示网文内容。
在一些实施例中,电子阅读器100-5在连接手机100-1之后,在电子阅读器100-5当前显示的如图8C所示的界面151中弹出对话框152,其中包括“已连接手机100-1,请选择你需要的服务”的文字提示,以及“立即阅读”控件153和“稍后阅读”控件154。
如果电子阅读器100-5的接续阅读120检测到用户关于“立即阅读”控件153的点击操作,则执行接续阅读操作,根据从手机100-1的接续服务118a接收的接续数据,开启接续阅读服务,并展示web网页界面,也即显示网文内容。
例如,在一些实施例中,电子阅读器100-5的接续阅读120检测到用户关于“立即阅读”控件153的点击操作之后,对从手机100-1的接续服务118a接收的接续数据进行解析,将接续数据中包括的对应于如图8A所示的界面101中微信网文1的URI,从服务器请求与该URI对应的界面内容,并构建微信网文1对应的web网页界面,显示出如图2D所示的电子阅读器100-5的界面102,其中界面102显示的内容与如图8A所示的手机100-1的界面101的内容相同,实现接续显示微信网文的功能。
如果电子阅读器100-5的接续阅读120检测到用户关于“稍后阅读”控件154的点击操作,则根据从手机100-1的接续服务118a接收的接续数据生成相应的缩略图或标题,添加到电子阅读器100-5接续阅读120的稍后阅读菜单中,供用户在需要查阅网文时,点击稍后阅读菜单,从中选择感兴趣的网文,即可进行网文内容的阅读,实现跨设备的稍后阅读功能。
例如,在一些实施例中,电子阅读器100-5的接续阅读120检测到用户关于“稍后阅读”控件154的点击操作之后,接续阅读120对从手机100-1的接续服务118a接收的接续数据进行解析,将接续数据中包括的对应于如图8A所示的界面101中微信网文1的URI(该处是以在线网文示例),从服务器请求与该URI对应的界面内容,然后根据请求的界面内容,提取出网文的标题等信息,添加到如图8D所示的稍后阅读156中。若用户点击微信网文1,电子阅读器100-5跳转到如图2D所示的微信网文1的内容显示界面102。
可以理解的是,对于离线网文,电子阅读器100-5的接续阅读120将接收到的接续数据中的网文文件解析成html文件,并且将解析出的html文件作为显示内容进行显示。
此外,电子阅读器100-5接续阅读120还可以将历史接续过的网文添加到网文书架上,以供用户在需要时点击并查看历史接续过的相应网文。例如,如图2F所示,电子阅读器100-5将历史接续过的微博网文1、今日头条网文1等添加到网文书架105中。
步骤717:电子阅读器100-5的接续阅读120通知电子阅读器100-5的接续服务118已完成接续。
步骤718:电子阅读器100-5的接续服务118和手机100-1的接续服务118a断开连接。
此外,在一些实施例中,为了节省功耗,在电子阅读器100-5的接续阅读120完成上述接续阅读或者“稍后阅读”之后,可以通过电子阅读器100-5的接续服务118b向手机100-1的接续服务118a发送通知,以断开电子阅读器100-5和手机100-1之间的通信连接。
实施例二
下面将介绍手机100-1将当前显示的电子书籍接续到电子阅读器100-5上进行显示的详细过程。具体地,如图9所示,包括以下步骤:
步骤901:手机100-1的阅读应用111向接续服务118a注册接续服务。
此外,在一些实施例中,为了实现手机的100-1接续服务118a对阅读应用111的监听,还需要阅读应用111向手机100-1的极简协议通信服务122a注册。
例如,在如图2E所示的实施例中,手机100-1当前正在显示微信阅读APP中书籍的界面103。在一些实施例中,手机100-1可以通过前述图5中步骤501涉及的通过接续服务应用118a来监听前台应用对应哪个APP,通常阅读APP只能用来阅读电子书籍,因此手机100-1通过监听前台应用确定出前台应用在预设的白名单中,即可确定当前的应用场景为电子书籍阅读场景。
在一些实施例中,手机100-1还可以通过智慧识屏117对界面103的内容进行截屏并解析后,识别出界面103中显示的内容为电子书籍,进而确定出手机100-1当前处于电子书籍阅读场景。
步骤902:手机100-1的接续服务118a向手机100-1的智慧大脑116a发送识别的场景信息。
步骤903:手机100-1的智慧大脑116a根据场景信息在发现的设备中推荐出适合电子书籍阅读的接续设备。
例如,手机100-1通过蓝牙广播发现了电子阅读器100-5、音响、笔记本电脑,手机100-1的智慧大脑116a通过预设的规则决策出电子阅读器100-5更加适合作为接续阅读的电子设备。
步骤904:手机100-1的智慧大脑116a向手机100-1的控制中心115发送显示推荐设备的指令。以供手机100-1的控制中心115显示出推荐的设备。
步骤905:手机100-1的控制中心115显示出推荐的设备,以供用户选择确认是否将推荐的设备作为接续阅读的电子设备。
例如,手机100-1弹出如图10A所示的提示信息“发现电子阅读器,是否连接电子阅读器接续阅读”162,供用户确认。
步骤906:手机100-1的控制中心115确定出选择电子阅读器100-5作为接续电子书籍阅读的设备。
当手机100-1的控制中心115检测到用户点击“是”控件164的操作后,确定出选择电子阅读器100-5作为接续电子书籍阅读的设备。若手机100-1的控制中心115检测到用户点击“否”控件163的操作,则确定不选择电子阅读器100-5作为接续电子书籍阅读的设备。
步骤907:手机100-1的控制中心115向电子阅读器100-5的接续服务118b请求设备信息。例如,请求电子阅读器100-5的MAC地址、建立无线通信连接时使用的token、预制共享密钥(pre-sharedkey, PSK)、设备序列号等设备信息,以建立无线通信连接,例如蓝牙、Wi-Fi P2P,从而根据建立的无线通信连接进行数据的交互。
步骤908:电子阅读器100-5的接续服务118b向手机100-1的控制中心115返回设备信息。
步骤909:手机100-1的控制中心115向手机100-1的接续服务118a发送接续指令。以拉起手机100-1的接续服务118a。
步骤910:手机100-1的接续服务118a响应于接续指令,向电子阅读器100-5的接续服务118b发送准备接续的通知消息,以拉起电子阅读器100-5的接续服务118b。
步骤911:电子阅读器100-5的接续服务118b向手机100-1的接续服务118a返回已开启接续功能的应答消息。
步骤912:手机100-1的接续服务118a向手机100-1的智慧识屏117请求接续数据。
在一些实施例中,手机100-1的接续服务118a还可以直接向手机100-1的阅读应用111直接请求当前显示的电子书籍JSON数据。
步骤913:手机100-1的智慧识屏117向手机100-1的接续服务118a返回接续数据。
例如,手机100-1的智慧识屏117将如图2E所示的微信电子书籍1对应的JSON数据返回手机100-1的接续服务118a。
又如,手机100-1的接续服务118a是直接向手机100-1的阅读应用111直接请求当前显示的电子书籍JSON数据,则由手机100-1的阅读应用111向手机100-1的接续服务118a返回电子书籍1对应的JSON数据。
步骤914:手机100-1的接续服务118a向电子阅读器100-5的接续服务118b发送接续数据。
例如,手机100-1需要将在线显示的如图2E所示的微信电子书籍1发送至推荐接续的电子阅读器100-5进行接续显示,则手机100-1的接续服务118a需要将如图2E所示的微信电子书籍1对应的JSON数据作为接续数据,通过蓝牙通道发送给电子阅读器100-5的接续服务118b。
又如,手机100-1需要将离线显示的微信电子书籍2(未示出)发送至推荐接续的电子阅读器100-5进行接续显示,则手机100-1的接续服务118a需要向手机100-1的智慧识屏117请求微信电子书籍2对应的JSON数据,并且向微信APP(未示出)请求的该离线电子书籍对应的文件,或者手机100-1的接续服务118a直接向手机100-1的微信APP请求微信电子书籍2对应的JSON数据以及文件,然后将电子书籍2对应的JSON数据以及文件作为接续数据,通过Wi-Fi P2P发送给电子阅读器100-5的接续服务118b。
在一些实施例中,为了使手机100-1的接续服务118a在发送接续数据之前,确定出通过哪种无线通信方式来传输接续数据,可以查询上述电子书籍JSON数据中包含的用于表征当前的应用场景的标识字段,例如“file_path”字段,来判断出相应的应用场景。如果手机100-1的接续服务118a在发送接续数据之前,确定电子书籍JSON数据中不包含“file_path”字段,则确定当前的应用场景为在线阅读电子书跨设备流转,则通过蓝牙通道发送接续数据即可。如果手机100-1的接续服务118a在发送接续数据之前,确定电子书籍JSON数据中包含“file_path”字段,且该字段的长度为1,则确定当前的应用场景为离线阅读电子书跨设备流转,则通过Wi-Fi P2P发送接续数据。如果手机100-1的接续服务118a在发送接续数据之前,确定电子书籍JSON数据中包含“file_path”字段,且该字段的长度大于1,则确定当前的应用场景为在线和离线混合书架跨设备流转,则即需要通过蓝牙发送在线电子书籍JSON数据,又需要通过Wi-Fi P2P发送离线电子书籍的文件数据。
步骤915:电子阅读器100-5的接续服务118b向电子阅读器100-5的接续阅读120发送接续数据 以及开启接续阅读服务的指令,以供电子阅读器100-5的接续阅读120开启接续阅读服务,接续显示电子书籍内容。
步骤916:电子阅读器100-5的接续阅读120开启接续阅读服务,接续显示电子书籍内容。
在一些实施例中,电子阅读器100-5的接续阅读120根据从接续数据中解析出的JSON数据中的电子书籍的名称等标识,向接续阅读120服务器请求相应的在线电子书籍,将在线电子书籍作为显示内容进行显示。
在一些实施例中,电子阅读器100-5的接续阅读120根据从接续数据中解析出的JSON数据中的电子书籍的名称等标识以及电子书籍文件,直接调用本地导入和本地电子书进度同步的接口,从解析出的JSON数据中获取阅读进度,然后显示相应进度下的离线电子书籍内容。
在一些实施例中,电子阅读器100-5在连接手机100-1之后,在电子阅读器100-5当前显示的如图8C所示的界面151中弹出对话框152,其中包括“已连接手机,请选择你需要的服务”的文字提示,以及“立即阅读”控件153和“稍后阅读”控件154。
如果电子阅读器100-5检测到用户关于“立即阅读”控件153的点击操作,则执行立即阅读操作,根据从手机100-1的接续服务118a接收的接续数据,直接从接续阅读120中拉起阅读器模块(接续阅读120中用以实现阅读器功能的模块),并通过解析出的电子书籍数据展示当前接续同步的电子书籍页面。
例如,在一些实施例中,电子阅读器100-5检测到用户关于“立即阅读”控件153的点击操作之后,对从手机100-1的接续服务118a接收的接续数据进行解析,将接续数据中包括的对应于如图2E所示的界面103中微信电子书籍1的JSON数据,电子阅读器100-5的接续阅读120中的阅读器模块根据微信电子书籍1的JSON数据,向接续阅读120的服务器请求对应的电子书籍内容,并将对应的书籍页面作为显示内容进行显示。并且构建微信电子书籍1对应的电子书籍显示界面,显示出如图2E所示的电子阅读器100-5的界面104,其中界面104显示的内容与如图2E所示的手机100-1的界面103的内容相同,实现接续显示微信电子书籍1的功能。
如果电子阅读器100-5检测到用户关于“稍后阅读”控件154的点击操作,则根据从手机100-1的接续服务118a接收的接续数据生成相应的缩略图或标题,添加到电子阅读器100-5接续阅读120的稍后阅读中,供用户在需要查阅电子书籍时,点击如图8D所示的稍后阅读156,从中选择感兴趣的电子书籍,即可进行电子书籍内容的阅读,实现跨设备的稍后阅读功能。
此外,可以理解的是,由于上述电子书籍JSON数据中包括阅读进度信息,因此,电子阅读器100-5的接续阅读120可以依据该进度信息实现阅读进度的同步,当用户点击稍后阅读156中的电子书籍1之后,如图2E所示的电子阅读器100-5的界面104中显示的内容与如图2E中手机100-1的界面103显示的内容一致,即实现了阅读进度的同步。
此外,电子阅读器100-5接续阅读120还可以将历史接续过的电子书籍添加到如图2G所示的阅读书架106中,以供用户在需要时点击查看历史接续过的相应电子书籍。
例如,在一些实施例中,电子阅读器100-5检测到用户关于如图8C所示的“立即阅读”控件153的点击操作之后,通过电子阅读器100-5的接续阅读120对从手机100-1的接续服务118a接收的接续数据进行解析,将接续数据中包括的对应于如图2E所示的界面103中微信电子书籍1的JSON数据,从接续阅读服务器请求与该JSON数据对应的界面内容,并且提取出电子书籍的标题、阅读进度等信息,生成如图2G所示的阅读书架106中的电子书籍1。若用户点击电子书籍1,电子阅读器100-5跳转到如图2E所示的微信电子书籍1的内容显示界面104。
此外,在一些实施例中,为了避免将同一电子书籍多次重复添加至阅读书架上,电子阅读器100-5可以在将一电子书籍添加阅读至书架之前,进行去重判断,例如对接收到的接续数据进行解析,根据解析得到的电子书籍文件名以及文件大小,判断针对该电子书籍是否已经在阅读书架中,如果是,则不再重复添加;否则将该电子书籍添加到阅读书架中。
步骤917:电子阅读器100-5的接续阅读120通知电子阅读器100-5的接续服务118已完成接续。
步骤918:电子阅读器100-5的接续服务118和手机100-1的接续服务118a断开连接。
此外,在一些实施例中,为了节省功耗,在电子阅读器100-5的接续阅读120完成上述接续阅读或者稍后阅读之后,可以通过电子阅读器100-5的接续服务118b向手机100-1的接续服务118a发送通知,以断开电子阅读器100-5和手机100-1之间的通信连接。
以上分别以实施例一涉及的将手机100-1当前显示的微信网文,接续到自动推荐的电子阅读器100-5上进行接续显示,以及实施例二涉及的将手机100-1当前显示的电子书籍,接续到自动推荐的电子阅读器100-5上进行接续显示为例,对申请提供的分布式显示方案进行了详细介绍。
此外,对于电子书籍阅读场景,本申请提供的分布式显示方案还可以将手机100-1当前运行的阅读APP书架上的多本离线或在线的电子书籍,批量发送给电子阅读器100-5,电子阅读器100-5将批量接收的多本离线或在线的电子书籍在接续阅读120的阅读书架或网文书架上进行接续管理、显示。也即,电子阅读器100-5也可以作为手机100-1的角色,进行反向接续。
此外,为了方便用户操作,还可以在电子阅读器100-5的接续阅读120中生成针对稍后阅读功能的“稍后阅读卡片”。其中,“稍后阅读卡片”为一种嵌入到接续阅读120中的服务卡片,是元服务(Feature Ability,FA)(这里是指接续阅读120提供的稍后阅读服务)的一种界面显示形式,将稍后阅读服务的重要信息或操作前置到卡片,以实现服务直达。例如,在如图10B所示的实施例中,用户长按电子阅读器100-5桌面的接续阅读的图标165,弹出的下拉菜单中包括服务卡片控件166以及卸载控件167,当用户点击服务卡片控件166之后,弹出如图10C所示的稍后阅读卡片168,用户可以随意拖动稍后阅读卡片168至电子阅读器100-5桌面的任意位置。若用户点击稍后阅读卡片168,则进入如图10D所示的界面169,用户界面169中的任意网文或电子书籍,即可实现稍后阅读功能。
实施例三
下面将以图11所示的流程图为例,示例性地介绍手机100-1将阅读应用111书架上的多本离线或在线的电子书籍,批量发送给电子阅读器100-5,电子阅读器100-5在接续阅读120的阅读书架上进行接续管理、显示的过程,以下简称混合书架跨设备流转过程。图11所示的流程图和上述实施例二涉及的图9所示的流程图相比,区别仅在于图11所示的步骤912'、步骤913'、步骤914'分别于图9所示的步骤912、步骤913、步骤914、步骤916不同,其他各个步骤均与图9所示的流程图中相应的步骤相同,因此,以下仅对图11所示的步骤912'、步骤913'、步骤914'、步骤916'进行详细介绍。具体地,
步骤912':手机100-1的接续服务118a向手机100-1的阅读应用111请求接续数据。
例如,假设手机100-1从发现的电子设备中推荐出电子阅读器100-5作为适合接续阅读的电子设备,并且手机100-1响应于用户关于选择连接电子阅读器100-5作为接续设备的操作之后,和电子阅读器100-5进行无线通信连接。
而后,手机100-1需要将微信阅读APP书架上的多个电子书籍发送至电子阅读器100-5进行接续管理或显示。则用户可以在手机100-1的微信阅读APP书架上选择多个离线和/或在线的电子书籍,然后批量发送至电子阅读器100-5进行接续管理或显示。手机100-1的接续服务118a向手机100-1的阅读 应用111用户选择接续的多个离线和/或在线的电子书籍的数据。
步骤913':手机100-1的阅读应用111向手机100-1的接续服务118a返回接续数据。
步骤914':手机100-1的接续服务118a向电子阅读器100-5的接续服务118b发送接续数据。
例如在图12所示的实施例中,显示出手机100-1微信阅读APP的书架显示界面171,如图12所示,手机100-1微信阅读APP书架包括电子书籍1至电子书籍4,其中电子书籍1为已下载到手机100-1本地的离线的电子书籍,电子书籍2至4为在线的电子书籍。当手机100-1的微信阅读APP响应于用户选择电子书籍1至电子书籍3并点击批量接续173控件的操作之后,手机100-1的接续服务118a向电子阅读器100-5的接续服务118b发送用户选择的电子书籍1至电子书籍3对应的接续数据。
对于在线的电子书籍2和电子书籍3,则手机100-1的接续服务118a通过蓝牙发送电子书籍2和电子书籍3对应的电子书籍JSON数据;对于离线的电子书籍1,则手机100-1的接续服务118a将电子书籍1对应的文件,通过Wi-Fi P2P发送给电子阅读器100-5的接续服务118b。
在一些实施例中,手机100-1的接续服务118a向电子阅读器100-5的接续服务118b通过蓝牙发送的数据具有例如下表3所示的格式:
字段名称 含义
String packageName 应用包名
String appName 应用名称
String paraData 接续数据
int contibuityType 接续类型
String pageUri 网页信息
int continuityState 接续状态
表3
需要说明的是,在该实例三中的混合书架跨设备流转过程中,对于接续数据字段:String paraData,其中可以填充例如上表1所示的电子书籍的JSON数据,然后将该JSON数据转换为字符串(String)。在另一些实施例中,如果需要将手机100-1的某APP的书架中的多个离线或在线网文批量发送至电子阅读器100-5进行接续管理,则对于接续数据字段:String paraData,其中可以填充例如上表2所示的网文的JSON数据,然后将该JSON数据转换为字符串(String)。
可以理解的是,上表3只是手机100-1的接续服务118a向电子阅读器100-5的接续服务118b通过蓝牙发送的数据格式的一种说明性的示例,在具体实现时,手机100-1的接续服务118a向电子阅读器100-5的接续服务118b通过蓝牙发送的数据的具体格式,以及其中各个字段的含义可以根据实际情况确定本申请对此不作限定。
步骤916':电子阅读器100-5的接续阅读120根据接收的数据开启接续阅读服务。
例如,电子阅读器100-5的接续阅读120的阅读模块将接收的上述电子书籍1的JSON数据进行处理,向接续阅读120的服务器请求电子书籍1下载和查看信息,并展示到如图12所示的阅读书架上。并且,电子阅读器100-5的接续阅读120直接调用本地导入和本地电子书进度同步的接口,将接收的上述电子书籍2和电子书籍3的文件导入阅读书架,展示到如图12所示的阅读书架上。如此,实现跨设备的书架管理,提升用户体验。
步骤917:电子阅读器100-5的接续阅读120通知电子阅读器100-5的接续服务118已完成接续。
步骤918:电子阅读器100-5的接续服务118和手机100-1的接续服务118a断开连接。
此外,在一些实施例中,为了节省功耗,在电子阅读器100-5的接续阅读120完成上述混合书架跨设备流转之后,可以通过电子阅读器100-5的接续服务118b向手机100-1的接续服务118a发送通知,以断开电子阅读器100-5和手机100-1之间的通信连接。
本申请提供的分布式显示方案通过对电子设备当前的应用场景进行识别,从而根据识别出的应用场景,自动在设备网中发现的其他电子设备中筛选出更加适合作为接续显示的电子设备,而非被动地在用户的操作下只能将用户预先选定的设备作为接续设备,可以提高用户的使用体验。此外,进一步地,本申请提供的分布式显示方案在阅读场景下,即在电子设备当前显示的内容为电子书籍、网文或阅读APP的书架的情况下,作为接续设备的电子设备还能够对其他电子设备发来的电子书籍或网文进行分类管理,对应电子书籍生成相应的阅读书架,对应网文生成相应的网文书架,从而为用户提供较好的接续阅读服务,进一步提升用户在阅读场景下的阅读体验。
图13根据本申请的一些实施例,示出了一种源显示装置200的结构框图。如图13,源显示装置200包括第一确定单元201、第二确定单元202以及发送单元203。其中,第一确定单元201用于确定源显示装置200中要通过其他显示装置进行接续显示的目标内容;第二确定单元202用于基于目标内容,从多个显示装置中确定出适合接续显示目标内容的目标显示装置;发送单元203,用于向目标显示装置发送用于在目标显示装置上接续显示目标内容所需的接续数据。
在一些实施例中,目标内容为源显示装置当前显示的内容。
在一些实施例中,第二确定单元通过以下方式从多个显示装置中确定出适合接续显示目标内容的目标显示装置:
第二确定单元基于目标内容,确定出与目标内容对应的应用场景;
第二确定单元根据应用场景,从多个显示装置中确定出适合接续显示目标内容的目标显示装置。
在一些实施例中,第二确定单元通过以下方式从多个显示装置中确定出适合接续显示目标内容的目标显示装置:
第二确定单元基于目标内容,确定出与目标内容对应的应用场景为阅读场景;
第二确定单元根据阅读场景,从多个显示装置中确定出适合接续显示阅读场景中的目标内容的目标显示装置。
在一些实施例中,第二确定单元通过以下方式确定出与目标内容对应的应用场景:
第二确定单元基于目标内容,确定出源显示装置安装的用于显示目标内容的第一应用;
第二确定单元根据第一应用,确定出与目标内容对应的应用场景。
在一些实施例中,发送单元通过以下方式向目标显示装置发送用于在目标显示装置上接续显示目标内容所需的接续数据:
在目标内容为在线内容的情况下,发送单元通过蓝牙向目标显示装置发送用于在目标显示装置上接续显示目标内容所需的接续数据;或
在目标内容为离线内容的情况下,发送单元通过点到点无线保真(Wireless-Fidelity point-to-point,Wi-Fi P2P)向目标显示装置发送用于在目标显示装置上接续显示在线内容所需的接续数据。
此外,在一些实施例中,在目标内容为在线网文的情况下,接续数据为在线网文接续数据,在线网文接续数据包括在线网文的统一资源标识符(Uniform Resource Identifier,URI);或
在目标内容为离线网文的情况下,接续数据为离线网文接续数据,离线网文接续数据包括离线网文的文件;或
在目标内容为在线电子书籍的情况下,接续数据为在线电子书籍接续数据,在线电子书籍接续数 据包括在线电子书籍的标识以及阅读进度;或
在目标内容为离线电子书籍的情况下,接续数据为离线电子书籍接续数据,离线电子书籍接续数据包括离线电子书籍的文件以及阅读进度。
在一些实施例中,在线网文接续数据还包括在线网文的标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在一些实施例中,离线网文接续数据还包括离线网文的URI、标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在一些实施例中,在线电子书籍接续数据还包括:在线电子书籍的章节结构。
在一些实施例中,离线电子书籍接续数据还包括:在线电子书籍的标识以及章节结构中的至少一种。
在一些实施例中,接续数据包括应用包名,应用包名用于指示目标显示装置通过应用包名对应的应用打开目标内容。
在一些实施例中,接续数据还包括源显示装置安装的用于显示目标内容的第一应用的身份认证信息,身份认证信息用于使目标显示装置具有从第一应用的服务器获取目标内容的权限。
在一些实施例中,源显示装置安装的用于显示目标内容的第一应用的服务器,与目标显示装置安装的用于接续显示目标内容的第二应用的服务器具有互相访问权限,使第二应用的服务器具有访问第一应用的服务器中的目标内容的权限,其中,源显示装置的第一应用从第一应用的服务器获取目标内容。
图14根据本申请的一些实施例,示出了一种目标显示装置300的结构框图。如图14所示,目标显示装置300包括接收单元301、显示单元302、第一添加单元303、第二添加单元304。其中,接收单元301用于接收源显示装置发送的用于在目标显示装置上接续显示目标内容所需的接续数据,其中,目标内容为源显示装置的第一确定单元确定出的源显示装置中要通过其他显示装置进行接续显示的内容;显示单元302,用于根据从源显示装置的发送单元接收的接续数据接续显示目标内容。第一添加单元303,用于根据从源显示装置的发送单元接收的接续数据,将目标内容添加至第二应用的书架中;第二添加单元304,用于根据从源显示装置的发送单元接收的接续数据,在目标显示装置安装的第二应用的稍后阅读卡片中添加目标内容。
在一些实施例中,在目标内容为在线网文的情况下,接续数据为在线网文接续数据,在线网文接续数据包括在线网文的统一资源标识符(Uniform Resource Identifier,URI)。
在一些实施例中,在目标内容为离线网文的情况下,接续数据为离线网文接续数据,离线网文接续数据包括离线网文的文件。
在一些实施例中,在目标内容为在线电子书籍的情况下,接续数据为在线电子书籍接续数据,在线电子书籍接续数据包括在线电子书籍的标识以及阅读进度。
在一些实施例中,在目标内容为离线电子书籍的情况下,接续数据为离线电子书籍接续数据,离线电子书籍接续数据包括离线电子书籍的文件以及阅读进度。
在一些实施例中,显示单元通过以下方式接续显示目标内容:
在目标内容为在线网文的情况下,显示单元根据从源显示装置接收的URI,接续显示在线网文;或
在目标内容为离线网文的情况下,显示单元根据从源显示装置的发送单元接收的离线网文的文件,接续显示离线网文;或
在目标内容为在线电子书籍的情况下,显示单元根据从源显示装置的发送单元接收的在线电子书 籍的标识,接续显示在线电子书籍;或
在目标内容为离线电子书籍的情况下,显示单元根据从源显示装置的发送单元接收的在线电子书籍的文件,接续显示离线电子书籍。
在一些实施例中,在线网文接续数据还包括在线网文的标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在一些实施例中,离线网文接续数据还包括离线网文的URI、标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
在一些实施例中,在线电子书籍接续数据还包括:在线电子书籍的章节结构。
在一些实施例中,离线电子书籍接续数据还包括:在线电子书籍的标识以及章节结构中的至少一种。
在一些实施例中,接续数据包括应用包名,应用包名用于指示目标显示装置通过应用包名对应的应用打开目标内容。
在一些实施例中,接续数据还包括源显示装置安装的用于显示目标内容的第一应用的身份认证信息,身份认证信息用于使目标显示装置具有从第一应用的服务器获取目标内容的权限。
在一些实施例中,源显示装置安装的用于显示目标内容的第一应用的服务器,与目标显示装置安装的用于接续显示目标内容的第二应用的服务器具有互相访问权限,使第二应用的服务器具有访问第一应用的服务器中的目标内容的权限,其中,源显示装置的第一应用从第一应用的服务器获取目标内容。
本申请公开的机制的各实施例可以被实现在硬件、软件、固件或这些实现方法的组合中。本申请的实施例可实现为在可编程系统上执行的计算机程序或程序代码,该可编程系统包括至少一个处理器、存储系统(包括易失性和非易失性存储器和/或存储元件)、至少一个输入设备以及至少一个输出设备。
可将程序代码应用于输入指令,以执行本申请描述的各功能并生成输出信息。可以按已知方式将输出信息应用于一个或多个输出设备。为了本申请的目的,处理系统包括具有诸如例如数字信号处理器(Digital Signal Processor,DSP)、微控制器、专用集成电路(Application Specific Integrated Circuit,ASIC)或微处理器之类的处理器的任何系统。
程序代码可以用高级程序化语言或面向对象的编程语言来实现,以便与处理系统通信。在需要时,也可用汇编语言或机器语言来实现程序代码。事实上,本申请中描述的机制不限于任何特定编程语言的范围。在任一情形下,该语言可以是编译语言或解释语言。
在一些情况下,所公开的实施例可以以硬件、固件、软件或其任何组合来实现。所公开的实施例还可以被实现为由一个或多个暂时或非暂时性机器可读(例如,计算机可读)存储介质承载或存储在其上的指令,其可以由一个或多个处理器读取和执行。例如,指令可以通过网络或通过其他计算机可读介质分发。因此,机器可读介质可以包括用于以机器(例如,计算机)可读的形式存储或传输信息的任何机制,包括但不限于,软盘、光盘、光碟、只读存储器(CD-ROMs)、磁光盘、只读存储器(Read Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、可擦除可编程只读存储器(Erasable Programmable Read Only Memory,EPROM)、电可擦除可编程只读存储器(Electrically Erasable Programmable Read-Only Memory,EEPROM)、磁卡或光卡、闪存、或用于利用因特网以电、光、声或其他形式的传播信号来传输信息(例如,载波、红外信号数字信号等)的有形的机器可读存储器。因此,机器可读介质包括适合于以机器(例如计算机)可读的形式存储或传输电子指令或信息的任何类型的机器可读介质。
在附图中,可以以特定布置和/或顺序示出一些结构或方法特征。然而,应该理解,可能不需要这 样的特定布置和/或排序。而是,在一些实施例中,这些特征可以以不同于说明性附图中所示的方式和/或顺序来布置。另外,在特定图中包括结构或方法特征并不意味着暗示在所有实施例中都需要这样的特征,并且在一些实施例中,可以不包括这些特征或者可以与其他特征组合。
需要说明的是,本申请各设备实施例中提到的各单元/模块都是逻辑单元/模块,在物理上,一个逻辑单元/模块可以是一个物理单元/模块,也可以是一个物理单元/模块的一部分,还可以以多个物理单元/模块的组合实现,这些逻辑单元/模块本身的物理实现方式并不是最重要的,这些逻辑单元/模块所实现的功能的组合才是解决本申请所提出的技术问题的关键。此外,为了突出本申请的创新部分,本申请上述各设备实施例并没有将与解决本申请所提出的技术问题关系不太密切的单元/模块引入,这并不表明上述设备实施例并不存在其它的单元/模块。
需要说明的是,在本专利的示例和说明书中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个”限定的要素,并不排除在包括要素的过程、方法、物品或者设备中还存在另外的相同要素。
虽然通过参照本申请的某些优选实施例,已经对本申请进行了图示和描述,但本领域的普通技术人员应该明白,可以在形式上和细节上对其作各种改变,而不偏离本申请的精神和范围。

Claims (40)

  1. 一种用于分布式显示的屏幕识别方法,其特征在于,包括:
    第一电子设备确定所述第一电子设备中要通过其他电子设备进行接续显示的目标内容;
    所述第一电子设备基于所述目标内容,从多个电子设备中确定出适合接续显示所述目标内容的第二电子设备;
    所述第一电子设备向所述第二电子设备发送用于在所述第二电子设备上接续显示所述目标内容所需的接续数据;
    所述第二电子设备根据从所述第一电子设备接收的所述接续数据接续显示所述目标内容。
  2. 根据权利要求1所述的方法,其特征在于,所述目标内容为所述第一电子设备当前显示的内容。
  3. 根据权利要求1或2所述的方法,其特征在于,所述第一电子设备基于所述目标内容,从多个电子设备中确定出适合接续显示所述目标内容的第二电子设备,包括:
    所述第一电子设备基于所述目标内容,确定出与所述目标内容对应的应用场景;
    所述第一电子设备根据所述应用场景,从多个电子设备中确定出适合接续显示所述目标内容的第二电子设备。
  4. 根据权利要求3所述的方法,其特征在于,所述第一电子设备基于所述目标内容,从多个电子设备中确定出适合接续显示所述目标内容的第二电子设备,包括:
    所述第一电子设备基于所述目标内容,确定出与所述目标内容对应的应用场景为阅读场景;
    所述第一电子设备根据所述阅读场景,从多个电子设备中确定出适合接续显示所述阅读场景中的所述目标内容的第二电子设备。
  5. 根据权利要求3或4所述的方法,其特征在于,所述第一电子设备基于所述目标内容,确定出与所述目标内容对应的应用场景,包括:
    所述第一电子设备基于所述目标内容,确定出所述第一电子设备安装的用于显示所述目标内容的第一应用;
    所述第一电子设备根据所述第一应用,确定出与所述目标内容对应的应用场景。
  6. 根据权利要求3所述的方法,其特征在于,所述第一电子设备向所述第二电子设备发送用于在所述第二电子设备上接续显示所述目标内容所需的接续数据,包括:
    在所述目标内容为在线内容的情况下,所述第一电子设备通过蓝牙向所述第二电子设备发送用于在所述第二电子设备上接续显示所述目标内容所需的接续数据;或
    在所述目标内容为离线内容的情况下,所述第一电子设备通过点到点无线保真(Wireless-Fidelity point-to-point,Wi-Fi P2P)向所述第二电子设备发送用于在所述第二电子设备上接续显示所述在线内容所需的接续数据。
  7. 根据权利要求1至6任一项所述的方法,其特征在于,在所述目标内容为在线网文的情况下,所述接续数据为在线网文接续数据,所述在线网文接续数据包括所述在线网文的统一资源标识符(Uniform Resource Identifier,URI);或
    在所述目标内容为离线网文的情况下,所述接续数据为离线网文接续数据,所述离线网文接续数据包括所述离线网文的文件;或
    在所述目标内容为在线电子书籍的情况下,所述接续数据为在线电子书籍接续数据,所述在线电子书籍接续数据包括所述在线电子书籍的标识以及阅读进度;或
    在所述目标内容为离线电子书籍的情况下,所述接续数据为离线电子书籍接续数据,所述离线电子书籍接续数据包括所述离线电子书籍的文件以及阅读进度。
  8. 根据权利要求7所述的方法,其特征在于,所述第二电子设备根据从所述第一电子设备接收的所述接续数据接续显示所述目标内容,包括:
    在所述目标内容为在线网文的情况下,所述第二电子设备根据从所述第一电子设备接收的所述URI,接续显示所述在线网文;或
    在所述目标内容为离线网文的情况下,所述第二电子设备根据从所述第一电子设备接收的所述离线网文的文件,接续显示所述离线网文;或
    在所述目标内容为在线电子书籍的情况下,所述第二电子设备根据从所述第一电子设备接收的所述在线电子书籍的标识,接续显示所述在线电子书籍;或
    在所述目标内容为离线电子书籍的情况下,所述第二电子设备根据从所述第一电子设备接收的所述在线电子书籍的文件,接续显示所述离线电子书籍。
  9. 根据权利要求7或8所述的方法,其特征在于,所述在线网文接续数据还包括所述在线网文的标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
  10. 根据权利要求7或8所述的方法,其特征在于,所述离线网文接续数据还包括所述离线网文的URI、标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
  11. 根据权利要求7或8所述的方法,其特征在于,所述在线电子书籍接续数据还包括:所述在线电子书籍的章节结构。
  12. 根据权利要求7或8所述的方法,其特征在于,所述离线电子书籍接续数据还包括:所述在线电子书籍的标识以及章节结构中的至少一种。
  13. 根据权利要求1至12中任一项所述的方法,其特征在于,所述第二电子设备安装有用于显示所述目标内容的第二应用,所述方法还包括:
    所述第二电子设备根据从所述第一电子设备接收的所述接续数据,将所述目标内容添加至所述第二应用的书架中。
  14. 根据权利要求13所述的方法,其特征在于,还包括:
    所述第二电子设备根据从所述第一电子设备接收的所述接续数据,在所述第二电子设备安装的所述第二应用的稍后阅读卡片中添加所述目标内容。
  15. 根据权利要求1至14中任一项所述的方法,其特征在于,所述接续数据包括应用包名,所述应用包名用于指示所述第二电子设备通过所述应用包名对应的应用打开所述目标内容。
  16. 根据权利要求15所述的方法,其特征在于,所述接续数据还包括所述第一电子设备安装的用于显示所述目标内容的第一应用的身份认证信息,所述身份认证信息用于使所述第二电子设备具有从所述第一应用的服务器获取所述目标内容的权限。
  17. 根据权利要求15或16所述的方法,其特征在于,所述第一电子设备安装的用于显示所述目标内容的第一应用的服务器,与所述第二电子设备安装的用于接续显示所述目标内容的第二应用的服务器具有互相访问权限,使所述第二应用的服务器具有访问所述第一应用的服务器中的所述目标内容的权限,其中,所述第一电子设备的所述第一应用从所述第一应用的服务器获取所述目标内容。
  18. 一种用于分布式显示的屏幕识别方法,其特征在于,包括:
    第一电子设备确定所述第一电子设备中要通过其他电子设备进行接续显示的目标内容;
    所述第一电子设备基于所述目标内容,从多个电子设备中确定出适合接续显示所述目标内容的第 二电子设备;
    所述第一电子设备向所述第二电子设备发送用于在所述第二电子设备上接续显示所述目标内容所需的接续数据。
  19. 根据权利要求18所述的方法,其特征在于,所述目标内容为所述第一电子设备当前显示的内容。
  20. 根据权利要求18或19所述的方法,其特征在于,所述第一电子设备基于所述目标内容,从多个电子设备中确定出适合接续显示所述目标内容的第二电子设备,包括:
    所述第一电子设备基于所述目标内容,确定出与所述目标内容对应的应用场景;
    所述第一电子设备根据所述应用场景,从多个电子设备中确定出适合接续显示所述目标内容的第二电子设备。
  21. 根据权利要求20所述的方法,其特征在于,所述第一电子设备基于所述目标内容,从多个电子设备中确定出适合接续显示所述目标内容的第二电子设备,包括:
    所述第一电子设备基于所述目标内容,确定出与所述目标内容对应的应用场景为阅读场景;
    所述第一电子设备根据所述阅读场景,从多个电子设备中确定出适合接续显示所述阅读场景中的所述目标内容的第二电子设备。
  22. 根据权利要求20或21所述的方法,其特征在于,所述第一电子设备基于所述目标内容,确定出与所述目标内容对应的应用场景,包括:
    所述第一电子设备基于所述目标内容,确定出所述第一电子设备安装的用于显示所述目标内容的第一应用;
    所述第一电子设备根据所述第一应用,确定出与所述目标内容对应的应用场景。
  23. 根据权利要求18至22任一项所述的方法,其特征在于,所述第一电子设备向所述第二电子设备发送用于在所述第二电子设备上接续显示所述目标内容所需的接续数据,包括:
    在所述目标内容为在线内容的情况下,所述第一电子设备通过蓝牙向所述第二电子设备发送用于在所述第二电子设备上接续显示所述目标内容所需的接续数据;或
    在所述目标内容为离线内容的情况下,所述第一电子设备通过点到点无线保真(Wireless-Fidelity point-to-point,Wi-Fi P2P)向所述第二电子设备发送用于在所述第二电子设备上接续显示所述在线内容所需的接续数据。
  24. 根据权利要求23所述的方法,其特征在于,在所述目标内容为在线网文的情况下,所述接续数据为在线网文接续数据,所述在线网文接续数据包括用于供所述第二电子设备接续显示所述在线网文的统一资源标识符(Uniform Resource Identifier,URI);或
    在所述目标内容为离线网文的情况下,所述接续数据为离线网文接续数据,所述离线网文接续数据包括用于供所述第二电子设备接续显示所述离线网文的文件;或
    在所述目标内容为在线电子书籍的情况下,所述接续数据为在线电子书籍接续数据,所述在线电子书籍接续数据包括用于供所述第二电子设备接续显示所述在线电子书籍的标识以及阅读进度;或
    在所述目标内容为离线电子书籍的情况下,所述接续数据为离线电子书籍接续数据,所述离线电子书籍接续数据包括用于供所述第二电子设备接续显示所述离线电子书籍的文件以及阅读进度。
  25. 根据权利要求24所述的方法,其特征在于,所述在线网文接续数据还包括所述在线网文的标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
  26. 根据权利要求24所述的方法,其特征在于,所述离线网文接续数据还包括所述离线网文的URI、 标题、解析来源、解析时间、服务器来源以及完整性校验标识中的至少一种。
  27. 根据权利要求24所述的方法,其特征在于,所述在线电子书籍接续数据还包括:所述在线电子书籍的章节结构。
  28. 根据权利要求24所述的方法,其特征在于,所述离线电子书籍接续数据还包括:所述在线电子书籍的标识以及章节结构中的至少一种。
  29. 根据权利要求18至28任一项所述的方法,其特征在于,所述接续数据包括应用包名,所述应用包名用于指示所述第二电子设备通过所述应用包名对应的应用打开所述目标内容。
  30. 根据权利要求29所述的方法,其特征在于,所述接续数据还包括所述第一电子设备安装的用于显示所述目标内容的第一应用的身份认证信息,所述身份认证信息用于使所述第二电子设备具有从所述第一应用的服务器获取所述目标内容的权限。
  31. 根据权利要求29或30所述的方法,其特征在于,所述第一电子设备安装的用于显示所述目标内容的第一应用的服务器,与所述第二电子设备安装的用于接续显示所述目标内容的第二应用的服务器具有互相访问权限,使所述第二应用的服务器具有访问所述第一应用的服务器中的所述目标内容的权限,其中,所述第一电子设备的所述第一应用从所述第一应用的服务器获取所述目标内容。
  32. 一种用于分布式显示的屏幕识别方法,其特征在于,包括:
    第二电子设备接收第一电子设备发送的用于在所述第二电子设备上接续显示目标内容所需的接续数据,其中,所述目标内容为所述第一电子设备确定出的所述第一电子设备中要通过其他电子设备进行接续显示的内容;
    所述第二电子设备根据从所述第一电子设备接收的所述接续数据接续显示所述目标内容。
  33. 根据权利要求32所述的方法,其特征在于,在所述目标内容为在线网文的情况下,所述接续数据为在线网文接续数据,所述在线网文接续数据包括所述在线网文的统一资源标识符(Uniform Resource Identifier,URI);或
    在所述目标内容为离线网文的情况下,所述接续数据为离线网文接续数据,所述离线网文接续数据包括所述离线网文的文件;或
    在所述目标内容为在线电子书籍的情况下,所述接续数据为在线电子书籍接续数据,所述在线电子书籍接续数据包括所述在线电子书籍的标识以及阅读进度;或
    在所述目标内容为离线电子书籍的情况下,所述接续数据为离线电子书籍接续数据,所述离线电子书籍接续数据包括所述离线电子书籍的文件以及阅读进度。
  34. 根据权利要求33所述的方法,其特征在于,所述第二电子设备根据从第一电子设备接收的接续数据接续显示目标内容,包括:
    在所述目标内容为在线网文的情况下,所述第二电子设备根据从所述第一电子设备接收的所述URI,接续显示所述在线网文;或
    在所述目标内容为离线网文的情况下,所述第二电子设备根据从所述第一电子设备接收的所述离线网文的文件,接续显示所述离线网文;或
    在所述目标内容为在线电子书籍的情况下,所述第二电子设备根据从所述第一电子设备接收的所述在线电子书籍的标识,接续显示所述在线电子书籍;或
    在所述目标内容为离线电子书籍的情况下,所述第二电子设备根据从所述第一电子设备接收的所述在线电子书籍的文件,接续显示所述离线电子书籍。
  35. 根据权利要求32至34中任一项所述的方法,其特征在于,所述第二电子设备安装有用于显示 所述目标内容的第二应用,所述方法还包括:
    所述第二电子设备根据从所述第一电子设备接收的所述接续数据,将所述目标内容添加至所述第二应用的书架中。
  36. 根据权利要求35所述的方法,其特征在于,还包括:
    所述第二电子设备根据从所述第一电子设备接收的所述接续数据,在所述第二电子设备安装的所述第二应用的稍后阅读卡片中添加所述目标内容。
  37. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有指令,该指令在电子设备上执行时使电子设备执行权利要求18-31中任一项所述的方法或者权利要求32-36中任一项所述的方法。
  38. 一种计算机程序产品,其特征在于,所述计算机程序产品包括指令,所述指令用于实现权利要求18-31中任一项所述的方法或者权利要求32-36中任一项所述的方法。
  39. 一种芯片装置,其特征在于,所述芯片装置包括:
    通信接口,用于输入和/或输出信息;
    处理器,用于执行计算机可执行程序,使得安装有所述芯片装置的设备执行权利要求18-31中任一项所述的方法或者权利要求32-36中任一项所述的方法。
  40. 一种电子设备,其特征在于,包括:
    存储器,用于存储由电子设备的一个或多个处理器执行的指令,以及
    处理器,当所述指令被一个或多个处理器执行时,所述处理器用于执行权利要求18-31中任一项所述的方法或者权利要求32-36中任一项所述的方法。
PCT/CN2022/120614 2021-09-24 2022-09-22 用于分布式显示的屏幕识别方法、介质及电子设备 WO2023046028A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22872072.8A EP4387210A1 (en) 2021-09-24 2022-09-22 Screen identification method for distributed display, medium and electronic device

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202122327031.6 2021-09-24
CN202122327031 2021-09-24
CN202210454464.4 2022-04-26
CN202210454464.4A CN115857847A (zh) 2021-09-24 2022-04-26 用于分布式显示的屏幕识别方法、介质及电子设备

Publications (1)

Publication Number Publication Date
WO2023046028A1 true WO2023046028A1 (zh) 2023-03-30

Family

ID=85660087

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/120614 WO2023046028A1 (zh) 2021-09-24 2022-09-22 用于分布式显示的屏幕识别方法、介质及电子设备

Country Status (3)

Country Link
EP (1) EP4387210A1 (zh)
CN (1) CN115857847A (zh)
WO (1) WO2023046028A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102750086A (zh) * 2012-05-31 2012-10-24 上海必邦信息科技有限公司 电子设备间实现无线分享显示页面控制的方法
CN111090371A (zh) * 2019-04-19 2020-05-01 广东小天才科技有限公司 一种阅读页面的切换方法及电子设备
WO2021023220A1 (zh) * 2019-08-06 2021-02-11 华为技术有限公司 一种内容接续方法、系统及电子设备
CN112714214A (zh) * 2019-10-24 2021-04-27 华为终端有限公司 一种内容接续方法及电子设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102750086A (zh) * 2012-05-31 2012-10-24 上海必邦信息科技有限公司 电子设备间实现无线分享显示页面控制的方法
CN111090371A (zh) * 2019-04-19 2020-05-01 广东小天才科技有限公司 一种阅读页面的切换方法及电子设备
WO2021023220A1 (zh) * 2019-08-06 2021-02-11 华为技术有限公司 一种内容接续方法、系统及电子设备
CN112714214A (zh) * 2019-10-24 2021-04-27 华为终端有限公司 一种内容接续方法及电子设备

Also Published As

Publication number Publication date
CN115857847A (zh) 2023-03-28
EP4387210A1 (en) 2024-06-19

Similar Documents

Publication Publication Date Title
WO2021013158A1 (zh) 显示方法及相关装置
CN112703478B (zh) 数据分享的方法、图形用户界面、电子设备及系统
WO2021139768A1 (zh) 跨设备任务处理的交互方法、电子设备及存储介质
WO2021017837A1 (zh) 一种卡片分享方法、装置及系统
US10135495B2 (en) Method and system for transferring data between plurality of devices
CN112291764B (zh) 一种内容接续系统
WO2021164445A1 (zh) 一种通知处理方法、电子设备和系统
WO2020155014A1 (zh) 智能家居设备分享系统、方法及电子设备
WO2020224447A1 (zh) 一种在联系人中添加智能家居设备的方法及系统
WO2022127661A1 (zh) 应用共享方法、电子设备和存储介质
WO2021249318A1 (zh) 一种投屏方法和终端
US10084850B2 (en) Terminal apparatus, server and method of controlling the same
WO2021244452A1 (zh) 一种多设备交互的方法及系统
WO2020233556A1 (zh) 一种通话内容处理方法和电子设备
WO2022078295A1 (zh) 一种设备推荐方法及电子设备
WO2022135157A1 (zh) 页面显示的方法、装置、电子设备以及可读存储介质
WO2023005900A1 (zh) 一种投屏方法、电子设备及系统
US20240354359A1 (en) Audio processing method, system, and related apparatus
WO2022001192A1 (zh) 应用数据的传输方法、终端及系统
EP3968671B1 (en) Method for information transmission and electronic device
WO2023005711A1 (zh) 一种服务的推荐方法及电子设备
WO2023005715A1 (zh) 快应用处理方法、电子设备与快应用系统
WO2023046028A1 (zh) 用于分布式显示的屏幕识别方法、介质及电子设备
WO2022089276A1 (zh) 一种收藏处理的方法及相关装置
WO2022052706A1 (zh) 一种服务的分享方法、系统及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22872072

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022872072

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022872072

Country of ref document: EP

Effective date: 20240314

NENP Non-entry into the national phase

Ref country code: DE