WO2022105403A1 - 跨设备的内容投屏方法、装置、设备及存储介质 - Google Patents

跨设备的内容投屏方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2022105403A1
WO2022105403A1 PCT/CN2021/118823 CN2021118823W WO2022105403A1 WO 2022105403 A1 WO2022105403 A1 WO 2022105403A1 CN 2021118823 W CN2021118823 W CN 2021118823W WO 2022105403 A1 WO2022105403 A1 WO 2022105403A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
screen
display screen
split
projection
Prior art date
Application number
PCT/CN2021/118823
Other languages
English (en)
French (fr)
Inventor
侯奕含
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2022105403A1 publication Critical patent/WO2022105403A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the embodiments of the present application relate to the technical field of content sharing, and in particular, to a cross-device content projection method, apparatus, device, and storage medium.
  • multiple users can either use their respective devices to play the same game, or log in to different shopping applications on their respective devices to compare prices for the same commodity.
  • users in the same room want to view their own device and the other party's device at the same time, they need to be close to each other to view their own device and the other party's device back and forth.
  • Embodiments of the present application provide a cross-device content projection method, apparatus, device, and storage medium.
  • the technical solution is as follows:
  • a method for projecting content across devices is provided, which is applied to a device with a display screen, and the method includes:
  • first content screen projection request sent by a first device, where the first content screen projection request is a request sent by the first device to the device with a display screen after performing a preset interactive operation;
  • the first content and the second content are played in a split-screen mode, and the second content is the content played in the second device.
  • a cross-device content screen projection device which is applied to a device with a display screen, and the device includes:
  • a first receiving module configured to receive a first content projection request sent by a first device, where the first content projection request is sent by the first device to the device with a display screen after performing a preset interactive operation request;
  • a first playing module configured to play the first content in response to the first content projection request, where the first content is the content played in the first device;
  • a second receiving module configured to receive a second content projection request sent by a second device, where the second content projection request is sent by the second device to the computer with the display screen after performing the preset interactive operation the request sent by the device;
  • a second playing module configured to play the first content and the second content in a split-screen mode in response to the second content projection request, where the second content is the content played in the second device.
  • a cross-device content projection system includes a device having a display screen, a first device, at least one second device, and a remote control device, wherein the remote control device includes a screen-casting label, and the remote control device is used to remotely control the device with a display screen;
  • the first device configured to scan the information in the screen projection label
  • the first device configured to send a first content projection request to the device with a display screen after scanning the information in the projection label
  • the device with a display screen, configured to receive the first content projection request
  • the device with a display screen, configured to play first content in response to the first content projection request, where the first content is the content played in the first device;
  • the second device configured to scan the information in the screen projection label
  • the second device configured to send a second content projection request to the device with a display screen after scanning the information in the projection label
  • the device with a display screen, configured to receive the second content projection request
  • the device with a display screen is configured to play the first content and the second content in a split-screen mode in response to the second content projection request, and the second content is played in the second device content.
  • a cross-device content projection system includes a device having a display screen, a first device and at least one second device, the first device including a first image an acquisition component, the second device includes a second image acquisition component;
  • the first device configured to capture a preset gesture or a preset action through the first image capture component
  • the first device configured to send a first content projection request to the device with a display screen after capturing the preset gesture or the preset action
  • the device with a display screen, configured to receive the first content projection request
  • the device with a display screen, configured to play first content in response to the first content projection request, where the first content is the content played in the first device;
  • the second device configured to capture the preset gesture or the preset action by using the second image capture component
  • the second device configured to send a second content projection request to the device with a display screen after capturing the preset gesture or the preset action
  • the device with a display screen, configured to receive the second content projection request
  • the device with a display screen is configured to play the first content and the second content in a split-screen mode in response to the second content projection request, and the second content is played in the second device content.
  • an electronic device includes a processor and a memory, the memory stores at least one instruction, the instruction is loaded and executed by the processor to implement the The cross-device content projection method provided by various aspects of the present application.
  • a computer-readable storage medium stores at least one instruction, the instruction is loaded and executed by a processor to implement the cross-device as provided in various aspects of the present application content projection method.
  • a computer program product comprising computer instructions stored in a computer-readable storage medium.
  • the processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in various optional implementation manners of the above-mentioned cross-device content projection aspect.
  • FIG. 1 is a schematic diagram of an implementation environment for cross-device content projection provided by an embodiment of the present application
  • FIG. 2 is a schematic diagram of a split-screen mode of a device with a display screen provided based on the embodiment shown in FIG. 1;
  • FIG. 3 is a schematic diagram of reading a radio frequency tag provided based on the embodiment shown in FIG. 2;
  • FIG. 4 is a flowchart of a cross-device content projection method provided by an exemplary embodiment of the present application
  • FIG. 5 is a flowchart of a method for cross-device content projection provided by another exemplary embodiment of the present application.
  • FIG. 6 is a schematic diagram of an application of a cross-device content screen projection method provided based on the embodiment shown in FIG. 5;
  • FIG. 7 is a flowchart of a method for cross-device content projection provided by another exemplary embodiment of the present application.
  • FIG. 8 is a flowchart of a method for cross-device content projection in a proctoring scenario provided by an embodiment of the present application
  • FIG. 9 is a flowchart of a method for cross-device content projection provided by an embodiment of the present application.
  • FIG. 10 is a schematic display diagram of a device with a display screen provided based on the embodiment shown in FIG. 9;
  • FIG. 11 is a schematic diagram of a display interface of a device with a display screen provided based on the embodiment shown in FIG. 9;
  • FIG. 12 is a structural block diagram of a cross-device content screen projection device provided by an exemplary embodiment of the present application.
  • FIG. 13 is a structural block diagram of a device with a display screen provided by an exemplary embodiment of the present application.
  • the present application provides a cross-device content projection method, wherein, when applied to a device with a display screen, the method includes: receiving a first content projection request sent by a first device, the first content projection request It is a request sent by the first device to the device with a display screen after performing a preset interactive operation; in response to the first content projection request, the first content is played, and the first content is the first content.
  • Content played in a device receiving a second content projection request sent by a second device, where the second content projection request is sent by the second device to the computer with the display screen after performing the preset interactive operation
  • the request sent by the device in response to the second content projection request, the first content and the second content are played in a split-screen mode, and the second content is the content played in the second device.
  • the preset interaction operation includes scanning a screen projection label, and the screen projection label is an electronic label corresponding to the device with a display screen; or, the preset interaction operation includes shooting a preset gesture; or, The preset interactive operation includes shooting a preset action.
  • the method before the receiving the first content screen projection request sent by the first device, the method further includes: receiving a split-screen instruction; in response to the split-screen instruction, entering the split-screen mode, the device having a display screen
  • the display screen of the device includes at least a first display area and a second display area in the split-screen mode; wherein, the first display area is used to display the first content, and the second display area is used to display the Second content.
  • the playing the first content and the second content in a split-screen mode in response to the second content projection request includes: acquiring split-screen information in response to the second content projection request; In response to the split-screen information meeting a preset condition, the split-screen mode is entered, and the display screen of the device with the display screen includes at least a first display area and a second display area in the split-screen mode; The first content is played in the first display area, and the second content is played in the second display area.
  • the acquiring the split screen information in response to the second content projection request includes: in response to the second content projection request, acquiring the projection time of the first device and the second content projection time
  • the reference duration between screen projection moments of the device; the entering the split-screen mode in response to the split-screen information meeting a preset condition includes: responding to the reference duration being less than a first threshold, entering the split-screen model.
  • the acquiring split screen information in response to the second content projection request includes: in response to the second content projection request, acquiring historical projection information of the second device, the historical The screen projection information includes at least one of the number of screen projections or the cumulative screen projection duration that the second device successfully projects to the first device; the response to the split screen information meeting a preset condition, entering the The split-screen mode includes: entering the split-screen mode in response to the number of screen projections being greater than or equal to a second threshold; or, entering the split-screen mode in response to the cumulative duration of the screen projection being greater than or equal to a third threshold .
  • the acquiring split screen information in response to the second content projection request includes: in response to the second content projection request, acquiring first image information in the first content, and acquiring the second image information in the second content; the entering into the split-screen mode in response to the split-screen information meeting a preset condition includes: responding to the first image information and the second image information If the similarity between them is greater than or equal to the fourth threshold, the split-screen mode is entered.
  • acquiring the split screen information in response to the second content projection request includes: in response to the second content projection request, acquiring a first content identifier corresponding to the first content and the the second content identifier corresponding to the second content; the entering into the split-screen mode in response to the split-screen information meeting a preset condition includes: in response to a match between the first content identifier and the second content identifier, Enter the split screen mode.
  • the method further includes: in response to the second content screen projection request, displaying a split screen button; in response to the split screen button is triggered to enter the split-screen mode, where the display screen of the device with the display screen includes at least a first display area and a second display area in the split-screen mode.
  • the method further includes: in response to the abnormal image included in the first content and/or the second content, recording the abnormal image and the time when the abnormal image is displayed, the abnormal image belongs to The application does not belong to the whitelisted application list; the content including the abnormal image is highlighted, and the highlighting manner includes at least one of highlighting, displaying a preset mark, or displaying a preset text.
  • the method further includes: sending a locking signal to the device where the abnormal image appears, where the locking signal is used to instruct the device where the abnormal image appears to stop receiving input signals.
  • the method further includes: receiving local area information, where the local area information is used to indicate that the first content is in the first content.
  • a local area of the In the display area of the area corresponding to the local area information enlarged by k times is displayed; wherein, when the local area information is used to indicate a local area in the first content, the corresponding area of the local area information
  • the display area is the first display area; when the partial area information is used to indicate a partial area in the second content, the display area corresponding to the partial area information is the second display area.
  • the method further includes: performing image recognition on the first content to obtain a first text matching a preset keyword, where the preset keyword is a key set in the device with a display screen performing image recognition on the second content to obtain a second text matching the preset keyword; and comparing and displaying the first text and the second text.
  • the method further includes: receiving a first commodity extraction command sent by the first device, where the first commodity extraction command is used to extract the commodity specified in the first content; extracting in response to the first object command, extract and store the corresponding first commodity; receive a second commodity extraction command sent by the second device, the second commodity extraction command is used to extract the commodity specified in the second content; in response to the first commodity 2.
  • Commodity extraction command extract and store the corresponding second commodity; receive a summary instruction, send the stored first commodity and the second commodity to the device that issued the summary instruction, and the device that issued the summary instruction
  • a device is the first device or the second device.
  • the first commodity and the second commodity are commodities belonging to the same shopping application
  • the summary instruction includes an identifier of the shopping application corresponding to the first commodity and the second commodity in common.
  • the device with the display screen can receive the content screen projection request sent by the first device and the second device successively, and can display the first content and the second content on a split screen.
  • both the first device and the second device send a corresponding content projection request to the device having the display screen after performing the preset interactive operation. Therefore, the present application can reduce the operation complexity of a device having a display screen simultaneously displaying content projected by multiple devices, and improve the efficiency of multi-device screen projection.
  • the first content projection request is the information sent by the first device to the device with the display screen, and is used to request that the first content played in the first device be played in the device with the display screen.
  • the first content projection request may be a character string conforming to a fixed format, and the character string includes keywords and character content.
  • the screen projection label is an electronic label corresponding to a device with a display screen.
  • the character content may include a first character string, the first character string is the information read by the first device, the information is the information stored in the screen projection label of the remote control device, and the screen projection label is used for remote control with a display screen.
  • label in the device For example, the device in the first device has an NFC (Near Field Communication, approach communication) module.
  • NFC Near Field Communication, approach communication
  • the first device can read the first character string in the NFC tag in the remote control.
  • the ID Identity Document, identity number
  • the NFC module in the first device reads the ID in the remote control and uses it as the first string .
  • RFID Radio Frequency Identification, radio frequency identification
  • the RFID module can read the first character string in the RFID tag of the remote control.
  • the remote control device of the device with the display screen can also be implemented as other short-range radio frequency identification tags.
  • a corresponding short-range identification module may be provided in the first device.
  • the first device may be provided with a radio frequency identification module that conforms to the A protocol, and the radio frequency identification module has the ability to read the information in the radio frequency identification.
  • the first content projection request can acquire the first character string from the preset application. That is, when the first device captures the preset gesture or captures the preset action through the first image capturing component, the first device can start the preset application and obtain the first character string from the preset application. Alternatively, the first device can acquire the first character string from the preset application when the preset application is in the activated state. It should be noted that the process of acquiring the second character string by the second device is similar to the process of acquiring the first character string by the first device, and details are not described herein again.
  • the second content projection request is the information sent by the second device to the device with the display screen, and is used to request to continue playing the second content played in the second device in the device with the display screen.
  • the second content projection request may be a character string conforming to a fixed format, and the character string includes keywords and character content.
  • the character content may include a second character string, where the second character string is information read by the second device from a screen projection tag of a remote control device used to remotely control a device with a display screen.
  • the radio frequency module set in the second device may be the same type of module as the radio frequency module set in the first device.
  • the radio frequency module set in the second device may be a module conforming to the same radio frequency protocol as the radio frequency module set in the first device.
  • String Template A string to set in devices with a display.
  • the character string template is the same as the character string reserved in the remote control device corresponding to the device with the display screen.
  • the string reserved in the remote control device is "abcdef1234" and the string template is also “abcdef1234".
  • the generated first string is "abcdef1234"
  • the device with the display screen passes the first string and the string template is the same, It can be verified that the first content originally played in the first device can continue to be played in the device with the display screen.
  • the second device correctly reads the character string reserved in the remote control device in the radio frequency module
  • the generated second character string is "abcdef1234".
  • the device with the display screen will continue to play the second content originally played on the second device in the device with the display screen when the second string and the string template are the same.
  • the character string template and the characters reserved in the remote control device corresponding to the device with the display screen are different, but the above two character strings match each other.
  • the character reserved in the remote control device is "33445566abc”
  • the string template is "1122334455cba”.
  • a string template is pre-stored in a device with a display screen, and a binding relationship between "1122334455cba" and "33445566abc" is stored.
  • a device with a display screen When a device with a display screen receives the first content projection request and reads "33445566abc" from it, or receives a second content projection request and reads out "33445566abc", the device with a display screen can read "33445566abc” from it. ” and “1122334455cba” pass the verification, continue to play the first content in the device with a display screen, or continue to play the second content in the device with a display screen.
  • the first content the content displayed in the first device, the content can be screen-cast by the first device in a cross-device manner and played in a device with a display screen.
  • the present application provides two optional playback modes of the first device, which are introduced as follows.
  • the first content is originally played on the first device, and after the first device successfully casts the first content to a device with a display screen for playback, the first content continues to be played on the first device play in.
  • the first content is a game screen
  • the game screen can continue to be played in the first device, and the game can normally receive user manipulation in the first device.
  • the first content is a user interface of a shopping application
  • the user can continue to display the user interface of the shopping application in the first device, so that the user using the first device can continue to operate and view commodity information displayed in the shopping application.
  • the first content is originally played on the first device, and after the first device successfully casts the first content to a device with a display screen for playback, the first content stops playing on the first device play in.
  • the first device may also continue to display a manipulation interface related to the first content. For example, when the first content is a video, the first device may also display controls such as play, stop, fast-forward, fast-rewind, adjust the playback progress, or adjust the volume.
  • the first content may be social applications, video applications, reading applications, map applications, weather applications, group purchase applications, office applications, photography applications, and financial applications , at least one of travel apps, shopping apps, game apps, or exam study apps.
  • the user interface to which the first content belongs may be the same interface as the user interface to which the second content belongs.
  • the display mode of the second content in the second device may be the same as the display mode of the first content in the first device.
  • the first content may include a first commodity
  • the second content may include a second commodity.
  • the first content and the second content are contents belonging to the same shopping application.
  • the cross-device content projection method shown in the embodiments of the present application may be applied to a device with a display screen.
  • the size of the display screen of a device with a display screen is a larger size device in the physical world.
  • the device with a display screen may be a TV, a projector, a computer display screen, a mural display screen or a monitor of a video proctoring system, a tablet computer or a notebook computer, which is not limited in this application.
  • a device with a display screen and a remote control can be implemented as the device with a display screen shown in this application.
  • FIG. 1 is a schematic diagram of an implementation environment of cross-device content screen projection provided by an embodiment of the present application.
  • a device 111 with a display screen a remote control device 112 , a first device 120 and a second device 130 are included.
  • the remote control device 112 is used to remotely control the device 111 having a display screen.
  • the device 111 with a display screen is a TV
  • the remote control device 112 is a TV remote controller
  • the first device 120 is a mobile phone
  • the second device 130 is also a mobile phone as an example.
  • the device 111 with a display screen may be a television placed in a user's home, business, or public place.
  • the device 111 with a display screen has a display screen with a larger size, and the device 111 with a display screen has the function of split-screen display.
  • the size of the display screen of the device 111 with the display screen may be more than 10 inches.
  • FIG. 2 is a schematic diagram of a split screen mode of a device with a display screen provided based on the embodiment shown in FIG. 1 .
  • the device 111 with a display screen After the device 111 with a display screen enters the split-screen mode, it includes a first display area 210 and a second display area 220 .
  • the device 111 with the display screen can independently display the designated content in the first display area 210 and the second display area 220 respectively.
  • the device 111 with a display screen displays the interface of the game G1 in the first display area 210 and displays the shopping application S1 in the second display area 220 .
  • the first device 120 may be connected to the device 111 having a display screen through Bluetooth, WiFi (Wireless Fidelity, wireless fidelity) or other short-range wireless connection networks.
  • WiFi Wireless Fidelity, wireless fidelity
  • the first device 120 can screen the first content to the device 111 with a display screen.
  • the second device 130 can establish a connection with the device 111 having a display screen in the same way, and project the second content originally displayed in the second device 130 to the device 111 having a display screen.
  • either the first device 120 or the second device 130 and the device 111 having a display screen can perform screen projection processing according to the same projection protocol.
  • the screen projection protocol may be any one of AirPlay, Miracast, DLNA, Chromecast, WiDi, WDHI, or a private screen projection protocol. It should be noted that the screen projection protocol here is only a schematic description, and does not limit the screen projection protocol actually applied in the embodiments of the present application.
  • FIG. 3 is a schematic diagram of reading a radio frequency tag provided based on the embodiment shown in FIG. 2 .
  • both the first device 120 and the second device 130 need to read the information in the screen projection tag in the remote control device 112 .
  • the process of reading the screen projection tag 310 in the remote control device by the first device 120 and the second device 130 respectively is introduced.
  • the first device 120 is provided with a first radio frequency module 320
  • the second device 130 is provided with a second radio frequency module 330 .
  • the remote control device 112 first performs a card-swiping operation with the first device 120 , and then performs a card-swiping operation with the second device 130 .
  • the first device 120 touches the lower part of the remote control device 112 .
  • the screen projection tag 310 disposed in the lower part of the remote control device 112 is read by the first radio frequency module 320 in the first device 120, and the first device 120 generates a first character string according to the read information.
  • the second device 130 touches the lower part of the remote control device 112 .
  • the screen projection tag 310 disposed in the lower part of the remote control device 112 is read by the second radio frequency module 330 in the second device 130, and the second device 130 generates a second character string according to the read information.
  • the first radio frequency module 320 in the first device 120 is disposed at the upper part of the back of the device
  • the second radio frequency module 330 in the second device 130 is disposed at the lower part of the back of the device.
  • the embodiments of the present application illustrate devices of different types, and it can be seen that the radio frequency modules are arranged in different positions.
  • the positions of the radio frequency modules in the devices are the same.
  • the system shown in FIG. 1 can include a device with a display screen, a first device, at least one second device and a remote control device, the remote control device includes a screen projection tag, and the remote control device is used for remote control and has a display screen. device of.
  • the first device is used to scan the information in the screen projection label; the first device is used to send a first content projection request to the device with a display screen after scanning the information in the screen projection label; the device with a display screen , used to receive the first content projection request; a device with a display screen is used to play the first content in response to the first content projection request, and the first content is the content played in the first device; the second device, using for scanning the information in the screen projection label; the second device for sending a second content projection request to the device with a display screen after scanning the information in the screen projection label; the device with a display screen for receiving the second content Screen projection request; a device with a display screen, configured to play the first content and the second content in a split-screen mode in response to the second content projection request, and the second content is the content played in the second device.
  • the system includes a device with a display screen, a first device, and at least one second device, the first device includes a first image capture component, and the second device includes a second device Image acquisition component.
  • the first device is used to shoot the preset gesture or the preset action through the first image acquisition component; the first device is used to send the first content projection to the device with the display screen after shooting the preset gesture or the preset action screen request; a device with a display screen for receiving a first content projection request; a device with a display screen for playing the first content in response to the first content projection request, and the first content is played on the first device
  • the second device is used to shoot the preset gesture or the preset action through the second image capture component; the second device is used to send the second content to the device with the display screen after shooting the preset gesture or the preset action A screen projection request; a device with a display screen for receiving a second content projection request; a device with a display screen for playing the first content and the second
  • FIG. 4 is a flowchart of a method for cross-device content projection provided by an exemplary embodiment of the present application.
  • the cross-device content projection method can be applied to the device with a display screen shown in FIG. 1 .
  • the cross-device content projection method includes:
  • Step 410 Receive a first content projection request sent by the first device, where the first content projection request is a request sent by the first device to a device having a display screen after performing a preset interactive operation.
  • the preset interactive operation may include one of scanning a screen projection label, shooting a preset gesture, or shooting a preset action.
  • the device with the display screen can receive the first content screen-casting request sent by the first device.
  • the first device sends a first content screen-casting request to the device with a display screen.
  • the screen projection label is set in the remote control of a device with a display screen
  • the first device will approach or touch the area in the remote control where the screen projection label is set, and the first device will The information generates a first content projection request, and sends the first content projection request to a device having a display screen.
  • the first device may capture the user's gesture through the first image capture component.
  • the first image acquisition component may be captured by a front camera or a rear camera.
  • the preset gestures include one-hand gestures, two-hand gestures, or hand-face combination gestures.
  • One-handed gestures are designated gestures made with either the left or right hand.
  • Two-handed gestures are gestures made by the left and right hands in cooperation with each other.
  • a hand-face combination gesture is a gesture formed by combining a hand and a human face, or, a hand-face combination gesture is a gesture formed by combining two hands and a human face. It should be noted that the embodiments of the present application do not limit the specific actions of the preset gestures.
  • the gesture made by the user is a preset gesture
  • the first device sends a first content projection request to a device having a display screen.
  • the device with the display screen receives the first content projection request.
  • the first device may collect multiple frames of images including the user's actions, and when the features extracted from the multiple frames of images conform to the features corresponding to the preset actions, the first device may determine to shoot When the preset action is reached, a first content projection request is sent to a device having a display screen. Correspondingly, the device with the display screen receives the first content projection request.
  • the device with the display screen may receive the first content screen projection request sent by the first device by means of short-range wireless communication.
  • the short-distance wireless communication mode may be any one of WiFi, Bluetooth or Zigbee (Zigbee).
  • the purpose is to continue playing the content originally played in the first device in the device with the display screen.
  • the first content is the content played in the first device.
  • the first content may be a user interface currently played in the first device, or the first content may be a user interface of an application currently running in the foreground in the first device.
  • Step 420 in response to the first content projection request, play the first content, where the first content is the content played in the first device.
  • the device with the display screen After receiving the first content projection request, the device with the display screen continues to play the first content originally played in the first device in response to the request.
  • the content to be played may be a video, a game screen or an interface displayed in real time by a mobile phone.
  • a device with a display screen can play the first content in response to matching the first string in the first content screencasting request with a string template, where the first string is read by the first device from the screencasting tag. to the information.
  • a device with a display screen can extract a first character string from the first content projection request, and match the first character string with a character string template. When the first string matches the string template, the device with the display screen plays the first content.
  • a device with a display screen can either play the first content in full screen, or display the first content in one of the display areas when the device with a display screen is currently in a multi-screen display mode or a split-screen mode. content.
  • the first character string is the information read by the first device from the screen projection tag.
  • the screen projection label can either be set in the remote control device corresponding to the device with the display screen, the screen projection label can also be set as a radio frequency card separately, and the radio frequency identification tag can also be attached to the frame of the device with the display screen. .
  • Step 430 Receive a second content projection request sent by the second device, where the second content projection request is a request sent by the second device to a device having a display screen after performing a preset interactive operation.
  • a device with a display screen receives a second content screen projection request sent by a second device is similar, and will not be repeated here.
  • the second device may be a device of the same model as the first device, or may be a device of a different model than the first device.
  • devices from the same manufacturer may be defined as devices of one model.
  • devices from the same manufacturer and from the same specific model are defined as devices of the same model.
  • the second device may be of the same type as the first device, or may be of a different type from the first device.
  • the types of devices may be classified into types of hardware according to classification methods such as mobile phones, tablet computers, smart watches, and notebook computers.
  • Step 440 In response to the second content projection request, the first content and the second content are played in a split-screen mode, and the second content is the content played in the second device.
  • the device with a display screen when a device with a display screen is already playing the first content projected by the first device, the device with a display screen can respond to a screen projection request sent by other devices, and use the split-screen mode to respond. At the same time, the previously played first content and the second content corresponding to the new demand are played.
  • the first content and the second content are played at the same time in response to matching the second string in the second content screencasting request with the string template, where the second string is read by the second device from the screencasting tag.
  • Information
  • the device with the display screen Since the device with the display screen is already playing the first content, when the second string matches the string template, the device with the display screen will occupy the area of the screen occupied by the device with the display screen according to the first content Size, which determines how to display the first content and the second content at the same time.
  • the device with a display screen when a device with a display screen displays the first content in a full screen, the device with a display screen will adopt a split-screen mode to re-divide into two display areas. Among them, one area is used to display the first content, and the other area is used to display the second content.
  • the above two display areas may be a first display area and a second display area, respectively.
  • the device with a display screen may also be in a multi-screen mode, and the device with a display screen in the multi-screen mode includes more than two display areas. Two of the display areas are used to display the first content and the second content.
  • the device with the display screen when the device with the display screen is already in the split-screen mode or the multi-screen mode to display the first content, the device with the display screen may display the first content in other display areas other than the first content The second content is displayed in .
  • a device with a display screen can simultaneously display the first content projected by the first device and the second content projected by the second device.
  • the device with the display screen can receive the content projection requests sent by the first device and the second device successively, The content continues to be played in the device with the display screen, and the second content in the second device continues to be played in the device with the display screen.
  • the first device and the second device send a screen projection request to the device with a display screen after performing a preset interactive operation, and play the corresponding content, which improves the ability of the device with a display screen to simultaneously display multiple The ability of the device to mirror the content of the screen, and improve the efficiency of multi-device screen projection.
  • a device with a display screen can also enter a split-screen mode in advance, and in the split-screen mode, successively receive requests from the first device and the second device, and display corresponding content at the same time. Please refer to the following examples.
  • FIG. 5 is a flowchart of a method for cross-device content projection provided by another exemplary embodiment of the present application.
  • the cross-device content projection method can be applied to the above-mentioned device with a display screen.
  • the cross-device content projection method includes:
  • Step 511 receiving a split screen instruction.
  • Split screen commands can be voice commands, infrared commands, or commands generated when a menu control is triggered.
  • the device with a display screen can receive the instruction through built-in software such as a voice assistant.
  • a device with a display screen can enter a voice-activated state after receiving a wake word.
  • the microphone of the device with the display screen can receive the voice and generate voice commands according to the voice.
  • Step 512 in response to the split-screen instruction, enter a split-screen mode, and the display screen of the device with the display screen includes at least a first display area and a second display area in the split-screen mode.
  • a device with a display screen can enter a split-screen mode in response to a split-screen command.
  • the split screen mode includes a first display area and a second display area. The first display area is used to display the first content, and the second display area is used to display the second content.
  • a device with a display screen will go into a voice-activated state. At this time, when the user says to enter the split-screen mode, the device with the display screen will enter the split-screen mode.
  • the user can open a specified menu in the device with the display screen through the remote control, and when the split-screen button in the menu is clicked, the device with the display screen will enter the split-screen mode.
  • Step 520 Receive a first content screen projection request sent by the first device.
  • step 520 the process performed in step 520 is the same as that in step 410, and details are not repeated here.
  • Step 530 in response to matching the first string in the first content projection request with the string template, play the first content in the first display area.
  • the first display area may be the area on the left
  • the second display area may be the area on the right .
  • Step 540 Receive a second content projection request sent by the second device.
  • step 540 the process performed in step 540 is the same as that in step 430, and details are not repeated here.
  • Step 550 in response to matching the second string in the second content projection request with the string template, play the second content in the second display area while playing the first content in the first display area.
  • the device with the display screen arranges the second content for display in the second display area.
  • FIG. 6 is a schematic diagram of an application of a method for cross-device content screen projection provided based on the embodiment shown in FIG. 5 .
  • the device with a display screen is a TV
  • the first device is a mobile phone A
  • the second device is a mobile phone B
  • the screencasting label with a binding relationship with the device with a display screen is set in the device with a display screen. in the remote control.
  • the user can use the remote control 610 or voice to control the TV 620 to enter the left and right split screen mode.
  • the TV 620 will display a prompt word 621 "The TV will enter the left and right split screen".
  • the user uses the A mobile phone 630 to lean against the remote control 610, and the radio frequency module of the A mobile phone 630 reads the first character string from the screen projection tag in the remote control 610, and includes the information in the first content projection request, Send to TV 620.
  • the TV 620 verifies that the first character string matches the character string template stored in the TV 620 , the content originally displayed in the A mobile phone 630 is displayed in the first display area 622 on the left.
  • the radio frequency module of the mobile phone B 640 reads the second character string from the screen projection tag in the remote control 610, and the information is included in the second content
  • the screen projection request is sent to the TV 620 .
  • the TV 620 verifies that the second character string matches the character string template stored in the TV 620
  • the content originally displayed in the B mobile phone 640 is displayed in the second display area 623 on the right.
  • the split-screen mode can be entered in advance according to the user's voice instruction or the instruction of the remote controller in advance.
  • the first device passes the verification of the device with the display screen
  • the first content displayed in the first device will be displayed in one of the display areas.
  • the second device passes the verification of the device with the display screen
  • the device with the display screen will display the second content displayed in the second device in addition to the display area where the first content is displayed.
  • the information used by the first device and the second device to verify with the device with the display screen is obtained from the screen projection tag that is bound to the device with the display screen.
  • the device with a display screen provided by the present application can provide a split-screen mode that is easy to enter, and the content played in other devices can be directly projected to a display area in the split-screen mode in just one step, and then , in the case where there is already projected content, the content in another device can still be quickly projected to other display areas in the split-screen mode.
  • the method provided by the embodiments of the present application can improve the ability of a device with a display screen to simultaneously display screencast content in multiple other devices.
  • the device with a display screen in addition to entering the split-screen mode in advance, also has the ability to intelligently determine whether to enter the split-screen display of the first content and the second content. Please refer to the following examples.
  • FIG. 7 is a flowchart of a method for cross-device content projection provided by another exemplary embodiment of the present application.
  • the cross-device content projection method can be applied to the above-mentioned device with a display screen.
  • this cross-device content projection method includes:
  • Step 710 Receive a first content projection request sent by the first device.
  • step 710 the execution process of step 710 is the same as that of step 410, and details are not repeated here.
  • Step 720 in response to the first content string in the first content projection request matching the character string template, play the first content in full screen.
  • Step 730 Receive a second content projection request sent by the second device.
  • step 730 is the same as that of step 430, and details are not repeated here.
  • Step 741 in response to the second content projection request, obtain split screen information.
  • split screen information may be included in the second content projection request.
  • the split screen information is used to provide the device with the display screen, so that the device with the display screen can determine whether to enter the split screen.
  • Step 742 in response to the split screen information meeting the preset conditions, play the first content in the first display area, and play the second content in the second display area, the display screen of the device with the display screen is at least in the split screen mode. It includes a first display area and a second display area.
  • the device with the display screen plays the first content in the first display area and the second content in the second display area when the split screen information meets the preset condition.
  • the first display area and the second display area are display areas that do not overlap with each other.
  • the split screen information is device information related to split screen, and specifically reflects the moment when the first device successfully projected the screen and the moment when the second device successfully projected the screen.
  • Step a1 in response to the second content projection request, obtain a reference duration between the projection time of the first device and the projection time of the second device.
  • Step a2 in response to the reference duration being less than the first threshold, play the first content in the first display area, and play the second content in the second display area.
  • the screen-casting moment of the first device is used to indicate the moment when the second content is successfully screened on the device with the display screen
  • the screen-casting moment of the second device is used to indicate that the third content is successfully screened on the device with the display screen. the moment in the device with the screen.
  • the device with the display screen will calculate the two screen projection times according to the successful screen projection time of the first device on the device with the display screen and the successful screen projection time of the second device on the device with the display screen.
  • the duration between moments, that is, the reference duration is calculated.
  • the reference duration can reflect the correlation of screen projection between the first device and the second device. If the reference duration is short, it means that the first device is performing screen projection on a device with a display screen, and the second device is in The two events of screencasting on a device with a display are strongly correlated. Therefore, based on this design idea, the present application plays the first content in the first display area and plays the second content in the second display area when the reference duration is less than the first threshold. After the above processing, the device with the display screen can play the first content projected by the first device and the second content projected by the second device simultaneously more intelligently.
  • the reference duration when the reference duration is greater than or equal to the first threshold, the first content originally displayed in the device with the display screen will be replaced and displayed by the second content in the second device.
  • the reference duration is 37 seconds
  • the first threshold is 120 seconds. In this case, the reference duration is less than the first threshold. Therefore, a device with a display screen plays the first content in the first display area and plays the second content in the second display area.
  • the reference duration is 560 seconds. In this case, the reference duration is greater than the first threshold. Therefore, the first content originally displayed in the device with the display screen will be replaced by the second content, and the device with the display screen will display the second content.
  • the split-screen information is device information related to split-screen, specifically, historical screen projection information of the second device.
  • Step b1 in response to the second content projection request, obtain historical projection information of the second device, where the historical projection information includes at least the number of projections or the cumulative duration of projections that the second device successfully projects to the device with a display screen. a kind of information.
  • Step b21 in response to the number of screen projections being greater than or equal to the second threshold, play the first content in the first display area, and play the second content in the second display area.
  • Step b22 in response to the cumulative duration of screen projection being greater than or equal to the third threshold, play the first content in the first display area, and play the second content in the second display area.
  • step b1 the device with a display screen may perform step b21 or step b22.
  • the device with the display screen can decide whether to display the first content and the second content simultaneously in a split screen according to the cumulative screen projection duration of the second device. If the cumulative screen projection time of the second device is long enough, it means that the second device and the device with a display screen have a strong correlation in screen projection. In this case, the device with the display screen will split the screen into two non-overlapping display areas, that is, the first display area and the second display area. Then, the device with the display screen displays the first content in the first display area and the second content in the second display area, respectively.
  • the device with the display screen can also decide whether to display the first content and the second content on a split screen according to the number of times the second device has successfully performed screen projection on the device with the display screen in the history.
  • the number of screen projections of the second device on the device with the display screen is greater than or equal to the second threshold, it means that the second device has a strong correlation with the device with the display screen in terms of screen projection, and the device with the display screen will After the screen is split, the first content and the second content are displayed simultaneously.
  • the device with the display screen will display a dialog box in the display screen.
  • the dialog box is used to remind the user to select a device with a display screen to display the first content and the second content through a split screen.
  • the dialog box is used to remind the user to select a device with a display screen to stop displaying the first content and display the second content in the display area where the first content was originally displayed.
  • the split-screen information refers to content related to split-screen, specifically, image information of the first content and image information of the second content.
  • Step c1 in response to the second content projection request, obtain first image information in the first content according to a preset strategy, and obtain second image information in the second content according to the preset strategy.
  • Step c2 in response to the similarity between the first image information and the second image information being greater than or equal to the fourth threshold, play the first content in the first display area, and play the second content in the second display area.
  • a device with a display screen can autonomously perform image recognition on the first content and the second content.
  • a device with a display screen can acquire the second content according to the second content projection request, and acquire the second key frame in the second content.
  • the second key frame is an image frame acquired at a specified moment.
  • the device with the display screen obtains the image frame in the first content at the same specified time, and the image frame in the first content is the first key frame.
  • a device with a display screen can extract image features in a first key frame and can extract image features in a second key frame.
  • the similarity between the image features in the first key frame and the image features in the second key frame is greater than or equal to the fourth threshold, it indicates that the first content and the second content are likely to belong to the same application, or, Explain that the first content and the second content display corresponding objects. For example, the same characters or the same items are displayed in the first content and the second content.
  • a device with a display screen will enter a split-screen state and display the first content and the second content at the same time.
  • the split screen information is the content related to the split screen, specifically the content identifier of the first content and the content identifier of the second content.
  • Step d1 in response to the second content projection request, obtain a first content identifier corresponding to the first content and a second content identifier corresponding to the second content.
  • Step d2 in response to the match between the first content identifier and the second content identifier, play the first content in the first display area, and play the second content in the second display area.
  • the content identifier may not only indicate an identifier of an application corresponding to the content, but also a category to which the application corresponding to the content belongs, and may also indicate an object type in the content.
  • the content identifier indicates the application corresponding to the content.
  • both the first content identifier and the second content identifier are used to indicate the application corresponding to the content.
  • the device with the display screen determines that the first content identifier matches the second content identifier, and plays the first content identifier in the first display area. content while playing the second content in the second display area.
  • the device with a display screen may stop displaying the first content and display the first content in the display area where the first content was originally displayed. Two content.
  • the content identifier indicates the category of the application to which the content corresponds.
  • the first content identifier and the second content identifier are respectively used to indicate the category of the application corresponding to the first content, and the category of the application corresponding to the second content.
  • the first content identification is a game application identification and the second content identification is a video application identification
  • the first content identification and the second content identification do not match.
  • the first content identifier is a game application identifier and the second content identifier is also a game application identifier
  • the first content identifier and the second content identifier match.
  • the content identifier indicates an object in the content, and the object may be a character or other items. For example, if the first content identification indicates the character Jack and the second content identification indicates the character Brown, the first content identification and the second content identification do not match. If the first content identifier refers to character Brown, and the second content identifier also refers to character Brown, the first content identifier and the second content identifier match.
  • the above four scenarios are used to instruct a device with a display screen to automatically recognize that it needs to enter a split-screen mode, and display the first content and the second content in different display areas respectively.
  • a device with a display screen can also provide a control for the user to select, so that the user can automatically choose whether to enter the split-screen mode, so as to display the first content in the first display area in the split-screen mode, and display the first content in the second display area.
  • the second content is displayed in . See the scenarios manually selected by the user below.
  • Step e1 displaying a split screen button in response to the second content projection request.
  • Step e2 in response to the split screen button being triggered, the first content is played in the first display area, and the second content is played in the second display area.
  • a device with a display screen can display a split-screen button when receiving a content projection request from the second device.
  • the split-screen button may be displayed on a display screen of a device having a display screen.
  • the user can use the remote control device to trigger the split screen button, and when the split screen button is triggered, the device with the display screen will play the first content in the first display area and the second content in the second display area.
  • the device with the display screen can also display the shutdown control, and when the user triggers the shutdown control, the device with the display screen will stop displaying the split screen button.
  • a device with a display screen can first receive a first content projection request from the first device, and display the first content corresponding to the first device in full screen when the request meets the preset conditions. Then, the device with the display screen automatically recognizes the importance of the second content or the security of the second device that projects the second content in various ways. When the second content is more important or the second device is relative to the device with the display When it is relatively safe, the device with the display screen automatically enters the split-screen mode, and displays the first content and the second content at the same time, which improves the intelligence of the device with the display screen and reduces the need for the user to display the first content and the second content at the same time. The required operation improves the convenience of simultaneously casting multiple devices on one device.
  • the device with a display screen can determine whether to automatically perform split-screen display according to the time length of the reference duration between the time when the first content and the second content start to be screened.
  • the time when the first content and the second content start to be projected on the device with a display screen is not long, it means that the correlation between the two contents is high enough, and the device with a display screen will automatically enter the split-screen state.
  • the first content and the second content are displayed at the same time, so that the device with a display screen can intelligently determine whether to display the first content and the second content at the same time from the screen projection behavior.
  • the device with the display screen can confirm the degree of intimacy between the second device and the device with the display screen by using the historical screencast information of the second device.
  • the device with the display screen will automatically enter the split-screen state, and display the first content and the second content at the same time, which improves the device with the display screen. Capability of the first content and the second content.
  • the device with the display screen can also decide whether to automatically enter the split screen state according to the similarity between the first content and the second content in the image, so as to display the first content and the second content at the same time.
  • the similarity between the first content and the second content on the image is relatively large, it indicates that the first content and the second content have a strong correlation, and the user is more likely to view and compare the two at the same time. Therefore, in this scenario, a device with a display screen can automatically enter a split-screen state, so as to display the first content and the second content at the same time.
  • a device with a display screen can also determine whether to enter the split-screen state according to whether the first content identifier matches the second content identifier.
  • the device with the display screen automatically enters the split-screen state and simultaneously the first content and the second content, so that when the contents displayed by multiple devices are related, the device with the display screen automatically displays the first content and the second content at the same time.
  • the embodiments of the present application can also be applied to scenarios in which a mobile device answers and an invigilator device monitors the mobile device.
  • the device with a display screen is a monitoring device
  • both the first device and the second device are devices that display exam papers and are used by candidates.
  • FIG. 8 please refer to the content shown in FIG. 8 .
  • FIG. 8 is a flowchart of a method for cross-device content screen projection applied in an exam proctoring scenario provided by an embodiment of the present application.
  • the method involved in FIG. 8 can be implemented by the device with a display screen shown in FIG. 1 , the details are as follows:
  • Step 811 start the device with the display screen, and the device with the display screen is the monitoring device of the examination room.
  • the device with the display screen is the monitoring device in the test room, and the invigilator can use the device with the display screen to understand the content displayed on the test equipment used by the candidates during the test.
  • the application may include one first device and several second devices.
  • the first device is the first device that casts the screen to the device with the display screen
  • the second device is the device that casts the screen to the device with the display screen after the first device completes the screen cast.
  • the monitoring device can provide a radio frequency card, and the radio frequency card is a screen-casting label.
  • the first device, the second device, etc. can approach the radio frequency card to read information from the radio frequency card to generate the first character string or the second character string.
  • each test room is equipped with one radio frequency card, and candidates who take the test in the test room use their own test equipment to scan the radio frequency card.
  • the radio frequency card can be set on each candidate's seat with a radio frequency card.
  • Step 812 Receive a first content projection request sent by the first device.
  • the first device after reading the information from the radio frequency card and generating the second character string, the first device will place the second character string in the first content projection request, and send the second character string to the first device.
  • a content projection request after reading the information from the radio frequency card and generating the second character string, the first device will place the second character string in the first content projection request, and send the second character string to the first device.
  • the device with the display screen receives the first content projection request sent by the first device.
  • Step 813 Play the first content in response to matching the first character string in the first content projection request with the character string template.
  • the device with the display screen can read the first character string from the content projection request, and play the first content when the first character string matches the character string template.
  • the first content is content displayed on the screen of the first device. That is, the content displayed in real time in the first device will be synchronously projected to the device with a display screen for display.
  • Step 814 Receive a second content projection request sent by the second device.
  • Step 815 in response to matching the second string in the second content screen projection request with the string template, play the first content and the second content at the same time.
  • a device with a display screen can correspond to one first device and several second devices.
  • the number of the second devices may be 7, 9, 15, or 19 or the like.
  • the device with the display screen will simultaneously display the first content and the second content.
  • candidates use the first device or the second device to answer the exam questions.
  • the invigilator can view the first content and several second content simultaneously in a device with a display screen, so as to view the answering interface viewed by the examinee in real time.
  • Step 821 in response to the abnormal image included in the first content and/or the second content, record the abnormal image and the time when the abnormal image is displayed.
  • the device with the display screen is capable of performing image recognition on images in the first content and/or the second content.
  • a device with a display screen can perform image recognition frame by frame.
  • a device with a display screen can recognize images in the same content every N frames. For example, a device with a display screen performs image recognition on the image frames in the first content, and takes 30 frames of images as a group of images.
  • a device with a display screen can perform image recognition on the first image frame in a set of images.
  • a normal image template can be preset in a device with a display screen.
  • the device with the display screen compares the image frame obtained from the first content or the second content with the image template.
  • the similarity is higher than the preset threshold, it indicates that the image frame belongs to a normal image; when the similarity is equal to or lower than the preset threshold, it indicates that the image frame belongs to an abnormal image.
  • the application to which the abnormal image belongs does not belong to the whitelist application list.
  • a device with a display screen can maintain a whitelist application list, and the application identifiers related to the exam will be included in the whitelist application list.
  • the identifiers of the applications to which the first content or the second content belongs belong to the whitelisted application list. If candidates use other applications, they will be captured by the device with a display screen for the first time. It should be noted that, each image frame in the first content or the second content acquired by the device with the display screen corresponds to the identifier of the application to which it belongs.
  • apps belonging to the whitelisted app list include A exam app and B calculator app.
  • the device with the display screen recognizes that there is an application in the first content to which an image frame belongs to neither the A test application nor the B calculator application, it is determined that the first content is content including an abnormal image.
  • the device with a display screen may continue to perform step 822.
  • Step 822 highlighting the content including the abnormal image, and the highlighting includes at least one of highlighting, displaying a preset mark, or displaying a preset text.
  • the device with a display screen may highlight the content including the abnormal image.
  • the first content in the first device includes an abnormal image
  • the device with a display screen highlights the first content when displaying the first content.
  • An optional highlighting manner includes, but is not limited to, highlighting an area, or attaching a preset mark to the first content, or attaching a preset text to the first content. The embodiment of the present application does not limit the specific highlighting manner.
  • Step 830 Send a lock signal to the device with the abnormal image, where the lock signal is used to instruct the device with the abnormal image to stop receiving the input signal.
  • the device with the display screen can also send a lock signal to the device with the abnormal image, so that the device with the abnormal image can no longer receive the input signal under the action of the lock signal.
  • the equipment with a display screen can directly lock the corresponding examination equipment when other equipment of the invigilator is abnormal, so as to strictly deal with the abnormal phenomenon of the examination, and realize the user's daily use of the equipment for paperless examination. And can receive the effect of strict supervision.
  • the methods provided in the embodiments of the present application can be applied in the invigilation scenario of paperless examinations, and can achieve the effect of candidates using their daily mobile devices to take the examination, and can achieve a relatively strict invigilation effect, reducing the cost of examination.
  • the device with the display screen in addition to simultaneously displaying the first content and the second content, can also control the displayed content.
  • the device with the display screen can also control the displayed content.
  • FIG. 9 is a flowchart of a method for cross-device content screen projection provided by an embodiment of the present application.
  • the method can be applied in a device with a display screen as shown in Figure 1.
  • the method includes:
  • Step 911 Receive a first content projection request sent by the first device.
  • Step 912 Play the first content in response to matching the first character string in the first content projection request with the character string template.
  • Step 913 Receive a second content projection request sent by the second device.
  • Step 914 in response to matching the second string in the second content screen projection request with the string template, play the first content and the second content at the same time.
  • Step 921 receiving local area information.
  • the local area information is used to indicate the information of a local area in the first device, or the information of a local area in the second device.
  • Step 922 in response to the local area information, magnify the area corresponding to the local area information by k times.
  • a device with a display screen can magnify the area corresponding to the local area information, so that the user can more easily observe the area he is more concerned about.
  • Step 923 in the display area corresponding to the local area information, display the area corresponding to the local area information enlarged by k times.
  • a device with a display screen can zoom in and display a local area in the first content under the control of the user.
  • the local area information is information sent by the first device to a device having a display screen.
  • the local area information is information sent by a remote control device corresponding to the device with a display screen.
  • the device with the display screen When the device with the display screen obtains the local area information, the device with the display screen will determine the area corresponding to the local area information. And, the image originally displayed in this area is enlarged by k times and displayed. If the display area corresponding to the partial area information is the first display area, the device with the display screen displays the area corresponding to the partial area information enlarged by k times in the first display area. If the display area corresponding to the local area information is the second display area, the device with the display screen displays the area corresponding to the local area information enlarged by k times in the second display area.
  • FIG. 10 is a schematic display diagram of a device with a display screen provided based on the embodiment shown in FIG. 9 .
  • the device 111 with a display screen includes a first display area 210 and a second display area 220 .
  • a first partial display area 211 is included in the first display area 210 .
  • the local area information is used to indicate the first local display area 211 .
  • the device 111 having the display screen displays the image enlarged by k times in the second partial display area 212 .
  • the device with the display screen can further enlarge and display the small map in the area, so that the user can see the details of the content of interest in more detail.
  • a device with a display screen can magnify a corresponding partial area in the second content by k times. For example, if the second content is the same as the first content, and the game interface is also displayed, the device with the display screen can display the minimap in the first content and the minimap in the first device in an area that is close to each other, It is convenient for the user to compare the determined portion of the first content and the second content directly from a device having a display screen.
  • Step 931 Perform image recognition on the first content to obtain a first text matching a preset keyword.
  • Step 932 Perform image recognition on the second content to obtain second text matching the preset keyword.
  • Step 933 compare and display the first text and the second text.
  • a device with a display screen can perform image recognition on the first content and the second content, and obtain text information therein.
  • the device with the display screen compares the first text and the second text and displays them together.
  • the preset keyword is a keyword set in a device with a display screen.
  • the first text is displayed in the first display area
  • the second text is displayed in the second display area
  • the distance between the first text and the second text is less than a fifth threshold.
  • the first text and the second text are displayed in a contrast area, which is an area spanning the first display area and the second display area.
  • the division algorithms of the first text and the second text are the same. For example, if the first text is a sentence, the second text is also a sentence. If the first text is a paragraph, the second text is also a paragraph.
  • the first content is a shopping page in the shopping application S2 for commodity A
  • the second content is a shopping page in the shopping application S3 for commodity A.
  • the preset keyword is "actual price”.
  • the first text extracted from the first content by the device with a display screen is "actual price: 224 yuan”
  • the second text extracted by the first device from the second content is "actual price: 206 yuan”.
  • the device with the display screen simultaneously displays the first text and the second text at the position where the first display area and the second display area meet, so that the user can directly compare the most concerned information.
  • FIG. 11 is a schematic diagram of a display interface of a device with a display screen provided based on the embodiment shown in FIG. 9 .
  • the display area of the device 111 with the display screen includes a first display area 210 and a second display area 220 .
  • the first display area 210 includes a first contrast display area 213
  • the second display area 220 includes a second contrast display area 221 .
  • the device 111 with a display screen may display the first text 11A extracted from the first content in the first comparison display area 213
  • the device 111 with a display screen may also display the text in the second content in the second comparison display area 221 .
  • the extracted second text 11B enables the user to intuitively compare the part of the first content and the second content that the user is more concerned about.
  • both the first content and the second content displayed in FIG. 11 are commodity basketballs, and the extracted information includes price, sales volume, and the name of the store they belong to.
  • devices with a display can also highlight less expensive text.
  • Step 941 Receive a first commodity extraction command sent by the first device.
  • the first commodity extraction command is used to extract the commodity specified in the first content.
  • Step 942 in response to the first commodity extraction command, extract and store the corresponding first commodity.
  • Step 943 Receive a second commodity extraction command sent by the second device.
  • the second commodity extraction command is used to extract the commodity specified in the second content.
  • Step 944 in response to the second commodity extraction command, extract and store the corresponding second commodity.
  • Step 945 Receive the aggregation instruction, and send the stored first commodity and the second commodity to the device that issued the aggregation instruction.
  • the device issuing the summary instruction is the first device or the second device.
  • the first device and the second device can respectively select commodities to be extracted from the content that has been projected onto the device with the display screen.
  • the item can be text, image or link.
  • the first item and the second item are items of the same type, which is the target type.
  • the present application can also extract objects such as attractions, commodities, restaurants, shopping malls, stars, movie names, concerts, or pages.
  • a corresponding policy may also be executed according to different object types. For example, when the target type is a scenic spot, the device with the display screen automatically generates a travel route, and sends the travel route to the first device or the second device.
  • the device with the display screen automatically compares the lowest-priced commodity among the commodities that have been extracted, and sends an additional purchase instruction to the first device or the second device. Instructions are used to instruct the item to be added to the shopping cart in the shopping application.
  • a device with a display screen can enlarge the content that needs to be enlarged at the same time in the first content that has been projected and displayed and the second content that needs to be enlarged at the same time, so as to effectively display the area that the user pays attention to.
  • Ability can enlarge the content that needs to be enlarged at the same time in the first content that has been projected and displayed and the second content that needs to be enlarged at the same time, so as to effectively display the area that the user pays attention to.
  • the device with a display screen can also perform image recognition on the first content and the second content, and the texts containing the text matching the preset keywords are displayed together, which reduces the need for users to compare the two contents at the same time.
  • the difficulty of focused information increases the efficiency of comparing content displayed in multiple other devices in a device with a display screen.
  • a device with a display screen can also extract and store corresponding objects under the control of the first device and the second device, respectively, and the first device and the second device can select objects in their respective devices.
  • the ability of multiple devices to jointly select objects is realized in the scenario where a device with a display screen displays a reference.
  • FIG. 12 is a structural block diagram of a cross-device content screen projection apparatus provided by an exemplary embodiment of the present application.
  • the cross-device content projection device can be implemented by software, hardware or a combination of the two to become all or a part of a device with a display screen.
  • the device includes:
  • the first receiving module 1210 is configured to receive a first content projection request sent by a first device, where the first content projection request is that the first device performs a preset interactive operation to the device with a display screen the request sent;
  • a first playing module 1220 configured to play the first content in response to the first content projection request, where the first content is the content played in the first device;
  • the second receiving module 1230 is configured to receive a second content screen projection request sent by the second device, where the second content screen projection request is that the second device performs the preset interactive operation to the screen with the display screen the request sent by the device;
  • the second playing module 1240 is configured to play the first content and the second content in a split-screen mode in response to the second content projection request, where the second content is the content played on the second device.
  • the preset interactive operation involved in the apparatus includes scanning a screen projection label, where the screen projection label is an electronic label corresponding to the device with a display screen; or, the preset The interactive operation includes shooting a preset gesture; or, the preset interactive operation includes shooting a preset action.
  • the apparatus further includes a third receiving module and a split-screen module, the third receiving module is configured to receive a split-screen instruction; the split-screen module is configured to respond to the split screen screen instruction, enter the split-screen mode, and the display screen of the device with the display screen includes at least a first display area and a second display area in the split-screen mode; wherein, the first display area is used for displaying The first content and the second display area are used to display the second content.
  • the second playback module 1240 is configured to obtain split-screen information in response to the second content projection request; and enter the A split-screen mode, in which the display screen of the device with a display screen includes at least a first display area and a second display area, the first content is played in the first display area, and the second display area is played in the second display area. The second content is played in the display area.
  • the second playback module 1240 is configured to, in response to the second content projection request, acquire the projection time of the first device and the projection time of the second device a reference duration between; and in response to the reference duration being less than a first threshold, the first content is played in the first display area, and the second content is played in the second display area.
  • the second playback module 1240 is configured to, in response to the second content projection request, acquire historical projection information of the second device, where the historical projection information includes all at least one of the number of screen projections or the cumulative duration of screen projections that the second device successfully projected to the device with a display screen; in response to the number of screen projections being greater than or equal to the second threshold, the first display Play the first content in the second display area, and play the second content in the second display area; or, in response to the cumulative duration of the screen projection being greater than or equal to a third threshold, in the first display area The first content is played, and the second content is played in the second display area.
  • the second playback module 1240 is configured to, in response to the second content projection request, acquire the first image information in the first content according to a preset policy, and The preset strategy acquires the second image information in the second content; in response to the similarity between the first image information and the second image information being greater than or equal to a fourth threshold, the first display The first content is played in the display area, and the second content is played in the second display area.
  • the second playback module 1240 is configured to, in response to the second content projection request, obtain a first content identifier corresponding to the first content and a corresponding first content identifier of the second content a second content identifier; in response to a match between the first content identifier and the second content identifier, play the first content in the first display area, and play the first content in the second display area Two content.
  • the apparatus further includes a button display module, configured to display a split-screen button in response to the second content projection request; the second playback module 1240, configured to respond to the second content projection request
  • the split-screen button is triggered to enter the split-screen mode, and the display screen of the device with the display screen includes at least a first display area and a second display area in the split-screen mode.
  • the apparatus further includes an abnormality recording module and a highlighting module, and the abnormality recording module is configured to respond to the abnormality image included in the first content and/or the second content, Record the abnormal image and the time when the abnormal image is displayed, and the application to which the abnormal image belongs does not belong to the whitelist application list; the highlighting module is used for highlighting the content including the abnormal image, the highlighting The display manner includes at least one of highlighting, displaying preset marks, or displaying preset text.
  • the apparatus further includes a device locking module, configured to send a locking signal to the device where the abnormal image occurs, where the locking signal is used to instruct the device where the abnormal image occurs to stop receiving input signal.
  • a device locking module configured to send a locking signal to the device where the abnormal image occurs, where the locking signal is used to instruct the device where the abnormal image occurs to stop receiving input signal.
  • the apparatus further includes a fourth receiving module, a partial amplifying module, and a partial display module, the fourth receiving module is configured to receive partial area information, and the partial area information is used to indicate the the information of a local area in the first device, or the information of a local area in the second device; the local amplifying module is used for responding to the local area information, corresponding to the local area information The area of is magnified by k times, and k is greater than 1; the local display module is configured to display the area corresponding to the local area information after magnification k times in the display area corresponding to the local area information, wherein, when the When the local area information is used to indicate a local area in the first content, the display area corresponding to the local area information is the first display area; when the local area information is used to indicate a local area in the second content In the case of a local area, the display area corresponding to the local area information is the second display area.
  • the apparatus further includes a first identification module, a second identification module and a sticking display module, and the first identification module is configured to perform image identification on the first content, and obtain an image corresponding to the first content.
  • the first text matched by a preset keyword, where the preset keyword is a keyword set in the device with a display screen;
  • the second recognition module is used to perform image recognition on the second content, and obtain the second text matching the preset keyword;
  • the comparison display module is configured to compare and display the first text and the second text.
  • the apparatus further includes a fifth receiving module, a first processing module, a sixth receiving module, a second processing module and a third processing module;
  • the fifth receiving module is configured to receive all the The first commodity extraction command sent by the first device, the first commodity extraction command is used to extract the commodity specified in the first content;
  • the first processing module is used for responding to the first object extraction command, extracting and store the corresponding first commodity;
  • the sixth receiving module is configured to receive a second commodity extraction command sent by the second device, and the second commodity extraction command is used to extract the commodity specified in the second content ;
  • the second processing module is used to extract and store the corresponding second commodity in response to the second commodity extraction command;
  • the third processing module is used to receive the summary instruction, and store the stored first commodity and the second commodity is sent to the device that issued the aggregation instruction, the device that issued the aggregation instruction is the first device or the second device.
  • the first commodity and the second commodity involved in the device are commodities belonging to the same shopping application
  • the summary instruction includes the first commodity and the second commodity The identifier of the shopping application to which the commodities commonly correspond.
  • FIG. 13 is a structural block diagram of a device with a display screen provided by an exemplary embodiment of the present application.
  • the device with a display screen includes a processor 1320, a memory 1340, a communication component 1360 and Display screen 1380, the memory 1340 stores at least one instruction, the instruction is loaded and executed by the processor 1320 to implement the cross-device content screen projection method described in the various method embodiments of this application.
  • Processor 1320 may include one or more processing cores.
  • the processor 1320 uses various interfaces and lines to connect various parts of the entire device 1300 with a display screen, by running or executing the instructions, programs, code sets or instruction sets stored in the memory 1340, and calling the stored in the memory 1340. data, perform various functions of the device 1300 with a display screen and process data.
  • the processor 1320 may adopt at least one of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). A hardware form is implemented.
  • DSP Digital Signal Processing
  • FPGA Field-Programmable Gate Array
  • PLA programmable logic array
  • the processor 1320 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like.
  • CPU Central Processing Unit
  • GPU Graphics Processing Unit
  • the CPU mainly handles the operating system, user interface, and application programs
  • the GPU is used to render and draw the content that needs to be displayed on the display screen
  • the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 1320, but is implemented by a single chip.
  • the memory 1340 may include a random access memory (Random Access Memory, RAM), or may include a read-only memory (Read-Only Memory, ROM).
  • the memory 1340 includes a non-transitory computer-readable storage medium.
  • Memory 1340 may be used to store instructions, programs, codes, sets of codes, or sets of instructions.
  • the memory 1340 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions, etc., used to implement the following method embodiments; the storage data area can store data and the like involved in the following method embodiments.
  • the communication component 1360 is configured to establish a communication connection with other devices through a specified communication protocol, and the communication connection includes WiFi, Bluetooth, ZigBee and other communication protocols, and the embodiment of the present application does not limit the communication protocol.
  • the communication component 1360 of the device with a display screen 1300 can be used to establish a communication connection with multiple devices simultaneously.
  • the display screen 1380 is used to display the image rendered by the processor.
  • the display screen 1380 may be a large-sized TV screen.
  • the TV screen can be 30 inches, 32 inches, 34 inches, 40 inches, 42 inches, 48 inches, 55 inches, 60 inches, 65 inches, or 100 inches.
  • the display screen 1380 may be implemented in sizes such as 18 inches, 20 inches, 22 inches, 24 inches, or 32 inches.
  • Embodiments of the present application further provide a computer-readable medium, where at least one instruction is stored in the computer-readable medium, and the at least one instruction is loaded and executed by the processor to implement the cross-device communication in each of the foregoing embodiments.
  • Content projection method
  • cross-device content screen projection device when the cross-device content screen projection device provided in the above embodiments executes the cross-device content screen projection method, only the division of the above functional modules is used as an example for illustration.
  • the function distribution is completed by different function modules, that is, the internal structure of the device is divided into different function modules to complete all or part of the functions described above.
  • the cross-device content screen projection device provided in the above embodiments and the cross-device content screen projection method embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

Abstract

本申请实施例公开了一种跨设备的内容投屏方法、装置、设备及存储介质,属于内容分享技术领域。由于具有显示屏的设备能够先后接收第一设备和第二设备发送的内容投屏请求,并能分屏显示第一内容和第二内容。其中,第一设备和第二设备均是在执行预设交互操作后向具有显示屏的设备发送相应的内容投屏请求。因此,本申请能够降低具有显示屏的设备同时显示多个设备投屏的内容的操作复杂度,并提高了多设备投屏的效率。

Description

跨设备的内容投屏方法、装置、设备及存储介质
本申请要求于2020年11月20日提交的申请号为202011311456.1、发明名称为“跨设备的内容投屏方法、装置、设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及内容分享技术领域,特别涉及一种跨设备的内容投屏方法、装置、设备及存储介质。
背景技术
随着智能设备技术的快速发展,多人使用各自的设备进行互动的场景也日益增多。
相关技术中,多个用户既可以使用各自的设备进行同一局游戏,也可以在各自的设备登录不同的购物应用,对同一个商品进行比价。在上述场景中,若处于同一个房间的用户想同时查看自己的设备以及对方的设备,则需要两个用户处于互相靠近的位置以便来回查看自己的设备以及对方的设备。
发明内容
本申请实施例提供了一种跨设备的内容投屏方法、装置、设备及存储介质。所述技术方案如下:
根据本申请的一方面内容,提供了一种跨设备的内容投屏方法,应用于具有显示屏的设备中,所述方法包括:
接收第一设备发送的第一内容投屏请求,所述第一内容投屏请求是所述第一设备在执行预设交互操作后向所述具有显示屏的设备发送的请求;
响应于所述第一内容投屏请求,播放第一内容,所述第一内容是所述第一设备中播放的内容;
接收第二设备发送的第二内容投屏请求,所述第二内容投屏请求是所述第二设备在执行所述预设交互操作后向所述具有显示屏的设备发送的请求;
响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
根据本申请的另一方面内容,提供了一种跨设备的内容投屏装置,应用于具有显示屏的设备中,所述装置包括:
第一接收模块,用于接收第一设备发送的第一内容投屏请求,所述第一内容投屏请求是所述第一设备在执行预设交互操作后向所述具有显示屏的设备发送的请求;
第一播放模块,用于响应于所述第一内容投屏请求,播放所述第一内容,所述第一内容是所述第一设备中播放的内容;
第二接收模块,用于接收第二设备发送的第二内容投屏请求,所述第二内容投屏请求是所述第二设备在执行所述预设交互操作后向所述具有显示屏的设备发送的请求;
第二播放模块,用于响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
根据本申请的另一方面内容,提供了一种跨设备的内容投屏系统,所述系统包括具有显示屏的设备、第一设备、至少一个第二设备和遥控设备,所述遥控设备中包括投屏标签,且所述遥控设备用于遥控所述具有显示屏的设备;
所述第一设备,用于扫描所述投屏标签中的信息;
所述第一设备,用于在扫描所述投屏标签中的信息后向所述具有显示屏的设备发送第一内容投屏请求;
所述具有显示屏的设备,用于接收所述第一内容投屏请求;
所述具有显示屏的设备,用于响应于所述第一内容投屏请求,播放第一内容,所述第一内容是所述第一设备中播放的内容;
所述第二设备,用于扫描所述投屏标签中的信息;
所述第二设备,用于在扫描所述投屏标签中的信息后向所述具有显示屏的设备发送第二内容投屏请求;
所述具有显示屏的设备,用于接收所述第二内容投屏请求;
所述具有显示屏的设备,用于响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
根据本申请的另一方面内容,提供了一种跨设备的内容投屏系统,所述系统包括具有显示屏的设备、第一设备和至少一个第二设备,所述第一设备包括第一图像采集组件,所述第二设备包括第二图像采集组件;
所述第一设备,用于通过所述第一图像采集组件拍摄预设手势或预设动作;
所述第一设备,用于在拍摄所述预设手势或所述预设动作后向所述具有显示屏的设备发送第一内容投屏请求;
所述具有显示屏的设备,用于接收所述第一内容投屏请求;
所述具有显示屏的设备,用于响应于所述第一内容投屏请求,播放第一内容,所述第一内容是所述第一设备中播放的内容;
所述第二设备,用于通过所述第二图像采集组件拍摄所述预设手势或所述预设动作;
所述第二设备,用于在拍摄所述预设手势或所述预设动作后向所述具有显示屏的设备发送第二内容投屏请求;
所述具有显示屏的设备,用于接收所述第二内容投屏请求;
所述具有显示屏的设备,用于响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
根据本申请的另一方面内容,提供了一种电子设备,所述电子设备包括处理器和存储器,所述存储器中存储有至少一条指令,所述指令由所述处理器加载并执行以实现如本申请各个方面提供的跨设备的内容投屏方法。
根据本申请的另一方面内容,提供了一种计算机可读存储介质,所述存储介质中存储有至少一条指令,所述指令由处理器加载并执行以实现如本申请各个方面提供的跨设备的内容投屏方法。
根据本申请的一个方面,提供了一种计算机程序产品,该计算机程序产品包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行上述跨设备的内容投屏方面的各种可选实现方式中提供的方法。
附图说明
图1是本申请实施例提供的一种跨设备的内容投屏的实施环境的示意图;
图2是基于图1所示实施例提供的一种具有显示屏的设备的分屏模式的示意图;
图3是基于图2所示实施例提供的一种读取射频标签的示意图;
图4是本申请一个示例性实施例提供的跨设备的内容投屏方法的流程图;
图5是本申请另一个示例性实施例提供的一种跨设备的内容投屏方法流程图;
图6是基于图5所示的实施例提供的一种跨设备的内容投屏方法的应用示意图;
图7是本申请另一个示例性实施例提供的一种跨设备的内容投屏方法流程图;
图8是本申请实施例提供的一种应用于监考场景的跨设备的内容投屏方法流程图;
图9是本申请实施例提供的一种跨设备的内容投屏的方法流程图;
图10是基于图9所示实施例提供的一种具有显示屏的设备的显示示意图;
图11是基于图9所示实施例提供的一种具有显示屏的设备的显示界面的示意图;
图12是本申请一个示例性实施例提供的一种跨设备的内容投屏装置的结构框图;
图13是本申请一个示例性实施例提供的具有显示屏的设备的结构框图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。
本申请提供一种跨设备的内容投屏方法,其中,应用于具有显示屏的设备中,所述方法包括:接收第一设备发送的第一内容投屏请求,所述第一内容投屏请求是所述第一设备在执行预设交互操作后向所述具有显示屏的设备发送的请求;响应于所述第一内容投屏请求,播放第一内容,所述第一内容是所述第一设备中播放的内容;接收第二设备发送的第二内容投屏请求,所述第二内容投屏请求是所述第二设备在执行所述预设交互操作后向所述具有显示屏的设备发送的请求;响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
可选地,所述预设交互操作包括扫描投屏标签,所述投屏标签是所述具有显示屏的设备对应的电子标签;或,所述预设交互操作包括拍摄预设手势;或,所述预设交互操作包括拍摄预设动作。
可选地,所述接收第一设备发送的第一内容投屏请求之前,还包括:接收分屏指令;响应于所述分屏指令,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域;其中,所述第一显示区域用于显示所述第一内容,所述第二显示区域用于显示所述第二内容。
可选地,所述响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,包括:响应于所述第二内容投屏请求,获取分屏信息;响应于所述分屏信息符合预设条件,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域;在所述第一显示区域中播放所述第一内容,并在所述第二显示区域中播放所述第二内容。
可选地,所述响应于所述第二内容投屏请求,获取分屏信息,包括:响应于所述第二内容投屏请求,获取所述第一设备的投屏时刻和所述第二设备的投屏时刻之间的参考时长;所述响应于所述分屏信息符合预设条件,进入所述分屏模式,包括:响应于所述参考时长小于第一阈值,进入所述分屏模式。
可选地,所述响应于所述第二内容投屏请求,获取分屏信息,包括:响应于所述第二内容投屏请求,获取所述第二设备的历史投屏信息,所述历史投屏信息包括所述第二设备成功向所述第一设备投屏的投屏次数或投屏累计时长中至少一种信息;所述响应于所述分屏信息符合预设条件,进入所述分屏模式,包括:响应于所述投屏次数大于或等于第二阈值,进入所述分屏模式;或,响应于所述投屏累计时长大于或等于第三阈值,进入所述分屏模式。
可选地,所述响应于所述第二内容投屏请求,获取分屏信息,包括:响应于所述第二内容投屏请求,获取所述第一内容中的第一图像信息,并获取所述第二内容中的第二图像信息;所述响应于所述分屏信息符合预设条件,进入所述分屏模式,包括:响应于所述第一图像信息和所述第二图像信息之间的相似度大于或等于第四阈值,进入所述分屏模式。
可选地,所述响应于所述第二内容投屏请求,获取分屏信息,包括:响应于所述第二内容投屏请求,获取所述第一内容对应的第一内容标识和所述第二内容对应的第二内容标识;所述响应于所述分屏信息符合预设条件,进入所述分屏模式,包括:响应于所述第一内容标识和所述第二内容标识匹配,进入所述分屏模式。
可选地,在所述接收第二设备发送的第二内容投屏请求之后,所述方法还包括:响应于所述第二内容投屏请求,显示分屏按钮;响应于所述分屏按钮被触发,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域。
可选地,所述方法还包括:响应于所述第一内容和/或所述第二内容中包括异常图像,记录所述异常图像和所述异常图像显示的时刻,所述异常图像所属的应用不属于白名单应用列表;将包括所述异常图像的内容突出显示,所述突出显示的方式包括高亮、显示预设标记或显示预设文本中至少一种。
可选地,所述方法还包括:向出现所述异常图像的设备发送锁定信号,所述锁定信号用于指示所述出现所述异常图像的设备停止接收输入信号。
可选地,在所述采用分屏模式播放所述第一内容和所述第二内容之后,所述方法还包括:接收局部区域信息,所述局部区域信息用于指示所述第一内容中的一个局部区域,或,所述第二内容中的一个局部区域;响应于所述局部区域信息,将所述局部区域信息指示的区域放大k倍,k大于1;在所述局部区域信息对应的显示区域中,显示放大k倍后的所述局部区域信息对应的区域;其中,当所述局部区域信息用于指示所述第一内容中的一个局部区域时,所述局部区域信息对应的显示区域是第一显示区域;当所述局部区域信息用于指示所述第二内容中的一个局部区域时,所述局部区域信息对应的显示区域是第二显示区域。
可选地,所述方法还包括:对所述第一内容进行图像识别,得到与预设关键字匹配的第一文本,所述预设关键字是所述具有显示屏的设备中设置的关键字;对所述第二内容进行图像识别,得到与所述预设关键字匹配的第二文本;将所述第一文本和所述第二文本进行对比显示。
可选地,所述方法还包括;接收所述第一设备发送的第一商品提取命令,所述第一商品提取命令用于提取所述第一内容中指定的商品;响应于第一对象提取命令,提取并存储对应的第一商品;接收所述第二设备发送的第二商品提取命令,所述第二商品提取命令用于提取所述第二内容中指定的商品;响应于所述第二商品提取命令,提取并存储对应的第二商品;接收汇总指令,将存储的所述第一商品和所述第二商品发送至发出所述汇总指令的设备,所述发出所述汇总指令的设备是所述第一设备或所述第二设备。
可选地,所述第一商品和所述第二商品是属于相同购物应用的商品,所述汇总指令中包含所述第一商品和所述第二商品共同对应的所述购物应用的标识。
在本申请中,由于具有显示屏的设备能够先后接收第一设备和第二设备发送的内容投屏请求,并能分屏显示第一内容和第二内容。其中,第一设备和第二设备均是在执行预设交互操作后向具有显示屏的 设备发送相应的内容投屏请求。因此,本申请能够降低具有显示屏的设备同时显示多个设备投屏的内容的操作复杂度,并提高了多设备投屏的效率。
为了本申请实施例所示方案易于理解,下面对本申请实施例中出现的若干名词进行介绍。
第一内容投屏请求:是第一设备发送给具有显示屏的设备的信息,用于请求将第一设备中播放的第一内容在具有显示屏的设备中播放。在一种可能的方式中,该第一内容投屏请求可以是符合固定格式的字符串,该字符串中包含关键字和字符内容。
可选地,当预设交互操作是扫描投屏标签,投屏标签是具有显示屏的设备对应的电子标签。字符内容中可以包括第一字符串,该第一字符串是第一设备读取到的信息,该信息是存储在遥控设备的投屏标签中的信息,投屏标签是用于遥控具有显示屏的设备中的标签。例如,第一设备中设备有NFC(Near Field Communication,进场通信)模块。在贴近具有显示屏的设备的遥控器时,第一设备能够读取遥控器中的NFC标签中的第一字符串。在另一种描述方式中,遥控器中的NFC标签中存储的是ID(Identity Document,身份标识号),第一设备中的NFC模块读取遥控器中的ID,将其作为第一字符串。
在另一种可能的方式中,第一设备中有RFID(Radio Frequency Identification,射频识别)模块。在RFID模块贴近具有显示屏的设备的遥控器时,RFID模块能够读取遥控器的RFID标签中的第一字符串。
需要说明的是,具有显示屏的设备的遥控设备中除了上述NFC标签和RFID标签,还可以实现为其它近距离射频识别标签。对应的,第一设备中可以设置相应的近距识别模块。比如,具有显示屏的设备的遥控设备中设置遵循A协议的射频识别标签,则第一设备中可以设置遵循A协议的射频识别模块,该射频识别模块具备读取射频识别中的信息的能力。
可选地,当预设交互操作包括拍摄预设手势,或者,预设交互操作包括拍摄预设动作时,第一内容投屏请求能够从预设应用中获取第一字符串。也即,当第一设备通过第一图像采集组件拍摄到预设手势或者拍摄到预设动作时,第一设备能够启动预设应用并从预设应用中获取第一字符串。或者,第一设备能够在预设应用处于启动状态时,从该预设应用中获取第一字符串。需要说明的是,第二设备获取第二字符串的过程与第一设备获取第一字符串的过程类似,本处不再赘述。
第二内容投屏请求:是第二设备发送给具有显示屏的设备的信息,用于请求将第二设备中播放的第二内容在具有显示屏的设备中继续播放。在一种可能的方式中,该第二内容投屏请求可以是符合固定格式的字符串,该字符串中包含关键字和字符内容。
可选地,字符内容中可以包括第二字符串,该第二字符串是第二设备从用于遥控具有显示屏的设备的遥控设备的投屏标签中读取到的信息。其中,第二设备中设置的射频模块可以和第一设备中设置的射频模块是同一类型的模块。换言之,第二设备中设置的射频模块可以和第一设备中设置的射频模块是符合同一射频协议的模块。
字符串模版:设置在具有显示屏的设备中的字符串。在一种可能的方式中,字符串模版和具有显示屏的设备对应的遥控设备中预留的字符串相同。第一设备和第二设备在正确读取遥控设备中的预留的字符串时,所述第一设备中的第一字符串、所述第二设备中的第二字符串以及字符串模版则为相同的字符串。
例如,遥控设备中预留的字符串是“abcdef1234”且字符串模版也是“abcdef1234”。当第一设备贴靠遥控设备,通过射频模块读取预留的字符串后,生成的第一字符串是“abcdef1234”,则具有显示屏的设备通过第一字符串和字符串模版相同时,能够通过验证,在具有显示屏的设备中继续播放原本在第一设备中播放的第一内容。相似的,当第二设备在射频模块正确读取遥控设备中预留的字符串时,生成的第二字符串是“abcdef1234”。具有显示屏的设备将在第二字符串和字符串模版相同时,在具有显示屏的设备中继续播放原本在第二设备中播放的第二内容。
在另一种可能的方式中,字符串模版和具有显示屏的设备对应的遥控设备中预留的字符不同,但上述两个字符串之间互相匹配。例如,遥控设备中预留的字符是“33445566abc”,字符串模版是“1122334455cba”。具有显示屏的设备中预先保存了字符串模版,并且保存了“1122334455cba”和“33445566abc”之间是绑定的关系。当具有显示屏的设备接收到第一内容投屏请求从中读取出“33445566abc”,或者,接收到第二内容投屏请求从中读取出“33445566abc”时,具有显示屏的设备可以在“33445566abc”和“1122334455cba”相匹配的场景下通过验证,在具有显示屏的设备中继续播放第一内容,或,在具有显示屏的设备中继续播放第二内容。
第一内容:显示在第一设备中的内容,该内容可以被第一设备经过跨设备的方式投屏在具有显示屏的设备中播放。本申请提供两种第一设备可选的播放方式,介绍如下。
在第一种可选的方式中,第一内容原本在第一设备中播放,在第一设备成功将第一内容投屏到具有显示屏的设备中播放后,第一内容继续在第一设备中播放。例如,当第一内容是游戏画面时,游戏画面 则可以在第一设备中继续播放,且游戏能够在第一设备中正常接收到用户的操控。又例如,当第一内容是购物应用的用户界面时,用户能够在第一设备中继续显示购物应用的用户界面,便于使用第一设备的用户继续操作并查看购物应用中显示的商品信息。
在第二种可选的方式中,第一内容原本在第一设备中播放,在第一设备成功将第一内容投屏到具有显示屏的设备中播放后,第一内容停止在第一设备中播放。在该方式中,第一设备还可以继续显示关于第一内容的操控界面。例如,当第一内容是视频时,第一设备还可以显示播放、停止、快进、快退、调整播放进度或调整音量等控件。
从第一内容所属的应用类型来说,第一内容可以是社交应用、视频类应用、阅读类应用、地图类应用、天气类应用、团购类应用、办公类应用、摄影类应用、金融类应用、出行类应用、购物类应用、游戏应用或考试学习类应用中的至少一种。
针对第二内容而言,第一内容所属的用户界面可以和第二内容所属的用户界面是相同的界面。第二内容在第二设备中的显示方式,可以和第一内容在第一设备中的显示方式相同,详情可参见上文对第一内容的介绍,此处不再赘述。
示意性的,第一内容中可以包括第一商品,第二内容中可以包括第二商品。第一内容和第二内容是属于相同购物应用的内容。
示例性地,本申请实施例所示的跨设备的内容投屏方法,可以应用在具有显示屏的设备中。可选地,具有显示屏的设备的显示屏尺寸在物理世界中是较大尺寸的设备。例如,具有显示屏的设备可以是电视、投影仪、电脑显示屏、壁画式显示屏或视频监考系统的监视器、平板电脑或笔记本电脑,本申请对此不作限定。在另一种可能的场景中,具备显示屏且配备有遥控器的设备均可实现为本申请中所示的具有显示屏的设备。
请参考图1,图1是本申请实施例提供的一种跨设备的内容投屏的实施环境的示意图。在图1中,包括具有显示屏的设备111、遥控设备112、第一设备120和第二设备130。其中,遥控设备112用于遥控具有显示屏的设备111。
需要说明的是,在图1中,以具有显示屏的设备111是电视,遥控设备112是电视遥控器,第一设备120是手机且第二设备130也是手机为例进行说明。
具有显示屏的设备111可以是放置在用户住宅、公司或者公共场所的电视。具有显示屏的设备111具有尺寸较大的显示屏,并且具有显示屏的设备111具备分屏显示的功能。可选地,具有显示屏的设备111的显示屏尺寸可以在10英寸以上。
为了示意性说明分屏的功能,请参见图2,图2是基于图1所示实施例提供的一种具有显示屏的设备的分屏模式的示意图。具有显示屏的设备111进入分屏模式后,包括第一显示区域210和第二显示区域220。具有显示屏的设备111能够独立在第一显示区域210以及第二显示区域220中分别显示指定的内容。例如,具有显示屏的设备111在第一显示区域210中显示游戏G1的界面,在第二显示区域220中显示购物应用S1。
第一设备120可以通过蓝牙、WiFi(Wireless Fidelity,无线保真)或者其它短距离无线连接网络与具有显示屏的设备111进行连接。示意性的,当第一设备120与具有显示屏的设备111处于同一WiFi网络中,第一设备120能够将第一内容投屏至具有显示屏的设备111中。
相应的,第二设备130能够通过相同的方式,与具有显示屏的设备111建立连接,将原本显示在第二设备130中的第二内容投屏至具有显示屏的设备111。
示意性的,第一设备120或者第二设备130,均可以和具有显示屏的设备111可以按照同一个投屏协议,进行投屏处理。
在本申请实施例中,投屏协议可以是AirPlay、Miracast、DLNA、Chromecast、WiDi、WDHI或私有投屏协议中任意一种协议。需要说明的是,本处投屏协议仅为示意性说明,不对本申请实施例实际应用的投屏协议形成限定。
在本申请实施例中,请参见图3,图3是基于图2所示实施例提供的一种读取射频标签的示意图。需要说明的是,在本申请实施例中第一设备120和第二设备130均需要读取遥控设备112中的投屏标签中的信息。在图3中,介绍第一设备120以及第二设备130分别读取遥控设备中的投屏标签310的过程。需要说明的是,第一设备120中设置有第一射频模块320,第二设备130中设置有第二射频模块330。
在实际应用的场景中,遥控设备112中的投屏标签310若与第一设备120以及第二设备130均进行刷卡式操作,则在时间上具有先后的次序。在本申请实施例中,定义遥控设备112先与第一设备120进行刷卡式操作,再与第二设备130进行刷卡式操作。
在图3所示的第一刷卡阶段3A中,第一设备120与遥控设备112的下部触碰。设置在遥控设备112 的下部中的投屏标签310被第一设备120中的第一射频模块320读取信息,第一设备120根据读取到的信息生成第一字符串。
在图3所示的第二刷卡阶段3B中,第二设备130与遥控设备112的下部触碰。设置在遥控设备112的下部中的投屏标签310被第二设备130中的第二射频模块330读取信息,第二设备130根据读取到的信息生成第二字符串。
需要说明的是,在图3中,第一设备120中的第一射频模块320设置在设备背面的上部,第二设备130中的第二射频模块330设置在设备背面的下部。本申请实施例借此说明不同型号的设备,可以见射频模块设置在不同的位置。相应的,相同型号的设备,射频模块在设备中的位置是相同的位置。
示意性的,如图1所示的系统,能够包括具有显示屏的设备、第一设备、至少一个第二设备和遥控设备,遥控设备中包括投屏标签,且遥控设备用于遥控具有显示屏的设备。其中,第一设备,用于扫描投屏标签中的信息;第一设备,用于在扫描投屏标签中的信息后向具有显示屏的设备发送第一内容投屏请求;具有显示屏的设备,用于接收第一内容投屏请求;具有显示屏的设备,用于响应于第一内容投屏请求,播放第一内容,第一内容是第一设备中播放的内容;第二设备,用于扫描投屏标签中的信息;第二设备,用于在扫描投屏标签中的信息后向具有显示屏的设备发送第二内容投屏请求;具有显示屏的设备,用于接收第二内容投屏请求;具有显示屏的设备,用于响应于第二内容投屏请求,采用分屏模式播放第一内容和第二内容,第二内容是第二设备中播放的内容。
在另一种可能实现的跨设备的内容投屏系统中,系统包括具有显示屏的设备、第一设备和至少一个第二设备,第一设备包括第一图像采集组件,第二设备包括第二图像采集组件。其中,第一设备,用于通过第一图像采集组件拍摄预设手势或预设动作;第一设备,用于在拍摄预设手势或预设动作后向具有显示屏的设备发送第一内容投屏请求;具有显示屏的设备,用于接收第一内容投屏请求;具有显示屏的设备,用于响应于第一内容投屏请求,播放第一内容,第一内容是第一设备中播放的内容;第二设备,用于通过第二图像采集组件拍摄预设手势或预设动作;第二设备,用于在拍摄预设手势或预设动作后向具有显示屏的设备发送第二内容投屏请求;具有显示屏的设备,用于接收第二内容投屏请求;具有显示屏的设备,用于响应于第二内容投屏请求,采用分屏模式播放第一内容和第二内容,第二内容是第二设备中播放的内容。
请参考图4,图4是本申请一个示例性实施例提供的一种跨设备的内容投屏方法的流程图。该跨设备的内容投屏方法可以应用在图1所示的具有显示屏的设备中。在图4中,跨设备的内容投屏方法包括:
步骤410,接收第一设备发送的第一内容投屏请求,第一内容投屏请求是第一设备在执行预设交互操作后向具有显示屏的设备发送的请求。
在本申请中,预设交互操作可以包括扫描投屏标签、拍摄预设手势或拍摄预设动作中的一种。
当预设交互操作是扫描投屏标签时,具有显示屏的设备能够接收第一设备发送的第一内容投屏请求。其中,第一设备在扫描完投屏标签后,向该具有显示屏的设备发送第一内容投屏请求。在一种场景中,若投屏标签设置在具有显示屏的设备的遥控器中,则第一设备贴近或者触碰遥控器中设置该投屏标签的区域,第一设备将根据读取到的信息生成第一内容投屏请求,并将该第一内容投屏请求发送至具有显示屏的设备。
当预设交互操作是拍摄预设手势时,第一设备可以通过第一图像采集组件拍摄用户的手势。其中,第一图像采集组件可以是前置摄像头或者后置摄像头拍摄。预设手势包括单手手势、双手手势或手脸组合手势中的一种。单手手势是左手或者右手一只手作出的指定手势。双手手势是左右两只手互相配合作出的手势。手脸组合手势是一只手和人脸组合在一起形成的手势,或者,手脸组合手势是两只手和人脸组合在一起形成的手势。需要说明的是,本申请实施例不对预设手势具体的动作作出限定。当用户做出的手势是预设手势时,第一设备向具有显示屏的设备发送第一内容投屏请求。相应的,具有显示屏的设备接收该第一内容投屏请求。
当预设交互操作是拍摄预设动作时,第一设备可以采集包含用户的动作的多帧图像,当多帧图像中提取出的特征符合预设动作对应的特征时,第一设备可以确定拍摄到了预设动作,向具有显示屏的设备发送第一内容投屏请求。相应的,具有显示屏的设备接收该第一内容投屏请求。
可选地,具有显示屏的设备可以通过短距离无线通信的方式接收第一设备发送的第一内容投屏请求。其中,该短距离无线通信的方式可以是WiFi、蓝牙或Zigbee(紫蜂)中任意一种。第一设备发送该第一内容投屏请求时,目的在于将原本在第一设备中播放的内容在具有显示屏的设备中继续播放。其中,该第一内容是第一设备中播放的内容。该第一内容可以是第一设备中当前播放的用户界面,或者,第一内容可以是第一设备中当前处于前台运行的应用的用户界面。
步骤420,响应于第一内容投屏请求,播放第一内容,第一内容是第一设备中播放的内容。
具有显示屏的设备在接收到第一内容投屏请求后,响应于该请求,继续播放原本在第一设备中播放 的第一内容。其中,播放的内容既可以是视频,也可以是游戏画面或者手机实时显示的界面。
可选地,具有显示屏的设备可以响应于第一内容投屏请求中的第一字符串与字符串模版匹配,播放第一内容,第一字符串是第一设备从投屏标签中读取到的信息。
在本申请中,具有显示屏的设备能够从第一内容投屏请求中提取出第一字符串,将该第一字符串与字符串模版进行匹配。当第一字符串和字符串模版匹配时,具有显示屏的设备播放该第一内容。在实际应用的场景中,具有显示屏的设备既可以全屏播放该第一内容,也可以在当前具有显示屏的设备处于多屏显示模式或者分屏模式中,在其中一个显示区域中显示第一内容。
需要说明的是,第一字符串是第一设备从投屏标签中读取到的信息。该投屏标签既可以设置在具有显示屏的设备对应的遥控设备中,该投屏标签也可以单独设置成为一张射频卡,该射频识别标签还可以贴附在具有显示屏的设备的边框中。
步骤430,接收第二设备发送的第二内容投屏请求,第二内容投屏请求是第二设备在执行预设交互操作后向具有显示屏的设备发送的请求。
类似于具有显示屏的设备接收第一设备发送的第一内容投屏请求,具有显示屏的设备接收第二设备发送的第二内容投屏请求的处理流程是类似的,此处不再赘述。
可选地,第二设备既可以和第一设备是同型号的设备,也可以和第一设备是不同型号的设备。在本申请实施例中,来自同一厂商的设备可以被定义为一个型号的设备。或者,既来自同一厂商又来自同一具体型号的设备被定义为同一个型号的设备。
可选地,第二设备既可以和第一设备是同类型的设备,可以和第一设备是不同类型的设备。在本申请实施例中,设备的类型可以按照手机、平板电脑、智能手表以及笔记本电脑等分类方式对硬件的种类进行分类。
步骤440,响应于第二内容投屏请求,采用分屏模式播放第一内容和第二内容,第二内容是第二设备中播放的内容。
在本申请中,当具有显示屏的设备中已经在播放第一设备投屏的第一内容时,具有显示屏的设备对应其它设备发送来的投屏请求,能够进行响应,并通过分屏模式同时播放原先播放的第一内容,以及,新需求对应的第二内容。
可选地,响应于第二内容投屏请求中的第二字符串与字符串模版匹配,同时播放第一内容和第二内容,第二字符串是第二设备从投屏标签中读取到的信息。
由于具有显示屏的设备中已经在播放第一内容,因此,当第二字符串与字符串模版匹配时,具有显示屏的设备将根据第一内容在具有显示屏的设备中所占屏幕的区域大小,决定如何同时显示第一内容和第二内容。
在一种可能的实现方式中,当具有显示屏的设备是全屏显示第一内容时,具有显示屏的设备将采用分屏模式,重新划分出两个显示区域。其中,一个区域用于显示第一内容,另一个区域用于显示第二内容。可选地,上述两个显示区域可以分别是第一显示区域和第二显示区域。可选地,具有显示屏的设备还可以处于多屏模式中,多屏模式中的具有显示屏的设备包括2个以上的显示区域。其中2个显示区域用于显示第一内容和第二内容。
在另一种可能的实现方式中,当具有显示屏的设备在已经处于分屏模式或者多屏模式显示第一内容时,具有显示屏的设备可以在除显示第一内容之外的其它显示区域中显示第二内容。
通过上述可能的处理方式,具有显示屏的设备能够同时显示第一设备投屏的第一内容和第二设备投屏显示的第二内容。
综上所述,本实施例提供的跨设备的内容投屏方法,由于具有显示屏的设备能够先后接收第一设备和第二设备发送的内容投屏请求,并将第一设备中的第一内容继续在具有显示屏的设备中播放,且将第二设备中的第二内容继续在具有显示屏的设备中播放。其中,第一设备和第二设备是在执行预设交互操作后向具有显示屏的设备发送的投屏请求,播放相应的内容,提高了具有显示屏的设备在操作较少下同时显示多个设备投屏的内容的能力,并提高了多设备投屏的效率。
基于上一个实施例所公开的方案,具有显示屏的设备还能够预先进入分屏模式,在分屏模式中先后接收第一设备和第二设备的请求,并同时显示相应的内容。请参考如下实施例。
请参见图5,图5是本申请另一个示例性实施例提供的一种跨设备的内容投屏方法流程图。该跨设备的内容投屏方法可以应用在上述所示的具有显示屏的设备中。在图5中,该跨设备的内容投屏方法包括:
步骤511,接收分屏指令。
具有显示屏的设备能够接收分屏指令。分屏指令可以是语音指令、红外指令或者菜单控件被触发时 生成的指令。
当分屏指令是语音指令时,具有显示屏的设备可以通过语音助手等内置的软件接收该指令。比如,具有显示屏的设备可以在接收到唤醒词之后,进入语音激活状态。在具有显示屏的设备处于语音激活状态,具有显示屏的设备的麦克风可以接收到语音,并根据该语音生成语音指令。
步骤512,响应于分屏指令,进入分屏模式,具有显示屏的设备的显示屏在分屏模式中至少包括第一显示区域和第二显示区域。
具有显示屏的设备能够响应于分屏指令,进入分屏模式。在本申请中,分屏模式包括第一显示区域和第二显示区域。其中,第一显示区域用于显示第一内容,第二显示区域用于显示第二内容。
例如,用户说出唤醒词“小布小布”,具有显示屏的设备将进入语音激活状态。此时,再当用户说出进入分屏模式时,具有显示屏的设备将进入分屏模式。
又例如,用户能够通过遥控器打开具有显示屏的设备中指定的菜单,当点击菜单中的分屏按钮时,具有显示屏的设备将进入分屏模式。
步骤520,接收第一设备发送的第一内容投屏请求。
在本例中,步骤520与步骤410执行的过程相同,此处不再赘述。
步骤530,响应于第一内容投屏请求中的第一字符串与字符串模版匹配,在第一显示区域播放第一内容。
需要说明的是,当具有显示屏的设备的显示区域分为第一显示区域和第二显示区域时,第一显示区域可以是靠左侧的区域,第二显示区域可以是靠右侧的区域。
步骤540,接收第二设备发送的第二内容投屏请求。
在本例中,步骤540与步骤430执行的过程相同,此处不再赘述。
步骤550,响应于第二内容投屏请求中的第二字符串与字符串模版匹配,在第一显示区域播放第一内容的同时,在第二显示区域中播放第二内容。
在本例中,由于第一显示区域中已经在显示第一内容。因此,具有显示屏的设备将第二内容安排在第二显示区域中进行显示。
下面将通过一个实际应用的例子对上述内容进行介绍。
请参见图6,图6是基于图5所示的实施例提供的一种跨设备的内容投屏方法的应用示意图。在图6中,具有显示屏的设备是电视,第一设备是A手机,第二设备是B手机,且与具有显示屏的设备具有绑定关系的投屏标签设置在具有显示屏的设备的遥控器中。
首先,用户可以使用遥控器610或者语音的方式,控制电视620进入左右分屏的模式。示意性的,当用户通过语音的方式控制电视620时,电视620将显示提示词621“电视将进入左右分屏”。
然后,用户使用A手机630贴靠遥控器610,A手机630的射频模块从遥控器610中的投屏标签中读取到第一字符串,并将该信息包含于第一内容投屏请求,发送至电视620。相应的,电视620在验证该第一字符串和电视620中存储的字符串模版匹配时,在左侧的第一显示区域622中显示原本在A手机630中显示的内容。
随后,另一用户可以使用B手机640贴靠相同的遥控器610,B手机640的射频模块从遥控器610中的投屏标签中读取到第二字符串,且该信息包含于第二内容投屏请求,发送至电视620。相应的,电视620在验证该第二字符串和电视620中存储的字符串模版匹配时,在右侧的第二显示区域623中显示原本在B手机640中显示的内容。
综上所述,本实施例能够根据提前根据用户的语音指令或者遥控器的指示下,提前进入分屏模式。在第一设备通过具有显示屏的设备的验证后,将在其中的一个显示区域中显示第一设备中显示的第一内容,同样的,在第二设备通过具有显示屏的设备的验证后,具有显示屏的设备将在除显示第一内容的显示区域中,显示第二设备中显示的第二内容。其中,第一设备和第二设备用于和具有显示屏的设备验证的信息均是从与具有显示屏的设备有绑定关系的投屏标签中获取的。由此可见,本申请提供的具有显示屏的设备能够提供便于进入的分屏模式,且仅需一步即可将其它设备中播放的内容直接投屏到分屏模式中的一个显示区域中,随后,在已经有投屏的内容的情况下,仍然可以快速将另外的设备中的内容投屏到分屏模式中的其它显示区域中。由此可见,本申请实施例提供的方法,能够提高具有显示屏的设备同时显示多个其它设备中的投屏内容的能力。
在本申请实施例中,除了提前进入分屏模式,具有显示屏的设备还具备智能判断是否进入分屏显示第一内容和第二内容的能力。请参考如下实施例。
请参见图7,图7是本申请另一个示例性实施例提供的一种跨设备的内容投屏方法流程图。该跨设备的内容投屏方法可以应用在上述所示的具有显示屏的设备中。在图7中,该跨设备的内容投屏方法包 括:
步骤710,接收第一设备发送的第一内容投屏请求。
在本例中,步骤710与步骤410的执行过程相同,本处不再赘述。
步骤720,响应于第一内容投屏请求中的第一字符串与字符串模版匹配,全屏播放第一内容。
步骤730,接收第二设备发送的第二内容投屏请求。
在本例中,步骤730与步骤430的执行过程相同,本处不再赘述。
步骤741,响应于第二内容投屏请求,获取分屏信息。
需要说明的是,分屏信息可以包括在第二内容投屏请求中。该分屏信息用于提供给具有显示屏的设备,以令具有显示屏的设备进行判断是否进入分屏。
步骤742,响应于分屏信息符合预设条件,在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容,具有显示屏的设备的显示屏在分屏模式中至少包括第一显示区域和第二显示区域。
在本例中,具有显示屏的设备在分屏信息符合预设条件时,在第一显示区域中播放第一内容,在第二显示区域中播放第二内容。其中,第一显示区域和第二显示区域是互不重合的显示区域。
需要说明的是,本申请能够根据分屏信息的具体形式,而提供相应的自动进入分屏模式的方案,现介绍如下。
(1),分屏信息是涉及分屏的设备信息,具体是体现第一设备成功投屏的时刻与第二设备成功投屏的时刻。
步骤a1,响应于第二内容投屏请求,获取第一设备的投屏时刻和第二设备的投屏时刻之间的参考时长。
步骤a2,响应于参考时长小于第一阈值,在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。
在本例中,第一设备的投屏时刻用于指示第二内容成功投屏在具有显示屏的设备中的时刻,第二设备的投屏时刻用于指示第三内容成功投屏在具有显示屏的设备中的时刻。
示意性的,具有显示屏的设备将根据第一设备成功在具有显示屏的设备上的投屏时刻,以及,第二设备成功在具有显示屏的设备上的投屏时刻,计算两个投屏时刻之间的时长,也即计算该参考时长。该参考时长可以反映第一设备和第二设备之间投屏的关联性,若该参考时长较短,则说明第一设备在具有显示屏的设备上的进行投屏,与,第二设备在具有显示屏的设备上进行投屏这两个事件具有较强的相关性。因此,基于该设计思想,本申请在该参考时长小于第一阈值时,在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。经过上述处理,具有显示屏的设备能够较为智能地同时播放第一设备投屏的第一内容和第二设备投屏的第二内容。
相应的,当参考时长大于或者等于第一阈值时,具有显示屏的设备中原本显示的第一内容,将被第二设备中的第二内容所替换显示。
在一个实际应用的例子中。例如参考时长是37秒,第一阈值是120秒。在该情况中,参考时长小于第一阈值。因此,具有显示屏的设备在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。
在另一个例子中,参考时长是560秒。在该情况中,参考时长大于第一阈值。因此,原本在具有显示屏的设备中显示的第一内容,将被第二内容所替换,具有显示屏的设备将显示第二内容。
(2),分屏信息是涉及分屏的设备信息,具体是第二设备的历史投屏信息。
步骤b1,响应于第二内容投屏请求,获取第二设备的历史投屏信息,历史投屏信息包括第二设备成功向具有显示屏的设备投屏的投屏次数或投屏累计时长中至少一种信息。
步骤b21,响应于投屏次数大于或等于第二阈值,在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。
步骤b22,响应于投屏累计时长大于或等于第三阈值,在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。
需要说明的是,具有显示屏的设备在执行完成步骤b1后,既可以执行步骤b21,也可以执行步骤b22。
在本例中,具有显示屏的设备能够根据第二设备的投屏累计时长决定,是否分屏同时显示第一内容和第二内容。若第二设备的投屏累积时长足够长,则说明第二设备与具有显示屏的设备在投屏方面有较强的相关性。在此情况下,具有显示屏的设备将分屏为两个互不重合的显示区域,也即第一显示区域和第二显示区域。然后,具有显示屏的设备分别在第一显示区域中显示第一内容,在第二显示区域中显示第二内容。
在本例中,具有显示屏的设备还能够根据第二设备历史上成功在具有显示屏的设备上进行投屏的投 屏次数,决定是否分屏显示第一内容和第二内容。当第二设备在具有显示屏的设备上的投屏次数大于或者等于第二阈值时,说明第二设备与具有显示屏的设备在投屏方面有较强的相关性,具有显示屏的设备将分屏后同时显示第一内容和第二内容。
相对的,当历史投屏信息指示第二设备与具有显示屏的设备在投屏方面的相关性不强时,具有显示屏的设备将在显示屏中显示对话框。该对话框用于提醒用户选择具有显示屏的设备是通过分屏显示第一内容和第二内容。或者,该对话框用于提醒用户选择具有显示屏的设备停止显示第一内容并在原本显示第一内容的显示区域显示第二内容。
(3),分屏信息是涉及分屏的内容,具体是第一内容的图像信息以及第二内容的图像信息。
步骤c1,响应于第二内容投屏请求,根据预设策略获取第一内容中的第一图像信息,并根据预设策略获取第二内容中的第二图像信息。
步骤c2,响应于第一图像信息和第二图像信息之间的相似度大于或等于第四阈值,在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。
在本例中,具有显示屏的设备能够自主对第一内容和第二内容进行图像识别。在具体的应用方式中,具有显示屏的设备能够根据第二内容投屏请求获取到第二内容,并获取第二内容中的第二关键帧。其中,第二关键帧是在指定时刻获取的图像帧。具有显示屏的设备在同样的指定时刻下,获取到第一内容中的图像帧,该第一内容中的图像帧是第一关键帧。具有显示屏的设备能够提取第一关键帧中的图像特征,并能够提取第二关键帧中的图像特征。当第一关键帧中的图像特征与第二关键帧中的图像特征之间的相似度大于或者等于第四阈值时,说明第一内容和第二内容有较大可能属于同一个应用,或者,说明第一内容和第二内容显示相应的对象。例如,第一内容和第二内容中显示有相同的人物或者显示有相同的物品。
由于第一内容和第二内容中显示的内容在相似度时,较大可能是用户希望同时投屏在具有显示屏的设备中同时观看进行比较。因此,在该场景中,具有显示屏的设备将进入分屏状态,并同时显示第一内容和第二内容。
(4),分屏信息是涉及分屏的内容,具体是第一内容的内容标识和第二内容的内容标识。
步骤d1,响应于第二内容投屏请求,获取第一内容对应的第一内容标识和第二内容对应的第二内容标识。
步骤d2,响应于第一内容标识和第二内容标识匹配,在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。
在本例中,内容标识既可以指示内容对应的应用的标识,也可以指示内容对应的应用所属的类别,还可以指示内容中的对象类型。
(1)内容标识指示内容对应的应用。例如,第一内容标识和第二内容标识均用于指示内容对应的应用。当第一内容标识是A应用的标识,且第二内容该标识是A应用的标识时,具有显示屏的设备确定第一内容标识和第二内容标识匹配,在第一显示区域中播放第一内容,同时在第二显示区域中播放第二内容。相对的,当第一内容标识指示的应用和第二内容标识指示的应用是不同的应用时,具有显示屏的设备可以停止显示第一内容,并在原本显示第一内容的显示区域中显示第二内容。
(2)内容标识指示内容对应的应用的类别。例如,第一内容标识和第二内容标识分别用于指示第一内容对应的应用的类别,和,第二内容对应的应用的类别。例如,当第一内容标识是游戏类应用标识且第二内容标识是视频应用标识,则第一内容标识和第二内容标识不匹配。当第一内容标识是游戏类应用标识且第二内容标识也是游戏类应用标识,则第一内容标识和第二内容标识匹配。
(3)内容标识指示内容中的对象,该对象可以是人物,也可以是其它的物品。例如,第一内容标识指示的是人物杰克,第二内容标识指示的是人物布朗,则第一内容标识和第二内容标识不匹配。若第一内容标识指示的是人物布朗,且第二内容标识指的也是人物布朗,则第一内容标识和第二内容标识匹配。
在本申请实施例中,上述四种场景用于指示具有显示屏的设备自动识别到需要进入分屏模式,在不同的显示区域中分别显示第一内容以及第二内容。而具有显示屏的设备还能够提供一个供用户选择的控件,供用户自动选择是否进入分屏模式,从而分别在分屏模式中的第一显示区域中显示第一内容,并在第二显示区域中显示第二内容。请参见如下用户手动选择的方案。
步骤e1,响应于第二内容投屏请求,显示分屏按钮。
步骤e2,响应于分屏按钮被触发,在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。
在本申请实施例中,具有显示屏的设备能够在接收到第二设备的内容投屏请求时,显示分屏按钮。示意性的,该分屏按钮可以显示在具有显示屏的设备的显示屏中。用户能够使用遥控设备触发该分屏按 钮,当该分屏按钮被触发时,具有显示屏的设备将在第一显示区域中播放第一内容,并在第二显示区域中播放第二内容。
可选地,具有显示屏的设备还能够显示关闭控件,当用户触发关闭控件时,具有显示屏的设备将停止显示分屏按钮。
综上所述,具有显示屏的设备能够先接收第一设备的第一内容投屏请求,并在该请求符合预设条件的时候全屏显示第一设备对应的第一内容。随后,具有显示屏的设备在通过多种方式自动识别第二内容的重要程度或者投屏第二内容的第二设备的安全性,在第二内容较为重要或者第二设备相对具有显示屏的设备较为安全时,具有显示屏的设备自动进入分屏模式,同时显示第一内容和第二内容,提高了具有显示屏的设备的智能化,减少了用户为第一内容和第二内容同时显示所需的操作,提高了多个设备同时投屏在一个设备上的便利性。
可选地,具有显示屏的设备能够根据第一内容和第二内容开始投屏时刻之间的参考时长的时间长度,确定是否自动进行分屏显示。当第一内容和第二内容在具有显示屏的设备上开始投屏的时刻相距时间不长,则说明两个内容之间的相关性足够高,具有显示屏的设备将自动进入分屏状态,并同时显示第一内容和第二内容,实现了具有显示屏的设备从投屏行为上智能确定是否同时显示第一内容和第二内容的能力。
可选地,具有显示屏的设备能够第二设备的历史投屏信息确认第二设备与具有显示屏的设备之间的亲密程度,当具有显示屏的设备和第二设备之间经常连接,具有较为亲密的关系,则具有显示屏的设备将自动进入分屏状态,并同时显示第一内容和第二内容,提高了具有显示屏的设备从第二设备的历史投屏情况智能判断是否同时显示第一内容和第二内容的能力。
可选地,具有显示屏的设备还能够根据第一内容与第二内容在图像上的相似度,决定是否自动进入分屏状态,从而同时显示第一内容和第二内容。当第一内容和第二内容在图像上的相似度较大时,说明第一内容和第二内容有较强的关联性,用户较大可能会同时查看两者并进行比较。因此,具有显示屏的设备在该场景中,能够自动进入分屏状态,从而同时显示第一内容和第二内容。
可选地,具有显示屏的设备还能够根据第一内容标识和第二内容标识是否匹配来确定是否进入分屏状态,当上述两个内容标识匹配时,说明第一内容和第二内容需要在能够同时查看的状态下进行显示。因此,在该场景中,具有显示屏的设备自动进入分屏状态并同时第一内容和第二内容,实现了多个设备显示的内容是相关的情况下,具有显示屏的设备自动同时显示第一内容和第二内容。
本申请实施例除了上述能够自动识别需要分屏的场景外,还能够应用在移动设备进行作答,且监考设备对移动设备进行监控的场景中。在该场景中,具有显示屏的设备是监控设备,第一设备和第二设备均为显示考试试卷且供考生使用的设备。关于该应用场景的介绍,请参考图8所示的内容。
请参考图8,图8是本申请实施例提供的一种应用于监考场景的跨设备的内容投屏方法流程图。图8中涉及的方法可以由图1所示的具有显示屏的设备实现,详情如下:
步骤811,启动具有显示屏的设备,具有显示屏的设备是考场的监控设备。
在本例中,具有显示屏的设备是考场中的监控设备,监考官可以在考试的过程中通过具有显示屏的设备了解考生使用的考试设备中显示的内容。
需要说明的是,第一设备和第二设备均为考试设备。本申请中可以包括一个第一设备和若干个第二设备。其中,第一设备是第一个投屏在具有显示屏的设备中投屏的设备,第二设备是在第一设备完成投屏之后在具有显示屏的设备中投屏的设备。
在该场景中,监控设备可以配套提供一个射频卡片,射频卡片是投屏标签。第一设备和第二设备等可以靠近该射频卡片,从而从射频卡片中读取信息,生成第一字符串或第二字符串。
需要说明的是,在一种可能的方式中,该射频卡片是每个考场配备一个,在该考场进行考试的考生均使用自己的考试设备扫描该射频卡片。
在另一种可能的方式中,该射频卡片可以在每个考生的座位上设置一个射频卡片。
步骤812,接收第一设备发送的第一内容投屏请求。
在本例中,第一设备在从射频卡片中读取信息,并生成第二字符串后,会将该第二字符串置于第一内容投屏请求中,并向第一设备发送该第一内容投屏请求。
相应的,该具有显示屏的设备接收第一设备发送的第一内容投屏请求。
步骤813,响应于第一内容投屏请求中的第一字符串与字符串模版匹配,播放第一内容。
具有显示屏的设备在接收到第一内容投屏请求之后,可以从该内容投屏请求中,读取出第一字符串,在第一字符串与字符串模版匹配时,播放第一内容。
其中,该第一内容是第一设备屏幕中显示的内容。也即,第一设备中实时显示的内容将同步投屏到 具有显示屏的设备中显示。
步骤814,接收第二设备发送的第二内容投屏请求。
步骤815,响应于第二内容投屏请求中的第二字符串与字符串模版匹配,同时播放第一内容和第二内容。
类似于第一设备将第一内容投屏到具有显示屏的设备中显示,第二设备将重复与第一设备一样的操作,也在具有显示屏的设备中投屏。在本申请实施例中,由于在一个考场中的考生数量通常有几个或者几十个。因此,一个具有显示屏的设备可以对应一个第一设备和若干个第二设备。
在上述对应设计中,考虑到具有显示屏的设备的屏幕尺寸,第二设备的数量可以是7个、9个、15个或者19等数量。
在第二设备成功将第二内容投屏到具有显示屏的设备上后,具有显示屏的设备将同时显示第一内容和第二内容。在该场景中,考生均使用第一设备或者第二设备进行考试答题。由于电子设备的特殊性,监考官同时监考多个考生使用的考试设备也较为困难。在本申请提供的方法中,监考官能够在具有显示屏的设备中同时看到第一内容和若干个第二内容,以实时查看考生所看的答题界面。
步骤821,响应于第一内容和/或第二内容中包括异常图像,记录异常图像和异常图像显示的时刻。
在本例中,具有显示屏的设备能够对第一内容和/或第二内容中的图像进行图像识别。在一种可能的方式中,具有显示屏的设备能够逐帧进行图像识别。在另一种可能的方式中,具有显示屏的设备能够每隔N帧,对同一个内容中的图像进行一次识别。例如,具有显示屏的设备对第一内容中的图像帧进行图像识别,以30帧图像为一组图像。具有显示屏的设备能够对一组图像中的第一张图像帧进行图像识别。
其中,具有显示屏的设备中可以预设属于正常的图像模版。具有显示屏的设备将从第一内容或者第二内容中获取到的图像帧,与,图像模版进行比较。当相似度高于预设阈值时,说明图像帧属于正常图像;当相似度等于或者低于预设阈值时,说明图像帧属于异常图像。
在具有显示屏的设备识别出异常图像时,记录出现异常图像的设备并记录异常图像显示的时刻。
在另一种识别异常图像的方式中,异常图像所属的应用不属于白名单应用列表。在考试场景中,具有显示屏的设备中可以维护一个白名单应用列表,与本场考试相关的应用标识将被列入该白名单应用列表中。当考生使用自己的考试设备使用上述与本场考试相关的应用时,第一内容或者第二内容所属的应用的标识均属于白名单应用列表。若考生使用其他的应用,则会被具有显示屏的设备第一时间抓取到。需要说明的是,具有显示屏的设备获取的第一内容或者第二内容中的每个图像帧均对应有所属的应用的标识。
例如,属于白名单应用列表的应用包括A考试应用和B计算器应用。当具有显示屏的设备识别到第一内容中存在一个图像帧所属的应用既不是A考试应用,也不是B计算器应用,则判断第一内容是包括异常图像的内容。
可选地,具有显示屏的设备除了执行步骤821,还可以继续执行步骤822。
步骤822,将包括异常图像的内容突出显示,突出显示包括高亮、显示预设标记或显示预设文本中至少一种。
在本申请实施例中,具有显示屏的设备为了提醒监考官出现异常的情况,可以将包括异常图像的内容突出显示。例如,第一设备中的第一内容包括异常图像,具有显示屏的设备在显示第一内容时,突出显示该第一内容。可选的突出显示的方式,包括但不限于高亮显示区域,或者在第一内容上附加一个预设标记,或者在第一内容上附加显示预设文本。本申请实施例不对具体的突出显示的方式进行限定。
步骤830,向出现异常图像的设备发送锁定信号,锁定信号用于指示出现异常图像的设备停止接收输入信号。
在本例中,具有显示屏的设备还能够向出现异常图像的设备发送锁定信号,使得出现异常图像的设备在锁定信号的作用下,不能再接收输入信号。通过该设计,使得具有显示屏的设备能够在监考的其它设备出现异常时,直接锁定相应的考试设备,从而实现严格处理考试异常现象,实现了用户使用自身日常使用的设备进行无纸化考试,且能够接收到严格监考的效果。
综上所述,本申请实施例提供的方法能够应用在无纸化考试的监考场景中,能够实现考生使用自己日常使用的移动设备来参加考试的效果,并且能够实现较为严格监考效果,降低了建造无纸化考场的成本且保证了考试严格的监考效果。
在本申请实施例中,具有显示屏的设备除了能够同时显示第一内容和第二内容,具有显示屏的设备还能够对其显示的内容进行控制,详情可参考图9所示的实施例。
请参考图9,图9是本申请实施例提供的一种跨设备的内容投屏的方法流程图。该方法可以应用在 如图1所示的具有显示屏的设备中。在图9中,方法包括:
步骤911,接收第一设备发送的第一内容投屏请求。
步骤912,响应于第一内容投屏请求中的第一字符串与字符串模版匹配,播放第一内容。
步骤913,接收第二设备发送的第二内容投屏请求。
步骤914,响应于第二内容投屏请求中的第二字符串与字符串模版匹配,同时播放第一内容和第二内容。
在本申请实施例中,上述步骤911至步骤914的执行过程可以参考步骤410至步骤440的执行过程,此处不再赘述。
步骤921,接收局部区域信息。
其中,局部区域信息用于指示第一设备中的一个局部区域的信息,或,第二设备中的一个局部区域的信息。
步骤922,响应于局部区域信息,将局部区域信息对应的区域放大k倍。
其中,k大于1。具有显示屏的设备能够通过放大局部区域信息对应的区域,令用户更为容易地观察到自己较为关注的区域。
步骤923,在局部区域信息对应的显示区域中,显示放大k倍后的局部区域信息对应的区域。
在本申请实施例中,具有显示屏的设备能够在用户的控制下对第一内容中的局部区域进行放大显示。一种可能的方式中,局部区域信息是第一设备发送至具有显示屏的设备的信息。另一种可能的方式中,局部区域信息是具有显示屏的设备对应的遥控设备发送的信息。
当具有显示屏的设备获取到局部区域信息时,具有显示屏的设备将确定该局部区域信息对应的区域。并且,将原本显示在该区域中的图像放大k倍显示。若局部区域信息对应的显示区域是第一显示区域,则具有显示屏的设备在第一显示区域显示放大k倍后的局部区域信息对应的区域。若局部区域信息对应的显示区域是第二显示区域,则具有显示屏的设备在第二显示区域显示放大k倍后的局部区域信息对应的区域。
请参见图10,图10是基于图9所示实施例提供的一种具有显示屏的设备的显示示意图。在图10中,具有显示屏的设备111中包括第一显示区域210和第二显示区域220。在第一显示区域210中包括第一局部显示区域211。其中,局部区域信息用于指示第一局部显示区域211。随后,具有显示屏的设备111在第二局部显示区域212中显示放大k倍后的图像。
例如,局部显示区域211中原本显示的第一内容中的小地图,则具有显示屏的设备可以将该区域内的小地图进一步放大显示,使得用户能够对于关心的内容能够更详细看到细节。
可选地,具有显示屏的设备能够将第二内容中,相对应的局部区域放大k倍显示。例如,第二内容和第一内容相同,同样显示有游戏界面,则具有显示屏的设备具备将第一内容中的小地图和第一设备中的小地图置于贴靠在一起的区域显示,便于用户直接从具有显示屏的设备中比较第一内容中和第二内容中被确定的部分。
步骤931,对第一内容进行图像识别,得到与预设关键字匹配的第一文本。
步骤932,对第二内容进行图像识别,得到与预设关键字匹配的第二文本。
步骤933,将第一文本和第二文本进行对比显示。
在本申请中,具有显示屏的设备能够对第一内容和第二内容进行图像识别,获取其中的文本信息。当其中的文本信息均与预设关键匹配时,具有显示屏的设备将第一文本和第二文本进行对比在一起显示。其中,预设关键字是具有显示屏的设备中设置的关键字。在一种显示的方式中,第一文本在第一显示区域中显示,第二文本在第二显示区域中显示,第一文本和第二文本之间的距离小于第五阈值。可选地,第一文本和第二文本在对比区域中显示,对比区域是横跨第一显示区域和第二显示区域的区域。
示意性的,第一文本和第二文本的划分算法相同。比如,若第一文本是一句话,则第二文本同样是一句话。若第一文本是一段话,则第二文本同样是一段话。
例如,若第一内容是针对商品A在购物应用S2中的购物页面,第二内容是针对商品A在购物应用S3中的购物页面。其中,预设关键字是“实际价格”。具有显示屏的设备在第一内容中提取到的第一文本是“实际价格:224元”,同时第一设备在第二内容中提取到的第二文本是“实际价格:206元”。随后,具有显示屏的设备在第一显示区域与第二显示区域交界的位置,同时显示该第一文本和第二文本,以便用户直接比较到最关心的信息。
请参见图11,图11是基于图9所示实施例提供的一种具有显示屏的设备的显示界面的示意图。在图11中,具有显示屏的设备111的显示区域包括第一显示区域210以及第二显示区域220。在第一显示区域210中包括第一对比显示区域213,在第二显示区域220中包括第二对比显示区域221。具有显示屏的设备111可以在第一对比显示区域213中显示第一内容中被提取到的第一文本11A,具有显示屏 的设备111还可以在第二对比显示区域221中显示第二内容中被提取到的第二文本11B,以便用户能够直观的比较第一内容和第二内容中,用户比较关心的部分。
需要说明的是,图11中显示的第一内容和第二内容均是商品篮球,被提取的信息包括价格、销量和所属的店铺名称。可选地,具有显示屏的设备还可以将价格较低的文本进行突出显示。
步骤941,接收第一设备发送的第一商品提取命令。
其中,第一商品提取命令用于提取第一内容中指定的商品。
步骤942,响应于第一商品提取命令,提取并存储对应的第一商品。
步骤943,接收第二设备发送的第二商品提取命令。
其中,第二商品提取命令用于提取第二内容中指定的商品。
步骤944,响应于第二商品提取命令,提取并存储对应的第二商品。
步骤945,接收汇总指令,将存储的第一商品和第二商品发送至发出汇总指令的设备。
其中,发出汇总指令的设备是第一设备或第二设备。
在本申请实施例中,第一设备和第二设备能够分别从已经投屏到具有显示屏的设备上的内容中,选定需要提取的商品。其中,商品可以是文本、图像或链接。
可选地,第一商品和第二商品是相同类型的商品,该类型是目标类型。
示意性的,本申请除了能够提取商品,还能够提取景点、商品、饭店、商场、明星、电影名、演唱会或页面等对象。
需要说明的是,在具有显示屏的设备提取并存储相应的对象之后,还可以根据对象类型的不同执行相应的策略。例如,当目标类型是景点时,具有显示屏的设备自动生成旅行路线,并向第一设备或者第二设备发送该旅行路线。
又例如,当目标类型是商品时,具有显示屏的设备自动比较已经被提取出的商品中,相同商品中的最低价商品,并向第一设备或者第二设备发送加购指令,该加购指令用于指示将该商品添加到购物应用中的购物车中。
综上所述,在本申请实施例中,具有显示屏的设备能够将已经被投屏显示的第一内容和第二内容中需要同时被放大的内容进行放大,实现了有效显示用户关注的区域的能力。
可选地,具有显示屏的设备还能够对第一内容以及第二内容进行图像识别,在其中包含有与预设关键字匹配的文本贴靠在一起显示,降低了用户同时比较两个内容中重点关注的信息的难度,提高了在具有显示屏的设备中比较多个其它设备中显示的内容的效率。
可选地,具有显示屏的设备还能够分别在第一设备和第二设备的控制下,分别提取并存储相应的对象,在第一设备和第二设备均可以在各自的设备中选定对象,最终被选定的对象可以汇总的其中一个设备中,实现了多个设备可以在具有显示屏的设备显示参考的场景下,完成共同选择对象的能力。
下述为本申请装置实施例,可以用于执行本申请方法实施例。对于本申请装置实施例中未披露的细节,请参照本申请方法实施例。
请参考图12,图12是本申请一个示例性实施例提供的一种跨设备的内容投屏装置的结构框图。该跨设备的内容投屏装置可以通过软件、硬件或者两者的结合实现成为具有显示屏的设备的全部或一部分。该装置包括:
第一接收模块1210,用于接收第一设备发送的第一内容投屏请求,所述第一内容投屏请求是所述第一设备在执行预设交互操作后向所述具有显示屏的设备发送的请求;
第一播放模块1220,用于响应于所述第一内容投屏请求,播放第一内容,所述第一内容是所述第一设备中播放的内容;
第二接收模块1230,用于接收第二设备发送的第二内容投屏请求,所述第二内容投屏请求是所述第二设备在执行所述预设交互操作后向所述具有显示屏的设备发送的请求;
第二播放模块1240,用于响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
在一个可选的实施例中,所述装置涉及的所述预设交互操作包括扫描投屏标签,所述投屏标签是所述具有显示屏的设备对应的电子标签;或,所述预设交互操作包括拍摄预设手势;或,所述预设交互操作包括拍摄预设动作。
在一个可选的实施例中,所述装置还包括第三接收模块和分屏模块,所述第三接收模块,用于接收分屏指令;所述分屏模块,用于响应于所述分屏指令,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域;其中,所述第一显示区域用于显示所述第一内容,所述第二显示区域用于显示所述第二内容。
在一个可选的实施例中,所述第二播放模块1240,用于响应于所述第二内容投屏请求,获取分屏信息;响应于所述分屏信息符合预设条件,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域,在第一显示区域中播放所述第一内容,并在第二显示区域中播放所述第二内容。
在一个可选的实施例中,所述第二播放模块1240,用于响应于所述第二内容投屏请求,获取所述第一设备的投屏时刻和所述第二设备的投屏时刻之间的参考时长;响应于所述参考时长小于第一阈值,在所述第一显示区域中播放所述第一内容,并在所述第二显示区域中播放所述第二内容。
在一个可选的实施例中,所述第二播放模块1240,用于响应于所述第二内容投屏请求,获取所述第二设备的历史投屏信息,所述历史投屏信息包括所述第二设备成功向所述具有显示屏的设备投屏的投屏次数或投屏累计时长中至少一种信息;响应于所述投屏次数大于或等于第二阈值,在所述第一显示区域中播放所述第一内容,并在所述第二显示区域中播放所述第二内容;或,响应于所述投屏累计时长大于或等于第三阈值,在所述第一显示区域中播放所述第一内容,并在所述第二显示区域中播放所述第二内容。
在一个可选的实施例中,所述第二播放模块1240,用于响应于所述第二内容投屏请求,根据预设策略获取所述第一内容中的第一图像信息,并根据所述预设策略获取所述第二内容中的第二图像信息;响应于所述第一图像信息和所述第二图像信息之间的相似度大于或等于第四阈值,在所述第一显示区域中播放所述第一内容,并在所述第二显示区域中播放所述第二内容。
在一个可选的实施例中,所述第二播放模块1240,用于响应于所述第二内容投屏请求,获取所述第一内容对应的第一内容标识和所述第二内容对应的第二内容标识;响应于所述第一内容标识和所述第二内容标识匹配,在所述第一显示区域中播放所述第一内容,并在所述第二显示区域中播放所述第二内容。
在一个可选的实施例中,所述装置还包括按钮显示模块,用于响应于所述第二内容投屏请求,显示分屏按钮;所述第二播放模块1240,用于响应于所述分屏按钮被触发,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域。
在一个可选的实施例中,所述装置还包括异常记录模块和突出显示模块,所述异常记录模块,用于响应于所述第一内容和/或所述第二内容中包括异常图像,记录所述异常图像和所述异常图像显示的时刻,所述异常图像所属的应用不属于白名单应用列表;所述突出显示模块,用于将包括所述异常图像的内容突出显示,所述突出显示的方式包括高亮、显示预设标记或显示预设文本中至少一种。
在一个可选的实施例中,所述装置还包括设备锁定模块,用于向出现所述异常图像的设备发送锁定信号,所述锁定信号用于指示所述出现所述异常图像的设备停止接收输入信号。
在一个可选的实施例中,所述装置还包括第四接收模块、局部放大模块和局部显示模块,所述第四接收模块,用于接收局部区域信息,所述局部区域信息用于指示所述第一设备中的一个局部区域的信息,或,所述第二设备中的一个局部区域的信息;所述局部放大模块,用于响应于所述局部区域信息,将所述局部区域信息对应的区域放大k倍,k大于1;所述局部显示模块,用于在所述局部区域信息对应的显示区域中,显示放大k倍后的所述局部区域信息对应的区域,其中,当所述局部区域信息用于指示所述第一内容中的一个局部区域时,所述局部区域信息对应的显示区域是第一显示区域;当所述局部区域信息用于指示所述第二内容中的一个局部区域时,所述局部区域信息对应的显示区域是第二显示区域。
在一个可选的实施例中,所述装置还包括第一识别模块、第二识别模块和贴靠显示模块,所述第一识别模块,用于对所述第一内容进行图像识别,得到与预设关键字匹配的第一文本,所述预设关键字是所述具有显示屏的设备中设置的关键字;所述第二识别模块,用于对所述第二内容进行图像识别,得到与所述预设关键字匹配的第二文本;所述对比显示模块,用于将所述第一文本和所述第二文本进行对比显示。
在一个可选的实施例中,所述装置还包括第五接收模块、第一处理模块、第六接收模块、第二处理模块和第三处理模块;所述第五接收模块,用于接收所述第一设备发送的第一商品提取命令,所述第一商品提取命令用于提取所述第一内容中指定的商品;所述第一处理模块,用于响应于第一对象提取命令,提取并存储对应的第一商品;所述第六接收模块,用于接收所述第二设备发送的第二商品提取命令,所述第二商品提取命令用于提取所述第二内容中指定的商品;所述第二处理模块,用于响应于所述第二商品提取命令,提取并存储对应的第二商品;所述第三处理模块,用于接收汇总指令,将存储的所述第一商品和所述第二商品发送至发出所述汇总指令的设备,所述发出所述汇总指令的设备是所述第一设备或所述第二设备。
在一个可选的实施例中,所述装置中涉及的所述第一商品和所述第二商品是属于相同购物应用的商品,所述汇总指令中包含所述第一商品和所述第二商品共同对应的所述购物应用的标识。
示意性的,本申请中的装置所实现的效果和方法所实现的效果相同,本处不再赘述。
请参见图13,图13是本申请一个示例性实施例提供的具有显示屏的设备的结构框图,如图13所示,该具有显示屏的设备包括处理器1320、存储器1340、通信组件1360和显示屏1380,所述存储器1340中存储有至少一条指令,所述指令由所述处理器1320加载并执行以实现如本申请各个方法实施例所述的跨设备的内容投屏方法。
处理器1320可以包括一个或者多个处理核心。处理器1320利用各种接口和线路连接整个具有显示屏的设备1300内的各个部分,通过运行或执行存储在存储器1340内的指令、程序、代码集或指令集,以及调用存储在存储器1340内的数据,执行具有显示屏的设备1300的各种功能和处理数据。可选的,处理器1320可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器1320可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics Processing Unit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作系统、用户界面和应用程序等;GPU用于负责显示屏所需要显示的内容的渲染和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器1320中,单独通过一块芯片进行实现。
存储器1340可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory,ROM)。可选的,该存储器1340包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器1340可用于存储指令、程序、代码、代码集或指令集。存储器1340可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作系统的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等;存储数据区可存储下面各个方法实施例中涉及到的数据等。
通信组件1360用于通过指定的通信协议与其它设备建立通信连接,通信连接包括WiFi、蓝牙、ZigBee以及其它通信协议,本申请实施例对通信协议不作限定。具有显示屏的设备1300的通信组件1360可以用于同时与多个设备建立通信连接。
显示屏1380用于显示经过处理器渲染后的图像。可选地,当具有显示屏的设备是电视等大屏显示设备时,该显示屏1380可以是大尺寸的电视屏幕。该电视屏幕可以是30寸、32寸、34寸、40寸、42寸、48寸、55寸、60寸、65寸或100寸等尺寸。在其它可能的实现方式中,若具有显示屏的设备是电脑显示器等设备,显示屏1380可以实现为18寸、20寸、22寸、24寸或者32寸等尺寸。
本申请实施例还提供了一种计算机可读介质,该计算机可读介质存储有至少一条指令,所述至少一条指令由所述处理器加载并执行以实现如上各个实施例所述的跨设备的内容投屏方法。
需要说明的是:上述实施例提供的跨设备的内容投屏装置在执行跨设备的内容投屏方法时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将设备的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的跨设备的内容投屏装置与跨设备的内容投屏方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。
以上所述仅为本申请的能够实现的示例性的实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。

Claims (20)

  1. 一种跨设备的内容投屏方法,其中,应用于具有显示屏的设备中,所述方法包括:
    接收第一设备发送的第一内容投屏请求,所述第一内容投屏请求是所述第一设备在执行预设交互操作后向所述具有显示屏的设备发送的请求;
    响应于所述第一内容投屏请求,播放第一内容,所述第一内容是所述第一设备中播放的内容;
    接收第二设备发送的第二内容投屏请求,所述第二内容投屏请求是所述第二设备在执行所述预设交互操作后向所述具有显示屏的设备发送的请求;
    响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
  2. 根据权利要求1所述的方法,
    所述预设交互操作包括扫描投屏标签,所述投屏标签是所述具有显示屏的设备对应的电子标签;
    或,
    所述预设交互操作包括拍摄预设手势;
    或,
    所述预设交互操作包括拍摄预设动作。
  3. 根据权利要求1或2所述的方法,所述接收第一设备发送的第一内容投屏请求之前,还包括:
    接收分屏指令;
    响应于所述分屏指令,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域;
    其中,所述第一显示区域用于显示所述第一内容,所述第二显示区域用于显示所述第二内容。
  4. 根据权利要求1或2所述的方法,所述响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,包括:
    响应于所述第二内容投屏请求,获取分屏信息;
    响应于所述分屏信息符合预设条件,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域;
    在所述第一显示区域中播放所述第一内容,并在所述第二显示区域中播放所述第二内容。
  5. 根据权利要求4所述的方法,所述响应于所述第二内容投屏请求,获取分屏信息,包括:
    响应于所述第二内容投屏请求,获取所述第一设备的投屏时刻和所述第二设备的投屏时刻之间的参考时长;
    所述响应于所述分屏信息符合预设条件,进入所述分屏模式,包括:
    响应于所述参考时长小于第一阈值,进入所述分屏模式。
  6. 根据权利要求4所述的方法,所述响应于所述第二内容投屏请求,获取分屏信息,包括:
    响应于所述第二内容投屏请求,获取所述第二设备的历史投屏信息,所述历史投屏信息包括所述第二设备成功向所述第一设备投屏的投屏次数或投屏累计时长中至少一种信息;
    所述响应于所述分屏信息符合预设条件,进入所述分屏模式,包括:
    响应于所述投屏次数大于或等于第二阈值,进入所述分屏模式;
    或,
    响应于所述投屏累计时长大于或等于第三阈值,进入所述分屏模式。
  7. 根据权利要求4所述的方法,所述响应于所述第二内容投屏请求,获取分屏信息,包括:
    响应于所述第二内容投屏请求,获取所述第一内容中的第一图像信息,并获取所述第二内容中的第二图像信息;
    所述响应于所述分屏信息符合预设条件,进入所述分屏模式,包括:
    响应于所述第一图像信息和所述第二图像信息之间的相似度大于或等于第四阈值,进入所述分屏模式。
  8. 根据权利要求4所述的方法,所述响应于所述第二内容投屏请求,获取分屏信息,包括:
    响应于所述第二内容投屏请求,获取所述第一内容对应的第一内容标识和所述第二内容对应的第二内容标识;
    所述响应于所述分屏信息符合预设条件,进入所述分屏模式,包括:
    响应于所述第一内容标识和所述第二内容标识匹配,进入所述分屏模式。
  9. 根据权利要求1或2所述的方法,在所述接收第二设备发送的第二内容投屏请求之后,所述方法还包括:
    响应于所述第二内容投屏请求,显示分屏按钮;
    响应于所述分屏按钮被触发,进入所述分屏模式,所述具有显示屏的设备的显示屏在所述分屏模式中至少包括第一显示区域和第二显示区域。
  10. 根据权利要求1或2所述的方法,所述方法还包括:
    响应于所述第一内容和/或所述第二内容中包括异常图像,记录所述异常图像和所述异常图像显示的时刻,所述异常图像所属的应用不属于白名单应用列表;
    将包括所述异常图像的内容突出显示,所述突出显示的方式包括高亮、显示预设标记或显示预设文本中至少一种。
  11. 根据权利要求10所述的方法,所述方法还包括:
    向出现所述异常图像的设备发送锁定信号,所述锁定信号用于指示所述出现所述异常图像的设备停止接收输入信号。
  12. 根据权利要求1或2所述的方法,在所述采用分屏模式播放所述第一内容和所述第二内容之后,所述方法还包括:
    接收局部区域信息,所述局部区域信息用于指示所述第一内容中的一个局部区域,或,所述第二内容中的一个局部区域;
    响应于所述局部区域信息,将所述局部区域信息指示的区域放大k倍,k大于1;
    在所述局部区域信息对应的显示区域中,显示放大k倍后的所述局部区域信息对应的区域;
    其中,当所述局部区域信息用于指示所述第一内容中的一个局部区域时,所述局部区域信息对应的显示区域是第一显示区域;当所述局部区域信息用于指示所述第二内容中的一个局部区域时,所述局部区域信息对应的显示区域是第二显示区域。
  13. 根据权利要求1所述的方法,所述方法还包括:
    对所述第一内容进行图像识别,得到与预设关键字匹配的第一文本,所述预设关键字是所述具有显示屏的设备中设置的关键字;
    对所述第二内容进行图像识别,得到与所述预设关键字匹配的第二文本;
    将所述第一文本和所述第二文本进行对比显示。
  14. 根据权利要求13所述的方法,所述方法还包括;
    接收所述第一设备发送的第一商品提取命令,所述第一商品提取命令用于提取所述第一内容中指定的商品;
    响应于第一对象提取命令,提取并存储对应的第一商品;
    接收所述第二设备发送的第二商品提取命令,所述第二商品提取命令用于提取所述第二内容中指定的商品;
    响应于所述第二商品提取命令,提取并存储对应的第二商品;
    接收汇总指令,将存储的所述第一商品和所述第二商品发送至发出所述汇总指令的设备,所述发出所述汇总指令的设备是所述第一设备或所述第二设备。
  15. 根据权利要求14所述的方法,所述第一商品和所述第二商品是属于相同购物应用的商品,所述汇总指令中包含所述第一商品和所述第二商品共同对应的所述购物应用的标识。
  16. 一种跨设备的内容投屏装置,其中,应用于具有显示屏的设备中,所述装置包括:
    第一接收模块,用于接收第一设备发送的第一内容投屏请求,所述第一内容投屏请求是所述第一设 备在执行预设交互操作后向所述具有显示屏的设备发送的请求;
    第一播放模块,用于响应于所述第一内容投屏请求,播放所述第一内容,所述第一内容是所述第一设备中播放的内容;
    第二接收模块,用于接收第二设备发送的第二内容投屏请求,所述第二内容投屏请求是所述第二设备在执行所述预设交互操作后向所述具有显示屏的设备发送的请求;
    第二播放模块,用于响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
  17. 一种电子设备,其中,所述设备包括处理器、和与所述处理器相连的存储器,以及存储在所述存储器上的程序指令,所述处理器执行所述程序指令时实现如权利要求1至15任一所述的跨设备的内容投屏方法。
  18. 一种计算机可读存储介质,所述存储介质中存储有程序指令,其中,所述程序指令被处理器执行时实现如权利要求1至15任一所述的跨设备的内容投屏方法。
  19. 一种跨设备的内容投屏系统,其中,所述系统包括具有显示屏的设备、第一设备、至少一个第二设备和遥控设备,所述遥控设备中包括投屏标签,且所述遥控设备用于遥控所述具有显示屏的设备;
    所述第一设备,用于扫描所述投屏标签中的信息;
    所述第一设备,用于在扫描所述投屏标签中的信息后向所述具有显示屏的设备发送第一内容投屏请求;
    所述具有显示屏的设备,用于接收所述第一内容投屏请求;
    所述具有显示屏的设备,用于响应于所述第一内容投屏请求,播放第一内容,所述第一内容是所述第一设备中播放的内容;
    所述第二设备,用于扫描所述投屏标签中的信息;
    所述第二设备,用于在扫描所述投屏标签中的信息后向所述具有显示屏的设备发送第二内容投屏请求;
    所述具有显示屏的设备,用于接收所述第二内容投屏请求;
    所述具有显示屏的设备,用于响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
  20. 一种跨设备的内容投屏系统,其中,所述系统包括具有显示屏的设备、第一设备和至少一个第二设备,所述第一设备包括第一图像采集组件,所述第二设备包括第二图像采集组件;
    所述第一设备,用于通过所述第一图像采集组件拍摄预设手势或预设动作;
    所述第一设备,用于在拍摄所述预设手势或所述预设动作后向所述具有显示屏的设备发送第一内容投屏请求;
    所述具有显示屏的设备,用于接收所述第一内容投屏请求;
    所述具有显示屏的设备,用于响应于所述第一内容投屏请求,播放第一内容,所述第一内容是所述第一设备中播放的内容;
    所述第二设备,用于通过所述第二图像采集组件拍摄所述预设手势或所述预设动作;
    所述第二设备,用于在拍摄所述预设手势或所述预设动作后向所述具有显示屏的设备发送第二内容投屏请求;
    所述具有显示屏的设备,用于接收所述第二内容投屏请求;
    所述具有显示屏的设备,用于响应于所述第二内容投屏请求,采用分屏模式播放所述第一内容和第二内容,所述第二内容是所述第二设备中播放的内容。
PCT/CN2021/118823 2020-11-20 2021-09-16 跨设备的内容投屏方法、装置、设备及存储介质 WO2022105403A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011311456.1A CN112306442B (zh) 2020-11-20 2020-11-20 跨设备的内容投屏方法、装置、设备及存储介质
CN202011311456.1 2020-11-20

Publications (1)

Publication Number Publication Date
WO2022105403A1 true WO2022105403A1 (zh) 2022-05-27

Family

ID=74335309

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/118823 WO2022105403A1 (zh) 2020-11-20 2021-09-16 跨设备的内容投屏方法、装置、设备及存储介质

Country Status (2)

Country Link
CN (1) CN112306442B (zh)
WO (1) WO2022105403A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116684456A (zh) * 2023-08-03 2023-09-01 云账户技术(天津)有限公司 一种大屏的可视化部署方法、装置、设备及介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112306442B (zh) * 2020-11-20 2023-05-12 Oppo广东移动通信有限公司 跨设备的内容投屏方法、装置、设备及存储介质
CN113190196B (zh) * 2021-04-27 2023-09-05 北京京东振世信息技术有限公司 多设备联动实现方法、装置、介质及电子设备
CN113010135B (zh) * 2021-04-29 2024-03-12 深圳Tcl新技术有限公司 一种数据处理方法、装置、显示终端和存储介质
CN113382293A (zh) * 2021-06-11 2021-09-10 北京字节跳动网络技术有限公司 内容显示的方法、装置、设备及计算机可读存储介质
CN113691850A (zh) * 2021-08-25 2021-11-23 深圳康佳电子科技有限公司 投屏控制方法、装置、智能终端及计算机可读存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103856809A (zh) * 2012-12-03 2014-06-11 中国移动通信集团公司 一种多点同屏方法、系统及终端设备
US20160198117A1 (en) * 2015-01-05 2016-07-07 Silicon Image, Inc. Displaying multiple videos on sink device using display information of source device
US20180192107A1 (en) * 2017-01-04 2018-07-05 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
CN109783181A (zh) * 2019-01-31 2019-05-21 掌阅科技股份有限公司 屏幕适配显示方法、电子设备及计算机存储介质
CN110381345A (zh) * 2019-07-05 2019-10-25 华为技术有限公司 一种投屏显示方法及电子设备
CN111131866A (zh) * 2019-11-25 2020-05-08 华为技术有限公司 一种投屏音视频播放方法及电子设备
CN112306442A (zh) * 2020-11-20 2021-02-02 Oppo广东移动通信有限公司 跨设备的内容投屏方法、装置、设备及存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9927923B2 (en) * 2013-11-19 2018-03-27 Hitachi Maxell, Ltd. Projection-type video display device
CN105487796A (zh) * 2015-11-25 2016-04-13 努比亚技术有限公司 一种分屏显示方法及终端
WO2018203595A1 (ko) * 2017-05-04 2018-11-08 임성현 터치 인터랙션이 가능한 프로젝터
CN111061445A (zh) * 2019-04-26 2020-04-24 华为技术有限公司 投屏方法和计算设备
CN111913628B (zh) * 2020-06-22 2022-05-06 维沃移动通信有限公司 分享方法、装置和电子设备

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103856809A (zh) * 2012-12-03 2014-06-11 中国移动通信集团公司 一种多点同屏方法、系统及终端设备
US20160198117A1 (en) * 2015-01-05 2016-07-07 Silicon Image, Inc. Displaying multiple videos on sink device using display information of source device
US20180192107A1 (en) * 2017-01-04 2018-07-05 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
CN109783181A (zh) * 2019-01-31 2019-05-21 掌阅科技股份有限公司 屏幕适配显示方法、电子设备及计算机存储介质
CN110381345A (zh) * 2019-07-05 2019-10-25 华为技术有限公司 一种投屏显示方法及电子设备
CN111131866A (zh) * 2019-11-25 2020-05-08 华为技术有限公司 一种投屏音视频播放方法及电子设备
CN112306442A (zh) * 2020-11-20 2021-02-02 Oppo广东移动通信有限公司 跨设备的内容投屏方法、装置、设备及存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116684456A (zh) * 2023-08-03 2023-09-01 云账户技术(天津)有限公司 一种大屏的可视化部署方法、装置、设备及介质
CN116684456B (zh) * 2023-08-03 2023-10-03 云账户技术(天津)有限公司 一种大屏的可视化部署方法、装置、设备及介质

Also Published As

Publication number Publication date
CN112306442A (zh) 2021-02-02
CN112306442B (zh) 2023-05-12

Similar Documents

Publication Publication Date Title
WO2022105403A1 (zh) 跨设备的内容投屏方法、装置、设备及存储介质
US11093046B2 (en) Sub-display designation for remote content source device
US11487423B2 (en) Sub-display input areas and hidden inputs
US11715444B2 (en) Notification handling in a user interface
RU2635238C1 (ru) Способ, устройство и терминал для воспроизведения музыки на основе фотоальбома с фотографиями лиц
US11880410B2 (en) Systems and methods for proactive information discovery with multiple senses
KR102330637B1 (ko) 증강현실 포토카드를 제공하는 시스템, 서버, 방법 및 그 기록매체
US20210185520A1 (en) Sub-display pairing
US20200013406A1 (en) Control method for human-computer interaction device, human-computer interaction device and human-computer interaction system
KR20110099991A (ko) 컬러센서를 이용한 휴대단말의 기능 제공 방법 및 장치
US11042222B1 (en) Sub-display designation and sharing
US10691717B2 (en) Method and apparatus for managing data
WO2024001956A1 (zh) 视频通话方法、装置、第一电子设备及第二电子设备
CN109246800B (zh) 一种无线连接的方法及设备
TWI595406B (zh) 顯示裝置及其傳遞訊息的方法
US11610044B2 (en) Dynamic management of content in an electronic presentation
KR102512709B1 (ko) 특정 장소의 컨텍스트 정보에 따른 인증을 위한 서버, 이의 제어 방법 및 전자 장치
KR20220064140A (ko) 증강현실 기반의 공연 콘텐츠 제공 방법 및 제공장치
JP2024043554A (ja) 姿見装置および姿見装置用のプログラム
CN105610686A (zh) 联系人分组方法及装置
KR20120101206A (ko) 영상정보 기반의 실시간 질의 응답 시스템 및 그 질의 방법
JP2023131635A (ja) 表示システム、表示方法、撮像装置、プログラム
TW201423434A (zh) 資訊學習系統及其方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21893554

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21893554

Country of ref document: EP

Kind code of ref document: A1